The Application of Operations Research Techniques to the Evaluation of Military Management Information Systems.

DTIC Science & Technology

systems such as management information systems . To provide a methodology yielding quantitative results which may assist a commander and his staff in...this analysis, it is proposed that management information systems be evaluated as a whole by a technique defined as the semantic differential. Each

The Training Information Management System. Volume 2. Phase 2 evaluation Report

DTIC Science & Technology

1986-07-01

The Training Information Management System (TIMS) is a computer-based system which can be used by Army personnel to collect and display training...but resides at a fixed location (e.g., the unit headquarters). This research note documents an evaluation of the Training Information Management System .

Adult Literacy Information and Evaluation System (ALIES): Background, Status and Future Directions.

ERIC Educational Resources Information Center

Cook, Jacqueline; And Others

This document describes the Adult Literacy Information and Evaluation System (ALIES), which is the management information system for New York City's citywide adult education program expansion effort begun in 1984. Chapter 1 describes the organization's creation in order to provide timely and reliable information to funders about the effects of the…

On Information Retrieval (IR) Systems: Revisiting Their Development, Evaluation Methodologies, and Assumptions (SIGs LAN, ED).

ERIC Educational Resources Information Center

Stirling, Keith

2000-01-01

Describes a session on information retrieval systems that planned to discuss relevance measures with Web-based information retrieval; retrieval system performance and evaluation; probabilistic independence of index terms; vector-based models; metalanguages and digital objects; how users assess the reliability, timeliness and bias of information;…

An Investigation of IBM’s Business Systems Planning (BSP) as a Suitable Methodology for Strategic Information Systems Planning for the Naval Reserve.

DTIC Science & Technology

1986-09-01

determine information systems (IS) needs. This thesis is limited to an evaluation of BSP as a :ethodology for understanding information flow in the Naval...external. The information systems of the organization are also evaluated in this chapter. The purpose of Chapter II is to familiarize the reader with...Wide Military Command and Control System (WWMCCS) .p *The general way in which the sources or end users of different categories of information are

Measuring value for money: a scoping review on economic evaluation of health information systems

PubMed Central

Bassi, Jesdeep; Lau, Francis

2013-01-01

Objective To explore how key components of economic evaluations have been included in evaluations of health information systems (HIS), to determine the state of knowledge on value for money for HIS, and provide guidance for future evaluations. Materials and methods We searched databases, previously collected papers, and references for relevant papers published from January 2000 to June 2012. For selection, papers had to: be a primary study; involve a computerized system for health information processing, decision support, or management reporting; and include an economic evaluation. Data on study design and economic evaluation methods were extracted and analyzed. Results Forty-two papers were selected and 33 were deemed high quality (scores ≥8/10) for further analysis. These included 12 economic analyses, five input cost analyses, and 16 cost-related outcome analyses. For HIS types, there were seven primary care electronic medical records, six computerized provider order entry systems, five medication management systems, five immunization information systems, four institutional information systems, three disease management systems, two clinical documentation systems, and one health information exchange network. In terms of value for money, 23 papers reported positive findings, eight were inconclusive, and two were negative. Conclusions We found a wide range of economic evaluation papers that were based on different assumptions, methods, and metrics. There is some evidence of value for money in selected healthcare organizations and HIS types. However, caution is needed when generalizing these findings. Better reporting of economic evaluation studies is needed to compare findings and build on the existing evidence base we identified. PMID:23416247

77 FR 46748 - Notice of Proposed Information Collection Requests; Institute of Education Sciences; Impact...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-06

... DEPARTMENT OF EDUCATION Notice of Proposed Information Collection Requests; Institute of Education Sciences; Impact Evaluation of Teacher and Leader Evaluation Systems SUMMARY: This study provides important implementation and impact information on the kinds of performance evaluation systems currently discussed in...

Design and evaluation of an onboard computer-based information system for aircraft

NASA Technical Reports Server (NTRS)

Rouse, S. H.; Rouse, W. B.; Hammer, J. M.

1982-01-01

Information seeking by human operators of technical systems is considered. Types of information and forms of presentation are discussed and important issues reviewed. This broad discussion provides a framework within which flight management is considered. The design of an onboard computer-based information system for aircraft is discussed. The aiding possibilities of a computer-based system are emphasized. Results of an experimental evaluation of a prototype system are presented. It is concluded that a computer-based information system can substantially lessen the frequency of human errors.

Increasing the Utility of Information Systems in Schools: Lessons from the Literature. Multilevel Evaluation Systems Project.

ERIC Educational Resources Information Center

Herman, Joan

The Multilevel Evaluation Systems Project is exploring the requirements for information systems that could help teachers and administrators sort through, analyze, and apply comprehensive information about their students, community, instructional processes, and outcomes to improve their schools. Toward this end, a multi-disciplinary literature…

Usability evaluation of Laboratory and Radiology Information Systems integrated into a hospital information system.

PubMed

Nabovati, Ehsan; Vakili-Arki, Hasan; Eslami, Saeid; Khajouei, Reza

2014-04-01

This study was conducted to evaluate the usability of widely used laboratory and radiology information systems. Three usability experts independently evaluated the user interfaces of Laboratory and Radiology Information Systems using heuristic evaluation method. They applied Nielsen's heuristics to identify and classify usability problems and Nielsen's severity rating to judge their severity. Overall, 116 unique heuristic violations were identified as usability problems. In terms of severity, 67 % of problems were rated as major and catastrophic. Among 10 heuristics, "consistency and standards" was violated most frequently. Moreover, mean severity of problems concerning "error prevention" and "help and documentation" heuristics was higher than of the others. Despite widespread use of specific healthcare information systems, they suffer from usability problems. Improving the usability of systems by following existing design standards and principles from the early phased of system development life cycle is recommended. Especially, it is recommended that the designers design systems that inhibit the initiation of erroneous actions and provide sufficient guidance to users.

The development and evaluation of a nursing information system for caring clinical in-patient.

PubMed

Fang, Yu-Wen; Li, Chih-Ping; Wang, Mei-Hua

2015-01-01

The research aimed to develop a nursing information system in order to simplify the admission procedure for caring clinical in-patient, enhance the efficiency of medical information documentation. Therefore, by correctly delivering patients’ health records, and providing continues care, patient safety and care quality would be effectively improved. The study method was to apply Spiral Model development system to compose a nursing information team. By using strategies of data collection, working environment observation, applying use-case modeling, and conferences of Joint Application Design (JAD) to complete the system requirement analysis and design. The Admission Care Management Information System (ACMIS) mainly included: (1) Admission nursing management information system. (2) Inter-shift meeting information management system. (3) The linkage of drug management system and physical examination record system. The framework contained qualitative and quantitative components that provided both formative and summative elements of the evaluation. System evaluation was to apply information success model, and developed questionnaire of consisting nurses’ acceptance and satisfaction. The results of questionnaires were users’ satisfaction, the perceived self-involvement, age and information quality were positively to personal and organizational effectiveness. According to the results of this study, the Admission Care Management Information System was practical to simplifying clinic working procedure and effective in communicating and documenting admission medical information.

ARTIMIS Telephone Travel Information Service : current use patterns and user satisfaction : evaluation of ARTIMIS Telephone Information System

DOT National Transportation Integrated Search

1999-06-01

This report summarizes the results of a phone survey that evaluated the user satisfaction of the telephone traveler information service, ARTIMIS (Advanced Regional Traffic Interactive Management and Information System), in Cincinnati / Northern Kentu...

Final evaluation report for the greater Yellowstone regional traveler and weather information system (GYRTWIS)

DOT National Transportation Integrated Search

2004-12-30

This final report describes the national evaluation of the Greater Yellowstone Regional Traveler and Weather Information System (GYRTWIS). This evaluation complements the ongoing GYRTWIS evaluation being conducted by WTI/MSU by investigating three ar...

Freight information real-time system for transport : evaluation final report

DOT National Transportation Integrated Search

2003-10-01

This report presents the findings of an independent evaluation of the Freight Information Real-time System for Transport (FIRST) intermodal freight Intelligent Transportation System (ITS) prototype system. FIRST is an Internet-based, real-time networ...

Test and Evaluation of the Navy Technical Information Presentation System (NTIPS) F-14A Field Test Results

DTIC Science & Technology

1988-09-01

Test and Evaluation Report Test and Evaluation of the Navy Technical Information Presentation System (NTIPS) F-14A Field Test Results by .0 Joseph J...PROGRAM PROJECT TASK WORK UNIT Washington, D.C. 20361 ELEMENT NO. NO. NO. ACCESSION NO. OMN 1820 11. TITLE (Include Security Classification) TEST AND...EVALUATION OF THE NAVY TECHNICAL INFORMATION PRESENTATION SYSTEM (NTIPS) F-14A FIELD TEST RESULTS 12. PERSONAL AUTHOR(S) Fuller, Joseph F. (DTRC) Post

'Televaluation' of clinical information systems: an integrative approach to assessing Web-based systems.

PubMed

Kushniruk, A W; Patel, C; Patel, V L; Cimino, J J

2001-04-01

The World Wide Web provides an unprecedented opportunity for widespread access to health-care applications by both patients and providers. The development of new methods for assessing the effectiveness and usability of these systems is becoming a critical issue. This paper describes the distance evaluation (i.e. 'televaluation') of emerging Web-based information technologies. In health informatics evaluation, there is a need for application of new ideas and methods from the fields of cognitive science and usability engineering. A framework is presented for conducting evaluations of health-care information technologies that integrates a number of methods, ranging from deployment of on-line questionnaires (and Web-based forms) to remote video-based usability testing of user interactions with clinical information systems. Examples illustrating application of these techniques are presented for the assessment of a patient clinical information system (PatCIS), as well as an evaluation of use of Web-based clinical guidelines. Issues in designing, prototyping and iteratively refining evaluation components are discussed, along with description of a 'virtual' usability laboratory.

Regional Information System for Educators: Installation and Evaluation.

ERIC Educational Resources Information Center

Kromer, Charles

This document describes the installation and evaluation of the Regional Information System within the Michigan-Ohio Regional Educational Laboratory (MOREL). MOREL is an agency established to develop and test alternatives to current educational practice under Title IV of ESEA. The Regional Information System was established to provide referrals to…

Evaluating Health Information Systems Using Ontologies.

PubMed

Eivazzadeh, Shahryar; Anderberg, Peter; Larsson, Tobias C; Fricker, Samuel A; Berglund, Johan

2016-06-16

There are several frameworks that attempt to address the challenges of evaluation of health information systems by offering models, methods, and guidelines about what to evaluate, how to evaluate, and how to report the evaluation results. Model-based evaluation frameworks usually suggest universally applicable evaluation aspects but do not consider case-specific aspects. On the other hand, evaluation frameworks that are case specific, by eliciting user requirements, limit their output to the evaluation aspects suggested by the users in the early phases of system development. In addition, these case-specific approaches extract different sets of evaluation aspects from each case, making it challenging to collectively compare, unify, or aggregate the evaluation of a set of heterogeneous health information systems. The aim of this paper is to find a method capable of suggesting evaluation aspects for a set of one or more health information systems-whether similar or heterogeneous-by organizing, unifying, and aggregating the quality attributes extracted from those systems and from an external evaluation framework. On the basis of the available literature in semantic networks and ontologies, a method (called Unified eValuation using Ontology; UVON) was developed that can organize, unify, and aggregate the quality attributes of several health information systems into a tree-style ontology structure. The method was extended to integrate its generated ontology with the evaluation aspects suggested by model-based evaluation frameworks. An approach was developed to extract evaluation aspects from the ontology that also considers evaluation case practicalities such as the maximum number of evaluation aspects to be measured or their required degree of specificity. The method was applied and tested in Future Internet Social and Technological Alignment Research (FI-STAR), a project of 7 cloud-based eHealth applications that were developed and deployed across European Union countries. The relevance of the evaluation aspects created by the UVON method for the FI-STAR project was validated by the corresponding stakeholders of each case. These evaluation aspects were extracted from a UVON-generated ontology structure that reflects both the internally declared required quality attributes in the 7 eHealth applications of the FI-STAR project and the evaluation aspects recommended by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. The extracted evaluation aspects were used to create questionnaires (for the corresponding patients and health professionals) to evaluate each individual case and the whole of the FI-STAR project. The UVON method can provide a relevant set of evaluation aspects for a heterogeneous set of health information systems by organizing, unifying, and aggregating the quality attributes through ontological structures. Those quality attributes can be either suggested by evaluation models or elicited from the stakeholders of those systems in the form of system requirements. The method continues to be systematic, context sensitive, and relevant across a heterogeneous set of health information systems.

GIS in Evaluation: Utilizing the Power of Geographic Information Systems to Represent Evaluation Data

ERIC Educational Resources Information Center

Azzam, Tarek; Robinson, David

2013-01-01

This article provides an introduction to geographic information systems (GIS) and how the technology can be used to enhance evaluation practice. As a tool, GIS enables evaluators to incorporate contextual features (such as accessibility of program sites or community health needs) into evaluation designs and highlights the interactions between…

Materials management information systems.

PubMed

1996-01-01

The hospital materials management function--ensuring that goods and services get from a source to an end user--encompasses many areas of the hospital and can significantly affect hospital costs. Performing this function in a manner that will keep costs down and ensure adequate cash flow requires effective management of a large amount of information from a variety of sources. To effectively coordinate such information, most hospitals have implemented some form of materials management information system (MMIS). These systems can be used to automate or facilitate functions such as purchasing, accounting, inventory management, and patient supply charges. In this study, we evaluated seven MMISs from seven vendors, focusing on the functional capabilities of each system and the quality of the service and support provided by the vendor. This Evaluation is intended to (1) assist hospitals purchasing an MMIS by educating materials managers about the capabilities, benefits, and limitations of MMISs and (2) educate clinical engineers and information system managers about the scope of materials management within a healthcare facility. Because software products cannot be evaluated in the same manner as most devices typically included in Health Devices Evaluations, our standard Evaluation protocol was not applicable for this technology. Instead, we based our ratings on our observations (e.g., during site visits), interviews we conducted with current users of each system, and information provided by the vendor (e.g., in response to a request for information [RFI]). We divided the Evaluation into the following sections: Section 1. Responsibilities and Information Requirements of Materials Management: Provides an overview of typical materials management functions and describes the capabilities, benefits, and limitations of MMISs. Also includes the supplementary article, "Inventory Cost and Reimbursement Issues" and the glossary, "Materials Management Terminology." Section 2. The MMIS Selection Process: Outlines steps to follow and describes factors to consider when selecting an MMIS. Also includes our Materials Management Process Evaluation and Needs Assessment Worksheet (which is also available online through ECRInet(TM)) and a list of suggested interview questions to be used when gathering user experience information for systems under consideration. Section 3A. MMIS Vendor Profiles: Presents information for the evaluated systems in a standardized, easy-to-compare format. Profiles include an Executive Summary describing our findings, a discussion of user comments, a listing of MMIS specifications, and information on the vendor's business background. Section 3B. Discussion of Vendor Profile Conclusions and Ratings: Presents our ratings and summarizes our rationale for all evaluated systems. Also includes a blank Vendor Profile Template to be used when gathering information on other vendors and systems. We found that, in general, all of the evaluated systems are able to meet most of the functional needs of a materials management department. However, we did uncover significant differences in the quality of service and support provided by each vendor, and our ratings reflect these differences: we rated two of the systems Acceptable--Preferred and four of the systems Acceptable. We have not yet rated the seventh system because our user experience information may not reflect the vendor's new ownership and management. When this vendor provides the references we requested, we will interview users and supply a rating. We caution readers against basing purchasing decisions solely on our ratings. Each hospital must consider the unique needs of its users and its overall strategic plans--a process that can be aided by using our Process Evaluation and Needs Assessment Worksheet. Our conclusions can then be used to narrow down the number of vendors under consideration...

Methods for evaluating information in managing the enterprise on the basis of a hybrid three-tier system

NASA Astrophysics Data System (ADS)

Vasil'ev, V. A.; Dobrynina, N. V.

2017-01-01

The article presents data on the influence of information upon the functioning of complex systems in the process of ensuring their effective management. Ways and methods for evaluating multidimensional information that reduce time and resources, improve the validity of the studied system management decisions, were proposed.

Analysis of a document/reporting system

NASA Technical Reports Server (NTRS)

Narrow, B.

1971-01-01

An in-depth analysis of the information system within the Data Processing Branch is presented. Quantitative measures are used to evaluate the efficiency and effectiveness of the information system. It is believed that this is the first documented study which utilizes quantitative measures for full scale system analysis. The quantitative measures and techniques for collecting and qualifying the basic data, as described, are applicable to any information system. Therefore this report is considered to be of interest to any persons concerned with the management design, analysis or evaluation of information systems.

Evaluating Health Information Systems Using Ontologies

PubMed Central

Anderberg, Peter; Larsson, Tobias C; Fricker, Samuel A; Berglund, Johan

2016-01-01

Background There are several frameworks that attempt to address the challenges of evaluation of health information systems by offering models, methods, and guidelines about what to evaluate, how to evaluate, and how to report the evaluation results. Model-based evaluation frameworks usually suggest universally applicable evaluation aspects but do not consider case-specific aspects. On the other hand, evaluation frameworks that are case specific, by eliciting user requirements, limit their output to the evaluation aspects suggested by the users in the early phases of system development. In addition, these case-specific approaches extract different sets of evaluation aspects from each case, making it challenging to collectively compare, unify, or aggregate the evaluation of a set of heterogeneous health information systems. Objectives The aim of this paper is to find a method capable of suggesting evaluation aspects for a set of one or more health information systems—whether similar or heterogeneous—by organizing, unifying, and aggregating the quality attributes extracted from those systems and from an external evaluation framework. Methods On the basis of the available literature in semantic networks and ontologies, a method (called Unified eValuation using Ontology; UVON) was developed that can organize, unify, and aggregate the quality attributes of several health information systems into a tree-style ontology structure. The method was extended to integrate its generated ontology with the evaluation aspects suggested by model-based evaluation frameworks. An approach was developed to extract evaluation aspects from the ontology that also considers evaluation case practicalities such as the maximum number of evaluation aspects to be measured or their required degree of specificity. The method was applied and tested in Future Internet Social and Technological Alignment Research (FI-STAR), a project of 7 cloud-based eHealth applications that were developed and deployed across European Union countries. Results The relevance of the evaluation aspects created by the UVON method for the FI-STAR project was validated by the corresponding stakeholders of each case. These evaluation aspects were extracted from a UVON-generated ontology structure that reflects both the internally declared required quality attributes in the 7 eHealth applications of the FI-STAR project and the evaluation aspects recommended by the Model for ASsessment of Telemedicine applications (MAST) evaluation framework. The extracted evaluation aspects were used to create questionnaires (for the corresponding patients and health professionals) to evaluate each individual case and the whole of the FI-STAR project. Conclusions The UVON method can provide a relevant set of evaluation aspects for a heterogeneous set of health information systems by organizing, unifying, and aggregating the quality attributes through ontological structures. Those quality attributes can be either suggested by evaluation models or elicited from the stakeholders of those systems in the form of system requirements. The method continues to be systematic, context sensitive, and relevant across a heterogeneous set of health information systems. PMID:27311735

Evaluation of the Idaho Transportation Department integrated road-weather information system

DOT National Transportation Integrated Search

2005-02-02

This report presents the results of FHWA's evaluation of the Idaho Transportation Department's (ITD) integration of its Road-Weather Information System (RWIS). The ITD RWIS project was selected for evaluation because it held significant potential to ...

Marketing in Admissions: The Information System Approach.

ERIC Educational Resources Information Center

Wofford, O. Douglas; Timmerman, Ed

1982-01-01

A marketing information system approach for college admissions is outlined that includes objectives, information needs and sources, a data collection format, and information evaluation. Coordination with other institutional information systems is recommended. (MSE)

[Development and clinical evaluation of an anesthesia information management system].

PubMed

Feng, Jing-yi; Chen, Hua; Zhu, Sheng-mei

2010-09-21

To study the design, implementation and clinical evaluation of an anesthesia information management system. To record, process and store peri-operative patient data automatically, all kinds of bedside monitoring equipments are connected into the system based on information integrating technology; after a statistical analysis of those patient data by data mining technology, patient status can be evaluated automatically based on risk prediction standard and decision support system, and then anesthetist could perform reasonable and safe clinical processes; with clinical processes electronically recorded, standard record tables could be generated, and clinical workflow is optimized, as well. With the system, kinds of patient data could be collected, stored, analyzed and archived, kinds of anesthesia documents could be generated, and patient status could be evaluated to support clinic decision. The anesthesia information management system is useful for improving anesthesia quality, decreasing risk of patient and clinician, and aiding to provide clinical proof.

Evaluating the success of an emergency response medical information system.

PubMed

Petter, Stacie; Fruhling, Ann

2011-07-01

STATPack™ is an information system used to aid in the diagnosis of pathogens in hospitals and state public health laboratories. STATPack™ is used as a communication and telemedicine diagnosis tool during emergencies. This paper explores the success of this emergency response medical information system (ERMIS) using a well-known framework of information systems success developed by DeLone and McLean. Using an online survey, the entire population of STATPack™ users evaluated the success of the information system by considering system quality, information quality, system use, intention to use, user satisfaction, individual impact, and organizational impact. The results indicate that the overall quality of this ERMIS (i.e., system quality, information quality, and service quality) has a positive impact on both user satisfaction and intention to use the system. However, given the nature of ERMIS, overall quality does not necessarily predict use of the system. Moreover, the user's satisfaction with the information system positively affected the intention to use the system. User satisfaction, intention to use, and system use had a positive influence on the system's impact on the individual. Finally, the organizational impacts of the system were positively influenced by use of the system and the system's individual impact on the user. The results of the study demonstrate how to evaluate the success of an ERMIS as well as introduce potential changes in how one applies the DeLone and McLean success model in an emergency response medical information system context. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation.

PubMed

Atashi, Alireza; Khajouei, Reza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Three trained usability evaluators independently evaluated the system using Nielsen's 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to "Consistency and standards" heuristic (25%) and the lowest related to "Flexibility and efficiency of use" (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users' and patients' time, increase errors and finally threaten patient's safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation.

User Interface Problems of a Nationwide Inpatient Information System: A Heuristic Evaluation

PubMed Central

Atashi, Alireza; Azizi, Amirabbas; Dadashi, Ali

2016-01-01

Summary Introduction While studies have shown that usability evaluation could uncover many design problems of health information systems, the usability of health information systems in developing countries using their native language is poorly studied. The objective of this study was to evaluate the usability of a nationwide inpatient information system used in many academic hospitals in Iran. Material and Methods Three trained usability evaluators independently evaluated the system using Nielsen’s 10 usability heuristics. The evaluators combined identified problems in a single list and independently rated the severity of the problems. We statistically compared the number and severity of problems identified by HIS experienced and non-experienced evaluators. Results A total of 158 usability problems were identified. After removing duplications 99 unique problems were left. The highest mismatch with usability principles was related to “Consistency and standards” heuristic (25%) and the lowest related to “Flexibility and efficiency of use” (4%). The average severity of problems ranged from 2.4 (Major problem) to 3.3 (Catastrophe problem). The experienced evaluator with HIS identified significantly more problems and gave higher severities to problems (p<0.02). Discussion Heuristic Evaluation identified a high number of usability problems in a widely used inpatient information system in many academic hospitals. These problems, if remain unsolved, may waste users’ and patients’ time, increase errors and finally threaten patient’s safety. Many of them can be fixed with simple redesign solutions such as using clear labels and better layouts. This study suggests conducting further studies to confirm the findings concerning effect of evaluator experience on the results of Heuristic Evaluation. PMID:27081409

48 CFR 873.112 - Evaluation information.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 48 Federal Acquisition Regulations System 5 2014-10-01 2014-10-01 false Evaluation information... Evaluation information. (a) Without regard to FAR 15.304 (except for 15.304(c)(1) and (c)(3), which do apply to acquisitions under this authority), the criteria, factors, or other evaluation information that...

Evaluation criteria for the district health management information systems: lessons from the Ministry of Health, Kenya.

PubMed

Odhiambo-Otieno, George W; Odero, Wilson W O

2005-03-01

The District Health Management Information Systems (DHMISs) were established by the Ministry of Health (MoH) in Kenya more than two decades ago. Since then, no comprehensive evaluation has been undertaken. This can partly be attributed to lack of defined criteria for evaluating them. To propose evaluation criteria for assessing the design, implementation and impact of DHMIS in the management of the District Health System (DHS) in Kenya. A descriptive cross-sectional study conducted in three DHSs in Kenya: Bungoma, Murang'a and Uasin Gishu districts. Data was collected through focus group discussions, key informant interviews, and documents' review. The respondents, purposely selected from the Ministry of Health headquarters and the three DHS districts, included designers, managers and end-users of the systems. A set of evaluation criteria for DHMISs was identified for each of the three phases of implementation: pre-implementation evaluation criteria (categorised as policy and objectives, technical feasibility, financial viability, political viability and administrative operability) to be applied at the design stage; concurrent implementation evaluation criteria to be applied during implementation of the new system; and post-implementation evaluation criteria (classified as internal - quality of information; external - resources and managerial support; ultimate - systems impact) to be applied after implementation of the system for at least three years. In designing a DHMIS model there is need to have built-in these three sets of evaluation criteria which should be used in a phased manner. Pre-implementation evaluation criteria should be used to evaluate the system's viability before more resources are committed to it; concurrent (operational) - implementation evaluation criteria should be used to monitor the process; and post-implementation evaluation criteria should be applied to assess the system's effectiveness.

Evaluation plan : national advanced rural transportation systems : field operational tests of traveler information services in tourism areas : executive summary

DOT National Transportation Integrated Search

1998-07-01

This evaluation addresses technical challenges of developing advanced traveler information systems (ATIS) in rural environments, institutional benefits and issues, usefulness of the information to the traveling public, effectiveness of various media ...

Geographic Information Systems (GIS) as an Evaluation Tool.

ERIC Educational Resources Information Center

Renger, Ralph; Cimetta, Adriana; Pettygrove, Sydney; Rogan, Seumas

2002-01-01

Describes how Geographic Information Systems (GIS) can be used to help evaluators convey complex information simply through a spatial representation. Demonstrates how GIS can be used to plot change over time, including impact and outcome data gathered by primary data collection. (SLD)

A multi-method approach to evaluate health information systems.

PubMed

Yu, Ping

2010-01-01

Systematic evaluation of the introduction and impact of health information systems (HIS) is a challenging task. As the implementation is a dynamic process, with diverse issues emerge at various stages of system introduction, it is challenge to weigh the contribution of various factors and differentiate the critical ones. A conceptual framework will be helpful in guiding the evaluation effort; otherwise data collection may not be comprehensive and accurate. This may again lead to inadequate interpretation of the phenomena under study. Based on comprehensive literature research and own practice of evaluating health information systems, the author proposes a multimethod approach that incorporates both quantitative and qualitative measurement and centered around DeLone and McLean Information System Success Model. This approach aims to quantify the performance of HIS and its impact, and provide comprehensive and accurate explanations about the casual relationships of the different factors. This approach will provide decision makers with accurate and actionable information for improving the performance of the introduced HIS.

Evaluation of the Computerized Assessment System for Psychotherapy Evaluation and Research (CASPER) as a Measure of Treatment Effectiveness with Psychiatric Inpatients

ERIC Educational Resources Information Center

Kinnaman, Joanna E. Strong; Farrell, Albert D.; Bisconer, Sarah W.

2006-01-01

Assessment procedures to evaluate inpatient treatment effectiveness can provide information to inform clinical practice. The Computerized Assessment System for Psychotherapy Evaluation and Research (CASPER) represents a standardized approach to assess patients' target problems that combines elements of individualized and nomothetic approaches.…

Participatory Design, User Involvement and Health IT Evaluation.

PubMed

Kushniruk, Andre; Nøhr, Christian

2016-01-01

End user involvement and input into the design and evaluation of information systems has been recognized as being a critical success factor in the adoption of information systems. Nowhere is this need more critical than in the design of health information systems. Consistent with evidence from the general software engineering literature, the degree of user input into design of complex systems has been identified as one of the most important factors in the success or failure of complex information systems. The participatory approach goes beyond user-centered design and co-operative design approaches to include end users as more active participants in design ideas and decision making. Proponents of participatory approaches argue for greater end user participation in both design and evaluative processes. Evidence regarding the effectiveness of increased user involvement in design is explored in this contribution in the context of health IT. The contribution will discuss several approaches to including users in design and evaluation. Challenges in IT evaluation during participatory design will be described and explored along with several case studies.

How can systems engineering inform the methods of programme evaluation in health professions education?

PubMed

Rojas, David; Grierson, Lawrence; Mylopoulos, Maria; Trbovich, Patricia; Bagli, Darius; Brydges, Ryan

2018-04-01

We evaluate programmes in health professions education (HPE) to determine their effectiveness and value. Programme evaluation has evolved from use of reductionist frameworks to those addressing the complex interactions between programme factors. Researchers in HPE have recently suggested a 'holistic programme evaluation' aiming to better describe and understand the implications of 'emergent processes and outcomes'. We propose a programme evaluation framework informed by principles and tools from systems engineering. Systems engineers conceptualise complexity and emergent elements in unique ways that may complement and extend contemporary programme evaluations in HPE. We demonstrate how the abstract decomposition space (ADS), an engineering knowledge elicitation tool, provides the foundation for a systems engineering informed programme evaluation designed to capture both planned and emergent programme elements. We translate the ADS tool to use education-oriented language, and describe how evaluators can use it to create a programme-specific ADS through iterative refinement. We provide a conceptualisation of emergent elements and an equation that evaluators can use to identify the emergent elements in their programme. Using our framework, evaluators can analyse programmes not as isolated units with planned processes and planned outcomes, but as unfolding, complex interactive systems that will exhibit emergent processes and emergent outcomes. Subsequent analysis of these emergent elements will inform the evaluator as they seek to optimise and improve the programme. Our proposed systems engineering informed programme evaluation framework provides principles and tools for analysing the implications of planned and emergent elements, as well as their potential interactions. We acknowledge that our framework is preliminary and will require application and constant refinement. We suggest that our framework will also advance our understanding of the construct of 'emergence' in HPE research. © 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.

Motivational Differences in Seeking Out Evaluative Categorization Information.

PubMed

Smallman, Rachel; Becker, Brittney

2017-07-01

Previous research shows that people draw finer evaluative distinctions when rating liked versus disliked objects (e.g., wanting a 5-point scale to evaluate liked cuisines and a 3-point scale to rate disliked cuisines). Known as the preference-categorization effect, this pattern may exist not only in how individuals form evaluative distinctions but also in how individuals seek out evaluative information. The current research presents three experiments that examine motivational differences in evaluative information seeking (rating scales and attributes). Experiment 1 found that freedom of choice (the ability to avoid undesirable stimuli) and sensitivity to punishment (as measured by the Behavior Inhibition System/Behavioral Approach System [BIS/BAS] scale) influenced preferences for desirable and undesirable evaluative information in a health-related decision. Experiment 2 examined choice optimization, finding that maximizers prefer finer evaluative information for both liked and disliked options in a consumer task. Experiment 3 found that this pattern generalizes to another type of evaluative categorization, attributes.

Applying usability methods to identify health literacy issues: an example using a Personal Health Record.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

The prevalence of consumer health information systems is increasing. However, usability and health literacy impact both the value and adoption of these systems. Health literacy and usability are closely related in that systems may not be used accurately if users cannot understand the information therein. Thus, it is imperative to focus on mitigating the demands on health literacy in consumer health information systems. This study modified two usability evaluation methods (heuristic evaluation and usability testing) to incorporate the identification of potential health literacy issues in a Personal Health Record (PHR). Heuristic evaluation is an analysis of a system performed by a usability specialist who evaluates how well the system abides by usability principles. In contrast, a usability test involves a post hoc analysis of a representative user interacting with the system. These two methods revealed several health literacy issues and suggestions to ameliorate them were made. Thus, it was demonstrated that usability methods could be successfully augmented for the purpose of investigating health literacy issues. To improve users' health knowledge, the adoption of consumer health information systems, and the accuracy of the information contained therein, it is encouraged that usability methods be applied with an added focus on health literacy.

Evaluation on the Occupational Information Access System as Used at Churchill High School. A Project Report.

ERIC Educational Resources Information Center

McKinlay, Bruce; Adams, Daniel

The Occupational Information Access System (OIAS) improves the accessibility of occupational labor market information for career planning. Its operation at Churchill High School is evaluated from several angels: the likes and dislikes of users; the effect of OIAS on users' knowledge of occupational information and on their career plans; why other…

Technical Literature Review Concerning Management Information Systems.

DTIC Science & Technology

interrelationships of the many aspects of management information systems (MIS); that is, with how analysis, design, operation, evaluation, and user considerations affect management information systems . (Author)

Enhancement of computer system for applications software branch

NASA Technical Reports Server (NTRS)

Bykat, Alex

1987-01-01

Presented is a compilation of the history of a two-month project concerned with a survey, evaluation, and specification of a new computer system for the Applications Software Branch of the Software and Data Management Division of Information and Electronic Systems Laboratory of Marshall Space Flight Center, NASA. Information gathering consisted of discussions and surveys of branch activities, evaluation of computer manufacturer literature, and presentations by vendors. Information gathering was followed by evaluation of their systems. The criteria of the latter were: the (tentative) architecture selected for the new system, type of network architecture supported, software tools, and to some extent the price. The information received from the vendors, as well as additional research, lead to detailed design of a suitable system. This design included considerations of hardware and software environments as well as personnel issues such as training. Design of the system culminated in a recommendation for a new computing system for the Branch.

75 FR 9279 - Proposed Information Collection (Survey of Satisfaction With the Disability Evaluation System...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-01

... DEPARTMENT OF VETERANS AFFAIRS [OMB Control No. 2900-New (DES)] Proposed Information Collection (Survey of Satisfaction With the Disability Evaluation System (DES)) Activity: Comment Request AGENCY... use of other forms of information technology. Title: Survey of Satisfaction with the Disability...

Evaluation and Information in the Field of Technical Aids for Disabled Persons: An European Perspective. Monograph Number Thirty-Five.

ERIC Educational Resources Information Center

Pedotti, Antonio, Ed.; Andrich, Renzo, Ed.

The monograph provides information on evaluation of technical aids, wheelchairs, and computerized information systems for disabled persons. The first chapter provides a general overview of actions of the European Community concerning technical aids evaluation, information on the "Concerted Action" program called "Evaluation of…

DEVELOPMENT OF A SYSTEM FOR AN EDUCATIONAL PRODUCTS INFORMATION EXCHANGE. FINAL REPORT.

ERIC Educational Resources Information Center

KOMOSKI, P. KENNETH

THIS STUDY WAS UNDERTAKEN TO DESIGN AN EASILY ACCESSIBLE NATIONWIDE SYSTEM FOR EXCHANGING DESCRIPTIVE, EVALUATIVE PRODUCT INFORMATION AMONG ALL SECTORS OF THE EDUCATIONAL COMMUNITY ON A COOPERATIVE COST-SHARING BASIS. THE FEASIBILITY OF SUCH A COLLECTION AND EXCHANGE OF DESCRIPTIVE AND EVALUATIVE INFORMATION ABOUT INSTRUCTIONAL MATERIALS SYSTEMS…

Evaluation of the Occupational Training Information System (OTIS). Final Report.

ERIC Educational Resources Information Center

Macro Systems, Inc., Silver Spring, MD.

The Occupational Training Information System (OTIS), which is in operation in Oklahoma and in a developmental stage in Kentucky, was evaluated. The principle objective of OTIS is to provide the information necessary to formulate educational, manpower, and economic development plans and policies. OTIS consists primarily of a manpower demand…

78 FR 48863 - Agency Information Collection Activities; Comment Request; Evaluation of the Early Warning and...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-12

... DEPARTMENT OF EDUCATION [Docket No.: ED-2013-ICCD-0106] Agency Information Collection Activities; Comment Request; Evaluation of the Early Warning and Intervention Monitoring System AGENCY: Institute of... Intervention Monitoring System. OMB Control Number: 1850-NEW. Type of Review: A new information collection...

75 FR 14449 - Statement of Organization, Functions, and Delegations of Authority

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-25

... and procedures, and provides direction, planning and evaluation for information technology systems and... development, monitoring and evaluation of public health capabilities, plans, infrastructure and systems to... and maintains a real-time management information system to monitor projects funded by the State and...

Comparison of two heuristic evaluation methods for evaluating the usability of health information systems.

PubMed

Khajouei, Reza; Hajesmaeel Gohari, Sadrieh; Mirzaee, Moghaddameh

2018-04-01

In addition to following the usual Heuristic Evaluation (HE) method, the usability of health information systems can also be evaluated using a checklist. The objective of this study is to compare the performance of these two methods in identifying usability problems of health information systems. Eight evaluators independently evaluated different parts of a Medical Records Information System using two methods of HE (usual and with a checklist). The two methods were compared in terms of the number of problems identified, problem type, and the severity of identified problems. In all, 192 usability problems were identified by two methods in the Medical Records Information System. This was significantly higher than the number of usability problems identified by the checklist and usual method (148 and 92, respectively) (p < 0.0001). After removing the duplicates, the difference between the number of unique usability problems identified by the checklist method (n = 100) and usual method (n = 44) was significant (p < 0.0001). Differences between the mean severity of the real usability problems (1.83) and those identified by only one of the methods (usual = 2.05, checklist = 1.74) were significant (p = 0.001). This study revealed the potential of the two HE methods for identifying usability problems of health information systems. The results demonstrated that the checklist method had significantly better performance in terms of the number of identified usability problems; however, the performance of the usual method for identifying problems of higher severity was significantly better. Although the checklist method can be more efficient for less experienced evaluators, wherever usability is critical, the checklist should be used with caution in usability evaluations. Copyright © 2018 Elsevier Inc. All rights reserved.

A Wireless Sensor Network-Based Portable Vehicle Detector Evaluation System

PubMed Central

Yoo, Seong-eun

2013-01-01

In an upcoming smart transportation environment, performance evaluations of existing Vehicle Detection Systems are crucial to maintain their accuracy. The existing evaluation method for Vehicle Detection Systems is based on a wired Vehicle Detection System reference and a video recorder, which must be operated and analyzed by capable traffic experts. However, this conventional evaluation system has many disadvantages. It is inconvenient to deploy, the evaluation takes a long time, and it lacks scalability and objectivity. To improve the evaluation procedure, this paper proposes a Portable Vehicle Detector Evaluation System based on wireless sensor networks. We describe both the architecture and design of a Vehicle Detector Evaluation System and the implementation results, focusing on the wireless sensor networks and methods for traffic information measurement. With the help of wireless sensor networks and automated analysis, our Vehicle Detector Evaluation System can evaluate a Vehicle Detection System conveniently and objectively. The extensive evaluations of our Vehicle Detector Evaluation System show that it can measure the traffic information such as volume counts and speed with over 98% accuracy. PMID:23344388

A wireless sensor network-based portable vehicle detector evaluation system.

PubMed

Yoo, Seong-eun

2013-01-17

In an upcoming smart transportation environment, performance evaluations of existing Vehicle Detection Systems are crucial to maintain their accuracy. The existing evaluation method for Vehicle Detection Systems is based on a wired Vehicle Detection System reference and a video recorder, which must be operated and analyzed by capable traffic experts. However, this conventional evaluation system has many disadvantages. It is inconvenient to deploy, the evaluation takes a long time, and it lacks scalability and objectivity. To improve the evaluation procedure, this paper proposes a Portable Vehicle Detector Evaluation System based on wireless sensor networks. We describe both the architecture and design of a Vehicle Detector Evaluation System and the implementation results, focusing on the wireless sensor networks and methods for traffic information measurement. With the help of wireless sensor networks and automated analysis, our Vehicle Detector Evaluation System can evaluate a Vehicle Detection System conveniently and objectively. The extensive evaluations of our Vehicle Detector Evaluation System show that it can measure the traffic information such as volume counts and speed with over 98% accuracy.

Information system success model for customer relationship management system in health promotion centers.

PubMed

Choi, Wona; Rho, Mi Jung; Park, Jiyun; Kim, Kwang-Jum; Kwon, Young Dae; Choi, In Young

2013-06-01

Intensified competitiveness in the healthcare industry has increased the number of healthcare centers and propelled the introduction of customer relationship management (CRM) systems to meet diverse customer demands. This study aimed to develop the information system success model of the CRM system by investigating previously proposed indicators within the model. THE EVALUATION AREAS OF THE CRM SYSTEM INCLUDES THREE AREAS: the system characteristics area (system quality, information quality, and service quality), the user area (perceived usefulness and user satisfaction), and the performance area (personal performance and organizational performance). Detailed evaluation criteria of the three areas were developed, and its validity was verified by a survey administered to CRM system users in 13 nationwide health promotion centers. The survey data were analyzed by the structural equation modeling method, and the results confirmed that the model is feasible. Information quality and service quality showed a statistically significant relationship with perceived usefulness and user satisfaction. Consequently, the perceived usefulness and user satisfaction had significant influence on individual performance as well as an indirect influence on organizational performance. This study extends the research area on information success from general information systems to CRM systems in health promotion centers applying a previous information success model. This lays a foundation for evaluating health promotion center systems and provides a useful guide for successful implementation of hospital CRM systems.

Information System Success Model for Customer Relationship Management System in Health Promotion Centers

PubMed Central

Choi, Wona; Rho, Mi Jung; Park, Jiyun; Kim, Kwang-Jum; Kwon, Young Dae

2013-01-01

Objectives Intensified competitiveness in the healthcare industry has increased the number of healthcare centers and propelled the introduction of customer relationship management (CRM) systems to meet diverse customer demands. This study aimed to develop the information system success model of the CRM system by investigating previously proposed indicators within the model. Methods The evaluation areas of the CRM system includes three areas: the system characteristics area (system quality, information quality, and service quality), the user area (perceived usefulness and user satisfaction), and the performance area (personal performance and organizational performance). Detailed evaluation criteria of the three areas were developed, and its validity was verified by a survey administered to CRM system users in 13 nationwide health promotion centers. The survey data were analyzed by the structural equation modeling method, and the results confirmed that the model is feasible. Results Information quality and service quality showed a statistically significant relationship with perceived usefulness and user satisfaction. Consequently, the perceived usefulness and user satisfaction had significant influence on individual performance as well as an indirect influence on organizational performance. Conclusions This study extends the research area on information success from general information systems to CRM systems in health promotion centers applying a previous information success model. This lays a foundation for evaluating health promotion center systems and provides a useful guide for successful implementation of hospital CRM systems. PMID:23882416

Evaluation criteria for district health management information systems: lessons from the Ministry of Health, Kenya.

PubMed

Odhiambo-Otieno, George W

2005-01-01

There has been no comprehensive evaluation of the district health management information systems (DHMISs) since the establishment of these systems by the Ministry of Health (MoH), in Kenya. This is partly due to lack of defined criteria for evaluating the systems. The objective of this study is to design evaluation criteria for assessing the viability, sustainability and ultimate contribution of DHMIS in the management of the district health system (DHS) in Kenya. This descriptive cross-sectional study was undertaken in three DHSs in Kenya. Empirical evidence was collected through interviews, complemented by a comprehensive review of relevant literature, reports and operational manuals of various health information systems in Kenya. A set of evaluation criteria for DHMISs in Kenya was designed for each of the three phases of implementation: phase one-pre-implementation evaluation criteria (categorized as policy and objectives, technical feasibility, financial viability, political viability and administrative operability) to be applied at the design stage; phase two-concurrent (operational) implementation evaluation criteria to be applied during implementation of the new system; phase three-post-implementation evaluation criteria (classified as internal-quality of information; external-resources and managerial support; ultimate-systems impact) to be applied after operating the implemented system for at least 3 years. In designing a DHMIS model there is need to have built-in these three sets of evaluation criteria which should be used in a phased manner. Pre-implementation evaluation criteria should be used to evaluate the system's viability before more resources are committed to its implementation; concurrent (operational) implementation evaluation criteria should be used to ascertain the status of the on-going implementation with the view to either fine-tune or abandon it altogether before more resources are used on it; and post-implementation evaluation criteria should be used to assess its overall effectiveness (if it has achieved its hypothesized benefits) towards the management of DHS.

Development and Evaluation of Disaster Information Management System Using Digital Pens and Tabletop User Interfaces

NASA Astrophysics Data System (ADS)

Fukada, Hidemi; Kobayashi, Kazue; Satou, Kenji; Kawana, Hideyuki; Masuda, Tomohiro

Most traditional disaster information systems are necessary to post expert staff with high computer literacy to operate the system quickly and correctly in the tense situation when a disaster occurs. However, in the current disaster response system of local governments, it is not easy for local governments to post such expert staff because they are struggling with staff cuts due to administrative and fiscal reform. In this research, we propose a disaster information management system that can be easily operated, even under the disorderly conditions of a disaster, by municipal personnel in charge of disaster management. This system achieves usability enabling easy input of damage information, even by local government staff with no expertise, by using a digital pen and tabletop user interface. Evaluation was conducted by prospective users using a prototype, and the evaluation results are satisfactory with regard to the function and operationality of the proposed system.

Resolution of Probabilistic Weather Forecasts with Application in Disease Management.

PubMed

Hughes, G; McRoberts, N; Burnett, F J

2017-02-01

Predictive systems in disease management often incorporate weather data among the disease risk factors, and sometimes this comes in the form of forecast weather data rather than observed weather data. In such cases, it is useful to have an evaluation of the operational weather forecast, in addition to the evaluation of the disease forecasts provided by the predictive system. Typically, weather forecasts and disease forecasts are evaluated using different methodologies. However, the information theoretic quantity expected mutual information provides a basis for evaluating both kinds of forecast. Expected mutual information is an appropriate metric for the average performance of a predictive system over a set of forecasts. Both relative entropy (a divergence, measuring information gain) and specific information (an entropy difference, measuring change in uncertainty) provide a basis for the assessment of individual forecasts.

Federal Family Education Loan Information System. Weak Computer Controls Increase Risk of Unauthorized Access to Sensitive Data. Report to the Secretary of Education.

ERIC Educational Resources Information Center

General Accounting Office, Washington, DC. Accounting and Information Management Div.

This report presents an evaluation of the general controls over the Federal Family Education Loan Program (FFELP) information system maintained and operated by a contractor for the U.S. Department of Education (ED), which administers FFELP. The evaluation found that ED's general controls over the FFELP information system did not adequately protect…

Supply of genetic information--amount, format, and frequency.

PubMed

Misztal, I; Lawlor, T J

1999-05-01

The volume and complexity of genetic information is increasing because of new traits and better models. New traits may include reproduction, health, and carcass. More comprehensive models include the test day model in dairy cattle or a growth model in beef cattle. More complex models, which may include nonadditive effects such as inbreeding and dominance, also provide additional information. The amount of information per animal may increase drastically if DNA marker typing becomes routine and quantitative trait loci information is utilized. In many industries, evaluations are run more frequently. They result in faster genetic progress and improved management and marketing opportunities but also in extra costs and information overload. Adopting new technology and making some organizational changes can help realize all the added benefits of the improvements to the genetic evaluation systems at an acceptable cost. Continuous genetic evaluation, in which new records are accepted and breeding values are updated continuously, will relieve time pressures. An online mating system with access to both genetic and marketing information can result in mating recommendations customized for each user. Such a system could utilize inbreeding and dominance information that cannot efficiently be accommodated in the current sire summaries or off-line mating programs. The new systems will require a new organizational approach in which the task of scientists and technicians will not be simply running the evaluations but also providing the research, design, supervision, and maintenance required in the entire system of evaluation, decision making, and distribution.

[Development of performance evaluation and management system on advanced schistosomiasis medical treatment].

PubMed

Zhou, Xiao-Rong; Huang, Shui-Sheng; Gong, Xin-Guo; Cen, Li-Ping; Zhang, Cong; Zhu, Hong; Yang, Jun-Jing; Chen, Li

2012-04-01

To construct a performance evaluation and management system on advanced schistosomiasis medical treatment, and analyze and evaluate the work of the advanced schistosomiasis medical treatment over the years. By applying the database management technique and C++ programming technique, we inputted the information of the advanced schistosomiasis cases into the system, and comprehensively evaluated the work of the advanced schistosomiasis medical treatment through the cost-effect analysis, cost-effectiveness analysis, and cost-benefit analysis. We made a set of software formula about cost-effect analysis, cost-effectiveness analysis, and cost-benefit analysis. This system had many features such as clear building, easy to operate, friendly surface, convenient information input and information search. It could benefit the performance evaluation of the province's advanced schistosomiasis medical treatment work. This system can satisfy the current needs of advanced schistosomiasis medical treatment work and can be easy to be widely used.

Earth Sciences Data and Information System (ESDIS) program planning and evaluation methodology development

NASA Technical Reports Server (NTRS)

Dickinson, William B.

1995-01-01

An Earth Sciences Data and Information System (ESDIS) Project Management Plan (PMP) is prepared. An ESDIS Project Systems Engineering Management Plan (SEMP) consistent with the developed PMP is also prepared. ESDIS and related EOS program requirements developments, management and analysis processes are evaluated. Opportunities to improve the effectiveness of these processes and program/project responsiveness to requirements are identified. Overall ESDIS cost estimation processes are evaluated, and recommendations to improve cost estimating and modeling techniques are developed. ESDIS schedules and scheduling tools are evaluated. Risk assessment, risk mitigation strategies and approaches, and use of risk information in management decision-making are addressed.

Surfing for health: user evaluation of a health information website. Part one: Background and literature review.

PubMed

Williams, Peter; Nicholas, David; Huntington, Paul; McLean, Fiona

2002-06-01

The Government in Britain is set on using the Internet to expand the provision of health information to the general public. Concerns over the quality of the health information have preoccupied commentators and organizations rather than the way users interact with health information systems. This report examines the issues surrounding the provision of electronic health information, and describes an evaluation undertaken of a commercial health website-that of Surgerydoor (http://www.surgerydoor.co.uk/), and comprises two parts. Part one outlines the literature on electronic health information evaluation. It discusses quality issues, but also redresses the imbalance by exploring other evaluative perspectives. Part two describes an evaluation of a health information Internet site in terms of its usability and appeal, undertaken as part of a Department of Health funded study on the impact of such systems.

An information system to improve financial management, resource allocation and activity planning: evaluation results.

PubMed

Ruland, C M; Ravn, I H

2001-01-01

An important strategy for improving resource management and cost containment in health care is to develop information systems that assist hospital managers in financial management, resource allocation, and activity planning. A crucial part of such development is a rigorous evaluation to assess whether the system accomplishes it's intended goals. To evaluate CLASSICA, a Decision Support System (DSS), that assists nurse managers in financial management, resource allocation, staffing, and activity planning. Using a pre-post test design with control units, CLASSICA was evaluated in four test units. Baseline data and simultaneous parallel measures were collected prior to system implementation at test sites and control units. Using expense reports, staffing and financial statistics, surveys, interviews with nurse managers, and logs as data sources, CLASSICA was evaluated on: cost reduction, quality of management information; usefulness as decision support for improved financial management and decision-making; user satisfaction; and ease of use. Evaluation results showed a 41% reduction in expenditures for overtime and extra hours as compared to a 1.8% reduction in control units during the same time period. Users reported a significant improvement in management information; nurse managers stated that they had gained control over costs. The system helped them analyze the relationships between patient activity staffing, and cost of care. Users reported high satisfaction with the system, the information and decision support it provided, and its ease of use. These results suggest that CLASSICA is a DSS that successfully assists nurse managers in cost effective management of their units.

Evaluating Nurses' Satisfaction With Two Nursing Information Systems.

PubMed

Khajouei, Reza; Abbasi, Reza

2017-06-01

Evaluating user satisfaction is one of the methods to ensure the usability of information systems. Considering the importance of nursing information systems in patient health, the objective of this study is to evaluate nurses' satisfaction with two widely used nursing information systems (Peyvand Dadeh and Tirazhe) in Iran. This descriptive-analytical study was done on 230 nurses in all teaching hospitals of Kerman University of Medical Sciences in 2015. Data were collected using an augmented version of a questionnaire developed by IBM. Data were analyzed by SPSS.16 using descriptive and analytical statistical methods including t test, analysis of variance, and Pearson correlation coefficient. The mean of overall satisfaction with the two systems was 61 ± 2.2 and 74 ± 2.4, respectively. The mean of satisfaction with different systems dimensions, that is, ease of use, information quality, and interface quality, was, respectively, 24 ± 1.9, 26 ± 9.7, and 12 ± 4.7 for Tirazhe and 29 ± 1.1, 39 ± 1.04 and 13 ± 5.3 for Peyvand Dadeh system. Nurses' satisfaction with both systems was at a medium level. The majority of nurses were relatively satisfied with the information quality and user interface quality of these systems. The results suggest that designing nursing information systems in accordance with their users' need improves usability. Hence, policy and decision makers of healthcare institutions should invest on usability when purchasing such systems.

Basic Concepts Required in the Development of a Planning Information System.

ERIC Educational Resources Information Center

Kennedy, F. D.

This report, the result of developmental research on a planning information system for North Carolina, describes the planning process at higher levels of State government, defines a general information system and derives a planning information system from various types of planning, provides guidelines for system design and evaluation, and…

Integrated System of Structural Health Monitoring and Intelligent Management for a Cable-Stayed Bridge

PubMed Central

Chen, Bin; Wang, Xu; Sun, Dezhang; Xie, Xu

2014-01-01

It is essential to construct structural health monitoring systems for large important bridges. Zhijiang Bridge is a cable-stayed bridge that was built recently over the Hangzhou Qiantang River (the largest river in Zhejiang Province). The length of Zhijiang Bridge is 478 m, which comprises an arched twin-tower space and a twin-cable plane structure. As an example, the present study describes the integrated system of structural health monitoring and intelligent management for Zhijiang Bridge, which comprises an information acquisition system, data management system, evaluation and decision-making system, and application service system. The monitoring components include the working environment of the bridge and various factors that affect bridge safety, such as the stress and strain of the main bridge structure, vibration, cable force, temperature, and wind speed. In addition, the integrated system includes a forecasting and decision-making module for real-time online evaluation, which provides warnings and makes decisions based on the monitoring information. From this, the monitoring information, evaluation results, maintenance decisions, and warning information can be input simultaneously into the bridge monitoring center and traffic emergency center to share the monitoring data, thereby facilitating evaluations and decision making using the system. PMID:25140342

Integrated system of structural health monitoring and intelligent management for a cable-stayed bridge.

PubMed

Chen, Bin; Wang, Xu; Sun, Dezhang; Xie, Xu

2014-01-01

It is essential to construct structural health monitoring systems for large important bridges. Zhijiang Bridge is a cable-stayed bridge that was built recently over the Hangzhou Qiantang River (the largest river in Zhejiang Province). The length of Zhijiang Bridge is 478 m, which comprises an arched twin-tower space and a twin-cable plane structure. As an example, the present study describes the integrated system of structural health monitoring and intelligent management for Zhijiang Bridge, which comprises an information acquisition system, data management system, evaluation and decision-making system, and application service system. The monitoring components include the working environment of the bridge and various factors that affect bridge safety, such as the stress and strain of the main bridge structure, vibration, cable force, temperature, and wind speed. In addition, the integrated system includes a forecasting and decision-making module for real-time online evaluation, which provides warnings and makes decisions based on the monitoring information. From this, the monitoring information, evaluation results, maintenance decisions, and warning information can be input simultaneously into the bridge monitoring center and traffic emergency center to share the monitoring data, thereby facilitating evaluations and decision making using the system.

Evaluating new health information technologies: expanding the frontiers of health care delivery and health promotion.

PubMed

Kreps, Gary L

2002-01-01

The modern health care system is being irrevocably changed by the development and introduction of new health information technologies (such as health information systems, decision-support tools, specialized websites, and innovative communication devices). While many of these new technologies hold the promise of revolutionizing the modern health system and facilitating improvements in health care delivery, health education, and health promotion, it is imperative to carefully examine and assess the effectiveness of these technological tools to determine which products are most useful to apply in specific contexts, as well as to learn how to best utilize these products and processes. Without good evaluative information about new technologies, we are unlikely to reap the greatest benefits from these powerful new tools. This chapter examines the demand for evaluating health information technologies and suggests several strategies for conducting rigorous and relevant evaluation research.

[Relations between health information systems and patient safety].

PubMed

Nøhr, Christian

2012-11-05

Health information systems have the potential to reduce medical errors, and indeed many studies have shown a significant reduction. However, if the systems are not designed and implemented properly, there is evidence that suggest that new types of errors will arise--i.e., technology-induced errors. Health information systems will need to undergo a more rigorous evaluation. Usability evaluation and simulation test with humans in the loop can help to detect and prevent technology-induced errors before they are deployed in real health-care settings.

Automation for deep space vehicle monitoring

NASA Technical Reports Server (NTRS)

Schwuttke, Ursula M.

1991-01-01

Information on automation for deep space vehicle monitoring is given in viewgraph form. Information is given on automation goals and strategy; the Monitor Analyzer of Real-time Voyager Engineering Link (MARVEL); intelligent input data management; decision theory for making tradeoffs; dynamic tradeoff evaluation; evaluation of anomaly detection results; evaluation of data management methods; system level analysis with cooperating expert systems; the distributed architecture of multiple expert systems; and event driven response.

Information data systems for a global change technology initiative architecture trade study

NASA Technical Reports Server (NTRS)

Murray, Nicholas D.

1991-01-01

The Global Change Technology Initiative (GCTI) was established to develop technology which will enable use of satellite systems of Earth observations on a global scale, enable use of the observations to predictively model Earth's changes, and provide scientists, government, business, and industry with quick access to the resulting information. At LaRC, a GCTI Architecture Trade Study was undertaken to develop and evaluate the architectural implications to meet the requirements of the global change studies and the eventual implementation of a global change system. The output of the trade study are recommended technologies for the GCTI. That portion of the study concerned with the information data system is documented. The information data system for an earth global change modeling system can be very extensive and beyond affordability in terms of today's costs. Therefore, an incremental approach to gaining a system is most likely. An options approach to levels of capability versus needed technologies was developed. The primary drivers of the requirements for the information data system evaluation were the needed science products, the science measurements, the spacecraft orbits, the instruments configurations, and the spacecraft configurations and their attendant architectures. The science products requirements were not studied here; however, some consideration of the product needs were included in the evaluation results. The information data system technology items were identified from the viewpoint of the desirable overall information system characteristics.

Building Capacity for Trauma-Informed Care in the Child Welfare System: Initial Results of a Statewide Implementation.

PubMed

Lang, Jason M; Campbell, Kimberly; Shanley, Paul; Crusto, Cindy A; Connell, Christian M

2016-05-01

Exposure to childhood trauma is a major public health concern and is especially prevalent among children in the child welfare system (CWS). State and tribal CWSs are increasingly focusing efforts on identifying and serving children exposed to trauma through the creation of trauma-informed systems. This evaluation of a statewide initiative in Connecticut describes the strategies used to create a trauma-informed CWS, including workforce development, trauma screening, policy change, and improved access to evidence-based trauma-focused treatments during the initial 2-year implementation period. Changes in system readiness and capacity to deliver trauma-informed care were evaluated using stratified random samples of child welfare staff who completed a comprehensive assessment prior to (N = 223) and 2 years following implementation (N = 231). Results indicated significant improvements in trauma-informed knowledge, practice, and collaboration across nearly all child welfare domains assessed, suggesting system-wide improvements in readiness and capacity to provide trauma-informed care. Variability across domains was observed, and frontline staff reported greater improvements than supervisors/managers in some domains. Lessons learned and recommendations for implementation and evaluation of trauma-informed care in child welfare and other child-serving systems are discussed. © The Author(s) 2016.

Towards an evaluation framework for information quality management (IQM) practices for health information systems--evaluation criteria for effective IQM practices.

PubMed

Mohammed, Siti Asma; Yusof, Maryati Mohd

2013-04-01

Poor information quality (IQ) must be understood as a business problem rather than systems problem. In health care organization, what is required is an effective quality management that continuously manages and reviews the factors influencing IQ in health information systems (HIS) so as to achieve the desired outcomes. Hence, in order to understand the issues of information quality management (IQM) practices in health care organizations, a more holistic evaluation study should be undertaken to investigate the IQM practices in health care organizations. It is the aim of this paper to identify the significant evaluation criteria that influence the production of good IQ in HIS. Six selected frameworks and best practices both from health informatics and information systems literature have been reviewed to identify the evaluation criteria from the perspective of human, organizational and technological factors. From the review, it was found that human and organization factors are of greater significance in influencing HIS IQ. Our review depicts that there is still shortage in finding a comprehensive IQM evaluation framework. Thus, the criteria from the frameworks reviewed can be used in combination for more comprehensive evaluation criteria. Integrated IQM evaluation criteria for HIS are then proposed in this study. Poor IQ is the result of complex interdependency within sociotechnical factors in health care organization and lack of formal and structured IQM practices. Thus, a feedback mechanism such as evaluation is needed to understand the issues in depth in the future. © 2012 Blackwell Publishing Ltd.

A CIS (Clinical Information System) Quality Evaluation Tool for Nursing Care Services

ERIC Educational Resources Information Center

Lee, Seon Ah

2010-01-01

The purpose of this study was to develop a tool to evaluate the quality of a clinical information system (CIS) conceived by nurses and conduct a pilot test with the developed tool as an initial assessment. CIS quality is required for successful implementation in information technology (IT) environments. The study started with the realization that…

Evaluating true BCI communication rate through mutual information and language models.

PubMed

Speier, William; Arnold, Corey; Pouratian, Nader

2013-01-01

Brain-computer interface (BCI) systems are a promising means for restoring communication to patients suffering from "locked-in" syndrome. Research to improve system performance primarily focuses on means to overcome the low signal to noise ratio of electroencephalogric (EEG) recordings. However, the literature and methods are difficult to compare due to the array of evaluation metrics and assumptions underlying them, including that: 1) all characters are equally probable, 2) character selection is memoryless, and 3) errors occur completely at random. The standardization of evaluation metrics that more accurately reflect the amount of information contained in BCI language output is critical to make progress. We present a mutual information-based metric that incorporates prior information and a model of systematic errors. The parameters of a system used in one study were re-optimized, showing that the metric used in optimization significantly affects the parameter values chosen and the resulting system performance. The results of 11 BCI communication studies were then evaluated using different metrics, including those previously used in BCI literature and the newly advocated metric. Six studies' results varied based on the metric used for evaluation and the proposed metric produced results that differed from those originally published in two of the studies. Standardizing metrics to accurately reflect the rate of information transmission is critical to properly evaluate and compare BCI communication systems and advance the field in an unbiased manner.

CRL/Brandeis: Description of the DIDEROT System as Used for MUC-5

DTIC Science & Technology

1993-01-01

been evaluated in the 4th Message Understanding Conference (MUC-4 ) where it was required to extract information from 200 texts on South American...Email : jamesp@cs.brandeis .edu Abstract This report describes the major developments over the last six months in completing th e Diderot information ...extraction system for the MUC-5 evaluation . Diderot is an information extraction system built at CRL and Brandeis University over th e past two

The Development of an Automated Data Base for Program Research and Evaluation in Continuing Education.

ERIC Educational Resources Information Center

Taylor, William H.

The System for Program Information in Continuing Education (SPICE), an information system being implemented at The University of Calgary (Alberta, Canada), was designed to facilitate the collection, manipulation, and reporting of evaluative data from continuing education program participants. The objectives of the system include the following: to…

A literature review for large-scale health information system project planning, implementation and evaluation.

PubMed

Sligo, Judith; Gauld, Robin; Roberts, Vaughan; Villa, Luis

2017-01-01

Information technology is perceived as a potential panacea for healthcare organisations to manage pressure to improve services in the face of increased demand. However, the implementation and evaluation of health information systems (HIS) is plagued with problems and implementation shortcomings and failures are rife. HIS implementation is complex and relies on organisational, structural, technological, and human factors to be successful. It also requires reflective, nuanced, multidimensional evaluation to provide ongoing feedback to ensure success. This article provides a comprehensive review of the literature about evaluating and implementing HIS, detailing the challenges and recommendations for both evaluators and healthcare organisations. The factors that inhibit or promote successful HIS implementation are identified and effective evaluation strategies are described with the goal of informing teams evaluating complex HIS. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Design and Establishment of Quality Model of Fundamental Geographic Information Database

NASA Astrophysics Data System (ADS)

Ma, W.; Zhang, J.; Zhao, Y.; Zhang, P.; Dang, Y.; Zhao, T.

2018-04-01

In order to make the quality evaluation for the Fundamental Geographic Information Databases(FGIDB) more comprehensive, objective and accurate, this paper studies and establishes a quality model of FGIDB, which formed by the standardization of database construction and quality control, the conformity of data set quality and the functionality of database management system, and also designs the overall principles, contents and methods of the quality evaluation for FGIDB, providing the basis and reference for carry out quality control and quality evaluation for FGIDB. This paper designs the quality elements, evaluation items and properties of the Fundamental Geographic Information Database gradually based on the quality model framework. Connected organically, these quality elements and evaluation items constitute the quality model of the Fundamental Geographic Information Database. This model is the foundation for the quality demand stipulation and quality evaluation of the Fundamental Geographic Information Database, and is of great significance on the quality assurance in the design and development stage, the demand formulation in the testing evaluation stage, and the standard system construction for quality evaluation technology of the Fundamental Geographic Information Database.

FIRES: Fire Information Retrieval and Evaluation System - A program for fire danger rating analysis

Treesearch

Patricia L. Andrews; Larry S. Bradshaw

1997-01-01

A computer program, FIRES: Fire Information Retrieval and Evaluation System, provides methods for evaluating the performance of fire danger rating indexes. The relationship between fire danger indexes and historical fire occurrence and size is examined through logistic regression and percentiles. Historical seasonal trends of fire danger and fire occurrence can be...

School District Evaluation: Database Warehouse Support.

ERIC Educational Resources Information Center

Adcock, Eugene P.; Haseltine, Reginald

The Prince George's County (Maryland) school system has developed a database warehouse system as an evaluation data support tool for fulfilling the system's information demands. This paper described the Research and Evaluation Assimilation Database (READ) warehouse support system and considers the requirements for data used in evaluation and how…

Knowledge-Based Information Retrieval.

ERIC Educational Resources Information Center

Ford, Nigel

1991-01-01

Discussion of information retrieval focuses on theoretical and empirical advances in knowledge-based information retrieval. Topics discussed include the use of natural language for queries; the use of expert systems; intelligent tutoring systems; user modeling; the need for evaluation of system effectiveness; and examples of systems, including…

Rebooting Kirkpatrick: Integrating Information System Theory Into the Evaluation of Web-based Continuing Professional Development Interventions for Interprofessional Education.

PubMed

Shen, Nelson; Yufe, Shira; Saadatfard, Omid; Sockalingam, Sanjeev; Wiljer, David

2017-01-01

Information system research has stressed the importance of theory in understanding how user perceptions can motivate the use and adoption of technology such as web-based continuing professional development programs for interprofessional education (WCPD-IPE). A systematic review was conducted to provide an information system perspective on the current state of WCPD-IPE program evaluation and how current evaluations capture essential theoretical constructs in promoting technology adoption. Six databases were searched to identify studies evaluating WCPD-IPE. Three investigators determined eligibility of the articles. Evaluation items extracted from the studies were assessed using the Kirkpatrick-Barr framework and mapped to the Benefits Evaluation Framework. Thirty-seven eligible studies yielded 362 evaluation items for analysis. Most items (n = 252) were assessed as Kirkpatrick-Barr level 1 (reaction) and were mainly focused on the quality (information, service, and quality) and satisfaction dimensions of the Benefits Evaluation. System quality was the least evaluated quality dimension, accounting for 26 items across 13 studies. WCPD-IPE use was reported in 17 studies and its antecedent factors were evaluated in varying degrees of comprehensiveness. Although user reactions were commonly evaluated, greater focus on user perceptions of system quality (ie, functionality and performance), usefulness, and usability of the web-based platform is required. Surprisingly, WCPD-IPE use was reported in less than half of the studies. This is problematic as use is a prerequisite to realizing any individual, organizational, or societal benefit of WCPD-IPE. This review proposes an integrated framework which accounts for these factors and provides a theoretically grounded guide for future evaluations.

I.C.I.S. Inter-Campus Information System.

ERIC Educational Resources Information Center

Alvir, Howard P.

A decision making system for educators to enable them to plan and make information-based decisions is briefly described. The information system's characteristics are explained, along with a summary of information systems in higher education. A self-test criteria of effectiveness and feedback and evaluation methods are also included. A request form…

A Management Information System Model for Program Management. Ph.D. Thesis - Oklahoma State Univ.; [Computerized Systems Analysis

NASA Technical Reports Server (NTRS)

Shipman, D. L.

1972-01-01

The development of a model to simulate the information system of a program management type of organization is reported. The model statistically determines the following parameters: type of messages, destinations, delivery durations, type processing, processing durations, communication channels, outgoing messages, and priorites. The total management information system of the program management organization is considered, including formal and informal information flows and both facilities and equipment. The model is written in General Purpose System Simulation 2 computer programming language for use on the Univac 1108, Executive 8 computer. The model is simulated on a daily basis and collects queue and resource utilization statistics for each decision point. The statistics are then used by management to evaluate proposed resource allocations, to evaluate proposed changes to the system, and to identify potential problem areas. The model employs both empirical and theoretical distributions which are adjusted to simulate the information flow being studied.

Career Information Systems: Guidelines and Considerations for Agencies Assisting the Economically Disadvantaged, Unemployed or Underemployed. Second Edition, Revised.

ERIC Educational Resources Information Center

Hartz, John; Lambert, Roger

Developed to aid agencies assisting the economically disadvantaged, unemployed, or underemployed in selecting good career information and the most useful career/occupational information systems, these guidelines present basic background on and criteria for evaluating career information and the systems which deliver the information. Preliminary…

A usability evaluation toolkit for In-Vehicle Information Systems (IVISs).

PubMed

Harvey, Catherine; Stanton, Neville A; Pickering, Carl A; McDonald, Mike; Zheng, Pengjun

2011-05-01

Usability must be defined specifically for the context of use of the particular system under investigation. This specific context of use should also be used to guide the definition of specific usability criteria and the selection of appropriate evaluation methods. There are four principles which can guide the selection of evaluation methods, relating to the information required in the evaluation, the stage at which to apply methods, the resources required and the people involved in the evaluation. This paper presents a framework for the evaluation of usability in the context of In-Vehicle Information Systems (IVISs). This framework guides designers through defining usability criteria for an evaluation, selecting appropriate evaluation methods and applying those methods. These stages form an iterative process of design-evaluation-redesign with the overall aim of improving the usability of IVISs and enhancing the driving experience, without compromising the safety of the driver. Copyright © 2010 Elsevier Ltd and The Ergonomics Society. All rights reserved.

The state agency experience (evaluation/selection of hardware for automated, geo-based information systems)

NASA Technical Reports Server (NTRS)

Campbell, L. F., Jr.

1981-01-01

The purpose and format of a panel session that addressed the procedures by which the hardware components of geographic information systems are evaluated and selected are described. State agencies from Alaska, Colorado, Montana, and Washington were represented and the topic was discussed within the general context of information requirements in land management decision making.

Flight Projects Office Information Systems Testbed (FIST)

NASA Technical Reports Server (NTRS)

Liggett, Patricia

1991-01-01

Viewgraphs on the Flight Projects Office Information Systems Testbed (FIST) are presented. The goal is to perform technology evaluation and prototyping of information systems to support SFOC and JPL flight projects in order to reduce risk in the development of operational data systems for such projects.

Cost and results of information systems for health and poverty indicators in the United Republic of Tanzania.

PubMed Central

Rommelmann, Vanessa; Setel, Philip W.; Hemed, Yusuf; Angeles, Gustavo; Mponezya, Hamisi; Whiting, David; Boerma, Ties

2005-01-01

OBJECTIVE: To examine the costs of complementary information generation activities in a resource-constrained setting and compare the costs and outputs of information subsystems that generate the statistics on poverty, health and survival required for monitoring, evaluation and reporting on health programmes in the United Republic of Tanzania. METHODS: Nine systems used by four government agencies or ministries were assessed. Costs were calculated from budgets and expenditure data made available by information system managers. System coverage, quality assurance and information production were reviewed using questionnaires and interviews. Information production was characterized in terms of 38 key sociodemographic indicators required for national programme monitoring. FINDINGS: In 2002-03 approximately US$ 0.53 was spent per Tanzanian citizen on the nine information subsystems that generated information on 37 of the 38 selected indicators. The census and reporting system for routine health service statistics had the largest participating populations and highest total costs. Nationally representative household surveys and demographic surveillance systems (which are not based on nationally representative samples) produced more than half the indicators and used the most rigorous quality assurance. Five systems produced fewer than 13 indicators and had comparatively high costs per participant. CONCLUSION: Policy-makers and programme planners should be aware of the many trade-offs with respect to system costs, coverage, production, representativeness and quality control when making investment choices for monitoring and evaluation. In future, formal cost-effectiveness studies of complementary information systems would help guide investments in the monitoring, evaluation and planning needed to demonstrate the impact of poverty-reduction and health programmes. PMID:16184275

Evaluating Monitoring Systems in the European Social Fund Context: A Sociotechnical Approach

ERIC Educational Resources Information Center

Iannacci, Federico; Cornford, Tony; Cordella, Antonio; Grillo, Francesco

2009-01-01

In contrast to the prevailing image of monitoring systems as technical systems, it is proposed that they should rather be conceived of as social endeavors at exchanging information. Drawing on the monitoring and evaluation framework of Cornford, Doukidis, and Forster, the concept of information agreement is suggested as a way of assessing the…

User-Based Information Retrieval System Interface Evaluation: An Examination of an On-Line Public Access Catalog.

ERIC Educational Resources Information Center

Hert, Carol A.; Nilan, Michael S.

1991-01-01

Presents preliminary data that characterizes the relationship between what users say they are trying to accomplish when using an online public access catalog (OPAC) and their perceptions of what input to give the system. Human-machine interaction is discussed, and appropriate methods for evaluating information retrieval systems are considered. (18…

Context-aware recommender system based on ontology for recommending tourist destinations at Bandung

NASA Astrophysics Data System (ADS)

Rizaldy Hafid Arigi, L.; Abdurahman Baizal, Z. K.; Herdiani, Anisa

2018-03-01

Recommender System is software that is able to provide personalized recommendation suits users’ needs. Recommender System has been widely implemented in various domains, including tourism. One approach that can be done for more personalized recommendations is the use of contextual information. This paper proposes a context aware recommender based ontology system in the tourism domain. The system is capable of recommending tourist destinations by using user preferences of the categories of tourism and contextual information such as user locations, weather around tourist destinations and close time of destination. Based on the evaluation, the system has accuracy of of 0.94 (item recommendation precision evaluated by expert) and 0.58 (implicitly from system-end user interaction). Based on the evaluation of user satisfaction, the system provides a satisfaction level of more than 0.7 (scale 0 to 1) for speed factors for providing liked recommendations (PE), informative description of recommendations (INF) and user trust (TR).

An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit).

PubMed

Yusof, Maryati Mohd; Kuljis, Jasna; Papazafeiropoulou, Anastasia; Stergioulas, Lampros K

2008-06-01

The realization of Health Information Systems (HIS) requires rigorous evaluation that addresses technology, human and organization issues. Our review indicates that current evaluation methods evaluate different aspects of HIS and they can be improved upon. A new evaluation framework, human, organization and technology-fit (HOT-fit) was developed after having conducted a critical appraisal of the findings of existing HIS evaluation studies. HOT-fit builds on previous models of IS evaluation--in particular, the IS Success Model and the IT-Organization Fit Model. This paper introduces the new framework for HIS evaluation that incorporates comprehensive dimensions and measures of HIS and provides a technological, human and organizational fit. Literature review on HIS and IS evaluation studies and pilot testing of developed framework. The framework was used to evaluate a Fundus Imaging System (FIS) of a primary care organization in the UK. The case study was conducted through observation, interview and document analysis. The main findings show that having the right user attitude and skills base together with good leadership, IT-friendly environment and good communication can have positive influence on the system adoption. Comprehensive, specific evaluation factors, dimensions and measures in the new framework (HOT-fit) are applicable in HIS evaluation. The use of such a framework is argued to be useful not only for comprehensive evaluation of the particular FIS system under investigation, but potentially also for any Health Information System in general.

48 CFR 873.112 - Evaluation information.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 48 Federal Acquisition Regulations System 5 2013-10-01 2013-10-01 false Evaluation information... DEPARTMENT SUPPLEMENTARY REGULATIONS SIMPLIFIED ACQUISITION PROCEDURES FOR HEALTH-CARE RESOURCES 873.112 Evaluation information. (a) Without regard to FAR 15.304 (except for 15.304(c)(1) and (c)(3), which do apply...

48 CFR 873.112 - Evaluation information.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 5 2010-10-01 2010-10-01 false Evaluation information... DEPARTMENT SUPPLEMENTARY REGULATIONS SIMPLIFIED ACQUISITION PROCEDURES FOR HEALTH-CARE RESOURCES 873.112 Evaluation information. (a) Without regard to FAR 15.304 (except for 15.304(c)(1) and (c)(3), which do apply...

48 CFR 873.112 - Evaluation information.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 5 2011-10-01 2011-10-01 false Evaluation information... DEPARTMENT SUPPLEMENTARY REGULATIONS SIMPLIFIED ACQUISITION PROCEDURES FOR HEALTH-CARE RESOURCES 873.112 Evaluation information. (a) Without regard to FAR 15.304 (except for 15.304(c)(1) and (c)(3), which do apply...

Multimodal digital color imaging system for facial skin lesion analysis

NASA Astrophysics Data System (ADS)

Bae, Youngwoo; Lee, Youn-Heum; Jung, Byungjo

2008-02-01

In dermatology, various digital imaging modalities have been used as an important tool to quantitatively evaluate the treatment effect of skin lesions. Cross-polarization color image was used to evaluate skin chromophores (melanin and hemoglobin) information and parallel-polarization image to evaluate skin texture information. In addition, UV-A induced fluorescent image has been widely used to evaluate various skin conditions such as sebum, keratosis, sun damages, and vitiligo. In order to maximize the evaluation efficacy of various skin lesions, it is necessary to integrate various imaging modalities into an imaging system. In this study, we propose a multimodal digital color imaging system, which provides four different digital color images of standard color image, parallel and cross-polarization color image, and UV-A induced fluorescent color image. Herein, we describe the imaging system and present the examples of image analysis. By analyzing the color information and morphological features of facial skin lesions, we are able to comparably and simultaneously evaluate various skin lesions. In conclusion, we are sure that the multimodal color imaging system can be utilized as an important assistant tool in dermatology.

Integrated corridor management initiative : demonstration phase evaluation. Dallas institutional and organizational analysis test plan.

DOT National Transportation Integrated Search

2000-10-01

The Advanced Rural Traveler Information System (ARTIS) began development June 30, 1995. While a number of activities were underway to operationally test and evaluate metro or urban traveler information systems in the 75 target markets, ARTIS setout t...

48 CFR 515.305-70 - Use of outside evaluators.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 4 2011-10-01 2011-10-01 false Use of outside evaluators. 515.305-70 Section 515.305-70 Federal Acquisition Regulations System GENERAL SERVICES ADMINISTRATION.... (b) Limitations on disclosing proposal information. You may disclose proposal information outside the...

76 FR 57722 - Notice of Proposed Information Collection Requests

Federal Register 2010, 2011, 2012, 2013, 2014

2011-09-16

... Emerging Teacher Evaluation Systems in the United States. OMB Control Number: Pending. Agency Form Number(s...: 467. Abstract: The Study of Emerging Teacher Evaluation Systems in the United States will contribute... DEPARTMENT OF EDUCATION Notice of Proposed Information Collection Requests AGENCY: Department of...

Promoting evaluation capacity building in a complex adaptive system.

PubMed

Lawrenz, Frances; Kollmann, Elizabeth Kunz; King, Jean A; Bequette, Marjorie; Pattison, Scott; Nelson, Amy Grack; Cohn, Sarah; Cardiel, Christopher L B; Iacovelli, Stephanie; Eliou, Gayra Ostgaard; Goss, Juli; Causey, Lauren; Sinkey, Anne; Beyer, Marta; Francisco, Melanie

2018-04-10

This study provides results from an NSF funded, four year, case study about evaluation capacity building in a complex adaptive system, the Nanoscale Informal Science Education Network (NISE Net). The results of the Complex Adaptive Systems as a Model for Network Evaluations (CASNET) project indicate that complex adaptive system concepts help to explain evaluation capacity building in a network. The NISE Network was found to be a complex learning system that was supportive of evaluation capacity building through feedback loops that provided for information sharing and interaction. Participants in the system had different levels of and sources of evaluation knowledge. To be successful at building capacity, the system needed to have a balance between both centralized and decentralized control, coherence, redundancy, and diversity. Embeddedness of individuals within the system also provided support and moved the capacity of the system forward. Finally, success depended on attention being paid to the control of resources. Implications of these findings are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

Performance evaluation of public hospital information systems by the information system success model.

PubMed

Cho, Kyoung Won; Bae, Sung-Kwon; Ryu, Ji-Hye; Kim, Kyeong Na; An, Chang-Ho; Chae, Young Moon

2015-01-01

This study was to evaluate the performance of the newly developed information system (IS) implemented on July 1, 2014 at three public hospitals in Korea. User satisfaction scores of twelve key performance indicators of six IS success factors based on the DeLone and McLean IS Success Model were utilized to evaluate IS performance before and after the newly developed system was introduced. All scores increased after system introduction except for the completeness of medical records and impact on the clinical environment. The relationships among six IS factors were also analyzed to identify the important factors influencing three IS success factors (Intention to Use, User Satisfaction, and Net Benefits). All relationships were significant except for the relationships among Service Quality, Intention to Use, and Net Benefits. The results suggest that hospitals should not only focus on systems and information quality; rather, they should also continuously improve service quality to improve user satisfaction and eventually reach full the potential of IS performance.

Sources of Information for Evaluating Rural Development: An Overview.

ERIC Educational Resources Information Center

Grayburn, Laura; And Others

Designed to help rural development evaluators and other social scientists use their bibliographic search time more efficiently, this information guide presents the following: (1) detailed information on computerized information retrieval systems, including name, location, subject matter, turnaround time, cost, availability, and utility…

Geographic information system for pigweed distribution in the US Southeast

USDA-ARS?s Scientific Manuscript database

In the southeastern United States, pigweeds have become troublesome weeds in agricultural systems. To implement management strategies to control them, agriculturalists need information on areas affected by pigweeds. Geographic information systems (GIS) afford users the ability to evaluate agricult...

A fuelwood plantation site selection procedure using geographic information system technology: A case study in support of the NASA Global Habitability Program

NASA Technical Reports Server (NTRS)

Roller, N. E. G.; Colwell, J. E.; Sellman, A. N.

1985-01-01

A study undertaken in support of NASA's Global Habitability Program is described. A demonstration of geographic information system (GIS) technology for site evaluation and selection is given. The objective was to locate potential fuelwood plantations within a 50 km radius of Nairobi, Kenya. A model was developed to evaluate site potential based on capability and suitability criteria and implemented using the Environmental Research Institute of Michigan's geographic information system.

CARETS: A prototype regional environmental information system. Volume 12: User evaluation of experimental land use maps and related products from the central Atlantic test site

NASA Technical Reports Server (NTRS)

Alexander, R. H. (Principal Investigator); Mcginty, H. K., III

1975-01-01

The author has identified the following significant results. Recommendations resulting from the CARETS evaluation reflect the need to establish a flexible and reliable system for providing more detailed raw and processed land resource information as well as the need to improve the methods of making information available to users.

Evaluating and selecting an information system, Part 1.

PubMed

Neal, T

1993-01-01

Initial steps in the process of evaluating and selecting a computerized information system for the pharmacy department are described. The first step in the selection process is to establish a steering committee and a project committee. The steering committee oversees the project, providing policy guidance, making major decisions, and allocating budgeted expenditures. The project committee conducts the departmental needs assessment, identifies system requirements, performs day-to-day functions, evaluates vendor proposals, trains personnel, and implements the system chosen. The second step is the assessment of needs in terms of personnel, workload, physical layout, and operating requirements. The needs assessment should be based on the department's mission statement and strategic plan. The third step is the development of a request for information (RFI) and a request for proposal (RFP). The RFI is a document designed for gathering preliminary information from a wide range of vendors; this general information is used in deciding whether to send the RFP to a given vendor. The RFP requests more detailed information and gives the purchaser's exact specifications for a system; the RFP also includes contractual information. To help ensure project success, many institutions turn to computer consultants for guidance. The initial steps in selecting a computerized pharmacy information system are establishing computerization committees, conducting a needs assessment, and writing an RFI and an RFP. A crucial early decision is whether to seek a consultant's expertise.

Management Information Systems for Higher Education. Studies in Institutional Management in Higher Education.

ERIC Educational Resources Information Center

Hussain, K. M., Ed.

Contents include an introduction to information systems (basic concepts and life-cycle); development of an information system (design, implementation, testing, and conversion); operation (evaluation and maintenance, quality control, and economics); and case studies of such systems at the New University of Lisbon, Bath University, Laval University…

Health information systems in the Islamic Republic of Iran: a case study in Kerman Province.

PubMed

Zolala, F

2011-09-01

Health information systems provide information for decision-making at all levels, from planning and management to evaluation of health services. Registration of vital events is the most basic level of any health information system. This case study used in-depth interviews, observations and examination of documents to explore the system of births and deaths registration in Kerman province. The findings were evaluated under 3 headings: data input, data processing and data usage. A range of problems were identified concerning legal requirements, staffing, data checking and publication of data. Different approaches are suggested to strengthen the system, such as introducing regulations to oblige different data sources to provide data and allocating sufficient resources, including human resources, and an improved technology infrastructure.

Evaluation plan : the I-40 Traveler and Tourist Information System field operational test

DOT National Transportation Integrated Search

1998-02-25

The I-40 Traveler and Tourist Information System (TTIS) in northern Arizona is a Field Operational Test (FOT) of Traveler Information Services in Tourism Areas funded through the National Advanced Rural Transportation Systems Program. The segment of ...

A combined report for freight information real-time system for transport (FIRST). Part A, final evaluation. Part B, detailed test plans

DOT National Transportation Integrated Search

2002-05-30

The ultimate goal of this evaluation is to identify any benefits in operational efficiency, air quality, and customer satisfaction with the implementation of the FIRST information technology system for the intermodal freight industry at the Port of N...

Description of cost data from state self-evaluations of commercial vehicle information systems and networks (CVISN) deployments (October 2003 to October 2005)

DOT National Transportation Integrated Search

2006-02-20

To help states track their own progress in deploying Commercial Vehicle Information Systems and Networks (CVISN) technologies, a self-evaluation requirement was included in the partnership agreements between the U.S. Department of Transportation (DOT...

75 FR 59236 - Privacy Act of 1974; System of Records

Federal Register 2010, 2011, 2012, 2013, 2014

2010-09-27

... Warrior Care and Recovery Transition Coordination Program System Solution SYSTEM LOCATION: Manpower Information Systems Technology Branch, Manpower Information Systems Division, Manpower and Reserve Affairs... analysis, tracking, reporting, evaluating program effectiveness and conducting research. ROUTINE USES OF...

Evaluation of Software Simulation of Road Weather Information System.

DOT National Transportation Integrated Search

2016-09-01

A road weather information system (RWIS) is a combination of technologies that collects, transmits, models, and disseminates weather and road condition information. Sensors measure a range of weatherrelated conditions, including pavement temperatur...

Project #8, Task 4 - Travel Information Services (TIS), Evaluation Of Available TIS Technology

DOT National Transportation Integrated Search

1995-05-22

THE L-95 CORRIDOR COALITION'S TRAVELER INFORMATION SERVICES (TIS) PROJECT IS INTENDED TO IMPLEMENT AN ADVANCED TRAVELER INFORMATION SYSTEM TAILORED TO THE UNIQUE NEEDS OF THE NORTHEAST CORRIDOR. THE SYSTEM WILL ACQUIRE AND DISSEMINATE INFORMATION ON ...

Quality of human-computer interaction - results of a national usability survey of hospital-IT in Germany

PubMed Central

2011-01-01

Background Due to the increasing functionality of medical information systems, it is hard to imagine day to day work in hospitals without IT support. Therefore, the design of dialogues between humans and information systems is one of the most important issues to be addressed in health care. This survey presents an analysis of the current quality level of human-computer interaction of healthcare-IT in German hospitals, focused on the users' point of view. Methods To evaluate the usability of clinical-IT according to the design principles of EN ISO 9241-10 the IsoMetrics Inventory, an assessment tool, was used. The focus of this paper has been put on suitability for task, training effort and conformity with user expectations, differentiated by information systems. Effectiveness has been evaluated with the focus on interoperability and functionality of different IT systems. Results 4521 persons from 371 hospitals visited the start page of the study, while 1003 persons from 158 hospitals completed the questionnaire. The results show relevant variations between different information systems. Conclusions Specialised information systems with defined functionality received better assessments than clinical information systems in general. This could be attributed to the improved customisation of these specialised systems for specific working environments. The results can be used as reference data for evaluation and benchmarking of human computer engineering in clinical health IT context for future studies. PMID:22070880

National Aeronautics and Space Administration fundamental research program. Information utilization and evaluation

NASA Technical Reports Server (NTRS)

Estes, J. E.; Eisgruber, L.

1981-01-01

In the second half of the 1980's NASA can expect to face difficult choices among alternative fundamental and applied research, and development projects that could potentially lead to improvements in the information systems used to manage renewable resources. The working group on information utilization and evaluation believes that effective choices cannot be made without a better understanding of the current and prospective problems and opportunities involved in the application of remote sensing to improve renewable research information systems. A renewable resources information system is defined in a broad context to include a flow of data/information from: acquisition through processing, storage, integration with other data, analysis, graphic presentation, decision making, and assessment of the affects of those decisions.

ERTS-1 Role in land management and planning in Minnesota

NASA Technical Reports Server (NTRS)

Sizer, J. E.; Brown, D. A.

1974-01-01

Research on applications of ERTS-1 imagery to land use has focused on evaluating the ability of ERTS-1 imagery to update and refine the detail of land use information in the Minnesota Land Management Information System. Work has been directed toward defining the capabilities of the ERTS-1 system to provide information about surface cover by identifying forest, water, and wetland resources; urban and agricultural development: and testing and evaluating data input and output procedures. As capabilities were developed, meetings were held with administrators and resource information users from various agencies of government to identify their information needs. A full scale systems test for several selected pilot areas in the state is nearly complete. Users have been identified for each test area and they have been instrumental in identifying data requirements and analysis needs for administrative purposes. Users have both rural and urban orientations and provide a basis for evaluation of the results.

Geographic Information Systems using CODES linked data (Crash outcome data evaluation system)

DOT National Transportation Integrated Search

2001-04-01

This report presents information about geographic information systems (GIS) and CODES linked data. Section one provides an overview of a GIS and the benefits of linking to CODES. Section two outlines the basic issues relative to the types of map data...

Usability study of a computer-based self-management system for older adults with chronic diseases.

PubMed

Or, Calvin; Tao, Da

2012-11-08

Usability can influence patients' acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants' comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users' true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system.

Usability Study of a Computer-Based Self-Management System for Older Adults with Chronic Diseases

PubMed Central

Tao, Da

2012-01-01

Background Usability can influence patients’ acceptance and adoption of a health information technology. However, little research has been conducted to study the usability of a self-management health care system, especially one geared toward elderly patients. Objective This usability study evaluated a new computer-based self-management system interface for older adults with chronic diseases, using a paper prototype approach. Methods Fifty older adults with different chronic diseases participated. Two usability evaluation methods were involved: (1) a heuristics evaluation and (2) end-user testing with a think-aloud testing method, audio recording, videotaping, and interviewing. A set of usability metrics was employed to determine the overall system usability, including task incompletion rate, task completion time, frequency of error, frequency of help, satisfaction, perceived usefulness, and perceived ease of use. Interviews were used to elicit participants’ comments on the system design. The quantitative data were analyzed using descriptive statistics and the qualitative data were analyzed for content. Results The participants were able to perform the predesigned self-management tasks with the current system design and they expressed mostly positive responses about the perceived usability measures regarding the system interface. However, the heuristics evaluation, performance measures, and interviews revealed a number of usability problems related to system navigation, information search and interpretation, information presentation, and readability. Design recommendations for further system interface modifications were discussed. Conclusions This study verified the usability of the self-management system developed for older adults with chronic diseases. Also, we demonstrated that our usability evaluation approach could be used to quickly and effectively identify usability problems in a health care information system at an early stage of the system development process using a paper prototype. Conducting a usability evaluation is an essential step in system development to ensure that the system features match the users’ true needs, expectations, and characteristics, and also to minimize the likelihood of the users committing user errors and having difficulties using the system. PMID:23612015

Evaluating a federated medical search engine: tailoring the methodology and reporting the evaluation outcomes.

PubMed

Saparova, D; Belden, J; Williams, J; Richardson, B; Schuster, K

2014-01-01

Federated medical search engines are health information systems that provide a single access point to different types of information. Their efficiency as clinical decision support tools has been demonstrated through numerous evaluations. Despite their rigor, very few of these studies report holistic evaluations of medical search engines and even fewer base their evaluations on existing evaluation frameworks. To evaluate a federated medical search engine, MedSocket, for its potential net benefits in an established clinical setting. This study applied the Human, Organization, and Technology (HOT-fit) evaluation framework in order to evaluate MedSocket. The hierarchical structure of the HOT-factors allowed for identification of a combination of efficiency metrics. Human fit was evaluated through user satisfaction and patterns of system use; technology fit was evaluated through the measurements of time-on-task and the accuracy of the found answers; and organization fit was evaluated from the perspective of system fit to the existing organizational structure. Evaluations produced mixed results and suggested several opportunities for system improvement. On average, participants were satisfied with MedSocket searches and confident in the accuracy of retrieved answers. However, MedSocket did not meet participants' expectations in terms of download speed, access to information, and relevance of the search results. These mixed results made it necessary to conclude that in the case of MedSocket, technology fit had a significant influence on the human and organization fit. Hence, improving technological capabilities of the system is critical before its net benefits can become noticeable. The HOT-fit evaluation framework was instrumental in tailoring the methodology for conducting a comprehensive evaluation of the search engine. Such multidimensional evaluation of the search engine resulted in recommendations for system improvement.

Towards a Clinical Trial Protocol to Evaluate Health Information Systems: Evaluation of a Computerized System for Monitoring Tuberculosis from a Patient Perspective in Brazil.

PubMed

Crepaldi, Nathalia Yukie; de Lima, Inacia Bezerra; Vicentine, Fernanda Bergamini; Rodrigues, Lídia Maria Lourençon; Sanches, Tiago Lara Michelin; Ruffino-Netto, Antonio; Alves, Domingos; Rijo, Rui Pedro Charters Lopes

2018-05-08

Assessment of health information systems consider different aspects of the system itself. They focus or on the professional who will use the software or on its usability or on the software engineering metrics or on financial and managerial issues. The existent approaches are very resources consuming, disconnected, and not standardized. As the software becomes more critical in the health organizations and in patients, becoming used as a medical device or a medicine, there is an urgency to identify tools and methods that can be applied in the development process. The present work is one of the steps of a broader study to identify standardized protocols to evaluate the health information systems as medicines and medical devices are evaluated by clinical trials. The goal of the present work was to evaluate the effect of the introduction of an information system for monitoring tuberculosis treatment (SISTB) in a Brazilian municipality from the patients' perspective. The Patient Satisfaction Questionnaire and the Hospital Consumer Assessment of Healthcare Providers and Systems were answered by the patients before and after the SISTB introduction, for comparison. Patients from an outpatient clinic, formed the control group, that is, at this site was not implanted the SISTB. Descriptive statistics and mixed effects model were used for data analysis. Eighty-eight interviews were conducted in the study. The questionnaire's results presented better averages after the system introduction but were not considered statistically significant. Therefore, it was not possible to associate system implantation with improved patient satisfaction. The HIS evaluation need be complete, the technical and managerial evaluation, the safety, the impact on the professionals and direct and/or indirect impact on patients are important. Developing the right tools and methods that can evaluate the software in its entirety, from the beginning of the development cycle with a normalized scale, are needed.

Command History for 1988

DTIC Science & Technology

1989-02-01

installs, and provides life cycle support for information management systems. 16. Provides information and reports to higher authority and the scientific com...instruction/policy. 29 November New Employees Margaret Overton Paula Augustine Staffing Clerk Clerk Typist Code OOB Code I I GS-203-4 GS-322-4 Sylvia ...Evaluation and Survey Systems-Develops systems to evaluate the effectiveness of quality of life programs and to improve the quality of personnel

Electronic immunization data collection systems: application of an evaluation framework.

PubMed

Heidebrecht, Christine L; Kwong, Jeffrey C; Finkelstein, Michael; Quan, Sherman D; Pereira, Jennifer A; Quach, Susan; Deeks, Shelley L

2014-01-14

Evaluating the features and performance of health information systems can serve to strengthen the systems themselves as well as to guide other organizations in the process of designing and implementing surveillance tools. We adapted an evaluation framework in order to assess electronic immunization data collection systems, and applied it in two Ontario public health units. The Centers for Disease Control and Prevention's Guidelines for Evaluating Public Health Surveillance Systems are broad in nature and serve as an organizational tool to guide the development of comprehensive evaluation materials. Based on these Guidelines, and informed by other evaluation resources and input from stakeholders in the public health community, we applied an evaluation framework to two examples of immunization data collection and examined several system attributes: simplicity, flexibility, data quality, timeliness, and acceptability. Data collection approaches included key informant interviews, logic and completeness assessments, client surveys, and on-site observations. Both evaluated systems allow high-quality immunization data to be collected, analyzed, and applied in a rapid fashion. However, neither system is currently able to link to other providers' immunization data or provincial data sources, limiting the comprehensiveness of coverage assessments. We recommended that both organizations explore possibilities for external data linkage and collaborate with other jurisdictions to promote a provincial immunization repository or data sharing platform. Electronic systems such as the ones described in this paper allow immunization data to be collected, analyzed, and applied in a rapid fashion, and represent the infostructure required to establish a population-based immunization registry, critical for comprehensively assessing vaccine coverage.

Evaluation methodologies for an advanced information processing system

NASA Technical Reports Server (NTRS)

Schabowsky, R. S., Jr.; Gai, E.; Walker, B. K.; Lala, J. H.; Motyka, P.

1984-01-01

The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.

A scalable healthcare information system based on a service-oriented architecture.

PubMed

Yang, Tzu-Hsiang; Sun, Yeali S; Lai, Feipei

2011-06-01

Many existing healthcare information systems are composed of a number of heterogeneous systems and face the important issue of system scalability. This paper first describes the comprehensive healthcare information systems used in National Taiwan University Hospital (NTUH) and then presents a service-oriented architecture (SOA)-based healthcare information system (HIS) based on the service standard HL7. The proposed architecture focuses on system scalability, in terms of both hardware and software. Moreover, we describe how scalability is implemented in rightsizing, service groups, databases, and hardware scalability. Although SOA-based systems sometimes display poor performance, through a performance evaluation of our HIS based on SOA, the average response time for outpatient, inpatient, and emergency HL7Central systems are 0.035, 0.04, and 0.036 s, respectively. The outpatient, inpatient, and emergency WebUI average response times are 0.79, 1.25, and 0.82 s. The scalability of the rightsizing project and our evaluation results show that the SOA HIS we propose provides evidence that SOA can provide system scalability and sustainability in a highly demanding healthcare information system.

[The validation of the process and the results of an information system in primary care].

PubMed

Bolíbar Ribas, B; Juncosa Font, S

1992-01-01

The needs of information for the primary health care centers planning and management, and the poor situation we started from, have generated a large amount of information systems, which, as a general rule, have not been sufficiently evaluated. Since 1986, in the Area de Gestión, 7, Centro, of the ICS here exists an information system of the general medicine services with a sampling method (ANAC-2). The validation of some aspects of the process and content is shown in order to evaluate the quality of information. The problems arisen during the process of collecting data from nine centers are analyzed during six months and its information content is compared with the one of each system with a standard respect their value. To evaluate the concordance, we have used a graphic representation of the differences of each system with a standard respect their mean value, and the "limits of agreement". On relation with the problems of collecting data, two centers show a nonfulfillment of the observation calendar higher than 20% and the logical divergences are not important. The kind of visits distribution is quite correct, even if the estimate of the whole number of visits is higher than 20% in two centers. In the activity indicators, the system of reference has a tendency to give average values lower than the ANAC-2, with the exception of prescription/visit. In referrals and prescriptions, the use of different sources of information between systems produces an average difference of 3.3 interconsults/100 visits and 0.8 prescriptions/visit respectively. Generally, the limits of agreement are wide and become unacceptable in laboratory. The study carried out is evaluated positively, for it detects the problematical areas which can be modified or require further studies. The importance of validating the information systems is emphasized, in spite of difficulties.

Regional Information System for Educators. Information Resources; Installation and Evaluation; Information Services; An Operational Handbook; Proceedings of the American Society for Information Science, Vol. 6, 1969. (five documents)

ERIC Educational Resources Information Center

Grimes, George; And Others

A series of four pamphlets which describe the Regional Information System (RIS) of the Michigan-Ohio Regional Educational Laboratory (MOREL), a system designed to provide an effective, systematic methodology for linking users with relevant resources, compose the major portion of this information package. Each publication details an aspect of the…

Evaluating a Federated Medical Search Engine

PubMed Central

Belden, J.; Williams, J.; Richardson, B.; Schuster, K.

2014-01-01

Summary Background Federated medical search engines are health information systems that provide a single access point to different types of information. Their efficiency as clinical decision support tools has been demonstrated through numerous evaluations. Despite their rigor, very few of these studies report holistic evaluations of medical search engines and even fewer base their evaluations on existing evaluation frameworks. Objectives To evaluate a federated medical search engine, MedSocket, for its potential net benefits in an established clinical setting. Methods This study applied the Human, Organization, and Technology (HOT-fit) evaluation framework in order to evaluate MedSocket. The hierarchical structure of the HOT-factors allowed for identification of a combination of efficiency metrics. Human fit was evaluated through user satisfaction and patterns of system use; technology fit was evaluated through the measurements of time-on-task and the accuracy of the found answers; and organization fit was evaluated from the perspective of system fit to the existing organizational structure. Results Evaluations produced mixed results and suggested several opportunities for system improvement. On average, participants were satisfied with MedSocket searches and confident in the accuracy of retrieved answers. However, MedSocket did not meet participants’ expectations in terms of download speed, access to information, and relevance of the search results. These mixed results made it necessary to conclude that in the case of MedSocket, technology fit had a significant influence on the human and organization fit. Hence, improving technological capabilities of the system is critical before its net benefits can become noticeable. Conclusions The HOT-fit evaluation framework was instrumental in tailoring the methodology for conducting a comprehensive evaluation of the search engine. Such multidimensional evaluation of the search engine resulted in recommendations for system improvement. PMID:25298813

Field evaluation of a wearable multimodal soldier navigation system.

PubMed

Aaltonen, Iina; Laarni, Jari

2017-09-01

Challenging environments pose difficulties for terrain navigation, and therefore wearable and multimodal navigation systems have been proposed to overcome these difficulties. Few such navigation systems, however, have been evaluated in field conditions. We evaluated how a multimodal system can aid in navigating in a forest in the context of a military exercise. The system included a head-mounted display, headphones, and a tactile vibrating vest. Visual, auditory, and tactile modalities were tested and evaluated using unimodal, bimodal, and trimodal conditions. Questionnaires, interviews and observations were used to evaluate the advantages and disadvantages of each modality and their multimodal use. The guidance was considered easy to interpret and helpful in navigation. Simplicity of the displayed information was required, which was partially conflicting with the request for having both distance and directional information available. Copyright © 2017 Elsevier Ltd. All rights reserved.

[Evaluation on application of China Disease Prevention and Control Information System of Hydatid Disease Ⅰ Current status at the provincial level].

PubMed

Zhi-Hua, Zhang; Qing, Yu; Tian, Tian; Wei-Ping, Wu; Ning, Xiao

2016-03-31

To evaluate the application status of China Disease Prevention and Control Information System of Hydatid Disease, in which questions existed are summarized in order to promote the system update. A questionnaire was designed and distributed to Inner Mongolia, Sichuan, Tibet, Gansu, Qinghai, Ningxia, Xinjiang and Xinjiang Production and Construction Corps to evaluate the application status of China Disease Prevention and Control Information System of Hydatid Disease assistant with telephone. The recovery rate of questionnaires was 87.5%. The statistics of closed questions showed that national application rate of the China Disease Prevention and Control Information System of Hydatid Disease was 100%, of which 15.3% were low frequency users, 57.1% believed the system was necessary, 28.6% considered it was dispensable, and 14.3% believed that it was totally unnecessary. The statistics of open-ended questions indicated that 6 endemic regions suggested to increase the guidance and training, while 4 endemic regions had opinions on sharing the information of the national infectious disease reporting systems and hydatid disease prevention and control information system, and the opinions on turning monthly report to quarterly report, and increasing statistics and analysis module, and 3 endemic regions deemed that the system had logic errors and defects. The problems of the system are mainly focused on the existence of systemic deficiencies and logic errors, lacking of statistical parameters and corresponding analysis function module, and lacking of the guidance and training, which limits the use of the system. Therefore, these problems should be resolved.

Graphical Weather Information System Evaluation: Usability, Perceived Utility, and Preferences from General Aviation Pilots

NASA Technical Reports Server (NTRS)

Latorella, Kara A.; Chamberlain, James P.

2002-01-01

Weather is a significant factor in General Aviation (GA) accidents and fatality rates. Graphical Weather Information Systems (GWISs) for the flight deck are appropriate technologies for mitigating the difficulties GA pilots have with current aviation weather information sources. This paper describes usability evaluations of a prototype GWIS by 12 GA pilots after using the system in flights towards convective weather. We provide design guidance for GWISs and discuss further research required to support weather situation awareness and in-flight decision making for GA pilots.

An evaluation method of computer usability based on human-to-computer information transmission model.

PubMed

Ogawa, K

1992-01-01

This paper proposes a new evaluation and prediction method for computer usability. This method is based on our two previously proposed information transmission measures created from a human-to-computer information transmission model. The model has three information transmission levels: the device, software, and task content levels. Two measures, called the device independent information measure (DI) and the computer independent information measure (CI), defined on the software and task content levels respectively, are given as the amount of information transmitted. Two information transmission rates are defined as DI/T and CI/T, where T is the task completion time: the device independent information transmission rate (RDI), and the computer independent information transmission rate (RCI). The method utilizes the RDI and RCI rates to evaluate relatively the usability of software and device operations on different computer systems. Experiments using three different systems, in this case a graphical information input task, confirm that the method offers an efficient way of determining computer usability.

32 CFR 806b.30 - Evaluating information systems for Privacy Act compliance.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 32 National Defense 6 2011-07-01 2011-07-01 false Evaluating information systems for Privacy Act compliance. 806b.30 Section 806b.30 National Defense Department of Defense (Continued) DEPARTMENT OF THE AIR... privacy issues are unchanged. (d) The depth and content of the Privacy Impact Assessment should be...

32 CFR 806b.30 - Evaluating information systems for Privacy Act compliance.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 32 National Defense 6 2010-07-01 2010-07-01 false Evaluating information systems for Privacy Act compliance. 806b.30 Section 806b.30 National Defense Department of Defense (Continued) DEPARTMENT OF THE AIR... privacy issues are unchanged. (d) The depth and content of the Privacy Impact Assessment should be...

511 Virginia evaluation

DOT National Transportation Integrated Search

2004-01-01

This document presents the results of the evaluation of the 511 Virginia Advanced Traveler Information System (ATIS), a system that operates on the I-81 corridor in Virginia. The evaluation focused on the Virginia Department of Transportation's (VDOT...

Evaluation of Emerging Technologies for Traffic Crash Reporting

DOT National Transportation Integrated Search

1998-02-01

An evaluation was performed of the effect of emerging technologies on traffic accident reporting. The technologies evaluated were standard laptop and pen-based portable computers, Global Positioning Systems (GPS), Geographic Information Systems (GIS)...

Applied information system-based in enhancing students' understanding towards higher order thinking (HOTS)

NASA Astrophysics Data System (ADS)

Hua, Ang Kean; Ping, Owi Wei

2017-05-01

The application of information and communications technology (ICT) had become more important in our daily life, especially in educational field. Teachers are encouraged to use information system-based in teaching Mathematical courses. Higher Order Thinking Skills (HOTS) approach is unable to explain using chalk and talk methods. It needs students to analyze, evaluate, and create by their own natural abilities. The aim of this research study was to evaluate the effectiveness of the application information system-based in enhance the students understanding about HOTS question. Mixed-methods or quantitative and qualitative approach was applied in collecting data, which involve only the standard five students and the teachers in Sabak Bernam, Selangor. Pra-postests was held before and after using information system-based in teaching to evaluate the students' understanding. The result from post-test indicates significant improvement which proves that the use of information system based able to enhance students' understanding about HOTS question and solve it. There were several factor influenced the students such as students' attitude, teachers attraction, school facilities, and computer approach. Teachers play an important role in attracting students to learn. Therefore, the school should provide a conducive learning environment and good facilities for students to learn so that they are able to access more information and always exposed to new knowledge. As conclusion, information system-based are able to enhance students understanding the need of HOTS questions and solve it.

Information Management Strategies for Program Tracking and Formative Evaluation

NASA Astrophysics Data System (ADS)

Siegfried, D.; Detrick, L.; Valaitis, S.; Johnson, A.; Thomas, S. H.; Fauver, A.

2013-05-01

The Institute for Broadening Participation (IBP) has developed information management systems to facilitate programmatic formative evaluation, tracking and outreach activities. Nearly a decade of design solutions and technical implementations in support of IBP's professional development and mentoring programs for students (including the "Pathways to Ocean Science," "Minorities Striving and Pursuing Higher Degrees of Success" in Earth System Science, and "Pathways to Engineering") has provided IBP with a toolbox of proven strategies for addressing program engagement and participant tracking, outreach, and a variety of other information management needs. In this session, IBP will use case-specific examples to share general design strategies for program participant and activities data collection in REUs and other program types. The cases will illustrate an approach that begins with a review of program logic, objectives, expected outcomes, constraints and requirements, which then informs a comprehensive system design. When implemented, such information systems improve administrative efficiency through streamlined data collection processes and easy-to-use data capture forms, and a corresponding set of reporting tools provides access to data that is crucial for ongoing program improvement. IBP presents this information in response to collaborations with administrators of Research Experience for Undergraduates (REU) programs as well as longer duration programs, who have expressed the need for more comprehensive and easy to use information systems. Recently IBP has also worked with the directors of NSF and NASA funded programs seeking assistance in addressing their formative evaluation needs including system design, information collection, and reporting efforts.

The development of an evaluation framework for injury surveillance systems

PubMed Central

Mitchell, Rebecca J; Williamson, Ann M; O'Connor, Rod

2009-01-01

Background Access to good quality information from injury surveillance is essential to develop and monitor injury prevention activities. To determine if information obtained from surveillance is of high quality, the limitations and strengths of a surveillance system are often examined. Guidelines have been developed to assist in evaluating certain types of surveillance systems. However, to date, no standard guidelines have been developed to specifically evaluate an injury surveillance system. The aim of this research is to develop a framework to guide the evaluation of injury surveillance systems. Methods The development of an Evaluation Framework for Injury Surveillance Systems (EFISS) involved a four stage process. First, a literature review was conducted to identify an initial set of characteristics that were recognised as important and/or had been recommended to be assessed in an evaluation of a surveillance system. Second, this set of characteristics was assessed using SMART criteria. Third, those surviving were presented to an expert panel using a two round modified-Delphi study to gain an alternative perspective on characteristic definitions, practicality of assessment, and characteristic importance. Finally, a rating system was created for the EFISS characteristics. Results The resulting EFISS consisted of 18 characteristics that assess three areas of an injury surveillance system – five characteristics assess data quality, nine characteristics assess the system's operation, and four characteristics assess the practical capability of an injury surveillance system. A rating system assesses the performance of each characteristic. Conclusion The development of the EFISS builds upon existing evaluation guidelines for surveillance systems and provides a framework tailored to evaluate an injury surveillance system. Ultimately, information obtained through an evaluation of an injury data collection using the EFISS would be useful for agencies to recommend how a collection could be improved to increase its usefulness for injury surveillance and in the long-term injury prevention. PMID:19627617

Information System and Geographic Information System Tools in the Data Analyses of the Control Program for Visceral Leishmaniases from 2006 to 2010 in the Sanitary District of Venda Nova, Belo Horizonte, Minas Gerais, Brazil

PubMed Central

Saraiva, Lara; Leite, Camila Gonçalves; de Carvalho, Luiz Otávio Alves; Andrade Filho, José Dilermando; de Menezes, Fernanda Carvalho; Fiúza, Vanessa de Oliveira Pires

2012-01-01

The aim of this paper is to report a brief history of control actions for Visceral Leishmaniasis (VL) from 2006 to 2010 in the Sanitary District (DS) of Venda Nova, Belo Horizonte, Minas Gerais, Brazil, focusing on the use of information systems and Geographic Information System (GIS) tools. The analyses showed that the use of an automated database allied with geoprocessing tools may favor control measures of VL, especially with regard to the evaluation of control actions carried out. Descriptive analyses of control measures allowed to evaluating that the information system and GIS tools promoted greater efficiency in making decisions and planning activities. These analyses also pointed to the necessity of new approaches to the control of VL in large urban centers. PMID:22518168

Evaluation of the Salt Lake City Computerized Rider Information System

DOT National Transportation Integrated Search

1985-11-01

The Utah Transit Authority (UTA) Computerized Rider Information System (CRIS) project involved the installation of an automated telephone service to quickly provide bus stop-specific schedule and service information to residents throughout the Author...

Evaluation of mobility impacts of advanced information systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Peeta, S.; Poonuru, K.; Sinha, K.

2000-06-01

Advanced technologies under the aegis of advanced traveler information systems and advanced traffic management systems are being employed to address the debilitating traffic congestion problem. Broadly identified under the label intelligent transportation systems (ITS), they focus on enhancing the efficiency of the existing roadway utilization. Though ITS has transitioned from the conceptual framework stage to the operational test phase that analyzes real-world feasibility, studies that systematically quantify the multidimensional real-world impacts of these technologies in terms of mobility, safety, and air quality, are lacking. This paper proposes a simulation-based framework to address the mobility impacts of these technologies through themore » provision of information to travelers. The information provision technologies are labeled as advanced information systems (AIS), and include pretrip information, en route information, variable message signs, and combinations thereof. The primary focus of the paper is to evaluate alternative AIS technologies using the heavily traveled Borman Expressway corridor in northwestern Indiana as a case study. Simulation results provide insights into the mobility impacts of AIS technologies, and contrast the effectiveness of alternative information provision sources and strategies.« less

The Naval Enlisted Professional Development Information System (NEPDIS): Front End Analysis (FEA) Process. Technical Report 159.

ERIC Educational Resources Information Center

Aagard, James A.; Ansbro, Thomas M.

The Naval Enlisted Professional Development Information System (NEPDIS) was designed to function as a fully computerized information assembly and analysis system to support labor force, personnel, and training management. The NEPDIS comprises separate training development, instructional, training record and evaluation, career development, and…

Consonance in Information System Projects: A Relationship Marketing Perspective

ERIC Educational Resources Information Center

Lin, Pei-Ying

2010-01-01

Different stakeholders in the information system project usually have different perceptions and expectations of the projects. There is seldom consistency in the stakeholders' evaluations of the project outcome. Thus the outcomes of information system projects are usually disappointing to one or more stakeholders. Consonance is a process that can…

Advanced Traveler Information Systems and Commercial Vehicle Operations Components of the Intelligent Transportation Systems: On-road Evaluation of ATIS Messages

DOT National Transportation Integrated Search

1998-03-01

This report describes the results of an on-road study that examined how Advanced Traveler Information Systems (ATIS) information influences driver behavior. The objective of the study was to develop ATIS design guidelines, primarily for In-Vehicle Si...

Assessing managerial information needs: Modification and evaluation of the Hospital Shift Leaders' Information Needs Questionnaire.

PubMed

Peltonen, Laura-Maria; Lundgrén-Laine, Heljä; Siirala, Eriikka; Löyttyniemi, Eliisa; Aantaa, Riku; Salanterä, Sanna

2018-03-01

The aims were (1) to evaluate the modified version of the Intensive Care Unit Information Need Questionnaire for the broader hospital setting, and (2) to describe the differences in respondents' managerial activities and information needs according to the position held by the respondent and the type of hospital unit. Information systems do not support managerial decision-making sufficiently and information needed in the day-to-day operations management in hospital units is unknown. An existing questionnaire was modified and evaluated. Shift leaders, that is, the nurses and physicians responsible for the day-to-day operations management in hospital units were reached using purposive sampling (n = 258). The questionnaire ascertained the importance of information. Cronbach's α ranged from .85-.96 for the subscales. Item - total correlations showed good explanatory power. Managerial activities and information needs differed between respondents in different positions, although all shared about one-third of important information needs. The response rate was 26% (n = 67). The validity and reliability of the questionnaire were good. Attention should be paid to the positions of shift leaders when developing information systems. The questionnaire can be used to determine important information when developing information systems to support day-to-day operations management in hospitals. © 2018 John Wiley & Sons Ltd.

The Contextualized Technology Adaptation Process (CTAP): Optimizing Health Information Technology to Improve Mental Health Systems.

PubMed

Lyon, Aaron R; Wasse, Jessica Knaster; Ludwig, Kristy; Zachry, Mark; Bruns, Eric J; Unützer, Jürgen; McCauley, Elizabeth

2016-05-01

Health information technologies have become a central fixture in the mental healthcare landscape, but few frameworks exist to guide their adaptation to novel settings. This paper introduces the contextualized technology adaptation process (CTAP) and presents data collected during Phase 1 of its application to measurement feedback system development in school mental health. The CTAP is built on models of human-centered design and implementation science and incorporates repeated mixed methods assessments to guide the design of technologies to ensure high compatibility with a destination setting. CTAP phases include: (1) Contextual evaluation, (2) Evaluation of the unadapted technology, (3) Trialing and evaluation of the adapted technology, (4) Refinement and larger-scale implementation, and (5) Sustainment through ongoing evaluation and system revision. Qualitative findings from school-based practitioner focus groups are presented, which provided information for CTAP Phase 1, contextual evaluation, surrounding education sector clinicians' workflows, types of technologies currently available, and influences on technology use. Discussion focuses on how findings will inform subsequent CTAP phases, as well as their implications for future technology adaptation across content domains and service sectors.

Examining the functionality of the DeLone and McLean information system success model as a framework for synthesis in nursing information and communication technology research.

PubMed

Booth, Richard G

2012-06-01

In this review, studies examining information and communication technology used by nurses in clinical practice were examined. Overall, a total of 39 studies were assessed spanning a time period from 1995 to 2008. The impacts of the various health information and communication technology evaluated by individual studies were synthesized using the DeLone and McLean's six-dimensional framework for evaluating information systems success (ie, System Quality, Information Quality, Service Quality, Use, User Satisfaction, and Net Benefits). Overall, the majority of researchers reported results related to the overall Net Benefits (positive, negative, and indifferent) of the health information and communication technology used by nurses. Attitudes and user satisfaction with technology were also commonly measured attributes. The current iteration of DeLone and McLean model is effective at synthesizing basic elements of health information and communication technology use by nurses. Regardless, the current model lacks the sociotechnical sensitivity to capture deeper nurse-technology relationalities. Limitations and recommendations are provided for researchers considering using the DeLone and McLean model for evaluating health information and communication technology used by nurses.

South Lake Tahoe Coordinated Transit System project : phase III evaluation report

DOT National Transportation Integrated Search

2000-03-01

Utah's basic highway information system is one of the most complete data base management systems found in any of the Highway Safety Information System (HSIS) States in terms of the number of files included in the system and the flexibility of output....

Urban Transportation Planning Short Course: Evaluation of Alternative Transportation Systems.

ERIC Educational Resources Information Center

Federal Highway Administration (DOT), Washington, DC.

This urban transportation pamphlet delves into the roles of policy groups and technical staffs in evaluating alternative transportation plans, evaluation criteria, systems to evaluate, and evaluation procedures. The introduction admits the importance of subjective, but informed, judgment as an effective tool in weighing alternative transportation…

Design package for a complete residential solar space heating and hot water system

NASA Technical Reports Server (NTRS)

1978-01-01

Information necessary to evaluate the design of a solar space heating and hot water system is reported. System performance specifications, the design data brochure, the system description, and other information pertaining to the design are included.

Using and Distributing Spaceflight Data: The Johnson Space Center Life Sciences Data Archive

NASA Technical Reports Server (NTRS)

Cardenas, J. A.; Buckey, J. C.; Turner, J. N.; White, T. S.; Havelka,J. A.

1995-01-01

Life sciences data collected before, during and after spaceflight are valuable and often irreplaceable. The Johnson Space Center Life is hard to find, and much of the data (e.g. Sciences Data Archive has been designed to provide researchers, engineers, managers and educators interactive access to information about and data from human spaceflight experiments. The archive system consists of a Data Acquisition System, Database Management System, CD-ROM Mastering System and Catalog Information System (CIS). The catalog information system is the heart of the archive. The CIS provides detailed experiment descriptions (both written and as QuickTime movies), hardware descriptions, hardware images, documents, and data. An initial evaluation of the archive at a scientific meeting showed that 88% of those who evaluated the catalog want to use the system when completed. The majority of the evaluators found the archive flexible, satisfying and easy to use. We conclude that the data archive effectively provides key life sciences data to interested users.

Access to Biomedical Information: The Unified Medical Language System.

ERIC Educational Resources Information Center

Squires, Steven J.

1993-01-01

Describes the development of a Unified Medical Language System (UMLS) by the National Library of Medicine that will retrieve and integrate information from a variety of information resources. Highlights include the metathesaurus; the UMLS semantic network; semantic locality; information sources map; evaluation of the metathesaurus; future…

Key informant interviews test plan : model deployment of a regional, multi-modal 511 traveler information system

DOT National Transportation Integrated Search

2004-01-28

This document presents the detailed plan to conduct the Key Informants Interviews Test, one of several test activities to be conducted as part of the national evaluation of the regional, multi-modal 511 Traveler Information System Model Deployment. T...

Evaluation of health information systems research in information systems research: A meta-analysis.

PubMed

Haried, Peter; Claybaugh, Craig; Dai, Hua

2017-04-01

Given the importance of the health-care industry and the promise of health information systems, researchers are encouraged to build on the shoulders of giants as the saying goes. The health information systems field has a unique opportunity to learn from and extend the work that has already been done by the highly correlated information systems field. As a result, this research article presents a past, present and future meta-analysis of health information systems research in information systems journals over the 2000-2015 time period. Our analysis reviewed 126 articles on a variety of topics related to health information systems research published in the "Senior Scholars" list of the top eight ranked information systems academic journals. Across the selected information systems academic journals, our findings compare research methodologies applied, health information systems topic areas investigated and research trends. Interesting results emerge in the range and evolution of health information systems research and opportunities for health information systems researchers and practitioners to consider moving forward.

Evacuation support system for improved medical documentation and information flow in the field.

PubMed

Walderhaug, Ståle; Meland, Per Håkon; Mikalsen, Marius; Sagen, Terje; Brevik, John Ivar

2008-02-01

Documentation of medical treatment and observation of patients during evacuation from the point of injury to definitive treatment is important both for optimizing patient treatment and managing the evacuation process. The current practice in military medical field documentation uses paper forms and voice communication. There are many shortcomings associated with this approach, especially with respect to information capture and sharing processes. Current research addresses the use of new technology for civilian ambulance-to-hospital communication. The research work presented in this article addresses information capture and sharing in extreme military conditions by evaluating a targeted computerized information system called EvacSys during a military exercise in northern Norway in December 2003. EvacSys was designed and implemented in close cooperation with military medical personnel in both Norway and the USA. The system was evaluated and compared to the traditional paper-based documentation method during a military exercise. The on-site evaluation was conducted in a military medical platoon in the Norwegian Armed Forces, using questionnaires, semi-structured interviews, observation and video recording to capture the users' system acceptance. A prototype software system running on a commercial off-the-shelf hardware platform was successfully developed. The evaluation of this system shows that the usability of digital information capturing and sharing are perceived to be at least as good as the traditional paper-based method. The medics found the new digital method to be more viable than the old one. No technical problems were encountered. Our research shows that it is feasible to utilize digital information systems for medical documentation in extreme outdoor environments. The usability concern is of utmost importance, and more research should be put into the design and alignment with existing workflow. Successful digitalization of information at the point of care will provide accurate and timely information for the management of resources during disaster response.

Management information systems: their role in the marketing activities of HMOs.

PubMed

Aronow, D B

1988-01-01

HMOs are particularly dependent on their information resources in providing cost-effective, high quality, accessible care. Understanding the role of MIS in HMO marketing activities may guide administrators in evaluating information systems applications within their organizations.

Willingness To Pay For Advanced Traveler Information Systems, Smartraveler Case Study

DOT National Transportation Integrated Search

1997-01-01

THE INTRODUCTION OF NEW ADVANCED TRAVELER INFORMATION SYSTEM (ATIS) PRODUCTS AND SERVICES WILL CREATE A UNIQUE MARKET SITUATION; INITIALLY, TRAVELERS WILL LACK THE INFORMATION WITH WHICH TO EFFECTIVELY EVALUATE THESE PRODUCTS FOR POSSIBLE ADOPTION. S...

Evaluation of atmospheric density models and preliminary functional specifications for the Langley Atmospheric Information Retrieval System (LAIRS)

NASA Technical Reports Server (NTRS)

Lee, T.; Boland, D. F., Jr.

1980-01-01

This document presents the results of an extensive survey and comparative evaluation of current atmosphere and wind models for inclusion in the Langley Atmospheric Information Retrieval System (LAIRS). It includes recommended models for use in LAIRS, estimated accuracies for the recommended models, and functional specifications for the development of LAIRS.

Integrated Approach To Design And Analysis Of Systems

NASA Technical Reports Server (NTRS)

Patterson-Hine, F. A.; Iverson, David L.

1993-01-01

Object-oriented fault-tree representation unifies evaluation of reliability and diagnosis of faults. Programming/fault tree described more fully in "Object-Oriented Algorithm For Evaluation Of Fault Trees" (ARC-12731). Augmented fault tree object contains more information than fault tree object used in quantitative analysis of reliability. Additional information needed to diagnose faults in system represented by fault tree.

The Development and Evaluation of an Information Technology Support System to Facilitate Inter-Organisational Collaboration in HRD

ERIC Educational Resources Information Center

Ford, Norma J.

2006-01-01

Purpose: The purpose of this article is to evaluate the diffusion of and user response to an information technology support system (ITSS) which was designed to facilitate inter-organisational coordination and collaboration in the professional development of officers employed by local authorities (LAs). Design/methodology/approach: An action…

Evaluating Business Intelligence/Business Analytics Software for Use in the Information Systems Curriculum

ERIC Educational Resources Information Center

Davis, Gary Alan; Woratschek, Charles R.

2015-01-01

Business Intelligence (BI) and Business Analytics (BA) Software has been included in many Information Systems (IS) curricula. This study surveyed current and past undergraduate and graduate students to evaluate various BI/BA tools. Specifically, this study compared several software tools from two of the major software providers in the BI/BA field.…

How can routine health information systems improve health systems functioning in low- and middle-income countries? Assessing the evidence base.

PubMed

Hotchkiss, David R; Diana, Mark L; Foreit, Karen G Fleischman

2012-01-01

Health system performance depends on production and use of quality health data and information. Routine health information systems (RHIS) are defined as systems that provide information at regular intervals of a year or less to meet predictable information needs. These include paper-based or electronic health records and facility- and district-level management information systems. RHIS are receiving increasing attention as an essential component of efficient, country-owned, integrated national systems. To guide investment decisions on RHIS, evidence is needed on which types of RHIS interventions work and which do not. This chapter is a systematic review of the literature on the evaluation of RHIS interventions in low- and middle-income countries, starting from the premise that investments in RHIS could be better understood and so produce greater benefits than they currently do. We describe the conceptual literature on the determinants of RHIS performance and its role in improving health systems functioning, discuss the evidence base on the effectiveness of strategies to improve RHIS performance, provide an overview of RHIS evaluation challenges, and make suggestions to improve the evidence base. The goal is to help ensure that (a) RHIS interventions are appropriately designed and implemented to improve health systems functioning and (b) resulting RHIS information is used more effectively.

Transition of genomic evaluation from a research project to a production system

USDA-ARS?s Scientific Manuscript database

Genomic data began to be included in official USDA genetic evaluations of dairy cattle in January 2009. Numerous changes to the evaluation system were made to enable efficient management of genomic information, to incorporate it in official evaluations, and to distribute evaluations. Artificial-inse...

Selecting Data-Base Management Software for Microcomputers in Libraries and Information Units.

ERIC Educational Resources Information Center

Pieska, K. A. O.

1986-01-01

Presents a model for the evaluation of database management systems software from the viewpoint of librarians and information specialists. The properties of data management systems, database management systems, and text retrieval systems are outlined and compared. (10 references) (CLB)

78 FR 18362 - Proposed Information Collection for Public Comment: Enterprise Income Verification (EIV) Systems...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-26

... affected agencies concerning the proposed collection of information to: (1) Evaluate whether the proposed... user with information related to the Rules of Behavior for system usage and the user's responsibilities... DEPARTMENT OF HOUSING AND URBAN DEVELOPMENT [Docket No. FR-5690-N-05] Proposed Information...

77 FR 50548 - Agency Information Collection: (PACT Qualitative Evaluation: Patient & Caregiver Interviews...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-08-21

... Systems Redesign and the PACT Demo Lab innovations and will inform the redesign and demo lab innovations in real time. It will also gather information on patient characteristics and their experiences with... Patient Aligned Care Teams (PACT) Systems Redesign, document patients' and their informal caregivers...

Guide to the Use of Information. Question Negotiation, Search Delivery, Search Evaluation.

ERIC Educational Resources Information Center

Kansas State Dept. of Education, Topeka.

This guide to the use of information reviews the development of Kansas Project Communicate from 1972-1976, and the Kansas State Department of Education (KSDE) computerized information service (KEDDS), which serves as the resource component of the information dissemination system. KEDDS (Kansas Educational Dissemination Diffusion system) is…

Information systems as a quality management tool in clinical laboratories

NASA Astrophysics Data System (ADS)

Schmitz, Vanessa; Rosecler Bez el Boukhari, Marta

2007-11-01

This article describes information systems as a quality management tool in clinical laboratories. The quality of laboratory analyses is of fundamental importance for health professionals in aiding appropriate diagnosis and treatment. Information systems allow the automation of internal quality management processes, using standard sample tests, Levey-Jennings charts and Westgard multirule analysis. This simplifies evaluation and interpretation of quality tests and reduces the possibility of human error. This study proposes the development of an information system with appropriate functions and costs for the automation of internal quality control in small and medium-sized clinical laboratories. To this end, it evaluates the functions and usability of two commercial software products designed for this purpose, identifying the positive features of each, so that these can be taken into account during the development of the proposed system.

PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems

PubMed Central

Aqil, Anwer; Lippeveld, Theo; Hozumi, Dairiku

2009-01-01

The utility and effectiveness of routine health information systems (RHIS) in improving health system performance in developing countries has been questioned. This paper argues that the health system needs internal mechanisms to develop performance targets, track progress, and create and manage knowledge for continuous improvement. Based on documented RHIS weaknesses, we have developed the Performance of Routine Information System Management (PRISM) framework, an innovative approach to design, strengthen and evaluate RHIS. The PRISM framework offers a paradigm shift by putting emphasis on RHIS performance and incorporating the organizational, technical and behavioural determinants of performance. By describing causal pathways of these determinants, the PRISM framework encourages and guides the development of interventions for strengthening or reforming RHIS. Furthermore, it conceptualizes and proposes a methodology for measuring the impact of RHIS on health system performance. Ultimately, the PRISM framework, in spite of its challenges and competing paradigms, proposes a new agenda for building and sustaining information systems, for the promotion of an information culture, and for encouraging accountability in health systems. PMID:19304786

Tree Testing of Hierarchical Menu Structures for Health Applications

PubMed Central

Le, Thai; Chaudhuri, Shomir; Chung, Jane; Thompson, Hilaire J; Demiris, George

2014-01-01

To address the need for greater evidence-based evaluation of Health Information Technology (HIT) systems we introduce a method of usability testing termed tree testing. In a tree test, participants are presented with an abstract hierarchical tree of the system taxonomy and asked to navigate through the tree in completing representative tasks. We apply tree testing to a commercially available health application, demonstrating a use case and providing a comparison with more traditional in-person usability testing methods. Online tree tests (N=54) and in-person usability tests (N=15) were conducted from August to September 2013. Tree testing provided a method to quantitatively evaluate the information structure of a system using various navigational metrics including completion time, task accuracy, and path length. The results of the analyses compared favorably to the results seen from the traditional usability test. Tree testing provides a flexible, evidence-based approach for researchers to evaluate the information structure of HITs. In addition, remote tree testing provides a quick, flexible, and high volume method of acquiring feedback in a structured format that allows for quantitative comparisons. With the diverse nature and often large quantities of health information available, addressing issues of terminology and concept classifications during the early development process of a health information system will improve navigation through the system and save future resources. Tree testing is a usability method that can be used to quickly and easily assess information hierarchy of health information systems. PMID:24582924

Management Information Systems in the Public Sector. A Human Resources Management Course Monograph. No. 4.

ERIC Educational Resources Information Center

Cerveny, Robert P.

This curriculum guide provides an introduction to Management Information Systems (MIS) concepts and techniques for students preparing to develop MISs in professional settings, and to assist in MIS evaluation. According to the guide, students are exposed to concepts drawn from systems theory, information theory, management theory, data base…

Teacher Feedback and Student Academic Achievement: Teacher Use of Student Information Systems

ERIC Educational Resources Information Center

Bishop, Daniel J.

2013-01-01

In an era of professional standards for educators and teacher evaluations linked to measures of student achievement, researchers use data from student information systems to address research questions linking teacher feedback to student achievement. A quantitative study of teacher use of the Skyward student information system (SIS) was conducted…

The Washington experience (evaluation and selection of hardware for automated geo-based information systems)

NASA Technical Reports Server (NTRS)

Harding, R. A.

1981-01-01

A Washington geographic information system is described. The system has thrust from two different angles: the proprietary need for information to support the management of five million acres of thrust lands by the Department of Natural Resources, and the need for data over the entire state because of statewide governmental responsibilities. The data base includes information relevant to agricultural, forest, industrial, business, and community growth with emphasis on assembling information useful in setting intermediate and long-range goals. System selection procedures and system feasibility studies are discussed.

Strategies for more effective monitoring and evaluation systems in HIV programmatic scale-up in resource-limited settings: Implications for health systems strengthening.

PubMed

Nash, Denis; Elul, Batya; Rabkin, Miriam; Tun, May; Saito, Suzue; Becker, Mark; Nuwagaba-Biribonwoha, Harriet

2009-11-01

Program monitoring and evaluation (M&E) has the potential to be a cornerstone of health systems strengthening and of evidence-informed implementation and scale-up of HIV-related services in resource-limited settings. We discuss common challenges to M&E systems used in the rapid scale-up of HIV services as well as innovations that may have relevance to systems used to monitor, evaluate, and inform health systems strengthening. These include (1) Web-based applications with decentralized data entry and real-time access to summary reporting; (2) timely feedback of information to site and district staff; (3) site-level integration of traditionally siloed program area indicators; (4) longitudinal tracking of program and site characteristics; (5) geographic information systems; and (6) use of routinely collected aggregate data for epidemiologic analysis and operations research. Although conventionally used in the context of vertical programs, these approaches can form a foundation on which data relevant to other health services and systems can be layered, including prevention services, primary care, maternal-child health, and chronic disease management. Guiding principles for sustainable national M&E systems include country-led development and ownership, support for national programs and policies, interoperability, and employment of an open-source approach to software development.

CURMIS. Curriculum Management Information System (and) Prospectus of a Design to Assist a High School Staff in the Evaluation of Its Program.

ERIC Educational Resources Information Center

Sapone, Carmelo V.

CURMIS (Curriculum Management Information System) is a conceptual system, the framework of which is designed to identify and reveal relationships among complex related interacting phenomena. This paper is a description of the system which will centralize and make conveniently available information needed for developing and monitoring instructional…

Factors Leading to Effectiveness and Satisfaction in Civil Engineer Information Systems

DTIC Science & Technology

2008-03-01

recently acquired MySQL in 2008 shortly after Oracle failed to acquire MySQL in 2007. For more information on policy implications concerning the use...individual level serves as the pertinent outcome variable and is used to evaluate and compare information systems in this study. Researchers have found...interim work information management system used by the Civil Engineer Operations Flight. The functions served by this system date back to the late

ESEA Title I Evaluation and Reporting System: User's Guide.

ERIC Educational Resources Information Center

Tallmadge, G. Kasten; Wood, Christine T.

This guidebook concentrates primarily on describing the impact-assessment component of the Elementary and Secondary Education Act (ESEA) Title I evaluation and reporting system for users of the system. Three general evaluation models are presented, along with implementation information for each. The first model, a norm-referenced design, may be…

An Information System Development Method Connecting Business Process Modeling and its Experimental Evaluation

NASA Astrophysics Data System (ADS)

Okawa, Tsutomu; Kaminishi, Tsukasa; Kojima, Yoshiyuki; Hirabayashi, Syuichi; Koizumi, Hisao

Business process modeling (BPM) is gaining attention as a measure of analysis and improvement of the business process. BPM analyses the current business process as an AS-IS model and solves problems to improve the current business and moreover it aims to create a business process, which produces values, as a TO-BE model. However, researches of techniques that connect the business process improvement acquired by BPM to the implementation of the information system seamlessly are rarely reported. If the business model obtained by BPM is converted into UML, and the implementation can be carried out by the technique of UML, we can expect the improvement in efficiency of information system implementation. In this paper, we describe a method of the system development, which converts the process model obtained by BPM into UML and the method is evaluated by modeling a prototype of a parts procurement system. In the evaluation, comparison with the case where the system is implemented by the conventional UML technique without going via BPM is performed.

[A comparative study of coding and information systems for the evaluation of medical and social conditions: the case of addictive disorders].

PubMed

Bourdais-Mannone, Claire; Cherikh, Faredj; Gicquel, Nathalie; Gelsi, Eve; Jove, Frédérique; Staccini, Pascal

2011-01-01

The purpose of this study was to conduct a descriptive and comparative analysis of the tools used by healthcare professionals specializing in addictive disorders to promote a rapprochement of information systems. The evaluation guide used to assess the compensation needs of disabled persons treated in "Maisons Départementales des Personnes Handicapées" (centres for disabled people) organizes information in different areas, including a psychological component. The guide includes social and environmental information in the "Recueil Commun sur les Addictions et les Prises en charges" (Joint Report on Drug Addiction and Drug Treatment). While the program for the medicalization of information systems includes care data, the current information about social situations remains inadequate. The international classification of diseases provides synthetic diagnostic codes to describe substance use, etiologic factors and the somatic and psychological complications inherent to addictive disorders. The current system could be radically simplified and harmonized and would benefit from adopting a more individualized approach to non-substance behavioral addictions. The international classification of disabilities provides tools for evaluating the psychological component included in the recent definition of addictive disorders. Legal information should play an integral role in the structure of the information system and in international classifications. The prevalence of episodes of care and treatment of addictive and psychological disorders was assessed at Nice University Hospital in all disciplines. Except in addiction treatment units, very few patients were found to have a RECAP file.

Evaluation of the Central Puget Sound Regional Fare Coordination Project

DOT National Transportation Integrated Search

2000-03-01

Utah's basic highway information system is one of the most complete data base management systems found in any of the Highway Safety Information System (HSIS) States in terms of the number of files included in the system and the flexibility of output....

The Theory and Application of Information and Referral Systems in the University of Maryland Residence Halls

ERIC Educational Resources Information Center

Thoman, Cherie; Moore, Jerry E.

1977-01-01

This resource system consists of eight information and referral centers each housing a resource instrument (binders and flip chart), an operator, outreach staff, one mobile instrument, a systematic updating system and an evaluation system. (Author/DOW)

Theater Army Medical Management Information System: A MANPRINT evaluation

DTIC Science & Technology

1989-06-01

Management Information System (TAMMIS) and the division level version of the system, TAMMIS-D. TAMMIS/ TAMMIS-D are automated, on-line, interactive, microcomputer systems designed to manage combat medical information but capable of performing peacetime functions as well. The systems were developed to meet the needs of medical commanders by providing timely, accurate, and relevant information on the status of patients, medical units, and medical supplies on the battlefield. The IOT&E was conducted at Fort Lewis, WA in tents erected between two-story barracks

Advanced traveler information system (ATIS) implementation and integration. Task 11, evaluation report

DOT National Transportation Integrated Search

2007-05-16

Advanced Traveler Information Systems (ATIS) are an integral component of the concept of Intelligent Transportation Systems (ITS). ATIS are envisioned to enhance personal mobility, safety and the productivity of transportation. The primary services o...

Economic Evaluation of the Information Security Levels Achieved by Electric Energy Providers in North Arctic Region

NASA Astrophysics Data System (ADS)

Sushko, O. P.; Kaznin, A. A.; Babkin, A. V.; Bogdanov, D. A.

2017-10-01

The study we are conducting involves the analysis of information security levels achieved by energy providers operating in the North Arctic Region. We look into whether the energy providers’ current information security levels meet reliability standards and determine what further actions may be needed for upgrading information security in the context of the digital transformation that the world community is undergoing. When developing the information security systems for electric energy providers or selecting the protection means for them, we are governed by the fact that the assets to be protected are process technologies. While information security risk can be assessed using different methods, the evaluation of the economic damage from these risks appears to be a difficult task. The most probable and harmful risks we have identified when evaluating the electric energy providers’ information security will be used by us as variables. To provide the evaluation, it is necessary to calculate the costs relating to elimination of the risks identified. The final stage of the study will involve the development of an operation algorithm for the North Arctic Region’s energy provider’s business information protection security system - a set of information security services, and security software and hardware.

Evaluating the effects of cognitive support on psychiatric clinical comprehension.

PubMed

Dalai, Venkata V; Khalid, Sana; Gottipati, Dinesh; Kannampallil, Thomas; John, Vineeth; Blatter, Brett; Patel, Vimla L; Cohen, Trevor

2014-10-01

Clinicians' attention is a precious resource, which in the current healthcare practice is consumed by the cognitive demands arising from complex patient conditions, information overload, time pressure, and the need to aggregate and synthesize information from disparate sources. The ability to organize information in ways that facilitate the generation of effective diagnostic solutions is a distinguishing characteristic of expert physicians, suggesting that automated systems that organize clinical information in a similar manner may augment physicians' decision-making capabilities. In this paper, we describe the design and evaluation of a theoretically driven cognitive support system (CSS) that assists psychiatrists in their interpretation of clinical cases. The system highlights, and provides the means to navigate to, text that is organized in accordance with a set of diagnostically and therapeutically meaningful higher-level concepts. To evaluate the interface, 16 psychiatry residents interpreted two clinical case scenarios, with and without the CSS. Think-aloud protocols captured during their interpretation of the cases were transcribed and analyzed qualitatively. In addition, the frequency and relative position of content related to key higher-level concepts in a verbal summary of the case were evaluated. In addition the transcripts from both groups were compared to an expert derived reference standard using latent semantic analysis (LSA). Qualitative analysis showed that users of the system better attended to specific clinically important aspects of both cases when these were highlighted by the system, and revealed ways in which the system mediates hypotheses generation and evaluation. Analysis of the summary data showed differences in emphasis with and without the system. The LSA analysis suggested users of the system were more "expert-like" in their emphasis, and that cognitive support was more effective in the more complex case. Cognitive support impacts upon clinical comprehension. This appears to be largely helpful, but may also lead to neglect of information (such as the psychosocial history) that the system does not highlight. The results have implications for the design of CSSs for clinical narratives including the role of information organization and textual embellishments for more efficient clinical case presentation and comprehension. Copyright © 2014 Elsevier B.V. All rights reserved.

Evaluating the effects of cognitive support on psychiatric clinical comprehension

PubMed Central

Dalai, Venkata V.; Khalid, Sana; Gottipati, Dinesh; Kannampallil, Thomas; John, Vineeth; Blatter, Brett; Patel, Vimla L.; Cohen, Trevor

2014-01-01

Objective Clinicians’ attention is a precious resource, which in the current healthcare practice is consumed by the cognitive demands arising from complex patient conditions, information overload, time pressure, and the need to aggregate and synthesize information from disparate sources. The ability to organize information in ways that facilitate the generation of effective diagnostic solutions is a distinguishing characteristic of expert physicians, suggesting that automated systems that organize clinical information in a similar manner may augment physicians’ decision-making capabilities. In this paper, we describe the design and evaluation of a theoretically driven cognitive support system (CSS) that assists psychiatrists in their interpretation of clinical cases. The system highlights, and provides the means to navigate to, text that is organized in accordance with a set of diagnostically and therapeutically meaningful higher-level concepts. Methods and Materials To evaluate the interface, 16 psychiatry residents interpreted two clinical case scenarios, with and without the CSS. Think-aloud protocols captured during their interpretation of the cases were transcribed and analyzed qualitatively. In addition, the frequency and relative position of content related to key higher-level concepts in a verbal summary of the case were evaluated. In addition the transcripts from both groups were compared to an expert derived reference standard using latent semantic analysis (LSA). Results Qualitative analysis showed that users of the system better attended to specific clinically important aspects of both cases when these were highlighted by the system, and revealed ways in which the system mediates hypotheses generation and evaluation. Analysis of the summary data showed differences in emphasis with and without the system. The LSA analysis suggested users of the system were more “expert-like” in their emphasis, and that cognitive support was more effective in the more complex case. Conclusions Cognitive support impacts upon clinical comprehension. This appears to be largely helpful, but may also lead to neglect of information (such as the psychosocial history) that the system does not highlight. The results have implications for the design of CSSs for clinical narratives including the role of information organization and textual embellishments for more efficient clinical case presentation and comprehension. PMID:25179216

Multi criteria evaluation for universal soil loss equation based on geographic information system

NASA Astrophysics Data System (ADS)

Purwaamijaya, I. M.

2018-05-01

The purpose of this research were to produce(l) a conceptual, functional model designed and implementation for universal soil loss equation (usle), (2) standard operational procedure for multi criteria evaluation of universal soil loss equation (usle) using geographic information system, (3) overlay land cover, slope, soil and rain fall layers to gain universal soil loss equation (usle) using multi criteria evaluation, (4) thematic map of universal soil loss equation (usle) in watershed, (5) attribute table of universal soil loss equation (usle) in watershed. Descriptive and formal correlation methods are used for this research. Cikapundung Watershed, Bandung, West Java, Indonesia was study location. This research was conducted on January 2016 to May 2016. A spatial analysis is used to superimposed land cover, slope, soil and rain layers become universal soil loss equation (usle). Multi criteria evaluation for universal soil loss equation (usle) using geographic information system could be used for conservation program.

Effectiveness of nursing management information systems: a systematic review.

PubMed

Choi, Mona; Yang, You Lee; Lee, Sun-Mi

2014-10-01

The purpose of this study was to review evaluation studies of nursing management information systems (NMISs) and their outcome measures to examine system effectiveness. For the systematic review, a literature search of the PubMed, CINAHL, Embase, and Cochrane Library databases was conducted to retrieve original articles published between 1970 and 2014. Medical Subject Headings (MeSH) terms included informatics, medical informatics, nursing informatics, medical informatics application, and management information systems for information systems and evaluation studies and nursing evaluation research for evaluation research. Additionally, manag(*) and admin(*), and nurs(*) were combined. Title, abstract, and full-text reviews were completed by two reviewers. And then, year, author, type of management system, study purpose, study design, data source, system users, study subjects, and outcomes were extracted from the selected articles. The quality and risk of bias of the studies that were finally selected were assessed with the Risk of Bias Assessment Tool for Non-randomized Studies (RoBANS) criteria. Out of the 2,257 retrieved articles, a total of six articles were selected. These included two scheduling programs, two nursing cost-related programs, and two patient care management programs. For the outcome measurements, usefulness, time saving, satisfaction, cost, attitude, usability, data quality/completeness/accuracy, and personnel work patterns were included. User satisfaction, time saving, and usefulness mostly showed positive findings. The study results suggest that NMISs were effective in time saving and useful in nursing care. Because there was a lack of quality in the reviewed studies, well-designed research, such as randomized controlled trials, should be conducted to more objectively evaluate the effectiveness of NMISs.

Evaluation of transit applications of advanced parking management systems : final evaluation report

DOT National Transportation Integrated Search

2008-05-09

Throughout the United States, transportation agencies have begun implementing advanced parking information systems to increase customer satisfaction and to improve traffic operations. Through the use of variable message signs, these systems provide m...

Transparent Information Systems through Gateways, Front Ends, Intermediaries, and Interfaces.

ERIC Educational Resources Information Center

Williams, Martha E.

1986-01-01

Provides overview of design requirements for transparent information retrieval (implies that user sees through complexity of retrieval activities sequence). Highlights include need for transparent systems; history of transparent retrieval research; information retrieval functions (automated converters, routers, selectors, evaluators/analyzers);…

Learning from Action Evaluation of the Use of Multimedia Case Studies in Management Information Systems Courses

ERIC Educational Resources Information Center

Kawulich, Barbara B.

2011-01-01

This manuscript shares lessons learned from conducting an action evaluation of the use of multimedia case studies in Management Information Systems (MIS) courses. Three undergraduate MIS classes took part in the study. The purpose for using case studies in these classes was to teach students about the role of MIS in business. An action evaluation…

An Evaluation of Geographic Information Systems in Social Studies Lessons: Teachers' Views

ERIC Educational Resources Information Center

Aladag, Elif

2014-01-01

The aim of this study is to evaluate the applicability of Geographic Information Systems (GIS), used increasingly in primary and secondary education across the world, in social studies lessons in Turkey. In line with this aim, 14 social studies teachers working in the province of Aydin, Turkey received a 6-hour training course about GIS during the…

Intermediate Trends in Math and Science Partnership-Related Changes in Student Achievement with Management Information System Data

ERIC Educational Resources Information Center

Dimitrov, Dimiter M.

2009-01-01

This substudy in the evaluation design of the Math and Science Partnership (MSP) Program Evaluation examines student proficiency in mathematics and science for the MSPs' schools in terms of changes across three years (2003/04, 2004/05, and 2005/06) and relationships with MSP-related variables using Management Information System data with the…

An integrated approach to system design, reliability, and diagnosis

NASA Technical Reports Server (NTRS)

Patterson-Hine, F. A.; Iverson, David L.

1990-01-01

The requirement for ultradependability of computer systems in future avionics and space applications necessitates a top-down, integrated systems engineering approach for design, implementation, testing, and operation. The functional analyses of hardware and software systems must be combined by models that are flexible enough to represent their interactions and behavior. The information contained in these models must be accessible throughout all phases of the system life cycle in order to maintain consistency and accuracy in design and operational decisions. One approach being taken by researchers at Ames Research Center is the creation of an object-oriented environment that integrates information about system components required in the reliability evaluation with behavioral information useful for diagnostic algorithms. Procedures have been developed at Ames that perform reliability evaluations during design and failure diagnoses during system operation. These procedures utilize information from a central source, structured as object-oriented fault trees. Fault trees were selected because they are a flexible model widely used in aerospace applications and because they give a concise, structured representation of system behavior. The utility of this integrated environment for aerospace applications in light of our experiences during its development and use is described. The techniques for reliability evaluation and failure diagnosis are discussed, and current extensions of the environment and areas requiring further development are summarized.

An integrated approach to system design, reliability, and diagnosis

NASA Astrophysics Data System (ADS)

Patterson-Hine, F. A.; Iverson, David L.

1990-12-01

The requirement for ultradependability of computer systems in future avionics and space applications necessitates a top-down, integrated systems engineering approach for design, implementation, testing, and operation. The functional analyses of hardware and software systems must be combined by models that are flexible enough to represent their interactions and behavior. The information contained in these models must be accessible throughout all phases of the system life cycle in order to maintain consistency and accuracy in design and operational decisions. One approach being taken by researchers at Ames Research Center is the creation of an object-oriented environment that integrates information about system components required in the reliability evaluation with behavioral information useful for diagnostic algorithms. Procedures have been developed at Ames that perform reliability evaluations during design and failure diagnoses during system operation. These procedures utilize information from a central source, structured as object-oriented fault trees. Fault trees were selected because they are a flexible model widely used in aerospace applications and because they give a concise, structured representation of system behavior. The utility of this integrated environment for aerospace applications in light of our experiences during its development and use is described. The techniques for reliability evaluation and failure diagnosis are discussed, and current extensions of the environment and areas requiring further development are summarized.

Using evaluation to adapt health information outreach to the complex environments of community-based organizations.

PubMed

Olney, Cynthia A

2005-10-01

After arguing that most community-based organizations (CBOs) function as complex adaptive systems, this white paper describes the evaluation goals, questions, indicators, and methods most important at different stages of community-based health information outreach. This paper presents the basic characteristics of complex adaptive systems and argues that the typical CBO can be considered this type of system. It then presents evaluation as a tool for helping outreach teams adapt their outreach efforts to the CBO environment and thus maximize success. Finally, it describes the goals, questions, indicators, and methods most important or helpful at each stage of evaluation (community assessment, needs assessment and planning, process evaluation, and outcomes assessment). Literature from complex adaptive systems as applied to health care, business, and evaluation settings is presented. Evaluation models and applications, particularly those based on participatory approaches, are presented as methods for maximizing the effectiveness of evaluation in dynamic CBO environments. If one accepts that CBOs function as complex adaptive systems-characterized by dynamic relationships among many agents, influences, and forces-then effective evaluation at the stages of community assessment, needs assessment and planning, process evaluation, and outcomes assessment is critical to outreach success.

Collecting and Using Staff Performance Information for School Improvement.

ERIC Educational Resources Information Center

Tucker, Null A.

Use of multiple data sources for evaluation of faculty performance by the DeKalb County (Georgia) School System is described. Focus is on two evaluations, the administrator evaluation and the counselor evaluation; the former has been employed longer than any other component of the evaluation system, while the latter is scheduled for its second…

You've Been Evaluated. Now What?: Use Results to Pump up Professional Learning's Potential

ERIC Educational Resources Information Center

Hirsh, Stephanie

2013-01-01

This school year, countless teachers are participating in new evaluation systems. Individual teachers working on their own examining evaluation feedback will have valuable information to inform individual improvement. However, teacher evaluations have the potential to achieve more, and to do it more quickly, when they are part of a comprehensive…

Evaluating the sustainability of a regional system using Fisher information in the San Luis Basin, Colorado

EPA Science Inventory

This paper describes the theory, data, and methodology necessary for using Fisher information to assess the sustainability of the San Luis Basin (SLB) regional system over time. Fisher information was originally developed as a measure of the information content in data and is an ...

Global Land Information System (GLIS)

USGS Publications Warehouse

,

1992-01-01

The Global Land Information System (GLIS) is an interactive computer system developed by the U.S. Geological Survey (USGS) for scientists seeking sources of information about the Earth's land surfaces. GLIS contains "metadata," that is, descriptive information about data sets. Through GLIS, scientists can evaluate data sets, determine their availability, and place online requests for products. GLIS is more, however, than a mere list of products. It offers online samples of earth science data that may be ordered through the system.

Technology scan of future traveler information systems and applications in Georgia.

DOT National Transportation Integrated Search

2013-10-01

Statewide traveler information provided in Georgia through its NaviGAtor/5-1-1 system is : primarily based on Intelligent Transportation Systems (ITS) related to freeway traffic : management. The purpose of this study is to evaluate traveler informat...

Managing Multiple Sources of Information in an Independent K-12 Private School: A Case Study in a Student Information Systems Evaluation

ERIC Educational Resources Information Center

Yares, Ali Chava Kaufman

2010-01-01

Information is everywhere and finding the best method to manage it is a problem that all types of organizations have to deal with. Schools use Student Information Systems (SIS) to manage Student Data, Financial Information, Development, Human Resources, Admission, Financial Aid, Enrollment, Scheduling, and Health Information. A survey of 107…

From Paper to PDA: Design and Evaluation of a Clinical Ward Instruction on a Mobile Device

NASA Astrophysics Data System (ADS)

Kanstrup, Anne Marie; Stage, Jan

Mobile devices with small screens and minimal facilities for interaction are increasingly being used in complex human activities for accessing and processing information, while the user is moving. This paper presents a case study of the design and evaluation of a mobile system, which involved transformation of complex text and tables to digital format on a PDA. The application domain was an emergency medical ward, and the user group was junior registrars. We designed a PDA-based system for accessing information, focusing on the ward instruction, implemented a prototype and evaluated it for usability and utility. The evaluation results indicate significant problems in the interaction with the system as well as the extent to which the system is useful for junior registrars in their daily work.

A system dynamics evaluation model: implementation of health information exchange for public health reporting

PubMed Central

Merrill, Jacqueline A; Deegan, Michael; Wilson, Rosalind V; Kaushal, Rainu; Fredericks, Kimberly

2013-01-01

Objective To evaluate the complex dynamics involved in implementing electronic health information exchange (HIE) for public health reporting at a state health department, and to identify policy implications to inform similar implementations. Materials and methods Qualitative data were collected over 8 months from seven experts at New York State Department of Health who implemented web services and protocols for querying, receipt, and validation of electronic data supplied by regional health information organizations. Extensive project documentation was also collected. During group meetings experts described the implementation process and created reference modes and causal diagrams that the evaluation team used to build a preliminary model. System dynamics modeling techniques were applied iteratively to build causal loop diagrams representing the implementation. The diagrams were validated iteratively by individual experts followed by group review online, and through confirmatory review of documents and artifacts. Results Three casual loop diagrams captured well-recognized system dynamics: Sliding Goals, Project Rework, and Maturity of Resources. The findings were associated with specific policies that address funding, leadership, ensuring expertise, planning for rework, communication, and timeline management. Discussion This evaluation illustrates the value of a qualitative approach to system dynamics modeling. As a tool for strategic thinking on complicated and intense processes, qualitative models can be produced with fewer resources than a full simulation, yet still provide insights that are timely and relevant. Conclusions System dynamics techniques clarified endogenous and exogenous factors at play in a highly complex technology implementation, which may inform other states engaged in implementing HIE supported by federal Health Information Technology for Economic and Clinical Health (HITECH) legislation. PMID:23292910

A system dynamics evaluation model: implementation of health information exchange for public health reporting.

PubMed

Merrill, Jacqueline A; Deegan, Michael; Wilson, Rosalind V; Kaushal, Rainu; Fredericks, Kimberly

2013-06-01

To evaluate the complex dynamics involved in implementing electronic health information exchange (HIE) for public health reporting at a state health department, and to identify policy implications to inform similar implementations. Qualitative data were collected over 8 months from seven experts at New York State Department of Health who implemented web services and protocols for querying, receipt, and validation of electronic data supplied by regional health information organizations. Extensive project documentation was also collected. During group meetings experts described the implementation process and created reference modes and causal diagrams that the evaluation team used to build a preliminary model. System dynamics modeling techniques were applied iteratively to build causal loop diagrams representing the implementation. The diagrams were validated iteratively by individual experts followed by group review online, and through confirmatory review of documents and artifacts. Three casual loop diagrams captured well-recognized system dynamics: Sliding Goals, Project Rework, and Maturity of Resources. The findings were associated with specific policies that address funding, leadership, ensuring expertise, planning for rework, communication, and timeline management. This evaluation illustrates the value of a qualitative approach to system dynamics modeling. As a tool for strategic thinking on complicated and intense processes, qualitative models can be produced with fewer resources than a full simulation, yet still provide insights that are timely and relevant. System dynamics techniques clarified endogenous and exogenous factors at play in a highly complex technology implementation, which may inform other states engaged in implementing HIE supported by federal Health Information Technology for Economic and Clinical Health (HITECH) legislation.

Evaluating Organizational Performance: Rational, Natural, and Open System Models

ERIC Educational Resources Information Center

Martz, Wes

2013-01-01

As the definition of organization has evolved, so have the approaches used to evaluate organizational performance. During the past 60 years, organizational theorists and management scholars have developed a comprehensive line of thinking with respect to organizational assessment that serves to inform and be informed by the evaluation discipline.…

Cockpit display of hazardous weather information

NASA Technical Reports Server (NTRS)

Hansman, R. John, Jr.; Wanke, Craig

1991-01-01

Information transfer and display issues associated with the dissemination of hazardous weather warnings are studied in the context of wind shear alerts. Operational and developmental wind shear detection systems are briefly reviewed. The July 11, 1988 microburst events observed as part of the Denver Terminal Doppler Weather Radar (TDWR) operational evaluation are analyzed in terms of information transfer and the effectiveness of the microburst alerts. Information transfer, message content and display issues associated with microburst alerts generated from ground based sources (Doppler Radar, Low Level Wind Shear Alert System, and Pilot Reports) are evaluated by means fo pilot opinion surveys and part task simulator studies.

75 FR 39036 - Public Housing Assessment System (PHAS): Management Operations Certification

Federal Register 2010, 2011, 2012, 2013, 2014

2010-07-07

... System (PHAS): Management Operations Certification AGENCY: Office of the Chief Information Officer, HUD... Management Corporations) submit management information for evaluation of all major areas of a participant's management operations. The information is used to assess the management performance of PHAs. DATES: Comments...

Human factors evaluation of the effectiveness of multi-modality displays in advanced traveler information systems

DOT National Transportation Integrated Search

1999-12-01

To achieve the goals for Advanced Traveler Information Systems (ATIS), significant information will necessarily be provided to the driver. A primary ATIS design issue is the display modality (i.e., visual, auditory, or the combination) selected for p...

Re-Evaluating Course Evaluations: Clarity, Visibility, and Functionality

ERIC Educational Resources Information Center

Richardson, Stephanie Jean; Coleman, Darrell; Stephenson, Jill

2014-01-01

This article presents an innovative framework that provides a means to understand and reevaluate student course evaluation systems. We present three major concepts vital to course evaluation systems and explain how they inform five evolutionary stages. Additionally, we show how the major stakeholders--students, faculty and administrators--are…

WE-E-217A-02: Methodologies for Evaluation of Standalone CAD System Performance.

PubMed

Sahiner, B

2012-06-01

Standalone performance evaluation of a CAD system provides information about the abnormality detection or classification performance of the computerized system alone. Although the performance of the reader with CAD is the final step in CAD system assessment, standalone performance evaluation is an important component for several reasons: First, standalone evaluation informs the reader about the performance level of the CAD system and may have an impact on how the reader uses the system. Second, it provides essential information to the system designer for algorithm optimization during system development. Third, standalone evaluation can provide a detailed description of algorithm performance (e.g., on subgroups of the population) because a larger data set with more samples from different subgroups can be included in standalone studies compared to reader studies. Proper standalone evaluation of a CAD system involves a number of key components, some of which are shared with the assessment of reader performance with CAD. These include (1) selection of a test data set that allows performance assessment with little or no bias and acceptable uncertainty; (2) a reference standard that indicates disease status as well as the location and extent of disease; (3) a clearly defined method for labeling each CAD mark as a true-positive or false-positive; and (4) a properly selected set of metrics to summarize the accuracy of the computer marks and their corresponding scores. In this lecture, we will discuss various approaches for the key components of standalone CAD performance evaluation listed above, and present some of the recommendations and opinions from the AAPM CAD subcommittee on these issues. Learning Objectives 1. Identify basic components and metrics in the assessment of standalone CAD systems 2. Understand how each component may affect the assessed performance 3. Learn about AAPM CAD subcommittee's opinions and recommendations on factors and metrics related to the evaluation of standalone CAD system performance. © 2012 American Association of Physicists in Medicine.

Appliance of Independent Component Analysis to System Intrusion Analysis

NASA Astrophysics Data System (ADS)

Ishii, Yoshikazu; Takagi, Tarou; Nakai, Kouji

In order to analyze the output of the intrusion detection system and the firewall, we evaluated the applicability of ICA(independent component analysis). We developed a simulator for evaluation of intrusion analysis method. The simulator consists of the network model of an information system, the service model and the vulnerability model of each server, and the action model performed on client and intruder. We applied the ICA for analyzing the audit trail of simulated information system. We report the evaluation result of the ICA on intrusion analysis. In the simulated case, ICA separated two attacks correctly, and related an attack and the abnormalities of the normal application produced under the influence of the attach.

How Information Visualization Systems Change Users' Understandings of Complex Data

ERIC Educational Resources Information Center

Allendoerfer, Kenneth Robert

2009-01-01

User-centered evaluations of information systems often focus on the usability of the system rather its usefulness. This study examined how a using an interactive knowledge-domain visualization (KDV) system affected users' understanding of a domain. Interactive KDVs allow users to create graphical representations of domains that depict important…

Using heuristic evaluations to assess the safety of health information systems.

PubMed

Carvalho, Christopher J; Borycki, Elizabeth M; Kushniruk, Andre W

2009-01-01

Health information systems (HISs) are typically seen as a mechanism for reducing medical errors. There is, however, evidence to prove that technology may actually be the cause of errors. As a result, it is crucial to fully test any system prior to its implementation. At present, evidence-based evaluation heuristics do not exist for assessing aspects of interface design that lead to medical errors. A three phase study was conducted to develop evidence-based heuristics for evaluating interfaces. Phase 1 consisted of a systematic review of the literature. In Phase 2 a comprehensive list of 33 evaluation heuristics was developed based on the review that could be used to test for potential technology induced errors. Phase 3 involved applying these healthcare specific heuristics to evaluate a HIS.

Evaluating hospital information systems from the point of view of the medical records section users in Medical-Educational Hospitals of Kermanshah 2014.

PubMed

Rostami, S; Sarmad, A; Mohammadi, M; Cheleie, M; Amiri, S; Zardoei Golanbary, S H

2015-01-01

Evaluating hospital information systems leads to the improvement and devotion based on the users' needs, especially the medical records section users in hospitals, which are in contact with this system from the moment the patient enters the hospital until his/ her release and after that. The present research aimed to evaluate the hospital information systems from the point of view of the medical record section employees. Materials and method : The current research was applicative-descriptive analytical and the research society included 70 users of the medical history section in the educational-medical centers of Kermanshah city. The data-gathering tool was the 10th part of 9241/ 10 Isometric standard questionnaire of evaluating hospital information systems, with 75 specific questions in 7 bases, with the five spectra Likertt scale, its conceptual admissibility being confirmed in previous researches. 22 SPSS statistical software analyzed its permanency in the present study, which was also confirmed by Cronbach's's alpha test, which equaled to 0.89, and the data. Findings : The highest level of the employees' satisfaction, based on gained scores median, was respectively the incompatibility with the users' expectations, measuring 3.55, self-description measuring 3.54 and controllability - 3.51, which in total presented the average scores of 3.39, the lowest level of satisfaction being related to useful learning , whose value was 3.19. Discussion and conclusion : Hospital information systems' users believe that it is more desirable that the existing systems are based on the measures and consider them proper for making them non-governmental and useful for undesired learning. Considering the long distance of the existing information systems with the desired performance, it is essential that "these systems pay more attention to a more complete and deeper recognition and awareness of users' opinions and requirements in their road. The movement and development is to increase their chance in succeeding and achieving their goals, where the goal is to improve the patients' care and improve the health of the society members with the help of information technology.

The evaluation of hospital laboratory information management systems based on the standards of the American National Standard Institute

PubMed Central

Isfahani, Sakineh Saghaeiannejad; Khajouei, Reza; Jahanbakhsh, Maryan; Mirmohamadi, Mahboubeh

2014-01-01

Introduction: Nowadays, modern laboratories are faced with a huge volume of information. One of the goals of the Laboratory Information Management System (LIMS) is to assist in the management of the information generated in the laboratory. This study intends to evaluate the LIMS based on the standards of the American National Standard Institute (ANSI). Materials and Methods: This research is a descriptive–analytical study, which had been conducted in 2011, on the LIMSs in use, in the teaching and private hospitals in Isfahan. The data collecting instrument was a checklist, which was made by evaluating three groups of information components namely: ‘System capabilities’, ‘work list functions,’ and ‘reporting’ based on LIS8-A. Data were analyzed using the SPSS 20. Data were analyzed using (relative) frequency, percentage. To compare the data the following statistical tests were used: Leven test, t-test, and Analysis of Variance (ANOVA). Results: The results of the study indicated that the LIMS had a low conformity (30%) with LIS8-A (P = 0.001), with no difference between teaching and private hospitals (P = 0.806). The ANOVA revealed that in terms of conformity with the LIS8-A standard, there was a significant difference between the systems produced by different vendors (P = 0.023). According to the results, a Kowsar system with more than %57 conformity in the three groups of information components had a better conformity to the standard, compared to the other systems. Conclusions: This study indicated that none of the LIMSs had a good conformity to the standard. It seems that system providers did not pay sufficient attention to many of the information components required by the standards when designing and developing their systems. It was suggested that standards from certified organizations and institutions be followed in the design and development process of health information systems. PMID:25077154

The evaluation of hospital laboratory information management systems based on the standards of the American National Standard Institute.

PubMed

Isfahani, Sakineh Saghaeiannejad; Khajouei, Reza; Jahanbakhsh, Maryan; Mirmohamadi, Mahboubeh

2014-01-01

Nowadays, modern laboratories are faced with a huge volume of information. One of the goals of the Laboratory Information Management System (LIMS) is to assist in the management of the information generated in the laboratory. This study intends to evaluate the LIMS based on the standards of the American National Standard Institute (ANSI). This research is a descriptive-analytical study, which had been conducted in 2011, on the LIMSs in use, in the teaching and private hospitals in Isfahan. The data collecting instrument was a checklist, which was made by evaluating three groups of information components namely: 'System capabilities', 'work list functions,' and 'reporting' based on LIS8-A. Data were analyzed using the SPSS 20. Data were analyzed using (relative) frequency, percentage. To compare the data the following statistical tests were used: Leven test, t-test, and Analysis of Variance (ANOVA). The results of the study indicated that the LIMS had a low conformity (30%) with LIS8-A (P = 0.001), with no difference between teaching and private hospitals (P = 0.806). The ANOVA revealed that in terms of conformity with the LIS8-A standard, there was a significant difference between the systems produced by different vendors (P = 0.023). According to the results, a Kowsar system with more than %57 conformity in the three groups of information components had a better conformity to the standard, compared to the other systems. This study indicated that none of the LIMSs had a good conformity to the standard. It seems that system providers did not pay sufficient attention to many of the information components required by the standards when designing and developing their systems. It was suggested that standards from certified organizations and institutions be followed in the design and development process of health information systems.

Evaluation of the commercial vehicle information systems and networks (CVISN) model deployment initiative. Volume I, Final report

DOT National Transportation Integrated Search

2002-03-01

The Commercial Vehicle Information Systems and Networks Model Deployment Initiative (CVISN MDI) is funded by the Intelligent Transportation Systems Joint Program Office (ITS JPO) and managed by the Federal Motor Carrier Safety Administration (FMCSA),...

Evaluation of the commercial vehicle information systems and networks (CVISN) model deployment initiative. Volume II, Appendices

DOT National Transportation Integrated Search

2002-03-01

The Commercial Vehicle Information Systems and Networks Model Deployment Initiative (CVISN MDI) is funded by the Intelligent Transportation Systems Joint Program Office (ITS JPO) and managed by the Federal Motor Carrier Safety Administration (FMCSA),...

CVISN business case (commercial vehicle information systems and networks)

DOT National Transportation Integrated Search

2007-10-15

The objective was to evaluate economic justifications and institutional issues affecting motor carriers and State transportation agencies regarding the deployment of CVISN technologies. CVISN (Commercial Vehicle Information Systems and Networks) incl...

Performance and cost evaluation of health information systems using micro-costing and discrete-event simulation.

PubMed

Rejeb, Olfa; Pilet, Claire; Hamana, Sabri; Xie, Xiaolan; Durand, Thierry; Aloui, Saber; Doly, Anne; Biron, Pierre; Perrier, Lionel; Augusto, Vincent

2018-06-01

Innovation and health-care funding reforms have contributed to the deployment of Information and Communication Technology (ICT) to improve patient care. Many health-care organizations considered the application of ICT as a crucial key to enhance health-care management. The purpose of this paper is to provide a methodology to assess the organizational impact of high-level Health Information System (HIS) on patient pathway. We propose an integrated performance evaluation of HIS approach through the combination of formal modeling using the Architecture of Integrated Information Systems (ARIS) models, a micro-costing approach for cost evaluation, and a Discrete-Event Simulation (DES) approach. The methodology is applied to the consultation for cancer treatment process. Simulation scenarios are established to conclude about the impact of HIS on patient pathway. We demonstrated that although high level HIS lengthen the consultation, occupation rate of oncologists are lower and quality of service is higher (through the number of available information accessed during the consultation to formulate the diagnostic). The provided method allows also to determine the most cost-effective ICT elements to improve the care process quality while minimizing costs. The methodology is flexible enough to be applied to other health-care systems.

Evidence-based use of electronic clinical tracking systems in advanced practice registered nurse education: an integrative review.

PubMed

Branstetter, M Laurie; Smith, Lynette S; Brooks, Andrea F

2014-07-01

Over the past decade, the federal government has mandated healthcare providers to incorporate electronic health records into practice by 2015. This technological update in healthcare documentation has generated a need for advanced practice RN programs to incorporate information technology into education. The National Organization of Nurse Practitioner Faculties created core competencies to guide program standards for advanced practice RN education. One core competency is Technology and Information Literacy. Educational programs are moving toward the utilization of electronic clinical tracking systems to capture students' clinical encounter data. The purpose of this integrative review was to evaluate current research on advanced practice RN students' documentation of clinical encounters utilizing electronic clinical tracking systems to meet advanced practice RN curriculum outcome goals in information technology as defined by the National Organization of Nurse Practitioner Faculties. The state of the science depicts student' and faculty attitudes, preferences, opinions, and data collections of students' clinical encounters. Although electronic clinical tracking systems were utilized to track students' clinical encounters, these systems have not been evaluated for meeting information technology core competency standards. Educational programs are utilizing electronic clinical tracking systems with limited evidence-based literature evaluating the ability of these systems to meet the core competencies in advanced practice RN programs.

48 CFR 2015.305 - Proposal evaluation.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 6 2010-10-01 2010-10-01 true Proposal evaluation. 2015.305 Section 2015.305 Federal Acquisition Regulations System NUCLEAR REGULATORY COMMISSION CONTRACTING... information to members of the Source Evaluation Panel at the same time technical proposals are distributed for...

Economic evaluation: Concepts, selected studies, system costs, and a proposed program

NASA Technical Reports Server (NTRS)

Osterhoudt, F. H. (Principal Investigator)

1979-01-01

The more usual approaches to valuing crop information are reviewed and an integrated approach is recommended. Problems associated with implementation are examined. What has already been accomplished in the economic evaluation of LACIE-type information is reported including various studies of benefits. The costs of the existing and proposed systems are considered. A method and approach is proposed for further studies.

Using Modified-ISS Model to Evaluate Medication Administration Safety During Bar Code Medication Administration Implementation in Taiwan Regional Teaching Hospital.

PubMed

Ma, Pei-Luen; Jheng, Yan-Wun; Jheng, Bi-Wei; Hou, I-Ching

2017-01-01

Bar code medication administration (BCMA) could reduce medical errors and promote patient safety. This research uses modified information systems success model (M-ISS model) to evaluate nurses' acceptance to BCMA. The result showed moderate correlation between medication administration safety (MAS) to system quality, information quality, service quality, user satisfaction, and limited satisfaction.

Land surface Verification Toolkit (LVT)

NASA Technical Reports Server (NTRS)

Kumar, Sujay V.

2017-01-01

LVT is a framework developed to provide an automated, consolidated environment for systematic land surface model evaluation Includes support for a range of in-situ, remote-sensing and other model and reanalysis products. Supports the analysis of outputs from various LIS subsystems, including LIS-DA, LIS-OPT, LIS-UE. Note: The Land Information System Verification Toolkit (LVT) is a NASA software tool designed to enable the evaluation, analysis and comparison of outputs generated by the Land Information System (LIS). The LVT software is released under the terms and conditions of the NASA Open Source Agreement (NOSA) Version 1.1 or later. Land Information System Verification Toolkit (LVT) NOSA.

Field Evaluation of Detection-Control System

DOT National Transportation Integrated Search

2015-04-01

In this research, a field evaluation of the Detection-Control System (D-CS) was conducted at eight sites located in four States. D-CS is similar to a traditional advance detector system in that it uses information from detectors located upstream of t...

The evolution of educational information systems and nurse faculty roles.

PubMed

Nelson, Ramona; Meyers, Linda; Rizzolo, Mary Anne; Rutar, Pamela; Proto, Marcia B; Newbold, Susan

2006-01-01

Institutions of higher education are purchasing and/or designing sophisticated administrative information systems to manage such functions as the application, admissions, and registration process, grants management, student records, and classroom scheduling. Although faculty also manage large amounts of data, few automated systems have been created to help faculty improve teaching and learning through the management of information related to individual students, the curriculum, educational programs, and program evaluation. This article highlights the potential benefits that comprehensive educational information systems offer nurse faculty.

Photovoltaic system criteria documents. Volume 3: Environmental issues and evaluation criteria for photovoltaic applications

NASA Technical Reports Server (NTRS)

Koenig, John C.; Billitti, Joseph W.; Tallon, John M.

1979-01-01

The environmental issues and evaluation criteria relating to the suitability of sites proposed for photovoltaic (PV) system deployment are identified. The important issues are defined, briefly discussed and then developed into evaluation criteria. System designers are provided with information on the environmental sensitivity of PV systems in realistic applications, background material which indicates the applicability of the siting issues identified, and evaluation criteria are defined to facilitate the selection of sites that maximize PV system operation.

A new and trustworthy formalism to compute entropy in quantum systems

NASA Astrophysics Data System (ADS)

Ansari, Mohammad

Entropy is nonlinear in density matrix and as such its evaluation in open quantum system has not been fully understood. Recently a quantum formalism was proposed by Ansari and Nazarov that evaluates entropy using parallel time evolutions of multiple worlds. We can use this formalism to evaluate entropy flow in a photovoltaic cells coupled to thermal reservoirs and cavity modes. Recently we studied the full counting statistics of energy transfers in such systems. This rigorously proves a nontrivial correspondence between energy exchanges and entropy changes in quantum systems, which only in systems without entanglement can be simplified to the textbook second law of thermodynamics. We evaluate the flow of entropy using this formalism. In the presence of entanglement, however, interestingly much less information is exchanged than what we expected. This increases the upper limit capacity for information transfer and its conversion to energy for next generation devices in mesoscopic physics.

Icon and user interface design for emergency medical information systems: a case study.

PubMed

Salman, Y Batu; Cheng, Hong-In; Patterson, Patrick E

2012-01-01

A usable medical information system should allow for reliable and accurate interaction between users and the system in emergencies. A participatory design approach was used to develop a medical information system in two Turkish hospitals. The process consisted of task and user analysis, an icon design survey, initial icon design, final icon design and evaluation, and installation of the iconic medical information system with the icons. We observed work sites to note working processes and tasks related to the information system and interviewed medical personnel. Emergency personnel then participated in the design process to develop a usable graphical user interface, by drawing icon sketches for 23 selected tasks. Similar sketches were requested for specific tasks such as family medical history, contact information, translation, addiction, required inspections, requests and applications, and nurse observations. The sketches were analyzed and redesigned into computer icons by professional designers and the research team. A second group of physicians and nurses then tested the understandability of the icons. The user interface layout was examined and evaluated by system users, followed by the system's installation. Medical personnel reported the participatory design process was interesting and believed the resulting designs would be more familiar and friendlier. Copyright © 2011 Elsevier Ireland Ltd. All rights reserved.

FAST-TRAC evaluation : evaluation summary report

DOT National Transportation Integrated Search

FAST-TRAC is an Intelligent Transportation System (ITS) that integrates advanced traffic control with a variety of advanced traffic information systems through centralized collection, processing, and dissemination of traffic data. The Road Commission...

Evaluation of the Transit Reliability Information Program

DOT National Transportation Integrated Search

1982-06-01

This report presents an evaluation of the rail portion of the Transit Reliability Information Program (TRIP), which was designed to collect and analyze equipment reliability data on U.S. transit systems. This assessment was conducted at the end of it...

48 CFR 42.1503 - Procedures.

Code of Federal Regulations, 2010 CFR

2010-10-01

... CONTRACT ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 42.1503 Procedures. (a) Agency procedures for the past performance evaluation system shall generally provide for input to the.... Those individuals identified may obtain information for the evaluation of performance from the program...

An Evaluation of a Computer-Based Videotext Information Delivery System for Farmers: The Green Thumb Project.

ERIC Educational Resources Information Center

Warner, Paul D.; Clearfield, Frank

The Green Thumb Project was designed to test the feasibility of operating a computerized system for disseminating weather, market, and other agricultural production and management information on a day-to-day basis; to develop a prototype software support system for the test; and to provide essential project information on conduct of the test to…

[A development and evaluation of nursing KMS using QFD in outpatient departments].

PubMed

Lee, Han Na; Yun, Eun Kyoung

2014-02-01

This study was done to develop and implement the Nursing KMS (knowledge management system) in order to improve knowledge sharing and creation among clinical nurses in outpatient departments. This study was a methodological research using the 'System Development Life Cycle': consisting of planning, analyzing, design, implementation, and evaluation. Quality Function Deployment (QFD) was applied to establish nurse requirements and to identify important design requirements. Participants were 32 nurses and for evaluation data were collected pre and post intervention at K Hospital in Seoul, a tertiary hospital with over 1,000 beds. The Nursing KMS was built using a Linux-based operating system, Oracle DBMS, and Java 1.6 web programming tools. The system was implemented as a sub-system of the hospital information system. There was statistically significant differences in the sharing of knowledge but creating of knowledge was no statistically meaningful difference observed. In terms of satisfaction with the system, system efficiency ranked first followed by system convenience, information suitability and information usefulness. The results indicate that the use of Nursing KMS increases nurses' knowledge sharing and can contribute to increased quality of nursing knowledge and provide more opportunities for nurses to gain expertise from knowledge shared among nurses.

Web-Based Evaluation System for Learning Management Systems

ERIC Educational Resources Information Center

Momani, Alaa

2010-01-01

E-learning systems have become an issue in recent years. A learning management system (LMS) is an electronic environment helps the educational society to communicate, exchange information, manage, and schedule the learning process. This study has provided a web-based evaluation system that may help the users to choose the convenient system…

Fuzzy Comprehensive Evaluation of Rural Information Poverty in China - - Case Study of Hebei Province

NASA Astrophysics Data System (ADS)

Sun, Guizhen; Wang, Shuanjun; Li, Yaqing; Wang, Huijun

Information poverty is a new form of poverty in information society. With the growing information-gap between urban and rural areas, information poverty is prevailing in the vast rural areas in China. It is largely restricted the new rural construction and the social harmonious development of villages and towns and must be resolved. The evaluation of rural information poverty is the premise to resolve it. In order to estimate the problem, index system of rural informatization evaluation of Hebei province was designed by means of Delphi. Then, according to the survey of farmers' information demand, AHP and FCE were used to estimate rural information poverty of Hebei province. The purpose of this study is to provide a new operational approach in evaluating or solving rural information poverty and constructing rural informatization in China.

Effectiveness of Nursing Management Information Systems: A Systematic Review

PubMed Central

Choi, Mona; Yang, You Lee

2014-01-01

Objectives The purpose of this study was to review evaluation studies of nursing management information systems (NMISs) and their outcome measures to examine system effectiveness. Methods For the systematic review, a literature search of the PubMed, CINAHL, Embase, and Cochrane Library databases was conducted to retrieve original articles published between 1970 and 2014. Medical Subject Headings (MeSH) terms included informatics, medical informatics, nursing informatics, medical informatics application, and management information systems for information systems and evaluation studies and nursing evaluation research for evaluation research. Additionally, manag* and admin*, and nurs* were combined. Title, abstract, and full-text reviews were completed by two reviewers. And then, year, author, type of management system, study purpose, study design, data source, system users, study subjects, and outcomes were extracted from the selected articles. The quality and risk of bias of the studies that were finally selected were assessed with the Risk of Bias Assessment Tool for Non-randomized Studies (RoBANS) criteria. Results Out of the 2,257 retrieved articles, a total of six articles were selected. These included two scheduling programs, two nursing cost-related programs, and two patient care management programs. For the outcome measurements, usefulness, time saving, satisfaction, cost, attitude, usability, data quality/completeness/accuracy, and personnel work patterns were included. User satisfaction, time saving, and usefulness mostly showed positive findings. Conclusions The study results suggest that NMISs were effective in time saving and useful in nursing care. Because there was a lack of quality in the reviewed studies, well-designed research, such as randomized controlled trials, should be conducted to more objectively evaluate the effectiveness of NMISs. PMID:25405060

Information technology model for evaluating emergency medicine teaching

NASA Astrophysics Data System (ADS)

Vorbach, James; Ryan, James

1996-02-01

This paper describes work in progress to develop an Information Technology (IT) model and supporting information system for the evaluation of clinical teaching in the Emergency Medicine (EM) Department of North Shore University Hospital. In the academic hospital setting student physicians, i.e. residents, and faculty function daily in their dual roles as teachers and students respectively, and as health care providers. Databases exist that are used to evaluate both groups in either academic or clinical performance, but rarely has this information been integrated to analyze the relationship between academic performance and the ability to care for patients. The goal of the IT model is to improve the quality of teaching of EM physicians by enabling the development of integrable metrics for faculty and resident evaluation. The IT model will include (1) methods for tracking residents in order to develop experimental databases; (2) methods to integrate lecture evaluation, clinical performance, resident evaluation, and quality assurance databases; and (3) a patient flow system to monitor patient rooms and the waiting area in the Emergency Medicine Department, to record and display status of medical orders, and to collect data for analyses.

A system for evaluating the use of media in CDC's National AIDS Information and Education Program.

PubMed

Salmon, C T; Jason, J

1991-01-01

The National AIDS Information and Education Program (NAIEP) commissioned the National Academy of Sciences to design a prototypical system of research for use in the evaluation of the agency's media campaign. It consists of four types of evaluation: formative, efficacy, process, and outcome. These types of evaluations are used to answer such questions as the following: What message strategies will work best? Can a campaign under optimal conditions be expected to make a difference? What interventions are actually delivered during the campaign? Has the campaign actually had an impact? How NAIEP has used the system and adapted it during 1 year of research activities is outlined, and examples from a variety of other social marketing programs are described.

Pilot Test and Evaluation of a System of Computer-Managed Instruction.

ERIC Educational Resources Information Center

Spuck, Dennis W.; Bozeman, William C.

1978-01-01

The Wisconsin System for Instructional Management (WIS SIM) was evaluated on three dimensions (functioning, utilization, and effects) and the information gathered was classified into three types--actual, perceptual, and judgmental. The test demonstrates that a system supportive of an individualized system of education can be designed, developed,…

Atlanta congestion reduction demonstration. National evaluation : content analysis test plan.

DOT National Transportation Integrated Search

2000-05-30

Commercial Vehicle Information Systems and Networks (CVISN) is the collection of information systems and communication networks that support commercial vehicle operations (CVO.) The National ITS Architecture provides a technical framework that descri...

MOICC and GIS: An Impact Study. Final Evaluation Report.

ERIC Educational Resources Information Center

Ryan, Charles W.; Drummond, Robert J.

The Guidance Information System (GIS) is a statewide computer-based career information system developed by the Maine Occupational Information Coordinating Committee (MOICC). A time-series design was utilized to investigate the impact of GIS on selected users in public schools and agencies. Participants completed questionnaires immediately after…

48 CFR 815.404-2 - Information to support proposal analysis.

Code of Federal Regulations, 2013 CFR

2013-10-01

...-2 Information to support proposal analysis. In evaluating start-up and other non-recurring costs... 48 Federal Acquisition Regulations System 5 2013-10-01 2013-10-01 false Information to support proposal analysis. 815.404-2 Section 815.404-2 Federal Acquisition Regulations System DEPARTMENT OF...

48 CFR 815.404-2 - Information to support proposal analysis.

Code of Federal Regulations, 2010 CFR

2010-10-01

...-2 Information to support proposal analysis. In evaluating start-up and other non-recurring costs... 48 Federal Acquisition Regulations System 5 2010-10-01 2010-10-01 false Information to support proposal analysis. 815.404-2 Section 815.404-2 Federal Acquisition Regulations System DEPARTMENT OF...

48 CFR 815.404-2 - Information to support proposal analysis.

Code of Federal Regulations, 2014 CFR

2014-10-01

...-2 Information to support proposal analysis. In evaluating start-up and other non-recurring costs... 48 Federal Acquisition Regulations System 5 2014-10-01 2014-10-01 false Information to support proposal analysis. 815.404-2 Section 815.404-2 Federal Acquisition Regulations System DEPARTMENT OF...

48 CFR 815.404-2 - Information to support proposal analysis.

Code of Federal Regulations, 2012 CFR

2012-10-01

...-2 Information to support proposal analysis. In evaluating start-up and other non-recurring costs... 48 Federal Acquisition Regulations System 5 2012-10-01 2012-10-01 false Information to support proposal analysis. 815.404-2 Section 815.404-2 Federal Acquisition Regulations System DEPARTMENT OF...

48 CFR 815.404-2 - Information to support proposal analysis.

Code of Federal Regulations, 2011 CFR

2011-10-01

...-2 Information to support proposal analysis. In evaluating start-up and other non-recurring costs... 48 Federal Acquisition Regulations System 5 2011-10-01 2011-10-01 false Information to support proposal analysis. 815.404-2 Section 815.404-2 Federal Acquisition Regulations System DEPARTMENT OF...

CHARACTERIZATION OF DATA VARIABILITY AND UNCERTAINTY: HEALTH EFFECTS ASSESSMENTS IN THE INTEGRATED RISK INFORMATION SYSTEM (IRIS)

EPA Science Inventory

In response to a Congressional directive contained in HR 106-379 regarding EPA's appropriations for FY2000, EPA has undertaken an evaluation of the characterization of data variability and uncertainty in its Integrated Risk Information System (IRIS) health effects information dat...

User-oriented evaluation of a medical image retrieval system for radiologists.

PubMed

Markonis, Dimitrios; Holzer, Markus; Baroz, Frederic; De Castaneda, Rafael Luis Ruiz; Boyer, Célia; Langs, Georg; Müller, Henning

2015-10-01

This article reports the user-oriented evaluation of a text- and content-based medical image retrieval system. User tests with radiologists using a search system for images in the medical literature are presented. The goal of the tests is to assess the usability of the system, identify system and interface aspects that need improvement and useful additions. Another objective is to investigate the system's added value to radiology information retrieval. The study provides an insight into required specifications and potential shortcomings of medical image retrieval systems through a concrete methodology for conducting user tests. User tests with a working image retrieval system of images from the biomedical literature were performed in an iterative manner, where each iteration had the participants perform radiology information seeking tasks and then refining the system as well as the user study design itself. During these tasks the interaction of the users with the system was monitored, usability aspects were measured, retrieval success rates recorded and feedback was collected through survey forms. In total, 16 radiologists participated in the user tests. The success rates in finding relevant information were on average 87% and 78% for image and case retrieval tasks, respectively. The average time for a successful search was below 3 min in both cases. Users felt quickly comfortable with the novel techniques and tools (after 5 to 15 min), such as content-based image retrieval and relevance feedback. User satisfaction measures show a very positive attitude toward the system's functionalities while the user feedback helped identifying the system's weak points. The participants proposed several potentially useful new functionalities, such as filtering by imaging modality and search for articles using image examples. The iterative character of the evaluation helped to obtain diverse and detailed feedback on all system aspects. Radiologists are quickly familiar with the functionalities but have several comments on desired functionalities. The analysis of the results can potentially assist system refinement for future medical information retrieval systems. Moreover, the methodology presented as well as the discussion on the limitations and challenges of such studies can be useful for user-oriented medical image retrieval evaluation, as user-oriented evaluation of interactive system is still only rarely performed. Such interactive evaluations can be limited in effort if done iteratively and can give many insights for developing better systems. Copyright © 2015. Published by Elsevier Ireland Ltd.

Advanced traveler information systems (ATIS) : development and testing of a surveillance and delay advisory system for rural areas, and evaluation of satellite communications system for mayday applications

DOT National Transportation Integrated Search

1999-04-01

In early 1993, the Federal Highway Administration (FHWA) initiated a comprehensive study of rural applications of Advanced Traveler Information Systems (ATIS). The study objectives were to guide Federal programs with respect to Intelligent Transporta...

[Evaluation and analysis of monitoring and early warning functions of the occupational disease reporting system in China].

PubMed

Zhu, Xiaojun; Li, Tao; Liu, Mengxuan

2015-06-01

To evaluate the monitoring and early warning functions of the occupational disease reporting system right now in China, and to analyze their influencing factors. An improved audit tool (ODIT) was used to score the monitoring and early warning functions with a total score of 10. The nine indices were completeness of information on the reporting form, coverage of the reporting system, accessibility of criteria or guidelines for diagnosis, education and training for physicians, completeness of the reporting system, statistical methods, investigation of special cases, release of monitoring information, and release of early warning information. According to the evaluation, the occupational disease reporting system in China had a score of 5.5 in monitoring existing occupational diseases with a low score for release of monitoring information; the reporting system had a score of 6.5 in early warning of newly occurring occupational diseases with low scores for education and training for physicians as well as completeness of the reporting system. The occupational disease reporting system in China still does not have full function in monitoring and early warning. It is the education and participation of physicians from general hospitals in the diagnosis and treatment of occupational diseases and suspected occupational diseases that need to be enhanced. In addition, the problem of monitoring the incidence of occupational diseases needs to be solved as soon as possible.

A health literacy and usability heuristic evaluation of a mobile consumer health application.

PubMed

Monkman, Helen; Kushniruk, Andre

2013-01-01

Usability and health literacy are two critical factors in the design and evaluation of consumer health information systems. However, methods for evaluating these two factors in conjunction remain limited. This study adapted a set of existing guidelines for the design of consumer health Web sites into evidence-based evaluation heuristics tailored specifically for mobile consumer health applications. In order to test the approach, a mobile consumer health application (app) was then evaluated using these heuristics. In addition to revealing ways to improve the usability of the system, this analysis identified opportunities to augment the content to make it more understandable by users with limited health literacy. This study successfully demonstrated the utility of converting existing design guidelines into heuristics for the evaluation of usability and health literacy. The heuristics generated could be applied for assessing and revising other existing consumer health information systems.

The MiPACQ clinical question answering system.

PubMed

Cairns, Brian L; Nielsen, Rodney D; Masanz, James J; Martin, James H; Palmer, Martha S; Ward, Wayne H; Savova, Guergana K

2011-01-01

The Multi-source Integrated Platform for Answering Clinical Questions (MiPACQ) is a QA pipeline that integrates a variety of information retrieval and natural language processing systems into an extensible question answering system. We present the system's architecture and an evaluation of MiPACQ on a human-annotated evaluation dataset based on the Medpedia health and medical encyclopedia. Compared with our baseline information retrieval system, the MiPACQ rule-based system demonstrates 84% improvement in Precision at One and the MiPACQ machine-learning-based system demonstrates 134% improvement. Other performance metrics including mean reciprocal rank and area under the precision/recall curves also showed significant improvement, validating the effectiveness of the MiPACQ design and implementation.

Development and Initial Evaluation of an Acceptance Testing Procedure for Air Supply and Distribution Systems in New Army Facilities

DTIC Science & Technology

1988-09-01

Unfortunately, although current construction practices can produce functional HVAC systems that provide adequate heating and cooling , they do not guarantee...developed by interviewing heating, ventilating, and air-conditioning ( HVAC ) profes- sionals, reviewing technical literature, and consolidating these...for recording this information. A glossary of possibly unfamiliar HVAC terms is included. An informal evaluation of the procedure showed that

Evaluation of VICAR software capability for land information support system needs. [Elk River quadrangle, Idaho

NASA Technical Reports Server (NTRS)

Yao, S. S. (Principal Investigator)

1981-01-01

A preliminary evaluation of the processing capability of the VICAR software for land information support system needs is presented. The geometric and radiometric properties of four sets of LANDSAT data taken over the Elk River, Idaho quadrangle were compared. Storage of data sets, the means of location, pixel resolution, and radiometric and geometric characteristics are described. Recommended modifications of VICAR programs are presented.

THE CAUSAL ANALYSIS / DIAGNOSIS DECISION INFORMATION SYSTEM (CADDIS) - 2007 UPDATE

EPA Science Inventory

CADDIS is an on-line decision support system that helps investigators in the regions, states and tribes find, access, organize, use and share information to produce causal evaluations in aquatic systems. It is based ...

In-vehicle Information Systems Behavioral Model and Design Support: IVIS Demand Prototype Software User’s Manual

DOT National Transportation Integrated Search

2000-03-06

The purpose of this research was to develop a behavioral model and prototype computer program for evaluation of modern in-vehicle information systems (IVIS). These systems differ from earlier in-vehicle instruments and displays in that they may requi...

In-Vehicle Information Systems Behavioral Model and Design Support: IVIS Demand Prototype Software User's Manual

DOT National Transportation Integrated Search

2000-03-06

The purpose of this research was to develop a behavioral model and prototype computer program for evaluation of modern in-vehicle information systems (IVIS). These systems differ from earlier in-vehicle instruments and displays in that they may requi...

Process evaluation distributed system

NASA Technical Reports Server (NTRS)

Moffatt, Christopher L. (Inventor)

2006-01-01

The distributed system includes a database server, an administration module, a process evaluation module, and a data display module. The administration module is in communication with the database server for providing observation criteria information to the database server. The process evaluation module is in communication with the database server for obtaining the observation criteria information from the database server and collecting process data based on the observation criteria information. The process evaluation module utilizes a personal digital assistant (PDA). A data display module in communication with the database server, including a website for viewing collected process data in a desired metrics form, the data display module also for providing desired editing and modification of the collected process data. The connectivity established by the database server to the administration module, the process evaluation module, and the data display module, minimizes the requirement for manual input of the collected process data.

The State of Retrieval System Evaluation.

ERIC Educational Resources Information Center

Salton, Gerald

1992-01-01

The current state of information retrieval (IR) evaluation is reviewed with criticisms directed at the available test collections and the research and evaluation methodologies used, including precision and recall rates for online searches and laboratory tests not including real users. Automatic text retrieval systems are also discussed. (32…

Information requirements of the National Aeronautics and Space Administration's safety, environmental health, and occupational medicine programs

NASA Technical Reports Server (NTRS)

Whyte, A. A.

1978-01-01

A survey of the internal and external reporting and recordkeeping procedures of these programs was conducted and the major problems associated with them are outlined. The impact of probable future requirements on existing information systems is evaluated. This report also presents the benefits of combining the safety and health information systems into one computerized system and recommendations for the development and scope of that system.

Environmental Public Health Tracking: Health and Environment Linked for Information Exchange-Atlanta (HEXIX-Atlanta: A cooperative Program Between CDC and NASA for Development of an Environmental Public Health Tracking Network in the Atlanta Metropolitan Area

NASA Technical Reports Server (NTRS)

Quattrochi, Dale A.; Niskar, Amanda Sue

2005-01-01

The Centers for Disease Control and Prevention (CDC) is coordinating HELIX- Atlanta to provide information regarding the five-county Metropolitan Atlanta Area (Clayton, Cobb, DeKalb, Fulton, and Gwinett) via a network of integrated environmental monitoring and public health data systems so that all sectors can take action to prevent and control environmentally related health effects. The HELIX-Atlanta Network is a tool to access interoperable information systems with optional information technology linkage functionality driven by scientific rationale. HELIX-Atlanta is a collaborative effort with local, state, federal, and academic partners, including the NASA Marshall Space Flight Center. The HELIX-Atlanta Partners identified the following HELIX-Atlanta initial focus areas: childhood lead poisoning, short-latency cancers, developmental disabilities, birth defects, vital records, respiratory health, age of housing, remote sensing data, and environmental monitoring, HELIX-Atlanta Partners identified and evaluated information systems containing information on the above focus areas. The information system evaluations resulted in recommendations for what resources would be needed to interoperate selected information systems in compliance with the CDC Public Health Information Network (PHIN). This presentation will discuss the collaborative process of building a network that links health and environment data for information exchange, including NASA remote sensing data, for use in HELIX-Atlanta.

Application of structured analysis to a telerobotic system

NASA Technical Reports Server (NTRS)

Dashman, Eric; Mclin, David; Harrison, F. W.; Soloway, Donald; Young, Steven

1990-01-01

The analysis and evaluation of a multiple arm telerobotic research and demonstration system developed by the NASA Intelligent Systems Research Laboratory (ISRL) is described. Structured analysis techniques were used to develop a detailed requirements model of an existing telerobotic testbed. Performance models generated during this process were used to further evaluate the total system. A commercial CASE tool called Teamwork was used to carry out the structured analysis and development of the functional requirements model. A structured analysis and design process using the ISRL telerobotic system as a model is described. Evaluation of this system focused on the identification of bottlenecks in this implementation. The results demonstrate that the use of structured methods and analysis tools can give useful performance information early in a design cycle. This information can be used to ensure that the proposed system meets its design requirements before it is built.

Quality evaluation on an e-learning system in continuing professional education of nurses.

PubMed

Lin, I-Chun; Chien, Yu-Mei; Chang, I-Chiu

2006-01-01

Maintaining high quality in Web-based learning is a powerful means of increasing the overall efficiency and effectiveness of distance learning. Many studies have evaluated Web-based learning but seldom evaluate from the information systems (IS) perspective. This study applied the famous IS Success model in measuring the quality of a Web-based learning system using a Web-based questionnaire for data collection. One hundred and fifty four nurses participated in the survey. Based on confirmatory factor analysis, the variables of the research model fit for measuring the quality of a Web-based learning system. As Web-based education continues to grow worldwide, the results of this study may assist the system adopter (hospital executives), the learner (nurses), and the system designers in making reasonable and informed judgments with regard to the quality of Web-based learning system in continuing professional education.

Service Evaluation in a Special Library: Supporting Development Research at the Institute of Social Sciences Library, New Delhi.

ERIC Educational Resources Information Center

Ghosh, Sharmila

2003-01-01

Discusses the development of special libraries to meet demands of interdisciplinary information and describes the library at The Institute of Social Sciences, New Delhi (India) which establishes a synergy between research and information derived from research through a computerized information management system. Considers evaluation of special…

Integrated corridor management initiative : demonstration phase evaluation, San Diego traveler response analysis test plan.

DOT National Transportation Integrated Search

1995-10-01

REAL-TIME TRAFFIC INFORMATION, ROUTE GUIDANCE, ROUTE PLANNING, INTELLIGENT VEHICLE INITIATIVE OR IVI ">">KEYWORDS: OPERATIONAL TESTS, TRAVTEK, ADVANCED TRAVELER INFORMATION SYSTEMS OR ATIS, ADVANCED TRAFFIC MANAGEMENT SYSTEMS OR ATMS, INTELLI...

System and method for non-destructive evaluation of surface characteristics of a magnetic material

DOEpatents

Jiles, David C.; Sipahi, Levent B.

1994-05-17

A system and a related method for non-destructive evaluation of the surface characteristics of a magnetic material. The sample is excited by an alternating magnetic field. The field frequency, amplitude and offset are controlled according to a predetermined protocol. The Barkhausen response of the sample is detected for the various fields and offsets and is analyzed. The system produces information relating to the frequency content, the amplitude content, the average or RMS energy content, as well as count rate information, for each of the Barkhausen responses at each of the excitation levels applied during the protocol. That information provides a contiguous body of data, heretofore unavailable, which can be analyzed to deduce information about the surface characteristics of the material at various depths below the surface.

System status display evaluation

NASA Technical Reports Server (NTRS)

Summers, Leland G.

1988-01-01

The System Status Display is an electronic display system which provides the crew with an enhanced capability for monitoring and managing the aircraft systems. A flight simulation in a fixed base cockpit simulator was used to evaluate alternative design concepts for this display system. The alternative concepts included pictorial versus alphanumeric text formats, multifunction versus dedicated controls, and integration of the procedures with the system status information versus paper checklists. Twelve pilots manually flew approach patterns with the different concepts. System malfunctions occurred which required the pilots to respond to the alert by reconfiguring the system. The pictorial display, the multifunction control interfaces collocated with the system display, and the procedures integrated with the status information all had shorter event processing times and lower subjective workloads.

On-board Attitude Determination System (OADS). [for advanced spacecraft missions

NASA Technical Reports Server (NTRS)

Carney, P.; Milillo, M.; Tate, V.; Wilson, J.; Yong, K.

1978-01-01

The requirements, capabilities and system design for an on-board attitude determination system (OADS) to be flown on advanced spacecraft missions were determined. Based upon the OADS requirements and system performance evaluation, a preliminary on-board attitude determination system is proposed. The proposed OADS system consists of one NASA Standard IRU (DRIRU-2) as the primary attitude determination sensor, two improved NASA Standard star tracker (SST) for periodic update of attitude information, a GPS receiver to provide on-board space vehicle position and velocity vector information, and a multiple microcomputer system for data processing and attitude determination functions. The functional block diagram of the proposed OADS system is shown. The computational requirements are evaluated based upon this proposed OADS system.

Alternative Techniques for Testing A Highway Information Systems

NASA Technical Reports Server (NTRS)

Mast, Truman; Mast, Truman

1974-01-01

The highway transport system as contrasted with other modes of transportation is quite unique in that the users of the system are responsible for the guidance and control functions of the vehicle. Research has shown that improved forms of motorist information, such as highway signs and markings, can enhance the predictability and reliability of the driving task. Test and evaluation of promising new concepts in motorist information must preceed widespread endorsement and implementation on our highway system. This paper reviews the merits and limitations of presently available human factor research techniques--laboratory, instrumented vehicle and traffic performance studies on operational facilities--for evaluating the efficacy of motorist information concepts. Specific examples are given to demonstrate the utility and the interrelationships of the alternative research techniques and there is a discussion of the most pressing immediate and future needs for improved highway signing and road marking research methodology.

Program Evaluation Grant. Final Report.

ERIC Educational Resources Information Center

Quadco Rehabilitation Center, Inc., Stryker, OH.

The purpose of the project was to increase the effectiveness and efficiency of those rehabilitation facilities which were utilized by the Ohio Rehabilitation Services Commission (RSC) through the development, installation, and utilization of a program evaluation system and a management information system. The two systems were developed and…

Quality evaluation of health information system's architectures developed using the HIS-DF methodology.

PubMed

López, Diego M; Blobel, Bernd; Gonzalez, Carolina

2010-01-01

Requirement analysis, design, implementation, evaluation, use, and maintenance of semantically interoperable Health Information Systems (HIS) have to be based on eHealth standards. HIS-DF is a comprehensive approach for HIS architectural development based on standard information models and vocabulary. The empirical validity of HIS-DF has not been demonstrated so far. Through an empirical experiment, the paper demonstrates that using HIS-DF and HL7 information models, semantic quality of HIS architecture can be improved, compared to architectures developed using traditional RUP process. Semantic quality of the architecture has been measured in terms of model's completeness and validity metrics. The experimental results demonstrated an increased completeness of 14.38% and an increased validity of 16.63% when using the HIS-DF and HL7 information models in a sample HIS development project. Quality assurance of the system architecture in earlier stages of HIS development presumes an increased quality of final HIS systems, which supposes an indirect impact on patient care.

A framework for improving the quality of health information on the world-wide-web and bettering public (e-)health: the MedCERTAIN approach.

PubMed

Eysenbach, G; Köhler, C; Yihune, G; Lampe, K; Cross, P; Brickley, D

2001-01-01

There has been considerable debate about the variable quality of health information on the world-wide-web and its impact on public health. While central authorities to regulate, control, censor, or centrally approve information, in-formation providers or websites are neither realistic nor desirable, public health professionals are interested in making systems available that direct patient streams to the best available information sources. National governments and medical societies have also recognized their responsibility to help users to identify "good quality" information sources. But what constitutes good quality, and how can such a system be implemented in a decentralized and democratic manner? This paper presents a model which combines aspects of consumer education, encouragement of best practices among information providers, self-labeling and external evaluations. The model is currently being implemented and evaluated in the MedCERTAIN project, funded by the European Union under the Action Plan for Safer Use of the Internet. The aim is to develop a technical and organisational infrastructure for a pilot system that allows consumers to access metainformation about web-sites and health information providers, including disclosure information from health providers and opinions of external evaluators. The paper explains the general conceptual framework of the model and presents preliminary experiences including results from an expert consensus meeting, where the framework was discussed.

Evaluation framework for 16 earmarked projects in Washington State

DOT National Transportation Integrated Search

2007-05-01

This report documents the results of applying a previously developed, standardized approach for evaluating advanced traveler information systems (ATIS) projects to a much more diverse group of 16 intelligent transportation systems (ITS) projects. The...

Evaluation of the TSC Dolphin Computer Assisted Instructional System in the Chapter 1 Program of the District of Columbia Public Schools. Final Report 85-9.

ERIC Educational Resources Information Center

Harris, Carolyn DeMeyer; And Others

Dolphin is a computer-assisted instruction system used to teach and reinforce skills in reading, language arts, and mathematics. An evaluation of this system was conducted to provide information to TSC Division of Houghton Mifflin regarding its effectiveness and possible modifications to the system. The general design of the evaluation was to…

Solar industrial process heat systems: An assessment of standards for materials and components

NASA Astrophysics Data System (ADS)

Rossiter, W. J.; Shipp, W. E.

1981-09-01

A study was conducted to obtain information on the performance of materials and components in operational solar industrial process heat (PH) systems, and to provide recommendations for the development of standards including evaluative test procedures for materials and components. An assessment of the needs for standards for evaluating the long-term performance of materials and components of IPH systems was made. The assessment was based on the availability of existing standards, and information obtained from a field survey of operational systems, the literature, and discussions with individuals in the industry. Field inspections of 10 operational IPH systems were performed.

Utilizing Web Information Systems for Organizational Knowledge Work: An Investigation of the Information Ecology and Information Behaviors of Users in a Telecommunications Company.

ERIC Educational Resources Information Center

Detlor, Brian

This paper outlines a detailed research investigation of Web information systems (WIS), such as intranets, extranets, and the World Wide Web, and their capacity to facilitate organizational knowledge work. The objective was to conduct a case study evaluation of WIS usage that examines the information needs and uses of major sets of users and the…

Consumer health information seeking on the Internet: the state of the art.

PubMed

Cline, R J; Haynes, K M

2001-12-01

Increasingly, consumers engage in health information seeking via the Internet. Taking a communication perspective, this review argues why public health professionals should be concerned about the topic, considers potential benefits, synthesizes quality concerns, identifies criteria for evaluating online health information and critiques the literature. More than 70 000 websites disseminate health information; in excess of 50 million people seek health information online, with likely consequences for the health care system. The Internet offers widespread access to health information, and the advantages of interactivity, information tailoring and anonymity. However, access is inequitable and use is hindered further by navigational challenges due to numerous design features (e.g. disorganization, technical language and lack of permanence). Increasingly, critics question the quality of online health information; limited research indicates that much is inaccurate. Meager information-evaluation skills add to consumers' vulnerability, and reinforce the need for quality standards and widespread criteria for evaluating health information. Extant literature can be characterized as speculative, comprised of basic 'how to' presentations, with little empirical research. Future research needs to address the Internet as part of the larger health communication system and take advantage of incorporating extant communication concepts. Not only should research focus on the 'net-gap' and information quality, it also should address the inherently communicative and transactional quality of Internet use. Both interpersonal and mass communication concepts open avenues for investigation and understanding the influence of the Internet on health beliefs and behaviors, health care, medical outcomes, and the health care system.

Evaluating Management Information Systems, A Protocol for Automated Peer Review Systems

PubMed Central

Black, Gordon C.

1980-01-01

This paper discusses key issues in evaluating an automated Peer Review System. Included are the conceptual base, design, steps in planning structural components, operation parameters, criteria, costs and a detailed outline or protocol for use in the evaluation. At the heart of the Peer Review System is the criteria utilized for measuring quality. Criteria evaluation should embrace, as a minimum, appropriateness, validity and reliability, and completemess or comprehensiveness of content. Such an evaluation is not complete without determining the impact (clinical outcome) of the service system or the patient and the population served.

Pharmaceutical information systems and possible implementations of informed consent -- developing an heuristic.

PubMed

Ploug, Thomas; Holm, Søren

2012-11-16

Denmark has implemented a comprehensive, nationwide pharmaceutical information system, and this system has been evaluated by the Danish Council of Ethics. The system can be seen as an exemplar of a comprehensive health information system for clinical use. The paper analyses 1) how informed consent can be implemented in the system and how different implementations create different impacts on autonomy and control of information, and 2) arguments directed towards justifying not seeking informed consent in this context. Based on the analysis a heuristic is provided which enables a ranking and estimation of the impact on autonomy and control of information of different options for consent to entry of data into the system and use of data from the system.The danger of routinisation of consent is identified.The Danish pharmaceutical information system raises issues in relation to autonomy and control of information, issues that will also occur in relation to other similar comprehensive health information systems. Some of these issues are well understood and their impact can be judged using the heuristic which is provided. More research is, however needed in relation to routinisation of consent.

[The organization of system of information support of regional health care].

PubMed

Konovalov, A A

2014-01-01

The comparative analysis was implemented concerning versions of architecture of segment of unified public information system of health care within the framework of the regional program of modernization of Nizhniy Novgorod health care system. The author proposed means of increasing effectiveness of public investments on the basis of analysis of aggregate value of ownership of information system. The evaluation is given concerning running up to target program indicators and dynamics of basic indicators of informatization of institutions of oblast health care system.

Evaluation of regional real-time transit communications and data information sharing in the national capital region.

DOT National Transportation Integrated Search

2015-03-01

This final report documents transit-related enhancements to the Regional Integration Transportation Information System (RITIS), creation of the RITIS Chat Instant Messaging tool, and final project evaluation of the effectiveness of the RITIS Chat too...

Evaluation of Traffic Information and Prediction System (TIPS) as work zone traffic control.

DOT National Transportation Integrated Search

2004-03-01

As part of a pavement rehabilitation project on I-64, the Traffic Information and Prediction System (TIPS) was installed as a a means of providing real-time data for motorists in advance and through the work zone. This system collects real-time data ...

Environmental Scanning in Educational Planning: Establishing a Strategic Trend Information System.

ERIC Educational Resources Information Center

Morrison, James L.

The systematic evaluation of the macroenvironment is sometimes referred to as a strategic trend information system. Strategic trend intelligence systems are highly developed, systematic intelligence programs that focus on trends and events in the external environment and provide institutions with knowledge to reduce areas of uncertainty and with…

28 CFR 16.71 - Exemption of the Office of the Deputy Attorney General System-limited access.

Code of Federal Regulations, 2013 CFR

2013-07-01

...) Drug Enforcement Task Force Evaluation and Reporting System (JUSTICE/DAG-003). (2) General Files System... Files System apply only to the extent that information is subject to exemption pursuant to 5 U.S.C. 552a..., release of an accounting of disclosures from the General Files System may reveal information that is...

28 CFR 16.71 - Exemption of the Office of the Deputy Attorney General System-limited access.

Code of Federal Regulations, 2010 CFR

2010-07-01

...) Drug Enforcement Task Force Evaluation and Reporting System (JUSTICE/DAG-003). (2) General Files System... Files System apply only to the extent that information is subject to exemption pursuant to 5 U.S.C. 552a..., release of an accounting of disclosures from the General Files System may reveal information that is...

28 CFR 16.71 - Exemption of the Office of the Deputy Attorney General System-limited access.

Code of Federal Regulations, 2011 CFR

2011-07-01

...) Drug Enforcement Task Force Evaluation and Reporting System (JUSTICE/DAG-003). (2) General Files System... Files System apply only to the extent that information is subject to exemption pursuant to 5 U.S.C. 552a..., release of an accounting of disclosures from the General Files System may reveal information that is...

28 CFR 16.71 - Exemption of the Office of the Deputy Attorney General System-limited access.

Code of Federal Regulations, 2012 CFR

2012-07-01

...) Drug Enforcement Task Force Evaluation and Reporting System (JUSTICE/DAG-003). (2) General Files System... Files System apply only to the extent that information is subject to exemption pursuant to 5 U.S.C. 552a..., release of an accounting of disclosures from the General Files System may reveal information that is...

Facilitating cancer research using natural language processing of pathology reports.

PubMed

Xu, Hua; Anderson, Kristin; Grann, Victor R; Friedman, Carol

2004-01-01

Many ongoing clinical research projects, such as projects involving studies associated with cancer, involve manual capture of information in surgical pathology reports so that the information can be used to determine the eligibility of recruited patients for the study and to provide other information, such as cancer prognosis. Natural language processing (NLP) systems offer an alternative to automated coding, but pathology reports have certain features that are difficult for NLP systems. This paper describes how a preprocessor was integrated with an existing NLP system (MedLEE) in order to reduce modification to the NLP system and to improve performance. The work was done in conjunction with an ongoing clinical research project that assesses disparities and risks of developing breast cancer for minority women. An evaluation of the system was performed using manually coded data from the research project's database as a gold standard. The evaluation outcome showed that the extended NLP system had a sensitivity of 90.6% and a precision of 91.6%. Results indicated that this system performed satisfactorily for capturing information for the cancer research project.

A Foggy Desert: Equitable Information Flow for a Fogwater System in Southwest Morocco

ERIC Educational Resources Information Center

Dodson, Leslie Lynn

2014-01-01

This dissertation describes the design, implementation and evaluation of a gender-inclusive information system linking rural women in Agni Hiya, Morocco and water project managers from the Association Dar Si-Hmad. This research was motivated by an interest in exploring the linkages between information and communication technologies (ICT), climate…

Use of the self-organising map network (SOMNet) as a decision support system for regional mental health planning.

PubMed

Chung, Younjin; Salvador-Carulla, Luis; Salinas-Pérez, José A; Uriarte-Uriarte, Jose J; Iruin-Sanz, Alvaro; García-Alonso, Carlos R

2018-04-25

Decision-making in mental health systems should be supported by the evidence-informed knowledge transfer of data. Since mental health systems are inherently complex, involving interactions between its structures, processes and outcomes, decision support systems (DSS) need to be developed using advanced computational methods and visual tools to allow full system analysis, whilst incorporating domain experts in the analysis process. In this study, we use a DSS model developed for interactive data mining and domain expert collaboration in the analysis of complex mental health systems to improve system knowledge and evidence-informed policy planning. We combine an interactive visual data mining approach, the self-organising map network (SOMNet), with an operational expert knowledge approach, expert-based collaborative analysis (EbCA), to develop a DSS model. The SOMNet was applied to the analysis of healthcare patterns and indicators of three different regional mental health systems in Spain, comprising 106 small catchment areas and providing healthcare for over 9 million inhabitants. Based on the EbCA, the domain experts in the development team guided and evaluated the analytical processes and results. Another group of 13 domain experts in mental health systems planning and research evaluated the model based on the analytical information of the SOMNet approach for processing information and discovering knowledge in a real-world context. Through the evaluation, the domain experts assessed the feasibility and technology readiness level (TRL) of the DSS model. The SOMNet, combined with the EbCA, effectively processed evidence-based information when analysing system outliers, explaining global and local patterns, and refining key performance indicators with their analytical interpretations. The evaluation results showed that the DSS model was feasible by the domain experts and reached level 7 of the TRL (system prototype demonstration in operational environment). This study supports the benefits of combining health systems engineering (SOMNet) and expert knowledge (EbCA) to analyse the complexity of health systems research. The use of the SOMNet approach contributes to the demonstration of DSS for mental health planning in practice.

Asynchronous Cooperative e-Learning System and Its Evaluation

NASA Astrophysics Data System (ADS)

Eto, Kazuhiro; Miyoshi, Takumi

Much attention has been attracted to collaborative learning on an e-learning system. However, it is difficult to implement the collaborative environment to an asynchronous e-learning system since collaboration would be realized only when learners join the system at the same time. On the other hand, cooperative learning has been proposed. In this method, learners can study on their own pace without making mutual agreement but with receiving cognitive information from others. In this paper, the authors have developed the asynchronous cooperative e-learning system that provides learners' attendance and studying progress as the cognitive information. The subjective evaluation experiments show that our system is slightly inferior to the synchronous collaborative e-learning system, but it can motivate the learners more than the conventional system.

Solar heating system installed at Blakedale Professional Center, Greenwood, South Carolina

NASA Technical Reports Server (NTRS)

1980-01-01

Information on the solar heating system installed at the Blakedale Professional Center, in Greenwood, South Carolina is presented. The information consists of site and building description, solar system description, performance evaluation, system problems and installation drawings. The solar system was designed to provide approximately 85 percent of the building's heating requirements. The system was installed concurrently with building construction and heats 4,440 square feet of the building. There are 954 square feet of liquid flat plate collectors that are proof-mounted and have a drain-down system to protect the collectors from freezing. A 5,000 gallon steel, polyurethane insulated tank buried underground provides storage. The system was fully instrumented for performance evaluation and integrated into the National Solar Data Network.

PERFORM: A System for Monitoring, Assessment and Management of Patients with Parkinson's Disease

PubMed Central

Tzallas, Alexandros T.; Tsipouras, Markos G.; Rigas, Georgios; Tsalikakis, Dimitrios G.; Karvounis, Evaggelos C.; Chondrogiorgi, Maria; Psomadellis, Fotis; Cancela, Jorge; Pastorino, Matteo; Waldmeyer, María Teresa Arredondo; Konitsiotis, Spiros; Fotiadis, Dimitrios I.

2014-01-01

In this paper, we describe the PERFORM system for the continuous remote monitoring and management of Parkinson's disease (PD) patients. The PERFORM system is an intelligent closed-loop system that seamlessly integrates a wide range of wearable sensors constantly monitoring several motor signals of the PD patients. Data acquired are pre-processed by advanced knowledge processing methods, integrated by fusion algorithms to allow health professionals to remotely monitor the overall status of the patients, adjust medication schedules and personalize treatment. The information collected by the sensors (accelerometers and gyroscopes) is processed by several classifiers. As a result, it is possible to evaluate and quantify the PD motor symptoms related to end of dose deterioration (tremor, bradykinesia, freezing of gait (FoG)) as well as those related to over-dose concentration (Levodopa-induced dyskinesia (LID)). Based on this information, together with information derived from tests performed with a virtual reality glove and information about the medication and food intake, a patient specific profile can be built. In addition, the patient specific profile with his evaluation during the last week and last month, is compared to understand whether his status is stable, improving or worsening. Based on that, the system analyses whether a medication change is needed—always under medical supervision—and in this case, information about the medication change proposal is sent to the patient. The performance of the system has been evaluated in real life conditions, the accuracy and acceptability of the system by the PD patients and healthcare professionals has been tested, and a comparison with the standard routine clinical evaluation done by the PD patients' physician has been carried out. The PERFORM system is used by the PD patients and in a simple and safe non-invasive way for long-term record of their motor status, thus offering to the clinician a precise, long-term and objective view of patient's motor status and drug/food intake. Thus, with the PERFORM system the clinician can remotely receive precise information for the PD patient's status on previous days and define the optimal therapeutical treatment. PMID:25393786

PERFORM: a system for monitoring, assessment and management of patients with Parkinson's disease.

PubMed

Tzallas, Alexandros T; Tsipouras, Markos G; Rigas, Georgios; Tsalikakis, Dimitrios G; Karvounis, Evaggelos C; Chondrogiorgi, Maria; Psomadellis, Fotis; Cancela, Jorge; Pastorino, Matteo; Waldmeyer, María Teresa Arredondo; Konitsiotis, Spiros; Fotiadis, Dimitrios I

2014-11-11

In this paper, we describe the PERFORM system for the continuous remote monitoring and management of Parkinson's disease (PD) patients. The PERFORM system is an intelligent closed-loop system that seamlessly integrates a wide range of wearable sensors constantly monitoring several motor signals of the PD patients. Data acquired are pre-processed by advanced knowledge processing methods, integrated by fusion algorithms to allow health professionals to remotely monitor the overall status of the patients, adjust medication schedules and personalize treatment. The information collected by the sensors (accelerometers and gyroscopes) is processed by several classifiers. As a result, it is possible to evaluate and quantify the PD motor symptoms related to end of dose deterioration (tremor, bradykinesia, freezing of gait (FoG)) as well as those related to over-dose concentration (Levodopa-induced dyskinesia (LID)). Based on this information, together with information derived from tests performed with a virtual reality glove and information about the medication and food intake, a patient specific profile can be built. In addition, the patient specific profile with his evaluation during the last week and last month, is compared to understand whether his status is stable, improving or worsening. Based on that, the system analyses whether a medication change is needed--always under medical supervision--and in this case, information about the medication change proposal is sent to the patient. The performance of the system has been evaluated in real life conditions, the accuracy and acceptability of the system by the PD patients and healthcare professionals has been tested, and a comparison with the standard routine clinical evaluation done by the PD patients' physician has been carried out. The PERFORM system is used by the PD patients and in a simple and safe non-invasive way for long-term record of their motor status, thus offering to the clinician a precise, long-term and objective view of patient's motor status and drug/food intake. Thus, with the PERFORM system the clinician can remotely receive precise information for the PD patient's status on previous days and define the optimal therapeutical treatment.

Health information systems evaluation frameworks: A systematic review.

PubMed

Eslami Andargoli, Amirhossein; Scheepers, Helana; Rajendran, Diana; Sohal, Amrik

2017-01-01

Evaluation of health information systems (HISs) is complicated because of the complex nature of the health care domain. Various studies have proposed different frameworks to reduce the complexity in the assessment of these systems. The aim of these frameworks is to provide a set of guidelines for the evaluation of the adequacy of health care information systems. This paper aims to analyse studies on the evaluation of HISs by applying a content, context and process (CCP) framework to address the 'who', 'what', 'how', 'when', and 'why' of the evaluation processes used. This will allow for a better understanding of the relative strengths and weaknesses of various HISs evaluation frameworks, and will pave the way for developing a more complete framework for HISs. A systematic literature review on HIS evaluation studies was undertaken to identify the currently available HIS evaluation frameworks. Five academic databases were selected to conduct this systematic literature review. Most of the studies only address some, but not all, of the five main questions, i.e. the who, what, how, when, why, and that there was a lack of consensus in the way these questions were addressed. The critical role of context was also largely neglected in these studies. Evaluation of HISs is complex. The health care domain is highly context sensitive and in order to have a complete assessment of HISs, consideration of contextual factors is necessary. Specifically, to have the right set of criteria to measure the 'what', the answer to the 'who' of the evaluation is necessary. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluation of a Computerized Clinical Information System (Micromedex).

PubMed Central

Lundsgaarde, H. P.; Moreshead, G. E.

1991-01-01

This paper summarizes data collected as part of a project designed to identify and assess the technical and organizational problems associated with the implementation and evaluation of a Computerized Clinical Information System (CCIS), Micromedex, in three U.S. Department of Veterans Affairs Medical Centers (VAMCs). The study began in 1987 as a national effort to implement decision support technologies in the Veterans Administration Decentralized Hospital Computer Program (DHCP). The specific objectives of this project were to (1) examine one particular decision support technology, (2) identify the technical and organizational barriers to the implementation of a CCIS in the VA host environment, (3) assess the possible benefits of this system to VA clinicians in terms of therapeutic decision making, and (4) develop new methods for identifying the clinical utility of a computer program designed to provide clinicians with a new information tool. The project was conducted intermittently over a three-year period at three VA medical centers chosen as implementation and evaluation test sites for Micromedex. Findings from the Kansas City Medical Center in Missouri are presented to illustrate some of the technical problems associated with the implementation of a commercial database program in the DHCP host environment, the organizational factors influencing clinical use of the system, and the methods used to evaluate its use. Data from 4581 provider encounters with the CCIS are summarized. Usage statistics are presented to illustrate the methodological possibilities for assessing the "benefits and burdens" of a computerized information system by using an automated collection of user demographics and program audit trails that allow evaluators to monitor user interactions with different segments of the database. PMID:1807583

Evaluation of a Computerized Clinical Information System (Micromedex).

PubMed

Lundsgaarde, H P; Moreshead, G E

1991-01-01

This paper summarizes data collected as part of a project designed to identify and assess the technical and organizational problems associated with the implementation and evaluation of a Computerized Clinical Information System (CCIS), Micromedex, in three U.S. Department of Veterans Affairs Medical Centers (VAMCs). The study began in 1987 as a national effort to implement decision support technologies in the Veterans Administration Decentralized Hospital Computer Program (DHCP). The specific objectives of this project were to (1) examine one particular decision support technology, (2) identify the technical and organizational barriers to the implementation of a CCIS in the VA host environment, (3) assess the possible benefits of this system to VA clinicians in terms of therapeutic decision making, and (4) develop new methods for identifying the clinical utility of a computer program designed to provide clinicians with a new information tool. The project was conducted intermittently over a three-year period at three VA medical centers chosen as implementation and evaluation test sites for Micromedex. Findings from the Kansas City Medical Center in Missouri are presented to illustrate some of the technical problems associated with the implementation of a commercial database program in the DHCP host environment, the organizational factors influencing clinical use of the system, and the methods used to evaluate its use. Data from 4581 provider encounters with the CCIS are summarized. Usage statistics are presented to illustrate the methodological possibilities for assessing the "benefits and burdens" of a computerized information system by using an automated collection of user demographics and program audit trails that allow evaluators to monitor user interactions with different segments of the database.

Design of Student Information Management Database Application System for Office and Departmental Target Responsibility System

NASA Astrophysics Data System (ADS)

Zhou, Hui

It is the inevitable outcome of higher education reform to carry out office and departmental target responsibility system, in which statistical processing of student's information is an important part of student's performance review. On the basis of the analysis of the student's evaluation, the student information management database application system is designed by using relational database management system software in this paper. In order to implement the function of student information management, the functional requirement, overall structure, data sheets and fields, data sheet Association and software codes are designed in details.

Methodology Evaluation Framework for Component-Based System Development.

ERIC Educational Resources Information Center

Dahanayake, Ajantha; Sol, Henk; Stojanovic, Zoran

2003-01-01

Explains component-based development (CBD) for distributed information systems and presents an evaluation framework, which highlights the extent to which a methodology is component oriented. Compares prominent CBD methods, discusses ways of modeling, and suggests that this is a first step towards a components-oriented systems development…

Evaluation of modern cotton harvest systems on irrigated cotton: Fiber quality

USDA-ARS?s Scientific Manuscript database

Picker and stripper harvest systems were evaluated on production-scale irrigated cotton on the High Plains of Texas over three harvest seasons. Observations on fiber quality using High Volume Instrument (HVI) and Advanced Fiber Information Systems (AFIS) were made on multiple cultivars harvested fro...

Swalley canal ice detection system : final report.

DOT National Transportation Integrated Search

1990-01-01

This report evaluates the reliability of information provided by a "SCAN 16" surface condition analyzer. SCAN systems are designed to inform highway maintenance personnel when frost, ice and snow are present on a roadway surface or bridge deck. The s...

ENVIRONMENTAL QUALITY INFORMATION SYSTEM - EQULS® - ITER

EPA Science Inventory

This project consisted of an evaluation of the Environmental Quality Information System (EQuIS) software designed by Earthsoft, Inc. as an environmental data management and analysis platform for monitoring and remediation projects. In consultation with the EQuIS vendor, six pri...

Assessment of Pharmacy Information System Performance in Three Hospitals in Eastern Province, Saudi Arabia

PubMed Central

El.Mahalli, Azza; El-Khafif, Sahar H.; Yamani, Wid

2016-01-01

The pharmacy information system is one of the central pillars of a hospital information system. This research evaluated a pharmacy information system according to six aspects of the medication process in three hospitals in Eastern Province, Saudi Arabia. System administrators were interviewed to determine availability of functionalities. Then, system users within the hospital were targeted to evaluate their level of usage of these functionalities. The study was cross-sectional. Two structured surveys were designed. The overall response rate of hospital users was 31.7 percent. In all three hospitals studied, the electronic health record is hybrid, implementation has been completed and the system is running, and the systems have computerized provider order entry and clinical decision support. Also, the pharmacy information systems are integrated with the electronic health record, and computerized provider order entry and almost all prescribing and transcription functionalities are available; however, drug dispensing is a mostly manual process. However, the study hospitals do not use barcode-assisted medication administration systems to verify patient identity and electronically check dose administration, and none of them have computerized adverse drug event monitoring that uses the electronic health record. The numbers of users who used different functionalities most or all of the time was generally low. The highest frequency of utilization was for patient administration records (56.8 percent), and the lowest was for linkage of the pharmacy information system to pharmacy stock (9.1 percent). Encouraging users to use different functionalities was highly recommended. PMID:26903780

Assessment of Pharmacy Information System Performance in Three Hospitals in Eastern Province, Saudi Arabia.

PubMed

El Mahalli, Azza; El-Khafif, Sahar H; Yamani, Wid

2016-01-01

The pharmacy information system is one of the central pillars of a hospital information system. This research evaluated a pharmacy information system according to six aspects of the medication process in three hospitals in Eastern Province, Saudi Arabia. System administrators were interviewed to determine availability of functionalities. Then, system users within the hospital were targeted to evaluate their level of usage of these functionalities. The study was cross-sectional. Two structured surveys were designed. The overall response rate of hospital users was 31.7 percent. In all three hospitals studied, the electronic health record is hybrid, implementation has been completed and the system is running, and the systems have computerized provider order entry and clinical decision support. Also, the pharmacy information systems are integrated with the electronic health record, and computerized provider order entry and almost all prescribing and transcription functionalities are available; however, drug dispensing is a mostly manual process. However, the study hospitals do not use barcode-assisted medication administration systems to verify patient identity and electronically check dose administration, and none of them have computerized adverse drug event monitoring that uses the electronic health record. The numbers of users who used different functionalities most or all of the time was generally low. The highest frequency of utilization was for patient administration records (56.8 percent), and the lowest was for linkage of the pharmacy information system to pharmacy stock (9.1 percent). Encouraging users to use different functionalities was highly recommended.

The MiPACQ Clinical Question Answering System

PubMed Central

Cairns, Brian L.; Nielsen, Rodney D.; Masanz, James J.; Martin, James H.; Palmer, Martha S.; Ward, Wayne H.; Savova, Guergana K.

2011-01-01

The Multi-source Integrated Platform for Answering Clinical Questions (MiPACQ) is a QA pipeline that integrates a variety of information retrieval and natural language processing systems into an extensible question answering system. We present the system’s architecture and an evaluation of MiPACQ on a human-annotated evaluation dataset based on the Medpedia health and medical encyclopedia. Compared with our baseline information retrieval system, the MiPACQ rule-based system demonstrates 84% improvement in Precision at One and the MiPACQ machine-learning-based system demonstrates 134% improvement. Other performance metrics including mean reciprocal rank and area under the precision/recall curves also showed significant improvement, validating the effectiveness of the MiPACQ design and implementation. PMID:22195068

Quantitative metrics for evaluating the phased roll-out of clinical information systems.

PubMed

Wong, David; Wu, Nicolas; Watkinson, Peter

2017-09-01

We introduce a novel quantitative approach for evaluating the order of roll-out during phased introduction of clinical information systems. Such roll-outs are associated with unavoidable risk due to patients transferring between clinical areas using both the old and new systems. We proposed a simple graphical model of patient flow through a hospital. Using a simple instance of the model, we showed how a roll-out order can be generated by minimising the flow of patients from the new system to the old system. The model was applied to admission and discharge data acquired from 37,080 patient journeys at the Churchill Hospital, Oxford between April 2013 and April 2014. The resulting order was evaluated empirically and produced acceptable orders. The development of data-driven approaches to clinical Information system roll-out provides insights that may not necessarily be ascertained through clinical judgment alone. Such methods could make a significant contribution to the smooth running of an organisation during the roll-out of a potentially disruptive technology. Unlike previous approaches, which are based on clinical opinion, the approach described here quantitatively assesses the appropriateness of competing roll-out strategies. The data-driven approach was shown to produce strategies that matched clinical intuition and provides a flexible framework that may be used to plan and monitor Clinical Information System roll-out. Copyright © 2017 The Author(s). Published by Elsevier B.V. All rights reserved.

Building Data and Information Capacity in Environmental Public Health: A Best-Worst Scaling Experiment.

PubMed

Wallar, Lauren E; Sargeant, Jan M; McEwen, Scott A; Mercer, Nicola J; Papadopoulos, Andrew

Environmental public health practitioners rely on information technology (IT) to maintain and improve environmental health. However, current systems have limited capacity. A better understanding of the importance of IT features is needed to enhance data and information capacity. (1) Rank IT features according to the percentage of respondents who rated them as essential to an information management system and (2) quantify the relative importance of a subset of these features using best-worst scaling. Information technology features were initially identified from a previously published systematic review of software evaluation criteria and a list of software options from a private corporation specializing in inspection software. Duplicates and features unrelated to environmental public health were removed. The condensed list was refined by a working group of environmental public health management to a final list of 57 IT features. The essentialness of features was electronically rated by environmental public health managers. Features where 50% to 80% of respondents rated them as essential (n = 26) were subsequently evaluated using best-worst scaling. Ontario, Canada. Environmental public health professionals in local public health. Importance scores of IT features. The majority of IT features (47/57) were considered essential to an information management system by at least half of the respondents (n = 52). The highest-rated features were delivery to printer, software encryption capability, and software maintenance services. Of the 26 features evaluated in the best-worst scaling exercise, the most important features were orientation to all practice areas, off-line capability, and ability to view past inspection reports and results. The development of a single, unified environmental public health information management system that fulfills the reporting and functionality needs of system users is recommended. This system should be implemented by all public health units to support data and information capacity in local environmental public health. This study can be used to guide vendor evaluation, negotiation, and selection in local environmental public health, and provides an example of academia-practice partnerships and the use of best-worst scaling in public health research.

Development and Demonstration of a Statistical Data Base System for Library and Network Planning and Evaluation. Fourth Quarterly Report.

ERIC Educational Resources Information Center

Jones, Dennis; And Others

The National Center for Higher Education Management Systems (NCHEMS) has completed the development and demonstration of a library statistical data base. The data base, or management information system, was developed for administrators of public and academic libraries. The system provides administrators with a framework of information and…

Cognitive models of pilot categorization and prioritization of flight-deck information

NASA Technical Reports Server (NTRS)

Jonsson, Jon E.; Ricks, Wendell R.

1995-01-01

In the past decade, automated systems on modern commercial flight decks have increased dramatically. Pilots now regularly interact and share tasks with these systems. This interaction has led human factors research to direct more attention to the pilot's cognitive processing and mental model of the information flow occurring on the flight deck. The experiment reported herein investigated how pilots mentally represent and process information typically available during flight. Fifty-two commercial pilots participated in tasks that required them to provide similarity ratings for pairs of flight-deck information and to prioritize this information under two contextual conditions. Pilots processed the information along three cognitive dimensions. These dimensions included the flight function and the flight action that the information supported and how frequently pilots refer to the information. Pilots classified the information as aviation, navigation, communications, or systems administration information. Prioritization results indicated a high degree of consensus among pilots, while scaling results revealed two dimensions along which information is prioritized. Pilot cognitive workload for flight-deck tasks and the potential for using these findings to operationalize cognitive metrics are evaluated. Such measures may be useful additions for flight-deck human performance evaluation.

Randomized pilot study and qualitative evaluation of a clinical decision support system for brain tumour diagnosis based on SV ¹H MRS: evaluation as an additional information procedure for novice radiologists.

PubMed

Sáez, Carlos; Martí-Bonmatí, Luis; Alberich-Bayarri, Angel; Robles, Montserrat; García-Gómez, Juan M

2014-02-01

The results of a randomized pilot study and qualitative evaluation of the clinical decision support system Curiam BT are reported. We evaluated the system's feasibility and potential value as a radiological information procedure complementary to magnetic resonance (MR) imaging to assist novice radiologists in diagnosing brain tumours using MR spectroscopy (1.5 and 3.0T). Fifty-five cases were analysed at three hospitals according to four non-exclusive diagnostic questions. Our results show that Curiam BT improved the diagnostic accuracy in all the four questions. Additionally, we discuss the findings of the users' feedback about the system, and the further work to optimize it for real environments and to conduct a large clinical trial. © 2013 Published by Elsevier Ltd.

Continued implementation and testing of a Neighborhood Office Center (NOC) and integration of the NOC with an administrative correspondence management information system

NASA Technical Reports Server (NTRS)

1978-01-01

The concept of decentralized (remote) neighborhood offices, linked together through a self-sustaining communications network for exchanging voice messages, video images, and digital data was quantitatively evaluated. Hardware and procedures for the integrated multifunctional system were developed. The configuration of the neighborhood office center (NOC) is explained, its production statistics given, and an experiment for NOC network integration via satellite is described. The hardware selected for the integration NOC/management information system is discussed, and the NASA teleconferencing network is evaluated.

Outlier Detection for Sensor Systems (ODSS): A MATLAB Macro for Evaluating Microphone Sensor Data Quality.

PubMed

Vasta, Robert; Crandell, Ian; Millican, Anthony; House, Leanna; Smith, Eric

2017-10-13

Microphone sensor systems provide information that may be used for a variety of applications. Such systems generate large amounts of data. One concern is with microphone failure and unusual values that may be generated as part of the information collection process. This paper describes methods and a MATLAB graphical interface that provides rapid evaluation of microphone performance and identifies irregularities. The approach and interface are described. An application to a microphone array used in a wind tunnel is used to illustrate the methodology.

Development of Information System for Patients with Cleft Lip and Palate undergoing Operation.

PubMed

Augsornwan, Darawan; Pattangtanang, Pantamanas; Surakunprapha, Palakorn

2015-08-01

Srinagarind Hospital has 150-200 patients with cleft lip and palate each year. When patients are admitted to hospital for surgery patients and family feel they are in a crisis of life, they feel fear anxiety and need to know about how to take care of wound, they worry if patient will feel pain, how to feed patients and many things about patients. Information is very important for patients/family to prevent complications and help their decision process, decrease parents stress and encourage better co-operation. To develop information system for patients with cleft lip-palate undergoing operation. This is an action research divided into 3 phases. Phase 1 Situation review: in this phase we interview, nursing care observation, and review nursing documents about the information giving. Phase 2 Develop information system: focus groups, for discussion about what nurses can do to develop the system to give information to patients/parents. Phase 3 evaluation: by interviewing 61 parents using the structure questionnaire. 100 percent of patients/parents received information but some items were not received. Patients/parents satisfaction was 94.9 percent, no complications. The information system development provides optimal care for patients and family with cleft lip and palate, but needs to improve some techniques or tools to give more information and evaluate further the nursing outcome after.

Trust-Based Security Level Evaluation Using Bayesian Belief Networks

NASA Astrophysics Data System (ADS)

Houmb, Siv Hilde; Ray, Indrakshi; Ray, Indrajit; Chakraborty, Sudip

Security is not merely about technical solutions and patching vulnerabilities. Security is about trade-offs and adhering to realistic security needs, employed to support core business processes. Also, modern systems are subject to a highly competitive market, often demanding rapid development cycles, short life-time, short time-to-market, and small budgets. Security evaluation standards, such as ISO 14508 Common Criteria and ISO/IEC 27002, are not adequate for evaluating the security of many modern systems for resource limitations, time-to-market, and other constraints. Towards this end, we propose an alternative time and cost effective approach for evaluating the security level of a security solution, system or part thereof. Our approach relies on collecting information from different sources, who are trusted to varying degrees, and on using a trust measure to aggregate available information when deriving security level. Our approach is quantitative and implemented as a Bayesian Belief Network (BBN) topology, allowing us to reason over uncertain information and seemingly aggregating disparate information. We illustrate our approach by deriving the security level of two alternative Denial of Service (DoS) solutions. Our approach can also be used in the context of security solution trade-off analysis.

Evaluating Feedback Systems by Civil Service Employees. HRDV 6000 Integrated Studies in Human Resources Development

DTIC Science & Technology

2001-07-01

Specifically, it gives leaders an azimuth check in their self-awareness, Evaluating feedback systems by civil service employees 16 gives feedback to assist ...constructive feedback and that managers needed to be taught how to communicate with employees . Currently, DOE has run this program since 1996 and...providing employees with developmental information. Information that would be used to assist leaders in improving in both their managerial and

The EU-project United4Health: User-Centred Design and Evaluation of a Collaborative Information System for a Norwegian Telehealth Service.

PubMed

Smaradottir, Berglind; Gerdes, Martin; Martinez, Santiago; Fensli, Rune

2015-01-01

This study presents the user-centred design and evaluation process of a Collaborative Information System (CIS), developed for a new telehealth service for remote monitoring of chronic obstructive pulmonary disease patients after hospital discharge. The CIS was designed based on the information gathered in a workshop, where target end-users described the context of use, a telehealth workflow and their preferred ways of interaction with the solution. Evaluation of the iterative refinements were made through user tests, semi-structured interviews and a questionnaire. A field trial reported results on the ease of use and user satisfaction during the interaction with the fully developed system. The implemented CIS was successfully deployed within the secured Norwegian Health Network. The research was a result of cooperation between international partners within the EU FP7 project United4Health.

Sharing resources, coordinating response : deploying and operating incident management systems

DOT National Transportation Integrated Search

1998-10-01

This report describes and, where possible, quantifies the value of information and information services for transportation agencies. It evaluates the various means of accessing information and looks at the important role of the information profession...

Overcoming structural constraints to patient utilization of electronic medical records: a critical review and proposal for an evaluation framework.

PubMed

Winkelman, Warren J; Leonard, Kevin J

2004-01-01

There are constraints embedded in medical record structure that limit use by patients in self-directed disease management. Through systematic review of the literature from a critical perspective, four characteristics that either enhance or mitigate the influence of medical record structure on patient utilization of an electronic patient record (EPR) system have been identified: environmental pressures, physician centeredness, collaborative organizational culture, and patient centeredness. An evaluation framework is proposed for use when considering adaptation of existing EPR systems for online patient access. Exemplars of patient-accessible EPR systems from the literature are evaluated utilizing the framework. From this study, it appears that traditional information system research and development methods may not wholly capture many pertinent social issues that arise when expanding access of EPR systems to patients. Critically rooted methods such as action research can directly inform development strategies so that these systems may positively influence health outcomes.

Advanced Rural Transportation Information and Coordination (ARTIC) operational test evaluation report : location : Arrowhead region of northeastern Minnesota

DOT National Transportation Integrated Search

2000-07-01

This report presents the results of a one-year evaluation test of an Intelligent Transportation Systems (ITS) project known as Advanced Rural Transportation Information and Coordination (ARTIC), located in the Arrowhead Region of Northeastern Minneso...

78 FR 35053 - Agency Information Collection Activities; Submission for OMB Review; Comment Request; Evaluation...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-06-11

... for OMB Review; Comment Request; Evaluation of the Army Unemployment Compensation for Ex... INFORMATION: I. Background: The Army Unemployment Compensation for Ex-Service Members (UCX) Claimants... create a strong collaborative partnership among the Unemployment Insurance (UI) system, the public...

E-medicine and health care consumers: recognizing current problems and possible resolutions for a safer environment.

PubMed

Brann, Maria; Anderson, James G

2002-01-01

Millions of Americans access the Internet for health information, which is changing the way patients seek information about, and often treat, certain medical conditions. It is estimated that there may be as many as 100,000 health-related Web sites. The availability of so much health information permits consumers to assume more responsibility for their own health care. At the same time, it raises a number of issues that need to be addressed. The health information available to Internet users may be inaccurate or out-of-date. Potential conflicts of interest result from the blurring of the distinction between advertising and professional health information. Also, potential threats to privacy may result from data mining. Health care consumers need to be able to evaluate the quality of the information provided on the Internet. Various evaluative mechanisms such as codes of ethics, rating systems, and seals of approval have been developed to aid in this process. The effectiveness of these solutions is evaluated in this paper. Finally, the paper addresses the importance of including patients in developing standardized quality assurance systems for online health information.

Analysis of information security management systems at 5 domestic hospitals with more than 500 beds.

PubMed

Park, Woo-Sung; Seo, Sun-Won; Son, Seung-Sik; Lee, Mee-Jeong; Kim, Shin-Hyo; Choi, Eun-Mi; Bang, Ji-Eon; Kim, Yea-Eun; Kim, Ok-Nam

2010-06-01

The information security management systems (ISMS) of 5 hospitals with more than 500 beds were evaluated with regards to the level of information security, management, and physical and technical aspects so that we might make recommendations on information security and security countermeasures which meet both international standards and the needs of individual hospitals. The ISMS check-list derived from international/domestic standards was distributed to each hospital to complete and the staff of each hospital was interviewed. Information Security Indicator and Information Security Values were used to estimate the present security levels and evaluate the application of each hospital's current system. With regard to the moderate clause of the ISMS, the hospitals were determined to be in compliance. The most vulnerable clause was asset management, in particular, information asset classification guidelines. The clauses of information security incident management and business continuity management were deemed necessary for the establishment of successful ISMS. The level of current ISMS in the hospitals evaluated was determined to be insufficient. Establishment of adequate ISMS is necessary to ensure patient privacy and the safe use of medical records for various purposes. Implementation of ISMS which meet international standards with a long-term and comprehensive perspective is of prime importance. To reflect the requirements of the varied interests of medical staff, consumers, and institutions, the establishment of political support is essential to create suitable hospital ISMS.

Evaluation of a Cyber Security System for Hospital Network.

PubMed

Faysel, Mohammad A

2015-01-01

Most of the cyber security systems use simulated data in evaluating their detection capabilities. The proposed cyber security system utilizes real hospital network connections. It uses a probabilistic data mining algorithm to detect anomalous events and takes appropriate response in real-time. On an evaluation using real-world hospital network data consisting of incoming network connections collected for a 24-hour period, the proposed system detected 15 unusual connections which were undetected by a commercial intrusion prevention system for the same network connections. Evaluation of the proposed system shows a potential to secure protected patient health information on a hospital network.

Service Quality: A Main Determinant Factor for Health Information System Success in Low-resource Settings.

PubMed

Tilahun, Binyam; Fritz, Fleur

2015-01-01

With the increasing implementation of different health information systems in developing countries, there is a growing need to measure the main determinants of their success. The results of this evaluation study on the determinants of HIS success in five low resource setting hospitals show that service quality is the main determinant factor for information system success in those kind of settings.

CRL/Brandeis: The DIDEROT System

DTIC Science & Technology

1993-01-01

system has already been evaluated in the 4th Mes- sage Understanding Conference (MUC-4) where it was required to extract information from 200 texts on...Directorate for Information Operations and Reports, 1215 Jefferson Davis Highway, Suite 1204, Arlington VA 22202-4302. Respondents should be aware that... information extraction system built at CRL and Brandeis University over the past two years. It was produced as part of our efforts in the Tipster project

Entropy studies on beam distortion by atmospheric turbulence

NASA Astrophysics Data System (ADS)

Wu, Chensheng; Ko, Jonathan; Davis, Christopher C.

2015-09-01

When a beam propagates through atmospheric turbulence over a known distance, the target beam profile deviates from the projected profile of the beam on the receiver. Intuitively, the unwanted distortion provides information about the atmospheric turbulence. This information is crucial for guiding adaptive optic systems and improving beam propagation results. In this paper, we propose an entropy study based on the image from a plenoptic sensor to provide a measure of information content of atmospheric turbulence. In general, lower levels of atmospheric turbulence will have a smaller information size while higher levels of atmospheric turbulence will cause significant expansion of the information size, which may exceed the maximum capacity of a sensing system and jeopardize the reliability of an AO system. Therefore, the entropy function can be used to analyze the turbulence distortion and evaluate performance of AO systems. In fact, it serves as a metric that can tell the improvement of beam correction in each iteration step. In addition, it points out the limitation of an AO system at optimized correction as well as the minimum information needed for wavefront sensing to achieve certain levels of correction. In this paper, we will demonstrate the definition of the entropy function and how it is related to evaluating information (randomness) carried by atmospheric turbulence.

Usability evaluation of pharmacogenomics clinical decision support aids and clinical knowledge resources in a computerized provider order entry system: a mixed methods approach.

PubMed

Devine, Emily Beth; Lee, Chia-Ju; Overby, Casey L; Abernethy, Neil; McCune, Jeannine; Smith, Joe W; Tarczy-Hornoch, Peter

2014-07-01

Pharmacogenomics (PGx) is positioned to have a widespread impact on the practice of medicine, yet physician acceptance is low. The presentation of context-specific PGx information, in the form of clinical decision support (CDS) alerts embedded in a computerized provider order entry (CPOE) system, can aid uptake. Usability evaluations can inform optimal design, which, in turn, can spur adoption. The study objectives were to: (1) evaluate an early prototype, commercial CPOE system with PGx-CDS alerts in a simulated environment, (2) identify potential improvements to the system user interface, and (3) understand the contexts under which PGx knowledge embedded in an electronic health record is useful to prescribers. Using a mixed methods approach, we presented seven cardiologists and three oncologists with five hypothetical clinical case scenarios. Each scenario featured a drug for which a gene encoding drug metabolizing enzyme required consideration of dosage adjustment. We used Morae(®) to capture comments and on-screen movements as participants prescribed each drug. In addition to PGx-CDS alerts, 'Infobutton(®)' and 'Evidence' icons provided participants with clinical knowledge resources to aid decision-making. Nine themes emerged. Five suggested minor improvements to the CPOE user interface; two suggested presenting PGx information through PGx-CDS alerts using an 'Infobutton' or 'Evidence' icon. The remaining themes were strong recommendations to provide succinct, relevant guidelines and dosing recommendations of phenotypic information from credible and trustworthy sources; any more information was overwhelming. Participants' median rating of PGx-CDS system usability was 2 on a Likert scale ranging from 1 (strongly agree) to 7 (strongly disagree). Usability evaluation results suggest that participants considered PGx information important for improving prescribing decisions; and that they would incorporate PGx-CDS when information is presented in relevant and useful ways. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

[THE EVALUATION OF THE EFFECTIVENESS OF THE IMPLEMENTATION OF INFORMATION SYSTEM 1C: ENTERPRISE IN THE HOSPITAL].

PubMed

Baimagambetova, A; Kulov, D; Tsay, A; Kairbekova, K; Sakenova, M

2017-03-01

The aim of research was to assess the impact of the introduction of information system 1C: Enterprise on the work of medical staff. It was evaluated staff satisfaction in terms of quality and speed of their duties, as well as sociological changes after the introduction in the work the information system 1C: Enterprise from 2010. The research involved 138 employees of the hospital, including 48 doctors and 90 nurses with experience of at least 5 years. The average age of respondents was 45 years. The study was conducted through questionnaires, including questions relating to life expectancy, changing the speed and quality of execution of tasks, also attended to questions about the change in the frequency of conflict situations and wages. Separately, it was included open-ended question about the change in the level of motivation before and after the implementation of the information system. Respondents gave the evaluation and describe the specific changes they have noticed. Objective assessment of the effectiveness was evaluated according to the official statistics on the number of people served, the time spent on one patient, the level of qualification of medical personnel. 76% of employees have noted positive changes in the work after the implementation of the information system 1C: Enterprise in the work, there is a change of diagnosis rate, the quality of treatment, 72.3% of physicians and 48% of nurses have noted a decrease in time spent on paperwork. 13.6% of physicians and 23.0% of nurses did not notice any difference. Other members expressed dissatisfaction, because of the necessity of learning of a computer program. After the number of the served population program of work increased by 6.8%, decreased the number of days of hospitalization by 12%. The use of modern information systems increases the level of health services and health workers, increasing productivity.

Landsat-4 MSS and Thematic Mapper data quality and information content analysis

NASA Technical Reports Server (NTRS)

Anuta, P. E.; Bartolucci, L. A.; Dean, M. E.; Lozano, D. F.; Malaret, E.; Mcgillem, C. D.; Valdes, J. A.; Valenzuela, C. R.

1984-01-01

Landsat-4 Thematic Mapper and Multispectral Scanner data were analyzed to obtain information on data quality and information content. Geometric evaluations were performed to test band-to-band registration accuracy. Thematic Mapper overall system resolution was evaluated using scene objects which demonstrated sharp high contrast edge responses. Radiometric evaluation included detector relative calibration, effects of resampling, and coherent noise effects. Information content evaluation was carried out using clustering, principal components, transformed divergence separability measure, and numerous supervised classifiers on data from Iowa and Illinois. A detailed spectral class analysis (multispectral classification) was carried out on data from the Des Moines, IA area to compare the information content of the MSS and TM for a large number of scene classes.

Economic Analysis and Business Case for Motor Carrier Industry Support of CVISN (Commercial Vehicle Information Systems and Networks)

DOT National Transportation Integrated Search

2007-10-02

The objective was to evaluate economic justifications for motor carriers to participate in CVISN deployment. CVISN (Commercial Vehicle Information Systems and Networks) includes: interstate credentials administration (registration and permitting), el...

What value may geographic information systems add to the art of identifying crash countermeasures?

DOT National Transportation Integrated Search

1999-04-01

Geographic Information Systems (GIS) can be employed to relate, organize, and analyze roadway and crash data, thereby facilitating crash countermeasure identification and evaluation. GIS cannot, however, replace the critical role of the local analyst...

Framework for evaluating public health surveillance systems for early detection of outbreaks: recommendations from the CDC Working Group.

PubMed

Buehler, James W; Hopkins, Richard S; Overhage, J Marc; Sosin, Daniel M; Tong, Van

2004-05-07

The threat of terrorism and high-profile disease outbreaks has drawn attention to public health surveillance systems for early detection of outbreaks. State and local health departments are enhancing existing surveillance systems and developing new systems to better detect outbreaks through public health surveillance. However, information is limited about the usefulness of surveillance systems for outbreak detection or the best ways to support this function. This report supplements previous guidelines for evaluating public health surveillance systems. Use of this framework is intended to improve decision-making regarding the implementation of surveillance for outbreak detection. Use of a standardized evaluation methodology, including description of system design and operation, also will enhance the exchange of information regarding methods to improve early detection of outbreaks. The framework directs particular attention to the measurement of timeliness and validity for outbreak detection. The evaluation framework is designed to support assessment and description of all surveillance approaches to early detection, whether through traditional disease reporting, specialized analytic routines for aberration detection, or surveillance using early indicators of disease outbreaks, such as syndromic surveillance.

Partners with a Purpose: District and Teachers Union Ccreate an Evaluation System That Nurtures Professional Growth

ERIC Educational Resources Information Center

Pham, Kathleen; Heinemann, Amanda

2014-01-01

What is--or should be--the purpose of a teacher evaluation system? To compare teachers? To inform the public? To help teachers improve? Legislators might say that a teacher evaluation system's purpose is to remove bad teachers. Administrators might say that it is to assist them in matching teacher skills to specific groups of students. Parents…

Passive sensor technology interface to assess elder activity in independent living.

PubMed

Alexander, Gregory L; Wakefield, Bonnie J; Rantz, Marilyn; Skubic, Marjorie; Aud, Myra A; Erdelez, Sanda; Ghenaimi, Said Al

2011-01-01

The effectiveness of clinical information systems to improve nursing and patient outcomes depends on human factors, including system usability, organizational workflow, and user satisfaction. The aim of this study was to examine to what extent residents, family members, and clinicians find a sensor data interface used to monitor elder activity levels usable and useful in an independent living setting. Three independent expert reviewers conducted an initial heuristic evaluation. Subsequently, 20 end users (5 residents, 5 family members, 5 registered nurses, and 5 physicians) participated in the evaluation. During the evaluation, each participant was asked to complete three scenarios taken from three residents. Morae recorder software was used to capture data during the user interactions. The heuristic evaluation resulted in 26 recommendations for interface improvement; these were classified under the headings content, aesthetic appeal, navigation, and architecture, which were derived from heuristic results. Total time for elderly residents to complete scenarios was much greater than for other users. Family members spent more time than clinicians but less time than residents did to complete scenarios. Elder residents and family members had difficulty interpreting clinical data and graphs, experienced information overload, and did not understand terminology. All users found the sensor data interface useful for identifying changing resident activities. Older adult users have special needs that should be addressed when designing clinical interfaces for them, especially information as important as health information. Evaluating human factors during user interactions with clinical information systems should be a requirement before implementation.

Evaluation research of small and medium-sized enterprise informatization on big data

NASA Astrophysics Data System (ADS)

Yang, Na

2017-09-01

Under the background of big data, key construction of small and medium-sized enterprise informationization level was needed, but information construction cost was large, while information cost of inputs can bring benefit to small and medium-sized enterprises. This paper established small and medium-sized enterprise informatization evaluation system from hardware and software security level, information organization level, information technology application and the profit level, and information ability level. The rough set theory was used to brief indexes, and then carry out evaluation by support vector machine (SVM) model. At last, examples were used to verify the theory in order to prove the effectiveness of the method.

CAESAR : an expert system for evaluation of scour and stream stability

DOT National Transportation Integrated Search

1999-01-01

This report documents the development and testing of a field-deployable, knowledge-based decision support system that assists bridge inspectors by acquiring, cataloging, storing, and retrieving information necessary for the evaluation of a bridge for...

HRATIS first year evaluation report

DOT National Transportation Integrated Search

2001-09-01

The ITS integration project, the Hampton Roads Advanced Traveler Information System (HRATIS), is a public-private partnership. The service collects information from multiple sources, fuses the data elements, and distributes the information through va...

Scientific customer needs - NASA user

NASA Technical Reports Server (NTRS)

Black, David C.

1987-01-01

Some requirements for scientific users of the Space Station are considered. The use of testbeds to evaluate design concepts for information systems, and for interfacing between designers and builders of systems is examined. The need for an information system that provides an effective interaction between ground-based users and their space-based equipment is discussed.

BIBLIO: A Computer System Designed to Support the Near-Library User Model of Information Retrieval.

ERIC Educational Resources Information Center

Belew, Richard K.; Holland, Maurita Peterson

1988-01-01

Description of the development of the Information Exchange Facility, a prototype microcomputer-based personal bibliographic facility, covers software selection, user selection, overview of the system, and evaluation. The plan for an integrated system, BIBLIO, and the future role of libraries are discussed. (eight references) (MES)

Evaluating Factors of Security Policy on Information Security Effectiveness in Developing Nations: A Case of Nigeria

ERIC Educational Resources Information Center

Okolo, Nkiru Benjamin

2016-01-01

Information systems of today face more potential security infringement than ever before. The regular susceptibility of data to breaches is a function of systems users' disinclination to follow appropriate security measures. A well-secured system maintains integrity, confidentiality, and availability, while providing appropriate and consistent…

Web-based provision of information on infectious diseases: a systems study.

PubMed

Roy, Anjana; Kostkova, Patty; Catchpole, Michael; Carson, Ewart

2006-12-01

The National electronic Library for Health (NeLH) is an Internet medical information resources portal, principally for healthcare professionals, within which the National electronic Library of Infection (NeLI) is one of NeLH Specialist Libraries providing evidence on infectious diseases. In this article, we describe a systems-based evaluation of NeLI based on a soft systems methodology. User feedback and other data for the analysis were obtained using online questionnaires. This evaluation, which is a pilot study aimed at demonstrating proof of concept, provided evidence for improving three systems that are crucial to effective NeLI provision. These are navigation of the site, quality and tagging of information provided by NeLI, and information regarding users and their usage of the system. On the basis of a soft systems analysis, an action plan was formulated identifying areas where improvement is needed. Actions for consideration included simplifying terminologies to improve the navigation, enhancing the provision of research assessments, quality tagging NeLI documents, provided by experts in the field, and attracting a broader cross-section of healthcare professional user.

Textractor: a hybrid system for medications and reason for their prescription extraction from clinical text documents.

PubMed

Meystre, Stéphane M; Thibault, Julien; Shen, Shuying; Hurdle, John F; South, Brett R

2010-01-01

OBJECTIVE To describe a new medication information extraction system-Textractor-developed for the 'i2b2 medication extraction challenge'. The development, functionalities, and official evaluation of the system are detailed. Textractor is based on the Apache Unstructured Information Management Architecture (UMIA) framework, and uses methods that are a hybrid between machine learning and pattern matching. Two modules in the system are based on machine learning algorithms, while other modules use regular expressions, rules, and dictionaries, and one module embeds MetaMap Transfer. The official evaluation was based on a reference standard of 251 discharge summaries annotated by all teams participating in the challenge. The metrics used were recall, precision, and the F(1)-measure. They were calculated with exact and inexact matches, and were averaged at the level of systems and documents. The reference metric for this challenge, the system-level overall F(1)-measure, reached about 77% for exact matches, with a recall of 72% and a precision of 83%. Performance was the best with route information (F(1)-measure about 86%), and was good for dosage and frequency information, with F(1)-measures of about 82-85%. Results were not as good for durations, with F(1)-measures of 36-39%, and for reasons, with F(1)-measures of 24-27%. The official evaluation of Textractor for the i2b2 medication extraction challenge demonstrated satisfactory performance. This system was among the 10 best performing systems in this challenge.

78 FR 67150 - Agency Information Collection Activities: Submission for OMB Review; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-11-08

... care while also increasing efficiency across the health care system. This would be achieved through...); Title of Information Collection: Evaluation of the Medicare Health Care Quality (MHCQ) Demonstration Evaluation: Focus Group and Interview Protocols; Use: The Medicare Health Care Quality (MHCQ) Demonstration...

Modern & Classical Languages: K-12 Program EValuation 1988-89.

ERIC Educational Resources Information Center

Martinez, Margaret Perea

This evaluation of the modern and classical languages programs, K-12, in the Albuquerque (New Mexico) public school system provides general information on the program's history, philosophy, recognition, curriculum development, teachers, and activities. Specific information is offered on the different program components, namely, the elementary…

Integrating Soft Set Theory and Fuzzy Linguistic Model to Evaluate the Performance of Training Simulation Systems

PubMed Central

Chang, Kuei-Hu; Chang, Yung-Chia; Chain, Kai; Chung, Hsiang-Yu

2016-01-01

The advancement of high technologies and the arrival of the information age have caused changes to the modern warfare. The military forces of many countries have replaced partially real training drills with training simulation systems to achieve combat readiness. However, considerable types of training simulation systems are used in military settings. In addition, differences in system set up time, functions, the environment, and the competency of system operators, as well as incomplete information have made it difficult to evaluate the performance of training simulation systems. To address the aforementioned problems, this study integrated analytic hierarchy process, soft set theory, and the fuzzy linguistic representation model to evaluate the performance of various training simulation systems. Furthermore, importance–performance analysis was adopted to examine the influence of saving costs and training safety of training simulation systems. The findings of this study are expected to facilitate applying military training simulation systems, avoiding wasting of resources (e.g., low utility and idle time), and providing data for subsequent applications and analysis. To verify the method proposed in this study, the numerical examples of the performance evaluation of training simulation systems were adopted and compared with the numerical results of an AHP and a novel AHP-based ranking technique. The results verified that not only could expert-provided questionnaire information be fully considered to lower the repetition rate of performance ranking, but a two-dimensional graph could also be used to help administrators allocate limited resources, thereby enhancing the investment benefits and training effectiveness of a training simulation system. PMID:27598390

Integrating Soft Set Theory and Fuzzy Linguistic Model to Evaluate the Performance of Training Simulation Systems.

PubMed

Chang, Kuei-Hu; Chang, Yung-Chia; Chain, Kai; Chung, Hsiang-Yu

2016-01-01

The advancement of high technologies and the arrival of the information age have caused changes to the modern warfare. The military forces of many countries have replaced partially real training drills with training simulation systems to achieve combat readiness. However, considerable types of training simulation systems are used in military settings. In addition, differences in system set up time, functions, the environment, and the competency of system operators, as well as incomplete information have made it difficult to evaluate the performance of training simulation systems. To address the aforementioned problems, this study integrated analytic hierarchy process, soft set theory, and the fuzzy linguistic representation model to evaluate the performance of various training simulation systems. Furthermore, importance-performance analysis was adopted to examine the influence of saving costs and training safety of training simulation systems. The findings of this study are expected to facilitate applying military training simulation systems, avoiding wasting of resources (e.g., low utility and idle time), and providing data for subsequent applications and analysis. To verify the method proposed in this study, the numerical examples of the performance evaluation of training simulation systems were adopted and compared with the numerical results of an AHP and a novel AHP-based ranking technique. The results verified that not only could expert-provided questionnaire information be fully considered to lower the repetition rate of performance ranking, but a two-dimensional graph could also be used to help administrators allocate limited resources, thereby enhancing the investment benefits and training effectiveness of a training simulation system.

Direct evaluation of free energy for large system through structure integration approach.

PubMed

Takeuchi, Kazuhito; Tanaka, Ryohei; Yuge, Koretaka

2015-09-30

We propose a new approach, 'structure integration', enabling direct evaluation of configurational free energy for large systems. The present approach is based on the statistical information of lattice. Through first-principles-based simulation, we find that the present method evaluates configurational free energy accurately in disorder states above critical temperature.

Accounting for human neurocognitive function in the design and evaluation of 360 degree situational awareness display systems

NASA Astrophysics Data System (ADS)

Metcalfe, Jason S.; Mikulski, Thomas; Dittman, Scott

2011-06-01

The current state and trajectory of development for display technologies supporting information acquisition, analysis and dissemination lends a broad informational infrastructure to operators of complex systems. The amount of information available threatens to outstrip the perceptual-cognitive capacities of operators, thus limiting their ability to effectively interact with targeted technologies. Therefore, a critical step in designing complex display systems is to find an appropriate match between capabilities, operational needs, and human ability to utilize complex information. The present work examines a set of evaluation parameters that were developed to facilitate the design of systems to support a specific military need; that is, the capacity to support the achievement and maintenance of real-time 360° situational awareness (SA) across a range of complex military environments. The focal point of this evaluation is on the reciprocity native to advanced engineering and human factors practices, with a specific emphasis on aligning the operator-systemenvironment fit. That is, the objective is to assess parameters for evaluation of 360° SA display systems that are suitable for military operations in tactical platforms across a broad range of current and potential operational environments. The approach is centered on five "families" of parameters, including vehicle sensors, data transmission, in-vehicle displays, intelligent automation, and neuroergonomic considerations. Parameters are examined under the assumption that displays designed to conform to natural neurocognitive processing will enhance and stabilize Soldier-system performance and, ultimately, unleash the human's potential to actively achieve and maintain the awareness necessary to enhance lethality and survivability within modern and future operational contexts.

An Annotated Bibliography of MANPRINT-Related Assessments and Evaluations Conducted by the U.S. Army, 2nd Edition: 1953 to 2009. Volume 3 - Test and Evaluation Reports

DTIC Science & Technology

2010-02-01

bibliography of the 583 MA reports reviewed by this paper . MANPRINT Asssessments are performed according to the direction of AR 602-2. They consist of an...bibliography of the 443 T&ERs reviewed by this paper . A T&ER is a system evaluation performed according to AR 73-1 for all systems in development in the...of the Defense Technical Information Center (DTIC) web page: https://dtic-stinet.dtic.mil/.  National Technical Information Service (NTIS): http

LANDSAT Range Resource Information System. [a user evaluation of green forage and rainfall accumulation maps

NASA Technical Reports Server (NTRS)

Boyd, W. E.; Harlan, J. C.

1981-01-01

A series of test products were developed from LANDSAT data sets for North Central Texas that paralleled the needs of ranchers, technical personnel, and the media. The products and evaluation questionnaires were mailed to approximately 150 ranchers who had reported an interest in evaluating the information systems. In addition to the rancher group, fourteen media people and a thirty-three member group in the agri business/technical community was also chosen to receive test products. The group responses are analyzed. Examples of the test products and associated questionnaires are included.

Scopus: A system for the evaluation of scientific journals

NASA Astrophysics Data System (ADS)

Guz, A. N.; Rushchitsky, J. J.

2009-04-01

The paper discusses the evaluation of scientific journals based on the Scopus database, information tools, and criteria. The SJR (SCImago Journal Rank) as the main criterion used by Scopus to evaluate scientific journals is considered. The Scopus and ISI systems are compared using information on the journal Prikladnaya Mekhanika ( International Applied Mechanics), a number of world-known journals on mechanics, and some journals on natural sciences issued by the National Academy of Sciences of Ukraine. Some comments and proposals are formulated. This paper may be considered as a follow up on papers published in Prikladnaya Mekhanika ( International Applied Mechanics) in 2005-2009

A Development of Automatic Audit System for Written Informed Consent using Machine Learning.

PubMed

Yamada, Hitomi; Takemura, Tadamasa; Asai, Takahiro; Okamoto, Kazuya; Kuroda, Tomohiro; Kuwata, Shigeki

2015-01-01

In Japan, most of all the university and advanced hospitals have implemented both electronic order entry systems and electronic charting. In addition, all medical records are subjected to inspector audit for quality assurance. The record of informed consent (IC) is very important as this provides evidence of consent from the patient or patient's family and health care provider. Therefore, we developed an automatic audit system for a hospital information system (HIS) that is able to evaluate IC automatically using machine learning.

Validating the Satisfaction and Continuance Intention of E-Learning Systems: Combining TAM and IS Success Models

ERIC Educational Resources Information Center

Lin, Tung-Cheng; Chen, Ching-Jen

2012-01-01

Many e-learning studies have evaluated learning attitudes and behaviors, based on TAM. However, a successful e-learning system (ELS) should take both system and information quality into account by applying ISM developed by Delone and McLean. In addition, the acceptance for information system depends on the perceived usefulness and ease of use…

Approach to building knowledge bases in information-measuring systems diagnostics of acute leukemias

NASA Astrophysics Data System (ADS)

Nikitaev, V. G.; Pronichev, A. N.; Polyakov, E. V.; Dmitrieva, V. V.

2018-01-01

The paper describes an approach for the formation of the reference base of peripheral blood cells and bone marrow in information-measuring systems of acute leukemia diagnostics. The proposed approach has allowed to create a system, that is enable peer evaluation of blood cells needed for the training of recognition systems when carrying out microscopic studies.

SYN-OP-SYS™: A Computerized Management Information System for Quality Assurance and Risk Management

PubMed Central

Thomas, David J.; Weiner, Jayne; Lippincott, Ronald C.

1985-01-01

SYN·OP·SYS™ is a computerized management information system for quality assurance and risk management. Computer software for the efficient collection and analysis of “occurrences” and the clinical data associated with these kinds of patient events is described. The system is evaluated according to certain computer design criteria, and the system's implementation is assessed.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques.

PubMed

Clark, Lindsey N; Benda, Natalie C; Hegde, Sudeep; McGeorge, Nicolette M; Guarrera-Schick, Theresa K; Hettinger, A Zachary; LaVergne, David T; Perry, Shawna J; Wears, Robert L; Fairbanks, Rollin J; Bisantz, Ann M

2017-04-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display's ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. Copyright © 2016 Elsevier Ltd. All rights reserved.

Usability evaluation of an emergency department information system prototype designed using cognitive systems engineering techniques

PubMed Central

Clark, Lindsey N.; Benda, Natalie C.; Hegde, Sudeep; McGeorge, Nicolette M.; Guarrera-Schick, Theresa K.; Hettinger, A. Zachary; LaVergne, David T.; Perry, Shawna J.; Wears, Robert L.; Fairbanks, Rollin J.; Bisantz, Ann M.

2017-01-01

This article presents an evaluation of novel display concepts for an emergency department information system (EDIS) designed using cognitive systems engineering methods. EDISs assist emergency medicine staff with tracking patient care and ED resource allocation. Participants performed patient planning and orientation tasks using the EDIS displays and rated the display’s ability to support various cognitive performance objectives along with the usability, usefulness, and predicted frequency of use for 18 system components. Mean ratings were positive for cognitive performance support objectives, usability, usefulness, and frequency of use, demonstrating the successful application of design methods to create useful and usable EDIS concepts that provide cognitive support for emergency medicine staff. Nurse and provider roles had significantly different perceptions of the usability and usefulness of certain EDIS components, suggesting that they have different information needs while working. PMID:28166896

Evaluation Methodologies for Information Management Systems; Building Digital Tobacco Industry Document Libraries at the University of California, San Francisco Library/Center for Knowledge Management; Experiments with the IFLA Functional Requirements for Bibliographic Records (FRBR); Coming to Term: Designing the Texas Email Repository Model.

ERIC Educational Resources Information Center

Morse, Emile L.; Schmidt, Heidi; Butter, Karen; Rider, Cynthia; Hickey, Thomas B.; O'Neill, Edward T.; Toves, Jenny; Green, Marlan; Soy, Sue; Gunn, Stan; Galloway, Patricia

2002-01-01

Includes four articles that discuss evaluation methods for information management systems under the Defense Advanced Research Projects Agency; building digital libraries at the University of California San Francisco's Tobacco Control Archives; IFLA's Functional Requirements for Bibliographic Records; and designing the Texas email repository model…

Development of design information for molecular-sieve type regenerative CO2-removal systems

NASA Technical Reports Server (NTRS)

Wright, R. M.; Ruder, J. M.; Dunn, V. B.; Hwang, K. C.

1973-01-01

Experimental and analytic studies were conducted with molecular sieve sorbents to provide basic design information, and to develop a system design technique for regenerable CO2-removal systems for manned spacecraft. Single sorbate equilibrium data were obtained over a wide range of conditions for CO2, water, nitrogen, and oxygen on several molecular sieve and silica gel sorbents. The coadsorption of CO2 with water preloads, and with oxygen and nitrogen was experimentally evaluated. Mass-transfer, and some limited heat-transfer performance evaluations were accomplished under representative operating conditions, including the coadsorption of CO2 and water. CO2-removal system performance prediction capability was derived.

Smart information system for gachon university gil hospital.

PubMed

Park, Dong Kyun; Jung, Eun Young; Jeong, Byung Hui; Moon, Byung Chan; Kang, Hyung Wook; Tchah, Hann; Han, Gi Seong; Cheng, Woo Sung; Lee, Young Ho

2012-03-01

In this research, the hospital information system of Gachon University Gil hospital is introduced and a future strategy for hospital information systems is proposed. This research introduces the development conditions of hospital information system at Gachon University Gil hospital, information about the development of the enterprise resource planning (ERP), a medical service process improvement system, and the personal health record (PHR) system. The medical service process and work efficiency were improved through the medical service process improvement system, which is the most common hospital information system at Gachon University Gil hospital and which includes an emergency medical service system, an online evaluation system and a round support system. Gachon University Gil hospital developed medical service improvement systems to increase work efficiency of medical team and optimized the systems to prove the availability of high-quality medical services for patients and their families. The PHR-based personalized health care solution is under development and will provide higher quality medical service for more patients in the future.

Smart Information System for Gachon University Gil Hospital

PubMed Central

Jung, Eun Young; Jeong, Byung Hui; Moon, Byung Chan; Kang, Hyung Wook; Tchah, Hann; Han, Gi Seong; Cheng, Woo Sung; Lee, Young Ho

2012-01-01

Objectives In this research, the hospital information system of Gachon University Gil hospital is introduced and a future strategy for hospital information systems is proposed. Methods This research introduces the development conditions of hospital information system at Gachon University Gil hospital, information about the development of the enterprise resource planning (ERP), a medical service process improvement system, and the personal health record (PHR) system. Results The medical service process and work efficiency were improved through the medical service process improvement system, which is the most common hospital information system at Gachon University Gil hospital and which includes an emergency medical service system, an online evaluation system and a round support system. Conclusions Gachon University Gil hospital developed medical service improvement systems to increase work efficiency of medical team and optimized the systems to prove the availability of high-quality medical services for patients and their families. The PHR-based personalized health care solution is under development and will provide higher quality medical service for more patients in the future. PMID:22509476

Multi-Modal Traveler Information System - Performance Criteria for Evaluating GCM Corridor Strategies & Technologies

DOT National Transportation Integrated Search

1997-07-16

The Gary-Chicago-Milwaukee (GCM) Multi-Modal Traveler Information System (MMTIS) is a complex project involving a wide spectrum of participants. In order to facilitate its implementation it is important to understand the direction of the MMTIS. This ...

Traffic Light System Can Increase Healthfulness Perception: Implications for Policy Making.

PubMed

Machín, Leandro; Aschemann-Witzel, Jessica; Curutchet, María Rosa; Giménez, Ana; Ares, Gastón

2018-04-04

To evaluate how information about low nutrient content included in the traffic light labeling system influences consumers' perception of the healthfulness of products with high content of 1 key nutrient, and to compare the traffic light system with warnings in terms of the perception of healthfulness. Images of front-of-pack (FOP) nutrition labels (the traffic light labeling system with different numbers of nutrients with low content, and warnings) were evaluated in study 1, whereas product labels featuring the different FOP nutrition labels were evaluated in study 2. Online studies conducted in Montevideo, Uruguay. A total of 1,228 Uruguayan Facebook users. Perception of healthfulness. The researchers used ANOVA to evaluate the influence of FOP nutrition labels on perceived healthfulness. The inclusion of information about low nutrient content in the traffic light system statistically significantly increased the perception of the healthfulness of products with high nutrient content. Nutritional warnings showed healthfulness ratings similar to those of the simplified version of the traffic light system. Information about low nutrient content in the traffic light system might be used to infer health, and thus could raise the perception of healthfulness and decrease the traffic light system's efficacy in discouraging the consumption of unhealthful products. A simplified version of the traffic light highlighting only high-nutrient content or nutritional warnings seems to overcome this problem. Copyright © 2018 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

An information system design for watershed-wide modeling of water loss to the atmosphere using remote sensing techniques

NASA Technical Reports Server (NTRS)

Khorram, S.

1977-01-01

Results are presented of a study intended to develop a general location-specific remote-sensing procedure for watershed-wide estimation of water loss to the atmosphere by evaporation and transpiration. The general approach involves a stepwise sequence of required information definition (input data), appropriate sample design, mathematical modeling, and evaluation of results. More specifically, the remote sensing-aided system developed to evaluate evapotranspiration employs a basic two-stage two-phase sample of three information resolution levels. Based on the discussed design, documentation, and feasibility analysis to yield timely, relatively accurate, and cost-effective evapotranspiration estimates on a watershed or subwatershed basis, work is now proceeding to implement this remote sensing-aided system.

Automated information retrieval using CLIPS

NASA Technical Reports Server (NTRS)

Raines, Rodney Doyle, III; Beug, James Lewis

1991-01-01

Expert systems have considerable potential to assist computer users in managing the large volume of information available to them. One possible use of an expert system is to model the information retrieval interests of a human user and then make recommendations to the user as to articles of interest. At Cal Poly, a prototype expert system written in the C Language Integrated Production System (CLIPS) serves as an Automated Information Retrieval System (AIRS). AIRS monitors a user's reading preferences, develops a profile of the user, and then evaluates items returned from the information base. When prompted by the user, AIRS returns a list of items of interest to the user. In order to minimize the impact on system resources, AIRS is designed to run in the background during periods of light system use.

Human Factors in the Design and Evaluation of Air Traffic Control Systems

DOT National Transportation Integrated Search

1995-04-01

This document presents human factors issues that should be considered in the design and evaluation of air traffic : control (ATC) systems and subsystems. It provides background material on the capabilities and limitations of humans as : information p...

Pharmaceutical information systems and possible implementations of informed consent - developing an heuristic

PubMed Central

2012-01-01

Background Denmark has implemented a comprehensive, nationwide pharmaceutical information system, and this system has been evaluated by the Danish Council of Ethics. The system can be seen as an exemplar of a comprehensive health information system for clinical use. Analysis The paper analyses 1) how informed consent can be implemented in the system and how different implementations create different impacts on autonomy and control of information, and 2) arguments directed towards justifying not seeking informed consent in this context. Results and Conclusion Based on the analysis a heuristic is provided which enables a ranking and estimation of the impact on autonomy and control of information of different options for consent to entry of data into the system and use of data from the system. The danger of routinisation of consent is identified. The Danish pharmaceutical information system raises issues in relation to autonomy and control of information, issues that will also occur in relation to other similar comprehensive health information systems. Some of these issues are well understood and their impact can be judged using the heuristic which is provided. More research is, however needed in relation to routinisation of consent. PMID:23157854

A multimedia interactive education system for prostate cancer patients: development and preliminary evaluation.

PubMed

Diefenbach, Michael A; Butz, Brian P

2004-01-21

A cancer diagnosis is highly distressing. Yet, to make informed treatment choices patients have to learn complicated disease and treatment information that is often fraught with medical and statistical terminology. Thus, patients need accurate and easy-to-understand information. To introduce the development and preliminary evaluation through focus groups of a novel highly-interactive multimedia-education software program for patients diagnosed with localized prostate cancer. The prostate interactive education system uses the metaphor of rooms in a virtual health center (ie, reception area, a library, physician offices, group meeting room) to organize information. Text information contained in the library is tailored to a person's information-seeking preference (ie, high versus low information seeker). We conducted a preliminary evaluation through 5 separate focus groups with prostate cancer survivors (N = 18) and their spouses (N = 15). Focus group results point to the timeliness and high acceptability of the software among the target audience. Results also underscore the importance of a guide or tutor who assists in navigating the program and who responds to queries to facilitate information retrieval. Focus groups have established the validity of our approach and point to new directions to further enhance the user interface.

An Object-Based Approach to Evaluation of Climate Variability Projections and Predictions

NASA Astrophysics Data System (ADS)

Ammann, C. M.; Brown, B.; Kalb, C. P.; Bullock, R.

2017-12-01

Evaluations of the performance of earth system model predictions and projections are of critical importance to enhance usefulness of these products. Such evaluations need to address specific concerns depending on the system and decisions of interest; hence, evaluation tools must be tailored to inform about specific issues. Traditional approaches that summarize grid-based comparisons of analyses and models, or between current and future climate, often do not reveal important information about the models' performance (e.g., spatial or temporal displacements; the reason behind a poor score) and are unable to accommodate these specific information needs. For example, summary statistics such as the correlation coefficient or the mean-squared error provide minimal information to developers, users, and decision makers regarding what is "right" and "wrong" with a model. New spatial and temporal-spatial object-based tools from the field of weather forecast verification (where comparisons typically focus on much finer temporal and spatial scales) have been adapted to more completely answer some of the important earth system model evaluation questions. In particular, the Method for Object-based Diagnostic Evaluation (MODE) tool and its temporal (three-dimensional) extension (MODE-TD) have been adapted for these evaluations. More specifically, these tools can be used to address spatial and temporal displacements in projections of El Nino-related precipitation and/or temperature anomalies, ITCZ-associated precipitation areas, atmospheric rivers, seasonal sea-ice extent, and other features of interest. Examples of several applications of these tools in a climate context will be presented, using output of the CESM large ensemble. In general, these tools provide diagnostic information about model performance - accounting for spatial, temporal, and intensity differences - that cannot be achieved using traditional (scalar) model comparison approaches. Thus, they can provide more meaningful information that can be used in decision-making and planning. Future extensions and applications of these tools in a climate context will be considered.

Constructing the informatics and information technology foundations of a medical device evaluation system: a report from the FDA unique device identifier demonstration.

PubMed

Drozda, Joseph P; Roach, James; Forsyth, Thomas; Helmering, Paul; Dummitt, Benjamin; Tcheng, James E

2018-02-01

The US Food and Drug Administration (FDA) has recognized the need to improve the tracking of medical device safety and performance, with implementation of Unique Device Identifiers (UDIs) in electronic health information as a key strategy. The FDA funded a demonstration by Mercy Health wherein prototype UDIs were incorporated into its electronic information systems. This report describes the demonstration's informatics architecture. Prototype UDIs for coronary stents were created and implemented across a series of information systems, resulting in UDI-associated data flow from manufacture through point of use to long-term follow-up, with barcode scanning linking clinical data with UDI-associated device attributes. A reference database containing device attributes and the UDI Research and Surveillance Database (UDIR) containing the linked clinical and device information were created, enabling longitudinal assessment of device performance. The demonstration included many stakeholders: multiple Mercy departments, manufacturers, health system partners, the FDA, professional societies, the National Cardiovascular Data Registry, and information system vendors. The resulting system of systems is described in detail, including entities, functions, linkage between the UDIR and proprietary systems using UDIs as the index key, data flow, roles and responsibilities of actors, and the UDIR data model. The demonstration provided proof of concept that UDIs can be incorporated into provider and enterprise electronic information systems and used as the index key to combine device and clinical data in a database useful for device evaluation. Keys to success and challenges to achieving this goal were identified. Fundamental informatics principles were central to accomplishing the system of systems model. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

Applied genetic evaluations for production and functional traits in dairy cattle.

PubMed

Mark, T

2004-08-01

The objective of this study was to review the current status of genetic evaluation systems for production and functional traits as practiced in different Interbull member countries and to discuss that status in relation to research results and potential improvements. Thirty-one countries provided information. Substantial variation was evident for number of traits considered per country, trait definition, genetic evaluation procedure within trait, effects included, and how these were treated in genetic evaluation models. All countries lacked genetic evaluations for one or more economically important traits. Improvement in the genetic evaluation models, especially for many functional traits, could be achieved by closing the gaps between research and practice. More detailed and up to date information about national genetic evaluation systems for traits in different countries is available at www.interbull.org. Female fertility and workability traits were considered in many countries and could be next in line for international genetic evaluations.

77 FR 65541 - Agency Information Collection Activities; Submission to the Office of Management and Budget for...

Federal Register 2010, 2011, 2012, 2013, 2014

2012-10-29

... DEPARTMENT OF EDUCATION [Docket No. ED-2012-ICCD-0045] Agency Information Collection Activities; Submission to the Office of Management and Budget for Review and Approval; Comment Request; Impact Evaluation of Teacher and Leader Evaluation Systems AGENCY: Department of Education (ED), Institute of Education...

The evaluation of advanced traveler information services (ATIS) impacts on truck travel time reliability : using the simulated yoked study concept

DOT National Transportation Integrated Search

2004-03-01

The ability of Advanced Traveler Information Systems (ATIS) to improve the on-time reliability of urban truck movements is evaluated through the application of the Heuristic On-Line Web- : Linked Arrival Time Estimation (HOWLATE) methodology. In HOWL...

An adaptive semantic based mediation system for data interoperability among Health Information Systems.

PubMed

Khan, Wajahat Ali; Khattak, Asad Masood; Hussain, Maqbool; Amin, Muhammad Bilal; Afzal, Muhammad; Nugent, Christopher; Lee, Sungyoung

2014-08-01

Heterogeneity in the management of the complex medical data, obstructs the attainment of data level interoperability among Health Information Systems (HIS). This diversity is dependent on the compliance of HISs with different healthcare standards. Its solution demands a mediation system for the accurate interpretation of data in different heterogeneous formats for achieving data interoperability. We propose an adaptive AdapteR Interoperability ENgine mediation system called ARIEN, that arbitrates between HISs compliant to different healthcare standards for accurate and seamless information exchange to achieve data interoperability. ARIEN stores the semantic mapping information between different standards in the Mediation Bridge Ontology (MBO) using ontology matching techniques. These mappings are provided by our System for Parallel Heterogeneity (SPHeRe) matching system and Personalized-Detailed Clinical Model (P-DCM) approach to guarantee accuracy of mappings. The realization of the effectiveness of the mappings stored in the MBO is evaluation of the accuracy in transformation process among different standard formats. We evaluated our proposed system with the transformation process of medical records between Clinical Document Architecture (CDA) and Virtual Medical Record (vMR) standards. The transformation process achieved over 90 % of accuracy level in conversion process between CDA and vMR standards using pattern oriented approach from the MBO. The proposed mediation system improves the overall communication process between HISs. It provides an accurate and seamless medical information exchange to ensure data interoperability and timely healthcare services to patients.

Computerization of a preanesthetic evaluation and user satisfaction evaluation.

PubMed

Arias, Antonio; Benítez, Sonia; Canosa, Daniela; Borbolla, Damián; Staccia, Gustavo; Plazzotta, Fernando; Casais, Marcela; Michelangelo, Hernán; Luna, Daniel; Bernaldo de Quirós, Fernán Gonzalez

2010-01-01

Preanesthetic evaluation purpose is to reduce morbidity and mortality through the review of the patient's medical history, clinical examination, and targeted clinical studies, providing referrals for medical consultations when appropriated. Changes in patient care, standards of health information management and patterns of perioperative care, have resulted in a re-conceptualization of this process where the documentation of patient medical information, the efforts in training and maintaining the integrity of the medical-legal evaluation are areas of concern. The aim of this paper is to describe the design, development, training, and implementation of a computerized preanesthetic evaluation form associated to the evaluation of the user satisfaction with the system. Since the system went live in September 2008 there were 15121 closed structured forms, 60% for ambulatory procedures and 40 % for procedures that required hospital admission. 82% of total closed structured forms had recorded a risk of the procedures of 1-2, according to the American Society of Anesthesiologists classification. The survey indicates a positive general satisfaction of the users with the system.

Novel Approaches to Improve Iris Recognition System Performance Based on Local Quality Evaluation and Feature Fusion

PubMed Central

2014-01-01

For building a new iris template, this paper proposes a strategy to fuse different portions of iris based on machine learning method to evaluate local quality of iris. There are three novelties compared to previous work. Firstly, the normalized segmented iris is divided into multitracks and then each track is estimated individually to analyze the recognition accuracy rate (RAR). Secondly, six local quality evaluation parameters are adopted to analyze texture information of each track. Besides, particle swarm optimization (PSO) is employed to get the weights of these evaluation parameters and corresponding weighted coefficients of different tracks. Finally, all tracks' information is fused according to the weights of different tracks. The experimental results based on subsets of three public and one private iris image databases demonstrate three contributions of this paper. (1) Our experimental results prove that partial iris image cannot completely replace the entire iris image for iris recognition system in several ways. (2) The proposed quality evaluation algorithm is a self-adaptive algorithm, and it can automatically optimize the parameters according to iris image samples' own characteristics. (3) Our feature information fusion strategy can effectively improve the performance of iris recognition system. PMID:24693243

Novel approaches to improve iris recognition system performance based on local quality evaluation and feature fusion.

PubMed

Chen, Ying; Liu, Yuanning; Zhu, Xiaodong; Chen, Huiling; He, Fei; Pang, Yutong

2014-01-01

For building a new iris template, this paper proposes a strategy to fuse different portions of iris based on machine learning method to evaluate local quality of iris. There are three novelties compared to previous work. Firstly, the normalized segmented iris is divided into multitracks and then each track is estimated individually to analyze the recognition accuracy rate (RAR). Secondly, six local quality evaluation parameters are adopted to analyze texture information of each track. Besides, particle swarm optimization (PSO) is employed to get the weights of these evaluation parameters and corresponding weighted coefficients of different tracks. Finally, all tracks' information is fused according to the weights of different tracks. The experimental results based on subsets of three public and one private iris image databases demonstrate three contributions of this paper. (1) Our experimental results prove that partial iris image cannot completely replace the entire iris image for iris recognition system in several ways. (2) The proposed quality evaluation algorithm is a self-adaptive algorithm, and it can automatically optimize the parameters according to iris image samples' own characteristics. (3) Our feature information fusion strategy can effectively improve the performance of iris recognition system.

Formal implementation of a performance evaluation model for the face recognition system.

PubMed

Shin, Yong-Nyuo; Kim, Jason; Lee, Yong-Jun; Shin, Woochang; Choi, Jin-Young

2008-01-01

Due to usability features, practical applications, and its lack of intrusiveness, face recognition technology, based on information, derived from individuals' facial features, has been attracting considerable attention recently. Reported recognition rates of commercialized face recognition systems cannot be admitted as official recognition rates, as they are based on assumptions that are beneficial to the specific system and face database. Therefore, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of any face recognition system. In this paper, we propose and formalize a performance evaluation model for the biometric recognition system, implementing an evaluation tool for face recognition systems based on the proposed model. Furthermore, we performed evaluations objectively by providing guidelines for the design and implementation of a performance evaluation system, formalizing the performance test process.

Consensus Recommendations for Systematic Evaluation of Drug-Drug Interaction Evidence for Clinical Decision Support

PubMed Central

Scheife, Richard T.; Hines, Lisa E.; Boyce, Richard D.; Chung, Sophie P.; Momper, Jeremiah; Sommer, Christine D.; Abernethy, Darrell R.; Horn, John; Sklar, Stephen J.; Wong, Samantha K.; Jones, Gretchen; Brown, Mary; Grizzle, Amy J.; Comes, Susan; Wilkins, Tricia Lee; Borst, Clarissa; Wittie, Michael A.; Rich, Alissa; Malone, Daniel C.

2015-01-01

Background Healthcare organizations, compendia, and drug knowledgebase vendors use varying methods to evaluate and synthesize evidence on drug-drug interactions (DDIs). This situation has a negative effect on electronic prescribing and medication information systems that warn clinicians of potentially harmful medication combinations. Objective To provide recommendations for systematic evaluation of evidence from the scientific literature, drug product labeling, and regulatory documents with respect to DDIs for clinical decision support. Methods A conference series was conducted to develop a structured process to improve the quality of DDI alerting systems. Three expert workgroups were assembled to address the goals of the conference. The Evidence Workgroup consisted of 15 individuals with expertise in pharmacology, drug information, biomedical informatics, and clinical decision support. Workgroup members met via webinar from January 2013 to February 2014. Two in-person meetings were conducted in May and September 2013 to reach consensus on recommendations. Results We developed expert-consensus answers to three key questions: 1) What is the best approach to evaluate DDI evidence?; 2) What evidence is required for a DDI to be applicable to an entire class of drugs?; and 3) How should a structured evaluation process be vetted and validated? Conclusion Evidence-based decision support for DDIs requires consistent application of transparent and systematic methods to evaluate the evidence. Drug information systems that implement these recommendations should be able to provide higher quality information about DDIs in drug compendia and clinical decision support tools. PMID:25556085

Two-stage commercial evaluation of engineering systems production projects for high-rise buildings

NASA Astrophysics Data System (ADS)

Bril, Aleksander; Kalinina, Olga; Levina, Anastasia

2018-03-01

The paper is devoted to the current and debatable problem of methodology of choosing the effective innovative enterprises for venture financing. A two-stage system of commercial innovation evaluation based on the UNIDO methodology is proposed. Engineering systems account for 25 to 40% of the cost of high-rise residential buildings. This proportion increases with the use of new construction technologies. Analysis of the construction market in Russia showed that the production of internal engineering systems elements based on innovative technologies has a growth trend. The production of simple elements is organized in small enterprises on the basis of new technologies. The most attractive for development is the use of venture financing of small innovative business. To improve the efficiency of these operations, the paper proposes a methodology for a two-stage evaluation of small business development projects. A two-stage system of commercial evaluation of innovative projects allows creating an information base for informed and coordinated decision-making on venture financing of enterprises that produce engineering systems elements for the construction business.

'CHEATS': a generic information communication technology (ICT) evaluation framework.

PubMed

Shaw, Nicola T

2002-05-01

This paper describes a generic framework for the evaluation of information communication technologies. This framework, CHEATS, utilises both qualitative and quantitative research methods and has proved appropriate in multiple clinical settings including telepsychiatry, teledermatology and teleeducation. The paper demonstrates how a multidisciplinary approach is essential when evaluating new and emerging technologies, particularly when such systems are implemented in real service as opposed to a research setting.

75 FR 25239 - Integrated Risk Information System (IRIS); Announcement of Availability of Literature Searches...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-05-07

... human health assessment program that evaluates quantitative and qualitative risk information on effects... quantitative and qualitative risk information on effects that may result from exposure to specific chemical...

Overview and Demonstration of USEPA’s Risk-Informed Materials Management (RIMM) Tool System

EPA Science Inventory

The Risk-Informed Materials Management (RIMM) Tool System is a data gathering and analysis platform for conducting material disposal and beneficial use assessments. Users can evaluate risks to human and ecological receptors associated with exposures to organic and inorganic chemi...

Evaluating effectiveness of real-time advanced traveler information systems using a small test vehicle fleet

DOT National Transportation Integrated Search

1997-01-01

ADVANCE was an in-vehicle advanced traveler information system (ATIS) providing route guidance in real time that operated in the northwestern portion and northwest suburbs of Chicago, Illinois. It used probe vehicles to generate dynamically travel ti...

QCS : a system for querying, clustering, and summarizing documents.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dunlavy, Daniel M.

2006-08-01

Information retrieval systems consist of many complicated components. Research and development of such systems is often hampered by the difficulty in evaluating how each particular component would behave across multiple systems. We present a novel hybrid information retrieval system--the Query, Cluster, Summarize (QCS) system--which is portable, modular, and permits experimentation with different instantiations of each of the constituent text analysis components. Most importantly, the combination of the three types of components in the QCS design improves retrievals by providing users more focused information organized by topic. We demonstrate the improved performance by a series of experiments using standard test setsmore » from the Document Understanding Conferences (DUC) along with the best known automatic metric for summarization system evaluation, ROUGE. Although the DUC data and evaluations were originally designed to test multidocument summarization, we developed a framework to extend it to the task of evaluation for each of the three components: query, clustering, and summarization. Under this framework, we then demonstrate that the QCS system (end-to-end) achieves performance as good as or better than the best summarization engines. Given a query, QCS retrieves relevant documents, separates the retrieved documents into topic clusters, and creates a single summary for each cluster. In the current implementation, Latent Semantic Indexing is used for retrieval, generalized spherical k-means is used for the document clustering, and a method coupling sentence ''trimming'', and a hidden Markov model, followed by a pivoted QR decomposition, is used to create a single extract summary for each cluster. The user interface is designed to provide access to detailed information in a compact and useful format. Our system demonstrates the feasibility of assembling an effective IR system from existing software libraries, the usefulness of the modularity of the design, and the value of this particular combination of modules.« less

QCS: a system for querying, clustering and summarizing documents.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dunlavy, Daniel M.; Schlesinger, Judith D.; O'Leary, Dianne P.

2006-10-01

Information retrieval systems consist of many complicated components. Research and development of such systems is often hampered by the difficulty in evaluating how each particular component would behave across multiple systems. We present a novel hybrid information retrieval system--the Query, Cluster, Summarize (QCS) system--which is portable, modular, and permits experimentation with different instantiations of each of the constituent text analysis components. Most importantly, the combination of the three types of components in the QCS design improves retrievals by providing users more focused information organized by topic. We demonstrate the improved performance by a series of experiments using standard test setsmore » from the Document Understanding Conferences (DUC) along with the best known automatic metric for summarization system evaluation, ROUGE. Although the DUC data and evaluations were originally designed to test multidocument summarization, we developed a framework to extend it to the task of evaluation for each of the three components: query, clustering, and summarization. Under this framework, we then demonstrate that the QCS system (end-to-end) achieves performance as good as or better than the best summarization engines. Given a query, QCS retrieves relevant documents, separates the retrieved documents into topic clusters, and creates a single summary for each cluster. In the current implementation, Latent Semantic Indexing is used for retrieval, generalized spherical k-means is used for the document clustering, and a method coupling sentence 'trimming', and a hidden Markov model, followed by a pivoted QR decomposition, is used to create a single extract summary for each cluster. The user interface is designed to provide access to detailed information in a compact and useful format. Our system demonstrates the feasibility of assembling an effective IR system from existing software libraries, the usefulness of the modularity of the design, and the value of this particular combination of modules.« less

Tested Tools You Can Use: Evaluating Earth System Science Courses

NASA Astrophysics Data System (ADS)

Lee, S. P.; Prakash, A.; Reider, D.; Baker, D.

2006-12-01

Earth System Science Education for the 21st Century (ESSE 21) has created a public access on-line evaluation resource available at http://esse21.usra.edu/evaltoolkit in collaboration with the ESSE 21 institutions, PIs, and evaluators. The purpose of the ESSE toolkit is to offer examples of how evaluation and assessment are/have been used in Earth System Science courses and programs. Our goal is to help instructors recognize different types of assessment and evaluation tools and uses that have proved useful in these courses and provide models for designing assessments in new courses. We have included actual examples of evaluations used by ESSE institution faculty in their own courses. This is not a comprehensive toolkit on educational evaluation and assessment, but it does provide several examples of evaluations that have been used successfully in Earth System Science courses and links to many good web resources on course evaluation. We have provided examples of assessments that are designed to collect information from students before, during and after courses. Some, presented in different formats, are designed to assess what students learn, others are designed to provide course instructors with information they can use to revise their courses. These assessments range from content tests to portfolios, from feedback forms to interviews, and from concept maps to attitude surveys.

Health Information Technologies-Academic and Commercial Evaluation (HIT-ACE) methodology: description and application to clinical feedback systems.

PubMed

Lyon, Aaron R; Lewis, Cara C; Melvin, Abigail; Boyd, Meredith; Nicodimos, Semret; Liu, Freda F; Jungbluth, Nathaniel

2016-09-22

Health information technologies (HIT) have become nearly ubiquitous in the contemporary healthcare landscape, but information about HIT development, functionality, and implementation readiness is frequently siloed. Theory-driven methods of compiling, evaluating, and integrating information from the academic and commercial sectors are necessary to guide stakeholder decision-making surrounding HIT adoption and to develop pragmatic HIT research agendas. This article presents the Health Information Technologies-Academic and Commercial Evaluation (HIT-ACE) methodology, a structured, theory-driven method for compiling and evaluating information from multiple sectors. As an example demonstration of the methodology, we apply HIT-ACE to mental and behavioral health measurement feedback systems (MFS). MFS are a specific class of HIT that support the implementation of routine outcome monitoring, an evidence-based practice. HIT-ACE is guided by theories and frameworks related to user-centered design and implementation science. The methodology involves four phases: (1) coding academic and commercial materials, (2) developer/purveyor interviews, (3) linking putative implementation mechanisms to hit capabilities, and (4) experimental testing of capabilities and mechanisms. In the current demonstration, phase 1 included a systematic process to identify MFS in mental and behavioral health using academic literature and commercial websites. Using user-centered design, implementation science, and feedback frameworks, the HIT-ACE coding system was developed, piloted, and used to review each identified system for the presence of 38 capabilities and 18 additional characteristics via a consensus coding process. Bibliometic data were also collected to examine the representation of the systems in the scientific literature. As an example, results are presented for the application of HIT-ACE phase 1 to MFS wherein 49 separate MFS were identified, reflecting a diverse array of characteristics and capabilities. Preliminary findings demonstrate the utility of HIT-ACE to represent the scope and diversity of a given class of HIT beyond what can be identified in the academic literature. Phase 2 data collection is expected to confirm and expand the information presented and phases 3 and 4 will provide more nuanced information about the impact of specific HIT capabilities. In all, HIT-ACE is expected to support adoption decisions and additional HIT development and implementation research.

Evaluation of a data dictionary system. [information dissemination and computer systems programs

NASA Technical Reports Server (NTRS)

Driggers, W. G.

1975-01-01

The usefulness was investigated of a data dictionary/directory system for achieving optimum benefits from existing and planned investments in computer data files in the Data Systems Development Branch and the Institutional Data Systems Division. Potential applications of the data catalogue system are discussed along with an evaluation of the system. Other topics discussed include data description, data structure, programming aids, programming languages, program networks, and test data.

Information System Design Methodology Based on PERT/CPM Networking and Optimization Techniques.

ERIC Educational Resources Information Center

Bose, Anindya

The dissertation attempts to demonstrate that the program evaluation and review technique (PERT)/Critical Path Method (CPM) or some modified version thereof can be developed into an information system design methodology. The methodology utilizes PERT/CPM which isolates the basic functional units of a system and sets them in a dynamic time/cost…

Bureau of Indian Affairs Schools: New Facilities Management Information System Promising, but Improved Data Accuracy Needed.

ERIC Educational Resources Information Center

General Accounting Office, Washington, DC.

A General Accounting Office (GAO) study evaluated the Bureau of Indian Affairs' (BIA) new facilities management information system (FMIS). Specifically, the study examined whether the new FMIS addresses the old system's weaknesses and meets BIA's management needs, whether BIA has finished validating the accuracy of data transferred from the old…

What Influences Geography Teachers' Usage of Geographic Information Systems? A Structural Equation Analysis

ERIC Educational Resources Information Center

Lay, Jinn-Guey; Chi, Yu-Lin; Hsieh, Yeu-Sheng; Chen, Yu-Wen

2013-01-01

Understanding the usage of the geographic information system (GIS) among geography teachers is a crucial step in evaluating the current dissemination of GIS knowledge and skills in Taiwan's educational system. The primary contribution of this research is to further our understanding of the factors that affect teachers' GIS usage. The structural…

Management Information Systems: Their Development and Use in the Administration of Higher Education.

ERIC Educational Resources Information Center

Minter, John, Ed.; Lawrence, Ben, Ed.

The purpose of the seminar, which brought together users and developers of analytical models and associated management information systems, was to explore in depth the problems and possibilities of such systems for higher education institutions, and to review the current "state-of-the-art." The papers in this report are: "Evaluating the…

Value of Defect Information in Automated Hardwood Edger and Trimmer Systems

Treesearch

Carmen Regalado; D. Earl Kline; Philip A. Araman

1992-01-01

Due to the limited capability of board defect scanners, not all defect information required to make the best edging and trimming decision can be scanned for use in an automated system. The objective of the study presented in this paper was to evaluate the lumber value obtainable from edging and trimming optimization using varying levels of defect information as input....

Design and implementation of a portal for the medical equipment market: MEDICOM.

PubMed

Palamas, S; Kalivas, D; Panou-Diamandi, O; Zeelenberg, C; van Nimwegen, C

2001-01-01

The MEDICOM (Medical Products Electronic Commerce) Portal provides the electronic means for medical-equipment manufacturers to communicate online with their customers while supporting the Purchasing Process and Post Market Surveillance. The Portal offers a powerful Internet-based search tool for finding medical products and manufacturers. Its main advantage is the fast, reliable and up-to-date retrieval of information while eliminating all unrelated content that a general-purpose search engine would retrieve. The Universal Medical Device Nomenclature System (UMDNS) registers all products. The Portal accepts end-user requests and generates a list of results containing text descriptions of devices, UMDNS attribute values, and links to manufacturer Web pages and online catalogues for access to more-detailed information. Device short descriptions are provided by the corresponding manufacturer. The Portal offers technical support for integration of the manufacturers Web sites with itself. The network of the Portal and the connected manufacturers sites is called the MEDICOM system. To establish an environment hosting all the interactions of consumers (health care organizations and professionals) and providers (manufacturers, distributors, and resellers of medical devices). The Portal provides the end-user interface, implements system management, and supports database compatibility. The Portal hosts information about the whole MEDICOM system (Common Database) and summarized descriptions of medical devices (Short Description Database); the manufacturers servers present extended descriptions. The Portal provides end-user profiling and registration, an efficient product-searching mechanism, bulletin boards, links to on-line libraries and standards, on-line information for the MEDICOM system, and special messages or advertisements from manufacturers. Platform independence and interoperability characterize the system design. Relational Database Management Systems are used for the system s databases. The end-user interface is implemented using HTML, Javascript, Java applets, and XML documents. Communication between the Portal and the manufacturers servers is implemented using a CORBA interface. Remote administration of the Portal is enabled by dynamically-generated HTML interfaces based on XML documents. A representative group of users evaluated the system. The aim of the evaluation was validation of the usability of all of MEDICOM s functionality. The evaluation procedure was based on ISO/IEC 9126 Information technology - Software product evaluation - Quality characteristics and guidelines for their use. The overall user evaluation of the MEDICOM system was very positive. The MEDICOM system was characterized as an innovative concept that brings significant added value to medical-equipment commerce. The eventual benefits of the MEDICOM system are (a) establishment of a worldwide-accessible marketplace between manufacturers and health care professionals that provides up-to-date and high-quality product information in an easy and friendly way and (b) enhancement of the efficiency of marketing procedures and after-sales support.

Design and Implementation of a Portal for the Medical Equipment Market: MEDICOM

PubMed Central

Kalivas, Dimitris; Panou-Diamandi, Ourania; Zeelenberg, Cees; van Nimwegen, Chris

2001-01-01

Background The MEDICOM (Medical Products Electronic Commerce) Portal provides the electronic means for medical-equipment manufacturers to communicate online with their customers while supporting the Purchasing Process and Post Market Surveillance. The Portal offers a powerful Internet-based search tool for finding medical products and manufacturers. Its main advantage is the fast, reliable and up-to-date retrieval of information while eliminating all unrelated content that a general-purpose search engine would retrieve. The Universal Medical Device Nomenclature System (UMDNS) registers all products. The Portal accepts end-user requests and generates a list of results containing text descriptions of devices, UMDNS attribute values, and links to manufacturer Web pages and online catalogues for access to more-detailed information. Device short descriptions are provided by the corresponding manufacturer. The Portal offers technical support for integration of the manufacturers' Web sites with itself. The network of the Portal and the connected manufacturers' sites is called the MEDICOM system. Objective To establish an environment hosting all the interactions of consumers (health care organizations and professionals) and providers (manufacturers, distributors, and resellers of medical devices). Methods The Portal provides the end-user interface, implements system management, and supports database compatibility. The Portal hosts information about the whole MEDICOM system (Common Database) and summarized descriptions of medical devices (Short Description Database); the manufacturers' servers present extended descriptions. The Portal provides end-user profiling and registration, an efficient product-searching mechanism, bulletin boards, links to on-line libraries and standards, on-line information for the MEDICOM system, and special messages or advertisements from manufacturers. Platform independence and interoperability characterize the system design. Relational Database Management Systems are used for the system's databases. The end-user interface is implemented using HTML, Javascript, Java applets, and XML documents. Communication between the Portal and the manufacturers' servers is implemented using a CORBA interface. Remote administration of the Portal is enabled by dynamically-generated HTML interfaces based on XML documents. A representative group of users evaluated the system. The aim of the evaluation was validation of the usability of all of MEDICOM's functionality. The evaluation procedure was based on ISO/IEC 9126 Information technology - Software product evaluation - Quality characteristics and guidelines for their use. Results The overall user evaluation of the MEDICOM system was very positive. The MEDICOM system was characterized as an innovative concept that brings significant added value to medical-equipment commerce. Conclusions The eventual benefits of the MEDICOM system are (a) establishment of a worldwide-accessible marketplace between manufacturers and health care professionals that provides up-to-date and high-quality product information in an easy and friendly way and (b) enhancement of the efficiency of marketing procedures and after-sales support. PMID:11772547

76 FR 6782 - Agency Information Collection Activities; Proposed Collection; Comment Request; Information...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-02-08

... ENVIRONMENTAL PROTECTION AGENCY [EPA-HQ-SFUND-2011-0052; FRL-9263-6] Agency Information Collection Activities; Proposed Collection; Comment Request; Information Collection Request for Superfund Site Evaluation and Hazard Ranking System AGENCY: Environmental Protection Agency (EPA). ACTION: Notice. SUMMARY...

Assessing electronic health record systems in emergency departments: Using a decision analytic Bayesian model.

PubMed

Ben-Assuli, Ofir; Leshno, Moshe

2016-09-01

In the last decade, health providers have implemented information systems to improve accuracy in medical diagnosis and decision-making. This article evaluates the impact of an electronic health record on emergency department physicians' diagnosis and admission decisions. A decision analytic approach using a decision tree was constructed to model the admission decision process to assess the added value of medical information retrieved from the electronic health record. Using a Bayesian statistical model, this method was evaluated on two coronary artery disease scenarios. The results show that the cases of coronary artery disease were better diagnosed when the electronic health record was consulted and led to more informed admission decisions. Furthermore, the value of medical information required for a specific admission decision in emergency departments could be quantified. The findings support the notion that physicians and patient healthcare can benefit from implementing electronic health record systems in emergency departments. © The Author(s) 2015.

Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot. Executive Summary

ERIC Educational Resources Information Center

Lipscomb, Stephen; Chiang, Hanley; Gill, Brian

2012-01-01

The Commonwealth of Pennsylvania plans to develop a new statewide evaluation system for teachers and principals in its public schools by school year 2013-2014. To inform the development of this evaluation system, the Team Pennsylvania Foundation (Team PA) undertook the first phase of the Pennsylvania Teacher and Principal Evaluation…

Value-Added Estimates for Phase 1 of the Pennsylvania Teacher and Principal Evaluation Pilot. Full Report

ERIC Educational Resources Information Center

Lipscomb, Stephen; Chiang, Hanley; Gill, Brian

2012-01-01

The Commonwealth of Pennsylvania plans to develop a new statewide evaluation system for teachers and principals in its public schools by school year 2013-2014. To inform the development of this evaluation system, the Team Pennsylvania Foundation (Team PA) undertook the first phase of the Pennsylvania Teacher and Principal Evaluation…

[Wound information management system: a standardized scheme for acquisition, storage and management of wound information].

PubMed

Liu, Hu; Su, Rong-jia; Wu, Min-jie; Zhang, Yi; Qiu, Xiang-jun; Feng, Jian-gang; Xie, Ting; Lu, Shu-liang

2012-06-01

To form a wound information management scheme with objectivity, standardization, and convenience by means of wound information management system. A wound information management system was set up with the acquisition terminal, the defined wound description, the data bank, and related softwares. The efficacy of this system was evaluated in clinical practice. The acquisition terminal was composed of the third generation mobile phone and the software. It was feasible to get access to the wound information, including description, image, and therapeutic plan from the data bank by mobile phone. During 4 months, a collection of a total of 232 wound treatment information was entered, and accordingly standardized data of 38 patients were formed automatically. This system can provide standardized wound information management by standardized techniques of acquisition, transmission, and storage of wound information. It can be used widely in hospitals, especially primary medical institutions. Data resource of the system makes it possible for epidemiological study with large sample size in future.

A model of evaluation planning, implementation and management: Toward a ?culture of information? within organizations

NASA Astrophysics Data System (ADS)

Bhola, H. S.

1992-03-01

The argument underlying the ongoing "paradigm shift" from logical positivism to constructionism is briefly laid out. A model of evaluation planning, implementation and management (called the P-I-M Model, for short) is then presented that assumes a complementarity between the two paradigms. The model further implies that for effective decision-making within human organizations, both "evaluative data" and "descriptive data" are needed. "Evaluative data" generated by evaluation studies must, therefore, be undergirded by an appropriate management information system (MIS) that can generate "descriptive data", concurrently with the process of program implementation. The P-I-M Model, if fully actualized, will enable human organizations to become vibrant "cultures of information" where "informed" decision-making becomes a shared norm among all stakeholders.

Global Combat Support System - Army Increment 2 (GCSS-A Inc 2)

DTIC Science & Technology

2016-03-01

2016 Major Automated Information System Annual Report Global Combat Support System - Army Increment 2 (GCSS-A Inc 2) Defense Acquisition...Secretary of Defense PB - President’s Budget RDT&E - Research, Development, Test, and Evaluation SAE - Service Acquisition Executive TBD - To Be...Date Assigned: Program Information Program Name Global Combat Support System - Army Increment 2 (GCSS-A Inc 2) DoD Component Army Responsible

Executive Information Systems for Providing Next Generation Strategic Information: An Evaluation of EIS (Executive Information System) Software and Recommended Applicability within the FAA Computing Environment

DTIC Science & Technology

1989-01-01

the FAA Computing Environment 7. Author(s) S. Performing Organization Report No. MT/O1-89. Al 9. Performing Organization Name and Address 10. Work Unit...him in advance by analysts and developers -- an electronic3 version of the Performance Indicators report. Ease of Use. pcEXPRESS has an automatic link...overcome within the required timeframe. I These advanced features of the EXPRESS system allow the fastest possible response to changing executive information

IRIS Toxicological Review of Ammonia (External Review Draft ...

EPA Pesticide Factsheets

EPA is conducting a peer review of the scientific basis supporting the human health hazard and dose-response assessment of ammonia that will appear in the Integrated Risk Information System (IRIS) database. EPA is undertaking an Integrated Risk Information System (IRIS) health assessment for ammonia. IRIS is an EPA database containing Agency scientific positions on potential adverse human health effects that may result from chronic (or lifetime) exposure to chemicals in the environment. IRIS contains chemical-specific summaries of qualitative and quantitative health information in support of two steps of the risk assessment paradigm, i.e., hazard identification and dose-response evaluation. IRIS assessments are used in combination with specific situational exposure assessment information to evaluate potential public health risk associated with environmental contaminants.

IRIS Toxicological Review of n-Butanol (External Review Draft ...

EPA Pesticide Factsheets

EPA is conducting a peer review of the scientific basis supporting the human health hazard and dose-response assessment of n-butanol that will appear in the Integrated Risk Information System (IRIS) database. EPA is undertaking an Integrated Risk Information System (IRIS) health assessment for n-butanol. IRIS is an EPA database containing Agency scientific positions on potential adverse human health effects that may result from chronic (or lifetime) exposure to chemicals in the environment. IRIS contains chemical-specific summaries of qualitative and quantitative health information in support of two steps of the risk assessment paradigm, i.e., hazard identification and dose-response evaluation. IRIS assessments are used in combination with specific situational exposure assessment information to evaluate potential public health risk associated with environmental contaminants.

Analysis of Information Security Management Systems at 5 Domestic Hospitals with More than 500 Beds

PubMed Central

Park, Woo-Sung; Son, Seung-Sik; Lee, Mee-Jeong; Kim, Shin-Hyo; Choi, Eun-Mi; Bang, Ji-Eon; Kim, Yea-Eun; Kim, Ok-Nam

2010-01-01

Objectives The information security management systems (ISMS) of 5 hospitals with more than 500 beds were evaluated with regards to the level of information security, management, and physical and technical aspects so that we might make recommendations on information security and security countermeasures which meet both international standards and the needs of individual hospitals. Methods The ISMS check-list derived from international/domestic standards was distributed to each hospital to complete and the staff of each hospital was interviewed. Information Security Indicator and Information Security Values were used to estimate the present security levels and evaluate the application of each hospital's current system. Results With regard to the moderate clause of the ISMS, the hospitals were determined to be in compliance. The most vulnerable clause was asset management, in particular, information asset classification guidelines. The clauses of information security incident management and business continuity management were deemed necessary for the establishment of successful ISMS. Conclusions The level of current ISMS in the hospitals evaluated was determined to be insufficient. Establishment of adequate ISMS is necessary to ensure patient privacy and the safe use of medical records for various purposes. Implementation of ISMS which meet international standards with a long-term and comprehensive perspective is of prime importance. To reflect the requirements of the varied interests of medical staff, consumers, and institutions, the establishment of political support is essential to create suitable hospital ISMS. PMID:21818429

An Information Security Control Assessment Methodology for Organizations

ERIC Educational Resources Information Center

Otero, Angel R.

2014-01-01

In an era where use and dependence of information systems is significantly high, the threat of incidents related to information security that could jeopardize the information held by organizations is more and more serious. Alarming facts within the literature point to inadequacies in information security practices, particularly the evaluation of…

Listening to the user: A case study

NASA Technical Reports Server (NTRS)

Pryor, H. E.

1976-01-01

The managers of the NASA Scientific and Technical Information System consistently maintain that whatever scientific and technical information services and products are provided must be geared primarily to user needs and not simply system compatibility and convenience. A system evaluation study begun in 1973 and continued to the present is described. The thrust of this on-going examination is to regularly evaluate the usefulness of the present information system to those it is intended to serve, engineers and scientists working in their professional roles, and to identify areas and ways in which the system can be made more responsive to user needs. Techniques used have covered the range from personal, in-depth interviews to widely distributed questionnaires. The findings have been positive. Many refinements made to on-going programs and projects and new endeavors begun in direct response to stated user needs are discussed. In the main these needs are not unreasonable and thus can be responded to with cost effective system modifications.

Client Functional Assessment Data as Management Information: Woodrow Wilson Rehabilitation Center's Management Information System

PubMed Central

Steidle, Ernest F.

1983-01-01

This paper describes the design of a functional assessment system, a component of a management information system (MIS) that supports a comprehensive rehabilitation facility. Products of the subsystem document the functional status of rehabilitation clients through process evaluation reporting and outcomes reporting. The purpose of this paper is to describe the design of this MIS component. The environment supported, the integration requirements and the needed development approach is unique, requiring significant input from health care professionals, medical informatics specialists, statisticians and program evaluators. Strategies for the implementation of the functional assessment system are the major results reported in this paper. They are most useful to the systems designer or management engineer in a human service delivery setting. MIS plan development, computer file structure and access methods, and approaches to scheduling applications is described. Finally, the development of functional status measures is discussed. Application of the methodologies described will facilitate similar efforts towards systems development in other human service delivery settings.

Power System Information Delivering System Based on Distributed Object

NASA Astrophysics Data System (ADS)

Tanaka, Tatsuji; Tsuchiya, Takehiko; Tamura, Setsuo; Seki, Tomomichi; Kubota, Kenji

In recent years, improvement in computer performance and development of computer network technology or the distributed information processing technology has a remarkable thing. Moreover, the deregulation is starting and will be spreading in the electric power industry in Japan. Consequently, power suppliers are required to supply low cost power with high quality services to customers. Corresponding to these movements the authors have been proposed SCOPE (System Configuration Of PowEr control system) architecture for distributed EMS/SCADA (Energy Management Systems / Supervisory Control and Data Acquisition) system based on distributed object technology, which offers the flexibility and expandability adapting those movements. In this paper, the authors introduce a prototype of the power system information delivering system, which was developed based on SCOPE architecture. This paper describes the architecture and the evaluation results of this prototype system. The power system information delivering system supplies useful power systems information such as electric power failures to the customers using Internet and distributed object technology. This system is new type of SCADA system which monitors failure of power transmission system and power distribution system with geographic information integrated way.

Reporting of HIV-infected pregnant women: estimates from a Brazilian study.

PubMed

Domingues, Rosa Maria Soares Madeira; Saraceni, Valéria; Leal, Maria do Carmo

2018-01-01

To estimate the coverage of the reporting of cases of HIV-infected pregnant women, to estimate the increase in the coverage of the reporting with the routine search of data in other Brazilian health information systems, and to identify missed opportunities for identification of HIV-infected pregnant women in Brazilian maternity hospitals. This is a descriptive study on the linkage of Brazilian databases with primary data from the "Nascer no Brasil" study and secondary database collection from national health information systems. The "Nascer no Brasil" is a national-based study carried out in 2011-2012 with 23,894 pregnant women, which identified HIV-infected pregnant women using prenatal and medical records. We searched for cases of HIV-infected pregnant women identified in the "Nascer no Brasil" study in the Information System of Notifiable Diseases, the Control System for Laboratory Tests of the National CD4+/CD8+ Lymphocyte Count and HIV Viral Load Network, and the Logistics Control System for Medications. We used the OpenRecLink software for the linkage of databases. We estimated the notification coverage, with the respective confidence interval, of the evaluated Brazilian health information systems. We estimated the coverage of the reporting of HIV-infected pregnant women in the Information System of Notifiable Diseases as 57.1% (95%CI 42.9-70.2), and we located 89.3% of the HIV-infected pregnant women (95%CI 81.2-94.2) in some of the Brazilian health information systems researched. The search in other national health information systems would result in an increase of 57.1% of the reported cases. We identified no missed opportunities for the diagnosis of HIV+ in pregnant women in the maternity hospitals evaluated by the "Nascer no Brasil" study. The routine search for information in other Brazilian health information systems, a procedure carried out by the Ministry of Health for cases of AIDS in adults and children, should be adopted for cases of HIV in pregnancy.

Distributed Practicum Supervision in a Managed Learning Environment (MLE)

ERIC Educational Resources Information Center

Carter, David

2005-01-01

This evaluation-research feasibility study piloted the creation of a technology-mediated managed learning environment (MLE) involving the implementation of one of a new generation of instructionally driven management information systems (IMISs). The system, and supporting information and communications technology (ICT) was employed to support…

Evaluation and Development of Pavement Scores, Performance Models and Needs Estimates for the TXDOT Pavement Management Information System : Final Report

DOT National Transportation Integrated Search

2012-10-01

This project conducted a thorough review of the existing Pavement Management Information System (PMIS) database, : performance models, needs estimates, utility curves, and scores calculations, as well as a review of District practices : concerning th...

Business Informatics: An Engineering Perspective on Information Systems

ERIC Educational Resources Information Center

Helfert, Markus

2008-01-01

Over the last three decades many universities have offered various programmes related to Information Systems. However, the rapid changes in recent years demand constant evaluation and modification of education programmes. Recent challenges include, for instance, the move towards programmes that are more applied and professionally-orientated. The…

Training Issues Associated with COTS-based Information Intensive Systems.

ERIC Educational Resources Information Center

Farr, John V.; Verma, Dinesh

2002-01-01

A literature review and survey responses from 194 information technology and aerospace contractors identified methods and outcomes of training delivery. Results were used to develop a framework for evaluating and selecting commercial off-the-shelf systems (COTS) for operations and maintenance training. (Contains 11 references.) (SK)

Candidate Causes. Sediments. In: Causal Analysis, Diagnosis Decision Information System, USEPA Website

EPA Science Inventory

CADDIS is an online application that helps scientists and engineers in the Regions, States, and Tribes find, access, organize, use, and share information to conduct causal evaluations in aquatic systems. It is based on the USEPA stressor identification process, a formal method fo...

A Web-based searchable system to confirm magnetic resonance compatibility of implantable medical devices in Japan: a preliminary study.

PubMed

Fujiwara, Yasuhiro; Fujioka, Hitoshi; Watanabe, Tomoko; Sekiguchi, Maiko; Murakami, Ryuji

2017-09-01

Confirmation of the magnetic resonance (MR) compatibility of implanted medical devices (IMDs) is mandatory before conducting magnetic resonance imaging (MRI) examinations. In Japan, few such confirmation methods are in use, and they are time-consuming. This study aimed to develop a Web-based searchable MR safety information system to confirm IMD compatibility and to evaluate the usefulness of the system. First, MR safety information for intravascular stents and stent grafts sold in Japan was gathered by interviewing 20 manufacturers. These IMDs were categorized based on the descriptions available on medical package inserts as: "MR Safe," "MR Conditional," "MR Unsafe," "Unknown," and "No Medical Package Insert Available". An MR safety information database for implants was created based on previously proposed item lists. Finally, a Web-based searchable system was developed using this database. A questionnaire was given to health-care personnel in Japan to evaluate the usefulness of this system. Seventy-nine datasets were collected using information provided by 12 manufacturers and by investigating the medical packaging of the IMDs. Although the datasets must be updated by collecting data from other manufacturers, this system facilitates the easy and rapid acquisition of MR safety information for IMDs, thereby improving the safety of MRI examinations.

48 CFR 2942.1503 - Procedures.

Code of Federal Regulations, 2011 CFR

2011-10-01

... at least annually for submission to the Past Performance Information Retrieval System (PPIRS), and... ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 2942.1503 Procedures. (a) In accordance with... criteria within their contracting activities. (d) Release of contractor performance evaluation information...

48 CFR 2942.1503 - Procedures.

Code of Federal Regulations, 2014 CFR

2014-10-01

... at least annually for submission to the Past Performance Information Retrieval System (PPIRS), and... ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 2942.1503 Procedures. (a) In accordance with... criteria within their contracting activities. (d) Release of contractor performance evaluation information...

48 CFR 2942.1503 - Procedures.

Code of Federal Regulations, 2010 CFR

2010-10-01

... at least annually for submission to the Past Performance Information Retrieval System (PPIRS), and... ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 2942.1503 Procedures. (a) In accordance with... criteria within their contracting activities. (d) Release of contractor performance evaluation information...

48 CFR 2942.1503 - Procedures.

Code of Federal Regulations, 2013 CFR

2013-10-01

... at least annually for submission to the Past Performance Information Retrieval System (PPIRS), and... ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 2942.1503 Procedures. (a) In accordance with... criteria within their contracting activities. (d) Release of contractor performance evaluation information...

48 CFR 2942.1503 - Procedures.

Code of Federal Regulations, 2012 CFR

2012-10-01

... at least annually for submission to the Past Performance Information Retrieval System (PPIRS), and... ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 2942.1503 Procedures. (a) In accordance with... criteria within their contracting activities. (d) Release of contractor performance evaluation information...

20 CFR 637.230 - Use of incentive bonuses.

Code of Federal Regulations, 2010 CFR

2010-04-01

... in paragraph (d) of this section, technical assistance, data and information collection and compilation, management information systems, post-program followup activities, and research and evaluation... information collection and compilation, recordkeeping, or the preparation of applications for incentive...

Existing pavement input information for the mechanistic-empirical pavement design guide.

DOT National Transportation Integrated Search

2009-02-01

The objective of this study is to systematically evaluate the Iowa Department of Transportations (DOTs) existing Pavement Management Information System (PMIS) with respect to the input information required for Mechanistic-Empirical Pavement Des...

IRIS Toxicological Review of Ammonia Noncancer Inhalation ...

EPA Pesticide Factsheets

EPA has finalized the Integrated Risk Information System (IRIS) Assessment of Ammonia (Noncancer Inhalation). This assessment addresses the potential noncancer human health effects from long-term inhalation exposure to ammonia. Now final, this assessment will update the current toxicological information on ammonia posted in 1991. EPA’s program and regional offices may use this assessment to inform decisions to protect human health. EPA completed the Integrated Risk Information System (IRIS) health assessment for ammonia. IRIS is an EPA database containing Agency scientific positions on potential adverse human health effects that may result from chronic (or lifetime) exposure to chemicals in the environment. IRIS contains chemical-specific summaries of qualitative and quantitative health information in support of two steps of the risk assessment paradigm, i.e., hazard identification and dose-response evaluation. IRIS assessments are used in combination with specific situational exposure assessment information to evaluate potential public health risk associated with environmental contaminants.

Development of the National Health Information Systems in Botswana: Pitfalls, prospects and lessons.

PubMed

Seitio-Kgokgwe, Onalenna; Gauld, Robin D C; Hill, Philip C; Barnett, Pauline

2015-01-01

Studies evaluating development of health information systems in developing countries are limited. Most of the available studies are based on pilot projects or cross-sectional studies. We took a longitudinal approach to analysing the development of Botswana's health information systems. We aimed to: (i) trace the development of the national health information systems in Botswana (ii) identify pitfalls during development and prospects that could be maximized to strengthen the system; and (iii) draw lessons for Botswana and other countries working on establishing or improving their health information systems. This article is based on data collected through document analysis and key informant interviews with policy makers, senior managers and staff of the Ministry of Health and senior officers from various stakeholder organizations. Lack of central coordination, weak leadership, weak policy and regulatory frameworks, and inadequate resources limited development of the national health information systems in Botswana. Lack of attention to issues of organizational structure is one of the major pitfalls. The ongoing reorganization of the Ministry of Health provides opportunity to reposition the health information system function. The current efforts including development of the health information management policy and plan could enhance the health information management system.

Oregon regional intelligent transportation systems (ITS) integration program. Final phase III report, transit tracker information displays

DOT National Transportation Integrated Search

2003-11-14

Transit Tracker uses global positioning system (GPS) technology to track how far a bus is along its scheduled route. This document presents the evaluation strategies and objectives, the data collection methodologies, and the results of the evaluation...

Los Angeles congestion reduction demonstration (Metro ExpressLanes) program. National evaluation : traffic system data test plan.

DOT National Transportation Integrated Search

1997-01-01

This document reports on the formal evaluation of the targeted (limited but highly focused) deployment of the Advanced Driver and Vehicle Advisory Navigation ConcEpt (ADVANCE), an in-vehicle advanced traveler information system designed to provide sh...

Applying the System Component and Operationally Relevant Evaluation (SCORE) Framework to Evaluate Advanced Military Technologies

DTIC Science & Technology

2010-03-01

and charac- terize the actions taken by the soldier (e.g., running, walking, climbing stairs ). Real-time image capture and exchange N The ability of...multimedia information sharing among soldiers in the field, two-way speech translation systems, and autonomous robotic platforms. Key words: Emerging...soldiers in the field, two-way speech translation systems, and autonomous robotic platforms. It has been the foundation for 10 technology evaluations

The case for randomized controlled trials to assess the impact of clinical information systems.

PubMed

Liu, Joseph L Y; Wyatt, Jeremy C

2011-01-01

There is a persistent view of a significant minority in the medical informatics community that the randomized controlled trial (RCT) has a limited role to play in evaluating clinical information systems. A common reason voiced by skeptics is that these systems are fundamentally different from drug interventions, so the RCT is irrelevant. There is an urgent need to promote the use of RCTs, given the shift to evidence-based policy and the need to demonstrate cost-effectiveness of these systems. The authors suggest returning to first principles and argue that what is required is clarity about how to match methods to evaluation questions. The authors address common concerns about RCTs, and the extent to which they are fallacious, and also discuss the challenges of conducting RCTs in informatics and alternative study designs when randomized trials are infeasible. While neither a perfect nor universal evaluation method, RCTs form an important part of an evaluator's toolkit.

The case for randomized controlled trials to assess the impact of clinical information systems

PubMed Central

Wyatt, Jeremy C

2011-01-01

There is a persistent view of a significant minority in the medical informatics community that the randomized controlled trial (RCT) has a limited role to play in evaluating clinical information systems. A common reason voiced by skeptics is that these systems are fundamentally different from drug interventions, so the RCT is irrelevant. There is an urgent need to promote the use of RCTs, given the shift to evidence-based policy and the need to demonstrate cost-effectiveness of these systems. The authors suggest returning to first principles and argue that what is required is clarity about how to match methods to evaluation questions. The authors address common concerns about RCTs, and the extent to which they are fallacious, and also discuss the challenges of conducting RCTs in informatics and alternative study designs when randomized trials are infeasible. While neither a perfect nor universal evaluation method, RCTs form an important part of an evaluator's toolkit. PMID:21270132

Evaluation of a multimedia information system for endoscopy

NASA Astrophysics Data System (ADS)

Enning, C. John W.; Siersema, Peter D.; van Blankenstein, Mark; van Boven, Gert-Jan; van Gennip, Elisabeth M.

1996-05-01

In a cooperation between the University Hospital Rotterdam (AZR) and HISCOM, HIS supplier, a multimedia information system for endoscopy (ENSIS) has been developed in a project funded by the Dutch Ministry of Health Care. An integral part of this project was an evaluation of costs and effects of this system. The system has been implemented on the gastroenterology department and the internal medicine ward in the AZR. The results indicate that the anatomical knowledge of requesting physicians improved with the system. Both the response time and availability of endoscopy images improved greatly. Because of the use of off-the-shelve technology (possible because of the relatively small resolution requirements of endoscopy images) ENSIS can be implemented at relatively low costs.

Multilingual Information Discovery and AccesS (MIDAS): A Joint ACM DL'99/ ACM SIGIR'99 Workshop.

ERIC Educational Resources Information Center

Oard, Douglas; Peters, Carol; Ruiz, Miguel; Frederking, Robert; Klavans, Judith; Sheridan, Paraic

1999-01-01

Discusses a multidisciplinary workshop that addressed issues concerning internationally distributed information networks. Highlights include multilingual information access in media other than character-coded text; cross-language information retrieval and multilingual metadata; and evaluation of multilingual systems. (LRW)

Information Structure, Information Technology, and the Human Services Organizational Environment.

ERIC Educational Resources Information Center

Semke, Jeanette I.; Nurius, Paula S.

1991-01-01

Examines current trends in data collection and information use in human services organizations. Describes issues for managers who are planning information systems, including practitioner resistance to automation. Proposes that conceptual integration of agendas for human services automation, practice evaluation, and service effectiveness enables…

State Energy Efficiency Program Evaluation Inventory

EIA Publications

2013-01-01

The focus of this inventory, some of which has been placed into a searchable spreadsheet, is to support the National Energy Modeling System (NEMS) and to research cost information in state-mandated energy efficiency program evaluations – e.g., for use in updating analytic and modeling assumptions used by the U.S. Energy Information Administration (EIA).

The Three Rs of Education Finance Reform: Re-Thinking, Re-Tooling, and Re-Evaluating School-Site Information.

ERIC Educational Resources Information Center

Speakman, Sheree T.; And Others

1997-01-01

Examines the need for new financial reporting and analysis, starting with rethinking the school finance field, retooling the management information systems for school finance, and re-evaluating knowledge about school-site management, accounting, and reporting. Demonstrates a new reporting methodology, the Financial Analysis Model, that traces…

Drug Information to Patient Care Areas via Television: Preliminary Evaluation of Two Years' Experience

ERIC Educational Resources Information Center

Springer, Sandra J.; And Others

1978-01-01

The research project described was undertaken to study the impact of the use of a closed circuit television system to deliver information about drugs, chemicals, and poisons from a central resource location to health professionals in patient care areas. Evaluation techniques included questionnaires, interviews with users, and extramural…

EDCATS: An Evaluation Tool

NASA Technical Reports Server (NTRS)

Heard, Pamala D.

1998-01-01

The purpose of this research is to explore the development of Marshall Space Flight Center Unique Programs. These academic tools provide the Education Program Office with important information from the Education Computer Aided Tracking System (EDCATS). This system is equipped to provide on-line data entry, evaluation, analysis, and report generation, with full archiving for all phases of the evaluation process. Another purpose is to develop reports and data that is tailored to Marshall Space Flight Center Unique Programs. It also attempts to acquire knowledge on how, why, and where information is derived. As a result, a user will be better prepared to decide which available tool is the most feasible for their reports.

DOE Office of Scientific and Technical Information (OSTI.GOV)

None

Information used to evaluate the initial design of the Elcam, Inc., Solar Domestic Hot Water System is presented. Included are such items as the system performance specification, detailed design drawings and other information. Elcam, Inc., has developed two solar heated prototype hot water systems and two heat exchangers. The hot water systems consist of the following subsystems: collector, storage, control, transport, auxiliary energy, and government-furnished Site Data Acquisition. The two systems are installed at Tempe, Arizona, and San Diego, California.

IMIRSEL: a secure music retrieval testing environment

NASA Astrophysics Data System (ADS)

Downie, John S.

2004-10-01

The Music Information Retrieval (MIR) and Music Digital Library (MDL) research communities have long noted the need for formal evaluation mechanisms. Issues concerning the unavailability of freely-available music materials have greatly hindered the creation of standardized test collections with which these communities could scientifically assess the strengths and weaknesses of their various music retrieval techniques. The International Music Information Retrieval Systems Evaluation Laboratory (IMIRSEL) is being developed at the University of Illinois at Urbana-Champaign (UIUC) specifically to overcome this hindrance to the scientific evaluation of MIR/MDL systems. Together with its subsidiary Human Use of Music Information Retrieval Systems (HUMIRS) project, IMIRSEL will allow MIR/MDL researchers access to the standardized large-scale collection of copyright-sensitive music materials and standardized test queries being housed at UIUC's National Center for Supercomputing Applications (NCSA). Virtual Research Labs (VRL), based upon NCSA's Data-to-Knowledge (D2K) tool set, are being developed through which MIR/MDL researchers will interact with the music materials under a "trusted code" security model.

A new approach to the concept of "relevance" in information retrieval (IR).

PubMed

Kagolovsky, Y; Möhr, J R

2001-01-01

The concept of "relevance" is the fundamental concept of information science in general and information retrieval, in particular. Although "relevance" is extensively used in evaluation of information retrieval, there are considerable problems associated with reaching an agreement on its definition, meaning, evaluation, and application in information retrieval. There are a number of different views on "relevance" and its use for evaluation. Based on a review of the literature the main problems associated with the concept of "relevance" in information retrieval are identified. The authors argue that the proposal for the solution of the problems can be based on the conceptual IR framework built using a systems analytic approach to IR. Using this framework different kinds of "relevance" relationships in the IR process are identified, and a methodology for evaluation of "relevance" based on methods of semantics capturing and comparison is proposed.

Overcoming Structural Constraints to Patient Utilization of Electronic Medical Records: A Critical Review and Proposal for an Evaluation Framework

PubMed Central

Winkelman, Warren J.; Leonard, Kevin J.

2004-01-01

There are constraints embedded in medical record structure that limit use by patients in self-directed disease management. Through systematic review of the literature from a critical perspective, four characteristics that either enhance or mitigate the influence of medical record structure on patient utilization of an electronic patient record (EPR) system have been identified: environmental pressures, physician centeredness, collaborative organizational culture, and patient centeredness. An evaluation framework is proposed for use when considering adaptation of existing EPR systems for online patient access. Exemplars of patient-accessible EPR systems from the literature are evaluated utilizing the framework. From this study, it appears that traditional information system research and development methods may not wholly capture many pertinent social issues that arise when expanding access of EPR systems to patients. Critically rooted methods such as action research can directly inform development strategies so that these systems may positively influence health outcomes. PMID:14633932

Evaluation of Worker Profiling and Reemployment Services Systems: Interim Report. Unemployment Insurance Occasional Paper 96-1.

ERIC Educational Resources Information Center

Hawkins, Evelyn K.; And Others

The Evaluation of Worker Profiling and Reemployment Services (WPRS) systems was designed to provide the U.S. Department of Labor information on how states are designing, implementing, and operating their worker profiling and reemployment services systems for dislocated workers and to compare the effectiveness of different state approaches to…

A methodology for the design and evaluation of user interfaces for interactive information systems. Ph.D. Thesis Final Report, 1 Jul. 1985 - 31 Dec. 1987

NASA Technical Reports Server (NTRS)

Dominick, Wayne D. (Editor); Farooq, Mohammad U.

1986-01-01

The definition of proposed research addressing the development and validation of a methodology for the design and evaluation of user interfaces for interactive information systems is given. The major objectives of this research are: the development of a comprehensive, objective, and generalizable methodology for the design and evaluation of user interfaces for information systems; the development of equations and/or analytical models to characterize user behavior and the performance of a designed interface; the design of a prototype system for the development and administration of user interfaces; and the design and use of controlled experiments to support the research and test/validate the proposed methodology. The proposed design methodology views the user interface as a virtual machine composed of three layers: an interactive layer, a dialogue manager layer, and an application interface layer. A command language model of user system interactions is presented because of its inherent simplicity and structured approach based on interaction events. All interaction events have a common structure based on common generic elements necessary for a successful dialogue. It is shown that, using this model, various types of interfaces could be designed and implemented to accommodate various categories of users. The implementation methodology is discussed in terms of how to store and organize the information.

Overview of the arthritis Cost Consequence Evaluation System (ACCES): a pharmacoeconomic model for celecoxib.

PubMed

Pettitt, D; Goldstein, J L; McGuire, A; Schwartz, J S; Burke, T; Maniadakis, N

2000-12-01

Pharmacoeconomic analyses have become useful and essential tools for health care decision makers who increasingly require such analyses prior to placing a drug on a national, regional or hospital formulary. Previous health economic models of non-steroidal anti-inflammatory drugs (NSAIDs) have been restricted to evaluating a narrow range of agents within specific health care delivery systems using medical information derived from homogeneous clinical trial data. This paper summarizes the Arthritis Cost Consequence Evaluation System (ACCES)--a pharmacoeconomic model that has been developed to predict and evaluate the costs and consequences associated with the use of celecoxib in patients with arthritis, compared with other NSAIDs and NSAIDs plus gastroprotective agents. The advantage of this model is that it can be customized to reflect local practice patterns, resource utilization and costs, as well as provide context-specific health economic information to a variety of providers and/or decision makers.

U.S. DOT ITS evaluation 2010 workshop summary.

DOT National Transportation Integrated Search

2010-03-12

This document presents a summary of the Intelligent Transportation Systems (ITS) Evaluation Workshop conducted on September 20, 2010 in Irvine, California. Sixty-four participants shared ideas and exchanged information on the evaluation of ITS resear...

Design and implementation of a hospital information system for the Palestine Red Crescent Society in Lebanon.

PubMed

Rossi, L; Materia, E; Hourani, A; Yousef, H; Racalbuto, V; Venier, C; Osman, M

2009-01-01

A case-mix hospital information system was designed and implemented in Palestine Red Crescent Society hospitals in order to support the network of Palestinian hospitals in Lebanon and to improve the health of refugees in the country. The system is based on routine collection of essential administrative and clinical data for each episode of hospitalization, relying on internationally accepted diagnostic codes. It is a computerized, user-friendly information system that is a stepping-stone towards better hospital management and evaluation of quality of care. It is also a useful model for the development of hospital information systems in Lebanon and in the Near East.

An evaluation of coding methodologies for potential use in the Alabama Resource Information System (ARIS)-transportation study for the state of Alabama

NASA Technical Reports Server (NTRS)

Montgomery, O. L.

1977-01-01

Procedures developed for digitizing the transportation arteries, airports, and dock facilities of Alabama and placing them in a computerized format compatible with the Alabama Resource Information System are described. The time required to digitize by the following methods: (a) manual, (b) Telereadex 29 with film reading and digitizing system, and (c) digitizing tablets was evaluated. A method for digitizing and storing information from the U. T. M. grid cell base which was compatible with the system was developed and tested. The highways, navigable waterways, railroads, airports, and docks in the study area were digitized and the data stored. The manual method of digitizing was shown to be best for small amounts of data, while the graphic input from the digitizing tablets would be the best approach for entering the large amounts of data required for an entire state.

Evaluation as a critical factor of success in local public health accreditation programs.

PubMed

Tremain, Beverly; Davis, Mary; Joly, Brenda; Edgar, Mark; Kushion, Mary L; Schmidt, Rita

2007-01-01

This article presents the variety of approaches used to conduct evaluations of performance improvement or accreditation systems, while illustrating the complexity of conducting evaluations to inform local public health practice. We, in addition, hope to inform the Exploring Accreditation Program about relevant experiences involving accreditation and performance assessment processes, specifically evaluation, as it debates and discusses a national voluntary model. A background of each state is given. To further explore these issues, interviews were conducted with each state's evaluator to gain more in-depth information on the many different evaluation strategies and approaches used. On the basis of the interviews, the authors provide several overall themes, which suggest that evaluation is a critical tool and success factor for performance assessment or accreditation programs.

Evaluating the Effectiveness of Web-based Climate Resilience Decision Support Tools: Insights from Coastal New Jersey

NASA Astrophysics Data System (ADS)

Brady, M.; Lathrop, R.; Auermuller, L. M.; Leichenko, R.

2016-12-01

Despite the recent surge of Web-based decision support tools designed to promote resiliency in U.S. coastal communities, to-date there has been no systematic study of their effectiveness. This study demonstrates a method to evaluate important aspects of effectiveness of four Web map tools designed to promote consideration of climate risk information in local decision-making and planning used in coastal New Jersey. In summer 2015, the research team conducted in-depth phone interviews with users of one regulatory and three non-regulatory Web map tools using a semi-structured questionnaire. The interview and analysis design drew from a combination of effectiveness evaluation approaches developed in software and information usability, program evaluation, and management information system (MIS) research. Effectiveness assessment results were further analyzed and discussed in terms of conceptual hierarchy of system objectives defined by respective tool developer and user organizations represented in the study. Insights from the interviews suggest that users rely on Web tools as a supplement to desktop and analog map sources because they provide relevant and up-to-date information in a highly accessible and mobile format. The users also reported relying on multiple information sources and comparison between digital and analog sources for decision support. However, with respect to this decision support benefit, users were constrained by accessibility factors such as lack of awareness and training with some tools, lack of salient information such as planning time horizons associated with future flood scenarios, and environmental factors such as mandates restricting some users to regulatory tools. Perceptions of Web tool credibility seem favorable overall, but factors including system design imperfections and inconsistencies in data and information across platforms limited trust, highlighting a need for better coordination between tools. Contributions of the study include user feedback on web-tool system designs consistent with collaborative methods for enhancing usability and a systematic look at effectiveness that includes both user perspectives and consideration of developer and organizational objectives.

A Reference Architecture for Space Information Management

NASA Technical Reports Server (NTRS)

Mattmann, Chris A.; Crichton, Daniel J.; Hughes, J. Steven; Ramirez, Paul M.; Berrios, Daniel C.

2006-01-01

We describe a reference architecture for space information management systems that elegantly overcomes the rigid design of common information systems in many domains. The reference architecture consists of a set of flexible, reusable, independent models and software components that function in unison, but remain separately managed entities. The main guiding principle of the reference architecture is to separate the various models of information (e.g., data, metadata, etc.) from implemented system code, allowing each to evolve independently. System modularity, systems interoperability, and dynamic evolution of information system components are the primary benefits of the design of the architecture. The architecture requires the use of information models that are substantially more advanced than those used by the vast majority of information systems. These models are more expressive and can be more easily modularized, distributed and maintained than simpler models e.g., configuration files and data dictionaries. Our current work focuses on formalizing the architecture within a CCSDS Green Book and evaluating the architecture within the context of the C3I initiative.

An information-theoretic approach to assess practical identifiability of parametric dynamical systems.

PubMed

Pant, Sanjay; Lombardi, Damiano

2015-10-01

A new approach for assessing parameter identifiability of dynamical systems in a Bayesian setting is presented. The concept of Shannon entropy is employed to measure the inherent uncertainty in the parameters. The expected reduction in this uncertainty is seen as the amount of information one expects to gain about the parameters due to the availability of noisy measurements of the dynamical system. Such expected information gain is interpreted in terms of the variance of a hypothetical measurement device that can measure the parameters directly, and is related to practical identifiability of the parameters. If the individual parameters are unidentifiable, correlation between parameter combinations is assessed through conditional mutual information to determine which sets of parameters can be identified together. The information theoretic quantities of entropy and information are evaluated numerically through a combination of Monte Carlo and k-nearest neighbour methods in a non-parametric fashion. Unlike many methods to evaluate identifiability proposed in the literature, the proposed approach takes the measurement-noise into account and is not restricted to any particular noise-structure. Whilst computationally intensive for large dynamical systems, it is easily parallelisable and is non-intrusive as it does not necessitate re-writing of the numerical solvers of the dynamical system. The application of such an approach is presented for a variety of dynamical systems--ranging from systems governed by ordinary differential equations to partial differential equations--and, where possible, validated against results previously published in the literature. Copyright © 2015 Elsevier Inc. All rights reserved.

Simulation studies for the evaluation of health information technologies: experiences and results.

PubMed

Ammenwerth, Elske; Hackl, Werner O; Binzer, Kristine; Christoffersen, Tue E H; Jensen, Sanne; Lawton, Kitta; Skjoet, Peter; Nohr, Christian

It is essential for new health information technologies (IT) to undergo rigorous evaluations to ensure they are effective and safe for use in real-world situations. However, evaluation of new health IT is challenging, as field studies are often not feasible when the technology being evaluated is not sufficiently mature. Laboratory-based evaluations have also been shown to have insufficient external validity. Simulation studies seem to be a way to bridge this gap. The aim of this study was to evaluate, using a simulation methodology, the impact of a new prototype of an electronic medication management system on the appropriateness of prescriptions and drug-related activities, including laboratory test ordering or medication changes. This article presents the results of a controlled simulation study with 50 simulation runs, including ten doctors and five simulation patients, and discusses experiences and lessons learnt while conducting the study. Although the new electronic medication management system showed tendencies to improve medication safety when compared with the standard system, this tendency was not significant. Altogether, five distinct situations were identified where the new medication management system did help to improve medication safety. This simulation study provided a good compromise between internal validity and external validity. However, several challenges need to be addressed when undertaking simulation evaluations including: preparation of adequate test cases; training of participants before using unfamiliar applications; consideration of time, effort and costs of conducting the simulation; technical maturity of the evaluated system; and allowing adequate preparation of simulation scenarios and simulation setting. Simulation studies are an interesting but time-consuming approach, which can be used to evaluate newly developed health IT systems, particularly those systems that are not yet sufficiently mature to undergo field evaluation studies.

E-health and healthcare enterprise information system leveraging service-oriented architecture.

PubMed

Hsieh, Sung-Huai; Hsieh, Sheau-Ling; Cheng, Po-Hsun; Lai, Feipei

2012-04-01

To present the successful experiences of an integrated, collaborative, distributed, large-scale enterprise healthcare information system over a wired and wireless infrastructure in National Taiwan University Hospital (NTUH). In order to smoothly and sequentially transfer from the complex relations among the old (legacy) systems to the new-generation enterprise healthcare information system, we adopted the multitier framework based on service-oriented architecture to integrate the heterogeneous systems as well as to interoperate among many other components and multiple databases. We also present mechanisms of a logical layer reusability approach and data (message) exchange flow via Health Level 7 (HL7) middleware, DICOM standard, and the Integrating the Healthcare Enterprise workflow. The architecture and protocols of the NTUH enterprise healthcare information system, especially in the Inpatient Information System (IIS), are discussed in detail. The NTUH Inpatient Healthcare Information System is designed and deployed on service-oriented architecture middleware frameworks. The mechanisms of integration as well as interoperability among the components and the multiple databases apply the HL7 standards for data exchanges, which are embedded in XML formats, and Microsoft .NET Web services to integrate heterogeneous platforms. The preliminary performance of the current operation IIS is evaluated and analyzed to verify the efficiency and effectiveness of the designed architecture; it shows reliability and robustness in the highly demanding traffic environment of NTUH. The newly developed NTUH IIS provides an open and flexible environment not only to share medical information easily among other branch hospitals, but also to reduce the cost of maintenance. The HL7 message standard is widely adopted to cover all data exchanges in the system. All services are independent modules that enable the system to be deployed and configured to the highest degree of flexibility. Furthermore, we can conclude that the multitier Inpatient Healthcare Information System has been designed successfully and in a collaborative manner, based on the index of performance evaluations, central processing unit, and memory utilizations.

Identifying Challenges to the Integration of Computer-Based Surveillance Information Systems in a Large City Health Department: A Case Study.

PubMed

Jennings, Jacky M; Stover, Jeffrey A; Bair-Merritt, Megan H; Fichtenberg, Caroline; Munoz, Mary Grace; Maziad, Rafiq; Ketemepi, Sherry Johnson; Zenilman, Jonathan

2009-01-01

Integrated infectious disease surveillance information systems have the potential to provide important new surveillance capacities and business efficiencies for local health departments. We conducted a case study at a large city health department of the primary computer-based infectious disease surveillance information systems during a 10-year period to identify the major challenges for information integration across the systems. The assessment included key informant interviews and evaluations of the computer-based surveillance information systems used for acute communicable diseases, human immunodeficiency virus/acquired immunodeficiency syndrome, sexually transmitted diseases, and tuberculosis. Assessments were conducted in 1998 with a follow-up in 2008. Assessments specifically identified and described the primary computer-based surveillance information system, any duplicative information systems, and selected variables collected. Persistent challenges to information integration across the information systems included the existence of duplicative data systems, differences in the variables used to collect similar information, and differences in basic architecture. The assessments identified a number of challenges for information integration across the infectious disease surveillance information systems at this city health department. The results suggest that local disease control programs use computer-based surveillance information systems that were not designed for data integration. To the extent that integration provides important new surveillance capacities and business efficiencies, we recommend that patient-centric information systems be designed that provide all the epidemiologic, clinical, and research needs in one system. In addition, the systems should include a standard system of elements and fields across similar surveillance systems.

Anesthesia information management systems marketplace and current vendors.

PubMed

Stonemetz, Jerry

2011-09-01

This article addresses the brief history of anesthesia information management systems (AIMS) and discusses the vendors that currently market AIMS. The current market penetration based on the information provided by these vendors is presented and the rationale for the purchase of AIMS is discussed. The considerations to be evaluated when making a vendor selection are also discussed. Copyright © 2011 Elsevier Inc. All rights reserved.

Social vs. Clinical Perspectives on the Use of Information: Implications for School-based Information Systems. Systemic Evaluation Project.

ERIC Educational Resources Information Center

Sirotnik, Kenneth A.; And Others

This paper presents a study of the contrast of social and clinical perspectives on the selection and use of information by school staff, including: (1) an outline of the context and activities of the study; (2) a definition and discussion of the basic distinction between social and clinical perspectives; (3) an examination of case material…

An Approach and Instrumentation for Management System Analysis

DTIC Science & Technology

1974-10-01

Benefit Analysis Systems Analysis Manpower Planning Resource Planning Information Theory 20. ABSTRACT (Conlliwa on ravaraa alda It nacaaaary...participants the data necessary to trace both formal and informal information flows and make cost- benefit judgments about specific communications. The...network within a manage- ment structure and to provide a basis tor preliminary cost- benefit evaluations. This objective was in response to Phase I of the

On the Role of Subjectivity in Establishing, Using, Operating and Evaluating Information Retrieval Systems. Treatise II on Retrieval System Theory

ERIC Educational Resources Information Center

Fugmann, Robert

1973-01-01

The personal literature search of a scientist is strongly governed by subjective influences. If he delegates his query, he must be aware of the problems emanating from this subjectivity. The information scientist, on the other hand, must consider the subjective character of the fundamental notions of information and order. (33 references)…

Automating Technical Processes and Reference Services Using SPIRES.

ERIC Educational Resources Information Center

Buckley, Joseph James

1983-01-01

Examines the capabilities, cost-effectiveness, and flexibility of the Stanford Public Information Retrieval System (SPIRES), an online information retrieval system producing a variety of printed products, and notes its use in the Title I Evaluation Clearinghouse, advantages of SPIRES, programing, and availability. Eleven references and a five-item…

Electronic Information Delivery Systems: Reports on Five Projects Sponsored by the Fred Meyer Charitable Trust.

ERIC Educational Resources Information Center

Ferguson, Douglas K.; And Others

1987-01-01

Describes five research projects that are setting up electronic information delivery systems to serve rural areas in the Pacific Northwest. The technologies being evaluated include simultaneous remote searching, facsimile transmissions, bit map image transmissions, and a combination of optical character recognition equipment and television…

Bibliographic Post-Processing with the TIS Intelligent Gateway: Analytical and Communication Capabilities.

ERIC Educational Resources Information Center

Burton, Hilary D.

TIS (Technology Information System) is an intelligent gateway system capable of performing quantitative evaluation and analysis of bibliographic citations using a set of Process functions. Originally developed by Lawrence Livermore National Laboratory (LLNL) to analyze information retrieved from three major federal databases, DOE/RECON,…

Database Software Selection for the Egyptian National STI Network.

ERIC Educational Resources Information Center

Slamecka, Vladimir

The evaluation and selection of information/data management system software for the Egyptian National Scientific and Technical (STI) Network are described. An overview of the state-of-the-art of database technology elaborates on the differences between information retrieval and database management systems (DBMS). The desirable characteristics of…

Landscape permeability for large carnivores in Washington: a geographic information system weighted-distance and least-cost corridor assessment.

Treesearch

Peter H. Singleton; William L. Gaines; John F. Lehmkuhl

2002-01-01

We conducted a regional-scale evaluation of landscape permeability for large carnivores in Washington and adjacent portions of British Columbia and Idaho. We developed geographic information system based landscape permeability models for wolves (Canis lupus), wolverine (Gulo gulo), lynx (Lynx canadensis),...

76 FR 32367 - Agency Information Collection Activities, Proposed Collection; Comment Request; Integrated Public...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-06-06

...; Integrated Public Alert and Warning Systems (IPAWS) Inventory AGENCY: Federal Emergency Management Agency... proposed revision of the information collection concerning public alert and warning systems at the Federal... evaluation and assessment of existing public alert and warning resources and their integration with the...

A Nugget-Based Test Collection Construction Paradigm

ERIC Educational Resources Information Center

Rajput, Shahzad K.

2012-01-01

The problem of building test collections is central to the development of information retrieval systems such as search engines. The primary use of test collections is the evaluation of IR systems. The widely employed "Cranfield paradigm" dictates that the information relevant to a topic be encoded at the level of documents, therefore…

An Intelligent Information Access System Assisting a Case Based Learning Methodology Evaluated in Higher Education with Medical Students

ERIC Educational Resources Information Center

Aparicio, Fernando; De Buenaga, Manuel; Rubio, Margarita; Hernando, Asuncion

2012-01-01

In recent years there has been a shift in educational methodologies toward a student-centered approach, one which increasingly emphasizes the integration of computer tools and intelligent systems adopting different roles. In this paper we describe in detail the development of an Intelligent Information Access system used as the basis for producing…

48 CFR 42.1503 - Procedures.

Code of Federal Regulations, 2011 CFR

2011-10-01

... the Past Performance Information Retrieval System (PPIRS) at www.ppirs.gov. The process for submitting... CONTRACT ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 42.1503 Procedures. (a.... Those individuals identified may obtain information for the evaluation of performance from the program...

48 CFR 42.1503 - Procedures.

Code of Federal Regulations, 2012 CFR

2012-10-01

... the Past Performance Information Retrieval System (PPIRS) at www.ppirs.gov. The process for submitting... CONTRACT ADMINISTRATION AND AUDIT SERVICES Contractor Performance Information 42.1503 Procedures. (a.... Those individuals identified may obtain information for the evaluation of performance from the program...

Thesaurus-Enhanced Search Interfaces.

ERIC Educational Resources Information Center

Shiri, Ali Asghar; Revie, Crawford; Chowdhury, Gobinda

2002-01-01

Discussion of user interfaces to information retrieval systems focuses on interfaces that incorporate thesauri as part of their searching and browsing facilities. Discusses research literature related to information searching behavior, information retrieval interface evaluation, search term selection, and query expansion; and compares thesaurus…

Bibliographic Instruction in the 21st Century.

ERIC Educational Resources Information Center

Poirier, Gayle

2000-01-01

Discusses bibliographic instruction in libraries. Topics include a history of bibliographic instruction; the Internet and electronic searching; librarians' use of technology; defining information needs; locating and accessing information, including classification systems and Boolean searching; evaluating information; using and communication…

Seattle wide-area information for travelers (SWIFT) : architecture study

DOT National Transportation Integrated Search

1998-10-19

The SWIFT (Seattle Wide-area Information For Travelers) Field Operational Test was intended to evaluate the performance of a large-scale urban Advanced Traveler Information System (ATIS) deployment in the Seattle area. The unique features of the SWIF...

Usability Evaluation of Laboratory Information Systems.

PubMed

Mathews, Althea; Marc, David

2017-01-01

Numerous studies have revealed widespread clinician frustration with the usability of electronic health records (EHRs) that is counterproductive to adoption of EHR systems to meet the aims of health-care reform. With poor system usability comes increased risk of negative unintended consequences. Usability issues could lead to user error and workarounds that have the potential to compromise patient safety and negatively impact the quality of care.[1] While there is ample research on EHR usability, there is little information on the usability of laboratory information systems (LISs). Yet, LISs facilitate the timely provision of a great deal of the information needed by physicians to make patient care decisions.[2] Medical and technical advances in genomics that require processing of an increased volume of complex laboratory data further underscore the importance of developing user-friendly LISs. This study aims to add to the body of knowledge on LIS usability. A survey was distributed among LIS users at hospitals across the United States. The survey consisted of the ten-item System Usability Scale (SUS). In addition, participants were asked to rate the ease of performing 24 common tasks with a LIS. Finally, respondents provided comments on what they liked and disliked about using the LIS to provide diagnostic insight into LIS perceived usability. The overall mean SUS score of 59.7 for the LIS evaluated is significantly lower than the benchmark of 68 ( P < 0.001). All LISs evaluated received mean SUS scores below 68 except for Orchard Harvest (78.7). While the years of experience using the LIS was found to be a statistically significant influence on mean SUS scores, the combined effect of years of experience and LIS used did not account for the statistically significant difference in the mean SUS score between Orchard Harvest and each of the other LISs evaluated. The results of this study indicate that overall usability of LISs is poor. Usability lags that of systems evaluated across 446 usability surveys.