Value-Added Models for Teacher Preparation Programs: Validity and Reliability Threats, and a Manageable Alternative

ERIC Educational Resources Information Center

Brady, Michael P.; Heiser, Lawrence A.; McCormick, Jazarae K.; Forgan, James

2016-01-01

High-stakes standardized student assessments are increasingly used in value-added evaluation models to connect teacher performance to P-12 student learning. These assessments are also being used to evaluate teacher preparation programs, despite validity and reliability threats. A more rational model linking student performance to candidates who…

Evaluation of reliability modeling tools for advanced fault tolerant systems

NASA Technical Reports Server (NTRS)

Baker, Robert; Scheper, Charlotte

1986-01-01

The Computer Aided Reliability Estimation (CARE III) and Automated Reliability Interactice Estimation System (ARIES 82) reliability tools for application to advanced fault tolerance aerospace systems were evaluated. To determine reliability modeling requirements, the evaluation focused on the Draper Laboratories' Advanced Information Processing System (AIPS) architecture as an example architecture for fault tolerance aerospace systems. Advantages and limitations were identified for each reliability evaluation tool. The CARE III program was designed primarily for analyzing ultrareliable flight control systems. The ARIES 82 program's primary use was to support university research and teaching. Both CARE III and ARIES 82 were not suited for determining the reliability of complex nodal networks of the type used to interconnect processing sites in the AIPS architecture. It was concluded that ARIES was not suitable for modeling advanced fault tolerant systems. It was further concluded that subject to some limitations (the difficulty in modeling systems with unpowered spare modules, systems where equipment maintenance must be considered, systems where failure depends on the sequence in which faults occurred, and systems where multiple faults greater than a double near coincident faults must be considered), CARE III is best suited for evaluating the reliability of advanced tolerant systems for air transport.

Interim reliability evaluation program, Browns Ferry fault trees

DOE Office of Scientific and Technical Information (OSTI.GOV)

Stewart, M.E.

1981-01-01

An abbreviated fault tree method is used to evaluate and model Browns Ferry systems in the Interim Reliability Evaluation programs, simplifying the recording and displaying of events, yet maintaining the system of identifying faults. The level of investigation is not changed. The analytical thought process inherent in the conventional method is not compromised. But the abbreviated method takes less time, and the fault modes are much more visible.

Adult Literacy Education: Program Evaluation and Learner Assessment. Information Series No. 338.

ERIC Educational Resources Information Center

Lytle, Susan L.; Wolfe, Marcie

Adult literacy programs need reliable information about program quality and effectiveness for accountability, improvement of practice, and expansion of knowledge. Evaluation and assessment reflect fundamental beliefs about adult learners, concepts of literacy, and educational settings. Resources for planning program evaluations include surveys,…

Lifetime Reliability Evaluation of Structural Ceramic Parts with the CARES/LIFE Computer Program

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Powers, Lynn M.; Janosik, Lesley A.; Gyekenyesi, John P.

1993-01-01

The computer program CARES/LIFE calculates the time-dependent reliability of monolithic ceramic components subjected to thermomechanical and/or proof test loading. This program is an extension of the CARES (Ceramics Analysis and Reliability Evaluation of Structures) computer program. CARES/LIFE accounts for the phenomenon of subcritical crack growth (SCG) by utilizing the power law, Paris law, or Walker equation. The two-parameter Weibull cumulative distribution function is used to characterize the variation in component strength. The effects of multiaxial stresses are modeled using either the principle of independent action (PIA), Weibull's normal stress averaging method (NSA), or Batdorf's theory. Inert strength and fatigue parameters are estimated from rupture strength data of naturally flawed specimens loaded in static, dynamic, or cyclic fatigue. Two example problems demonstrating cyclic fatigue parameter estimation and component reliability analysis with proof testing are included.

Reliability and Availability Evaluation Program Manual.

DTIC Science & Technology

1982-11-01

research and development. The manual’s purpose was to provide a practical method for making reliability measurements, measurements directly related to... Research , Development, Test and Evaluation. RMA Reliability, Maintainability and Availability. R&R Repair and Refurbishment, Repair and Replacement, etc...length. phenomena such as mechanical wear and A number of researchers in the reliability chemical deterioration. Maintenance should field 14-pages 402

Establishing monitoring programs for travel time reliability.

DOT National Transportation Integrated Search

2014-01-01

Within the second Strategic Highway Research Program (SHRP 2), Project L02 focused on creating a suite of methods by which transportation agencies could monitor and evaluate travel time reliability. Creation of the methods also produced an improved u...

Evaluating Federal Social Programs: An Uncertain Act.

ERIC Educational Resources Information Center

Levitan, Sar A.; Wurzburg, Gregory K.

This study of the federal government's evaluation of social programs indicates that it is virtually impossible to establish a bias-free, valid, and reliable system of inquiry to determine the effects of social programs. Divided into five chapters, the document examines the aspirations and limitations of evaluations, methodology, evaluation in the…

Clinical peer review program self-evaluation for US hospitals.

PubMed

Edwards, Marc T

2010-01-01

Prior research has shown wide variation in clinical peer review program structure, process, governance, and perceived effectiveness. This study sought to validate the utility of a Peer Review Program Self-Evaluation Tool as a potential guide to physician and hospital leaders seeking greater program value. Data from 330 hospitals show that the total score from the self-evaluation tool is strongly associated with perceived quality impact. Organizational culture also plays a significant role. When controlling for these factors, there was no evidence of benefit from a multispecialty review process. Physicians do not generally use reliable methods to measure clinical performance. A high rate of change since 2007 has not produced much improvement. The Peer Review Program Self-Evaluation Tool reliably differentiates hospitals along a continuum of perceived program performance. The full potential of peer review as a process to improve the quality and safety of care has yet to be realized.

Human Reliability Program Workshop

DOE Office of Scientific and Technical Information (OSTI.GOV)

Landers, John; Rogers, Erin; Gerke, Gretchen

A Human Reliability Program (HRP) is designed to protect national security as well as worker and public safety by continuously evaluating the reliability of those who have access to sensitive materials, facilities, and programs. Some elements of a site HRP include systematic (1) supervisory reviews, (2) medical and psychological assessments, (3) management evaluations, (4) personnel security reviews, and (4) training of HRP staff and critical positions. Over the years of implementing an HRP, the Department of Energy (DOE) has faced various challenges and overcome obstacles. During this 4-day activity, participants will examine programs that mitigate threats to nuclear security andmore » the insider threat to include HRP, Nuclear Security Culture (NSC) Enhancement, and Employee Assistance Programs. The focus will be to develop an understanding of the need for a systematic HRP and to discuss challenges and best practices associated with mitigating the insider threat.« less

Computing Reliabilities Of Ceramic Components Subject To Fracture

NASA Technical Reports Server (NTRS)

Nemeth, N. N.; Gyekenyesi, J. P.; Manderscheid, J. M.

1992-01-01

CARES calculates fast-fracture reliability or failure probability of macroscopically isotropic ceramic components. Program uses results from commercial structural-analysis program (MSC/NASTRAN or ANSYS) to evaluate reliability of component in presence of inherent surface- and/or volume-type flaws. Computes measure of reliability by use of finite-element mathematical model applicable to multiple materials in sense model made function of statistical characterizations of many ceramic materials. Reliability analysis uses element stress, temperature, area, and volume outputs, obtained from two-dimensional shell and three-dimensional solid isoparametric or axisymmetric finite elements. Written in FORTRAN 77.

An Interprofessional Program Evaluation Case Study: Utilizing Multiple Measures To Assess What Matters. AIR 1997 Annual Forum Paper.

ERIC Educational Resources Information Center

Delaney, Anne Marie

This paper reviews the first two years of a model program-evaluation case study which is intended to show: (1) how program evaluation can contribute to academic and professional degree programs; (2) how qualitative and quantitative techniques can be used to produce reliable measures for evaluation studies; and (3) how the role of the institutional…

Reliability model generator specification

NASA Technical Reports Server (NTRS)

Cohen, Gerald C.; Mccann, Catherine

1990-01-01

The Reliability Model Generator (RMG), a program which produces reliability models from block diagrams for ASSIST, the interface for the reliability evaluation tool SURE is described. An account is given of motivation for RMG and the implemented algorithms are discussed. The appendices contain the algorithms and two detailed traces of examples.

Evaluation methodologies for an advanced information processing system

NASA Technical Reports Server (NTRS)

Schabowsky, R. S., Jr.; Gai, E.; Walker, B. K.; Lala, J. H.; Motyka, P.

1984-01-01

The system concept and requirements for an Advanced Information Processing System (AIPS) are briefly described, but the emphasis of this paper is on the evaluation methodologies being developed and utilized in the AIPS program. The evaluation tasks include hardware reliability, maintainability and availability, software reliability, performance, and performability. Hardware RMA and software reliability are addressed with Markov modeling techniques. The performance analysis for AIPS is based on queueing theory. Performability is a measure of merit which combines system reliability and performance measures. The probability laws of the performance measures are obtained from the Markov reliability models. Scalar functions of this law such as the mean and variance provide measures of merit in the AIPS performability evaluations.

Evaluation Criteria for Micro-CAI: A Psychometric Approach

PubMed Central

Wallace, Douglas; Slichter, Mark; Bolwell, Christine

1985-01-01

The increased use of microcomputer-based instructional programs has resulted in a greater need for third-party evaluation of the software. This in turn has prompted the development of micro-CAI evaluation tools. The present project sought to develop a prototype instrument to assess the impact of CAI program presentation characteristics on students. Data analysis and scale construction was conducted using standard item reliability analyses and factor analytic techniques. Adequate subscale reliabilities and factor structures were found, suggesting that a psychometric approach to CAI evaluation may possess some merit. Efforts to assess the utility of the resultant instrument are currently underway.

Test effectiveness study report: An analytical study of system test effectiveness and reliability growth of three commercial spacecraft programs

NASA Technical Reports Server (NTRS)

Feldstein, J. F.

1977-01-01

Failure data from 16 commercial spacecraft were analyzed to evaluate failure trends, reliability growth, and effectiveness of tests. It was shown that the test programs were highly effective in ensuring a high level of in-orbit reliability. There was only a single catastrophic problem in 44 years of in-orbit operation on 12 spacecraft. The results also indicate that in-orbit failure rates are highly correlated with unit and systems test failure rates. The data suggest that test effectiveness estimates can be used to guide the content of a test program to ensure that in-orbit reliability goals are achieved.

Ceramic component reliability with the restructured NASA/CARES computer program

NASA Technical Reports Server (NTRS)

Powers, Lynn M.; Starlinger, Alois; Gyekenyesi, John P.

1992-01-01

The Ceramics Analysis and Reliability Evaluation of Structures (CARES) integrated design program on statistical fast fracture reliability and monolithic ceramic components is enhanced to include the use of a neutral data base, two-dimensional modeling, and variable problem size. The data base allows for the efficient transfer of element stresses, temperatures, and volumes/areas from the finite element output to the reliability analysis program. Elements are divided to insure a direct correspondence between the subelements and the Gaussian integration points. Two-dimensional modeling is accomplished by assessing the volume flaw reliability with shell elements. To demonstrate the improvements in the algorithm, example problems are selected from a round-robin conducted by WELFEP (WEakest Link failure probability prediction by Finite Element Postprocessors).

Reliability database development for use with an object-oriented fault tree evaluation program

NASA Technical Reports Server (NTRS)

Heger, A. Sharif; Harringtton, Robert J.; Koen, Billy V.; Patterson-Hine, F. Ann

1989-01-01

A description is given of the development of a fault-tree analysis method using object-oriented programming. In addition, the authors discuss the programs that have been developed or are under development to connect a fault-tree analysis routine to a reliability database. To assess the performance of the routines, a relational database simulating one of the nuclear power industry databases has been constructed. For a realistic assessment of the results of this project, the use of one of existing nuclear power reliability databases is planned.

Reliability Technology to Achieve Insertion of Advanced Packaging (RELTECH) program

NASA Astrophysics Data System (ADS)

Fayette, Daniel F.; Speicher, Patricia; Stoklosa, Mark J.; Evans, Jillian V.; Evans, John W.; Gentile, Mike; Pagel, Chuck A.; Hakim, Edward

1993-08-01

A joint military-commercial effort to evaluate multichip module (MCM) structures is discussed. The program, Reliability Technology to Achieve Insertion of Advanced Packaging (RELTECH), has been designed to identify the failure mechanisms that are possible in MCM structures. The RELTECH test vehicles, technical assessment task, product evaluation plan, reliability modeling task, accelerated and environmental testing, and post-test physical analysis and failure analysis are described. The information obtained through RELTECH can be used to address standardization issues, through development of cost effective qualification and appropriate screening criteria, for inclusion into a commercial specification and the MIL-H-38534 general specification for hybrid microcircuits.

Reliability Technology to Achieve Insertion of Advanced Packaging (RELTECH) program

NASA Technical Reports Server (NTRS)

Fayette, Daniel F.; Speicher, Patricia; Stoklosa, Mark J.; Evans, Jillian V.; Evans, John W.; Gentile, Mike; Pagel, Chuck A.; Hakim, Edward

1993-01-01

A joint military-commercial effort to evaluate multichip module (MCM) structures is discussed. The program, Reliability Technology to Achieve Insertion of Advanced Packaging (RELTECH), has been designed to identify the failure mechanisms that are possible in MCM structures. The RELTECH test vehicles, technical assessment task, product evaluation plan, reliability modeling task, accelerated and environmental testing, and post-test physical analysis and failure analysis are described. The information obtained through RELTECH can be used to address standardization issues, through development of cost effective qualification and appropriate screening criteria, for inclusion into a commercial specification and the MIL-H-38534 general specification for hybrid microcircuits.

Using LISREL to Evaluate Measurement Models and Scale Reliability.

ERIC Educational Resources Information Center

Fleishman, John; Benson, Jeri

1987-01-01

LISREL program was used to examine measurement model assumptions and to assess reliability of Coopersmith Self-Esteem Inventory for Children, Form B. Data on 722 third-sixth graders from over 70 schools in large urban school district were used. LISREL program assessed (1) nature of basic measurement model for scale, (2) scale invariance across…

Interpretive Reliability of Six Computer-Based Test Interpretation Programs for the Minnesota Multiphasic Personality Inventory-2.

PubMed

Deskovitz, Mark A; Weed, Nathan C; McLaughlan, Joseph K; Williams, John E

2016-04-01

The reliability of six Minnesota Multiphasic Personality Inventory-Second edition (MMPI-2) computer-based test interpretation (CBTI) programs was evaluated across a set of 20 commonly appearing MMPI-2 profile codetypes in clinical settings. Evaluation of CBTI reliability comprised examination of (a) interrater reliability, the degree to which raters arrive at similar inferences based on the same CBTI profile and (b) interprogram reliability, the level of agreement across different CBTI systems. Profile inferences drawn by four raters were operationalized using q-sort methodology. Results revealed no significant differences overall with regard to interrater and interprogram reliability. Some specific CBTI/profile combinations (e.g., the CBTI by Automated Assessment Associates on a within normal limits profile) and specific profiles (e.g., the 4/9 profile displayed greater interprogram reliability than the 2/4 profile) were interpreted with variable consensus (α range = .21-.95). In practice, users should consider that certain MMPI-2 profiles are interpreted more or less consensually and that some CBTIs show variable reliability depending on the profile. © The Author(s) 2015.

Evaluating training of screening, brief intervention, and referral to treatment (SBIRT) for substance use: Reliability of the MD3 SBIRT Coding Scale.

PubMed

DiClemente, Carlo C; Crouch, Taylor Berens; Norwood, Amber E Q; Delahanty, Janine; Welsh, Christopher

2015-03-01

Screening, brief intervention, and referral to treatment (SBIRT) has become an empirically supported and widely implemented approach in primary and specialty care for addressing substance misuse. Accordingly, training of providers in SBIRT has increased exponentially in recent years. However, the quality and fidelity of training programs and subsequent interventions are largely unknown because of the lack of SBIRT-specific evaluation tools. The purpose of this study was to create a coding scale to assess quality and fidelity of SBIRT interactions addressing alcohol, tobacco, illicit drugs, and prescription medication misuse. The scale was developed to evaluate performance in an SBIRT residency training program. Scale development was based on training protocol and competencies with consultation from Motivational Interviewing coding experts. Trained medical residents practiced SBIRT with standardized patients during 10- to 15-min videotaped interactions. This study included 25 tapes from the Family Medicine program coded by 3 unique coder pairs with varying levels of coding experience. Interrater reliability was assessed for overall scale components and individual items via intraclass correlation coefficients. Coder pair-specific reliability was also assessed. Interrater reliability was excellent overall for the scale components (>.85) and nearly all items. Reliability was higher for more experienced coders, though still adequate for the trained coder pair. Descriptive data demonstrated a broad range of adherence and skills. Subscale correlations supported concurrent and discriminant validity. Data provide evidence that the MD3 SBIRT Coding Scale is a psychometrically reliable coding system for evaluating SBIRT interactions and can be used to evaluate implementation skills for fidelity, training, assessment, and research. Recommendations for refinement and further testing of the measure are discussed. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

The probability estimation of the electronic lesson implementation taking into account software reliability

NASA Astrophysics Data System (ADS)

Gurov, V. V.

2017-01-01

Software tools for educational purposes, such as e-lessons, computer-based testing system, from the point of view of reliability, have a number of features. The main ones among them are the need to ensure a sufficiently high probability of their faultless operation for a specified time, as well as the impossibility of their rapid recovery by the way of replacing it with a similar running program during the classes. The article considers the peculiarities of reliability evaluation of programs in contrast to assessments of hardware reliability. The basic requirements to reliability of software used for carrying out practical and laboratory classes in the form of computer-based training programs are given. The essential requirements applicable to the reliability of software used for conducting the practical and laboratory studies in the form of computer-based teaching programs are also described. The mathematical tool based on Markov chains, which allows to determine the degree of debugging of the training program for use in the educational process by means of applying the graph of the software modules interaction, is presented.

Partnering to Establish and Study Simulation in International Nursing Education.

PubMed

Garner, Shelby L; Killingsworth, Erin; Raj, Leena

The purpose of this article was to describe an international partnership to establish and study simulation in India. A pilot study was performed to determine interrater reliability among faculty new to simulation when evaluating nursing student competency performance. Interrater reliability was below the ideal agreement level. Findings in this study underscore the need to obtain baseline interrater reliability data before integrating competency evaluation into a simulation program.

Pre- and Post-Planned Evaluation: Which Is Preferable?

ERIC Educational Resources Information Center

Strasser, Stephen; Deniston, O. Lynn

1978-01-01

Factors involved in pre-planned and post-planned evaluation of program effectiveness are compared: (1) reliability and cost of data; (2) internal and external validity; (3) obtrusiveness and threat; (4) goal displacement and program direction. A model to help program administrators decide which approach is more appropriate is presented. (Author/MH)

Reliability and the design process at Honeywell Avionics Division

NASA Technical Reports Server (NTRS)

Bezat, A.

1981-01-01

The division's philosophy for designed-in reliability and a comparison of reliability programs for space, manned military aircraft, and commercial aircraft, are presented. Topics include: the reliability interface with design and production; the concept phase through final proposal; the design, development, test and evaluation phase; the production phase; and the commonality among space, military, and commercial avionics.

Reliability and risk assessment of structures

NASA Technical Reports Server (NTRS)

Chamis, C. C.

1991-01-01

Development of reliability and risk assessment of structural components and structures is a major activity at Lewis Research Center. It consists of five program elements: (1) probabilistic loads; (2) probabilistic finite element analysis; (3) probabilistic material behavior; (4) assessment of reliability and risk; and (5) probabilistic structural performance evaluation. Recent progress includes: (1) the evaluation of the various uncertainties in terms of cumulative distribution functions for various structural response variables based on known or assumed uncertainties in primitive structural variables; (2) evaluation of the failure probability; (3) reliability and risk-cost assessment; and (4) an outline of an emerging approach for eventual certification of man-rated structures by computational methods. Collectively, the results demonstrate that the structural durability/reliability of man-rated structural components and structures can be effectively evaluated by using formal probabilistic methods.

Monolithic ceramic analysis using the SCARE program

NASA Technical Reports Server (NTRS)

Manderscheid, Jane M.

1988-01-01

The Structural Ceramics Analysis and Reliability Evaluation (SCARE) computer program calculates the fast fracture reliability of monolithic ceramic components. The code is a post-processor to the MSC/NASTRAN general purpose finite element program. The SCARE program automatically accepts the MSC/NASTRAN output necessary to compute reliability. This includes element stresses, temperatures, volumes, and areas. The SCARE program computes two-parameter Weibull strength distributions from input fracture data for both volume and surface flaws. The distributions can then be used to calculate the reliability of geometrically complex components subjected to multiaxial stress states. Several fracture criteria and flaw types are available for selection by the user, including out-of-plane crack extension theories. The theoretical basis for the reliability calculations was proposed by Batdorf. These models combine linear elastic fracture mechanics (LEFM) with Weibull statistics to provide a mechanistic failure criterion. Other fracture theories included in SCARE are the normal stress averaging technique and the principle of independent action. The objective of this presentation is to summarize these theories, including their limitations and advantages, and to provide a general description of the SCARE program, along with example problems.

Object-oriented fault tree evaluation program for quantitative analyses

NASA Technical Reports Server (NTRS)

Patterson-Hine, F. A.; Koen, B. V.

1988-01-01

Object-oriented programming can be combined with fault free techniques to give a significantly improved environment for evaluating the safety and reliability of large complex systems for space missions. Deep knowledge about system components and interactions, available from reliability studies and other sources, can be described using objects that make up a knowledge base. This knowledge base can be interrogated throughout the design process, during system testing, and during operation, and can be easily modified to reflect design changes in order to maintain a consistent information source. An object-oriented environment for reliability assessment has been developed on a Texas Instrument (TI) Explorer LISP workstation. The program, which directly evaluates system fault trees, utilizes the object-oriented extension to LISP called Flavors that is available on the Explorer. The object representation of a fault tree facilitates the storage and retrieval of information associated with each event in the tree, including tree structural information and intermediate results obtained during the tree reduction process. Reliability data associated with each basic event are stored in the fault tree objects. The object-oriented environment on the Explorer also includes a graphical tree editor which was modified to display and edit the fault trees.

Evaluation of Arsenic Removal Technology: Arsenic Demonstration Program

EPA Science Inventory

Specific objectives of this program are to evaluate the reliability of the arsenic technologies of small scale systems; to gauge the simplicity of system operations, maintenance and operator skill; to determine the cost-effectiveness of the treatment technologies; and to characte...

Qualitative and Semiquantitative Assessment of Exposure to Engineered Nanomaterials within the French EpiNano Program: Inter- and Intramethod Reliability Study.

PubMed

Guseva Canu, Irina; Jezewski-Serra, Delphine; Delabre, Laurène; Ducamp, Stéphane; Iwatsubo, Yuriko; Audignon-Durand, Sabine; Ducros, Cécile; Radauceanu, Anca; Durand, Catherine; Witschger, Olivier; Flahaut, Emmanuel

2017-01-01

The relatively recent development of industries working with nanomaterials has created challenges for exposure assessment. In this article, we propose a relatively simple approach to assessing nanomaterial exposures for the purposes of epidemiological studies of workers in these industries. This method consists of an onsite industrial hygiene visit of facilities carried out individually and a description of workstations where nano-objects and their agglomerates and aggregates (NOAA) are present using a standardized tool, the Onsite technical logbook. To assess its reliability, we implemented this approach for assessing exposure to NOAA in workplaces at seven workstations which synthesize and functionalize carbon nanotubes. The prediction of exposure to NOAA using this method exhibited substantial agreement with that of the reference method, the latter being based on an onsite group visit, an expert's report and exposure measurements (Cohen kappa = 0.70, sensitivity = 0.88, specificity = 0.92). Intramethod comparison of results for exposure prediction showed moderate agreement between the three evaluators (two program team evaluators and one external evaluator) (weighted Fleiss kappa = 0.60, P = 0.003). Interevaluator reliability of the semiquantitative exposure characterization results was excellent between the two evaluators from the program team (Spearman rho = 0.93, P = 0.03) and fair when these two evaluators' results were compared with the external evaluator's results. The project was undertaken within the framework of the French epidemiological surveillance program EpiNano. This study allowed a first reliability assessment of the EpiNano method. However, to further validate this method a comparison with robust quantitative exposure measurement data is necessary. © The Author 2017. Published by Oxford University Press on behalf of the British Occupational Hygiene Society.

Ceramics Analysis and Reliability Evaluation of Structures (CARES). Users and programmers manual

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Manderscheid, Jane M.; Gyekenyesi, John P.

1990-01-01

This manual describes how to use the Ceramics Analysis and Reliability Evaluation of Structures (CARES) computer program. The primary function of the code is to calculate the fast fracture reliability or failure probability of macroscopically isotropic ceramic components. These components may be subjected to complex thermomechanical loadings, such as those found in heat engine applications. The program uses results from MSC/NASTRAN or ANSYS finite element analysis programs to evaluate component reliability due to inherent surface and/or volume type flaws. CARES utilizes the Batdorf model and the two-parameter Weibull cumulative distribution function to describe the effect of multiaxial stress states on material strength. The principle of independent action (PIA) and the Weibull normal stress averaging models are also included. Weibull material strength parameters, the Batdorf crack density coefficient, and other related statistical quantities are estimated from four-point bend bar or unifrom uniaxial tensile specimen fracture strength data. Parameter estimation can be performed for single or multiple failure modes by using the least-square analysis or the maximum likelihood method. Kolmogorov-Smirnov and Anderson-Darling goodness-of-fit tests, ninety percent confidence intervals on the Weibull parameters, and Kanofsky-Srinivasan ninety percent confidence band values are also provided. The probabilistic fast-fracture theories used in CARES, along with the input and output for CARES, are described. Example problems to demonstrate various feature of the program are also included. This manual describes the MSC/NASTRAN version of the CARES program.

Long life reliability thermal control systems study

NASA Technical Reports Server (NTRS)

Scollon, T. R., Jr.; Killen, R. E.

1972-01-01

The results of a program undertaken to conceptually design and evaluate a passive, high reliability, long life thermal control system for space station application are presented. The program consisted of four steps: (1) investigate and select potential thermal system elements; (2) conceive, evaluate and select a thermal control system using these elements; (3) conduct a verification test of a prototype segment of the selected system; and (4) evaluate the utilization of waste heat from the power supply. The result of this project is a conceptual thermal control system design which employs heat pipes as primary components, both for heat transport and temperature control. The system, its evaluation, and the test results are described.

Reliability assessment of Multichip Module technologies via the Triservice/NASA RELTECH program

NASA Astrophysics Data System (ADS)

Fayette, Daniel F.

1994-10-01

Multichip Module (MCM) packaging/interconnect technologies have seen increased emphasis from both the commercial and military communities as a means of increasing capability and performance while providing a vehicle for reducing cost, power and weight of the end item electronic application. This is accomplished through three basic Multichip module technologies, MCM-L that are laminates, MCM-C that are ceramic type substrates and MCM-D that are deposited substrates (e.g., polymer dielectric with thin film metals). Three types of interconnect structures are also used with these substrates and include, wire bond, Tape Automated Bonds (TAB) and flip chip ball bonds. Application, cost, producibility and reliability are the drivers that will determine which MCM technology will best fit a respective need or requirement. With all the benefits and technologies cited, it would be expected that the use of, or the planned use of, MCM's would be more extensive in both military and commercial applications. However, two significant roadblocks exist to implementation of these new technologies: the absence of reliability data and a single national standard for the procurement of reliable/quality MCM's. To address the preceding issues, the Reliability Technology to Achieve Insertion of Advanced Packaging (RELTECH) program has been established. This program, which began in May 1992, has endeavored to evaluate a cross section of MCM technologies covering all classes of MCM's previously cited. NASA and the Tri-Services (Air Force Rome Laboratory, Naval Surface Warfare Center, Crane IN and Army Research Laboratory) have teamed together with sponsorship from ARPA to evaluate the performance, reliability and producibility of MCM's for both military and commercial usage. This is done in close cooperation with our industry partners whose support is critical to the goals of the program. Several tasks are being performed by the RELTECH program and data from this effort, in conjunction with information from our industry partners as well as discussions with industry organizations (IPC, EIA, ISHM, etc.) are being used to develop the qualification and screening requirements for MCM's. Specific tasks being performed by the RELTECH program include technical assessments, product evaluations, reliability modeling, environmental testing, and failure analysis. This paper will describe the various tasks associated with the RELTECH program, status, progress and a description of the national dual use specification being developed for MCM technologies.

Validation of the German revised version of the program in palliative care education and practice questionnaire (PCEP-GR).

PubMed

Fetz, Katharina; Wenzel-Meyburg, Ursula; Schulz-Quach, Christian

2017-12-28

The evaluation of the effectiveness of undergraduate palliative care education (UPCE) programs is an essential foundation to providing high-quality UPCE programs. Therefore, the implementation of valid evaluation tools is indispensable. Until today, there has been no general consensus regarding concrete outcome parameters and their accurate measurement. The Program in Palliative Care Education and Practice Questionnaire (German Revised Version; PCEP-GR) is a promising assessment tool for UPCE. The aim of the current study was to evaluate the psychometric properties of PCEP-GR and to demonstrate its feasibility for the evaluation of UPCE programs. The practical feasibility of the PCEP-GR and its acceptance in medical students were investigated in a pilot study with 24 undergraduate medical students at Heinrich Heine University Dusseldorf, Germany. Subsequently, the PCEP-GR was surveyed in a representative sample (N = 680) of medical students in order to investigate its psychometric properties. Factorial validity was investigated by means of principal component analysis (PCA). Reliability was examined by means of split-half-reliability analysis and analysis of internal consistency. After taking into consideration the PCA and distribution analysis results, an evaluation instruction for the PCEP-GR was developed. The PCEP-GR proved to be feasible and well-accepted in medical students. PCA revealed a four-factorial solution indicating four PCEP-GR subscales: preparation to provide palliative care, attitudes towards palliative care, self-estimation of competence in communication with dying patients and their relatives and self-estimation of knowledge and skills in palliative care. The PCEP-GR showed good split-half-reliability and acceptable to good internal consistency of subscales. Attitudes towards palliative care slightly missed the criterion of acceptable internal consistency. The evaluation instruction suggests a global PCEP-GR index and four subscales. The PCEP-GR has proven to be a feasible, economic, valid and reliable tool for the assessment of UPCE that comprises self-efficacy expectation and relevant attitudes towards palliative care.

Development of Reliable and Validated Tools to Evaluate Technical Resuscitation Skills in a Pediatric Simulation Setting: Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics.

PubMed

Faudeux, Camille; Tran, Antoine; Dupont, Audrey; Desmontils, Jonathan; Montaudié, Isabelle; Bréaud, Jean; Braun, Marc; Fournier, Jean-Paul; Bérard, Etienne; Berlengi, Noémie; Schweitzer, Cyril; Haas, Hervé; Caci, Hervé; Gatin, Amélie; Giovannini-Chami, Lisa

2017-09-01

To develop a reliable and validated tool to evaluate technical resuscitation skills in a pediatric simulation setting. Four Resuscitation and Emergency Simulation Checklist for Assessment in Pediatrics (RESCAPE) evaluation tools were created, following international guidelines: intraosseous needle insertion, bag mask ventilation, endotracheal intubation, and cardiac massage. We applied a modified Delphi methodology evaluation to binary rating items. Reliability was assessed comparing the ratings of 2 observers (1 in real time and 1 after a video-recorded review). The tools were assessed for content, construct, and criterion validity, and for sensitivity to change. Inter-rater reliability, evaluated with Cohen kappa coefficients, was perfect or near-perfect (>0.8) for 92.5% of items and each Cronbach alpha coefficient was ≥0.91. Principal component analyses showed that all 4 tools were unidimensional. Significant increases in median scores with increasing levels of medical expertise were demonstrated for RESCAPE-intraosseous needle insertion (P = .0002), RESCAPE-bag mask ventilation (P = .0002), RESCAPE-endotracheal intubation (P = .0001), and RESCAPE-cardiac massage (P = .0037). Significantly increased median scores over time were also demonstrated during a simulation-based educational program. RESCAPE tools are reliable and validated tools for the evaluation of technical resuscitation skills in pediatric settings during simulation-based educational programs. They might also be used for medical practice performance evaluations. Copyright © 2017 Elsevier Inc. All rights reserved.

Training and quality assurance with the Structured Clinical Interview for DSM-IV (SCID-I/P).

PubMed

Ventura, J; Liberman, R P; Green, M F; Shaner, A; Mintz, J

1998-06-15

Accuracy in psychiatric diagnosis is critical for evaluating the suitability of the subjects for entry into research protocols and for establishing comparability of findings across study sites. However, training programs in the use of diagnostic instruments for research projects are not well systematized. Furthermore, little information has been published on the maintenance of interrater reliability of diagnostic assessments. At the UCLA Research Center for Major Mental Illnesses, a Training and Quality Assurance Program for SCID interviewers was used to evaluate interrater reliability and diagnostic accuracy. Although clinically experienced interviewers achieved better interrater reliability and overall diagnostic accuracy than neophyte interviewers, both groups were able to achieve and maintain high levels of interrater reliability, diagnostic accuracy, and interviewer skill. At the first quality assurance check after training, there were no significant differences between experienced and neophyte interviewers in interrater reliability or diagnostic accuracy. Standardization of training and quality assurance procedures within and across research projects may make research findings from study sites more comparable.

Integrated Approach To Design And Analysis Of Systems

NASA Technical Reports Server (NTRS)

Patterson-Hine, F. A.; Iverson, David L.

1993-01-01

Object-oriented fault-tree representation unifies evaluation of reliability and diagnosis of faults. Programming/fault tree described more fully in "Object-Oriented Algorithm For Evaluation Of Fault Trees" (ARC-12731). Augmented fault tree object contains more information than fault tree object used in quantitative analysis of reliability. Additional information needed to diagnose faults in system represented by fault tree.

Measuring Program Quality, Part 2: Addressing Potential Cultural Bias in a Rater Reliability Exam

ERIC Educational Resources Information Center

Richer, Amanda; Charmaraman, Linda; Ceder, Ineke

2018-01-01

Like instruments used in afterschool programs to assess children's social and emotional growth or to evaluate staff members' performance, instruments used to evaluate program quality should be free from bias. Practitioners and researchers alike want to know that assessment instruments, whatever their type or intent, treat all people fairly and do…

Bayesian Inference for NASA Probabilistic Risk and Reliability Analysis

NASA Technical Reports Server (NTRS)

Dezfuli, Homayoon; Kelly, Dana; Smith, Curtis; Vedros, Kurt; Galyean, William

2009-01-01

This document, Bayesian Inference for NASA Probabilistic Risk and Reliability Analysis, is intended to provide guidelines for the collection and evaluation of risk and reliability-related data. It is aimed at scientists and engineers familiar with risk and reliability methods and provides a hands-on approach to the investigation and application of a variety of risk and reliability data assessment methods, tools, and techniques. This document provides both: A broad perspective on data analysis collection and evaluation issues. A narrow focus on the methods to implement a comprehensive information repository. The topics addressed herein cover the fundamentals of how data and information are to be used in risk and reliability analysis models and their potential role in decision making. Understanding these topics is essential to attaining a risk informed decision making environment that is being sought by NASA requirements and procedures such as 8000.4 (Agency Risk Management Procedural Requirements), NPR 8705.05 (Probabilistic Risk Assessment Procedures for NASA Programs and Projects), and the System Safety requirements of NPR 8715.3 (NASA General Safety Program Requirements).

A Multi-Stage Longitudinal Comparative Design Stage II Evaluation of the Changing Lives Program: The Life Course Interview (RDA-LCI)

ERIC Educational Resources Information Center

Arango, Lisa Lewis; Kurtines, William M.; Montgomery, Marilyn J.; Ritchie, Rachel

2008-01-01

The study reported in this article, a Multi-Stage Longitudinal Comparative Design Stage II evaluation conducted as a planned preliminary efficacy evaluation (psychometric evaluation of measures, short-term controlled outcome studies, etc.) of the Changing Lives Program (CLP), provided evidence for the reliability and validity of the qualitative…

Hybrid propulsion technology program

NASA Technical Reports Server (NTRS)

1990-01-01

Technology was identified which will enable application of hybrid propulsion to manned and unmanned space launch vehicles. Two design concepts are proposed. The first is a hybrid propulsion system using the classical method of regression (classical hybrid) resulting from the flow of oxidizer across a fuel grain surface. The second system uses a self-sustaining gas generator (gas generator hybrid) to produce a fuel rich exhaust that was mixed with oxidizer in a separate combustor. Both systems offer cost and reliability improvement over the existing solid rocket booster and proposed liquid boosters. The designs were evaluated using life cycle cost and reliability. The program consisted of: (1) identification and evaluation of candidate oxidizers and fuels; (2) preliminary evaluation of booster design concepts; (3) preparation of a detailed point design including life cycle costs and reliability analyses; (4) identification of those hybrid specific technologies needing improvement; and (5) preperation of a technology acquisition plan and large scale demonstration plan.

Graduate nurses' evaluation of mentorship: Development of a new tool.

PubMed

Tiew, Lay Hwa; Koh, Catherine S L; Creedy, Debra K; Tam, W S W

2017-07-01

Develop and test an instrument to measure graduate-nurses' perceptions of a structured mentorship program. New graduate nurses may experience difficulties in the transition from student to practitioner. Mentoring is commonly used to support graduates. However, there is a lack of published tools measuring graduate nurses' perceptions of mentorship. As mentoring is resource intensive, development and testing of a validated tool are important to assist in determining program effectiveness. A pretest-posttest interventional design was used. Following a critical review of literature and content experts' input, the 10-item National University Hospital Mentorship Evaluation (NUH ME) instrument was tested with a convenience sample of 83 graduate nurses. Psychometric tests included internal reliability, stability, content validity, and factor analysis. Changed scores were evaluated using paired samples t-test. Seventy-three graduates (88%) out of a possible 83 completed the pre-and post-program survey. Internal reliability was excellent with a Cronbach's alpha of 0.92. Test-retest reliability was stable over time (ICC=0.81). Exploratory factor analysis supported a 1-factor solution explaining 58.2% of variance. Paired samples t-test showed statistical significance between the pre- and post-program scores (p<0.001). The NUH-ME measure was found to be valid and reliable. Confirmatory Factor Analysis of the tool with different groups of nursing graduates is required. Mentorship programs can be an effective recruitment and retention strategy, but are also resource intensive. Measuring new graduates' perceptions of mentoring contributes to program relevance in addressing their personal, professional and clinical skill development needs. As mentoring engages a diverse range of mentors, feedback through measurement may also positively alter organizational learning culture. Copyright © 2017. Published by Elsevier Ltd.

Performance Evaluation Tests for Environmental Research (PETER): evaluation of 114 measures

NASA Technical Reports Server (NTRS)

Bittner, A. C. Jr; Carter, R. C.; Kennedy, R. S.; Harbeson, M. M.; Krause, M.

1986-01-01

The goal of the Performance Evaluation Tests for Environmental Research (PETER) Program was to identify a set of measures of human capabilities for use in the study of environmental and other time-course effects. 114 measures studied in the PETER Program were evaluated and categorized into four groups based upon task stability and task definition. The Recommended category contained 30 measures that clearly obtained total stabilization and had an acceptable level of reliability efficiency. The Acceptable-But-Redundant category contained 15 measures. The 37 measures in the Marginal category, which included an inordinate number of slope and other derived measures, usually had desirable features which were outweighed by faults. The 32 measures in the Unacceptable category had either differential instability or weak reliability efficiency. It is our opinion that the 30 measures in the Recommended category should be given first consideration for environmental research applications. Further, it is recommended that information pertaining to preexperimental practice requirements and stabilized reliabilities should be utilized in repeated-measures environmental studies.

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation.

PubMed

Hodge, Lauren M; Turner, Karen M T; Sanders, Matthew R; Filus, Ania

2017-07-01

An evaluation measure of enablers and inhibitors to sustained evidence-based program (EBP) implementation may provide a useful tool to enhance organizations' capacity. This paper outlines preliminary validation of such a measure. An expert informant and consumer feedback approach was used to tailor constructs from two existing measures assessing key domains associated with sustained implementation. Validity and reliability were evaluated for an inventory composed of five subscales: Program benefits, Program burden, Workplace support, Workplace cohesion, and Leadership style. Exploratory and confirmatory factor analysis with a sample of 593 Triple P-Positive Parenting Program-practitioners led to a 28-item scale with good reliability and good convergent, discriminant, and predictive validity. Practitioners sustaining implementation at least 3 years post-training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support, and positive leadership style, and lower program burden compared to practitioners who were non-sustainers.

An Improved Version of the NASA-Lockheed Multielement Airfoil Analysis Computer Program

NASA Technical Reports Server (NTRS)

Brune, G. W.; Manke, J. W.

1978-01-01

An improved version of the NASA-Lockheed computer program for the analysis of multielement airfoils is described. The predictions of the program are evaluated by comparison with recent experimental high lift data including lift, pitching moment, profile drag, and detailed distributions of surface pressures and boundary layer parameters. The results of the evaluation show that the contract objectives of improving program reliability and accuracy have been met.

Fault diagnostic instrumentation design for environmental control and life support systems

NASA Technical Reports Server (NTRS)

Yang, P. Y.; You, K. C.; Wynveen, R. A.; Powell, J. D., Jr.

1979-01-01

As a development phase moves toward flight hardware, the system availability becomes an important design aspect which requires high reliability and maintainability. As part of continous development efforts, a program to evaluate, design, and demonstrate advanced instrumentation fault diagnostics was successfully completed. Fault tolerance designs for reliability and other instrumenation capabilities to increase maintainability were evaluated and studied.

Interim reliability-evaluation program: analysis of the Browns Ferry, Unit 1, nuclear plant. Appendix C - sequence quantification

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mays, S.E.; Poloski, J.P.; Sullivan, W.H.

1982-07-01

This report describes a risk study of the Browns Ferry, Unit 1, nuclear plant. The study is one of four such studies sponsored by the NRC Office of Research, Division of Risk Assessment, as part of its Interim Reliability Evaluation Program (IREP), Phase II. This report is contained in four volumes: a main report and three appendixes. Appendix C generally describes the methods used to estimate accident sequence frequency values. Information is presented concerning the approach, example collection, failure data, candidate dominant sequences, uncertainty analysis, and sensitivity analysis.

INSREC: Computational System for Quantitative Analysis of Radiation Effects Covering All Radiation Field

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dong Hoon Shin; Young Wook Lee; Young Ho Cho

2006-07-01

In the nuclear energy field, there are so many difficult things that even people who are working in this field are not much familiar with, such as, Dose evaluation, Dose management, etc. Thus, so many efforts have been done to achieve the knowledge and data for understanding. Although some data had been achieved, the applications of these data to necessary cases were more difficult job. Moreover, the type of Dose evaluation program until now was 'Console type' which is not easy enough to use for the beginners. To overcome the above causes of difficulties, the window-based integrated program and databasemore » management were developed in our research lab. The program, called as INSREC, consists of four sub-programs as follow; INSREC-NOM, INSREC-ACT, INSREC-MED, and INSREC-EXI. In ICONE 11 conference, INSREC-program(ICONE-36203) which can evaluates on/off-site dose of nuclear power plant in normal operation was introduced. Upgraded INSREC-program which will be presented in ICONE 14 conference has three additional codes comparing with pre-presented INSREC-program. Those subprograms can evaluate on/off-site Dose of nuclear power plant in accident cases. And they also have the functions of 'Dose evaluation and management' in the hospital and provide the 'Expert system' based on knowledge related to nuclear energy/radiation field. The INSREC-NOM, one of subprograms, is composed of 'Source term evaluation program', 'Atmospheric diffusion factor evaluation program', 'Off-site dose evaluation program', and 'On-site database program'. The INSREC-ACT is composed of 'On/Off-site dose evaluation program' and 'Result analysis program' and the INSREC-MED is composed of 'Workers/patients dose database program' and 'Dose evaluation program for treatment room'. The final one, INSREC-EXI, is composed of 'Database searching program based on artificial intelligence', 'Instruction program,' and 'FAQ/Q and A boards'. Each program was developed by using of Visual C++, Microsoft Access mainly. To verify the reliability, some suitable programs were selected such as AZAP and Stardose programs for the comparison. The AZAP program was selected for the on/off-site dose evaluation during the normal operation of nuclear reactor and Stardose program was used for the on/off-site dose evaluation in accident. The MCNP code was used for the dose evaluation and management in the hospital. Each comparison result was acceptable in errors analysis. According to the reliable verification results, it was concluded that INSREC program had an acceptable reliability for dose calculation and could give many proper dada for the sites. To serve the INSREC to people, the proper server system was constructed. We gave chances for the people (user) to utilize the INSREC through network connected to server system. The reactions were pretty much good enough to be satisfied. For the future work, many efforts will be given to improve the better user-interface and more necessary data will be provided to more people through database supplement and management. (authors)« less

Reliability Centered Maintenance - Methodologies

NASA Technical Reports Server (NTRS)

Kammerer, Catherine C.

2009-01-01

Journal article about Reliability Centered Maintenance (RCM) methodologies used by United Space Alliance, LLC (USA) in support of the Space Shuttle Program at Kennedy Space Center. The USA Reliability Centered Maintenance program differs from traditional RCM programs because various methodologies are utilized to take advantage of their respective strengths for each application. Based on operational experience, USA has customized the traditional RCM methodology into a streamlined lean logic path and has implemented the use of statistical tools to drive the process. USA RCM has integrated many of the L6S tools into both RCM methodologies. The tools utilized in the Measure, Analyze, and Improve phases of a Lean Six Sigma project lend themselves to application in the RCM process. All USA RCM methodologies meet the requirements defined in SAE JA 1011, Evaluation Criteria for Reliability-Centered Maintenance (RCM) Processes. The proposed article explores these methodologies.

Reliability Analysis of RSG-GAS Primary Cooling System to Support Aging Management Program

NASA Astrophysics Data System (ADS)

Deswandri; Subekti, M.; Sunaryo, Geni Rina

2018-02-01

Multipurpose Research Reactor G.A. Siwabessy (RSG-GAS) which has been operating since 1987 is one of the main facilities on supporting research, development and application of nuclear energy programs in BATAN. Until now, the RSG-GAS research reactor has been successfully operated safely and securely. However, because it has been operating for nearly 30 years, the structures, systems and components (SSCs) from the reactor would have started experiencing an aging phase. The process of aging certainly causes a decrease in reliability and safe performances of the reactor, therefore the aging management program is needed to resolve the issues. One of the programs in the aging management is to evaluate the safety and reliability of the system and also screening the critical components to be managed.One method that can be used for such purposes is the Fault Tree Analysis (FTA). In this papers FTA method is used to screening the critical components in the RSG-GAS Primary Cooling System. The evaluation results showed that the primary isolation valves are the basic events which are dominant against the system failure.

Teacher Advancement Program (TAP) at Wilburn Elementary School: Year 3 Evaluation Report. Eye on Evaluation. D&A Report No. 11.02

ERIC Educational Resources Information Center

Baenen, Nancy

2011-01-01

The Teacher Advancement Program (TAP) is a model for training, teacher advancement, and instructional strategies. Based on interviews and observations, the four TAP principles were implemented with fidelity during the 2010-11 school year, with one exception--teacher evaluations. Feedback was slow, and teachers had concerns about the reliability of…

Pilot testing of SHRP 2 reliability data and analytical products: Southern California.

DOT National Transportation Integrated Search

2015-01-01

The second Strategic Highway Research Program (SHRP 2) has been investigating the critical subject of travel time reliability for several years. As part of this research, SHRP 2 supported multiple efforts to develop products to evaluate travel time r...

38 CFR 1.15 - Standards for program evaluation.

Code of Federal Regulations, 2010 CFR

2010-07-01

... program operates. (3) Validity. The degree of statistical validity should be assessed within the research... decisions. (4) Reliability. Use of the same research design by others should yield the same findings. (g...

Evaluating Failures and Near Misses in Human Spaceflight History for Lessons for Future Human Spaceflight

NASA Technical Reports Server (NTRS)

Barr, Stephanie

2009-01-01

There have been a number of studies done in the past drawn on lessons learned with regard to human loss-of-life events. Generally, the systemic causes and proximate causes for fatal events have both been examined in considerable detail. However, an examination of near-fatal accidents and failures that narrowly missed being fatal could be equally useful, not only in detecting causes, both proximate and systemic, but also for determining what factors averted disaster, what design decisions and/or operator actions prevented catastrophe. Additionally, review of risk factors for upcoming or future programs will often look at trending statistics, generally focusing on failure/success statistics. Unfortunately, doing so can give a skewed or misleading view of past reliability or a reliability that cannot be presumed to apply to a new program. One reason for this might be that failure/success criteria aren't the same across programs, but also that apparent success can hide systemic faults that, under other circumstances, can be fatal to a program with different parameters. A program with a number of near misses can look more reliable than a consistently healthy program with a single out-of-family failure and provide very misleading data if it is not examined in detail. This is particularly true for a manned space program where failure/success includes more than making a particular orbit. Augmenting reliability evaluations with this near miss data can provide insight and expand on the limitations of a strictly pass/fail evaluation. Even more importantly, a thorough understanding of these near miss events can identify conditions that prevented fatalities. Those conditions may be key to a programs reliability, but, without insight to the repercussions if such conditions were not in place, their importance may not be readily clear. As programs mature and political and fiscal responsibilities come to the fore, often there is considerable incentive to eliminate unnecessary conservatism, design margin, redundancy, operational support, testing, training, or safety oversight. An evaluation that demonstrates how these features and capabilities averted disaster can ensure processes that saved lives or missions are not discarded without appropriate review and understanding. Close examination of accidents that almost were can also highlight differences in design from one program to another, either justifying reliability comparisons or negating them. It can also provide considerable insight into how those saving factors were developed and implemented so that similar methods can be used to ensure appropriate life-saving and mission saving factors can be developed, even for a dissimilar space program. The lessons are appropriate for seasoned manned space programs and agencies, but crucial for untried agencies and organizations that are interested in sending man into space. The large body of publicly available near miss and accident data available provide invaluable insight into programmatic, technical, and even political issues that can be addressed before they impact safety. In this paper, we examine a number of these near misses and accidents and steps a program, agency, or potential spacefaring company might take to improve their chances of success and avoid mission or safety disasters using this data.

Dairy cattle genomics evaluation program update

USDA-ARS?s Scientific Manuscript database

Implementation of genomic evaluation has caused profound changes in dairy cattle breeding. All young bulls bought by major artificial-insemination organizations now are selected based on these evaluation. Evaluation reliability can reach ~75% for yield traits, which is adequate for marketing semen o...

Care 3, Phase 1, volume 1

NASA Technical Reports Server (NTRS)

Stiffler, J. J.; Bryant, L. A.; Guccione, L.

1979-01-01

A computer program to aid in accessing the reliability of fault tolerant avionics systems was developed. A simple mathematical expression was used to evaluate the reliability of any redundant configuration over any interval during which the failure rates and coverage parameters remained unaffected by configuration changes. Provision was made for convolving such expressions in order to evaluate the reliability of a dual mode system. A coverage model was also developed to determine the various relevant coverage coefficients as a function of the available hardware and software fault detector characteristics, and subsequent isolation and recovery delay statistics.

Questions for Online Surveys

ERIC Educational Resources Information Center

Ritter, Lois A., Ed.; Sue, Valerie M., Ed.

2007-01-01

The primary function of an evaluation is often to assess the degree of success of a program or to collect information that may be used to improve a program, product, or service. To meet an evaluation's goals and objectives by using an online survey, it is imperative that the questionnaire contain valid and reliable items asked about specific…

10 CFR 712.37 - Evaluation for hallucinogen use.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Evaluation for hallucinogen use. 712.37 Section 712.37 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.37 Evaluation for... performance and observed behavior. ...

10 CFR 712.37 - Evaluation for hallucinogen use.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 4 2013-01-01 2013-01-01 false Evaluation for hallucinogen use. 712.37 Section 712.37 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.37 Evaluation for... performance and observed behavior. ...

10 CFR 712.37 - Evaluation for hallucinogen use.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 4 2014-01-01 2014-01-01 false Evaluation for hallucinogen use. 712.37 Section 712.37 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.37 Evaluation for... performance and observed behavior. ...

10 CFR 712.37 - Evaluation for hallucinogen use.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false Evaluation for hallucinogen use. 712.37 Section 712.37 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.37 Evaluation for... performance and observed behavior. ...

10 CFR 712.37 - Evaluation for hallucinogen use.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 4 2012-01-01 2012-01-01 false Evaluation for hallucinogen use. 712.37 Section 712.37 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.37 Evaluation for... performance and observed behavior. ...

NERF - A Computer Program for the Numerical Evaluation of Reliability Functions - Reliability Modelling, Numerical Methods and Program Documentation,

DTIC Science & Technology

1983-09-01

gives the adaptive procedure the desirabl, property of providLng a self indication of possible failure. Let In(ab) denote a numerical estimate of I(ab...opertor’s response to the prompt stored in A. This respose is checked and INTEST set true if ’YES’, ’Y’ or ’T’ has been entered. INTEST is set false

Evaluating Failures and near Misses in Human Spaceflight History for Lessons for Future Human Spaceflight

NASA Technical Reports Server (NTRS)

Barr, Stephanie

2010-01-01

Studies done in the past have drawn on lessons learned with regard to human loss-of-life events. However, an examination of near-fatal accidents can be equally useful, not only in detecting causes, both proximate and systemic, but also for determining what factors averted disaster, what design decisions and/or operator actions prevented catastrophe. Binary pass/fail launch history is often used for risk, but this also has limitations. A program with a number of near misses can look more reliable than a consistently healthy program with a single out-of-family failure. Augmenting reliability evaluations with this near miss data can provide insight and expand on the limitations of a strictly pass/fail evaluation. This paper intends to show how near-miss lessons learned can provide crucial data for any new human spaceflight programs that are interested in sending man into space

Evaluating Failures and Near Misses in Human Spaceflight History for Lessons for Future Human Spaceflight

NASA Astrophysics Data System (ADS)

Barr, Stephanie

2010-09-01

Studies done in the past have drawn on lessons learned with regard to human loss-of-life events. However, an examination of near-fatal accidents can be equally useful, not only in detecting causes, both proximate and systemic, but also for determining what factors averted disaster, what design decisions and/or operator actions prevented catastrophe. Binary pass/fail launch history is often used for risk, but this also has limitations. A program with a number of near misses can look more reliable than a consistently healthy program with a single out-of-family failure. Augmenting reliability evaluations with this near miss data can provide insight and expand on the limitations of a strictly pass/fail evaluation. This paper intends to show how near-miss lessons learned can provide crucial data for any new human spaceflight programs that are interested in sending man into space.

UpStart Parent Survey-Prenatal: A New Tool for Evaluating Prenatal Education Programs.

PubMed

Benzies, Karen M; Barker, Leslie; Churchill, Jocelyn; Smith, Jennifer; Horn, Sarah

2016-09-01

To evaluate a new prenatal education program evaluation tool, the UpStart Parent Survey - Prenatal, in terms of: (a) reliability and validity; (b) sensitivity to change over time; (c) whether results differed for mothers versus fathers; and (d) whether results differed when using an electronic tablet-computer versus a paper survey. Psychometric study. Participants were 277 expectant mothers (n = 161) and fathers (n = 106) enrolled in Childbirth Essentials, a 6-week prenatal education program. The UpStart Parent Survey - Prenatal is a retrospective pretest/posttest survey with three scales: Parenting Knowledge, Parenting Experience, and Program Satisfaction, and three open-ended questions. The UpStart Parent Survey - Prenatal is sensitive to change and demonstrated significant positive differences in parenting knowledge and parenting experience. There was no difference in results whether the survey was completed by mothers or fathers. Results were similar whether paper or electronic formats were used. The survey was easy to complete. The UpStart Parent Survey - Prenatal holds promise as a reliable and valid evaluation tool to capture outcomes of brief prenatal education programs that target the general population of expectant parents. © 2016 Wiley Periodicals, Inc.

Interim reliability-evaluation program: analysis of the Browns Ferry, Unit 1, nuclear plant. Appendix B - system descriptions and fault trees

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mays, S.E.; Poloski, J.P.; Sullivan, W.H.

1982-07-01

This report describes a risk study of the Browns Ferry, Unit 1, nuclear plant. The study is one of four such studies sponsored by the NRC Office of Research, Division of Risk Assessment, as part of its Interim Reliability Evaluation Program (IREP), Phase II. This report is contained in four volumes: a main report and three appendixes. Appendix B provides a description of Browns Ferry, Unit 1, plant systems and the failure evaluation of those systems as they apply to accidents at Browns Ferry. Information is presented concerning front-line system fault analysis; support system fault analysis; human error models andmore » probabilities; and generic control circuit analyses.« less

General test plan redundant sensor strapdown IMU evaluation program

NASA Technical Reports Server (NTRS)

Hartwell, T.; Irwin, H. A.; Miyatake, Y.; Wedekind, D. E.

1971-01-01

The general test plan for a redundant sensor strapdown inertial measuring unit evaluation program is presented. The inertial unit contains six gyros and three orthogonal accelerometers. The software incorporates failure detection and correction logic and a land vehicle navigation program. The principal objective of the test is a demonstration of the practicability, reliability, and performance of the inertial measuring unit with failure detection and correction in operational environments.

Risk Management of Microelectronics: The NASA Electronic Parts and Packaging (NEPP) Program

NASA Technical Reports Server (NTRS)

LaBel, Kenneth A.; Sampson, Michael J.

2005-01-01

This viewgraph information provides information on how the NASA Electronic Parts and Packaging (NEPP) Program evaluates the reliability of technologies for Electrical, Electronic, and Electromechanical (EEE) parts, and their suitability for spacecraft applications.

Framework for a National Testing and Evaluation Program Based Upon the National Stormwater Testing and Evaluation for Products and Practices (STEPP) Initiative (WERF Report INFR2R14)

EPA Science Inventory

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective S...

Evaluating Outcomes of High Fidelity Simulation Curriculum in a Community College Nursing Program

ERIC Educational Resources Information Center

Denlea, Gregory Richard

2017-01-01

This study took place at a Wake Technical Community College, a multi-campus institution in Raleigh, North Carolina. An evaluation of the return on investment in high fidelity simulation used by an associate degree of nursing program was conducted with valid and reliable instruments. The study demonstrated that comparable student outcomes are…

Time-dependent reliability analysis of ceramic engine components

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.

1993-01-01

The computer program CARES/LIFE calculates the time-dependent reliability of monolithic ceramic components subjected to thermomechanical and/or proof test loading. This program is an extension of the CARES (Ceramics Analysis and Reliability Evaluation of Structures) computer program. CARES/LIFE accounts for the phenomenon of subcritical crack growth (SCG) by utilizing either the power or Paris law relations. The two-parameter Weibull cumulative distribution function is used to characterize the variation in component strength. The effects of multiaxial stresses are modeled using either the principle of independent action (PIA), the Weibull normal stress averaging method (NSA), or the Batdorf theory. Inert strength and fatigue parameters are estimated from rupture strength data of naturally flawed specimens loaded in static, dynamic, or cyclic fatigue. Two example problems demonstrating proof testing and fatigue parameter estimation are given.

Qualification of an evaluated butterfly-packaged DFB laser designed for space applications

NASA Astrophysics Data System (ADS)

Tornow, S.; Stier, C.; Buettner, T.; Laurent, T.; Kneier, M.; Bru, J.; Lien, Y.

2017-11-01

An extended qualification program has proven the quality of a previously evaluated semiconductor laser diode, which is intended to be used in a subsystem for the GAIA mission. We report on results of several reliability tests performed in subgroups. The requirements of the procurement specification with respect to reliability and desired manufacturing processes were confirmed. This is an example for successful collaboration between component supplier, system integrator and payload responsible party.

An Independent Evaluation of the FMEA/CIL Hazard Analysis Alternative Study

NASA Technical Reports Server (NTRS)

Ray, Paul S.

1996-01-01

The present instruments of safety and reliability risk control for a majority of the National Aeronautics and Space Administration (NASA) programs/projects consist of Failure Mode and Effects Analysis (FMEA), Hazard Analysis (HA), Critical Items List (CIL), and Hazard Report (HR). This extensive analytical approach was introduced in the early 1970's and was implemented for the Space Shuttle Program by NHB 5300.4 (1D-2. Since the Challenger accident in 1986, the process has been expanded considerably and resulted in introduction of similar and/or duplicated activities in the safety/reliability risk analysis. A study initiated in 1995, to search for an alternative to the current FMEA/CIL Hazard Analysis methodology generated a proposed method on April 30, 1996. The objective of this Summer Faculty Study was to participate in and conduct an independent evaluation of the proposed alternative to simplify the present safety and reliability risk control procedure.

The Program Evaluation Standards Applied for Metaevaluation Purposes: Investigating Interrater Reliability and Implications for Use

ERIC Educational Resources Information Center

Wingate, Lori A.

2009-01-01

Metaevaluation is the evaluation of evaluation. Metaevaluation may focus particular evaluation cases, evaluation systems, or the discipline overall. Leading scholars within the discipline consider metaevaluation to be a professional imperative, demonstrating that evaluation is a reflexive enterprise. Various criteria have been set forth for what…

Towards automatic Markov reliability modeling of computer architectures

NASA Technical Reports Server (NTRS)

Liceaga, C. A.; Siewiorek, D. P.

1986-01-01

The analysis and evaluation of reliability measures using time-varying Markov models is required for Processor-Memory-Switch (PMS) structures that have competing processes such as standby redundancy and repair, or renewal processes such as transient or intermittent faults. The task of generating these models is tedious and prone to human error due to the large number of states and transitions involved in any reasonable system. Therefore model formulation is a major analysis bottleneck, and model verification is a major validation problem. The general unfamiliarity of computer architects with Markov modeling techniques further increases the necessity of automating the model formulation. This paper presents an overview of the Automated Reliability Modeling (ARM) program, under development at NASA Langley Research Center. ARM will accept as input a description of the PMS interconnection graph, the behavior of the PMS components, the fault-tolerant strategies, and the operational requirements. The output of ARM will be the reliability of availability Markov model formulated for direct use by evaluation programs. The advantages of such an approach are (a) utility to a large class of users, not necessarily expert in reliability analysis, and (b) a lower probability of human error in the computation.

Development and validation of a questionnaire to evaluate patient satisfaction with diabetes disease management.

PubMed

Paddock, L E; Veloski, J; Chatterton, M L; Gevirtz, F O; Nash, D B

2000-07-01

To develop a reliable and valid questionnaire to measure patient satisfaction with diabetes disease management programs. Questions related to structure, process, and outcomes were categorized into 14 domains defining the essential elements of diabetes disease management. Health professionals confirmed the content validity. Face validity was established by a patient focus group. The questionnaire was mailed to 711 patients with diabetes who participated in a disease management program. To reduce the number of questionnaire items, a principal components analysis was performed using a varimax rotation. The Scree test was used to select significant components. To further assess reliability and validity; Cronbach's alpha and product-moment correlations were calculated for components having > or =3 items with loadings >0.50. The validated 73-item mailed satisfaction survey had a 34.1% response rate. Principal components analysis yielded 13 components with eigenvalues > 1.0. The Scree test proposed a 6-component solution (39 items), which explained 59% of the total variation. Internal consistency reliabilities computed for the first 6 components (alpha = 0.79-0.95) were acceptable. The final questionnaire, the Diabetes Management Evaluation Tool (DMET), was designed to assess patient satisfaction with diabetes disease management programs. Although more extensive testing of the questionnaire is appropriate, preliminary reliability and validity of the DMET has been demonstrated.

An experiment in software reliability

NASA Technical Reports Server (NTRS)

Dunham, J. R.; Pierce, J. L.

1986-01-01

The results of a software reliability experiment conducted in a controlled laboratory setting are reported. The experiment was undertaken to gather data on software failures and is one in a series of experiments being pursued by the Fault Tolerant Systems Branch of NASA Langley Research Center to find a means of credibly performing reliability evaluations of flight control software. The experiment tests a small sample of implementations of radar tracking software having ultra-reliability requirements and uses n-version programming for error detection, and repetitive run modeling for failure and fault rate estimation. The experiment results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay.

10 CFR 712.36 - Medical assessment process.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Medical assessment process. 712.36 Section 712.36 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Medical Standards § 712.36 Medical assessment process. (a) The... the SOMD must integrate the medical evaluations, psychological evaluations, psychiatric evaluations...

The Effect of Instrument-Specific Rater Training on Interrater Reliability and Counseling Skills Performance Differentiation

ERIC Educational Resources Information Center

Meacham, Paul Douglas, Jr.

2013-01-01

The purpose of this study was to explore the effect of instrument-specific rater training on interrater reliability (IRR) and counseling skills performance differentiation. Strong IRR is of primary concern to effective program evaluation (McCullough, Kuhn, Andrews, Valen, Hatch, & Osimo, 2003; Schanche, Nielsen, McCullough, Valen, &…

Validating the Alcohol Use Disorders Identification Test with Persons Who Have a Serious Mental Illness

ERIC Educational Resources Information Center

O'Hare, Thomas; Sherrer, Margaret V.; LaButti, Annamaria; Emrick, Kelly

2004-01-01

Objective/Method: The use of brief, reliable, valid, and practical measures of substance use is critical for conducting individual assessments and program evaluation for integrated mental health-substance abuse services for persons with serious mental illness. This investigation examines the internal consistency reliability, concurrent validity,…

Probabilistic structural analysis by extremum methods

NASA Technical Reports Server (NTRS)

Nafday, Avinash M.

1990-01-01

The objective is to demonstrate discrete extremum methods of structural analysis as a tool for structural system reliability evaluation. Specifically, linear and multiobjective linear programming models for analysis of rigid plastic frames under proportional and multiparametric loadings, respectively, are considered. Kinematic and static approaches for analysis form a primal-dual pair in each of these models and have a polyhedral format. Duality relations link extreme points and hyperplanes of these polyhedra and lead naturally to dual methods for system reliability evaluation.

CUMBIN - CUMULATIVE BINOMIAL PROGRAMS

NASA Technical Reports Server (NTRS)

Bowerman, P. N.

1994-01-01

The cumulative binomial program, CUMBIN, is one of a set of three programs which calculate cumulative binomial probability distributions for arbitrary inputs. The three programs, CUMBIN, NEWTONP (NPO-17556), and CROSSER (NPO-17557), can be used independently of one another. CUMBIN can be used by statisticians and users of statistical procedures, test planners, designers, and numerical analysts. The program has been used for reliability/availability calculations. CUMBIN calculates the probability that a system of n components has at least k operating if the probability that any one operating is p and the components are independent. Equivalently, this is the reliability of a k-out-of-n system having independent components with common reliability p. CUMBIN can evaluate the incomplete beta distribution for two positive integer arguments. CUMBIN can also evaluate the cumulative F distribution and the negative binomial distribution, and can determine the sample size in a test design. CUMBIN is designed to work well with all integer values 0 < k <= n. To run the program, the user simply runs the executable version and inputs the information requested by the program. The program is not designed to weed out incorrect inputs, so the user must take care to make sure the inputs are correct. Once all input has been entered, the program calculates and lists the result. The CUMBIN program is written in C. It was developed on an IBM AT with a numeric co-processor using Microsoft C 5.0. Because the source code is written using standard C structures and functions, it should compile correctly with most C compilers. The program format is interactive. It has been implemented under DOS 3.2 and has a memory requirement of 26K. CUMBIN was developed in 1988.

Predicting Vandalism in a General Youth Sample via the HEW Youth Development Model's Community Program Impact Scales, Age, and Sex.

ERIC Educational Resources Information Center

Truckenmiller, James L.

The former HEW National Strategy for Youth Development model was a community-based planning and procedural tool to enhance and to prevent delinquency through a process of youth needs assessments, needs targeted programs, and program impact evaluation. The program's 12 Impact Scales have been found to have acceptable reliabilities, substantial…

Evaluation test program, valve, explosive actuated, normally closed Pyronetics model 1400

NASA Technical Reports Server (NTRS)

Avalos, E.

1971-01-01

Evaluation tests of the explosive actuated normally closed valves used to control and isolate hydrazine flow in the TOPS spacecraft, are presented. The malfunctions, modifications, service life, and reliability of the valve are also outlined.

Getting the story straight: evaluating the test-retest reliability of a university health history questionnaire.

PubMed

Gilkison, C R; Fenton, M V; Lester, J W

1992-05-01

This study was designed to establish the reliability of a health history questionnaire used as a screening tool for incoming university students. The authors used a test-retest design, with a test interval of 6 months, on a sample of medical and nursing students. The analysis focused on overall reliability of the questionnaire and reproducibility of specific items, based on question format. Questionnaire items of specific interest were those with dichotomous yes/no response options versus open-ended format questions, those using the words frequently or recently, or those that asked multiple questions. Demographic characteristics of the subjects were considered in the evaluation of reliability. Overall reliability of the questionnaire (93.6%) was above the anticipated level of 90%, and subject sex or program of study did not show any significant differences in reproducibility of responses. Although wording of questions did not affect item reliability, dichotomous format questions demonstrated a higher degree of reliability (96.4%) than the overall reliability of the questionnaire. Recommendations for enhancing the reliability of the questionnaire are based on item analysis and information gathered from interviews with subjects.

Psychometric evaluation of the parent situation inventory: a role-play measure of coping in parents of substance-using adolescents.

PubMed

McGillicuddy, Neil B; Rychtarik, Robert G; Morsheimer, Elizabeth T

2004-12-01

This article reports on the generalizability, reliability, and construct validity of the Parent Situation Inventory (PSI), a role-play measure of coping skills in parents experiencing problems from an adolescent's drug and alcohol use. Generalizability was robust (.80) and alternate form and test-retest reliability were satisfactory. PSI skillfulness was negatively related to the parent's own substance use and to the adolescent's alcohol use. The PSI shows promise as a reliable and potentially valid measure of coping in this population and has direct implications for developing and evaluating skill-based parent training programs. Copyright 2004 APA.

Reliability of Interaural Time Difference-Based Localization Training in Elderly Individuals with Speech-in-Noise Perception Disorder.

PubMed

Delphi, Maryam; Lotfi, M-Yones; Moossavi, Abdollah; Bakhshi, Enayatollah; Banimostafa, Maryam

2017-09-01

Previous studies have shown that interaural-time-difference (ITD) training can improve localization ability. Surprisingly little is, however, known about localization training vis-à-vis speech perception in noise based on interaural time difference in the envelope (ITD ENV). We sought to investigate the reliability of an ITD ENV-based training program in speech-in-noise perception among elderly individuals with normal hearing and speech-in-noise disorder. The present interventional study was performed during 2016. Sixteen elderly men between 55 and 65 years of age with the clinical diagnosis of normal hearing up to 2000 Hz and speech-in-noise perception disorder participated in this study. The training localization program was based on changes in ITD ENV. In order to evaluate the reliability of the training program, we performed speech-in-noise tests before the training program, immediately afterward, and then at 2 months' follow-up. The reliability of the training program was analyzed using the Friedman test and the SPSS software. Significant statistical differences were shown in the mean scores of speech-in-noise perception between the 3 time points (P=0.001). The results also indicated no difference in the mean scores of speech-in-noise perception between the 2 time points of immediately after the training program and 2 months' follow-up (P=0.212). The present study showed the reliability of an ITD ENV-based localization training in elderly individuals with speech-in-noise perception disorder.

Reliability techniques in the petroleum industry

NASA Technical Reports Server (NTRS)

Williams, H. L.

1971-01-01

Quantitative reliability evaluation methods used in the Apollo Spacecraft Program are translated into petroleum industry requirements with emphasis on offsetting reliability demonstration costs and limited production runs. Described are the qualitative disciplines applicable, the definitions and criteria that accompany the disciplines, and the generic application of these disciplines to the chemical industry. The disciplines are then translated into proposed definitions and criteria for the industry, into a base-line reliability plan that includes these disciplines, and into application notes to aid in adapting the base-line plan to a specific operation.

Surgeons' attitude toward a competency-based training and assessment program: results of a multicenter survey.

PubMed

Hopmans, Cornelis J; den Hoed, Pieter T; Wallenburg, Iris; van der Laan, Lijkckle; van der Harst, Erwin; van der Elst, Maarten; Mannaerts, Guido H H; Dawson, Imro; van Lanschot, Jan J B; Ijzermans, Jan N M

2013-01-01

Currently, most surgical training programs are focused on the development and evaluation of professional competencies. Also in the Netherlands, competency-based training and assessment programs were introduced to restructure postgraduate medical training. The current surgical residency program is based on the Canadian Medical Education Directives for Specialists (CanMEDS) competencies and uses assessment tools to evaluate residents' competence progression. In this study, we examined the attitude of surgical residents and attending surgeons toward a competency-based training and assessment program used to restructure general surgical training in the Netherlands in 2009. In 2011, all residents (n = 51) and attending surgeons (n = 108) in 1 training region, consisting of 7 hospitals, were surveyed. Participants were asked to rate the importance of the CanMEDS competencies and the suitability of the adopted assessment tools. Items were rated on a 5-point Likert scale and considered relevant when at least 80% of the respondents rated an item with a score of 4 or 5 (indicating a positive attitude). Reliability was evaluated by calculating the Cronbach's α, and the Mann-Whitney test was applied to assess differences between groups. The response rate was 88% (n = 140). The CanMEDS framework demonstrated good reliability (Cronbach's α = 0.87). However, the importance of the competencies 'Manager' (78%) and 'Health Advocate' (70%) was undervalued. The assessment tools failed to achieve an acceptable reliability (Cronbach's α = 0.55), and individual tools were predominantly considered unsuitable for assessment. Exceptions were the tools 'in-training evaluation report' (91%) and 'objective structured assessment of technical skill' (82%). No significant differences were found between the residents and the attending surgeons. This study has demonstrated that, 2 years after the reform of the general surgical residency program, residents and attending surgeons in a large training region in the Netherlands do not acknowledge the importance of all CanMEDS competencies and consider the assessment tools generally unsuitable for competence evaluation. Copyright © 2013 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Evaluation through research of a three-track career ladder program for registered nurses.

PubMed

Korman, Carol; Eliades, Aris Beoglos

2010-01-01

A descriptive study design was employed to survey registered nurse participants in a career ladder program comprising of three tracks: clinical, education, and management. Findings indicate that participation allows nurses of varying education preparation and roles to demonstrate professional development. Implications for staff development include efficacy of the online survey technique, provision of a reliable tool to evaluate a career ladder, and evaluation of a career ladder that includes the staff development educator.

Electrical, Electronic, and Electromechanical (EEE) parts management and control requirements for NASA space flight programs

NASA Technical Reports Server (NTRS)

1989-01-01

This document establishes electrical, electronic, and electromechanical (EEE) parts management and control requirements for contractors providing and maintaining space flight and mission-essential or critical ground support equipment for NASA space flight programs. Although the text is worded 'the contractor shall,' the requirements are also to be used by NASA Headquarters and field installations for developing program/project parts management and control requirements for in-house and contracted efforts. This document places increased emphasis on parts programs to ensure that reliability and quality are considered through adequate consideration of the selection, control, and application of parts. It is the intent of this document to identify disciplines that can be implemented to obtain reliable parts which meet mission needs. The parts management and control requirements described in this document are to be selectively applied, based on equipment class and mission needs. Individual equipment needs should be evaluated to determine the extent to which each requirement should be implemented on a procurement. Utilization of this document does not preclude the usage of other documents. The entire process of developing and implementing requirements is referred to as 'tailoring' the program for a specific project. Some factors that should be considered in this tailoring process include program phase, equipment category and criticality, equipment complexity, and mission requirements. Parts management and control requirements advocated by this document directly support the concept of 'reliability by design' and are an integral part of system reliability and maintainability. Achieving the required availability and mission success objectives during operation depends on the attention given reliability and maintainability in the design phase. Consequently, it is intended that the requirements described in this document are consistent with those of NASA publications, 'Reliability Program Requirements for Aeronautical and Space System Contractors,' NHB 5300.4(1A-l); 'Maintainability Program Requirements for Space Systems,' NHB 5300.4(1E); and 'Quality Program Provisions for Aeronautical and Space System Contractors,' NHB 5300.4(1B).

Drug utilization review: mechanisms to improve its effectiveness and broaden its scope. The U.S. Pharmacopeia Drug Utilization Review Advisory Panel.

PubMed

2000-01-01

To address important problems and needed changes in online and retrospective drug utilization review (DUR) programs. Emphasis is placed on reliability of DUR criteria and the shift of traditional retrospective DUR programs toward disease management and health care outcomes. Published literature evaluating the role of online and retrospective DUR programs. Particular attention was given to studies assessing DUR criteria reliability and new interventions with retrospective DUR programs. A literature review was conducted along with an expert summary from the U.S. Pharmacopeia Drug Utilization Review Advisory Panel. Studies have revealed variations in DUR criteria that could be affecting clinical practice and patient care. Appropriate formal methodologies and use of consistent procedures in developing online prospective DUR programs and systems could help resolve these problems. Traditional retrospective DUR is also shifting to incorporate disease management and methodologies from health outcomes and pharmacoeconomics studies. Refinements are needed to improve the reliability and validity of online DUR criteria and to minimize false positive messages. Databases created as a result of DUR efforts have been used in new and innovative ways to incorporate health outcomes data and disease management interventions. Additional outcomes data, combined with quality assurance efforts, should increase the utility of DUR/disease management efforts in evaluating health systems while improving the effectiveness and efficiency of pharmacists' health care interventions.

Time-Tagged Risk/Reliability Assessment Program for Development and Operation of Space System

NASA Astrophysics Data System (ADS)

Kubota, Yuki; Takegahara, Haruki; Aoyagi, Junichiro

We have investigated a new method of risk/reliability assessment for development and operation of space system. It is difficult to evaluate risk of spacecraft, because of long time operation, maintenance free and difficulty of test under the ground condition. Conventional methods are FMECA, FTA, ETA and miscellaneous. These are not enough to assess chronological anomaly and there is a problem to share information during R&D. A new method of risk and reliability assessment, T-TRAP (Time-tagged Risk/Reliability Assessment Program) is proposed as a management tool for the development and operation of space system. T-TRAP consisting of time-resolved Fault Tree and Criticality Analyses, upon occurrence of anomaly in the system, facilitates the responsible personnel to quickly identify the failure cause and decide corrective actions. This paper describes T-TRAP method and its availability.

Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) Tutorial

DOE Office of Scientific and Technical Information (OSTI.GOV)

C. L. Smith; S. T. Beck; S. T. Wood

2008-08-01

The Systems Analysis Programs for Hands-on Integrated Reliability Evaluations (SAPHIRE) refers to a set of computer programs that were developed to create and analyze probabilistic risk assessment (PRAs). This volume is the tutorial manual for the SAPHIRE system. In this document, a series of lessons are provided that guide the user through basic steps common to most analyses preformed with SAPHIRE. The tutorial is divided into two major sections covering both basic and advanced features. The section covering basic topics contains lessons that lead the reader through development of a probabilistic hypothetical problem involving a vehicle accident, highlighting the program’smore » most fundamental features. The advanced features section contains additional lessons that expand on fundamental analysis features of SAPHIRE and provide insights into more complex analysis techniques. Together, these two elements provide an overview into the operation and capabilities of the SAPHIRE software.« less

Durability evaluation of ceramic components using CARES/LIFE

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Powers, Lynn M.; Janosik, Lesley A.; Gyekenyesi, John P.

1994-01-01

The computer program CARES/LIFE calculates the time-dependent reliability of monolithic ceramic components subjected to thermomechanical and/or proof test loading. This program is an extension of the CARES (Ceramics Analysis and Reliability Evaluation of Structures) computer program. CARES/LIFE accounts for the phenomenon of subcritical crack growth (SCG) by utilizing the power law, Paris law, or Walker equation. The two-parameter Weibull cumulative distribution function is used to characterize the variation in component strength. The effects of multiaxial stresses are modeled using either the principle of independent action (PIA), the Weibull normal stress averaging method (NSA), or the Batdorf theory. Inert strength and fatigue parameters are estimated from rupture strength data of naturally flawed specimens loaded in static, dynamic, or cyclic fatigue. Application of this design methodology is demonstrated using experimental data from alumina bar and disk flexure specimens which exhibit SCG when exposed to water.

Durability evaluation of ceramic components using CARES/LIFE

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nemeth, N.N.; Janosik, L.A.; Gyekenyesi, J.P.

1996-01-01

The computer program CARES/LIFE calculates the time-dependent reliability of monolithic ceramic components subjected to thermomechanical and/or proof test loading. This program is an extension of the CARES (Ceramics Analysis and Reliability Evaluation of Structures) computer program. CARES/LIFE accounts for the phenomenon of subcritical crack growth (SCG) by utilizing the power law, Paris law, or Walker equation. The two-parameter Weibull cumulative distribution function is used to characterize the variation in component strength. The effects of multiaxial stresses are modeled using either the principle of independent action (PIA), the Weibull normal stress averaging method (NSA), or the Batdorf theory. Inert strength andmore » fatigue parameters are estimated from rupture strength data of naturally flawed specimens loaded in static, dynamic, or cyclic fatigue. Application of this design methodology is demonstrated using experimental data from alumina bar and disk flexure specimens, which exhibit SCG when exposed to water.« less

The National Aeronautics and Space Administration Nondestructive Evaluation Program for Safe and Reliable Operations

NASA Technical Reports Server (NTRS)

Generazio, Ed

2005-01-01

The National Aeronautics and Space Administration (NASA) Nondestructive Evaluation (NDE) Program is presented. As a result of the loss of seven astronauts and the Space Shuttle Columbia on February 1, 2003, NASA has undergone many changes in its organization. NDE is one of the key areas that are recognized by the Columbia Accident Investigation Board (CAIB) that needed to be strengthened by warranting NDE as a discipline with Independent Technical Authority (iTA). The current NASA NDE system and activities are presented including the latest developments in inspection technologies being applied to the Space Transportation System (STS). The unfolding trends and directions in NDE for the future are discussed as they apply to assuring safe and reliable operations.

Reliability of lower limb alignment measures using an established landmark-based method with a customized computer software program

PubMed Central

Sled, Elizabeth A.; Sheehy, Lisa M.; Felson, David T.; Costigan, Patrick A.; Lam, Miu; Cooke, T. Derek V.

2010-01-01

The objective of the study was to evaluate the reliability of frontal plane lower limb alignment measures using a landmark-based method by (1) comparing inter- and intra-reader reliability between measurements of alignment obtained manually with those using a computer program, and (2) determining inter- and intra-reader reliability of computer-assisted alignment measures from full-limb radiographs. An established method for measuring alignment was used, involving selection of 10 femoral and tibial bone landmarks. 1) To compare manual and computer methods, we used digital images and matching paper copies of five alignment patterns simulating healthy and malaligned limbs drawn using AutoCAD. Seven readers were trained in each system. Paper copies were measured manually and repeat measurements were performed daily for 3 days, followed by a similar routine with the digital images using the computer. 2) To examine the reliability of computer-assisted measures from full-limb radiographs, 100 images (200 limbs) were selected as a random sample from 1,500 full-limb digital radiographs which were part of the Multicenter Osteoarthritis (MOST) Study. Three trained readers used the software program to measure alignment twice from the batch of 100 images, with two or more weeks between batch handling. Manual and computer measures of alignment showed excellent agreement (intraclass correlations [ICCs] 0.977 – 0.999 for computer analysis; 0.820 – 0.995 for manual measures). The computer program applied to full-limb radiographs produced alignment measurements with high inter- and intra-reader reliability (ICCs 0.839 – 0.998). In conclusion, alignment measures using a bone landmark-based approach and a computer program were highly reliable between multiple readers. PMID:19882339

An Evaluation of the Validity and Reliability of a Food Behavior Checklist Modified for Children

ERIC Educational Resources Information Center

Branscum, Paul; Sharma, Manoj; Kaye, Gail; Succop, Paul

2010-01-01

Objective: The objective of this study was to report the construct validity and internal consistency reliability of the Food Behavior Checklist modified for children (FBC-MC), with low-income, Youth Expanded Food and Nutrition Education Program (EFNEP)-eligible children. Methods: Using a cross-sectional research design, construct validity was…

Test-Retest Reliability of the Parent Behavior Importance Questionnaire-Revised and the Parent Behavior Frequency Questionnaire-Revised

ERIC Educational Resources Information Center

Mowder, Barbara A.; Shamah, Renee

2011-01-01

This study evaluated the test-retest reliability of two parenting measures: the Parent Behavior Importance Questionnaire-Revised (PBIQ-R) and Parent Behavior Frequency Questionnaire-Revised (PBFQ-R). These self-report parenting behavior assessment measures may be utilized as pre- and post-parent education program measures, with parents as well as…

NASA Electronic Parts and Packaging Program

NASA Technical Reports Server (NTRS)

Kayali, Sammy

2000-01-01

NEPP program objectives are to: (1) Access the reliability of newly available electronic parts and packaging technologies for usage on NASA projects through validations, assessments, and characterizations, and the development of test methods/tools; (2)Expedite infusion paths for advanced (emerging) electronic parts and packaging technologies by evaluations of readiness for manufacturability and project usage consideration; (3) Provide NASA projects with technology selection, application, and validation guidelines for electronic parts and packaging hardware and processes; nd (4) Retain and disseminate electronic parts and packaging quality assurance, reliability validations, tools, and availability information to the NASA community.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed

Colantonio, A

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations.

Assessing the effects of employee assistance programs: a review of employee assistance program evaluations.

PubMed Central

Colantonio, A.

1989-01-01

Employee assistance programs have grown at a dramatic rate, yet the effectiveness of these programs has been called into question. The purpose of this paper was to assess the effectiveness of employee assistance programs (EAPs) by reviewing recently published EAP evaluations. All studies evaluating EAPs published since 1975 from peer-reviewed journals in the English language were included in this analysis. Each of the articles was assessed in the following areas: (a) program description (subjects, setting, type of intervention, format), (b) evaluation design (research design, variables measured, operational methods), and (c) program outcomes. Results indicate numerous methodological and conceptual weaknesses and issues. These weaknesses included lack of controlled research designs and short time lags between pre- and post-test measures. Other problems identified are missing information regarding subjects, type of intervention, how variables are measured (operational methods), and reliability and validity of evaluation instruments. Due to the aforementioned weaknesses, positive outcomes could not be supported. Recommendations are made for future EAP evaluations. PMID:2728498

Measures of Success: A Survey of Selected Vocational and Technical Education Programs in Florida which Train Students in Occupations Requiring Licenses.

ERIC Educational Resources Information Center

Florida State Advisory Council on Vocational and Technical Education, Tallahassee.

A study of 13 vocational and technical education programs in Florida was conducted which represented an attempt to identify valid and reliable sources of data whereby some vocational programs might be evaluated in specified terms of effectiveness. The programs selected for study were among those which require graduating students to pass licensing…

A systematic review of evaluated suicide prevention programs targeting indigenous youth.

PubMed

Harlow, Alyssa F; Bohanna, India; Clough, Alan

2014-01-01

Indigenous young people have significantly higher suicide rates than their non-indigenous counterparts. There is a need for culturally appropriate and effective suicide prevention programs for this demographic. This review assesses suicide prevention programs that have been evaluated for indigenous youth in Australia, Canada, New Zealand, and the United States. The databases MEDLINE and PsycINFO were searched for publications on suicide prevention programs targeting indigenous youth that include reports on evaluations and outcomes. Program content, indigenous involvement, evaluation design, program implementation, and outcomes were assessed for each article. The search yielded 229 articles; 90 abstracts were assessed, and 11 articles describing nine programs were reviewed. Two Australian programs and seven American programs were included. Programs were culturally tailored, flexible, and incorporated multiple-levels of prevention. No randomized controlled trials were found, and many programs employed ad hoc evaluations, poor program description, and no process evaluation. Despite culturally appropriate content, the results of the review indicate that more controlled study designs using planned evaluations and valid outcome measures are needed in research on indigenous youth suicide prevention. Such changes may positively influence the future of research on indigenous youth suicide prevention as the outcomes and efficacy will be more reliable.

Measuring stakeholder participation in evaluation: an empirical validation of the Participatory Evaluation Measurement Instrument (PEMI).

PubMed

Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joël

2012-08-01

Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. This study consists of a first empirical validation of a measurement instrument that fully covers the content of participation, namely the Participatory Evaluation Measurement Instrument (PEMI). It specifically examines (1) the intercoder reliability of scores derived by two research assistants on published evaluation cases; (2) the convergence between the scores of coders and those of key respondents (i.e., authors); and (3) the convergence between the authors' scores on the PEMI and the Evaluation Involvement Scale (EIS). A purposive sample of 40 cases drawn from the evaluation literature was used to assess reliability. One author per case in this sample was then invited to participate in a survey; 25 fully usable questionnaires were received. Stakeholder participation was measured on nominal and ordinal scales. Cohen's κ, the intraclass correlation coefficient, and Spearman's ρ were used to assess reliability and convergence. Reliability results ranged from fair to excellent. Convergence between coders' and authors' scores ranged from poor to good. Scores derived from the PEMI and the EIS were moderately associated. Evidence from this study is strong in the case of intercoder reliability and ranges from weak to strong in the case of convergent validation. Globally, this suggests that the PEMI can produce scores that are both reliable and valid.

New International Program to Asses the Reliability of Emerging Nondestructive Techniques (PARENT)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Prokofiev, Iouri; Cumblidge, Stephen E.; Csontos, Aladar A.

2013-01-25

The Nuclear Regulatory Commission (NRC) established the Program to Assess the Reliability of Emerging Nondestructive Techniques (PARENT) to follow on from the successful Program for the Inspection of Nickel alloy Components (PINC). The goal of the PARENT is to conduct a confirmatory assessment of the reliability of nondestructive evaluation (NDE) techniques for detecting and sizing primary water stress corrosion cracks (PWSCC) and applying the lessons learned from PINC to a series of round-robin tests. These open and blind round-robin tests will comprise a new set of typical pressure boundary components including dissimilar metal welds (DMWs) and bottom-mounted instrumentation penetrations. Openmore » round-robin tests will engage research and industry teams worldwide to investigate and demonstrate the reliability of emerging NDE techniques to detect and size flaws with a wide range of lengths, depths, orientations, and locations. Blind round-robin tests will utilize various testing organizations, whose inspectors and procedures are certified by the standards for the nuclear industry in their respective countries, to investigate the ability of established NDE techniques to detect and size flaws whose characteristics range from relatively easy to very difficult for detection and sizing. Blind and open round-robin testing started in late 2011 and early 2012, respectively. This paper will present the work scope with reports on progress, NDE methods evaluated, and project timeline for PARENT.« less

Reliability of questionnaires to assess the healthy eating and activity environment of a child's home and school.

PubMed

Wilson, Annabelle; Magarey, Anthea; Mastersson, Nadia

2013-01-01

Childhood overweight and obesity are a growing concern globally, and environments, including the home and school, can contribute to this epidemic. This paper assesses the reliability of two questionnaires (parent and teacher) used in the evaluation of a community-based childhood obesity prevention intervention, the eat well be active (ewba) Community Programs. Parents and teachers were recruited from two primary schools and they completed the same questionnaire twice in 2008 and 2009. Data from both questionnaires were classified into outcomes relevant to healthy eating and activity, and target outcomes, based on the goals of the ewba Community Programs, were identified. Fourteen and 12 outcomes were developed from the parent and teacher questionnaires, respectively. Sixty parents and 28 teachers participated in the reliability study. Intraclass correlation coefficients for outcomes ranged from 0.37 to 0.92 (parent) (P < 0.05) and from 0.42 to 0.86 (teacher) (P < 0.05). Internal consistency, measured by Cronbach's alpha, of teacher scores ranged from 0.11 to 0.91 and 0.13 to 0.78 for scores from the parent questionnaire. The parent and teacher questionnaires are moderately reliable tools for simultaneously assessing child intakes, environments, attitudes, and knowledge associated with healthy eating and physical activity in the home and school and may be useful for evaluation of similar programs.

Psychometric Characteristics of Process Evaluation Measures for a Rural School-based Childhood Obesity Prevention Study: Louisiana Health

PubMed Central

Newton, R. L.; Thomson, J. L.; Rau, K.; Duhe’, S.; Sample, A.; Singleton, N.; Anton, S. D.; Webber, L. S.; Williamson, D. A.

2011-01-01

Purpose To evaluate the implementation of intervention components of the Louisiana Health study, which was a multi-component childhood obesity prevention program conducted in rural schools. Design Content analysis. Setting Process evaluation assessed implementation in the classrooms, gym classes, and cafeterias. Subjects Classroom teachers (n = 232), physical education teachers (n = 53), food service managers (n = 33), and trained observers (n = 9). Measures Five process evaluation measures were created: Physical Education Questionnaire (PEQ), Intervention Questionnaire (IQ), Food Service Manager Questionnaire (FSMQ), Classroom Observation (CO) and School Nutrition Environment Observation (SNEO). Analysis Inter-rater reliability and internal consistency were conducted on all measures. ANOVA and Chi-square were used to compare differences across study groups on questionnaires and observations. Results The PEQ and one sub-scale from the FSMQ were eliminated because their reliability coefficients fell below acceptable standards. The sub-scale internal consistencies for the IQ, FSMQ, CO, and SNEO (all Cronbach’s α > .60) were acceptable. Conclusions After the initial 4 months of intervention, there was evidence that the Louisiana Health intervention was being implemented as it was designed. In summary, four process evaluation measures were found to be sufficiently reliable and valid for assessing the delivery of various aspects of a school-based obesity prevention program. These process measures could be modified to evaluate the delivery of other similar school-based interventions. PMID:21721969

Psychometric characteristics of process evaluation measures for a rural school-based childhood obesity prevention study: Louisiana Health.

PubMed

Newton, Robert L; Thomson, Jessica L; Rau, Kristi K; Ragusa, Shelly A; Sample, Alicia D; Singleton, Nakisha N; Anton, Stephen D; Webber, Larry S; Williamson, Donald A

2011-01-01

To evaluate the implementation of intervention components of the Louisiana Health study, which was a multicomponent childhood obesity prevention program conducted in rural schools. Content analysis. Process evaluation assessed implementation in classrooms, gym classes, and cafeterias. Classroom teachers (n  =  232), physical education teachers (n  =  53), food service managers (n  =  33), and trained observers (n  =  9). Five process evaluation measures were created: Physical Education Questionnaire (PEQ), Intervention Questionnaire (IQ), Food Service Manager Questionnaire (FSMQ), Classroom Observation (CO), and School Nutrition Environment Observation (SNEO). Interrater reliability and internal consistency were assessed on all measures. Analysis of variance and χ(2) were used to compare differences across study groups on questionnaires and observations. The PEQ and one subscale from the FSMQ were eliminated because their reliability coefficients fell below acceptable standards. The subscale internal consistencies for the IQ, FSMQ, CO, and SNEO (all Cronbach α > .60) were acceptable. After the initial 4 months of intervention, there was evidence that the Louisiana Health intervention was being implemented as it was designed. In summary, four process evaluation measures were found to be sufficiently reliable and valid for assessing the delivery of various aspects of a school-based obesity prevention program. These process measures could be modified to evaluate the delivery of other similar school-based interventions.

76 FR 4912 - Proposed Information Collection Activity; Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2011-01-27

... reliable evaluation design to produce accurate evidence of the effect of HPOG on individuals and health job training programs systems. The goals of the HPOG evaluation are to establish a performance management... grantee organizations (higher education Institutions, workforce investment boards, private training...

Transit vehicle emissions program.

DOT National Transportation Integrated Search

2013-08-01

The evaluation, selection, and implementation of fuel and powertrain technology choices are critically important to accomplishing : the mission of providing safe, efficient, reliable, environmentally-conscious, and cost-effective public transportatio...

The relationship between faculty performance assessment and results on the in-training examination for residents in an emergency medicine training program.

PubMed

Ryan, James G; Barlas, David; Pollack, Simcha

2013-12-01

Medical knowledge (MK) in residents is commonly assessed by the in-training examination (ITE) and faculty evaluations of resident performance. We assessed the reliability of clinical evaluations of residents by faculty and the relationship between faculty assessments of resident performance and ITE scores. We conducted a cross-sectional, observational study at an academic emergency department with a postgraduate year (PGY)-1 to PGY-3 emergency medicine residency program, comparing summative, quarterly, faculty evaluation data for MK and overall clinical competency (OC) with annual ITE scores, accounting for PGY level. We also assessed the reliability of faculty evaluations using a random effects, intraclass correlation analysis. We analyzed data for 59 emergency medicine residents during a 6-year period. Faculty evaluations of MK and OC were highly reliable (κ  =  0.99) and remained reliable after stratification by year of training (mean κ  =  0.68-0.84). Assessments of resident performance (MK and OC) and the ITE increased with PGY level. The MK and OC results had high correlations with PGY level, and ITE scores correlated moderately with PGY. The OC and MK results had a moderate correlation with ITE score. When residents were grouped by PGY level, there was no significant correlation between MK as assessed by the faculty and the ITE score. Resident clinical performance and ITE scores both increase with resident PGY level, but ITE scores do not predict resident clinical performance compared with peers at their PGY level.

The Relationship Between Faculty Performance Assessment and Results on the In-Training Examination for Residents in an Emergency Medicine Training Program

PubMed Central

Ryan, James G.; Barlas, David; Pollack, Simcha

2013-01-01

Background Medical knowledge (MK) in residents is commonly assessed by the in-training examination (ITE) and faculty evaluations of resident performance. Objective We assessed the reliability of clinical evaluations of residents by faculty and the relationship between faculty assessments of resident performance and ITE scores. Methods We conducted a cross-sectional, observational study at an academic emergency department with a postgraduate year (PGY)-1 to PGY-3 emergency medicine residency program, comparing summative, quarterly, faculty evaluation data for MK and overall clinical competency (OC) with annual ITE scores, accounting for PGY level. We also assessed the reliability of faculty evaluations using a random effects, intraclass correlation analysis. Results We analyzed data for 59 emergency medicine residents during a 6-year period. Faculty evaluations of MK and OC were highly reliable (κ  =  0.99) and remained reliable after stratification by year of training (mean κ  =  0.68–0.84). Assessments of resident performance (MK and OC) and the ITE increased with PGY level. The MK and OC results had high correlations with PGY level, and ITE scores correlated moderately with PGY. The OC and MK results had a moderate correlation with ITE score. When residents were grouped by PGY level, there was no significant correlation between MK as assessed by the faculty and the ITE score. Conclusions Resident clinical performance and ITE scores both increase with resident PGY level, but ITE scores do not predict resident clinical performance compared with peers at their PGY level. PMID:24455005

Implementation of new clinical programs in the VHA healthcare system: the importance of early collaboration between clinical leadership and research.

PubMed

Wu, R Ryanne; Kinsinger, Linda S; Provenzale, Dawn; King, Heather A; Akerly, Patricia; Barnes, Lottie K; Datta, Santanu K; Grubber, Janet M; Katich, Nicholas; McNeil, Rebecca B; Monte, Robert; Sperber, Nina R; Atkins, David; Jackson, George L

2014-12-01

Collaboration between policy, research, and clinical partners is crucial to achieving proven quality care. The Veterans Health Administration has expended great efforts towards fostering such collaborations. Through this, we have learned that an ideal collaboration involves partnership from the very beginning of a new clinical program, so that the program is designed in a way that ensures quality, validity, and puts into place the infrastructure necessary for a reliable evaluation. This paper will give an example of one such project, the Lung Cancer Screening Demonstration Project (LCSDP). We will outline the ways that clinical, policy, and research partners collaborated in design, planning, and implementation in order to create a sustainable model that could be rigorously evaluated for efficacy and fidelity. We will describe the use of the Donabedian quality matrix to determine the necessary characteristics of a quality program and the importance of the linkage with engineering, information technology, and clinical paradigms to connect the development of an on-the-ground clinical program with the evaluation goal of a learning healthcare organization. While the LCSDP is the example given here, these partnerships and suggestions are salient to any healthcare organization seeking to implement new scientifically proven care in a useful and reliable way.

E-Service Quality Evaluation on E-Government Website: Case Study BPJS Kesehatan Indonesia

NASA Astrophysics Data System (ADS)

Rasyid, A.; Alfina, I.

2017-01-01

This research intends to develop a model to evaluate the quality of e-services on e-government. The proposed model consists of seven dimensions: web design, reliability, responsiveness, privacy and security, personalization, information, and ease of use. The model is used to measure the quality of the e-registration of BPJS Kesehatan, an Indonesian government health insurance program. The validation and reliability testing show that of the seven dimensions proposed, only four that suitable for the case study. The result shows that the BPJS Kesehatan e-registration service is good in reliability and responsiveness dimensions, while from web design and ease of use dimensions the e-service still needs to be optimized.

Modeling of unit operating considerations in generating-capacity reliability evaluation. Volume 2. Computer-program documentation. Final report. [GENESIS, OPCON and OPPLAN

DOE Office of Scientific and Technical Information (OSTI.GOV)

Patton, A.D.; Ayoub, A.K.; Singh, C.

1982-07-01

This report describes the structure and operation of prototype computer programs developed for a Monte Carlo simulation model, GENESIS, and for two analytical models, OPCON and OPPLAN. It includes input data requirements and sample test cases.

Psychometric Properties of the School Attitude Assessment Survey-Revised with International Baccalaureate High School Students

ERIC Educational Resources Information Center

Dedrick, Robert F.; Shaunessy-Dedrick, Elizabeth; Suldo, Shannon M.; Ferron, John M.

2015-01-01

In two studies (ns = 312 and 1,149) with 9- to 12-grade students in pre-International Baccalaureate (IB) and IB Diploma programs, we evaluated the reliability, factor structure, measurement invariance, and criterion-related validity of the scores from the School Attitude Assessment Survey-Revised (SAAS-R). Reliabilities of the five SAAS-R subscale…

Investigating the Quality of the School Technology Needs Assessment (STNA) 3.0: A Validity and Reliability Study

ERIC Educational Resources Information Center

Corn, Jenifer O.

2010-01-01

Schools and districts should use a well-designed needs assessment to inform important decisions about a range of technology program areas. Presently, there is a lack of valid and reliable instruments available and accessible to schools to effectively assess their educational needs to better design and evaluate their projects and initiatives. The…

Evaluation of English Language Development Programs in the Santa Ana Unified School District. A Report on Data System Reliability and Statistical Modeling of Program Impacts.

ERIC Educational Resources Information Center

Mitchell, Douglas E.; Destino, Tom; Karam, Rita

In response to concern about the effectiveness of programs for English-as-a-Second-Language students in California's schools, the Santa Ana Unified School District, in which over 80 percent of students are limited-English-proficient (LEP) conducted a study of both the operations and effectiveness of the district's language development program,…

Automatic specification of reliability models for fault-tolerant computers

NASA Technical Reports Server (NTRS)

Liceaga, Carlos A.; Siewiorek, Daniel P.

1993-01-01

The calculation of reliability measures using Markov models is required for life-critical processor-memory-switch structures that have standby redundancy or that are subject to transient or intermittent faults or repair. The task of specifying these models is tedious and prone to human error because of the large number of states and transitions required in any reasonable system. Therefore, model specification is a major analysis bottleneck, and model verification is a major validation problem. The general unfamiliarity of computer architects with Markov modeling techniques further increases the necessity of automating the model specification. Automation requires a general system description language (SDL). For practicality, this SDL should also provide a high level of abstraction and be easy to learn and use. The first attempt to define and implement an SDL with those characteristics is presented. A program named Automated Reliability Modeling (ARM) was constructed as a research vehicle. The ARM program uses a graphical interface as its SDL, and it outputs a Markov reliability model specification formulated for direct use by programs that generate and evaluate the model.

[Evaluation of patient satisfaction after stroke rehabilitation program. Validation study for the Spanish version of the Satisfaction Pound Scale].

PubMed

Aguirrezabal Juaristi, Aizpea; Ferrer Fores, Montse; Marco Navarro, Ester; Mojal García, Sergi; Vilagut Saiz, Gemma; Duarte Oller, Esther

2016-11-18

The Satisfaction Pound Scale is a specific questionnaire to evaluate satisfaction with the rehabilitation program after a stroke. The aim of this study was to adapt this scale to Spanish and to evaluate its metric characteristics. The adaptation included translation and back-translation methods. Metric characteristics were evaluated in 74 patients, all of whom were administered the Satisfaction Pound Scale and the Short Form 36 (SF-36). The statistical model was tested by confirmatory factor analysis (CFA). Reliability was determined through Cronbach alpha coefficient and a test-retest procedure. Construct validity was assessed by means of correlations between the satisfaction scale and the SF-36. Adjustment indicators in the CFA were very good. Reproducibility test showed correlations higher than 0.85, and all correlations between SF-36 dimensions and the satisfaction scale were lower than 0.2, in accordance with the hypotheses raised. The Spanish version of the Satisfaction Pounds Scale is reliable and valid, therefore it is a useful tool to assess satisfaction with the post-stroke rehabilitation program in our area. Copyright © 2016 Elsevier España, S.L.U. All rights reserved.

Numeric data distribution: The vital role of data exchange in today's world

NASA Technical Reports Server (NTRS)

Chase, Malcolm W.

1994-01-01

The major aim of the NIST standard Reference Data Program (SRD) is to provide critically evaluated numeric data to the scientific and technical community in a convenient and accessible form. A second aim of the program is to provide feedback into the experimental and theoretical programs to help raise the general standards of measurement. By communicating the experience gained in evaluating the world output of data in the physical sciences, NIST/SRD helps to advance the level of experimental techniques and improve the reliability of physical measurements.

Reliability of risk assessment measures used in sexually violent predator proceedings.

PubMed

Miller, Cailey S; Kimonis, Eva R; Otto, Randy K; Kline, Suzonne M; Wasserman, Adam L

2012-12-01

The field interrater reliability of three assessment tools frequently used by mental health professionals when evaluating sex offenders' risk for reoffending--the Psychopathy Checklist-Revised (PCL-R), the Minnesota Sex Offender Screening Tool-Revised (MnSOST-R) and the Static-99-was examined within the context of sexually violent predator program proceedings. Rater agreement was highest for the Static--99 (intraclass correlation coefficient [ICC₁] = .78) and lowest for the PCL-R (ICC₁ = .60; MnSOST-R ICC₁ = .74), although all instruments demonstrated lower field reliability than that reported in their test manuals. Findings raise concerns about the reliability of risk assessment tools that are used to inform judgments of risk in high-stake sexually violent predator proceedings. Implications for future research and suggestions for improving evaluator training to increase accuracy when informing legal decision making are discussed.

The development and validation of The Inquiry Science Observation Coding Sheet.

PubMed

Brandon, P R; Taum, A K H; Young, D B; Pottenger, F M

2008-08-01

Evaluation reports increasingly document the degree of program implementation, particularly the extent to which programs adhere to prescribed steps and procedures. Many reports are cursory, however, and few, if any, fully portray the long and winding path taken when developing evaluation instruments, particularly observation instruments. In this article, we describe the development of an observational method for evaluating the degree to which K-12 inquiry science programs are implemented, including the many steps and decisions that occurred during the development, and present evidence for the reliability and validity of the data that we collected with the instrument. The article introduces a method for measuring the adherence of inquiry science implementation and gives evaluators a full picture of what they might expect when developing observation instruments for assessing the degree of program implementation.

Do in-training evaluation reports deserve their bad reputations? A study of the reliability and predictive ability of ITER scores and narrative comments.

PubMed

Ginsburg, Shiphra; Eva, Kevin; Regehr, Glenn

2013-10-01

Although scores on in-training evaluation reports (ITERs) are often criticized for poor reliability and validity, ITER comments may yield valuable information. The authors assessed across-rotation reliability of ITER scores in one internal medicine program, ability of ITER scores and comments to predict postgraduate year three (PGY3) performance, and reliability and incremental predictive validity of attendings' analysis of written comments. Numeric and narrative data from the first two years of ITERs for one cohort of residents at the University of Toronto Faculty of Medicine (2009-2011) were assessed for reliability and predictive validity of third-year performance. Twenty-four faculty attendings rank-ordered comments (without scores) such that each resident was ranked by three faculty. Mean ITER scores and comment rankings were submitted to regression analyses; dependent variables were PGY3 ITER scores and program directors' rankings. Reliabilities of ITER scores across nine rotations for 63 residents were 0.53 for both postgraduate year one (PGY1) and postgraduate year two (PGY2). Interrater reliabilities across three attendings' rankings were 0.83 for PGY1 and 0.79 for PGY2. There were strong correlations between ITER scores and comments within each year (0.72 and 0.70). Regressions revealed that PGY1 and PGY2 ITER scores collectively explained 25% of variance in PGY3 scores and 46% of variance in PGY3 rankings. Comment rankings did not improve predictions. ITER scores across multiple rotations showed decent reliability and predictive validity. Comment ranks did not add to the predictive ability, but correlation analyses suggest that trainee performance can be measured through these comments.

Forward Skirt Structural Testing on the Space Launch System (SLS) Program

NASA Technical Reports Server (NTRS)

Lohrer, J. D.; Wright, R. D.

2016-01-01

Structural testing was performed to evaluate heritage forward skirts from the Space Shuttle program for use on the NASA Space Launch System (SLS) program. Testing was needed because SLS ascent loads are 35% higher than Space Shuttle loads. Objectives of testing were to determine margins of safety, demonstrate reliability, and validate analytical models. Testing combined with analysis was able to show heritage forward skirts were acceptable to use on the SLS program.

Advanced flight control system study

NASA Technical Reports Server (NTRS)

Mcgough, J.; Moses, K.; Klafin, J. F.

1982-01-01

The architecture, requirements, and system elements of an ultrareliable, advanced flight control system are described. The basic criteria are functional reliability of 10 to the minus 10 power/hour of flight and only 6 month scheduled maintenance. A distributed system architecture is described, including a multiplexed communication system, reliable bus controller, the use of skewed sensor arrays, and actuator interfaces. Test bed and flight evaluation program are proposed.

Designing a Measurement Framework for Response to Intervention in Early Childhood Programs

ERIC Educational Resources Information Center

McConnell, Scott R.; Wackerle-Hollman, Alisha K.; Roloff, Tracy A.; Rodriguez, Michael

2014-01-01

The overall architecture and major components of a measurement system designed and evaluated to support Response to Intervention (RTI) in the areas of language and literacy in early childhood programs are described. Efficient and reliable measurement is essential for implementing any viable RTI system, and implementing such a system in early…

National 4-H Common Measures: Initial Evaluation from California 4-H

ERIC Educational Resources Information Center

Lewis, Kendra M.; Horrillo, Shannon J.; Widaman, Keith; Worker, Steven M.; Trzesniewski, Kali

2015-01-01

Evaluation is a key component to learning about the effectiveness of a program. This article provides descriptive statistics of the newly developed National 4-H Common Measures (science, healthy living, citizenship, and youth development) based on data from 721 California 4-H youth. The measures were evaluated for their reliability and validity of…

Quality management for space systems in ISRO

NASA Astrophysics Data System (ADS)

Satish, S.; Selva Raju, S.; Nanjunda Swamy, T. S.; Kulkarni, P. L.

2009-11-01

In a little over four decades, the Indian Space Program has carved a niche for itself with the unique application driven program oriented towards National development. The end-to-end capability approach of the space projects in the country call for innovative practices and procedures in assuring the quality and reliability of space systems. The System Reliability (SR) efforts initiated at the start of the projects continue during the entire life cycle of the project encompassing design, development, realisation, assembly, testing and integration and during launch. Even after the launch, SR groups participate in the on-orbit evaluation of transponders in communication satellites and camera systems in remote sensing satellites. SR groups play a major role in identification, evaluation and inculcating quality practices in work centres involved in the fabrication of mechanical, electronics and propulsion systems required for Indian Space Research Organization's (ISRO's) launch vehicle and spacecraft projects. Also the reliability analysis activities like prediction, assessment and demonstration as well as de-rating analysis, Failure Mode Effects and Criticality Analysis (FMECA) and worst-case analysis are carried out by SR groups during various stages of project realisation. These activities provide the basis for project management to take appropriate techno-managerial decisions to ensure that the required reliability goals are met. Extensive test facilities catering to the needs of the space program has been set up. A system for consolidating the experience and expertise gained for issue of standards called product assurance specifications to be used in all ISRO centres has also been established.

Surface flaw reliability analysis of ceramic components with the SCARE finite element postprocessor program

NASA Technical Reports Server (NTRS)

Gyekenyesi, John P.; Nemeth, Noel N.

1987-01-01

The SCARE (Structural Ceramics Analysis and Reliability Evaluation) computer program on statistical fast fracture reliability analysis with quadratic elements for volume distributed imperfections is enhanced to include the use of linear finite elements and the capability of designing against concurrent surface flaw induced ceramic component failure. The SCARE code is presently coupled as a postprocessor to the MSC/NASTRAN general purpose, finite element analysis program. The improved version now includes the Weibull and Batdorf statistical failure theories for both surface and volume flaw based reliability analysis. The program uses the two-parameter Weibull fracture strength cumulative failure probability distribution model with the principle of independent action for poly-axial stress states, and Batdorf's shear-sensitive as well as shear-insensitive statistical theories. The shear-sensitive surface crack configurations include the Griffith crack and Griffith notch geometries, using the total critical coplanar strain energy release rate criterion to predict mixed-mode fracture. Weibull material parameters based on both surface and volume flaw induced fracture can also be calculated from modulus of rupture bar tests, using the least squares method with known specimen geometry and grouped fracture data. The statistical fast fracture theories for surface flaw induced failure, along with selected input and output formats and options, are summarized. An example problem to demonstrate various features of the program is included.

TECHNOLOGY EVALUATION REPORT: BIOTROL SOIL WASHING SYSTEM FOR TREATMENT OF A WOOD PRESERVING SITE - VOLUME II

EPA Science Inventory

The SITE Program demonstration of one configuration of the BioTrol Soil Washing System (BSWS) was conducted to obtain reliable performance and cost data that can be used to evaluate the potential applicability of the technology as a remediation alternative for sites contaminated ...

Instruments and Scoring Guide of the Experiential Education Evaluation Project.

ERIC Educational Resources Information Center

Conrad, Dan; Hedin, Diane

As a result of the Experiential Education Evaluation Project the publication identifies instruments used to measure and assess experiential learning programs. The following information is given for each instrument: rationale for its inclusion in the study; precise issues or outcomes designed to measure, validity and reliability data; and…

Object-Oriented Algorithm For Evaluation Of Fault Trees

NASA Technical Reports Server (NTRS)

Patterson-Hine, F. A.; Koen, B. V.

1992-01-01

Algorithm for direct evaluation of fault trees incorporates techniques of object-oriented programming. Reduces number of calls needed to solve trees with repeated events. Provides significantly improved software environment for such computations as quantitative analyses of safety and reliability of complicated systems of equipment (e.g., spacecraft or factories).

Building model analysis applications with the Joint Universal Parameter IdenTification and Evaluation of Reliability (JUPITER) API

USGS Publications Warehouse

Banta, E.R.; Hill, M.C.; Poeter, E.; Doherty, J.E.; Babendreier, J.

2008-01-01

The open-source, public domain JUPITER (Joint Universal Parameter IdenTification and Evaluation of Reliability) API (Application Programming Interface) provides conventions and Fortran-90 modules to develop applications (computer programs) for analyzing process models. The input and output conventions allow application users to access various applications and the analysis methods they embody with a minimum of time and effort. Process models simulate, for example, physical, chemical, and (or) biological systems of interest using phenomenological, theoretical, or heuristic approaches. The types of model analyses supported by the JUPITER API include, but are not limited to, sensitivity analysis, data needs assessment, calibration, uncertainty analysis, model discrimination, and optimization. The advantages provided by the JUPITER API for users and programmers allow for rapid programming and testing of new ideas. Application-specific coding can be in languages other than the Fortran-90 of the API. This article briefly describes the capabilities and utility of the JUPITER API, lists existing applications, and uses UCODE_2005 as an example.

Valid and reliable authentic assessment of culminating student performance in the biomedical sciences.

PubMed

Oh, Deborah M; Kim, Joshua M; Garcia, Raymond E; Krilowicz, Beverly L

2005-06-01

There is increasing pressure, both from institutions central to the national scientific mission and from regional and national accrediting agencies, on natural sciences faculty to move beyond course examinations as measures of student performance and to instead develop and use reliable and valid authentic assessment measures for both individual courses and for degree-granting programs. We report here on a capstone course developed by two natural sciences departments, Biological Sciences and Chemistry/Biochemistry, which engages students in an important culminating experience, requiring synthesis of skills and knowledge developed throughout the program while providing the departments with important assessment information for use in program improvement. The student work products produced in the course, a written grant proposal, and an oral summary of the proposal, provide a rich source of data regarding student performance on an authentic assessment task. The validity and reliability of the instruments and the resulting student performance data were demonstrated by collaborative review by content experts and a variety of statistical measures of interrater reliability, including percentage agreement, intraclass correlations, and generalizability coefficients. The high interrater reliability reported when the assessment instruments were used for the first time by a group of external evaluators suggests that the assessment process and instruments reported here will be easily adopted by other natural science faculty.

Reliability of nine programs of topological predictions and their application to integral membrane channel and carrier proteins.

PubMed

Reddy, Abhinay; Cho, Jaehoon; Ling, Sam; Reddy, Vamsee; Shlykov, Maksim; Saier, Milton H

2014-01-01

We evaluated topological predictions for nine different programs, HMMTOP, TMHMM, SVMTOP, DAS, SOSUI, TOPCONS, PHOBIUS, MEMSAT-SVM (hereinafter referred to as MEMSAT), and SPOCTOPUS. These programs were first evaluated using four large topologically well-defined families of secondary transporters, and the three best programs were further evaluated using topologically more diverse families of channels and carriers. In the initial studies, the order of accuracy was: SPOCTOPUS > MEMSAT > HMMTOP > TOPCONS > PHOBIUS > TMHMM > SVMTOP > DAS > SOSUI. Some families, such as the Sugar Porter Family (2.A.1.1) of the Major Facilitator Superfamily (MFS; TC #2.A.1) and the Amino Acid/Polyamine/Organocation (APC) Family (TC #2.A.3), were correctly predicted with high accuracy while others, such as the Mitochondrial Carrier (MC) (TC #2.A.29) and the K(+) transporter (Trk) families (TC #2.A.38), were predicted with much lower accuracy. For small, topologically homogeneous families, SPOCTOPUS and MEMSAT were generally most reliable, while with large, more diverse superfamilies, HMMTOP often proved to have the greatest prediction accuracy. We next developed a novel program, TM-STATS, that tabulates HMMTOP, SPOCTOPUS or MEMSAT-based topological predictions for any subdivision (class, subclass, superfamily, family, subfamily, or any combination of these) of the Transporter Classification Database (TCDB; www.tcdb.org) and examined the following subclasses: α-type channel proteins (TC subclasses 1.A and 1.E), secreted pore-forming toxins (TC subclass 1.C) and secondary carriers (subclass 2.A). Histograms were generated for each of these subclasses, and the results were analyzed according to subclass, family and protein. The results provide an update of topological predictions for integral membrane transport proteins as well as guides for the development of more reliable topological prediction programs, taking family-specific characteristics into account. © 2014 S. Karger AG, Basel.

A rater training protocol to assess team performance.

PubMed

Eppich, Walter; Nannicelli, Anna P; Seivert, Nicholas P; Sohn, Min-Woong; Rozenfeld, Ranna; Woods, Donna M; Holl, Jane L

2015-01-01

Simulation-based methodologies are increasingly used to assess teamwork and communication skills and provide team training. Formative feedback regarding team performance is an essential component. While effective use of simulation for assessment or training requires accurate rating of team performance, examples of rater-training programs in health care are scarce. We describe our rater training program and report interrater reliability during phases of training and independent rating. We selected an assessment tool shown to yield valid and reliable results and developed a rater training protocol with an accompanying rater training handbook. The rater training program was modeled after previously described high-stakes assessments in the setting of 3 facilitated training sessions. Adjacent agreement was used to measure interrater reliability between raters. Nine raters with a background in health care and/or patient safety evaluated team performance of 42 in-situ simulations using post-hoc video review. Adjacent agreement increased from the second training session (83.6%) to the third training session (85.6%) when evaluating the same video segments. Adjacent agreement for the rating of overall team performance was 78.3%, which was added for the third training session. Adjacent agreement was 97% 4 weeks posttraining and 90.6% at the end of independent rating of all simulation videos. Rater training is an important element in team performance assessment, and providing examples of rater training programs is essential. Articulating key rating anchors promotes adequate interrater reliability. In addition, using adjacent agreement as a measure allows differentiation between high- and low-performing teams on video review. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Analysis of linear measurements on 3D surface models using CBCT data segmentation obtained by automatic standard pre-set thresholds in two segmentation software programs: an in vitro study.

PubMed

Poleti, Marcelo Lupion; Fernandes, Thais Maria Freire; Pagin, Otávio; Moretti, Marcela Rodrigues; Rubira-Bullen, Izabel Regina Fischer

2016-01-01

The aim of this in vitro study was to evaluate the reliability and accuracy of linear measurements on three-dimensional (3D) surface models obtained by standard pre-set thresholds in two segmentation software programs. Ten mandibles with 17 silica markers were scanned for 0.3-mm voxels in the i-CAT Classic (Imaging Sciences International, Hatfield, PA, USA). Twenty linear measurements were carried out by two observers two times on the 3D surface models: the Dolphin Imaging 11.5 (Dolphin Imaging & Management Solutions, Chatsworth, CA, USA), using two filters(Translucent and Solid-1), and in the InVesalius 3.0.0 (Centre for Information Technology Renato Archer, Campinas, SP, Brazil). The physical measurements were made by another observer two times using a digital caliper on the dry mandibles. Excellent intra- and inter-observer reliability for the markers, physical measurements, and 3D surface models were found (intra-class correlation coefficient (ICC) and Pearson's r ≥ 0.91). The linear measurements on 3D surface models by Dolphin and InVesalius software programs were accurate (Dolphin Solid-1 > InVesalius > Dolphin Translucent). The highest absolute and percentage errors were obtained for the variable R1-R1 (1.37 mm) and MF-AC (2.53 %) in the Dolphin Translucent and InVesalius software, respectively. Linear measurements on 3D surface models obtained by standard pre-set thresholds in the Dolphin and InVesalius software programs are reliable and accurate compared with physical measurements. Studies that evaluate the reliability and accuracy of the 3D models are necessary to ensure error predictability and to establish diagnosis, treatment plan, and prognosis in a more realistic way.

Design of ceramic components with the NASA/CARES computer program

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Manderscheid, Jane M.; Gyekenyesi, John P.

1990-01-01

The ceramics analysis and reliability evaluation of structures (CARES) computer program is described. The primary function of the code is to calculate the fast-fracture reliability or failure probability of macro-scopically isotropic ceramic components. These components may be subjected to complex thermomechanical loadings, such as those found in heat engine applications. CARES uses results from MSC/NASTRAN or ANSYS finite-element analysis programs to evaluate how inherent surface and/or volume type flaws component reliability. CARES utilizes the Batdorf model and the two-parameter Weibull cumulative distribution function to describe the effects of multiaxial stress states on material strength. The principle of independent action (PIA) and the Weibull normal stress averaging models are also included. Weibull material strength parameters, the Batdorf crack density coefficient, and other related statistical quantities are estimated from four-point bend bar or uniform uniaxial tensile specimen fracture strength data. Parameter estimation can be performed for a single or multiple failure modes by using a least-squares analysis or a maximum likelihood method. Kolmogorov-Smirnov and Anderson-Darling goodness-to-fit-tests, 90 percent confidence intervals on the Weibull parameters, and Kanofsky-Srinivasan 90 percent confidence band values are also provided. Examples are provided to illustrate the various features of CARES.

Evaluation of rail test frequencies using risk analysis

DOT National Transportation Integrated Search

2009-03-03

Several industries now use risk analysis to develop : inspection programs to ensure acceptable mechanical integrity : and reliability. These industries include nuclear and electric : power generation, oil refining, gas processing, onshore and : offsh...

78 FR 70577 - Agency Information Collection Activities; Proposed Collection, Comments Requested, New Collection...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-11-26

... Program the ability to conduct pretests which evaluate the validity and reliability of information... the proposed collection of information, including the validity of the methodology and assumptions used...

Program For Evaluation Of Reliability Of Ceramic Parts

NASA Technical Reports Server (NTRS)

Nemeth, N.; Janosik, L. A.; Gyekenyesi, J. P.; Powers, Lynn M.

1996-01-01

CARES/LIFE predicts probability of failure of monolithic ceramic component as function of service time. Assesses risk that component fractures prematurely as result of subcritical crack growth (SCG). Effect of proof testing of components prior to service also considered. Coupled to such commercially available finite-element programs as ANSYS, ABAQUS, MARC, MSC/NASTRAN, and COSMOS/M. Also retains all capabilities of previous CARES code, which includes estimation of fast-fracture component reliability and Weibull parameters from inert strength (without SCG contributing to failure) specimen data. Estimates parameters that characterize SCG from specimen data as well. Written in ANSI FORTRAN 77 to be machine-independent. Program runs on any computer in which sufficient addressable memory (at least 8MB) and FORTRAN 77 compiler available. For IBM-compatible personal computer with minimum 640K memory, limited program available (CARES/PC, COSMIC number LEW-15248).

NASA trend analysis procedures

NASA Technical Reports Server (NTRS)

1993-01-01

This publication is primarily intended for use by NASA personnel engaged in managing or implementing trend analysis programs. 'Trend analysis' refers to the observation of current activity in the context of the past in order to infer the expected level of future activity. NASA trend analysis was divided into 5 categories: problem, performance, supportability, programmatic, and reliability. Problem trend analysis uncovers multiple occurrences of historical hardware or software problems or failures in order to focus future corrective action. Performance trend analysis observes changing levels of real-time or historical flight vehicle performance parameters such as temperatures, pressures, and flow rates as compared to specification or 'safe' limits. Supportability trend analysis assesses the adequacy of the spaceflight logistics system; example indicators are repair-turn-around time and parts stockage levels. Programmatic trend analysis uses quantitative indicators to evaluate the 'health' of NASA programs of all types. Finally, reliability trend analysis attempts to evaluate the growth of system reliability based on a decreasing rate of occurrence of hardware problems over time. Procedures for conducting all five types of trend analysis are provided in this publication, prepared through the joint efforts of the NASA Trend Analysis Working Group.

Reliability design and verification for launch-vehicle propulsion systems - Report of an AIAA Workshop, Washington, DC, May 16, 17, 1989

NASA Astrophysics Data System (ADS)

Launch vehicle propulsion system reliability considerations during the design and verification processes are discussed. The tools available for predicting and minimizing anomalies or failure modes are described and objectives for validating advanced launch system propulsion reliability are listed. Methods for ensuring vehicle/propulsion system interface reliability are examined and improvements in the propulsion system development process are suggested to improve reliability in launch operations. Also, possible approaches to streamline the specification and procurement process are given. It is suggested that government and industry should define reliability program requirements and manage production and operations activities in a manner that provides control over reliability drivers. Also, it is recommended that sufficient funds should be invested in design, development, test, and evaluation processes to ensure that reliability is not inappropriately subordinated to other management considerations.

Materials development and evaluation for the ceramic helical expander

DOE Office of Scientific and Technical Information (OSTI.GOV)

Landingham, R.L.; Taylor, R.W.

The supporting role of the materials program for the ceramic helical expander program is described. The materials problems for this rotory expander in an extremely severe environment-a direct coal-fired Brayton topping cycle is defined. Readily available materials and methods for possible solution to these material problems as well as initiating some longer-range studies to improve reliability were evaluated. A preliminary screening of materials in hot coal-fired environments to select candidate materials and coating was made. More detailed evaluations of these candidate materials-reaction-bonded silicon nitride (RBSN) and Si--Al--O--N (Sialon) system- and coatings-chemical-vapor-deposited silicon nitride (CVD-Si/sub 3/N/sub 4/) and CVD-Sialon need tomore » be performed. Termination of the helical expander program abruptly stopped the materials program during this evaluation.« less

Materials development and evaluation for the ceramic helical expander

DOE Office of Scientific and Technical Information (OSTI.GOV)

Landingham, R.L.; Taylor, R.W.

The supporting role of the materials program for the ceramic helical expander program is described. The materials problems for this rotory expander in an extremely severe environment - a direct coal-fired Brayton topping cycle is defined. Readily available materials and methods are evaluated for possible solution to these material problems as well as initiating some longer-range studies to improve reliability. A preliminary screening of materials in hot coal-fired environments to select candidate materials and coating, was made, but there is a need to perform more detailed evaluations of these candidate materials-reaction-bonded silicon nitride (RBSN) and Si--Al--O--N (Sialon) system- and coatings-chemical-vapor-depositedmore » silicon nitride (CVD-Si/sub 3/N/sub 4/) and CVD-Sialon. Termination of the helical expander program abruptly stopped the materials program during this evaluation.« less

Curriculum-Based Measurement of Oral Reading: Multi-Study Evaluation of Schedule, Duration, and Dataset Quality on Progress Monitoring Outcomes

ERIC Educational Resources Information Center

Christ, Theodore J.; Zopluoglu, Cengiz; Monaghen, Barbara D.; Van Norman, Ethan R.

2013-01-01

Curriculum-Based Measurement of Oral Reading (CBM-R) is used to collect time series data, estimate the rate of student achievement, and evaluate program effectiveness. A series of 5 studies were carried out to evaluate the validity, reliability, precision, and diagnostic accuracy of progress monitoring across a variety of progress monitoring…

Design Development Test and Evaluation (DDT and E) Considerations for Safe and Reliable Human Rated Spacecraft Systems

NASA Technical Reports Server (NTRS)

Miller, James; Leggett, Jay; Kramer-White, Julie

2008-01-01

A team directed by the NASA Engineering and Safety Center (NESC) collected methodologies for how best to develop safe and reliable human rated systems and how to identify the drivers that provide the basis for assessing safety and reliability. The team also identified techniques, methodologies, and best practices to assure that NASA can develop safe and reliable human rated systems. The results are drawn from a wide variety of resources, from experts involved with the space program since its inception to the best-practices espoused in contemporary engineering doctrine. This report focuses on safety and reliability considerations and does not duplicate or update any existing references. Neither does it intend to replace existing standards and policy.

CARES/Life Ceramics Durability Evaluation Software Used for Mars Microprobe Aeroshell

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.

1998-01-01

The CARES/Life computer program, which was developed at the NASA Lewis Research Center, predicts the probability of a monolithic ceramic component's failure as a function of time in service. The program has many features and options for materials evaluation and component design. It couples commercial finite element programs-which resolve a component's temperature and stress distribution-to-reliability evaluation and fracture mechanics routines for modeling strength-limiting defects. These routines are based on calculations of the probabilistic nature of the brittle material's strength. The capability, flexibility, and uniqueness of CARES/Life has attracted many users representing a broad range of interests and has resulted in numerous awards for technological achievements and technology transfer.

Assessing impact of physical activity-based youth development programs: validation of the Life Skills Transfer Survey (LSTS).

PubMed

Weiss, Maureen R; Bolter, Nicole D; Kipp, Lindsay E

2014-09-01

A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of life skills transfer would enable evaluation of PYD programs in successfully teaching skills that youth report using in other domains. The purpose of our studies was to develop and validate a measure of perceived life skills transfer, based on data collected with The First Tee, a physical activity-based PYD program. In 3 studies, we conducted a series of steps to provide content and construct validity and internal consistency reliability for the Life Skills Transfer Survey (LSTS), a measure of perceived life skills transfer. Study 1 provided content validity for the LSTS that included 8 life skills and 50 items. Study 2 revealed construct validity (structural validity) through a confirmatory factor analysis and convergent validity by correlating scores on the LSTS with scores on an assessment tool that measures a related construct. Study 3 offered additional construct validity by reassessing youth 1 year later and showing that scores during both time periods were invariant in factor pattern, loadings, and variances and covariances. Studies 2 and 3 demonstrated internal consistency reliability of the LSTS. RESULTS from 3 studies provide evidence of content and construct validity and internal consistency reliability for the LSTS, which can be used in evaluation research with youth development programs.

VET Program Completion Rates: An Evaluation of the Current Method. Occasional Paper

ERIC Educational Resources Information Center

National Centre for Vocational Education Research (NCVER), 2016

2016-01-01

This work asks one simple question: "how reliable is the method used by the National Centre for Vocational Education Research (NCVER) to estimate projected rates of VET program completion?" In other words, how well do early projections align with actual completion rates some years later? Completion rates are simple to calculate with a…

Development, validation, and utility of an instrument to assess core competencies in the Leadership Education in Neurodevelopmental and Related Disabilities (LEND) program.

PubMed

Leff, Stephen S; Baum, Katherine T; Bevans, Katherine B; Blum, Nathan J

2015-02-01

To describe the development and psychometric evaluation of the Core Competency Measure (CCM), an instrument designed to assess professional competencies as defined by the Maternal Child Health Bureau (MCHB) and targeted by Leadership Education in Neurodevelopmental and Related Disabilities (LEND) programs. The CCM is a 44-item self-report measure comprised of six subscales to assess clinical, interdisciplinary, family-centered/cultural, community, research, and advocacy/policy competencies. The CCM was developed in an iterative fashion through participatory action research, and then nine cohorts of LEND trainees (N = 144) from 14 different disciplines completed the CCM during the first week of the training program. A 6-factor confirmatory factor analysis model was fit to data from the 44 original items. After three items were removed, the model adequately fit the data (comparative fit indices = .93, root mean error of approximation = .06) with all factor loadings exceeding .55. The measure was determined to be quite reliable as adequate internal consistency and test-retest reliability were found for each subscale. The instrument's construct validity was supported by expected differences in self-rated competencies among fellows representing various disciplines, and the convergent validity was supported by the pattern of inter-correlations between subscale scores. The CCM appears to be a reliable and valid measure of MCHB core competencies for our sample of LEND trainees. It provides an assessment of key training areas addressed by the LEND program. Although the measure was developed within only one LEND Program, with additional research it has the potential to serve as a standardized tool to evaluate the strengths and limitations of MCHB training, both within and between programs.

Implementation of a personnel reliability program as a facilitator of biosafety and biosecurity culture in BSL-3 and BSL-4 laboratories.

PubMed

Higgins, Jacki J; Weaver, Patrick; Fitch, J Patrick; Johnson, Barbara; Pearl, R Marene

2013-06-01

In late 2010, the National Biodefense Analysis and Countermeasures Center (NBACC) implemented a Personnel Reliability Program (PRP) with the goal of enabling active participation by its staff to drive and improve the biosafety and biosecurity culture at the organization. A philosophical keystone for accomplishment of NBACC's scientific mission is simultaneous excellence in operations and outreach. Its personnel reliability program builds on this approach to: (1) enable and support a culture of responsibility based on human performance principles, (2) maintain compliance with regulations, and (3) address the risk associated with the insider threat. Recently, the Code of Federal Regulations (CFR) governing use and possession of biological select agents and toxins (BSAT) was amended to require a pre-access suitability assessment and ongoing evaluation for staff accessing Tier 1 BSAT. These 2 new requirements are in addition to the already required Federal Bureau of Investigation (FBI) Security Risk Assessment (SRA). Two years prior to the release of these guidelines, NBACC developed its PRP to supplement the SRA requirement as a means to empower personnel and foster an operational environment where any and all work with BSAT is conducted in a safe, secure, and reliable manner.

Affordable MMICs for Air Force systems

NASA Astrophysics Data System (ADS)

Kemerley, Robert T.; Fayette, Daniel F.

1991-05-01

The paper deals with a program directed at demonstrating affordable MMIC chips - the microwave/mm-wave monolithic integrated circuit (MIMIC) program. Focus is placed on experiments involving the growth and characterization of III-V materials, and the design, fabrication, and evaluation of ICs in the 1 to 60 GHz frequency range, as well as efforts related to the reliability testing, failure analysis, and generation of qualified manufacture's list procedures for GaAs MMICs and modules. Attributes associated with GaAs-technology devices, quality, reliability, and performance in select environments are discussed, including the dependence of these structures over temperature ranges, electrostatic discharge sensitivity, and susceptibility to environmental stresses.

Probabilistic simulation of uncertainties in thermal structures

NASA Technical Reports Server (NTRS)

Chamis, Christos C.; Shiao, Michael

1990-01-01

Development of probabilistic structural analysis methods for hot structures is a major activity at Lewis Research Center. It consists of five program elements: (1) probabilistic loads; (2) probabilistic finite element analysis; (3) probabilistic material behavior; (4) assessment of reliability and risk; and (5) probabilistic structural performance evaluation. Recent progress includes: (1) quantification of the effects of uncertainties for several variables on high pressure fuel turbopump (HPFT) blade temperature, pressure, and torque of the Space Shuttle Main Engine (SSME); (2) the evaluation of the cumulative distribution function for various structural response variables based on assumed uncertainties in primitive structural variables; (3) evaluation of the failure probability; (4) reliability and risk-cost assessment, and (5) an outline of an emerging approach for eventual hot structures certification. Collectively, the results demonstrate that the structural durability/reliability of hot structural components can be effectively evaluated in a formal probabilistic framework. In addition, the approach can be readily extended to computationally simulate certification of hot structures for aerospace environments.

Assessment of NDE Reliability Data

NASA Technical Reports Server (NTRS)

Yee, B. G. W.; Chang, F. H.; Couchman, J. C.; Lemon, G. H.; Packman, P. F.

1976-01-01

Twenty sets of relevant Nondestructive Evaluation (NDE) reliability data have been identified, collected, compiled, and categorized. A criterion for the selection of data for statistical analysis considerations has been formulated. A model to grade the quality and validity of the data sets has been developed. Data input formats, which record the pertinent parameters of the defect/specimen and inspection procedures, have been formulated for each NDE method. A comprehensive computer program has been written to calculate the probability of flaw detection at several confidence levels by the binomial distribution. This program also selects the desired data sets for pooling and tests the statistical pooling criteria before calculating the composite detection reliability. Probability of detection curves at 95 and 50 percent confidence levels have been plotted for individual sets of relevant data as well as for several sets of merged data with common sets of NDE parameters.

Comparative Analysis of the Reliability of Steel Structure with Pinned and Rigid Nodes Subjected to Fire

NASA Astrophysics Data System (ADS)

Kubicka, Katarzyna; Radoń, Urszula; Szaniec, Waldemar; Pawlak, Urszula

2017-10-01

The paper concerns the reliability analysis of steel structures subjected to high temperatures of fire gases. Two types of spatial structures were analysed, namely with pinned and rigid nodes. The fire analysis was carried out according to prescriptions of Eurocode. The static-strength analysis was conducted using the finite element method (FEM). The MES3D program, developed by Szaniec (Kielce University of Technology, Poland), was used for this purpose. The results received from MES3D made it possible to carry out the reliability analysis using the Numpress Explore program that was developed at the Institute of Fundamental Technological Research of the Polish Academy of Sciences [9]. The measurement of reliability of structures is the Hasofer-Lind reliability index (β). The reliability analysis was carried out according to approximation (FORM, SORM) and simulation (Importance Sampling, Monte Carlo) methods. As the fire progresses, the value of reliability index decreases. The analysis conducted for the study made it possible to evaluate the impact of node types on those changes. In real structures, it is often difficult to define correctly types of nodes, so some simplifications are made. The presented analysis contributes to the recognition of consequences of such assumptions for the safety of structures, subjected to fire.

Adult Literacy Information and Evaluation System (ALIES): Background, Status and Future Directions.

ERIC Educational Resources Information Center

Cook, Jacqueline; And Others

This document describes the Adult Literacy Information and Evaluation System (ALIES), which is the management information system for New York City's citywide adult education program expansion effort begun in 1984. Chapter 1 describes the organization's creation in order to provide timely and reliable information to funders about the effects of the…

A screening mammography program. Staying alive and making it work.

PubMed

Monsees, B S; Destouet, J M

1992-01-01

The success of a mammography screening program requires thorough planning. A dependably high volume and a streamlined efficient operation are essential to survival of the program. Factors that warrant consideration prior to designing such a program include the following: Distinction between screening and diagnostic mammography examinations. Selection of a site that will meet the needs of the community and yet provide a consistently high volume. Low examination cost for screening mammography coupled with a detailed financial analysis and reappraisal on an ongoing basis. A customized marketing program that incorporates methods to increase awareness, compliance, and utilization by women and referring physicians. Well-trained, efficient, and dedicated personnel. An operation that is designed for rapid throughput and expeditious patient flow. An efficient plan for film handling, interpretation, reporting, and storage. Timely communication of examination results. A reliable mechanism for follow-up evaluation and outcome data collection. Establishment of a consistent and reliable quality assurance program and the production of high quality mammograms.

Evaluating adolescent pregnancy programs: rethinking our priorities.

PubMed

Stahler, G J; DuCette, J P

1991-01-01

Noting that impact evaluations of adolescent pregnancy programs are characterized by poor quality, the authors recommend using a different standard in assessing the value of programs. While the number of adolescent pregnancy programs has multiplied during the last 3 decades, little is known about their impact in ameliorating the negative consequences of too-early childbearing. An ideal evaluation of these programs would randomly select and randomly assign subjects to experimental and control groups. But evaluations conducted by individual program generally face obstacles that limit the randomness of the study. most individual programs lack the financial resources and do not employ the full-time professional evaluators needed to carry out a valid evaluation. These factors result in too short an evaluation period, incomplete and inaccurate data, and lack of randomness in the assignment of control groups. To more accurately assess the impact of the programs, the authors recommend that individual programs focus on process evaluation and collection of complete and reliable data on their clients. From the onset, a program should have a clear description of its content, logic of intervention, and method of implementation. It should maintain thorough records on client characteristics, service utilization, and should conduct long-term follow-ups. For rigorous impact evaluations, programs should rely on 3rd party entities. These independent organizations -- universities or research institutes -- do not have a stake in the outcome of the evaluation, making the study all the more objective. Furthermore, they provide experienced researchers.

Activities of the DOE Nuclear Criticality Safety Program (NCSP) at the Oak Ridge Electron Linear Accelerator (ORELA)

NASA Astrophysics Data System (ADS)

Valentine, Timothy E.; Leal, Luiz C.; Guber, Klaus H.

2002-12-01

The Department of Energy established the Nuclear Criticality Safety Program (NCSP) in response to the Recommendation 97-2 by the Defense Nuclear Facilities Safety Board. The NCSP consists of seven elements of which nuclear data measurements and evaluations is a key component. The intent of the nuclear data activities is to provide high resolution nuclear data measurements that are evaluated, validated, and formatted for use by the nuclear criticality safety community to provide improved and reliable calculations for nuclear criticality safety evaluations. High resolution capture, fission, and transmission measurements are performed at the Oak Ridge Electron Linear Accelerator (ORELA) to address the needs of the criticality safety community and to address known deficiencies in nuclear data evaluations. The activities at ORELA include measurements on both light and heavy nuclei and have been used to identify improvements in measurement techniques that greatly improve the measurement of small capture cross sections. The measurement activities at ORELA provide precise and reliable high-resolution nuclear data for the nuclear criticality safety community.

[Validity and Reliability of the Korean Version Scale of the Clinical Learning Environment, Supervision and Nurse Teacher Evaluation Scale (CLES+T)].

PubMed

Kim, Sun Hee; Yoo, So Yeon; Kim, Yae Young

2018-02-01

This study was conducted to evaluate the validity and reliability of the Korean version of the clinical learning environment, supervision and nurse teacher evaluation scale (CLES+T) that measures the clinical learning environment and the conditions associated with supervision and nurse teachers. The English CLES+T was translated into Korean with forward and back translation. Survey data were collected from 434 nursing students who had more than four days of clinical practice in Korean hospitals. Internal consistency reliability and construct validity using confirmatory and exploratory factor analysis were conducted. SPSS 20.0 and AMOS 22.0 programs were used for data analysis. The exploratory factor analysis revealed seven factors for the thirty three-item scale. Confirmatory factor analysis supported good convergent and discriminant validities. The Cronbach's alpha for the overall scale was .94 and for the seven subscales ranged from .78 to .94. The findings suggest that the 33-items Korean CLES+T is an appropriate instrument to measure Korean nursing students'clinical learning environment with good validity and reliability. © 2018 Korean Society of Nursing Science.

Stirling Powered Van Progam overview

NASA Technical Reports Server (NTRS)

Shaltens, R. K.

1986-01-01

The Stirling Powered Van Program (SPVP) is a multiyear, multiphase program to evaluate the automotive Stirling engine (ASE) in Air Force vans under realistic conditions. The objective of the SPVP is to transfer to manufacturer and end user(s) (i.e., on the path to commercialization) the second-generation Mod 2 ASE upon completion of the Automotive Stirling Engine Program in 1987. In order to meet this objective, the SPVP must establish Stirling performance, integrity, reliability, durability and maintainability. The ASE program background leading to the van program is reviewed and plans for evaluating the kinematic Stirling engine in Air Force vans examined. Also discussed are the NASA technology transfers to industry that have been accomplished and those which are currently being developed.

The Practice of Health Program Evaluation.

PubMed

Lewis, Sarah R

2017-11-01

The Practice of Health Program Evaluation provides an overview of the evaluation process for public health programs while diving deeper to address select advanced concepts and techniques. The book unfolds evaluation as a three-phased process consisting of identification of evaluation questions, data collection and analysis, and dissemination of results and recommendations. The text covers research design, sampling methods, as well as quantitative and qualitative approaches. Types of evaluation are also discussed, including economic assessment and systems research as relative newcomers. Aspects critical to conducting a successful evaluation regardless of type or research design are emphasized, such as stakeholder engagement, validity and reliability, and adoption of sound recommendations. The book encourages evaluators to document their approach by developing an evaluation plan, a data analysis plan, and a dissemination plan, in order to help build consensus throughout the process. The evaluative text offers a good bird's-eye view of the evaluation process, while offering guidance for evaluation experts on how to navigate political waters and advocate for their findings to help affect change.

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

SEASAT economic assessment. Volume 10: The SATIL 2 program (a program for the evaluation of the costs of an operational SEASAT system as a function of operational requirements and reliability. [computer programs for economic analysis and systems analysis of SEASAT satellite systems

NASA Technical Reports Server (NTRS)

1975-01-01

The SATIL 2 computer program was developed to assist with the programmatic evaluation of alternative approaches to establishing and maintaining a specified mix of operational sensors on spacecraft in an operational SEASAT system. The program computes the probability distributions of events (i.e., number of launch attempts, number of spacecraft purchased, etc.), annual recurring cost, and present value of recurring cost. This is accomplished for the specific task of placing a desired mix of sensors in orbit in an optimal fashion in order to satisfy a specified sensor demand function. Flow charts are shown, and printouts of the programs are given.

A flight test of laminar flow control leading-edge systems

NASA Technical Reports Server (NTRS)

Fischer, M. C.; Wright, A. S., Jr.; Wagner, R. D.

1983-01-01

NASA's program for development of a laminar flow technology base for application to commercial transports has made significant progress since its inception in 1976. Current efforts are focused on development of practical reliable systems for the leading-edge region where the most difficult problems in applying laminar flow exist. Practical solutions to these problems will remove many concerns about the ultimate practicality of laminar flow. To address these issues, two contractors performed studies, conducted development tests, and designed and fabricated fully functional leading-edge test articles for installation on the NASA JetStar aircraft. Systems evaluation and performance testing will be conducted to thoroughly evaluate all system capabilities and characteristics. A simulated airline service flight test program will be performed to obtain the operational sensitivity, maintenance, and reliability data needed to establish that practical solutions exist for the difficult leading-edge area of a future commercial transport employing laminar flow control.

Flight testing the Digital Electronic Engine Control (DEEC) A unique management experience

NASA Technical Reports Server (NTRS)

Putnam, T. W.; Burcham, F. W., Jr.; Kock, B. M.

1983-01-01

The concept for the DEEC had its origin in the early 1970s. At that time it was recognized that the F100 engine performance, operability, reliability, and cost could be substantially improved by replacing the original mechanical/supervisory electronic control system with a full-authority digital control system. By 1978, the engine manufacturer had designed and initiated the procurement of flight-qualified control system hardware. As a precursor to an integrated controls program, a flight evaluation of the DEEC system on the F-15 aircraft was proposed. Questions regarding the management of the DEEC flight evaluation program are discussed along with the program elements, the technical results of the F-15 evaluation, and the impact of the flight evaluation on after-burning turbofan controls technology and its use in and application to military aircraft. The lessons learned through the conduct of the program are discussed.

Psychometric Evaluation of the Social Problem-Solving Inventory-Revised among Overweight or Obese Adults

ERIC Educational Resources Information Center

Wang, Jing; Matthews, Judith T.; Sereika, Susan M.; Chasens, Eileen R.; Ewing, Linda J.; Burke, Lora E.

2013-01-01

Problem solving is a key component of weight loss programs. The Social Problem Solving Inventory-Revised (SPSI-R) has not been evaluated in weight loss studies. The purpose of this study was to evaluate the psychometrics of the SPSI-R. Cronbach's a (0.95 for total score; 0.67-0.92 for subscales) confirmed internal consistency reliability. The…

Preliminary study of the reliability of imaging charge coupled devices

NASA Technical Reports Server (NTRS)

Beall, J. R.; Borenstein, M. D.; Homan, R. A.; Johnson, D. L.; Wilson, D. D.; Young, V. F.

1978-01-01

Imaging CCDs are capable of low light level response and high signal-to-noise ratios. In space applications they offer the user the ability to achieve extremely high resolution imaging with minimum circuitry in the photo sensor array. This work relates the CCD121H Fairchild device to the fundamentals of CCDs and the representative technologies. Several failure modes are described, construction is analyzed and test results are reported. In addition, the relationship of the device reliability to packaging principles is analyzed and test data presented. Finally, a test program is defined for more general reliability evaluation of CCDs.

Stress and Reliability Analysis of a Metal-Ceramic Dental Crown

NASA Technical Reports Server (NTRS)

Anusavice, Kenneth J; Sokolowski, Todd M.; Hojjatie, Barry; Nemeth, Noel N.

1996-01-01

Interaction of mechanical and thermal stresses with the flaws and microcracks within the ceramic region of metal-ceramic dental crowns can result in catastrophic or delayed failure of these restorations. The objective of this study was to determine the combined influence of induced functional stresses and pre-existing flaws and microcracks on the time-dependent probability of failure of a metal-ceramic molar crown. A three-dimensional finite element model of a porcelain fused-to-metal (PFM) molar crown was developed using the ANSYS finite element program. The crown consisted of a body porcelain, opaque porcelain, and a metal substrate. The model had a 300 Newton load applied perpendicular to one cusp, a load of 30ON applied at 30 degrees from the perpendicular load case, directed toward the center, and a 600 Newton vertical load. Ceramic specimens were subjected to a biaxial flexure test and the load-to-failure of each specimen was measured. The results of the finite element stress analysis and the flexure tests were incorporated in the NASA developed CARES/LIFE program to determine the Weibull and fatigue parameters and time-dependent fracture reliability of the PFM crown. CARES/LIFE calculates the time-dependent reliability of monolithic ceramic components subjected to thermomechanical and/Or proof test loading. This program is an extension of the CARES (Ceramics Analysis and Reliability Evaluation of Structures) computer program.

SARA - SURE/ASSIST RELIABILITY ANALYSIS WORKSTATION (VAX VMS VERSION)

NASA Technical Reports Server (NTRS)

Butler, R. W.

1994-01-01

SARA, the SURE/ASSIST Reliability Analysis Workstation, is a bundle of programs used to solve reliability problems. The mathematical approach chosen to solve a reliability problem may vary with the size and nature of the problem. The Systems Validation Methods group at NASA Langley Research Center has created a set of four software packages that form the basis for a reliability analysis workstation, including three for use in analyzing reconfigurable, fault-tolerant systems and one for analyzing non-reconfigurable systems. The SARA bundle includes the three for reconfigurable, fault-tolerant systems: SURE reliability analysis program (COSMIC program LAR-13789, LAR-14921); the ASSIST specification interface program (LAR-14193, LAR-14923), and PAWS/STEM reliability analysis programs (LAR-14165, LAR-14920). As indicated by the program numbers in parentheses, each of these three packages is also available separately in two machine versions. The fourth package, which is only available separately, is FTC, the Fault Tree Compiler (LAR-14586, LAR-14922). FTC is used to calculate the top-event probability for a fault tree which describes a non-reconfigurable system. PAWS/STEM and SURE are analysis programs which utilize different solution methods, but have a common input language, the SURE language. ASSIST is a preprocessor that generates SURE language from a more abstract definition. ASSIST, SURE, and PAWS/STEM are described briefly in the following paragraphs. For additional details about the individual packages, including pricing, please refer to their respective abstracts. ASSIST, the Abstract Semi-Markov Specification Interface to the SURE Tool program, allows a reliability engineer to describe the failure behavior of a fault-tolerant computer system in an abstract, high-level language. The ASSIST program then automatically generates a corresponding semi-Markov model. A one-page ASSIST-language description may result in a semi-Markov model with thousands of states and transitions. The ASSIST program also includes model-reduction techniques to facilitate efficient modeling of large systems. The semi-Markov model generated by ASSIST is in the format needed for input to SURE and PAWS/STEM. The Semi-Markov Unreliability Range Evaluator, SURE, is an analysis tool for reconfigurable, fault-tolerant systems. SURE provides an efficient means for calculating accurate upper and lower bounds for the death state probabilities for a large class of semi-Markov models, not just those which can be reduced to critical-pair architectures. The calculated bounds are close enough (usually within 5 percent of each other) for use in reliability studies of ultra-reliable computer systems. The SURE bounding theorems have algebraic solutions and are consequently computationally efficient even for large and complex systems. SURE can optionally regard a specified parameter as a variable over a range of values, enabling an automatic sensitivity analysis. SURE output is tabular. The PAWS/STEM package includes two programs for the creation and evaluation of pure Markov models describing the behavior of fault-tolerant reconfigurable computer systems: the Pade Approximation with Scaling (PAWS) and Scaled Taylor Exponential Matrix (STEM) programs. PAWS and STEM produce exact solutions for the probability of system failure and provide a conservative estimate of the number of significant digits in the solution. Markov models of fault-tolerant architectures inevitably lead to numerically stiff differential equations. Both PAWS and STEM have the capability to solve numerically stiff models. These complementary programs use separate methods to determine the matrix exponential in the solution of the model's system of differential equations. In general, PAWS is better suited to evaluate small and dense models. STEM operates at lower precision, but works faster than PAWS for larger models. The programs that comprise the SARA package were originally developed for use on DEC VAX series computers running VMS and were later ported for use on Sun series computers running SunOS. They are written in C-language, Pascal, and FORTRAN 77. An ANSI compliant C compiler is required in order to compile the C portion of the Sun version source code. The Pascal and FORTRAN code can be compiled on Sun computers using Sun Pascal and Sun Fortran. For the VMS version, VAX C, VAX PASCAL, and VAX FORTRAN can be used to recompile the source code. The standard distribution medium for the VMS version of SARA (COS-10041) is a 9-track 1600 BPI magnetic tape in VMSINSTAL format. It is also available on a TK50 tape cartridge in VMSINSTAL format. Executables are included. The standard distribution medium for the Sun version of SARA (COS-10039) is a .25 inch streaming magnetic tape cartridge in UNIX tar format. Both Sun3 and Sun4 executables are included. Electronic copies of the ASSIST user's manual in TeX and PostScript formats are provided on the distribution medium. DEC, VAX, VMS, and TK50 are registered trademarks of Digital Equipment Corporation. Sun, Sun3, Sun4, and SunOS are trademarks of Sun Microsystems, Inc. TeX is a trademark of the American Mathematical Society. PostScript is a registered trademark of Adobe Systems Incorporated.

SARA - SURE/ASSIST RELIABILITY ANALYSIS WORKSTATION (UNIX VERSION)

NASA Technical Reports Server (NTRS)

Butler, R. W.

1994-01-01

SARA, the SURE/ASSIST Reliability Analysis Workstation, is a bundle of programs used to solve reliability problems. The mathematical approach chosen to solve a reliability problem may vary with the size and nature of the problem. The Systems Validation Methods group at NASA Langley Research Center has created a set of four software packages that form the basis for a reliability analysis workstation, including three for use in analyzing reconfigurable, fault-tolerant systems and one for analyzing non-reconfigurable systems. The SARA bundle includes the three for reconfigurable, fault-tolerant systems: SURE reliability analysis program (COSMIC program LAR-13789, LAR-14921); the ASSIST specification interface program (LAR-14193, LAR-14923), and PAWS/STEM reliability analysis programs (LAR-14165, LAR-14920). As indicated by the program numbers in parentheses, each of these three packages is also available separately in two machine versions. The fourth package, which is only available separately, is FTC, the Fault Tree Compiler (LAR-14586, LAR-14922). FTC is used to calculate the top-event probability for a fault tree which describes a non-reconfigurable system. PAWS/STEM and SURE are analysis programs which utilize different solution methods, but have a common input language, the SURE language. ASSIST is a preprocessor that generates SURE language from a more abstract definition. ASSIST, SURE, and PAWS/STEM are described briefly in the following paragraphs. For additional details about the individual packages, including pricing, please refer to their respective abstracts. ASSIST, the Abstract Semi-Markov Specification Interface to the SURE Tool program, allows a reliability engineer to describe the failure behavior of a fault-tolerant computer system in an abstract, high-level language. The ASSIST program then automatically generates a corresponding semi-Markov model. A one-page ASSIST-language description may result in a semi-Markov model with thousands of states and transitions. The ASSIST program also includes model-reduction techniques to facilitate efficient modeling of large systems. The semi-Markov model generated by ASSIST is in the format needed for input to SURE and PAWS/STEM. The Semi-Markov Unreliability Range Evaluator, SURE, is an analysis tool for reconfigurable, fault-tolerant systems. SURE provides an efficient means for calculating accurate upper and lower bounds for the death state probabilities for a large class of semi-Markov models, not just those which can be reduced to critical-pair architectures. The calculated bounds are close enough (usually within 5 percent of each other) for use in reliability studies of ultra-reliable computer systems. The SURE bounding theorems have algebraic solutions and are consequently computationally efficient even for large and complex systems. SURE can optionally regard a specified parameter as a variable over a range of values, enabling an automatic sensitivity analysis. SURE output is tabular. The PAWS/STEM package includes two programs for the creation and evaluation of pure Markov models describing the behavior of fault-tolerant reconfigurable computer systems: the Pade Approximation with Scaling (PAWS) and Scaled Taylor Exponential Matrix (STEM) programs. PAWS and STEM produce exact solutions for the probability of system failure and provide a conservative estimate of the number of significant digits in the solution. Markov models of fault-tolerant architectures inevitably lead to numerically stiff differential equations. Both PAWS and STEM have the capability to solve numerically stiff models. These complementary programs use separate methods to determine the matrix exponential in the solution of the model's system of differential equations. In general, PAWS is better suited to evaluate small and dense models. STEM operates at lower precision, but works faster than PAWS for larger models. The programs that comprise the SARA package were originally developed for use on DEC VAX series computers running VMS and were later ported for use on Sun series computers running SunOS. They are written in C-language, Pascal, and FORTRAN 77. An ANSI compliant C compiler is required in order to compile the C portion of the Sun version source code. The Pascal and FORTRAN code can be compiled on Sun computers using Sun Pascal and Sun Fortran. For the VMS version, VAX C, VAX PASCAL, and VAX FORTRAN can be used to recompile the source code. The standard distribution medium for the VMS version of SARA (COS-10041) is a 9-track 1600 BPI magnetic tape in VMSINSTAL format. It is also available on a TK50 tape cartridge in VMSINSTAL format. Executables are included. The standard distribution medium for the Sun version of SARA (COS-10039) is a .25 inch streaming magnetic tape cartridge in UNIX tar format. Both Sun3 and Sun4 executables are included. Electronic copies of the ASSIST user's manual in TeX and PostScript formats are provided on the distribution medium. DEC, VAX, VMS, and TK50 are registered trademarks of Digital Equipment Corporation. Sun, Sun3, Sun4, and SunOS are trademarks of Sun Microsystems, Inc. TeX is a trademark of the American Mathematical Society. PostScript is a registered trademark of Adobe Systems Incorporated.

A Methodological Evaluation of an Environmental Education Survey: Is There a Technological Advantage

ERIC Educational Resources Information Center

Sharp, Ryan L.; Bradley, Michael J.; Maples, James N.

2017-01-01

Environmental education represents a conceivable way to counter the effects of youth's lack of exposure to the natural environment. However, the effectiveness of these programs is often not evaluated, and when they are, the methods for doing so are not consistent. Without proper and reliable methods of data collection, the results may be…

The Factor Structure of Consumer Beliefs and Attitudes About Medical Care: Implications for the Academic Medical Community.

ERIC Educational Resources Information Center

Ware, John E.; And Others

This paper summarizes findings of a program of evaluation research. In this research the authors assumed that reliable and valid measurement of consumers' attitudes and beliefs about various aspects of medical care is possible and that more valid evaluation systems could be achieved if consumer perceptions are carefully considered during…

Hierarchical storage management system evaluation

NASA Technical Reports Server (NTRS)

Woodrow, Thomas S.

1993-01-01

The Numerical Aerodynamic Simulation (NAS) Program at NASA Ames Research Center has been developing a hierarchical storage management system, NAStore, for some 6 years. This evaluation compares functionality, performance, reliability, and other factors of NAStore and three commercial alternatives. FileServ is found to be slightly better overall than NAStore and DMF. UniTree is found to be severely lacking in comparison.

Assessing institutional support for Hispanic nursing student retention: a study to evaluate the psychometric properties of two self-assessment inventories.

PubMed

Bond, Mary Lou; Cason, Carolyn L

2014-01-01

To assess the content validity and internal consistency reliability of the Healthcare Professions Education Program Self-Assessment (PSA) and the Institutional Self-Assessment for Factors Supporting Hispanic Student Retention (ISA). Health disparities among vulnerable populations are among the top priorities demanding attention in the United States. Efforts to recruit and retain Hispanic nursing students are essential. Based on a sample of provosts, deans/directors, and an author of the Model of Institutional Support, participants commented on the perceived validity and usefulness of each item of the PSA and ISA. Internal consistency reliability was calculated by Cronbach's alpha using responses from nursing schools in states with large Hispanic populations. The ISA and PSA were found to be reliable and valid tools for assessing institutional friendliness. The instruments highlight strengths and identify potential areas of improvement at institutional and program levels.

JUPITER PROJECT - MERGING INVERSE PROBLEM FORMULATION TECHNOLOGIES

EPA Science Inventory

The JUPITER (Joint Universal Parameter IdenTification and Evaluation of Reliability) project seeks to enhance and build on the technology and momentum behind two of the most popular sensitivity analysis, data assessment, calibration, and uncertainty analysis programs used in envi...

Evaluation of the musculoskeletal system of patients in cardiopulmonary and metabolic rehabilitation programs.

PubMed

Carvalho, Tales de; Mozerle, Angelise; Ulbrich, Anderson Zampier; Andrade, Alexsandro Luiz de; Moraes, Emmanuele Elise Campos de; Mara, Lourenço Sampaio de

2010-08-01

Participants of cardiopulmonary and metabolic rehabilitation (CPMR) programs may present with musculoskeletal changes that may affect treatment compliance and effectiveness. To develop an instrument for evaluation of the musculoskeletal system and identification of problems, especially those related to exercise, so that patients can be cleared to exercise with no restrictions, cleared with restrictions, or not cleared before approval from a specialist. Construction and validation (according to Cronbach's alpha) of a musculoskeletal system assessment inventory (MSSAI), for subsequent administration to participants in CPMR programs. A total of 103 individuals participating in CPMR programs were evaluated by means of the MSSAI, whose internal validity and reliability proved to be satisfactory. Of these, 33 were men (32%) and 70 were women (68%), with age ranging from 36 to 84 years; 47 (45.6%) had already been diagnosed with musculoskeletal system disorders; 39 (37.9%) had already received specific treatment for the musculoskeletal system; 33 (32%) used to take medications to relieve symptoms related to the musculoskeletal system; and 10 (9.7%) had a medical restriction for performing some type of exercise. We should point out that 48 individuals (46.6%) reported pain in the musculoskeletal system; in 14 (13.6%) of them, the pain worsened by exercise, and this should have prevented them from participating in exercise programs before receiving approval from a specialist. The MSSAI, whose internal validity and reliability proved satisfactory, showed that there was some restriction to exercise practice for almost half of the individuals participating in CPMR programs, and that some of them should not have been cleared without approval from a specialist.

Reliability of a Market Basket Assessment Tool (MBAT) for Use in SNAP-Ed Healthy Retail Initiatives.

PubMed

Misyak, Sarah A; Hedrick, Valisa E; Pudney, Ellen; Serrano, Elena L; Farris, Alisha R

2018-05-01

To evaluate the reliability of the Market Basket Assessment Tool (MBAT) for assessing the availability of fruits and vegetables, low-fat or nonfat dairy and eggs, lean meats, whole-grain products, and seeds, beans, and nuts in Supplemental Nutrition Assistance Program-authorized retail environments. Different trained raters used the MBAT simultaneously at 14 retail environments to measure interrater reliability. Raters returned to 12 retail environments (85.7%) 1 week later to measure test-retest reliability. Data were analyzed using paired-sample t tests and correlations. No significant differences were found for interrater reliability or test-retest reliability for individual categories (mean differences, 0.0 to 0.3 ± 0.2 points) or total score (mean difference, 0.5 ± 0.4 points and (mean differences, 0.0 to 0.3 ± 0.3 points) or total score (mean difference, 0.8 ± 0.4 points), respectively. Future steps include validation of the MBAT. A low-burden tool can facilitate evaluation of efforts to promote healthful foods in retail environments. Copyright © 2018 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Framework for a National Testing and Evaluation Program ...

EPA Pesticide Factsheets

Abstract:The National STEPP Program seeks to improve water quality by accelerating the effective implementation and adoption of innovative stormwater management technologies. Itwill attempt to accomplish this by establishing practices through highly reliable, and cost-effective Stormwater control measures (SCM) testing, evaluation, and verification services. The program will aim to remove barriers to innovation, minimize duplicative performance evaluation needs, increase confidence that regulatory requirements are met by creating consistency among testing and evaluation protocols, and establishing equity between public domain and proprietary SCM evaluation approaches.The Environmental Technology Verification Program, established by the U.S. Environmental Protection Agency (EPA) 18 years ago, was the only national program of its kindin the stormwater sector, but is now defunct, leaving a national leadership void. The STEPP initiative was triggered in part by regulatory demands in the government and private sectors to fill this vacuum. A concerted focus and study of this matter led to the release of a Water Environment Federation (WEF) white paper entitled “Investigation into the Feasibility of a National Testing and Evaluation Program for Stormwater Products and Practices” in February 2014. During this second phase of the STEPP initiative, and with EPA support, five analogous technology evaluation programs related to both stormwater and non-stormwater were an

[Process design in high-reliability organizations].

PubMed

Sommer, K-J; Kranz, J; Steffens, J

2014-05-01

Modern medicine is a highly complex service industry in which individual care providers are linked in a complicated network. The complexity and interlinkedness is associated with risks concerning patient safety. Other highly complex industries like commercial aviation have succeeded in maintaining or even increasing its safety levels despite rapidly increasing passenger figures. Standard operating procedures (SOPs), crew resource management (CRM), as well as operational risk evaluation (ORE) are historically developed and trusted parts of a comprehensive and systemic safety program. If medicine wants to follow this quantum leap towards increased patient safety, it must intensively evaluate the results of other high-reliability industries and seek step-by-step implementation after a critical assessment.

Implementation of a patient safety program at a tertiary health system: A longitudinal analysis of interventions and serious safety events.

PubMed

Cropper, Douglas P; Harb, Nidal H; Said, Patricia A; Lemke, Jon H; Shammas, Nicolas W

2018-04-01

We hypothesize that implementation of a safety program based on high reliability organization principles will reduce serious safety events (SSE). The safety program focused on 7 essential elements: (a) safety rounding, (b) safety oversight teams, (c) safety huddles, (d) safety coaches, (e) good catches/safety heroes, (f) safety education, and (g) red rule. An educational curriculum was implemented focusing on changing high-risk behaviors and implementing critical safety policies. All unusual occurrences were captured in the Midas system and investigated by risk specialists, the safety officer, and the chief medical officer. A multidepartmental committee evaluated these events, and a root cause analysis (RCA) was performed. Events were tabulated and serious safety event (SSE) recorded and plotted over time. Safety success stories (SSSs) were also evaluated over time. A steady drop in SSEs was seen over 9 years. Also a rise in SSSs was evident, reflecting on staff engagement in the program. The parallel change in SSEs, SSSs, and the implementation of various safety interventions highly suggest that the program was successful in achieving its goals. A safety program based on high-reliability organization principles and made a core value of the institution can have a significant positive impact on reducing SSEs. © 2018 American Society for Healthcare Risk Management of the American Hospital Association.

Transit Reliability Information Program : PATCO-WMATA Propulsion System Reliability/Productivity Analysis

DOT National Transportation Integrated Search

1984-10-01

The Transit Reliability Information Program (TRIP) is a government-initiated program to assist the transit industry in satisfying its need for transit reliability information. TRIP provides this assistance through the operation of a national data ban...

Validity and reliability of an in-training evaluation report to measure the CanMEDS roles in emergency medicine residents.

PubMed

Kassam, Aliya; Donnon, Tyrone; Rigby, Ian

2014-03-01

There is a question of whether a single assessment tool can assess the key competencies of residents as mandated by the Royal College of Physicians and Surgeons of Canada CanMEDS roles framework. The objective of the present study was to investigate the reliability and validity of an emergency medicine (EM) in-training evaluation report (ITER). ITER data from 2009 to 2011 were combined for residents across the 5 years of the EM residency training program. An exploratory factor analysis with varimax rotation was used to explore the construct validity of the ITER. A total of 172 ITERs were completed on residents across their first to fifth year of training. A combined, 24-item ITER yielded a five-factor solution measuring the CanMEDs role Medical Expert/Scholar, Communicator/Collaborator, Professional, Health Advocate and Manager subscales. The factor solution accounted for 79% of the variance, and reliability coefficients (Cronbach alpha) ranged from α  =  0.90 to 0.95 for each subscale and α  =  0.97 overall. The combined, 24-item ITER used to assess residents' competencies in the EM residency program showed strong reliability and evidence of construct validity for assessment of the CanMEDS roles. Further research is needed to develop and test ITER items that will differentiate each CanMEDS role exclusively.

Methodology for Developing a New EFNEP Food and Physical Activity Behaviors Questionnaire.

PubMed

Murray, Erin K; Auld, Garry; Baker, Susan S; Barale, Karen; Franck, Karen; Khan, Tarana; Palmer-Keenan, Debra; Walsh, Jennifer

2017-10-01

Research methods are described for developing a food and physical activity behaviors questionnaire for the Expanded Food and Nutrition Education Program (EFNEP), a US Department of Agriculture nutrition education program serving low-income families. Mixed-methods observational study. The questionnaire will include 5 domains: (1) diet quality, (2) physical activity, (3) food safety, (4) food security, and (5) food resource management. A 5-stage process will be used to assess the questionnaire's test-retest reliability and content, face, and construct validity. Research teams across the US will coordinate questionnaire development and testing nationally. Convenience samples of low-income EFNEP, or EFNEP-eligible, adult participants across the US. A 5-stage process: (1) prioritize domain concepts to evaluate (2) question generation and content analysis panel, (3) question pretesting using cognitive interviews, (4) test-retest reliability assessment, and (5) construct validity testing. A nationally tested valid and reliable food and physical activity behaviors questionnaire for low-income adults to evaluate EFNEP's effectiveness. Cognitive interviews will be summarized to identify themes and dominant trends. Paired t tests (P ≤ .05) and Spearman and intra-class correlation coefficients (r > .5) will be conducted to assess reliability. Construct validity will be assessed using Wilcoxon t test (P ≤ .05), Spearman correlations, and Bland-Altman plots. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Measuring infrastructure: A key step in program evaluation and planning

PubMed Central

Schmitt, Carol L.; Glasgow, LaShawn; Lavinghouze, S. Rene; Rieker, Patricia P.; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-01-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General’s call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model’s utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. PMID:27037655

Measuring infrastructure: A key step in program evaluation and planning.

PubMed

Schmitt, Carol L; Glasgow, LaShawn; Lavinghouze, S Rene; Rieker, Patricia P; Fulmer, Erika; McAleer, Kelly; Rogers, Todd

2016-06-01

State tobacco prevention and control programs (TCPs) require a fully functioning infrastructure to respond effectively to the Surgeon General's call for accelerating the national reduction in tobacco use. The literature describes common elements of infrastructure; however, a lack of valid and reliable measures has made it difficult for program planners to monitor relevant infrastructure indicators and address observed deficiencies, or for evaluators to determine the association among infrastructure, program efforts, and program outcomes. The Component Model of Infrastructure (CMI) is a comprehensive, evidence-based framework that facilitates TCP program planning efforts to develop and maintain their infrastructure. Measures of CMI components were needed to evaluate the model's utility and predictive capability for assessing infrastructure. This paper describes the development of CMI measures and results of a pilot test with nine state TCP managers. Pilot test findings indicate that the tool has good face validity and is clear and easy to follow. The CMI tool yields data that can enhance public health efforts in a funding-constrained environment and provides insight into program sustainability. Ultimately, the CMI measurement tool could facilitate better evaluation and program planning across public health programs. Copyright © 2016 Elsevier Ltd. All rights reserved.

The 25-KVA amorphous metal-core transformer developmental test report

NASA Astrophysics Data System (ADS)

Urata, G. V.; Franchi, J. O.; Franchi, P. E.

1989-08-01

NCEL has completed a test and evaluation program for 25-kVA amorphous metal-core transformers. These transformers save energy by reducing no-load losses by 60 to 70 percent. No-load losses are estimated to cost the Navy millions annually and if all of the Navy transformers were replaced by amorphous metal-core transformers, the Navy would save millions a year. The program objective was to evaluate the electrical performance and operational reliability of the amorphous metal-core transformers compared to conventional silicon-steel transformers.

A prospective study assessing agreement and reliability of a geriatric evaluation.

PubMed

Locatelli, Isabella; Monod, Stéfanie; Cornuz, Jacques; Büla, Christophe J; Senn, Nicolas

2017-07-19

The present study takes place within a geriatric program, aiming at improving the diagnosis and management of geriatric syndromes in primary care. Within this program it was of prime importance to be able to rely on a robust and reproducible geriatric consultation to use as a gold standard for evaluating a primary care brief assessment tool. The specific objective of the present study was thus assessing the agreement and reliability of a comprehensive geriatric consultation. The study was conducted at the outpatient clinic of the Service of Geriatric Medicine, University of Lausanne, Switzerland. All community-dwelling older persons aged 70 years and above were eligible. Patients were excluded if they hadn't a primary care physician, they were unable to speak French, or they were already assessed by a geriatrician within the last 12 months. A set of 9 geriatricians evaluated 20 patients. Each patient was assessed twice within a 2-month delay. Geriatric consultations were based on a structured evaluation process, leading to rating the following geriatric conditions: functional, cognitive, visual, and hearing impairment, mood disorders, risk of fall, osteoporosis, malnutrition, and urinary incontinence. Reliability and agreement estimates on each of these items were obtained using a three-way Intraclass Correlation and a three-way Observed Disagreement index. The latter allowed a decomposition of overall disagreement into disagreements due to each source of error variability (visit, rater and random). Agreement ranged between 0.62 and 0.85. For most domains, geriatrician-related error variability explained an important proportion of disagreement. Reliability ranged between 0 and 0.8. It was poor/moderate for visual impairment, malnutrition and risk of fall, and good/excellent for functional/cognitive/hearing impairment, osteoporosis, incontinence and mood disorders. Six out of nine items of the geriatric consultation described in this study (functional/cognitive/hearing impairment, osteoporosis, incontinence and mood disorders) present a good to excellent reliability and can safely be used as a reference (gold standard) to evaluate the diagnostic performance of a primary care brief assessment tool. More objective/significant measures are needed to improve reliability of malnutrition, visual impairment, and risk of fall assessment before they can serve as a safe gold standard of a primary care tool.

Analysis of the reliability and reproducibility of goniometry compared to hand photogrammetry

PubMed Central

de Carvalho, Rosana Martins Ferreira; Mazzer, Nilton; Barbieri, Claudio Henrique

2012-01-01

Objective: To evaluate the intra- and inter-examiner reliability and reproducibility of goniometry in relation to photogrammetry of hand, comparing the angles of thumb abduction, PIP joint flexion of the II finger and MCP joint flexion of the V finger. Methods: The study included 30 volunteers, who were divided into three groups: one group of 10 physiotherapy students, one group of 10 physiotherapists, and a third group of 10 therapists of the hand. Each examiner performed the measurements on the same hand mold, using the goniometer followed by two photogrammetry software programs; CorelDraw® and ALCimagem®. Results: The results revealed that the groups and the methods proposed presented inter-examiner reliability, generally rated as excellent (ICC 0.998 I.C. 95% 0.995 - 0.999). In the intra-examiner evaluation, an excellent level of reliability was found between the three groups. In the comparison between groups for each angle and each method, no significant differences were found between the groups for most of the measurements. Conclusion: Goniometry and photogrammetry are reliable and reproducible methods for evaluating measurements of the hand. However, due to the lack of similar references, detailed studies are needed to define the normal parameters between the methods in the joints of the hand. Level of Evidence II, Diagnostic Study. PMID:24453594

FAA center for aviation systems reliability: an overview

NASA Astrophysics Data System (ADS)

Brasche, Lisa J. H.

1996-11-01

The FAA Center for Aviation Systems Reliability has as its objectives: to develop quantitative nondestructive evaluation (NDE) methods for aircraft structures and materials, including prototype instrumentation, software, techniques and procedures; and to develop and maintain comprehensive education and training programs specific to the inspection of aviation structures. The program, which includes contributions from Iowa State University, Northwestern University, Wayne State University, Tuskegee University, AlliedSignal Propulsion Engines, General Electric Aircraft Engines and Pratt and Whitney, has been in existence since 1990. Efforts under way include: development of inspection for adhesively bonded structures; detection of corrosion; development of advanced NDE concepts that form the basis for an inspection simulator; improvements of titanium inspection as part of the Engine Titanium Consortium; development of education and training program. An overview of the efforts underway will be provided with focus on those technologies closest to technology transfer.

NASA/Army Rotorcraft Transmission Research, a Review of Recent Significant Accomplishments

NASA Technical Reports Server (NTRS)

Krantz, Timothy L.

1994-01-01

A joint helicopter transmission research program between NASA Lewis Research Center and the U.S. Army Research Lab has existed since 1970. Research goals are to reduce weight and noise while increasing life, reliability, and safety. These research goals are achieved by the NASA/Army Mechanical Systems Technology Branch through both in-house research and cooperative research projects with university and industry partners. Some recent significant technical accomplishments produced by this cooperative research are reviewed. The following research projects are reviewed: oil-off survivability of tapered roller bearings, design and evaluation of high contact ratio gearing, finite element analysis of spiral bevel gears, computer numerical control grinding of spiral bevel gears, gear dynamics code validation, computer program for life and reliability of helicopter transmissions, planetary gear train efficiency study, and the Advanced Rotorcraft Transmission (ART) program.

Redesign of the System for Evaluation of Teaching Qualities in Anesthesiology Residency Training (SETQ Smart).

PubMed

Lombarts, Kiki M J M H; Ferguson, Andrew; Hollmann, Markus W; Malling, Bente; Arah, Onyebuchi A

2016-11-01

Given the increasing international recognition of clinical teaching as a competency and regulation of residency training, evaluation of anesthesiology faculty teaching is needed. The System for Evaluating Teaching Qualities (SETQ) Smart questionnaires were developed for assessing teaching performance of faculty in residency training programs in different countries. This study investigated (1) the structure, (2) the psychometric qualities of the new tools, and (3) the number of residents' evaluations needed per anesthesiology faculty to use the instruments reliably. Two SETQ Smart questionnaires-for faculty self-evaluation and for resident evaluation of faculty-were developed. A multicenter survey was conducted among 399 anesthesiology faculty and 430 residents in six countries. Statistical analyses included exploratory factor analysis, reliability analysis using Cronbach α, item-total scale correlations, interscale correlations, comparison of composite scales to global ratings, and generalizability analysis to assess residents' evaluations needed per faculty. In total, 240 residents completed 1,622 evaluations of 247 faculty. The SETQ Smart questionnaires revealed six teaching qualities consisting of 25 items. Cronbach α's were very high (greater than 0.95) for the overall SETQ Smart questionnaires and high (greater than 0.80) for the separate teaching qualities. Interscale correlations were all within the acceptable range of moderate correlation. Overall, questionnaire and scale scores correlated moderately to highly with the global ratings. For reliable feedback to individual faculty, three to five resident evaluations are needed. The first internationally piloted questionnaires for evaluating individual anesthesiology faculty teaching performance can be reliably, validly, and feasibly used for formative purposes in residency training.

Transit Reliability Information Program : Reliability Verification Demonstration Plan for Rapid Rail Vehicles

DOT National Transportation Integrated Search

1981-08-01

The Transit Reliability Information Program (TRIP) is a government-initiated program to assist the transit industry in satisfying its need for transit reliability information. TRIP provides this assistance through the operation of a national Data Ban...

Implementation of a Personnel Reliability Program as a Facilitator of Biosafety and Biosecurity Culture in BSL-3 and BSL-4 Laboratories

PubMed Central

Weaver, Patrick; Fitch, J. Patrick; Johnson, Barbara; Pearl, R. Marene

2013-01-01

In late 2010, the National Biodefense Analysis and Countermeasures Center (NBACC) implemented a Personnel Reliability Program (PRP) with the goal of enabling active participation by its staff to drive and improve the biosafety and biosecurity culture at the organization. A philosophical keystone for accomplishment of NBACC's scientific mission is simultaneous excellence in operations and outreach. Its personnel reliability program builds on this approach to: (1) enable and support a culture of responsibility based on human performance principles, (2) maintain compliance with regulations, and (3) address the risk associated with the insider threat. Recently, the Code of Federal Regulations (CFR) governing use and possession of biological select agents and toxins (BSAT) was amended to require a pre-access suitability assessment and ongoing evaluation for staff accessing Tier 1 BSAT. These 2 new requirements are in addition to the already required Federal Bureau of Investigation (FBI) Security Risk Assessment (SRA). Two years prior to the release of these guidelines, NBACC developed its PRP to supplement the SRA requirement as a means to empower personnel and foster an operational environment where any and all work with BSAT is conducted in a safe, secure, and reliable manner. PMID:23745523

Development and evaluation of a radar air traffic control research task.

DOT National Transportation Integrated Search

1965-12-01

A system is described in which various elements of the radar air traffic controller's task can be presented repeatedly, reliably, and concurrently to each of six experimental subjects seated at separate task consoles. Programming of display condition...

An empirical study of flight control software reliability

NASA Technical Reports Server (NTRS)

Dunham, J. R.; Pierce, J. L.

1986-01-01

The results of a laboratory experiment in flight control software reliability are reported. The experiment tests a small sample of implementations of a pitch axis control law for a PA28 aircraft with over 14 million pitch commands with varying levels of additive input and feedback noise. The testing which uses the method of n-version programming for error detection surfaced four software faults in one implementation of the control law. The small number of detected faults precluded the conduct of the error burst analyses. The pitch axis problem provides data for use in constructing a model in the prediction of the reliability of software in systems with feedback. The study is undertaken to find means to perform reliability evaluations of flight control software.

Cycle life test. Evaluation program for secondary spacecraft cells. [performance tests on silver zinc batteries, silver cadmium batteries, and nickel cadmium batteries

NASA Technical Reports Server (NTRS)

Harkness, J. D.

1976-01-01

Considerable research is being done to find more efficient and reliable means of starting electrical energy for orbiting satellites. Rechargeable cells offer one such means. A test program is described which has been established in order to further the evaluation of certain types of cells and to obtain performance and failure data as an aid to their continued improvement. The purpose of the program is to determine the cycling performance capabilities of packs of cells under different load and temperature conditions. The various kinds of cells tested were nickel-cadmium, silver-cadmium, and silver-zinc sealed cells. A summary of the results of the life cycling program is given in this report.

DOE research and development report. Progress report, October 1980-September 1981

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bingham, Carleton D.

The DOE New Brunswick Laboratory (NBL) is the US Government's Nuclear Materials Standards and Measurement Laboratory. NBL is assigned the mission to provide and maintain, as an essential part of federal statutory responsibilities related to national and international safeguards of nuclear materials for USA defense and energy programs, an ongoing capability for: the development, preparation, certification, and distribution of reference materials for the calibration and standardization of nuclear materials measurements; the development, improvement, and evaluation of nuclear materials measurement technology; the assessment and evaluation of the practice and application of nuclear materials measurement technology; expert and reliable specialized nuclear materialsmore » measurement services for the government; and technology exchange and training in nuclear materials measurement and standards. Progress reports for this fiscal year are presented under the following sections: (1) development or evaluation of measurement technology (elemental assay of uranium plutonium; isotope composition); (2) standards and reference materials (NBL standards and reference materials; NBS reference materials); and (3) evaluation programs (safeguards analytical laboratory evaluation; general analytical evaluation program; other evaluation programs).« less

10 CFR 712.1 - Purpose.

Code of Federal Regulations, 2011 CFR

2011-01-01

... HUMAN RELIABILITY PROGRAM Establishment of and Procedures for the Human Reliability Program General Provisions § 712.1 Purpose. This part establishes the policies and procedures for a Human Reliability Program... judgment and reliability may be impaired by physical or mental/personality disorders, alcohol abuse, use of...

Development of a scale to measure individuals’ ratings of peace

PubMed Central

2014-01-01

Background The evolving concept of peace-building and the interplay between peace and health is examined in many venues, including at the World Health Assembly. However, without a metric to determine effectiveness of intervention programs all efforts are prone to subjective assessment. This paper develops a psychometric index that lays the foundation for measuring community peace stemming from intervention programs. Methods After developing a working definition of ‘peace’ and delineating a Peace Evaluation Across Cultures and Environments (PEACE) scale with seven constructs comprised of 71 items, a beta version of the index was pilot-tested. Two hundred and fifty subjects in three sites in the U.S. were studied using a five-point Likert scale to evaluate the psychometric functioning of the PEACE scale. Known groups validation was performed using the SOS-10. In addition, test-retest reliability was performed on 20 subjects. Results The preliminary data demonstrated that the scale has acceptable psychometric properties for measuring an individual’s level of peacefulness. The study also provides reliability and validity data for the scale. The data demonstrated internal consistency, correlation between data and psychological well-being, and test-retest reliability. Conclusions The PEACE scale may serve as a novel assessment tool in the health sector and be valuable in monitoring and evaluating the peace-building impact of health initiatives in conflict-affected regions. PMID:25298781

Further psychometric evaluation and revision of the Mayo-Portland Adaptability Inventory in a national sample.

PubMed

Malec, James F; Kragness, Miriam; Evans, Randall W; Finlay, Karen L; Kent, Ann; Lezak, Muriel D

2003-01-01

To evaluate the internal consistency of the Mayo-Portland Adaptability Inventory (MPAI), further refine the instrument, and provide reference data based on a large, geographically diverse sample of persons with acquired brain injury (ABI). 386 persons, most with moderate to severe ABI. Outpatient, community-based, and residential rehabilitation facilities for persons with ABI located in the United States: West, Midwest, and Southeast. Rasch, item cluster, principal components, and traditional psychometric analyses for internal consistency of MPAI data and subscales. With rescoring of rating scales for 4 items, a 29-item version of the MPAI showed satisfactory internal consistency by Rasch (Person Reliability=.88; Item Reliability=.99) and traditional psychometric indicators (Cronbach's alpha=.89). Three rationally derived subscales for Ability, Activity, and Participation demonstrated psychometric properties that were equivalent to subscales derived empirically through item cluster and factor analyses. For the 3 subscales, Person Reliability ranged from.78 to.79; Item Reliability, from.98 to.99; and Cronbach's alpha, from.76 to.83. Subscales correlated moderately (Pearson r =.49-.65) with each other and strongly with the overall scale (Pearson r=.82-.86). Outcome after ABI is represented by the unitary dimension described by the MPAI. MPAI subscales further define regions of this dimension that may be useful for evaluation of clinical cases and program evaluation.

Reliability in individual monitoring service.

PubMed

Mod Ali, N

2011-03-01

As a laboratory certified to ISO 9001:2008 and accredited to ISO/IEC 17025, the Secondary Standard Dosimetry Laboratory (SSDL)-Nuclear Malaysia has incorporated an overall comprehensive system for technical and quality management in promoting a reliable individual monitoring service (IMS). Faster identification and resolution of issues regarding dosemeter preparation and issuing of reports, personnel enhancement, improved customer satisfaction and overall efficiency of laboratory activities are all results of the implementation of an effective quality system. Review of these measures and responses to observed trends provide continuous improvement of the system. By having these mechanisms, reliability of the IMS can be assured in the promotion of safe behaviour at all levels of the workforce utilising ionising radiation facilities. Upgradation of in the reporting program through a web-based e-SSDL marks a major improvement in Nuclear Malaysia's IMS reliability on the whole. The system is a vital step in providing a user friendly and effective occupational exposure evaluation program in the country. It provides a higher level of confidence in the results generated for occupational dose monitoring of the IMS, thus, enhances the status of the radiation protection framework of the country.

FIA BioSum: a tool to evaluate financial costs, opportunities and effectiveness of fuel treatments.

Treesearch

Jeremy Fried; Glenn Christensen

2004-01-01

FIA BioSum, a tool developed by the USDA Forest Services Forest Inventory and Analysis (FIA) Program, generates reliable cost estimates, identifies opportunities and evaluates the effectiveness of fuel treatments in forested landscapes. BioSum is an analytic framework that integrates a suite of widely used computer models with a foundation of attribute-rich,...

Magnetic Domain Strain Sensor Program

DTIC Science & Technology

1990-08-01

metallic glass onto quartz and the CVD coated titanium were received from XiMagnetics. The coatings received from Damaskos initially appeared to be...successful but later proved defective in repeata- bility and reliability testing. The 8-inch-diameter metallic glass target that Damaskos was using...the backing plate. Scanning Electron Microscope (SEM) evaluations were done to confirm and evaluate the Damaskos coatings. 33 P-1121 :0313

Systems design study of the Pioneer Venus spacecraft. Volume 2. Preliminary program development plan

NASA Technical Reports Server (NTRS)

1973-01-01

The preliminary development plan for the Pioneer Venus program is presented. This preliminary plan treats only developmental aspects that would have a significant effect on program cost. These significant development areas were: master program schedule planning; test planning - both unit and system testing for probes/orbiter/ probe bus; ground support equipment; performance assurance; and science integration Various test planning options and test method techniques were evaluated in terms of achieving a low-cost program without degrading mission performance or system reliability. The approaches studied and the methodology of the selected approach are defined.

Technology demonstrator program for Space Station Environmental Control Life Support System

NASA Technical Reports Server (NTRS)

Adams, Alan M.; Platt, Gordon K.; Claunch, William C.; Humphries, William R.

1987-01-01

The main objectives and requirements of the NASA/Marshall Space Flight Center Technology Demonstration Program are discussed. The program consists of a comparative test and a 90-day manned system test to evaluate an Environmental Control and Life Support System (ECLSS). In the comparative test phase, 14 types of subsystems which perform oxygen and water reclamation functions are to be examined in terms of performance maintenance/service requirements, reliability, and safety. The manned chamber testing phase involves a four person crew using a partial ECLSS for 90 days. The schedule for the program and the program hardware requirements are described.

Building a Database of Developmental Neurotoxitants: Evidence from Human and Animal Studies

EPA Science Inventory

EPA’s program for the screening and prioritization of chemicals for developmental neurotoxicity (DNT) necessitates the generation of a list of chemicals that are known mammalian developmental neurotoxicants. This chemical list will be used to evaluate the sensitivity, reliability...

77 FR 71787 - Agency Information Collection Extension

Federal Register 2010, 2011, 2012, 2013, 2014

2012-12-04

... annual supervisory review, medical assessment, management evaluation, and a DOE personnel security review... explosive duties do not have emotional, mental, or physical conditions that could result in an accidental or.... 1910-5122; (2) Information Collection Request Title: Human Reliability Program; (3) Type of Review...

Liquid Rocket Propulsion Technology: An evaluation of NASA's program. [for space transportation systems

NASA Technical Reports Server (NTRS)

1981-01-01

The liquid rocket propulsion technology needs to support anticipated future space vehicles were examined including any special action needs to be taken to assure that an industrial base in substained. Propulsion system requirements of Earth-to-orbit vehicles, orbital transfer vehicles, and planetary missions were evaluated. Areas of the fundamental technology program undertaking these needs discussed include: pumps and pump drives; combustion heat transfer; nozzle aerodynamics; low gravity cryogenic fluid management; and component and system life reliability, and maintenance. The primary conclusion is that continued development of the shuttle main engine system to achieve design performance and life should be the highest priority in the rocket engine program.

Validation of the dutch version of the health education impact questionnaire (HEIQ) and comparison of the Dutch translation with the English, German and French HEIQ.

PubMed

Ammerlaan, Judy W; van Os-Medendorp, Harmieke; Sont, Jacob K; Elsworth, Gerald R; Osborne, Richard H

2017-01-31

The Health Education Impact Questionnaire (heiQ) evaluates the effectiveness of health education and self-management programs provided to people dealing with a wide range of conditions. Aim of this study was to translate, culturally adapt and validate the Dutch translation of the heiQ and to compare the results with the English, German and French translations. A systematic translation process was undertaken. Psychometric properties were studied among patients with arthritis, atopic dermatitis, food allergy and asthma (n = 286). Factorial validity using confirmatory factor analysis, item difficulty (D), item remainder correlation and composite reliability were conducted. Stability was tested using the intra-class correlation coefficient (ICC). Items were well understood and only minor language adjustments were required. Confirmatory fit indices were >0.95 and item difficulty was D ≥ 0.65 for all items in scales showing acceptable fit indices, except for the reversed Emotional distress scale. Composite reliability ranged between 0.67 and 0.85. Test-retest reliability (n = 93) ICC varied between 0.61 and 0.84. Comparisons with other translations showed comparable fit indices. A lower ICC on Self-monitoring and insight scale was observed. The Dutch translation of the heiQ was found to be well understood and user friendly by patients with Rheumatoid Arthritis, Atopic Dermatitis, Food allergy and asthma and to have robust psychometric properties for evaluating the impact of health education and self-management programs. Given the wide applications of the heiQ and the comparability of the Dutch results with the English, German and French version, the heiQ is a practical and useful questionnaire to evaluate the impact of self-management support programs in different countries and populations with different diseases.

Photovoltaic module reliability improvement through application testing and failure analysis

NASA Technical Reports Server (NTRS)

Dumas, L. N.; Shumka, A.

1982-01-01

During the first four years of the U.S. Department of Energy (DOE) National Photovoltatic Program, the Jet Propulsion Laboratory Low-Cost Solar Array (LSA) Project purchased about 400 kW of photovoltaic modules for test and experiments. In order to identify, report, and analyze test and operational problems with the Block Procurement modules, a problem/failure reporting and analysis system was implemented by the LSA Project with the main purpose of providing manufacturers with feedback from test and field experience needed for the improvement of product performance and reliability. A description of the more significant types of failures is presented, taking into account interconnects, cracked cells, dielectric breakdown, delamination, and corrosion. Current design practices and reliability evaluations are also discussed. The conducted evaluation indicates that current module designs incorporate damage-resistant and fault-tolerant features which address field failure mechanisms observed to date.

Postflight analysis for Delta Program Mission no. 113: COS-B Mission

NASA Technical Reports Server (NTRS)

1976-01-01

On 8 August 1975, the COS-B spacecraft was launched successfully from the Western Test Range (Delta Program Mission No. 113). The launch vehicle was a three stage Extended Long Tank Delta DSV-3P-11B vehicle. Postflight analyses performed in connection with flight are presented. Vehicle trajectory, stage performance, vehicle reliability and the propulsion, guidance, flight control, electronics, mechanical and structural systems are evaluated.

A Cost Analysis Model for Army Sponsored Graduate Dental Education Programs.

DTIC Science & Technology

1997-04-01

characteristics of a good measurement tool ? Cooper and Emory in their textbook, Business Research Methods, state there are three major criteria for evaluating...a measurement tool : validity, reliability, and practicality (Cooper and Emory 1995). Validity can be compartmentalized into internal and external...tremendous expense? The AEGD-1 year program is used extensively as a recruiting tool to encourage senior dental students to join the Army Dental Corps. The

Improving Nutrition and Physical Activity Policies in Afterschool Programs: Results from a Group-Randomized Controlled Trial

PubMed Central

Kenney, Erica L.; Giles, Catherine M.; deBlois, Madeleine E.; Gortmaker, Steven L.; Chinfatt, Sherene; Cradock, Angie L.

2017-01-01

OBJECTIVE Afterschool programs can be health-promoting environments for children. Written policies positively influence nutrition and physical activity (PA) environments, but effective strategies for building staff capacity to write such policies have not been evaluated. This study measures the comprehensiveness of written nutrition, PA, and screen time policies in afterschool programs and assesses impact of the Out of School Nutrition and Physical Activity (OSNAP) intervention on key policies. METHODS Twenty afterschool programs in Boston, MA participated in a group-randomized, controlled trial from September 2010 to June 2011. Intervention program staff attended learning collaboratives focused on practice and policy change. The Out-of-School Time (OST) Policy Assessment Index evaluated written policies. Inter-rater reliability and construct validity of the measure and impact of the intervention on written policies were assessed. RESULTS The measure demonstrated moderate to excellent inter-rater reliability (Spearman’s r=0.53 to 0.97) and construct validity. OSNAP was associated with significant increases in standards-based policy statements surrounding snacks (+2.6, p=0.003), beverages (+2.3, p=0.008), screen time (+0.8, p=0.046), family communication (+2.2, p=0.002), and a summary index of OSNAP goals (+3.3, p=0.02). CONCLUSIONS OSNAP demonstrated success in building staff capacity to write health-promoting policy statements. Future research should focus on determining policy change impact on practices. PMID:24941286

The palliative care knowledge questionnaire for PEACE: reliability and validity of an instrument to measure palliative care knowledge among physicians.

PubMed

Yamamoto, Ryo; Kizawa, Yoshiyuki; Nakazawa, Yoko; Morita, Tatsuya

2013-11-01

In Japan, a nationwide palliative care education program for primary palliative care (the Palliative care Emphasis program on symptom management and Assessment for Continuous medical Education: PEACE) was established in 2008. Effective delivery of such programs relies on adequate evaluations of program efficacy; however, such an instrument does not exist. This study aimed to develop and validate a measurement tool to quantify knowledge level of physicians about broader areas of palliative care, by which the effect of an education program could be measured. We conducted a cross-sectional, anonymous, self-administered questionnaire survey with a group of 801 conveniently sampled physicians in October 2010. To examine the test-retest reliability of items and domains, the questionnaire was reissued two weeks after the first survey was completed. This study used psychometric methods, including item response theory, intraclass correlation coefficients, and known-group validity. The response rate was 54% (n=434). We included 33 items across the following 9 domains: (1) philosophy of palliative care, (2) cancer pain, (3) side effects of opioids, (4) dyspnea, (5) nausea and vomiting, (6) psychological distress, (7) delirium, (8) communication regarding palliative care, and (9) community-based palliative care. For these items, the intraclass correlation was 0.84 and the Kuder-Richardson Formula 20 (KR-20) test of internal consistency was 0.87. There was a significant difference in the scores between palliative care specialists and other physicians. We successfully validated a newly developed palliative care knowledge questionnaire to evaluate PEACE effectiveness (PEACE-Q). The PEACE-Q could be useful for evaluating both palliative care knowledge among physicians and education programs in primary palliative care.

SURE - SEMI-MARKOV UNRELIABILITY RANGE EVALUATOR (VAX VMS VERSION)

NASA Technical Reports Server (NTRS)

Butler, R. W.

1994-01-01

The Semi-Markov Unreliability Range Evaluator, SURE, is an analysis tool for reconfigurable, fault-tolerant systems. Traditional reliability analyses are based on aggregates of fault-handling and fault-occurrence models. SURE provides an efficient means for calculating accurate upper and lower bounds for the death state probabilities for a large class of semi-Markov models, not just those which can be reduced to critical-pair architectures. The calculated bounds are close enough (usually within 5 percent of each other) for use in reliability studies of ultra-reliable computer systems. The SURE bounding theorems have algebraic solutions and are consequently computationally efficient even for large and complex systems. SURE can optionally regard a specified parameter as a variable over a range of values, enabling an automatic sensitivity analysis. Highly reliable systems employ redundancy and reconfiguration as methods of ensuring operation. When such systems are modeled stochastically, some state transitions are orders of magnitude faster than others; that is, fault recovery is usually faster than fault arrival. SURE takes these time differences into account. Slow transitions are described by exponential functions and fast transitions are modeled by either the White or Lee theorems based on means, variances, and percentiles. The user must assign identifiers to every state in the system and define all transitions in the semi-Markov model. SURE input statements are composed of variables and constants related by FORTRAN-like operators such as =, +, *, SIN, EXP, etc. There are a dozen major commands such as READ, READO, SAVE, SHOW, PRUNE, TRUNCate, CALCulator, and RUN. Once the state transitions have been defined, SURE calculates the upper and lower probability bounds for entering specified death states within a specified mission time. SURE output is tabular. The mathematical approach chosen to solve a reliability problem may vary with the size and nature of the problem. Although different solution techniques are utilized on different programs, it is possible to have a common input language. The Systems Validation Methods group at NASA Langley Research Center has created a set of programs that form the basis for a reliability analysis workstation. The set of programs are: SURE reliability analysis program (COSMIC program LAR-13789, LAR-14921); the ASSIST specification interface program (LAR-14193, LAR-14923), PAWS/STEM reliability analysis programs (LAR-14165, LAR-14920); and the FTC fault tree tool (LAR-14586, LAR-14922). FTC is used to calculate the top-event probability for a fault tree. PAWS/STEM and SURE are programs which interpret the same SURE language, but utilize different solution methods. ASSIST is a preprocessor that generates SURE language from a more abstract definition. SURE, ASSIST, and PAWS/STEM are also offered as a bundle. Please see the abstract for COS-10039/COS-10041, SARA - SURE/ASSIST Reliability Analysis Workstation, for pricing details. SURE was originally developed for DEC VAX series computers running VMS and was later ported for use on Sun computers running SunOS. The VMS version (LAR13789) is written in PASCAL, C-language, and FORTRAN 77. The standard distribution medium for the VMS version of SURE is a 9-track 1600 BPI magnetic tape in VMSINSTAL format. It is also available on a TK50 tape cartridge in VMSINSTAL format. Executables are included. The Sun UNIX version (LAR14921) is written in ANSI C-language and PASCAL. An ANSI compliant C compiler is required in order to compile the C portion of this package. The standard distribution medium for the Sun version of SURE is a .25 inch streaming magnetic tape cartridge in UNIX tar format. Both Sun3 and Sun4 executables are included. SURE was developed in 1988 and last updated in 1992. DEC, VAX, VMS, and TK50 are trademarks of Digital Equipment Corporation. TEMPLATE is a registered trademark of Template Graphics Software, Inc. UNIX is a registered trademark of AT&T Bell Laboratories. Sun3 and Sun4 are trademarks of Sun Microsystems, Inc.

SURE - SEMI-MARKOV UNRELIABILITY RANGE EVALUATOR (SUN VERSION)

NASA Technical Reports Server (NTRS)

Butler, R. W.

1994-01-01

The Semi-Markov Unreliability Range Evaluator, SURE, is an analysis tool for reconfigurable, fault-tolerant systems. Traditional reliability analyses are based on aggregates of fault-handling and fault-occurrence models. SURE provides an efficient means for calculating accurate upper and lower bounds for the death state probabilities for a large class of semi-Markov models, not just those which can be reduced to critical-pair architectures. The calculated bounds are close enough (usually within 5 percent of each other) for use in reliability studies of ultra-reliable computer systems. The SURE bounding theorems have algebraic solutions and are consequently computationally efficient even for large and complex systems. SURE can optionally regard a specified parameter as a variable over a range of values, enabling an automatic sensitivity analysis. Highly reliable systems employ redundancy and reconfiguration as methods of ensuring operation. When such systems are modeled stochastically, some state transitions are orders of magnitude faster than others; that is, fault recovery is usually faster than fault arrival. SURE takes these time differences into account. Slow transitions are described by exponential functions and fast transitions are modeled by either the White or Lee theorems based on means, variances, and percentiles. The user must assign identifiers to every state in the system and define all transitions in the semi-Markov model. SURE input statements are composed of variables and constants related by FORTRAN-like operators such as =, +, *, SIN, EXP, etc. There are a dozen major commands such as READ, READO, SAVE, SHOW, PRUNE, TRUNCate, CALCulator, and RUN. Once the state transitions have been defined, SURE calculates the upper and lower probability bounds for entering specified death states within a specified mission time. SURE output is tabular. The mathematical approach chosen to solve a reliability problem may vary with the size and nature of the problem. Although different solution techniques are utilized on different programs, it is possible to have a common input language. The Systems Validation Methods group at NASA Langley Research Center has created a set of programs that form the basis for a reliability analysis workstation. The set of programs are: SURE reliability analysis program (COSMIC program LAR-13789, LAR-14921); the ASSIST specification interface program (LAR-14193, LAR-14923), PAWS/STEM reliability analysis programs (LAR-14165, LAR-14920); and the FTC fault tree tool (LAR-14586, LAR-14922). FTC is used to calculate the top-event probability for a fault tree. PAWS/STEM and SURE are programs which interpret the same SURE language, but utilize different solution methods. ASSIST is a preprocessor that generates SURE language from a more abstract definition. SURE, ASSIST, and PAWS/STEM are also offered as a bundle. Please see the abstract for COS-10039/COS-10041, SARA - SURE/ASSIST Reliability Analysis Workstation, for pricing details. SURE was originally developed for DEC VAX series computers running VMS and was later ported for use on Sun computers running SunOS. The VMS version (LAR13789) is written in PASCAL, C-language, and FORTRAN 77. The standard distribution medium for the VMS version of SURE is a 9-track 1600 BPI magnetic tape in VMSINSTAL format. It is also available on a TK50 tape cartridge in VMSINSTAL format. Executables are included. The Sun UNIX version (LAR14921) is written in ANSI C-language and PASCAL. An ANSI compliant C compiler is required in order to compile the C portion of this package. The standard distribution medium for the Sun version of SURE is a .25 inch streaming magnetic tape cartridge in UNIX tar format. Both Sun3 and Sun4 executables are included. SURE was developed in 1988 and last updated in 1992. DEC, VAX, VMS, and TK50 are trademarks of Digital Equipment Corporation. TEMPLATE is a registered trademark of Template Graphics Software, Inc. UNIX is a registered trademark of AT&T Bell Laboratories. Sun3 and Sun4 are trademarks of Sun Microsystems, Inc.

Selenide isotope generator for the Galileo mission. Reliability program plan

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1978-10-01

The reliability program plan for the Selenide Isotope Generator (SIG) program is presented. It delineates the specific tasks that will be accomplished by Teledyne Energy Systems and its suppliers during design, development, fabrication and test of deliverable Radioisotopic Thermoelectric Generators (RTG), Electrical Heated Thermoelectric Generators (ETG) and associated Ground Support Equipment (GSE). The Plan is formulated in general accordance with procedures specified in DOE Reliability Engineering Program Requirements Publication No. SNS-2, dated June 17, 1974. The Reliability Program Plan presented herein defines the total reliability effort without further reference to Government Specifications. The reliability tasks to be accomplished are delineatedmore » herein and become the basis for contract compliance to the extent specified in the SIG contract Statement of Work.« less

78 FR 49595 - Aviation Rulemaking Advisory Committee-New Task

Federal Register 2010, 2011, 2012, 2013, 2014

2013-08-14

... the new ARAC activity and solicits membership for the Maintenance Reliability Program Working Group... establish the Maintenance Reliability Program Working Group. The working group will serve as staff to ARAC... programs. The Maintenance Reliability Program Working Group will provide advice and recommendations on the...

[An instrument in Spanish to evaluate the performance of clinical teachers by students].

PubMed

Bitran, Marcela; Mena, Beltrán; Riquelme, Arnoldo; Padilla, Oslando; Sánchez, Ignacio; Moreno, Rodrigo

2010-06-01

The modernization of clinical teaching has called for the creation of faculty development programs, and the design of suitable instruments to evaluate clinical teachers' performance. To report the development and validation of an instrument in Spanish designed to measure the students' perceptions of their clinical teachers' performance and to provide them with feedback to improve their teaching practices. In a process that included the active participation of authorities, professors in charge of courses and internships, clinical teachers, students and medical education experts, we developed a 30-item questionnaire called MEDUC30 to evaluate the performance of clinical teachers by their students. The internal validity was assessed by factor analysis of 5214 evaluations of 265 teachers, gathered from 2004 to 2007. The reliability was measured with the Cronbach's alpha coefficient and the generalizability coefficient (g). MEDUC30 had good content and construct validity. Its internal structure was compatible with four factors: patient-centered teaching, teaching skills, assessment skills and learning climate, and it proved to be consistent with the structure anticipated by the theory. The scores were highly reliable (Cronbach's alpha: 0.97); five evaluations per teacher were sufficient to reach a reliability coefficient (g) of 0.8. MEDUC30 is a valid, reliable and useful instrument to evaluate the performance of clinical teachers. To our knowledge, this is the first instrument in Spanish for which solid validity and reliability evidences have been reported. We hope that MEDUC30 will be used to improve medical education in Spanish-speaking medical schools, providing teachers a specific feedback upon which to improve their pedagogical practice, and authorities with valuable information for the assessment of their faculty.

Transit Reliability Information Program Participants Guidelines

DOT National Transportation Integrated Search

1981-03-01

The document provides guidelines for participation in the Transit Reliability Information Program (TRIP). TRIP is a government-initiated program designed to assist the transit industry in satisfying its need for transit equipment reliability data. TR...

An enhanced cluster analysis program with bootstrap significance testing for ecological community analysis

USGS Publications Warehouse

McKenna, J.E.

2003-01-01

The biosphere is filled with complex living patterns and important questions about biodiversity and community and ecosystem ecology are concerned with structure and function of multispecies systems that are responsible for those patterns. Cluster analysis identifies discrete groups within multivariate data and is an effective method of coping with these complexities, but often suffers from subjective identification of groups. The bootstrap testing method greatly improves objective significance determination for cluster analysis. The BOOTCLUS program makes cluster analysis that reliably identifies real patterns within a data set more accessible and easier to use than previously available programs. A variety of analysis options and rapid re-analysis provide a means to quickly evaluate several aspects of a data set. Interpretation is influenced by sampling design and a priori designation of samples into replicate groups, and ultimately relies on the researcher's knowledge of the organisms and their environment. However, the BOOTCLUS program provides reliable, objectively determined groupings of multivariate data.

Effectiveness evaluation of STOL transport operations (phase 2). [computer simulation program of commercial short haul aircraft operations

NASA Technical Reports Server (NTRS)

Welp, D. W.; Brown, R. A.; Ullman, D. G.; Kuhner, M. B.

1974-01-01

A computer simulation program which models a commercial short-haul aircraft operating in the civil air system was developed. The purpose of the program is to evaluate the effect of a given aircraft avionics capability on the ability of the aircraft to perform on-time carrier operations. The program outputs consist primarily of those quantities which can be used to determine direct operating costs. These include: (1) schedule reliability or delays, (2) repairs/replacements, (3) fuel consumption, and (4) cancellations. More comprehensive models of the terminal area environment were added and a simulation of an existing airline operation was conducted to obtain a form of model verification. The capability of the program to provide comparative results (sensitivity analysis) was then demonstrated by modifying the aircraft avionics capability for additional computer simulations.

Developing an Internet-based Communication System for Residency Training Programs

PubMed Central

Fortin, Auguste H; Luzzi, Kristina; Galaty, Leslie; Wong, Jeffrey G; Huot, Stephen J

2002-01-01

Administrative communication is increasingly challenging for residency programs as the number of training sites expands. The Internet provides a cost-effective opportunity to address these needs. Using the World Wide Web, we developed a single, reliable, accurate, and accessible source of administrative information for residents, faculty, and staff in a multisite internal medicine residency at reduced costs. Evaluation of the effectiveness of the website was determined by tracking website use, materials and personnel costs, and resident, staff, and faculty satisfaction. Office supply and personnel costs were reduced by 89% and personnel effort by 85%. All users were highly satisfied with the web communication tool and all reported increased knowledge of program information and a greater sense of “connectedness.” We conclude that an internet-based communication system that provides a single, reliable, accurate, and accessible source of information for residents, faculty, and staff can be developed with minimum resources and reduced costs. PMID:11972724

Quantifying Error in Survey Measures of School and Classroom Environments

ERIC Educational Resources Information Center

Schweig, Jonathan David

2014-01-01

Developing indicators that reflect important aspects of school and classroom environments has become central in a nationwide effort to develop comprehensive programs that measure teacher quality and effectiveness. Formulating teacher evaluation policy necessitates accurate and reliable methods for measuring these environmental variables. This…

76 FR 47178 - Energy Efficiency Program: Test Procedure for Lighting Systems (Luminaires)

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-04

...: Test Procedure for Lighting Systems (Luminaires) AGENCY: Office of Energy Efficiency and Renewable... (``DOE'' or the ``Department'') is currently evaluating energy efficiency test procedures for luminaires... products. DOE recognizes that well-designed test procedures are important to produce reliable, repeatable...

40 CFR 57.405 - Formulation, approval, and implementation of requirements.

Code of Federal Regulations, 2014 CFR

2014-07-01

... completion of the measures specified in the approved plan evaluating the performance and adequacy of the SCS.... The reliability study shall include a comprehensive analysis of the system's operation during one or... (CONTINUED) AIR PROGRAMS (CONTINUED) PRIMARY NONFERROUS SMELTER ORDERS Supplementary Control System...

40 CFR 57.405 - Formulation, approval, and implementation of requirements.

Code of Federal Regulations, 2012 CFR

2012-07-01

... completion of the measures specified in the approved plan evaluating the performance and adequacy of the SCS.... The reliability study shall include a comprehensive analysis of the system's operation during one or... (CONTINUED) AIR PROGRAMS (CONTINUED) PRIMARY NONFERROUS SMELTER ORDERS Supplementary Control System...

40 CFR 57.405 - Formulation, approval, and implementation of requirements.

Code of Federal Regulations, 2011 CFR

2011-07-01

... completion of the measures specified in the approved plan evaluating the performance and adequacy of the SCS.... The reliability study shall include a comprehensive analysis of the system's operation during one or... (CONTINUED) AIR PROGRAMS (CONTINUED) PRIMARY NONFERROUS SMELTER ORDERS Supplementary Control System...

40 CFR 57.405 - Formulation, approval, and implementation of requirements.

Code of Federal Regulations, 2013 CFR

2013-07-01

... completion of the measures specified in the approved plan evaluating the performance and adequacy of the SCS.... The reliability study shall include a comprehensive analysis of the system's operation during one or... (CONTINUED) AIR PROGRAMS (CONTINUED) PRIMARY NONFERROUS SMELTER ORDERS Supplementary Control System...

Twenty-fifth water reactor safety information meeting: Proceedings. Volume 2: Human reliability analysis and human performance evaluation; Technical issues related to rulemakings; Risk-informed, performance-based initiatives; High burn-up fuel research

DOE Office of Scientific and Technical Information (OSTI.GOV)

Monteleone, S.

1998-03-01

This three-volume report contains papers presented at the conference. The papers are printed in the order of their presentation in each session and describe progress and results of programs in nuclear safety research conducted in this country and abroad. Foreign participation in the meeting included papers presented by researchers from France, Japan, Norway, and Russia. The titles of the papers and the names of the authors have been updated and may differ from those that appeared in the final program of the meeting. This volume contains the following: (1) human reliability analysis and human performance evaluation; (2) technical issues relatedmore » to rulemakings; (3) risk-informed, performance-based initiatives; and (4) high burn-up fuel research. Selected papers have been indexed separately for inclusion in the Energy Science and Technology Database.« less

Transit Reliability Information Program (TRIP) : Final Technical Report

DOT National Transportation Integrated Search

1984-05-01

The Transit Reliability Information Program (TRIP) is a government-initiated program to assist the transit industry in satisfying its need for rail transit car subsystem reliability information. TRIP provided this assistance through the operation of ...

Transit Reliability Information Program (TRIP) Phase I Report

DOT National Transportation Integrated Search

1981-06-01

The Transit Reliability Information Program (TRIP) is a government initiated program to assist the transit industry in satisfying its need for transit reliability information. TRIP provides this assistance through the operation of a national reliabil...

Veterinary students' perceptions of their learning environment as measured by the Dundee Ready Education Environment Measure.

PubMed

Pelzer, Jacquelyn M; Hodgson, Jennifer L; Werre, Stephen R

2014-03-24

The Dundee Ready Education Environment Measure (DREEM) has been widely used to evaluate the learning environment within health sciences education, however, this tool has not been applied in veterinary medical education. The aim of this study was to evaluate the reliability and validity of the DREEM tool in a veterinary medical program and to determine veterinary students' perceptions of their learning environment. The DREEM is a survey tool which quantitatively measures students' perceptions of their learning environment. The survey consists of 50 items, each scored 0-4 on a Likert Scale. The 50 items are subsequently analysed within five subscales related to students' perceptions of learning, faculty (teachers), academic atmosphere, and self-perceptions (academic and social). An overall score is obtained by summing the mean score for each subscale, with an overall possible score of 200. All students in the program were asked to complete the DREEM. Means and standard deviations were calculated for the 50 items, the five subscale scores and the overall score. Cronbach's alpha was determined for the five subscales and overall score to evaluate reliability. Confirmatory factor analysis was used to evaluate construct validity. 224 responses (53%) were received. The Cronbach's alpha for the overall score was 0.93 and for the five subscales were; perceptions of learning 0.85, perceptions of faculty 0.79, perceptions of atmosphere 0.81, academic self-perceptions 0.68, and social self-perceptions 0.72. Construct validity was determined to be acceptable (p < 0.001) and all items contributed to the overall validity of the DREEM. The overall DREEM score was 128.9/200, which is a positive result based on the developers' descriptors and comparable to other health science education programs. Four individual items of concern were identified by students. In this setting the DREEM was a reliable and valid tool to measure veterinary students' perceptions of their learning environment. The four items identified as concerning originated from four of the five subscales, but all related to workload. Negative perceptions regarding workload is a common concern of students in health education programs. If not addressed, this perception may have an unfavourable impact on veterinary students' learning environment.

Curriculum Evaluation in Online Education: The Case of Teacher Candidates Preparing Online for Public Personnel Selection Examination

ERIC Educational Resources Information Center

Karacaoglu, Ömer Cem

2018-01-01

The aim of the present study is to evaluate the efficiency of an online curriculum based on the views of lecturers and students enrolled in the program. The study is mainly based on survey method. In order to collect qualitative data, interviews forms developed by the researcher were used. The reliability and validity of the interview forms were…

Translation and validation of the Malay version of the Stroke Knowledge Test.

PubMed

Sowtali, Siti Noorkhairina; Yusoff, Dariah Mohd; Harith, Sakinah; Mohamed, Monniaty

2016-04-01

To date, there is a lack of published studies on assessment tools to evaluate the effectiveness of stroke education programs. This study developed and validated the Malay language version of the Stroke Knowledge Test research instrument. This study involved translation, validity, and reliability phases. The instrument underwent backward and forward translation of the English version into the Malay language. Nine experts reviewed the content for consistency, clarity, difficulty, and suitability for inclusion. Perceived usefulness and utilization were obtained from experts' opinions. Later, face validity assessment was conducted with 10 stroke patients to determine appropriateness of sentences and grammar used. A pilot study was conducted with 41 stroke patients to determine the item analysis and reliability of the translated instrument using the Kuder Richardson 20 or Cronbach's alpha. The final Malay version Stroke Knowledge Test included 20 items with good content coverage, acceptable item properties, and positive expert review ratings. Psychometric investigations suggest that Malay version Stroke Knowledge Test had moderate reliability with Kuder Richardson 20 or Cronbach's alpha of 0.58. Improvement is required for Stroke Knowledge Test items with unacceptable difficulty indices. Overall, the average rating of perceived usefulness and perceived utility of the instruments were both 72.7%, suggesting that reviewers were likely to use the instruments in their facilities. Malay version Stroke Knowledge Test was a valid and reliable tool to assess educational needs and to evaluate stroke knowledge among participants of group-based stroke education programs in Malaysia.

Education Research: Bias and poor interrater reliability in evaluating the neurology clinical skills examination

PubMed Central

Schuh, L A.; London, Z; Neel, R; Brock, C; Kissela, B M.; Schultz, L; Gelb, D J.

2009-01-01

Objective: The American Board of Psychiatry and Neurology (ABPN) has recently replaced the traditional, centralized oral examination with the locally administered Neurology Clinical Skills Examination (NEX). The ABPN postulated the experience with the NEX would be similar to the Mini-Clinical Evaluation Exercise, a reliable and valid assessment tool. The reliability and validity of the NEX has not been established. Methods: NEX encounters were videotaped at 4 neurology programs. Local faculty and ABPN examiners graded the encounters using 2 different evaluation forms: an ABPN form and one with a contracted rating scale. Some NEX encounters were purposely failed by residents. Cohen’s kappa and intraclass correlation coefficients (ICC) were calculated for local vs ABPN examiners. Results: Ninety-eight videotaped NEX encounters of 32 residents were evaluated by 20 local faculty evaluators and 18 ABPN examiners. The interrater reliability for a determination of pass vs fail for each encounter was poor (kappa 0.32; 95% confidence interval [CI] = 0.11, 0.53). ICC between local faculty and ABPN examiners for each performance rating on the ABPN NEX form was poor to moderate (ICC range 0.14-0.44), and did not improve with the contracted rating form (ICC range 0.09-0.36). ABPN examiners were more likely than local examiners to fail residents. Conclusions: There is poor interrater reliability between local faculty and American Board of Psychiatry and Neurology examiners. A bias was detected for favorable assessment locally, which is concerning for the validity of the examination. Further study is needed to assess whether training can improve interrater reliability and offset bias. GLOSSARY ABIM = American Board of Internal Medicine; ABPN = American Board of Psychiatry and Neurology; CI = confidence interval; HFH = Henry Ford Hospital; ICC = intraclass correlation coefficients; IM = internal medicine; mini-CEX = Mini-Clinical Evaluation Exercise; NEX = Neurology Clinical Skills Examination; RITE = residency inservice training examination; UC = University of Cincinnati; UM = University of Michigan; USF = University of South Florida. PMID:19605769

PAWS/STEM - PADE APPROXIMATION WITH SCALING AND SCALED TAYLOR EXPONENTIAL MATRIX (VAX VMS VERSION)

NASA Technical Reports Server (NTRS)

Butler, R. W.

1994-01-01

Traditional fault-tree techniques for analyzing the reliability of large, complex systems fail to model the dynamic reconfiguration capabilities of modern computer systems. Markov models, on the other hand, can describe fault-recovery (via system reconfiguration) as well as fault-occurrence. The Pade Approximation with Scaling (PAWS) and Scaled Taylor Exponential Matrix (STEM) programs provide a flexible, user-friendly, language-based interface for the creation and evaluation of Markov models describing the behavior of fault-tolerant reconfigurable computer systems. PAWS and STEM produce exact solutions for the probability of system failure and provide a conservative estimate of the number of significant digits in the solution. The calculation of the probability of entering a death state of a Markov model (representing system failure) requires the solution of a set of coupled differential equations. Because of the large disparity between the rates of fault arrivals and system recoveries, Markov models of fault-tolerant architectures inevitably lead to numerically stiff differential equations. Both PAWS and STEM have the capability to solve numerically stiff models. These complementary programs use separate methods to determine the matrix exponential in the solution of the model's system of differential equations. In general, PAWS is better suited to evaluate small and dense models. STEM operates at lower precision, but works faster than PAWS for larger models. The mathematical approach chosen to solve a reliability problem may vary with the size and nature of the problem. Although different solution techniques are utilized on different programs, it is possible to have a common input language. The Systems Validation Methods group at NASA Langley Research Center has created a set of programs that form the basis for a reliability analysis workstation. The set of programs are: SURE reliability analysis program (COSMIC program LAR-13789, LAR-14921); the ASSIST specification interface program (LAR-14193, LAR-14923), PAWS/STEM reliability analysis programs (LAR-14165, LAR-14920); and the FTC fault tree tool (LAR-14586, LAR-14922). FTC is used to calculate the top-event probability for a fault tree. PAWS/STEM and SURE are programs which interpret the same SURE language, but utilize different solution methods. ASSIST is a preprocessor that generates SURE language from a more abstract definition. SURE, ASSIST, and PAWS/STEM are also offered as a bundle. Please see the abstract for COS-10039/COS-10041, SARA - SURE/ASSIST Reliability Analysis Workstation, for pricing details. PAWS/STEM was originally developed for DEC VAX series computers running VMS and was later ported for use on Sun computers running SunOS. The package is written in PASCAL, ANSI compliant C-language, and FORTRAN 77. The standard distribution medium for the VMS version of PAWS/STEM (LAR-14165) is a 9-track 1600 BPI magnetic tape in VMSINSTAL format. It is also available on a TK50 tape cartridge in VMSINSTAL format. Executables are included. The standard distribution medium for the Sun version of PAWS/STEM (LAR-14920) is a .25 inch streaming magnetic tape cartridge in UNIX tar format. Both Sun3 and Sun4 executables are included. PAWS/STEM was developed in 1989 and last updated in 1991. DEC, VAX, VMS, and TK50 are trademarks of Digital Equipment Corporation. SunOS, Sun3, and Sun4 are trademarks of Sun Microsystems, Inc. UNIX is a registered trademark of AT&T Bell Laboratories.

PAWS/STEM - PADE APPROXIMATION WITH SCALING AND SCALED TAYLOR EXPONENTIAL MATRIX (SUN VERSION)

NASA Technical Reports Server (NTRS)

Butler, R. W.

1994-01-01

Traditional fault-tree techniques for analyzing the reliability of large, complex systems fail to model the dynamic reconfiguration capabilities of modern computer systems. Markov models, on the other hand, can describe fault-recovery (via system reconfiguration) as well as fault-occurrence. The Pade Approximation with Scaling (PAWS) and Scaled Taylor Exponential Matrix (STEM) programs provide a flexible, user-friendly, language-based interface for the creation and evaluation of Markov models describing the behavior of fault-tolerant reconfigurable computer systems. PAWS and STEM produce exact solutions for the probability of system failure and provide a conservative estimate of the number of significant digits in the solution. The calculation of the probability of entering a death state of a Markov model (representing system failure) requires the solution of a set of coupled differential equations. Because of the large disparity between the rates of fault arrivals and system recoveries, Markov models of fault-tolerant architectures inevitably lead to numerically stiff differential equations. Both PAWS and STEM have the capability to solve numerically stiff models. These complementary programs use separate methods to determine the matrix exponential in the solution of the model's system of differential equations. In general, PAWS is better suited to evaluate small and dense models. STEM operates at lower precision, but works faster than PAWS for larger models. The mathematical approach chosen to solve a reliability problem may vary with the size and nature of the problem. Although different solution techniques are utilized on different programs, it is possible to have a common input language. The Systems Validation Methods group at NASA Langley Research Center has created a set of programs that form the basis for a reliability analysis workstation. The set of programs are: SURE reliability analysis program (COSMIC program LAR-13789, LAR-14921); the ASSIST specification interface program (LAR-14193, LAR-14923), PAWS/STEM reliability analysis programs (LAR-14165, LAR-14920); and the FTC fault tree tool (LAR-14586, LAR-14922). FTC is used to calculate the top-event probability for a fault tree. PAWS/STEM and SURE are programs which interpret the same SURE language, but utilize different solution methods. ASSIST is a preprocessor that generates SURE language from a more abstract definition. SURE, ASSIST, and PAWS/STEM are also offered as a bundle. Please see the abstract for COS-10039/COS-10041, SARA - SURE/ASSIST Reliability Analysis Workstation, for pricing details. PAWS/STEM was originally developed for DEC VAX series computers running VMS and was later ported for use on Sun computers running SunOS. The package is written in PASCAL, ANSI compliant C-language, and FORTRAN 77. The standard distribution medium for the VMS version of PAWS/STEM (LAR-14165) is a 9-track 1600 BPI magnetic tape in VMSINSTAL format. It is also available on a TK50 tape cartridge in VMSINSTAL format. Executables are included. The standard distribution medium for the Sun version of PAWS/STEM (LAR-14920) is a .25 inch streaming magnetic tape cartridge in UNIX tar format. Both Sun3 and Sun4 executables are included. PAWS/STEM was developed in 1989 and last updated in 1991. DEC, VAX, VMS, and TK50 are trademarks of Digital Equipment Corporation. SunOS, Sun3, and Sun4 are trademarks of Sun Microsystems, Inc. UNIX is a registered trademark of AT&T Bell Laboratories.

The multiple mini-interview for selecting medical residents: first experience in the Middle East region.

PubMed

Ahmed, Ashraf; Qayed, Khalil Ibrahim; Abdulrahman, Mahera; Tavares, Walter; Rosenfeld, Jack

2014-08-01

Numerous studies have shown that multiple mini-interviews (MMI) provides a standard, fair, and more reliable method for assessing applicants. This article presents the first MMI experience for selection of medical residents in the Middle East culture and an Arab country. In 2012, we started using the MMI in interviewing applicants to the residency program of Dubai Health Authority. This interview process consisted of eight, eight-minute structured interview scenarios. Applicants rotated through the stations, each with its own interviewer and scenario. They read the scenario and were requested to discuss the issues with the interviewers. Sociodemographic and station assessment data provided for each applicant were analyzed to determine whether the MMI was a reliable assessment of the non-clinical attributes in the present setting of an Arab country. One hundred and eighty-seven candidates from 27 different countries were interviewed for Dubai Residency Training Program using MMI. They were graduates of 5 medical universities within United Arab Emirates (UAE) and 60 different universities outside UAE. With this applicant's pool, a MMI with eight stations, produced absolute and relative reliability of 0.8 and 0.81, respectively. The person × station interaction contributed 63% of the variance components, the person contributed 34% of the variance components, and the station contributed 2% of the variance components. The MMI has been used in numerous universities in English speaking countries. The MMI evaluates non-clinical attributes and this study provides further evidence for its reliability but in a different country and culture. The MMI offers a fair and more reliable assessment of applicants to medical residency programs. The present data show that this assessment technique applied in a non-western country and Arab culture still produced reliable results.

Effects of back posture education on elementary schoolchildren's back function.

PubMed

Geldhof, Elisabeth; Cardon, Greet; De Bourdeaudhuij, Ilse; Danneels, Lieven; Coorevits, Pascal; Vanderstraeten, Guy; De Clercq, Dirk

2007-06-01

The possible effects of back education on children's back function were never evaluated. Therefore, main aim of the present study was to evaluate the effects of back education in elementary schoolchildren on back function parameters. Since the reliability of back function measurement in children is poorly defined, another objective was to test the selected instruments for reliability in 8-11-year olds. The multi-factorial intervention lasting two school-years consisted of a back education program and the stimulation of postural dynamism in the class. Trunk muscle endurance, leg muscle capacity and spinal curvature were evaluated in a pre-post design including 41 children who received the back education program (mean age at post-test: 11.2 +/- 0.9 years) and 28 controls (mean age at post-test: 11.4 +/- 0.6 years). Besides, test-retest reliability with a 1-week interval was investigated in a separate sample. Therefore, 47 children (mean age: 10.1 +/- 0.5 years) were tested for reliability of trunk muscle endurance and 40 children (mean age: 10.2 +/- 0.7 years) for the assessment of spinal curvatures. Reliability of endurance testing was very good to good for the trunk flexors (ICC = 0.82) and trunk extensors (ICC = 0.63). The assessment of the thoracic (ICC = 0.69) and the lumbar curvature (ICC = 0.52) in seating position showed good to acceptable reliability. Low ICCs were found for the assessment of the thoracic (ICC = 0.39) and the lumbar curvature (ICC = 0.37) in stance. The effects of 2 year back education showed an increase in trunk flexor endurance in the intervention group compared to a decrease in the controls and a trend towards significance for a higher increase in trunk extensor endurance in the intervention group. For leg muscle capacity and spinal curvature no intervention effects were found. The small samples recommend cautious interpretation of intervention effects. However, the present study's findings favor the implementation of back education with focus on postural dynamism in the class as an integral part of the elementary school curriculum in the scope of optimizing spinal loading through the school environment.

Diagnostic reliability of MMPI-2 computer-based test interpretations.

PubMed

Pant, Hina; McCabe, Brian J; Deskovitz, Mark A; Weed, Nathan C; Williams, John E

2014-09-01

Reflecting the common use of the MMPI-2 to provide diagnostic considerations, computer-based test interpretations (CBTIs) also typically offer diagnostic suggestions. However, these diagnostic suggestions can sometimes be shown to vary widely across different CBTI programs even for identical MMPI-2 profiles. The present study evaluated the diagnostic reliability of 6 commercially available CBTIs using a 20-item Q-sort task developed for this study. Four raters each sorted diagnostic classifications based on these 6 CBTI reports for 20 MMPI-2 profiles. Two questions were addressed. First, do users of CBTIs understand the diagnostic information contained within the reports similarly? Overall, diagnostic sorts of the CBTIs showed moderate inter-interpreter diagnostic reliability (mean r = .56), with sorts for the 1/2/3 profile showing the highest inter-interpreter diagnostic reliability (mean r = .67). Second, do different CBTIs programs vary with respect to diagnostic suggestions? It was found that diagnostic sorts of the CBTIs had a mean inter-CBTI diagnostic reliability of r = .56, indicating moderate but not strong agreement across CBTIs in terms of diagnostic suggestions. The strongest inter-CBTI diagnostic agreement was found for sorts of the 1/2/3 profile CBTIs (mean r = .71). Limitations and future directions are discussed. PsycINFO Database Record (c) 2014 APA, all rights reserved.

HiRel: Hybrid Automated Reliability Predictor (HARP) integrated reliability tool system, (version 7.0). Volume 1: HARP introduction and user's guide

NASA Technical Reports Server (NTRS)

Bavuso, Salvatore J.; Rothmann, Elizabeth; Dugan, Joanne Bechta; Trivedi, Kishor S.; Mittal, Nitin; Boyd, Mark A.; Geist, Robert M.; Smotherman, Mark D.

1994-01-01

The Hybrid Automated Reliability Predictor (HARP) integrated Reliability (HiRel) tool system for reliability/availability prediction offers a toolbox of integrated reliability/availability programs that can be used to customize the user's application in a workstation or nonworkstation environment. HiRel consists of interactive graphical input/output programs and four reliability/availability modeling engines that provide analytical and simulative solutions to a wide host of reliable fault-tolerant system architectures and is also applicable to electronic systems in general. The tool system was designed to be compatible with most computing platforms and operating systems, and some programs have been beta tested, within the aerospace community for over 8 years. Volume 1 provides an introduction to the HARP program. Comprehensive information on HARP mathematical models can be found in the references.

Small Business Innovations

NASA Technical Reports Server (NTRS)

1992-01-01

The purpose of QASE RT is to enable system analysts and software engineers to evaluate performance and reliability implications of design alternatives. The program resulted from two Small Business Innovation Research (SBIR) projects. After receiving a description of the system architecture and workload from the user, QASE RT translates the system description into simulation models and executes them. Simulation provides detailed performance evaluation. The results of the evaluations are service and response times, offered load and device utilizations and functional availability.

The need for accurate total cholesterol measurement. Recommended analytical goals, current state of reliability, and guidelines for better determinations.

PubMed

Naito, H K

1989-03-01

We have approached a dawn of a new era in detection, evaluation, treatment, and monitoring of individuals with elevated blood cholesterol levels who are at increased risk for CHD. The NHLBI's National Cholesterol Education Program will be the major force underlying this national awareness program, which is dependent on the clinical laboratories providing reliable data. Precision or reproducibility of results is not a problem for most of the laboratories, but accuracy is a major concern. Both the manufacturers and laboratorians need to standardize the measurement for cholesterol so that the accuracy base is traceable to the NCCLS NRS/CHOL. The manufacturers need to adopt a uniform policy that will ensure that the values assigned to calibration, quality control, and quality assurance or survey materials are accurate and traceable to the NCCLS/CHOL. Since, at present, there are some limitations of these materials caused by matrix effects, laboratories are encouraged to use the CDC-NHLBI National Reference Laboratory Network to evaluate and monitor their ability to measure patient blood cholesterol levels accurately. Major areas of analytical problems are identified and general, as well as specific, recommendations are provided to help ensure reliable measurement of cholesterol in patient specimens.

Coupling long and short term decisions in the design of urban water supply infrastructure for added reliability and flexibility

NASA Astrophysics Data System (ADS)

Marques, G.; Fraga, C. C. S.; Medellin-Azuara, J.

2016-12-01

The expansion and operation of urban water supply systems under growing demands, hydrologic uncertainty and water scarcity requires a strategic combination of supply sources for reliability, reduced costs and improved operational flexibility. The design and operation of such portfolio of water supply sources involves integration of long and short term planning to determine what and when to expand, and how much to use of each supply source accounting for interest rates, economies of scale and hydrologic variability. This research presents an integrated methodology coupling dynamic programming optimization with quadratic programming to optimize the expansion (long term) and operations (short term) of multiple water supply alternatives. Lagrange Multipliers produced by the short-term model provide a signal about the marginal opportunity cost of expansion to the long-term model, in an iterative procedure. A simulation model hosts the water supply infrastructure and hydrologic conditions. Results allow (a) identification of trade offs between cost and reliability of different expansion paths and water use decisions; (b) evaluation of water transfers between urban supply systems; and (c) evaluation of potential gains by reducing water system losses as a portfolio component. The latter is critical in several developing countries where water supply system losses are high and often neglected in favor of more system expansion.

Safety, reliability, maintainability and quality provisions for the Space Shuttle program

NASA Technical Reports Server (NTRS)

1990-01-01

This publication establishes common safety, reliability, maintainability and quality provisions for the Space Shuttle Program. NASA Centers shall use this publication both as the basis for negotiating safety, reliability, maintainability and quality requirements with Shuttle Program contractors and as the guideline for conduct of program safety, reliability, maintainability and quality activities at the Centers. Centers shall assure that applicable provisions of the publication are imposed in lower tier contracts. Centers shall give due regard to other Space Shuttle Program planning in order to provide an integrated total Space Shuttle Program activity. In the implementation of safety, reliability, maintainability and quality activities, consideration shall be given to hardware complexity, supplier experience, state of hardware development, unit cost, and hardware use. The approach and methods for contractor implementation shall be described in the contractors safety, reliability, maintainability and quality plans. This publication incorporates provisions of NASA documents: NHB 1700.1 'NASA Safety Manual, Vol. 1'; NHB 5300.4(IA), 'Reliability Program Provisions for Aeronautical and Space System Contractors'; and NHB 5300.4(1B), 'Quality Program Provisions for Aeronautical and Space System Contractors'. It has been tailored from the above documents based on experience in other programs. It is intended that this publication be reviewed and revised, as appropriate, to reflect new experience and to assure continuing viability.

The use and reliability of SymNose for quantitative measurement of the nose and lip in unilateral cleft lip and palate patients.

PubMed

Mosmuller, David; Tan, Robin; Mulder, Frans; Bachour, Yara; de Vet, Henrica; Don Griot, Peter

2016-10-01

It is essential to have a reliable assessment method in order to compare the results of cleft lip and palate surgery. In this study the computer-based program SymNose, a method for quantitative assessment of the nose and lip, will be assessed on usability and reliability. The symmetry of the nose and lip was measured twice in 50 six-year-old complete and incomplete unilateral cleft lip and palate patients by four observers. For the frontal view the asymmetry level of the nose and upper lip were evaluated and for the basal view the asymmetry level of the nose and nostrils were evaluated. A mean inter-observer reliability when tracing each image once or twice was 0.70 and 0.75, respectively. Tracing the photographs with 2 observers and 4 observers gave a mean inter-observer score of 0.86 and 0.92, respectively. The mean intra-observer reliability varied between 0.80 and 0.84. SymNose is a practical and reliable tool for the retrospective assessment of large caseloads of 2D photographs of cleft patients for research purposes. Moderate to high single inter-observer reliability was found. For future research with SymNose reliable outcomes can be achieved by using the average outcomes of single tracings of two observers. Copyright © 2016 European Association for Cranio-Maxillo-Facial Surgery. Published by Elsevier Ltd. All rights reserved.

Quantitative comparison and evaluation of software packages for assessment of abdominal adipose tissue distribution by magnetic resonance imaging.

PubMed

Bonekamp, S; Ghosh, P; Crawford, S; Solga, S F; Horska, A; Brancati, F L; Diehl, A M; Smith, S; Clark, J M

2008-01-01

To examine five available software packages for the assessment of abdominal adipose tissue with magnetic resonance imaging, compare their features and assess the reliability of measurement results. Feature evaluation and test-retest reliability of softwares (NIHImage, SliceOmatic, Analyze, HippoFat and EasyVision) used in manual, semi-automated or automated segmentation of abdominal adipose tissue. A random sample of 15 obese adults with type 2 diabetes. Axial T1-weighted spin echo images centered at vertebral bodies of L2-L3 were acquired at 1.5 T. Five software packages were evaluated (NIHImage, SliceOmatic, Analyze, HippoFat and EasyVision), comparing manual, semi-automated and automated segmentation approaches. Images were segmented into cross-sectional area (CSA), and the areas of visceral (VAT) and subcutaneous adipose tissue (SAT). Ease of learning and use and the design of the graphical user interface (GUI) were rated. Intra-observer accuracy and agreement between the software packages were calculated using intra-class correlation. Intra-class correlation coefficient was used to obtain test-retest reliability. Three of the five evaluated programs offered a semi-automated technique to segment the images based on histogram values or a user-defined threshold. One software package allowed manual delineation only. One fully automated program demonstrated the drawbacks of uncritical automated processing. The semi-automated approaches reduced variability and measurement error, and improved reproducibility. There was no significant difference in the intra-observer agreement in SAT and CSA. The VAT measurements showed significantly lower test-retest reliability. There were some differences between the software packages in qualitative aspects, such as user friendliness. Four out of five packages provided essentially the same results with respect to the inter- and intra-rater reproducibility. Our results using SliceOmatic, Analyze or NIHImage were comparable and could be used interchangeably. Newly developed fully automated approaches should be compared to one of the examined software packages.

Quantitative comparison and evaluation of software packages for assessment of abdominal adipose tissue distribution by magnetic resonance imaging

PubMed Central

Bonekamp, S; Ghosh, P; Crawford, S; Solga, SF; Horska, A; Brancati, FL; Diehl, AM; Smith, S; Clark, JM

2009-01-01

Objective To examine five available software packages for the assessment of abdominal adipose tissue with magnetic resonance imaging, compare their features and assess the reliability of measurement results. Design Feature evaluation and test–retest reliability of softwares (NIHImage, SliceOmatic, Analyze, HippoFat and EasyVision) used in manual, semi-automated or automated segmentation of abdominal adipose tissue. Subjects A random sample of 15 obese adults with type 2 diabetes. Measurements Axial T1-weighted spin echo images centered at vertebral bodies of L2–L3 were acquired at 1.5 T. Five software packages were evaluated (NIHImage, SliceOmatic, Analyze, HippoFat and EasyVision), comparing manual, semi-automated and automated segmentation approaches. Images were segmented into cross-sectional area (CSA), and the areas of visceral (VAT) and subcutaneous adipose tissue (SAT). Ease of learning and use and the design of the graphical user interface (GUI) were rated. Intra-observer accuracy and agreement between the software packages were calculated using intra-class correlation. Intra-class correlation coefficient was used to obtain test–retest reliability. Results Three of the five evaluated programs offered a semi-automated technique to segment the images based on histogram values or a user-defined threshold. One software package allowed manual delineation only. One fully automated program demonstrated the drawbacks of uncritical automated processing. The semi-automated approaches reduced variability and measurement error, and improved reproducibility. There was no significant difference in the intra-observer agreement in SAT and CSA. The VAT measurements showed significantly lower test–retest reliability. There were some differences between the software packages in qualitative aspects, such as user friendliness. Conclusion Four out of five packages provided essentially the same results with respect to the inter- and intra-rater reproducibility. Our results using SliceOmatic, Analyze or NIHImage were comparable and could be used interchangeably. Newly developed fully automated approaches should be compared to one of the examined software packages. PMID:17700582

Predicting the Reliability of Ceramics Under Transient Loads and Temperatures With CARES/Life

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Jadaan, Osama M.; Palfi, Tamas; Baker, Eric H.

2003-01-01

A methodology is shown for predicting the time-dependent reliability of ceramic components against catastrophic rupture when subjected to transient thermomechanical loads (including cyclic loads). The methodology takes into account the changes in material response that can occur with temperature or time (i.e., changing fatigue and Weibull parameters with temperature or time). This capability has been added to the NASA CARES/Life (Ceramic Analysis and Reliability Evaluation of Structures/Life) code. The code has been modified to have the ability to interface with commercially available finite element analysis (FEA) codes executed for transient load histories. Examples are provided to demonstrate the features of the methodology as implemented in the CARES/Life program.

Designing Computer-Based Assessments: Multidisciplinary Findings and Student Perspectives

ERIC Educational Resources Information Center

Dembitzer, Leah; Zelikovitz, Sarah; Kettler, Ryan J.

2017-01-01

A partnership was created between psychologists and computer programmers to develop a computer-based assessment program. Psychometric concerns of accessibility, reliability, and validity were juxtaposed with core development concepts of usability and user-centric design. Phases of development were iterative, with evaluation phases alternating with…

Technology Demonstration Summary Technology Evaluation Report, Site Demonstration Test, Hazcon Solidification, Douglassville, Pennsylvania

EPA Science Inventory

The major objective of the HAZCON Solidification SITE Program Demonstration Test was to develop reliable performance and cost information. The demonstration occurred at a 50-acre site of a former oil reprocessing plant at Douglassville, PA containing a wide range of organic...

Blended Learning: A Dangerous Idea?

ERIC Educational Resources Information Center

Moskal, Patsy; Dziuban, Charles; Hartman, Joel

2013-01-01

The authors make the case that implementation of a successful blended learning program requires alignment of institutional, faculty, and student goals. Reliable and robust infrastructure must be in place to support students and faculty. Continuous evaluation can effectively track the impact of blended learning on students, faculty, and the…

Evaluation of audit-based performance measures for dental care plans.

PubMed

Bader, J D; Shugars, D A; White, B A; Rindal, D B

1999-01-01

Although a set of clinical performance measures, i.e., a report card for dental plans, has been designed for use with administrative data, most plans do not have administrative data systems containing the data needed to calculate the measures. Therefore, we evaluated the use of a set of proxy clinical performance measures calculated from data obtained through chart audits. Chart audits were conducted in seven dental programs--three public health clinics, two dental health maintenance organizations (DHMO), and two preferred provider organizations (PPO). In all instances audits were completed by clinical staff who had been trained using telephone consultation and a self-instructional audit manual. The performance measures were calculated for the seven programs, audit reliability was assessed in four programs, and for one program the audit-based proxy measures were compared to the measures calculated using administrative data. The audit-based measures were sensitive to known differences in program performance. The chart audit procedures yielded reasonably reliable data. However, missing data in patient charts rendered the calculation of some measures problematic--namely, caries and periodontal disease assessment and experience. Agreement between administrative and audit-based measures was good for most, but not all, measures in one program. The audit-based proxy measures represent a complex but feasible approach to the calculation of performance measures for those programs lacking robust administrative data systems. However, until charts contain more complete diagnostic information (i.e., periodontal charting and diagnostic codes or reason-for-treatment codes), accurate determination of these aspects of clinical performance will be difficult.

Reliability history of the Apollo guidance computer

NASA Technical Reports Server (NTRS)

Hall, E. C.

1972-01-01

The Apollo guidance computer was designed to provide the computation necessary for guidance, navigation and control of the command module and the lunar landing module of the Apollo spacecraft. The computer was designed using the technology of the early 1960's and the production was completed by 1969. During the development, production, and operational phase of the program, the computer has accumulated a very interesting history which is valuable for evaluating the technology, production methods, system integration, and the reliability of the hardware. The operational experience in the Apollo guidance systems includes 17 computers which flew missions and another 26 flight type computers which are still in various phases of prelaunch activity including storage, system checkout, prelaunch spacecraft checkout, etc. These computers were manufactured and maintained under very strict quality control procedures with requirements for reporting and analyzing all indications of failure. Probably no other computer or electronic equipment with equivalent complexity has been as well documented and monitored. Since it has demonstrated a unique reliability history, it is important to evaluate the techniques and methods which have contributed to the high reliability of this computer.

Joint Winter Runway Friction Program Accomplishments

NASA Technical Reports Server (NTRS)

Yager, Thomas J.; Wambold, James C.; Henry, John J.; Andresen, Arild; Bastian, Matthew

2002-01-01

The major program objectives are: (1) harmonize ground vehicle friction measurements to report consistent friction value or index for similar contaminated runway conditions, for example, compacted snow, and (2) establish reliable correlation between ground vehicle friction measurements and aircraft braking performance. Accomplishing these objectives would give airport operators better procedures for evaluating runway friction and maintaining acceptable operating conditions, providing pilots information to base go/no go decisions, and would contribute to reducing traction-related aircraft accidents.

Timeline historical review of income and financial transactions: a reliable assessment of personal finances.

PubMed

Black, Anne C; Serowik, Kristin L; Ablondi, Karen M; Rosen, Marc I

2013-01-01

The need for accurate and reliable information about income and resources available to individuals with psychiatric disabilities is critical for the assessment of need and evaluation of programs designed to alleviate financial hardship or affect finance allocation. Measurement of finances is ubiquitous in studies of economics, poverty, and social services. However, evidence has demonstrated that these measures often contain error. We compare the 1-week test-retest reliability of income and finance data from 24 adult psychiatric outpatients using assessment-as-usual (AAU) and a new instrument, the Timeline Historical Review of Income and Financial Transactions (THRIFT). Reliability estimates obtained with the THRIFT for Income (0.77), Expenses (0.91), and Debt (0.99) domains were significantly better than those obtained with AAU. Reliability estimates for Balance did not differ. THRIFT reduced measurement error and provided more reliable information than AAU for assessment of personal finances in psychiatric patients receiving Social Security benefits. The instrument also may be useful with other low-income groups.

A Numerical Round Robin for the Reliability Prediction of Structural Ceramics

NASA Technical Reports Server (NTRS)

Powers, Lynn M.; Janosik, Lesley A.

1993-01-01

A round robin has been conducted on integrated fast fracture design programs for brittle materials. An informal working group (WELFEP-WEakest Link failure probability prediction by Finite Element Postprocessors) was formed to discuss and evaluate the implementation of the programs examined in the study. Results from the study have provided insight on the differences between the various programs examined. Conclusions from the study have shown that when brittle materials are used in design, analysis must understand how to apply the concepts presented herein to failure probability analysis.

Evaluation program for secondary spacecraft cells: Seventeenth annual report of cycle life test

NASA Technical Reports Server (NTRS)

Harkness, J. D.

1981-01-01

Acceptance tests were conducted on nickel cadmium, silver cadmium, and silver zinc cells to insure that all cells put into the life cycle program meet the specifications outlined in the respective purchase contracts. Statistical information is presented on cell performance characteristics and limitations. Weaknesses discovered in cell design are reported and aid in research and development efforts toward improving the reliability of space batteries. Battery weaknesses encountered in satellite programs such as IMP, NIMBUS, OGO, OAO, SAS, and TETR were studied and remedied through special tests.

NASA Applications and Lessons Learned in Reliability Engineering

NASA Technical Reports Server (NTRS)

Safie, Fayssal M.; Fuller, Raymond P.

2011-01-01

Since the Shuttle Challenger accident in 1986, communities across NASA have been developing and extensively using quantitative reliability and risk assessment methods in their decision making process. This paper discusses several reliability engineering applications that NASA has used over the year to support the design, development, and operation of critical space flight hardware. Specifically, the paper discusses several reliability engineering applications used by NASA in areas such as risk management, inspection policies, components upgrades, reliability growth, integrated failure analysis, and physics based probabilistic engineering analysis. In each of these areas, the paper provides a brief discussion of a case study to demonstrate the value added and the criticality of reliability engineering in supporting NASA project and program decisions to fly safely. Examples of these case studies discussed are reliability based life limit extension of Shuttle Space Main Engine (SSME) hardware, Reliability based inspection policies for Auxiliary Power Unit (APU) turbine disc, probabilistic structural engineering analysis for reliability prediction of the SSME alternate turbo-pump development, impact of ET foam reliability on the Space Shuttle System risk, and reliability based Space Shuttle upgrade for safety. Special attention is given in this paper to the physics based probabilistic engineering analysis applications and their critical role in evaluating the reliability of NASA development hardware including their potential use in a research and technology development environment.

Software reliability experiments data analysis and investigation

NASA Technical Reports Server (NTRS)

Walker, J. Leslie; Caglayan, Alper K.

1991-01-01

The objectives are to investigate the fundamental reasons which cause independently developed software programs to fail dependently, and to examine fault tolerant software structures which maximize reliability gain in the presence of such dependent failure behavior. The authors used 20 redundant programs from a software reliability experiment to analyze the software errors causing coincident failures, to compare the reliability of N-version and recovery block structures composed of these programs, and to examine the impact of diversity on software reliability using subpopulations of these programs. The results indicate that both conceptually related and unrelated errors can cause coincident failures and that recovery block structures offer more reliability gain than N-version structures if acceptance checks that fail independently from the software components are available. The authors present a theory of general program checkers that have potential application for acceptance tests.

Psychometric properties of the Peer Proficiency Assessment (PEPA): a tool for evaluation of undergraduate peer counselors' motivational interviewing fidelity.

PubMed

Mastroleo, Nadine R; Mallett, Kimberly A; Turrisi, Rob; Ray, Anne E

2009-09-01

Despite the expanding use of undergraduate student peer counseling interventions aimed at reducing college student drinking, few programs evaluate peer counselors' competency to conduct these interventions. The present research describes the development and psychometric assessments of the Peer Proficiency Assessment (PEPA), a new tool for examining Motivational Interviewing adherence in undergraduate student peer delivered interventions. Twenty peer delivered sessions were evaluated by master and undergraduate student coders using a cross-validation design to examine peer based alcohol intervention sessions. Assessments revealed high inter-rater reliability between student and master coders and good correlations between previously established fidelity tools. Findings lend support for the use of the PEPA to examine peer counselor competency. The PEPA, training for use, inter-rater reliability information, construct and predictive validity, and tool usefulness are described.

Automated Portable Test System (APTS) - A performance envelope assessment tool

NASA Technical Reports Server (NTRS)

Kennedy, R. S.; Dunlap, W. P.; Jones, M. B.; Wilkes, R. L.; Bittner, A. C., Jr.

1985-01-01

The reliability and stability of microcomputer-based psychological tests are evaluated. The hardware, test programs, and system control of the Automated Portable Test System, which assesses human performance and subjective status, are described. Subjects were administered 11 pen-and-pencil and microcomputer-based tests for 10 sessions. The data reveal that nine of the 10 tests stabilized by the third administration; inertial correlations were high and consistent. It is noted that the microcomputer-based tests display good psychometric properties in terms of differential stability and reliability.

Structural reliability methods: Code development status

NASA Astrophysics Data System (ADS)

Millwater, Harry R.; Thacker, Ben H.; Wu, Y.-T.; Cruse, T. A.

1991-05-01

The Probabilistic Structures Analysis Method (PSAM) program integrates state of the art probabilistic algorithms with structural analysis methods in order to quantify the behavior of Space Shuttle Main Engine structures subject to uncertain loadings, boundary conditions, material parameters, and geometric conditions. An advanced, efficient probabilistic structural analysis software program, NESSUS (Numerical Evaluation of Stochastic Structures Under Stress) was developed as a deliverable. NESSUS contains a number of integrated software components to perform probabilistic analysis of complex structures. A nonlinear finite element module NESSUS/FEM is used to model the structure and obtain structural sensitivities. Some of the capabilities of NESSUS/FEM are shown. A Fast Probability Integration module NESSUS/FPI estimates the probability given the structural sensitivities. A driver module, PFEM, couples the FEM and FPI. NESSUS, version 5.0, addresses component reliability, resistance, and risk.

Structural reliability methods: Code development status

NASA Technical Reports Server (NTRS)

Millwater, Harry R.; Thacker, Ben H.; Wu, Y.-T.; Cruse, T. A.

1991-01-01

The Probabilistic Structures Analysis Method (PSAM) program integrates state of the art probabilistic algorithms with structural analysis methods in order to quantify the behavior of Space Shuttle Main Engine structures subject to uncertain loadings, boundary conditions, material parameters, and geometric conditions. An advanced, efficient probabilistic structural analysis software program, NESSUS (Numerical Evaluation of Stochastic Structures Under Stress) was developed as a deliverable. NESSUS contains a number of integrated software components to perform probabilistic analysis of complex structures. A nonlinear finite element module NESSUS/FEM is used to model the structure and obtain structural sensitivities. Some of the capabilities of NESSUS/FEM are shown. A Fast Probability Integration module NESSUS/FPI estimates the probability given the structural sensitivities. A driver module, PFEM, couples the FEM and FPI. NESSUS, version 5.0, addresses component reliability, resistance, and risk.

A Theory-Grounded Measure of Adolescents’ Response to a Media Literacy Intervention

PubMed Central

Greene, Kathryn; Yanovitzky, Itzhak; Carpenter, Amanda; Banerjee, Smita C.; Magsamen-Conrad, Kate; Hecht, Michael L.; Elek, Elvira

2016-01-01

Media literacy interventions offer promising avenues for the prevention of risky health behaviors among children and adolescents, but current literature remains largely equivocal about their efficacy. The primary objective of this study was to develop and test theoretically-grounded measures of audiences’ degree of engagement with the content of media literacy programs based on the recognition that engagement (and not participation per se) can better explain and predict individual variations in the effects of these programs. We tested the validity and reliability of a measure of engagement with two different samples of 10th grade high school students who participated in a pilot and actual test of a brief media literacy curriculum. Four message evaluation factors (involvement, perceived novelty, critical thinking, personal reflection) emerged and demonstrate acceptable reliability. PMID:28042522

Program of Research, Development, Test and Evaluation, FY 1978

DTIC Science & Technology

1977-01-18

reliability of warning and the characterization of an SLSM attack. The performance of optical surveillance satellites Is gen - erally limited by the...development, and acquisition of weapon systems. Vi 1-2 o Enhance Innovation because it Is the life blood of future ac ’ fances . Most of the steps necessary

75 FR 13515 - Office of Innovation and Improvement (OII); Overview Information; Ready-to-Learn Television...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-03-22

... on rigorous scientifically based research methods to assess the effectiveness of a particular... activities and programs; and (B) Includes research that-- (i) Employs systematic, empirical methods that draw... or observational methods that provide reliable and valid data across evaluators and observers, across...

Business Administration Scale for Family Child Care, BAS

ERIC Educational Resources Information Center

Talan, Teri N.; Bloom, Paula Jorde

2009-01-01

The "BAS for Family Child Care" is the first valid and reliable tool for measuring and improving the overall quality of business and professional practices in family child care settings. It is applicable for multiple uses, including program self-improvement, technical assistance and monitoring, training, research and evaluation, and public…

A new semiquantitative method for evaluation of metastasis progression.

PubMed

Volarevic, A; Ljujic, B; Volarevic, V; Milovanovic, M; Kanjevac, T; Lukic, A; Arsenijevic, N

2012-01-01

Although recent technical advancements are directed toward developing novel assays and methods for detection of micro and macro metastasis, there are still no reports of reliable, simple to use imaging software that could be used for the detection and quantification of metastasis in tissue sections. We herein report a new semiquantitative method for evaluation of metastasis progression in a well established 4T1 orthotopic mouse model of breast cancer metastasis. The new semiquantitative method presented here was implemented by using the Autodesk AutoCAD 2012 program, a computer-aided design program used primarily for preparing technical drawings in 2 dimensions. By using the Autodesk AutoCAD 2012 software- aided graphical evaluation we managed to detect each metastatic lesion and we precisely calculated the average percentage of lung and liver tissue parenchyma with metastasis in 4T1 tumor-bearing mice. The data were highly specific and relevant to descriptive histological analysis, confirming reliability and accuracy of the AutoCAD 2012 software as new method for quantification of metastatic lesions. The new semiquantitative method using AutoCAD 2012 software provides a novel approach for the estimation of metastatic progression in histological tissue sections.

HiRel: Hybrid Automated Reliability Predictor (HARP) integrated reliability tool system, (version 7.0). Volume 4: HARP Output (HARPO) graphics display user's guide

NASA Technical Reports Server (NTRS)

Sproles, Darrell W.; Bavuso, Salvatore J.

1994-01-01

The Hybrid Automated Reliability Predictor (HARP) integrated Reliability (HiRel) tool system for reliability/availability prediction offers a toolbox of integrated reliability/availability programs that can be used to customize the user's application in a workstation or nonworkstation environment. HiRel consists of interactive graphical input/output programs and four reliability/availability modeling engines that provide analytical and simulative solutions to a wide host of highly reliable fault-tolerant system architectures and is also applicable to electronic systems in general. The tool system was designed at the outset to be compatible with most computing platforms and operating systems and some programs have been beta tested within the aerospace community for over 8 years. This document is a user's guide for the HiRel graphical postprocessor program HARPO (HARP Output). HARPO reads ASCII files generated by HARP. It provides an interactive plotting capability that can be used to display alternate model data for trade-off analyses. File data can also be imported to other commercial software programs.

[Computer assisted application of mandarin speech test materials].

PubMed

Zhang, Hua; Wang, Shuo; Chen, Jing; Deng, Jun-Min; Yang, Xiao-Lin; Guo, Lian-Sheng; Zhao, Xiao-Yan; Shao, Guang-Yu; Han, De-Min

2008-06-01

To design an intelligent speech test system with reliability and convenience using the computer software and to evaluate this system. First, the intelligent system was designed by the Delphi program language. Second, the seven monosyllabic word lists recorded on CD were separated by Cool Edit Pro v2.1 software and put into the system as test materials. Finally, the intelligent system was used to evaluate the equivalence of difficulty between seven lists. Fifty-five college students with normal hearing participated in the study. The seven monosyllabic word lists had equivalent difficulty (F = 1.582, P > 0.05) to the subjects between each other and the system was proved as reliability and convenience. The intelligent system has the feasibility in the clinical practice.

Evaluation in undergraduate medical education: Conceptualizing and validating a novel questionnaire for assessing the quality of bedside teaching.

PubMed

Dreiling, Katharina; Montano, Diego; Poinstingl, Herbert; Müller, Tjark; Schiekirka-Schwake, Sarah; Anders, Sven; von Steinbüchel, Nicole; Raupach, Tobias

2017-08-01

Evaluation is an integral part of curriculum development in medical education. Given the peculiarities of bedside teaching, specific evaluation tools for this instructional format are needed. Development of these tools should be informed by appropriate frameworks. The purpose of this study was to develop a specific evaluation tool for bedside teaching based on the Stanford Faculty Development Program's clinical teaching framework. Based on a literature review yielding 47 evaluation items, an 18-item questionnaire was compiled and subsequently completed by undergraduate medical students at two German universities. Reliability and validity were assessed in an exploratory full information item factor analysis (study one) and a confirmatory factor analysis as well as a measurement invariance analysis (study two). The exploratory analysis involving 824 students revealed a three-factor structure. Reliability estimates of the subscales were satisfactory (α = 0.71-0.84). The model yielded satisfactory fit indices in the confirmatory factor analysis involving 1043 students. The new questionnaire is short and yet based on a widely-used framework for clinical teaching. The analyses presented here indicate good reliability and validity of the instrument. Future research needs to investigate whether feedback generated from this tool helps to improve teaching quality and student learning outcome.

Development and reliability of the rating of compensatory movements in upper limb prosthesis wearers during work-related tasks.

PubMed

van der Laan, Tallie M J; Postema, Sietke G; Reneman, Michiel F; Bongers, Raoul M; van der Sluis, Corry K

2018-02-10

Reliability study. Quantifying compensatory movements during work-related tasks may help to prevent musculoskeletal complaints in individuals with upper limb absence. (1) To develop a qualitative scoring system for rating compensatory shoulder and trunk movements in upper limb prosthesis wearers during the performance of functional capacity evaluation tests adjusted for use by 1-handed individuals (functional capacity evaluation-one handed [FCE-OH]); (2) to examine the interrater and intrarater reliability of the scoring system; and (3) to assess its feasibility. Movement patterns of 12 videotaped upper limb prosthesis wearers and 20 controls were analyzed. Compensatory movements were defined for each FCE-OH test, and a scoring system was developed, pilot tested, and adjusted. During reliability testing, 18 raters (12 FCE experts and 6 physiotherapists/gait analysts) scored videotapes of upper limb prosthesis wearers performing 4 FCE-OH tests 2 times (2 weeks apart). Agreement was expressed in % and kappa value. Feasibility (focus area's "acceptability", "demand," and "implementation") was determined by using a questionnaire. After 2 rounds of pilot testing and adjusting, reliability of a third version was tested. The interrater reliability for the first and second rating sessions were к = 0.54 (confidence interval [CI]: 0.52-0.57) and к = 0.64 (CI: 0.61-0.66), respectively. The intrarater reliability was к = 0.77 (CI: 0.72-0.82). The feasibility was good but could be improved by a training program. It seems possible to identify compensatory movements in upper limb prosthesis wearers during the performance of FCE-OH tests reliably by observation using the developed observational scoring system. Interrater reliability was satisfactory in most instances; intrarater reliability was good. Feasibility was established. Copyright © 2018 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Digital electronic engine control history

NASA Technical Reports Server (NTRS)

Putnam, T. W.

1984-01-01

Full authority digital electronic engine controls (DEECs) were studied, developed, and ground tested because of projected benefits in operability, improved performance, reduced maintenance, improved reliability, and lower life cycle costs. The issues of operability and improved performance, however, are assessed in a flight test program. The DEEC on a F100 engine in an F-15 aircraft was demonstrated and evaluated. The events leading to the flight test program are chronicled and important management and technical results are identified.

10 CFR 712.19 - Removal from HRP.

Code of Federal Regulations, 2010 CFR

2010-01-01

... OF ENERGY HUMAN RELIABILITY PROGRAM Establishment of and Procedures for the Human Reliability Program... immediately remove that individual from HRP duties pending a determination of the individual's reliability. A... HRP duties pending a determination of the individual's reliability is an interim, precautionary action...

Software reliability: Application of a reliability model to requirements error analysis

NASA Technical Reports Server (NTRS)

Logan, J.

1980-01-01

The application of a software reliability model having a well defined correspondence of computer program properties to requirements error analysis is described. Requirements error categories which can be related to program structural elements are identified and their effect on program execution considered. The model is applied to a hypothetical B-5 requirement specification for a program module.

Creating High Reliability in Health Care Organizations

PubMed Central

Pronovost, Peter J; Berenholtz, Sean M; Goeschel, Christine A; Needham, Dale M; Sexton, J Bryan; Thompson, David A; Lubomski, Lisa H; Marsteller, Jill A; Makary, Martin A; Hunt, Elizabeth

2006-01-01

Objective The objective of this paper was to present a comprehensive approach to help health care organizations reliably deliver effective interventions. Context Reliability in healthcare translates into using valid rate-based measures. Yet high reliability organizations have proven that the context in which care is delivered, called organizational culture, also has important influences on patient safety. Model for Improvement Our model to improve reliability, which also includes interventions to improve culture, focuses on valid rate-based measures. This model includes (1) identifying evidence-based interventions that improve the outcome, (2) selecting interventions with the most impact on outcomes and converting to behaviors, (3) developing measures to evaluate reliability, (4) measuring baseline performance, and (5) ensuring patients receive the evidence-based interventions. The comprehensive unit-based safety program (CUSP) is used to improve culture and guide organizations in learning from mistakes that are important, but cannot be measured as rates. Conclusions We present how this model was used in over 100 intensive care units in Michigan to improve culture and eliminate catheter-related blood stream infections—both were accomplished. Our model differs from existing models in that it incorporates efforts to improve a vital component for system redesign—culture, it targets 3 important groups—senior leaders, team leaders, and front line staff, and facilitates change management—engage, educate, execute, and evaluate for planned interventions. PMID:16898981

Interviewer as instrument: accounting for human factors in evaluation research.

PubMed

Brown, Joel H

2006-04-01

This methodological study examines an original data collection model designed to incorporate human factors and enhance data richness in qualitative and evaluation research. Evidence supporting this model is drawn from in-depth youth and adult interviews in one of the largest policy/program evaluations undertaken in the United States, the Drug, Alcohol, and Tobacco Education evaluation (77 districts, 118 schools). When applying the explicit observation technique (EOT)--the strategic and nonjudgmental disclosure of nonverbal human factor cues by the interviewer to the respondent during interview--data revealed the observation disclosure pattern. Here, respondents linked perceptions with policy or program implementation or effectiveness evidence. Although more research is needed, it is concluded that the EOT yields richer data when compared with traditional semistructured interviews and, thus, holds promise to enhance qualitative and evaluation research methods. Validity and reliability as well as qualitative and evaluation research considerations are discussed.

Engineering evaluation of SSME dynamic data from engine tests and SSV flights

NASA Technical Reports Server (NTRS)

1986-01-01

An engineering evaluation of dynamic data from SSME hot firing tests and SSV flights is summarized. The basic objective of the study is to provide analyses of vibration, strain and dynamic pressure measurements in support of MSFC performance and reliability improvement programs. A brief description of the SSME test program is given and a typical test evaluation cycle reviewed. Data banks generated to characterize SSME component dynamic characteristics are described and statistical analyses performed on these data base measurements are discussed. Analytical models applied to define the dynamic behavior of SSME components (such as turbopump bearing elements and the flight accelerometer safety cut-off system) are also summarized. Appendices are included to illustrate some typical tasks performed under this study.

Evolution and outcomes of a quality improvement program.

PubMed

Thor, Johan; Herrlin, Bo; Wittlöv, Karin; Øvretveit, John; Brommels, Mats

2010-01-01

The purpose of this paper is to examine the outcomes and evolution over a five-year period of a Swedish university hospital quality improvement program in light of enduring uncertainty regarding the effectiveness of such programs in healthcare and how best to evaluate it. The paper takes the form of a case study, using data collected as part of the program, including quality indicators from clinical improvement projects and participants' program evaluations. Overall, 58 percent of the program's projects (39/67) demonstrated success. A greater proportion of projects led by female doctors demonstrated success (91 percent, n=11) than projects led by male doctors (51 percent, n=55). Facilitators at the hospital continuously adapted the improvement methods to the local context. A lack of dedicated time for improvement efforts was the participants' biggest difficulty. The dominant benefits included an increased ability to see the "bigger picture" and the improvements achieved for patients and employees. Quality measurement, which is important for conducting and evaluating improvement efforts, was weak with limited reliability. Nevertheless, the present study adds evidence about the effectiveness of healthcare improvement programs. Gender differences in improvement team leadership merit further study. Improvement program evaluation should assess the extent to which improvement methods are locally adapted and applied. This case study reports the outcomes of all improvement projects undertaken in one healthcare organization over a five-year period and provides in-depth insight into an improvement program's changeable nature.

How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE)

PubMed Central

Dwyer, Tim; Takahashi, Susan Glover; Hynes, Melissa Kennedy; Herold, Jodi; Wasserstein, David; Nousiainen, Markku; Ferguson, Peter; Wadey, Veronica; Murnaghan, M. Lucas; Leroux, Tim; Semple, John; Hodges, Brian; Ogilvie-Harris, Darrell

2014-01-01

Background Assessing residents’ understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid. Methods The OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs). Results Twenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores. Conclusion An OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program. PMID:25078926

Application of reliability-centered-maintenance to BWR ECCS motor operator valve performance

DOE Office of Scientific and Technical Information (OSTI.GOV)

Feltus, M.A.; Choi, Y.A.

1993-01-01

This paper describes the application of reliability-centered maintenance (RCM) methods to plant probabilistic risk assessment (PRA) and safety analyses for four boiling water reactor emergency core cooling systems (ECCSs): (1) high-pressure coolant injection (HPCI); (2) reactor core isolation cooling (RCIC); (3) residual heat removal (RHR); and (4) core spray systems. Reliability-centered maintenance is a system function-based technique for improving a preventive maintenance program that is applied on a component basis. Those components that truly affect plant function are identified, and maintenance tasks are focused on preventing their failures. The RCM evaluation establishes the relevant criteria that preserve system function somore » that an RCM-focused approach can be flexible and dynamic.« less

The Diagnostic Validity and Reliability of an Internet-Based Clinical Assessment Program for Mental Disorders

PubMed Central

Klein, Britt; Meyer, Denny; Austin, David William; Abbott, Jo-Anne M

2015-01-01

Background Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. Objective The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. Methods Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. Results With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder: κ=.37) to strong (eg, panic disorder: κ=.62). Although the e-PASS’ sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia: κ=.54) to substantial (eg, bulimia nervosa: κ=.87). Conclusions The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders. Trial Registration Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG). PMID:26392066

[Validation of Diabetes Mellitus Knowledge (DKN-A) and Attitude (ATT-19) Questionnaires].

PubMed

Torres, Heloisa C; Virginia A, Hortale; Schall, Virginia T

2005-12-01

To present the cross-cultural adaptation of the Diabetes Knowledge Scale and Attitudes Questionnaires targeted to evaluate Brazilian Diabetes Mellitus patients. These questionnaires underwent the following steps: presentation, translation, back translation, semantic and idiomatic assessments, cultural and conceptual similarities and a pilot test. They were administered in two opportunities a month apart in a sample of 61 Diabetes Mellitus type-2 patients from a university hospital. The study design included a test-retest reliability of the answers, which were analyzed and estimated by means of the Kappa coefficient. The findings suggested an adequacy of the instruments to the Portuguese language and Brazilian cultural identity. The Kappa coefficient in the reliability analysis showed levels of concordance from moderate to high (0.44 to 0.69) for most questions. The questionnaires proved to be of very easy understanding for the studied subjects and reliable and valid for use in the evaluation of diabetes educational programs in the reality of Brazil.

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

Trial application of reliability technology to emergency diesel generators at the Trojan Nuclear Power Plant

DOE Office of Scientific and Technical Information (OSTI.GOV)

Wong, S.M.; Boccio, J.L.; Karimian, S.

1986-01-01

In this paper, a trial application of reliability technology to the emergency diesel generator system at the Trojan Nuclear Power Plant is presented. An approach for formulating a reliability program plan for this system is being developed. The trial application has shown that a reliability program process, using risk- and reliability-based techniques, can be interwoven into current plant operational activities to help in controlling, analyzing, and predicting faults that can challenge safety systems. With the cooperation of the utility, Portland General Electric Co., this reliability program can eventually be implemented at Trojan to track its effectiveness.

HiRel: Hybrid Automated Reliability Predictor (HARP) integrated reliability tool system, (version 7.0). Volume 3: HARP Graphics Oriented (GO) input user's guide

NASA Technical Reports Server (NTRS)

Bavuso, Salvatore J.; Rothmann, Elizabeth; Mittal, Nitin; Koppen, Sandra Howell

1994-01-01

The Hybrid Automated Reliability Predictor (HARP) integrated Reliability (HiRel) tool system for reliability/availability prediction offers a toolbox of integrated reliability/availability programs that can be used to customize the user's application in a workstation or nonworkstation environment. HiRel consists of interactive graphical input/output programs and four reliability/availability modeling engines that provide analytical and simulative solutions to a wide host of highly reliable fault-tolerant system architectures and is also applicable to electronic systems in general. The tool system was designed at the outset to be compatible with most computing platforms and operating systems, and some programs have been beta tested within the aerospace community for over 8 years. This document is a user's guide for the HiRel graphical preprocessor Graphics Oriented (GO) program. GO is a graphical user interface for the HARP engine that enables the drawing of reliability/availability models on a monitor. A mouse is used to select fault tree gates or Markov graphical symbols from a menu for drawing.

CCARES: A computer algorithm for the reliability analysis of laminated CMC components

NASA Technical Reports Server (NTRS)

Duffy, Stephen F.; Gyekenyesi, John P.

1993-01-01

Structural components produced from laminated CMC (ceramic matrix composite) materials are being considered for a broad range of aerospace applications that include various structural components for the national aerospace plane, the space shuttle main engine, and advanced gas turbines. Specifically, these applications include segmented engine liners, small missile engine turbine rotors, and exhaust nozzles. Use of these materials allows for improvements in fuel efficiency due to increased engine temperatures and pressures, which in turn generate more power and thrust. Furthermore, this class of materials offers significant potential for raising the thrust-to-weight ratio of gas turbine engines by tailoring directions of high specific reliability. The emerging composite systems, particularly those with silicon nitride or silicon carbide matrix, can compete with metals in many demanding applications. Laminated CMC prototypes have already demonstrated functional capabilities at temperatures approaching 1400 C, which is well beyond the operational limits of most metallic materials. Laminated CMC material systems have several mechanical characteristics which must be carefully considered in the design process. Test bed software programs are needed that incorporate stochastic design concepts that are user friendly, computationally efficient, and have flexible architectures that readily incorporate changes in design philosophy. The CCARES (Composite Ceramics Analysis and Reliability Evaluation of Structures) program is representative of an effort to fill this need. CCARES is a public domain computer algorithm, coupled to a general purpose finite element program, which predicts the fast fracture reliability of a structural component under multiaxial loading conditions.

Development of Evaluation Indicators for Hospice and Palliative Care Professionals Training Programs in Korea.

PubMed

Kang, Jina; Park, Kyoung-Ok

2017-01-01

The importance of training for Hospice and Palliative Care (HPC) professionals has been increasing with the systemization of HPC in Korea. Hence, the need and importance of training quality for HPC professionals are growing. This study evaluated the construct validity and reliability of the Evaluation Indicators for standard Hospice and Palliative Care Training (EIHPCT) program. As a framework to develop evaluation indicators, an invented theoretical model combining Stufflebeam's CIPP (Context-Input-Process-Product) evaluation model with PRECEDE-PROCEED model was used. To verify the construct validity of the EIHPCT program, a structured survey was performed with 169 professionals who were the HPC training program administrators, trainers, and trainees. To examine the validity of the areas of the EIHPCT program, exploratory factor analysis and confirmatory factor analysis were conducted. First, in the exploratory factor analysis, the indicators with factor loadings above 0.4 were chosen as desirable items, and some cross-loaded items that loaded at 0.4 or higher on two or more factors were adjusted as the higher factor. Second, the model fit of the modified EIHPCT program was quite good in the confirmatory factor analysis (Goodness-of-Fit Index > 0.70, Comparative Fit Index > 0.80, Normed Fit Index > 0.80, Root Mean square of Residuals < 0.05). The modified model of the EIHPCT comprised 4 areas, 13 subdomains, and 61 indicators. The evaluation indicators of the modified model will be valuable references for improving the HPC professional training program.

Development and validation of an exercise performance support system for people with lower extremity impairment.

PubMed

Minor, M A; Reid, J C; Griffin, J Z; Pittman, C B; Patrick, T B; Cutts, J H

1998-02-01

To identify innovative strategies to support appropriate, self-directed exercise that increase physical activity levels of people with arthritis. This article reports on one interactive, multimedia exercise performance support system (PSS) for people with lower extremity impairments in strength or flexibility. An interdisciplinary team developed the PSS using self-report of lower extremity musculoskeletal impairments (flexibility and strength) to produce an individualized exercise program with video and print educational materials. Initial evaluation has investigated the validity and reliability of program assessments and recommendations. PSS self-report and professional assessments were similar, with more impairments indicated by self-report. PSS exercise recommendations were similar to those made by 3 expert physical therapists using the same exercise data base. Results of PSS impairment assessments were stable over a 1-week period. PSS exercise recommendations appear to be reliable and a valid reflection of current exercise knowledge in rheumatology. Furthermore, users were able to complete the computer-based program with minimal assistance and reported it to be enjoyable and informative.

Aligning English Language Testing with Curriculum

ERIC Educational Resources Information Center

Palacio, Marcela; Gaviria, Sandra; Brown, James Dean

2016-01-01

Frustrations with traditional testing led a group of teachers at the English for adults program at Universidad EAFIT (Colombia) to design tests aligned with the institutional teaching philosophy and classroom practices. This article reports on a study of an item-by-item evaluation of a series of English exams for validity and reliability in an…

An Assessment of Propensity Score Matching as a Nonexperimental Impact Estimator: Evidence from Mexico's PROGRESA Program

ERIC Educational Resources Information Center

Diaz, Juan Jose; Handa, Sudhanshu

2006-01-01

Not all policy questions can be addressed by social experiments. Nonexperimental evaluation methods provide an alternative to experimental designs but their results depend on untestable assumptions. This paper presents evidence on the reliability of propensity score matching (PSM), which estimates treatment effects under the assumption of…

Prediction of School Performance from the Minnesota Child Development Inventory: Implications for Preschool Screening.

ERIC Educational Resources Information Center

Colligan, Robert C.

Almost all preschool screening programs depend entirely on information and observations obtained during a brief evaluative session with the child. However, the logistics involved in managing large numbers of parents and children, the use of volunteers having varying degrees of sophistication or competency in assessment, the reliability and…

Using Reliable Change to Calculate Clinically Significant Progress in Children with EBD: A BHRS Program Evaluation

ERIC Educational Resources Information Center

Thoder, Vincent J.; Hesky, James G.; Cautilli, Joseph D.

2010-01-01

Children often have complex emotional and behavioral disorders (ADHD, ODD, Depression, PTSD, etc.). A large amount of research exists in the behavioral treatment of children with these disorders regarding specific behavioral problems. Much less research exists for the treatment of comprehensive problematic behaviors that these children experience…

Examining the Quality of IEPs for Young Children with Autism

ERIC Educational Resources Information Center

Ruble, Lisa A.; McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2010-01-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool's reliability; test the tool on a pilot sample of IEPs of young children; and examine…

A Computer Program for Reliability Evaluation of Large-Scale Undirected Networks via Polygon-to-Chain Reductions.

DTIC Science & Technology

1983-10-01

UNLIMITED. It ’Partially supported by Conselho Nacional de Desenvolvimento Cientifico e Tecnologico - CNPq, Brazil. Reproduction in whole or in part is...Desenvolvimento Cientifico e Tecnologico - CNPq, Brazil. Reproduction in whole or in part is per- mitted for any purpose of the United States Goverment

Evaluating the Validity and Reliability of a Student Self-Advocacy Teacher Rating Scale

ERIC Educational Resources Information Center

Walick, Christopher M.

2017-01-01

Self-advocacy skills are critical to high school and post-secondary success. Unfortunately, students with disabilities often times struggle with self-advocacy. While there are effective, evidence-based programs to teach self-advocacy skills, there are few scales that directly measure self-advocacy. The current research study was conducted to…

Evaluating the treatment efficacy of Bacillus thuriengiensis Var. Kurstaki: reliability of various tools

Treesearch

Ghislain Rousseau

2003-01-01

The success of an operational or pilot insecticide spraying program against the spruce budworm (Choristoneura fumiferana Clemens) depends to a great extent on a variety of factors, and, in particular on: spraying efficacy and the meteorological conditions during and immediately following spraying. Among other things, spraying efficacy depends on:...

Market study phase 2 follow-up activity. The Baylor Mark 3 Haploscope

NASA Technical Reports Server (NTRS)

1977-01-01

Efforts to accelerate commercialization of the haploscope, and to determine quickly and reliably the level of manufacturer interest in the product are presented. The nature of the decision making process within firms as it concerns project selection and new product evaluation is discussed. Implications for the NASA marketing program were assessed.

Thick thermal barrier coatings for diesel engines

NASA Technical Reports Server (NTRS)

Beardsley, M. Brad

1995-01-01

Caterpillar's approach to applying thick thermal barrier coatings (TTBC's) to diesel engine combustion chambers has been to use advanced modeling techniques to predict engine conditions and combine this information with fundamental property evaluation of TTBC systems to predict engine performance and TTBC stress states. Engine testing has been used to verify the predicted performance of the TTBC systems and provide information on failure mechanisms. The objective Caterpillar's program to date has been to advance the fundamental understanding of thick thermal barrier coating systems. Previous reviews of thermal barrier coating technology concluded that the current level of understanding of coating system behavior is inadequate and the lack of fundamental understanding may impeded the application of TTBC's to diesel engines. Areas of TTBC technology being examined in this program include powder characteristics and chemistry; bond coat composition; coating design, microstructure, and thickness as they affect properties, durability, and reliability; and TTBC 'aging' effects (microstructural and property changes) under diesel engine operating conditions. Methods to evaluate the reliability and durability of TTBC's have been developed that attempt to understand the fundamental strength of TTBC's for particular stress states.

Measurement of cognitive performance in computer programming concept acquisition: interactive effects of visual metaphors and the cognitive style construct.

PubMed

McKay, E

2000-01-01

An innovative research program was devised to investigate the interactive effect of instructional strategies enhanced with text-plus-textual metaphors or text-plus-graphical metaphors, and cognitive style on the acquisition of programming concepts. The Cognitive Styles Analysis (CSA) program (Riding,1991) was used to establish the participants' cognitive style. The QUEST Interactive Test Analysis System (Adams and Khoo,1996) provided the cognitive performance measuring tool, which ensured an absence of error measurement in the programming knowledge testing instruments. Therefore, reliability of the instrumentation was assured through the calibration techniques utilized by the QUEST estimate; providing predictability of the research design. A means analysis of the QUEST data, using the Cohen (1977) approach to size effect and statistical power further quantified the significance of the findings. The experimental methodology adopted for this research links the disciplines of instructional science, cognitive psychology, and objective measurement to provide reliable mechanisms for beneficial use in the evaluation of cognitive performance by the education, training and development sectors. Furthermore, the research outcomes will be of interest to educators, cognitive psychologists, communications engineers, and computer scientists specializing in computer-human interactions.

GUI Type Fault Diagnostic Program for a Turboshaft Engine Using Fuzzy and Neural Networks

NASA Astrophysics Data System (ADS)

Kong, Changduk; Koo, Youngju

2011-04-01

The helicopter to be operated in a severe flight environmental condition must have a very reliable propulsion system. On-line condition monitoring and fault detection of the engine can promote reliability and availability of the helicopter propulsion system. A hybrid health monitoring program using Fuzzy Logic and Neural Network Algorithms can be proposed. In this hybrid method, the Fuzzy Logic identifies easily the faulted components from engine measuring parameter changes, and the Neural Networks can quantify accurately its identified faults. In order to use effectively the fault diagnostic system, a GUI (Graphical User Interface) type program is newly proposed. This program is composed of the real time monitoring part, the engine condition monitoring part and the fault diagnostic part. The real time monitoring part can display measuring parameters of the study turboshaft engine such as power turbine inlet temperature, exhaust gas temperature, fuel flow, torque and gas generator speed. The engine condition monitoring part can evaluate the engine condition through comparison between monitoring performance parameters the base performance parameters analyzed by the base performance analysis program using look-up tables. The fault diagnostic part can identify and quantify the single faults the multiple faults from the monitoring parameters using hybrid method.

Quality Evaluation of Raw Moutan Cortex Using the AHP and Gray Correlation-TOPSIS Method

PubMed Central

Zhou, Sujuan; Liu, Bo; Meng, Jiang

2017-01-01

Background: Raw Moutan cortex (RMC) is an important Chinese herbal medicine. Comprehensive and objective quality evaluation of Chinese herbal medicine has been one of the most important issues in the modern herbs development. Objective: To evaluate and compare the quality of RMC using the weighted gray correlation- Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) method. Materials and Methods: The percentage composition of gallic acid, catechin, oxypaeoniflorin, paeoniflorin, quercetin, benzoylpaeoniflorin, paeonol in different batches of RMC was determined, and then adopting MATLAB programming to construct the gray correlation-TOPSIS assessment model for quality evaluation of RMC. Results: The quality evaluation results of model evaluation and objective evaluation were consistent, reliable, and stable. Conclusion: The model of gray correlation-TOPSIS can be well applied to the quality evaluation of traditional Chinese medicine with multiple components and has broad prospect in application. SUMMARY The experiment tries to construct a model to evaluate the quality of RMC using the weighted gray correlation- Technique for Order Preference by Similarity to an Ideal Solution (TOPSIS) method. Results show the model is reliable and provide a feasible way in evaluating quality of traditional Chinese medicine with multiple components. PMID:28839384

76 FR 17159 - Office of New Reactors; Final Interim Staff Guidance on Standard Review Plan, Section 17.4...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-03-28

... Interim Staff Guidance on Standard Review Plan, Section 17.4, ``Reliability Assurance Program'' AGENCY... design reliability assurance program (RAP). This ISG updates the guidance provided to the staff in Standard Review Plan (SRP), Section 17.4, ``Reliability Assurance Program,'' of NUREG-0800, ``Standard...

Evaluating plyometric exercises using time to stabilization.

PubMed

Ebben, William P; Vanderzanden, Tyler; Wurm, Bradley J; Petushek, Erich J

2010-02-01

Plyometric exercises are frequently used in strength and conditioning and rehabilitation programs because the landing phase of these exercises requires dynamic stabilization. This study examined the differences in landing stability of a variety of plyometric exercises by assessing time to stabilization (TTS), its reliability, and sex differences therein. Forty-nine men and women performed a variety of plyometric exercises thought to represent a continuum of difficulty of dynamic stabilization during landing. Plyometric exercises included line hops, cone hops, squat jumps, tuck jumps, countermovement jumps, dumbbell countermovement jumps, and single leg countermovement jumps, each performed for 3 repetitions on a force platform. A 2-way mixed analysis of covariance with repeated measures for plyometric exercise type was used to evaluate the main effects for plyometric exercise type and the interaction between plyometric exercise type and sex for TTS. Subject jumping ability was evaluated as a covariate. Results revealed significant main effects for plyometric exercise type (p < or = 0.001) and for the interaction between plyometric exercise type and sex (p = 0.002). Bonferroni adjusted post hoc analysis demonstrated differences in TTS between a number of plyometric exercises for men and women. Reliability analysis revealed intraclass correlation coefficients ranging from 0.51 to 0.86 with no significant difference between trials (p > 0.05). Practitioners who use plyometrics to train dynamic stability should create programs that progress the intensity of the exercises based on the results of this study. This study also demonstrated that TTS is moderately to highly reliable for a variety of jumping conditions for both men and women.

Criteria for Evaluating Alternative Network and Link Layer Protocols for the NASA Constellation Program Communication Architecture

NASA Technical Reports Server (NTRS)

Benbenek, Daniel; Soloff, Jason; Lieb, Erica

2010-01-01

Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.

Comment on "Evaluation of X-ray diffraction methods for determining the crystal growth mechanisms of clay minerals in mudstones, shales and slates," by L. N. Warr and D. R. Peacor

USGS Publications Warehouse

Eberl, D.D.; Srodon, J.; Drits, V.A.

2003-01-01

A recent paper by Warr and Peacor (2002) suggested that our use of the Bertaut-Warren-Averbach technique (MudMaster computer program) for studying changes in crystallite thickness distributions (CTDs) of clay minerals during diagenesis and very low-grade metamorphism is not reliable because it is dependent on many variables which can not be fully controlled. Furthermore, the authors implied that the measured shapes of CTDs cannot be used with confidence to deduce crystal growth mechanisms and histories for clays, based on our CTD simulation approach (using the Galoper computer program). We disagree with both points, and show that the techniques are powerful, reliable and useful for studying clay mineral alteration in rocks. ?? 2003 Schweiz. Mineral. Petrogr. Ges.

Standardizing an approach to the evaluation of implementation science proposals.

PubMed

Crable, Erika L; Biancarelli, Dea; Walkey, Allan J; Allen, Caitlin G; Proctor, Enola K; Drainoni, Mari-Lynn

2018-05-29

The fields of implementation and improvement sciences have experienced rapid growth in recent years. However, research that seeks to inform health care change may have difficulty translating core components of implementation and improvement sciences within the traditional paradigms used to evaluate efficacy and effectiveness research. A review of implementation and improvement sciences grant proposals within an academic medical center using a traditional National Institutes of Health framework highlighted the need for tools that could assist investigators and reviewers in describing and evaluating proposed implementation and improvement sciences research. We operationalized existing recommendations for writing implementation science proposals as the ImplemeNtation and Improvement Science Proposals Evaluation CriTeria (INSPECT) scoring system. The resulting system was applied to pilot grants submitted to a call for implementation and improvement science proposals at an academic medical center. We evaluated the reliability of the INSPECT system using Krippendorff's alpha coefficients and explored the utility of the INSPECT system to characterize common deficiencies in implementation research proposals. We scored 30 research proposals using the INSPECT system. Proposals received a median cumulative score of 7 out of a possible score of 30. Across individual elements of INSPECT, proposals scored highest for criteria rating evidence of a care or quality gap. Proposals generally performed poorly on all other criteria. Most proposals received scores of 0 for criteria identifying an evidence-based practice or treatment (50%), conceptual model and theoretical justification (70%), setting's readiness to adopt new services/treatment/programs (54%), implementation strategy/process (67%), and measurement and analysis (70%). Inter-coder reliability testing showed excellent reliability (Krippendorff's alpha coefficient 0.88) for the application of the scoring system overall and demonstrated reliability scores ranging from 0.77 to 0.99 for individual elements. The INSPECT scoring system presents a new scoring criteria with a high degree of inter-rater reliability and utility for evaluating the quality of implementation and improvement sciences grant proposals.

Reliability Analysis for AFTI-F16 SRFCS Using ASSIST and SURE

NASA Technical Reports Server (NTRS)

Wu, N. Eva

2001-01-01

This paper reports the results of a study on reliability analysis of an AFTI-16 Self-Repairing Flight Control System (SRFCS) using software tools SURE (Semi-Markov Unreliability Range Evaluator and ASSIST (Abstract Semi-Markov Specification Interface to the SURE Tool). The purpose of the study is to investigate the potential utility of the software tools in the ongoing effort of the NASA Aviation Safety Program, where the class of systems must be extended beyond the originally intended serving class of electronic digital processors. The study concludes that SURE and ASSIST are applicable to reliability, analysis of flight control systems. They are especially efficient for sensitivity analysis that quantifies the dependence of system reliability on model parameters. The study also confirms an earlier finding on the dominant role of a parameter called a failure coverage. The paper will remark on issues related to the improvement of coverage and the optimization of redundancy level.

Joint Air-to-Surface Standoff Missile (JASSM)

DTIC Science & Technology

2015-12-01

6.1.3) All Ops All Ops Joint Critical Ops All Ops All Ops Missile Reliability (KSA) (CPD para 6.2.8) 4th Lot .91 4th Lot .91 IOT &E .80 4th Lot .85 IOT &E...the ORD 303-95-III dated January 20, 2004 Change Explanations None Acronyms and Abbreviations IOT &E - Initial Operational Test and Evaluation KSA... Actuator Control Card, Lots 12 and 4 Systems Engineering Program Support/Program Tooling and Test Equipment, and JASSM-ER Standard Data Protocol (DS

The RAND Online Measure Repository for Evaluating Psychological Health and Traumatic Brain Injury Programs. The RAND Toolkit, Volume 2

DTIC Science & Technology

2014-01-01

tempo may raise the risk for mental health challenges. During this time, the U.S. Department of Defense (DoD) has implemented numerous programs to...and were based on the constraints of each electronic database. However, most searches were variations on a basic three-category format: The first...Gerontology, 1983, 38: 111–116. Iannuzzo RW, Jaeger J, Goldberg JF, Kafantaris V, Sublette ME. “Development and Reliability of the Ham-D/MADRS

New Brunswick Laboratory: Progress report, October 1987--September 1988

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

NBL has been tasked by the DOE Office of Safeguards and Security, Defense Programs (OSS/DP) to assure the application of accurate and reliable measurement technology for the safeguarding of special nuclear materials. NBL is fulfilling its mission responsibilities by identifying and addressing the measurement and measurement-related needs of the nuclear material safeguards community. These responsibilities are being addressed by activities in the following program areas: (1) reference and calibration materials, (2) measurement development, (3) measurement services, (4) measurement evaluation, (5) safeguards assessment, and (6) site-specific assistance. Highlights of each of these programs areas are provided in this summary.

Safety considerations in the design and operation of large wind turbines

NASA Technical Reports Server (NTRS)

Reilly, D. H.

1979-01-01

The engineering and safety techniques used to assure the reliable and safe operation of large wind turbine generators utilizing the Mod 2 Wind Turbine System Program as an example is described. The techniques involve a careful definition of the wind turbine's natural and operating environments, use of proven structural design criteria and analysis techniques, an evaluation of potential failure modes and hazards, and use of a fail safe and redundant component engineering philosophy. The role of an effective quality assurance program, tailored to specific hardware criticality, and the checkout and validation program developed to assure system integrity are described.

Flight evaluation results from the general-aviation advanced avionics system program

NASA Technical Reports Server (NTRS)

Callas, G. P.; Denery, D. G.; Hardy, G. H.; Nedell, B. F.

1983-01-01

A demonstration advanced avionics system (DAAS) for general-aviation aircraft was tested at NASA Ames Research Center to provide information required for the design of reliable, low-cost, advanced avionics systems which would make general-aviation operations safer and more practicable. Guest pilots flew a DAAS-equipped NASA Cessna 402-B aircraft to evaluate the usefulness of data busing, distributed microprocessors, and shared electronic displays, and to provide data on the DAAS pilot/system interface for the design of future integrated avionics systems. Evaluation results indicate that the DAAS hardware and functional capability meet the program objective. Most pilots felt that the DAAS representative of the way avionics systems would evolve and felt the added capability would improve the safety and practicability of general-aviation operations. Flight-evaluation results compiled from questionnaires are presented, the results of the debriefings are summarized. General conclusions of the flight evaluation are included.

UNIX-based operating systems robustness evaluation

NASA Technical Reports Server (NTRS)

Chang, Yu-Ming

1996-01-01

Robust operating systems are required for reliable computing. Techniques for robustness evaluation of operating systems not only enhance the understanding of the reliability of computer systems, but also provide valuable feed- back to system designers. This thesis presents results from robustness evaluation experiments on five UNIX-based operating systems, which include Digital Equipment's OSF/l, Hewlett Packard's HP-UX, Sun Microsystems' Solaris and SunOS, and Silicon Graphics' IRIX. Three sets of experiments were performed. The methodology for evaluation tested (1) the exception handling mechanism, (2) system resource management, and (3) system capacity under high workload stress. An exception generator was used to evaluate the exception handling mechanism of the operating systems. Results included exit status of the exception generator and the system state. Resource management techniques used by individual operating systems were tested using programs designed to usurp system resources such as physical memory and process slots. Finally, the workload stress testing evaluated the effect of the workload on system performance by running a synthetic workload and recording the response time of local and remote user requests. Moderate to severe performance degradations were observed on the systems under stress.

Psychosocial Adjustment to Illness Scale: Factor structure, reliability, and validity assessment in a sample of Greek breast cancer patients.

PubMed

Kolokotroni, Philippa; Anagnostopoulos, Fotios; Missitzis, Ioannis

2017-07-01

The study and measurement of psychosocial adjustment is important for evaluating patients' well-being, and assessing the illness's course, treatment's success, and patients' recovery. In this study, internal consistency reliability and construct validity of the Greek version of the Psychosocial Adjustment to Illness Scale-Self-Report (PAIS-SR) were examined. Demographic and psychosocial data were collected from a sample of 243 women with breast cancer, recruited from September 2011 to December 2012. With some exceptions in specific items, the original conceptually-derived PAIS-SR subscales emerged in a seven-factor solution. Social Environment, Job and Household Duties, and Psychological Distress accounted for more of the total variance than other subscales. PAIS-SR showed good internal consistency reliability, with Cronbach's alpha coefficients >0.62. Correlations of PAIS-SR domains with measures of quality of life and posttraumatic stress symptoms supported the convergent validity of the PAIS-SR and its significance for cancer research. The Greek version of the PAIS-SR has acceptable internal consistency reliability and construct validity, as well as satisfactory convergent validity. Results provide some suggestions for the development of programs to evaluate adjustment status and implement psychosocial interventions among breast cancer survivors.

Probabilistic Prediction of Lifetimes of Ceramic Parts

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Gyekenyesi, John P.; Jadaan, Osama M.; Palfi, Tamas; Powers, Lynn; Reh, Stefan; Baker, Eric H.

2006-01-01

ANSYS/CARES/PDS is a software system that combines the ANSYS Probabilistic Design System (PDS) software with a modified version of the Ceramics Analysis and Reliability Evaluation of Structures Life (CARES/Life) Version 6.0 software. [A prior version of CARES/Life was reported in Program for Evaluation of Reliability of Ceramic Parts (LEW-16018), NASA Tech Briefs, Vol. 20, No. 3 (March 1996), page 28.] CARES/Life models effects of stochastic strength, slow crack growth, and stress distribution on the overall reliability of a ceramic component. The essence of the enhancement in CARES/Life 6.0 is the capability to predict the probability of failure using results from transient finite-element analysis. ANSYS PDS models the effects of uncertainty in material properties, dimensions, and loading on the stress distribution and deformation. ANSYS/CARES/PDS accounts for the effects of probabilistic strength, probabilistic loads, probabilistic material properties, and probabilistic tolerances on the lifetime and reliability of the component. Even failure probability becomes a stochastic quantity that can be tracked as a response variable. ANSYS/CARES/PDS enables tracking of all stochastic quantities in the design space, thereby enabling more precise probabilistic prediction of lifetimes of ceramic components.

Examples of Nonconservatism in the CARE 3 Program

NASA Technical Reports Server (NTRS)

Dotson, Kelly J.

1988-01-01

This paper presents parameter regions in the CARE 3 (Computer-Aided Reliability Estimation version 3) computer program where the program overestimates the reliability of a modeled system without warning the user. Five simple models of fault-tolerant computer systems are analyzed; and, the parameter regions where reliability is overestimated are given. The source of the error in the reliability estimates for models which incorporate transient fault occurrences was not readily apparent. However, the source of much of the error for models with permanent and intermittent faults can be attributed to the choice of values for the run-time parameters of the program.

DATMAN: A reliability data analysis program using Bayesian updating

DOE Office of Scientific and Technical Information (OSTI.GOV)

Becker, M.; Feltus, M.A.

1996-12-31

Preventive maintenance (PM) techniques focus on the prevention of failures, in particular, system components that are important to plant functions. Reliability-centered maintenance (RCM) improves on the PM techniques by introducing a set of guidelines by which to evaluate the system functions. It also minimizes intrusive maintenance, labor, and equipment downtime without sacrificing system performance when its function is essential for plant safety. Both the PM and RCM approaches require that system reliability data be updated as more component failures and operation time are acquired. Systems reliability and the likelihood of component failures can be calculated by Bayesian statistical methods, whichmore » can update these data. The DATMAN computer code has been developed at Penn State to simplify the Bayesian analysis by performing tedious calculations needed for RCM reliability analysis. DATMAN reads data for updating, fits a distribution that best fits the data, and calculates component reliability. DATMAN provides a user-friendly interface menu that allows the user to choose from several common prior and posterior distributions, insert new failure data, and visually select the distribution that matches the data most accurately.« less

Hierarchical Bayesian Model Averaging for Chance Constrained Remediation Designs

NASA Astrophysics Data System (ADS)

Chitsazan, N.; Tsai, F. T.

2012-12-01

Groundwater remediation designs are heavily relying on simulation models which are subjected to various sources of uncertainty in their predictions. To develop a robust remediation design, it is crucial to understand the effect of uncertainty sources. In this research, we introduce a hierarchical Bayesian model averaging (HBMA) framework to segregate and prioritize sources of uncertainty in a multi-layer frame, where each layer targets a source of uncertainty. The HBMA framework provides an insight to uncertainty priorities and propagation. In addition, HBMA allows evaluating model weights in different hierarchy levels and assessing the relative importance of models in each level. To account for uncertainty, we employ a chance constrained (CC) programming for stochastic remediation design. Chance constrained programming was implemented traditionally to account for parameter uncertainty. Recently, many studies suggested that model structure uncertainty is not negligible compared to parameter uncertainty. Using chance constrained programming along with HBMA can provide a rigorous tool for groundwater remediation designs under uncertainty. In this research, the HBMA-CC was applied to a remediation design in a synthetic aquifer. The design was to develop a scavenger well approach to mitigate saltwater intrusion toward production wells. HBMA was employed to assess uncertainties from model structure, parameter estimation and kriging interpolation. An improved harmony search optimization method was used to find the optimal location of the scavenger well. We evaluated prediction variances of chloride concentration at the production wells through the HBMA framework. The results showed that choosing the single best model may lead to a significant error in evaluating prediction variances for two reasons. First, considering the single best model, variances that stem from uncertainty in the model structure will be ignored. Second, considering the best model with non-dominant model weight may underestimate or overestimate prediction variances by ignoring other plausible propositions. Chance constraints allow developing a remediation design with a desirable reliability. However, considering the single best model, the calculated reliability will be different from the desirable reliability. We calculated the reliability of the design for the models at different levels of HBMA. The results showed that by moving toward the top layers of HBMA, the calculated reliability converges to the chosen reliability. We employed the chance constrained optimization along with the HBMA framework to find the optimal location and pumpage for the scavenger well. The results showed that using models at different levels in the HBMA framework, the optimal location of the scavenger well remained the same, but the optimal extraction rate was altered. Thus, we concluded that the optimal pumping rate was sensitive to the prediction variance. Also, the prediction variance was changed by using different extraction rate. Using very high extraction rate will cause prediction variances of chloride concentration at the production wells to approach zero regardless of which HBMA models used.

Software For Computing Reliability Of Other Software

NASA Technical Reports Server (NTRS)

Nikora, Allen; Antczak, Thomas M.; Lyu, Michael

1995-01-01

Computer Aided Software Reliability Estimation (CASRE) computer program developed for use in measuring reliability of other software. Easier for non-specialists in reliability to use than many other currently available programs developed for same purpose. CASRE incorporates mathematical modeling capabilities of public-domain Statistical Modeling and Estimation of Reliability Functions for Software (SMERFS) computer program and runs in Windows software environment. Provides menu-driven command interface; enabling and disabling of menu options guides user through (1) selection of set of failure data, (2) execution of mathematical model, and (3) analysis of results from model. Written in C language.

Pilot study of a budget-tailored culinary nutrition education program for undergraduate food science students

NASA Astrophysics Data System (ADS)

Kerrison, Dorothy Adair

The primary objective of this pilot study is to provide evidence that a budget-tailored culinary nutrition program is both appropriate and applicable to undergraduate food science students both in everyday life as well as their future health careers. Two validated programs were combined into one program in order to evaluate their combined effects: Cooking With a Chef and Cooking Matters at the Store. The secondary objective of this pilot study is to evaluate the components and reliability of a questionnaire created specifically for this pilot study. A review of past literature was written, which included culinary nutrition as a source of primary prevention, the importance of incorporating cost with culinary nutrition, and the importance of incorporating cost with culinary nutrition. Based on the literature review, it was determined that a budget-tailored culinary nutrition program was appropriate and applicable to undergraduate food science students interested in pursuing health-related careers. The pilot study design was a semi-crossover study: all four groups received the program, however, two groups were first treated as the control groups. All fifty-four participants received 5 sessions of culinary nutrition information from Cooking With a Chef, collaboratively delivered by a nutrition educator and a chef, and one session of information about shopping healthy on a budget from Cooking Matters at the Store in the form of a grocery store tour led by the nutrition educator. Three questionnaires were administered to the participants that evaluated culinary nutrition and price knowledge, cooking attitudes, and opinions of the programs' relevance to participants' everyday lives and careers. Two of the questionnaires, including a questionnaire developed specifically for the pilot study, were delivered as a pre- and post-test while the third questionnaire was delivered as a post-test. Eight random participants also partook in a focus group session led by the nutrition educator. Based on statistical results, there were significant differences between the treatment group and control group in Cooking Self-Efficacy (p=0.0024), Self-Efficacy for Using Basic Cooking Techniques (p=<0.0001), Self-Efficacy for Using Fruits, Vegetables, and Seasonings (p=<0.0001), and the ability to use economical methods to purchase low-cost produce and identify different forms of produce (p=<0.0001). For the one-time post-program administered questionnaire, the participants received an average score of 89.44 percent. The reliability procedure performed on the pilot study questionnaire showed that 13 of the 15 items were statistically reliable (p<0.05). The factor analysis procedure performed showed that there were five factors within the pilot study questionnaire. Participant responses from the focus group included how the program was a positive change from other mandatory courses, reaffirmed or increased interest in their major(s) and applied both to their everyday life and future career. This pilot study demonstrates preliminary results of the effects of combining culinary nutrition information with budget and price concepts to deliver to undergraduate food science students. The significance of understanding both culinary nutrition and price is important in order to effectively deliver nutrition counseling to patients of all different demographics. Additional testing and modification could be performed on the curriculum as well as the pilot study questionnaire in order to effectively relate the instrument to the program and increase the instrument's reliability.

The Efficacy of Stuttering Measurement Training: Evaluating Two Training Programs

PubMed Central

Bainbridge, Lauren A.; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong

2015-01-01

Purpose Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Method Four groups, each with 12 randomly allocated participants, completed a pretest–posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Results Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. Conclusions The SMS program was shown to produce a “medium” effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training. PMID:25629956

The efficacy of stuttering measurement training: evaluating two training programs.

PubMed

Bainbridge, Lauren A; Stavros, Candace; Ebrahimian, Mineh; Wang, Yuedong; Ingham, Roger J

2015-04-01

Two stuttering measurement training programs currently used for training clinicians were evaluated for their efficacy in improving the accuracy of total stuttering event counting. Four groups, each with 12 randomly allocated participants, completed a pretest-posttest design training study. They were evaluated by their counts of stuttering events on eight 3-min audiovisual speech samples from adults and children who stutter. Stuttering judgment training involved use of either the Stuttering Measurement System (SMS), Stuttering Measurement Assessment and Training (SMAAT) programs, or no training. To test for the reliability of any training effect, SMS training was repeated with the 4th group. Both SMS-trained groups produced approximately 34% improvement, significantly better than no training or the SMAAT program. The SMAAT program produced a mixed result. The SMS program was shown to produce a "medium" effect size improvement in the accuracy of stuttering event counts, and this improvement was almost perfectly replicated in a 2nd group. Half of the SMAAT judges produced a 36% improvement in accuracy, but the other half showed no improvement. Additional studies are needed to demonstrate the durability of the reported improvements, but these positive effects justify the importance of stuttering measurement training.

Reliability and validity of assessing subspecialty level of faculty anesthesiologists' supervision of anesthesiology residents.

PubMed

De Oliveira, Gildasio S; Dexter, Franklin; Bialek, Jane M; McCarthy, Robert J

2015-01-01

Supervision of anesthesiology residents is a major responsibility of faculty (academic) anesthesiologists. Supervision can be evaluated daily for individual anesthesiologists using a 9-question instrument. Faculty anesthesiologists with lesser individual scores contribute to lesser departmental (global) scores. Low (<3, "frequent") department-wide evaluations of supervision are associated with more mistakes with negative consequences to patients. With the long-term aim for residency programs to be evaluated partly based on the quality of their resident supervision, we assessed the 9-item instrument's reliability and validity when used to compare anesthesia programs' rotations nationwide. One thousand five hundred residents in the American Society of Anesthesiologists' directory of anesthesia trainees were randomly selected to be participants. Residents were contacted via e-mail and requested to complete a Web-based survey. Nonrespondents were mailed a paper version of the survey. Internal consistency of the supervision scale was excellent, with Cronbach's α = 0.909 (95% CI, 0.896-0.922, n = 641 respondents). Discriminant validity was found based on absence of rank correlation of supervision score with characteristics of the respondents and programs (all P > 0.10): age, hours worked per week, female, year of anesthesia training, weeks in the current rotation, sequence of survey response, size of residency class, and number of survey respondents from the current rotation and program. Convergent validity was found based on significant positive correlation between supervision score and variables related to safety culture (all P < 0.0001): "Overall perceptions of patient safety," "Teamwork within units," "Nonpunitive response to errors," "Handoffs and transitions," "Feedback and communication about error," "Communication openness," and rotation's "overall grade on patient safety." Convergent validity was found also based on significant negative correlation with variables related to the individual resident's burnout (all P < 0.0001): "I feel burnout from my work," "I have become more callous toward people since I took this job," and numbers of "errors with potential negative consequences to patients [that you have] made and/or witnessed." Usefulness was shown by supervision being predicted by the same 1 variable for each of 3 regression tree criteria: "Teamwork within [the rotation]" (e.g., "When one area in this rotation gets busy, others help out"). Evaluation of the overall quality of supervision of residents by faculty anesthesiologists depends on the reliability and validity of the instrument. Our results show that the 9-item de Oliveira Filho et al. supervision scale can be applied for overall (department, rotation) assessment of anesthesia training programs.

Johnson Space Center's Risk and Reliability Analysis Group 2008 Annual Report

NASA Technical Reports Server (NTRS)

Valentine, Mark; Boyer, Roger; Cross, Bob; Hamlin, Teri; Roelant, Henk; Stewart, Mike; Bigler, Mark; Winter, Scott; Reistle, Bruce; Heydorn,Dick

2009-01-01

The Johnson Space Center (JSC) Safety & Mission Assurance (S&MA) Directorate s Risk and Reliability Analysis Group provides both mathematical and engineering analysis expertise in the areas of Probabilistic Risk Assessment (PRA), Reliability and Maintainability (R&M) analysis, and data collection and analysis. The fundamental goal of this group is to provide National Aeronautics and Space Administration (NASA) decisionmakers with the necessary information to make informed decisions when evaluating personnel, flight hardware, and public safety concerns associated with current operating systems as well as with any future systems. The Analysis Group includes a staff of statistical and reliability experts with valuable backgrounds in the statistical, reliability, and engineering fields. This group includes JSC S&MA Analysis Branch personnel as well as S&MA support services contractors, such as Science Applications International Corporation (SAIC) and SoHaR. The Analysis Group s experience base includes nuclear power (both commercial and navy), manufacturing, Department of Defense, chemical, and shipping industries, as well as significant aerospace experience specifically in the Shuttle, International Space Station (ISS), and Constellation Programs. The Analysis Group partners with project and program offices, other NASA centers, NASA contractors, and universities to provide additional resources or information to the group when performing various analysis tasks. The JSC S&MA Analysis Group is recognized as a leader in risk and reliability analysis within the NASA community. Therefore, the Analysis Group is in high demand to help the Space Shuttle Program (SSP) continue to fly safely, assist in designing the next generation spacecraft for the Constellation Program (CxP), and promote advanced analytical techniques. The Analysis Section s tasks include teaching classes and instituting personnel qualification processes to enhance the professional abilities of our analysts as well as performing major probabilistic assessments used to support flight rationale and help establish program requirements. During 2008, the Analysis Group performed more than 70 assessments. Although all these assessments were important, some were instrumental in the decisionmaking processes for the Shuttle and Constellation Programs. Two of the more significant tasks were the Space Transportation System (STS)-122 Low Level Cutoff PRA for the SSP and the Orion Pad Abort One (PA-1) PRA for the CxP. These two activities, along with the numerous other tasks the Analysis Group performed in 2008, are summarized in this report. This report also highlights several ongoing and upcoming efforts to provide crucial statistical and probabilistic assessments, such as the Extravehicular Activity (EVA) PRA for the Hubble Space Telescope service mission and the first fully integrated PRAs for the CxP's Lunar Sortie and ISS missions.

Design for Reliability and Safety Approach for the NASA New Launch Vehicle

NASA Technical Reports Server (NTRS)

Safie, Fayssal, M.; Weldon, Danny M.

2007-01-01

The United States National Aeronautics and Space Administration (NASA) is in the midst of a space exploration program intended for sending crew and cargo to the international Space Station (ISS), to the moon, and beyond. This program is called Constellation. As part of the Constellation program, NASA is developing new launch vehicles aimed at significantly increase safety and reliability, reduce the cost of accessing space, and provide a growth path for manned space exploration. Achieving these goals requires a rigorous process that addresses reliability, safety, and cost upfront and throughout all the phases of the life cycle of the program. This paper discusses the "Design for Reliability and Safety" approach for the NASA new crew launch vehicle called ARES I. The ARES I is being developed by NASA Marshall Space Flight Center (MSFC) in support of the Constellation program. The ARES I consists of three major Elements: A solid First Stage (FS), an Upper Stage (US), and liquid Upper Stage Engine (USE). Stacked on top of the ARES I is the Crew exploration vehicle (CEV). The CEV consists of a Launch Abort System (LAS), Crew Module (CM), Service Module (SM), and a Spacecraft Adapter (SA). The CEV development is being led by NASA Johnson Space Center (JSC). Designing for high reliability and safety require a good integrated working environment and a sound technical design approach. The "Design for Reliability and Safety" approach addressed in this paper discusses both the environment and the technical process put in place to support the ARES I design. To address the integrated working environment, the ARES I project office has established a risk based design group called "Operability Design and Analysis" (OD&A) group. This group is an integrated group intended to bring together the engineering, design, and safety organizations together to optimize the system design for safety, reliability, and cost. On the technical side, the ARES I project has, through the OD&A environment, implemented a probabilistic approach to analyze and evaluate design uncertainties and understand their impact on safety, reliability, and cost. This paper focuses on the use of the various probabilistic approaches that have been pursued by the ARES I project. Specifically, the paper discusses an integrated functional probabilistic analysis approach that addresses upffont some key areas to support the ARES I Design Analysis Cycle (DAC) pre Preliminary Design (PD) Phase. This functional approach is a probabilistic physics based approach that combines failure probabilities with system dynamics and engineering failure impact models to identify key system risk drivers and potential system design requirements. The paper also discusses other probabilistic risk assessment approaches planned by the ARES I project to support the PD phase and beyond.

Stochastic-Strength-Based Damage Simulation of Ceramic Matrix Composite Laminates

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Mital, Subodh K.; Murthy, Pappu L. N.; Bednarcyk, Brett A.; Pineda, Evan J.; Bhatt, Ramakrishna T.; Arnold, Steven M.

2016-01-01

The Finite Element Analysis-Micromechanics Analysis Code/Ceramics Analysis and Reliability Evaluation of Structures (FEAMAC/CARES) program was used to characterize and predict the progressive damage response of silicon-carbide-fiber-reinforced reaction-bonded silicon nitride matrix (SiC/RBSN) composite laminate tensile specimens. Studied were unidirectional laminates [0] (sub 8), [10] (sub 8), [45] (sub 8), and [90] (sub 8); cross-ply laminates [0 (sub 2) divided by 90 (sub 2),]s; angled-ply laminates [plus 45 (sub 2) divided by -45 (sub 2), ]s; doubled-edge-notched [0] (sub 8), laminates; and central-hole laminates. Results correlated well with the experimental data. This work was performed as a validation and benchmarking exercise of the FEAMAC/CARES program. FEAMAC/CARES simulates stochastic-based discrete-event progressive damage of ceramic matrix composite and polymer matrix composite material structures. It couples three software programs: (1) the Micromechanics Analysis Code with Generalized Method of Cells (MAC/GMC), (2) the Ceramics Analysis and Reliability Evaluation of Structures Life Prediction Program (CARES/Life), and (3) the Abaqus finite element analysis program. MAC/GMC contributes multiscale modeling capabilities and micromechanics relations to determine stresses and deformations at the microscale of the composite material repeating-unit-cell (RUC). CARES/Life contributes statistical multiaxial failure criteria that can be applied to the individual brittle-material constituents of the RUC, and Abaqus is used to model the overall composite structure. For each FEAMAC/CARES simulation trial, the stochastic nature of brittle material strength results in random, discrete damage events that incrementally progress until ultimate structural failure.

A Survey of Clinical Faculty Calibration in Dental Hygiene Programs.

PubMed

Dicke, Nichole L; Hodges, Kathleen O; Rogo, Ellen J; Hewett, Beverly J

2015-08-01

This study investigated the calibration efforts of entry-level dental hygiene programs in the U.S. Four aspects were explored, including attitudes, characteristics, quality and satisfaction, to evaluate current calibration practices. A descriptive comparative survey design was used. Directors of accredited dental hygiene programs (n=345) were asked to forward an electronic survey invitation to clinical faculty. Eighty-five directors forwarded the survey to 847 faculty; 45.3% (n=384) participated. The 37-item survey contained multiple-choice and Likert scale questions and was available for 3 weeks. Descriptive statistics were used to analyze demographic data and research questions. The Kruskal-Wallis, Spearman Correlation Coefficient and Mann-Whitney U tests were employed to analyze hypotheses (p=0.05). The demographic profile for participants revealed that most worked for institutions awarding associate entry-level degrees, had 1 to 10 years' experience, taught clinically and didactically, and held a master's degree. Clinical instructors valued calibration, believed it reduced variation and wanted more calibration. Some were not offered quality calibration. There was a difference between the entry-level degree awarded and the program's evaluation of clinical skill faculty reliability, as analyzed using the Kruskal-Wallis test (p=0.008). Additionally, full-time versus part-time educators reported more observed student frustration with faculty variance, as evaluated using the Mann-Whitney U test (p=0.001, bfp=0.004). Faculty members value calibration's potential benefits and want enhanced calibration efforts. Calibration efforts need to be improved to include standards for measuring intra- and inter-rater reliability and plans for resolving inconsistencies. More research is needed to determine effective calibration methods and their impact on student learning. Copyright © 2015 The American Dental Hygienists’ Association.

An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders.

PubMed

Kirigin, K A; Braukmann, C J; Atwater, J D; Wolf, M M

1982-01-01

Juvenile crime is a serious problem for which treatment approach has been found to be reliably effective. This outcome evaluation assessed during and posttreatment effectiveness of Teaching-Family group home treatment programs for juvenile offenders. The evaluation included the original Achievement Place program, which was the prototype for the development of the Teaching-Family treatment approach, 12 replications of Achievement Place, and 9 comparison group home programs. Primary dependent measures were retrieved from court and police files and included number of alleged offenses, percentage of youths involved in those alleged offenses, and percentage of youths institutionalized. Other dependent measures were subjective ratings of effectiveness obtained from the program consumers, including the group home residents. The results showed difference during treatment favoring the Teaching-Family programs on rate of alleged criminal offenses, percentage of youths involved in those offenses, and consumer ratings of the programs. The consumer ratings provided by the youths and their school teachers were found to be inversely and significantly correlated with the reduction of criminal offenses during treatment. There were no significant differences during treatment on measures of noncriminal offenses (e.g., truancy, runaway, and curfew violations). In the posttreatment year, none of the differences between the groups was significant on any of the outcome measures. The results are discussed in terms of measurement and design issues in the evaluation of delinquency treatment programs and in relation to the evaluation; of Teaching-Family group homes by Richard Jones and his colleagues.

An evaluation of Teaching-Family (Achievement Place) group homes for juvenile offenders.

PubMed Central

Kirigin, K A; Braukmann, C J; Atwater, J D; Wolf, M M

1982-01-01

Juvenile crime is a serious problem for which treatment approach has been found to be reliably effective. This outcome evaluation assessed during and posttreatment effectiveness of Teaching-Family group home treatment programs for juvenile offenders. The evaluation included the original Achievement Place program, which was the prototype for the development of the Teaching-Family treatment approach, 12 replications of Achievement Place, and 9 comparison group home programs. Primary dependent measures were retrieved from court and police files and included number of alleged offenses, percentage of youths involved in those alleged offenses, and percentage of youths institutionalized. Other dependent measures were subjective ratings of effectiveness obtained from the program consumers, including the group home residents. The results showed difference during treatment favoring the Teaching-Family programs on rate of alleged criminal offenses, percentage of youths involved in those offenses, and consumer ratings of the programs. The consumer ratings provided by the youths and their school teachers were found to be inversely and significantly correlated with the reduction of criminal offenses during treatment. There were no significant differences during treatment on measures of noncriminal offenses (e.g., truancy, runaway, and curfew violations). In the posttreatment year, none of the differences between the groups was significant on any of the outcome measures. The results are discussed in terms of measurement and design issues in the evaluation of delinquency treatment programs and in relation to the evaluation; of Teaching-Family group homes by Richard Jones and his colleagues. PMID:7096223

Fault Tree Analysis.

PubMed

McElroy, Lisa M; Khorzad, Rebeca; Rowe, Theresa A; Abecassis, Zachary A; Apley, Daniel W; Barnard, Cynthia; Holl, Jane L

The purpose of this study was to use fault tree analysis to evaluate the adequacy of quality reporting programs in identifying root causes of postoperative bloodstream infection (BSI). A systematic review of the literature was used to construct a fault tree to evaluate 3 postoperative BSI reporting programs: National Surgical Quality Improvement Program (NSQIP), Centers for Medicare and Medicaid Services (CMS), and The Joint Commission (JC). The literature review revealed 699 eligible publications, 90 of which were used to create the fault tree containing 105 faults. A total of 14 identified faults are currently mandated for reporting to NSQIP, 5 to CMS, and 3 to JC; 2 or more programs require 4 identified faults. The fault tree identifies numerous contributing faults to postoperative BSI and reveals substantial variation in the requirements and ability of national quality data reporting programs to capture these potential faults. Efforts to prevent postoperative BSI require more comprehensive data collection to identify the root causes and develop high-reliability improvement strategies.

Reliability and validity of the Minnesota Multiphasic Personality Inventory-2-Restructured Form (MMPI-2-RF) in evaluations of chronic low back pain patients.

PubMed

Tarescavage, Anthony M; Scheman, Judith; Ben-Porath, Yossef S

2015-06-01

The purpose of the current study was to investigate the reliability and concurrent validity of Minnesota Multiphasic Personality Inventory (MMPI)-2-Restructured Form (2-RF) (Ben-Porath & Tellegen, 2008/2011) scores in a sample of 811 chronic low back pain patients (346 males, 529 females) beginning treatment in a short-term interdisciplinary pain rehabilitation program. We calculated internal consistency coefficients, mean-item correlations, and SEM for all substantive scales, as well as zero-order correlations with collateral medical record information and self-report testing. Results indicated reliability and validity for most of the MMPI-2-RF substantive scales. Implications of these findings and limitations of this study are discussed. (c) 2015 APA, all rights reserved).

Demand response, behind-the-meter generation and air quality.

PubMed

Zhang, Xiyue; Zhang, K Max

2015-02-03

We investigated the implications of behind-the-meter (BTM) generation participating in demand response (DR) programs. Specifically, we evaluated the impacts of NOx emissions from BTM generators enrolled in the New York Independent System Operator (NYISO)'s reliability-based DR programs. Through analyzing the DR program enrollment data, DR event records, ozone air quality monitoring data, and emission characteristics of the generators, we found that the emissions from BTM generators very likely contribute to exceedingly high ozone concentrations in the Northeast Corridor region, and very likely account for a substantial fraction of total NOx emissions from electricity generation. In addition, a companion study showed that the emissions from BTM generators could also form near-source particulate matter (PM) hotspots. The important policy implications are that the absence of up-to-date regulations on BTM generators may offset the current efforts to reduce the emissions from peaking power plants, and that there is a need to quantify the environmental impacts of DR programs in designing sound policies related to demand-side resources. Furthermore, we proposed the concept of "Green" DR resources, referring to those that not only provide power systems reliability services, but also have verifiable environmental benefits or minimal negative environmental impacts. We argue that Green DR resources that are able to maintain resource adequacy and reduce emissions at the same time are key to achieving the cobenefits of power system reliability and protecting public health during periods with peak electricity demand.

Validity and reliability of the robotic objective structured assessment of technical skills

PubMed Central

Siddiqui, Nazema Y.; Galloway, Michael L.; Geller, Elizabeth J.; Green, Isabel C.; Hur, Hye-Chun; Langston, Kyle; Pitter, Michael C.; Tarr, Megan E.; Martino, Martin A.

2015-01-01

Objective Objective structured assessments of technical skills (OSATS) have been developed to measure the skill of surgical trainees. Our aim was to develop an OSATS specifically for trainees learning robotic surgery. Study Design This is a multi-institutional study in eight academic training programs. We created an assessment form to evaluate robotic surgical skill through five inanimate exercises. Obstetrics/gynecology, general surgery, and urology residents, fellows, and faculty completed five robotic exercises on a standard training model. Study sessions were recorded and randomly assigned to three blinded judges who scored performance using the assessment form. Construct validity was evaluated by comparing scores between participants with different levels of surgical experience; inter- and intra-rater reliability were also assessed. Results We evaluated 83 residents, 9 fellows, and 13 faculty, totaling 105 participants; 88 (84%) were from obstetrics/gynecology. Our assessment form demonstrated construct validity, with faculty and fellows performing significantly better than residents (mean scores: 89 ± 8 faculty; 74 ± 17 fellows; 59 ± 22 residents, p<0.01). In addition, participants with more robotic console experience scored significantly higher than those with fewer prior console surgeries (p<0.01). R-OSATS demonstrated good inter-rater reliability across all five drills (mean Cronbach's α: 0.79 ± 0.02). Intra-rater reliability was also high (mean Spearman's correlation: 0.91 ± 0.11). Conclusions We developed an assessment form for robotic surgical skill that demonstrates construct validity, inter- and intra-rater reliability. When paired with standardized robotic skill drills this form may be useful to distinguish between levels of trainee performance. PMID:24807319

Psychometric Properties of Korean Version of the Second Victim Experience and Support Tool (K-SVEST).

PubMed

Kim, Eun-Mi; Kim, Sun-Aee; Lee, Ju-Ry; Burlison, Jonathan D; Oh, Eui Geum

2018-02-13

"Second victims" are defined as healthcare professionals whose wellness is influenced by adverse clinical events. The Second Victim Experience and Support Tool (SVEST) was used to measure the second-victim experience and quality of support resources. Although the reliability and validity of the original SVEST have been validated, those for the Korean tool have not been validated. The aim of the study was to evaluate the psychometric properties of the Korean version of the SVEST. The study included 305 clinical nurses as participants. The SVEST was translated into Korean via back translation. Content validity was assessed by seven experts, and test-retest reliability was evaluated by 30 clinicians. Internal consistency and construct validity were assessed via confirmatory factor analysis. The analyses were performed using SPSS 23.0 and STATA 13.0 software. The content validity index value demonstrated validity; item- and scale-level content validity index values were both 0.95. Test-retest reliability and internal consistency reliability were satisfactory: the intraclass consistent coefficient was 0.71, and Cronbach α values ranged from 0.59 to 0.87. The CFA showed a significantly good fit for an eight-factor structure (χ = 578.21, df = 303, comparative fit index = 0.92, Tucker-Lewis index = 0.90, root mean square error of approximation = 0.05). The K-SVEST demonstrated good psychometric properties and adequate validity and reliability. The results showed that the Korean version of SVEST demonstrated the extent of second victimhood and support resources in Korean healthcare workers and could aid in the development of support programs and evaluation of their effectiveness.

[Use of the reliable change index to evaluate the effectiveness of clinical interventions: Application of an asthma training program].

PubMed

Montero, Mikel; Iraurgi, Ioseba; Matellanes, Begoña; Montero, José Manuel

2015-12-01

To compare two methods for the evaluation of outcomes to assess effectiveness of a therapeutic intervention of a professional education program on asthma control. A naturalistic, intervention study in which asthmatic patients were attended by clinicians (IG group) who Had taken part in a special education program and a control group (CG) that received medical assistance from clinicians still waiting to be trained. Five urban Primary Care Health Centres of the same region. From an initial sample of 100 patients, 76 formed the final sample for analysis. The study included 37 males and 39 females, aged between 18 and 65 years (M=41.2 years). The two study groups were found to be homogeneous except for the sex variable. Training program for clinical treatment adherence. Peak flow as spirometric index, and structured interview. The results were initially analysed using classical techniques based on robust ANOVA models, and then by calculating the Reliable Change Index (RCI). ANOVA models, conducted separately for each sex, showed no significant differences, due to sample size. RCI methodology showed significant differences in the percentage of patients improved in both groups, as well as clinically relevant changes being observed individually. The RCI method is presented as an attractive alternative as regards the classical methods of analysis that can help in the clinical decision. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

The evaluation of reproductive health PhD program in Iran: The input indicators analysis.

PubMed

AbdiShahshahani, Mahshid; Ehsanpour, Soheila; Yamani, Nikoo; Kohan, Shahnaz

2014-11-01

Appropriate quality achievement of a PhD program requires frequent assessment and discovering the shortcomings in the program. Inputs, which are important elements of the curriculum, are frequently missed in evaluations. The purpose of this study was to evaluate the input indicators of reproductive health PhD program in Iran based on the Context, Input, Process, and Product (CIPP) evaluation model. This is a descriptive and evaluative study based on the CIPP evaluation model. It was conducted in 2013 in four Iranian schools of nursing and midwifery of medical sciences universities. Statistical population consisted of four groups: heads of departments (n = 5), faculty members (n = 18), graduates (n = 12), and PhD students of reproductive health (n = 54). Data collection tools were five separate questionnaires including 37 indicators that were developed by the researcher. Content and face validity were evaluated based on the experts' indications. The Cronbach's alpha coefficient was calculated in order to obtain the reliability of the questionnaires. Collected data were analyzed by SPSS software. Data were analyzed by descriptive statistics (mean, frequency, percentage, and standard deviation), and one-way analysis of variance (ANOVA) and least significant difference (LSD) post hoc tests to compare means between groups. The results of the study indicated that the highest percentage of the heads of departments (80%), graduates (66.7%), and students (68.5%) evaluated the status of input indicators of reproductive health PhD program as relatively appropriate, while most of the faculties (66.7%) evaluated that as appropriate. It is suggested to explore the reasons for relatively appropriate evaluation of input indicators by further academic researches and improve the reproductive health PhD program accordingly.

Reliability of an Automated High-Resolution Manometry Analysis Program across Expert Users, Novice Users, and Speech-Language Pathologists

ERIC Educational Resources Information Center

Jones, Corinne A.; Hoffman, Matthew R.; Geng, Zhixian; Abdelhalim, Suzan M.; Jiang, Jack J.; McCulloch, Timothy M.

2014-01-01

Purpose: The purpose of this study was to investigate inter- and intrarater reliability among expert users, novice users, and speech-language pathologists with a semiautomated high-resolution manometry analysis program. We hypothesized that all users would have high intrarater reliability and high interrater reliability. Method: Three expert…

Development of a Rating Form to Evaluate Grant Applications to the Hogg Foundation for Mental Health

ERIC Educational Resources Information Center

Whaley, Arthur L.; Rodriguez, Reymundo; Alexander, Laurel A.

2006-01-01

Reliance on subjective grant proposal review methods leads private philanthropies to underfund mental health programs, even when foundations have mental health focuses. This article describes a private mental health foundation's efforts to increase the objectivity of its proposal review process by developing a reliable, valid proposal rating form.…

Commercial remote sensing & spatial information (CRS & SI) technologies program for reliable transportation systems planning : volume 1 - comparative evaluation of link-level travel time from different technologies and sources.

DOT National Transportation Integrated Search

2015-03-01

Accurate travel time information is required to efficiently plan and effectively manage transportation network. Technologies and : private data sources such as INRIX, TomTom and HERE offer the potential to continuously collect travel time data and us...

The Tentative Drug Use Scale: A Quick and Relatively Problem Free Outcome Measure for Drug Abuse Prevention Projects

ERIC Educational Resources Information Center

Horan, John J.; Williams, John M.

1975-01-01

Difficulties involved with the evaluation of drug abuse prevention programs are numerous. Tentative Drug Use Scale (TDUS) was designed in response to a number of specific problems associated with obtaining behavioral data. Advantages of this scale over others are discussed. Reliability and validity information are provided. (Author)

Tests of the Validity and Reliability of the Community Service Attitudes Scale

ERIC Educational Resources Information Center

Perry, Brian; Osbaldiston, Richard; Henning, Jaime

2014-01-01

Community service is deeply rooted in American culture. There have been repeated calls for the necessity of evaluating these programs, especially for service-learning. The purpose of this research was to validate an easy-to-use scale that measures 10 components of students' attitudes toward community service. The sample was drawn from two…

Performance Assessments in Science: Hands-On Tasks and Scoring Guides.

ERIC Educational Resources Information Center

Stecher, Brian M.; Klein, Stephen P.

In 1992, RAND received a grant from the National Science Foundation to study the technical quality of performance assessments in science and to evaluate their feasibility for use in large-scale testing programs. The specific goals of the project were to assess the reliability and validity of hands-on science testing and to investigate the cost and…

What the Research Tells Us about the Impact of Induction and Mentoring Programs for Beginning Teachers

ERIC Educational Resources Information Center

Ingersoll, Richard; Strong, Michael

2012-01-01

This chapter summarizes a comprehensive and critical review that the authors recently completed of empirical studies that evaluate the effects of induction on various outcomes. The review's objective was to provide researchers, policy makers, and educators with a reliable and current assessment of what is known and not known about the…

Reliability Evaluation of Concentrator Photovoltaic Modules per IEC Qualification Specifications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Tamizhmani, Govindasamy

2012-12-05

This project is related to the qualification testing of new generation CPV (concentrator photovoltaics) modules at lower testing costs and lower turnaround time. In this project, the first testing program was completed for two CPV manufacturers, the second testing program was completed for two manufacturers at 65% of the actual testing cost and at less than 3 months of testing turnaround time and the third testing program was completed for two manufacturers at 65% of the actual testing cost and at less than 3 months of testing turnaround time. Due to their financial situation and restructuring, Amonix (one of themore » CPV manufacturers) intermittently terminated the test programs.« less

The Role of Demand Response in Reducing Water-Related Power Plant Vulnerabilities

NASA Astrophysics Data System (ADS)

Macknick, J.; Brinkman, G.; Zhou, E.; O'Connell, M.; Newmark, R. L.; Miara, A.; Cohen, S. M.

2015-12-01

The electric sector depends on readily available water supplies for reliable and efficient operation. Elevated water temperatures or low water levels can trigger regulatory or plant-level decisions to curtail power generation, which can affect system cost and reliability. In the past decade, dozens of power plants in the U.S. have curtailed generation due to water temperatures and water shortages. Curtailments occur during the summer, when temperatures are highest and there is greatest demand for electricity. Climate change could alter the availability and temperature of water resources, exacerbating these issues. Constructing alternative cooling systems to address vulnerabilities can be capital intensive and can also affect power plant efficiencies. Demand response programs are being implemented by electric system planners and operators to reduce and shift electricity demands from peak usage periods to other times of the day. Demand response programs can also play a role in reducing water-related power sector vulnerabilities during summer months. Traditionally, production cost modeling and demand response analyses do not include water resources. In this effort, we integrate an electricity production cost modeling framework with water-related impacts on power plants in a test system to evaluate the impacts of demand response measures on power system costs and reliability. Specifically, we i) quantify the cost and reliability implications of incorporating water resources into production cost modeling, ii) evaluate the impacts of demand response measures on reducing system costs and vulnerabilities, and iii) consider sensitivity analyses with cooling systems to highlight a range of potential benefits of demand response measures. Impacts from climate change on power plant performance and water resources are discussed. Results provide key insights to policymakers and practitioners for reducing water-related power plant vulnerabilities via lower cost methods.

Effectiveness of different approaches to disseminating traveler information on travel time reliability.

DOT National Transportation Integrated Search

2014-01-01

The second Strategic Highway Research Program (SHRP 2) Reliability program aims to improve trip time reliability by reducing the frequency and effects of events that cause travel times to fluctuate unpredictably. Congestion caused by unreliable, or n...

Evaluation of on-campus continuing medical education programs in Alberta

PubMed Central

Hazlett, C. B.; Bachynski, J. E.; Embleton, J.

1973-01-01

Seven on-campus continuing medical education programs offered during the 1971-72 academic year were evaluated. A multiple-choice examination was taken by the participants before each course; the same examination was administered immediately after the course was completed, and a third examination was taken three to five months later. It was found that for each course there was a significant increase in knowledge at both post-testing periods. A questionnaire developed for the purpose of determining the effectiveness of the courses was also administered at the time of the third test, and exhibited reasonable degrees of reliability and validity. A large proportion of the participants indicated the content of their courses was relevant and necessary, and was being used in their medical practice. It was concluded that the effectiveness of these programs justified their continuation. PMID:4704095

Evaluation of potential emission spectra for the reliable classification of fluorescently coded materials

NASA Astrophysics Data System (ADS)

Brunner, Siegfried; Kargel, Christian

2011-06-01

The conservation and efficient use of natural and especially strategic resources like oil and water have become global issues, which increasingly initiate environmental and political activities for comprehensive recycling programs. To effectively reutilize oil-based materials necessary in many industrial fields (e.g. chemical and pharmaceutical industry, automotive, packaging), appropriate methods for a fast and highly reliable automated material identification are required. One non-contacting, color- and shape-independent new technique that eliminates the shortcomings of existing methods is to label materials like plastics with certain combinations of fluorescent markers ("optical codes", "optical fingerprints") incorporated during manufacture. Since time-resolved measurements are complex (and expensive), fluorescent markers must be designed that possess unique spectral signatures. The number of identifiable materials increases with the number of fluorescent markers that can be reliably distinguished within the limited wavelength band available. In this article we shall investigate the reliable detection and classification of fluorescent markers with specific fluorescence emission spectra. These simulated spectra are modeled based on realistic fluorescence spectra acquired from material samples using a modern VNIR spectral imaging system. In order to maximize the number of materials that can be reliably identified, we evaluate the performance of 8 classification algorithms based on different spectral similarity measures. The results help guide the design of appropriate fluorescent markers, optical sensors and the overall measurement system.

Development and Initial Reliability Testing of NAK-50+: A Nutrition Attitude and Knowledge Questionnaire for Adults 50+ Years of Age.

PubMed

Ducak, Kate; Keller, Heather

2016-03-01

Few questionnaires to test nutrition knowledge and attitudes of older adults living independently in the community have been developed and tested to assess self-management tools such as Nutri-eSCREEN and other education programs. This study is a first step in the development of a questionnaire designed to evaluate the nutrition knowledge and attitudes of independent older adults (NAK-50+). The steps involved in this study were: (i) drafting initial questions based on the content of the Nutri-eSCREEN education material, (ii) using cognitive interviewing to determine if these questions were understandable and relevant (n = 9 adults ≥50 years of age), and (iii) completing test-retest reliability in a convenient community sample (n = 60 adults ≥50 years of age). Intra-class coefficients (ICC) and kappa were used to determine reliability. A 33-item questionnaire resulted from this development and analysis. ICC for the total score was 0.68 indicating good agreement and thus initial reliability. NAK-50+ is a face valid and reliable questionnaire that assesses nutrition knowledge and attitudes in independent adults aged ≥50 years. Further work to determine construct validity and to refine the questionnaire is warranted. Availability of the questionnaire for this age group will support rigorous evaluation of education and self-management interventions for this segment of the population.

Advanced release technologies program

NASA Technical Reports Server (NTRS)

Purdy, Bill

1994-01-01

The objective of the ARTS program was to develop lighter and less expensive spacecraft ordnance and release systems that answer to the requirements of a wide variety of spacecraft applications. These improvements were to be evaluated at the spacecraft system level, as it was determined that there were substantial system-level costs associated with the present ordnance and release subsystems. New, better devices were to be developed, then flight qualified, then integrated into a flight experiment in order to prove the reliability required for their subsequent use on high-reliability spacecraft. The secondary goal of the program was to quantify the system-level benefits of these new subsystems based upon the development program results. Three non-explosive release mechanisms and one laser-diode-based ordnance system were qualified under the program. The release devices being developed were required to release high preloads because it is easier to scale down a release mechanism than to scale it up. The laser initiator developed was required to be a direct replacement for NASA Standard Initiators, since these are the most common initiator in use presently. The program began in October, 1991, with completion of the flight experiment scheduled for February, 1994. This paper provides an overview of the ARTS program, discusses the benefits of using the ARTS components, introduces the new components, compares them with conventional systems and each other, and provides recommendations on how best to implement them.

Does a web-based feedback training program result in improved reliability in clinicians' ratings of the Global Assessment of Functioning (GAF) Scale?

PubMed

Støre-Valen, Jakob; Ryum, Truls; Pedersen, Geir A F; Pripp, Are H; Jose, Paul E; Karterud, Sigmund

2015-09-01

The Global Assessment of Functioning (GAF) Scale is used in routine clinical practice and research to estimate symptom and functional severity and longitudinal change. Concerns about poor interrater reliability have been raised, and the present study evaluated the effect of a Web-based GAF training program designed to improve interrater reliability in routine clinical practice. Clinicians rated up to 20 vignettes online, and received deviation scores as immediate feedback (i.e., own scores compared with expert raters) after each rating. Growth curves of absolute SD scores across the vignettes were modeled. A linear mixed effects model, using the clinician's deviation scores from expert raters as the dependent variable, indicated an improvement in reliability during training. Moderation by content of scale (symptoms; functioning), scale range (average; extreme), previous experience with GAF rating, profession, and postgraduate training were assessed. Training reduced deviation scores for inexperienced GAF raters, for individuals in clinical professions other than nursing and medicine, and for individuals with no postgraduate specialization. In addition, training was most beneficial for cases with average severity of symptoms compared with cases with extreme severity. The results support the use of Web-based training with feedback routines as a means to improve the reliability of GAF ratings performed by clinicians in mental health practice. These results especially pertain to clinicians in mental health practice who do not have a masters or doctoral degree. (c) 2015 APA, all rights reserved.

The Americleft Speech Project: A Training and Reliability Study.

PubMed

Chapman, Kathy L; Baylis, Adriane; Trost-Cardamone, Judith; Cordero, Kelly Nett; Dixon, Angela; Dobbelsteyn, Cindy; Thurmes, Anna; Wilson, Kristina; Harding-Bell, Anne; Sweeney, Triona; Stoddard, Gregory; Sell, Debbie

2016-01-01

To describe the results of two reliability studies and to assess the effect of training on interrater reliability scores. The first study (1) examined interrater and intrarater reliability scores (weighted and unweighted kappas) and (2) compared interrater reliability scores before and after training on the use of the Cleft Audit Protocol for Speech-Augmented (CAPS-A) with British English-speaking children. The second study examined interrater and intrarater reliability on a modified version of the CAPS-A (CAPS-A Americleft Modification) with American and Canadian English-speaking children. Finally, comparisons were made between the interrater and intrarater reliability scores obtained for Study 1 and Study 2. The participants were speech-language pathologists from the Americleft Speech Project. In Study 1, interrater reliability scores improved for 6 of the 13 parameters following training on the CAPS-A protocol. Comparison of the reliability results for the two studies indicated lower scores for Study 2 compared with Study 1. However, this appeared to be an artifact of the kappa statistic that occurred due to insufficient variability in the reliability samples for Study 2. When percent agreement scores were also calculated, the ratings appeared similar across Study 1 and Study 2. The findings of this study suggested that improvements in interrater reliability could be obtained following a program of systematic training. However, improvements were not uniform across all parameters. Acceptable levels of reliability were achieved for those parameters most important for evaluation of velopharyngeal function.

The Americleft Speech Project: A Training and Reliability Study

PubMed Central

Chapman, Kathy L.; Baylis, Adriane; Trost-Cardamone, Judith; Cordero, Kelly Nett; Dixon, Angela; Dobbelsteyn, Cindy; Thurmes, Anna; Wilson, Kristina; Harding-Bell, Anne; Sweeney, Triona; Stoddard, Gregory; Sell, Debbie

2017-01-01

Objective To describe the results of two reliability studies and to assess the effect of training on interrater reliability scores. Design The first study (1) examined interrater and intrarater reliability scores (weighted and unweighted kappas) and (2) compared interrater reliability scores before and after training on the use of the Cleft Audit Protocol for Speech–Augmented (CAPS-A) with British English-speaking children. The second study examined interrater and intrarater reliability on a modified version of the CAPS-A (CAPS-A Americleft Modification) with American and Canadian English-speaking children. Finally, comparisons were made between the interrater and intrarater reliability scores obtained for Study 1 and Study 2. Participants The participants were speech-language pathologists from the Americleft Speech Project. Results In Study 1, interrater reliability scores improved for 6 of the 13 parameters following training on the CAPS-A protocol. Comparison of the reliability results for the two studies indicated lower scores for Study 2 compared with Study 1. However, this appeared to be an artifact of the kappa statistic that occurred due to insufficient variability in the reliability samples for Study 2. When percent agreement scores were also calculated, the ratings appeared similar across Study 1 and Study 2. Conclusion The findings of this study suggested that improvements in interrater reliability could be obtained following a program of systematic training. However, improvements were not uniform across all parameters. Acceptable levels of reliability were achieved for those parameters most important for evaluation of velopharyngeal function. PMID:25531738

Analysis of whisker-toughened CMC structural components using an interactive reliability model

NASA Technical Reports Server (NTRS)

Duffy, Stephen F.; Palko, Joseph L.

1992-01-01

Realizing wider utilization of ceramic matrix composites (CMC) requires the development of advanced structural analysis technologies. This article focuses on the use of interactive reliability models to predict component probability of failure. The deterministic William-Warnke failure criterion serves as theoretical basis for the reliability model presented here. The model has been implemented into a test-bed software program. This computer program has been coupled to a general-purpose finite element program. A simple structural problem is presented to illustrate the reliability model and the computer algorithm.

Apollo experience report: Reliability and quality assurance

NASA Technical Reports Server (NTRS)

Sperber, K. P.

1973-01-01

The reliability of the Apollo spacecraft resulted from the application of proven reliability and quality techniques and from sound management, engineering, and manufacturing practices. Continual assessment of these techniques and practices was made during the program, and, when deficiencies were detected, adjustments were made and the deficiencies were effectively corrected. The most significant practices, deficiencies, adjustments, and experiences during the Apollo Program are described in this report. These experiences can be helpful in establishing an effective base on which to structure an efficient reliability and quality assurance effort for future space-flight programs.

An Evaluation Method of Equipment Reliability Configuration Management

NASA Astrophysics Data System (ADS)

Wang, Wei; Feng, Weijia; Zhang, Wei; Li, Yuan

2018-01-01

At present, many equipment development companies have been aware of the great significance of reliability of the equipment development. But, due to the lack of effective management evaluation method, it is very difficult for the equipment development company to manage its own reliability work. Evaluation method of equipment reliability configuration management is to determine the reliability management capabilities of equipment development company. Reliability is not only designed, but also managed to achieve. This paper evaluates the reliability management capabilities by reliability configuration capability maturity model(RCM-CMM) evaluation method.

Evaluation of satisfaction in an extracurricular enrichment program for high-intellectual ability participants.

PubMed

Sastre I Riba, Sylvia; Fonseca-Pedrero, Eduardo; Santarén-Rosell, Marta; Urraca-Martínez, María Luz

2015-01-01

The objective of this study was to evaluate the satisfaction of an extracurricular enrichment program of the cognitive and personal management of participants with high intellectual ability. At the first time point, the sample consisted of n= 38 participants, and n= 20 parents; n= 48 participants at the second time point; and n= 60 participants at the third time point. The Satisfaction Questionnaire (CSA in Spanish), both for students (CSA-S) and for parents (CSA-P), was constructed. The CSA-S scores showed adequate psychometric properties. Exploratory factor analysis yielded a unidimensional structure. Cronbach’s alpha ranged between 85 and .86. Test-retest reliability was 0.45 (p<.05). The generalizability coefficient was .98. A high percentage of the sample was satisfied with the program, perceived improvements in cognitive and emotional management, motivation and interest in learning, and in the frequency and quality of their interpersonal relationships. The evaluation of educational programs is necessary in order to determine the efficacy and the effects of their implementation on the participants’ personal and intellectual management.

External quality-assurance programs managed by the U.S. Geological Survey in support of the National Atmospheric Deposition Program/National Trends Network

USGS Publications Warehouse

Latysh, Natalie E.; Wetherbee, Gregory A.

2005-01-01

The U.S. Geological Survey, Branch of Quality Systems, operates the external quality-assurance programs for the National Atmospheric Deposition Program/National Trends Network (NADP/NTN). Beginning in 1978, six different programs have been implemented?the intersite-comparison program, the blind-audit program, the sample-handling evaluation program, the field-audit program, the interlaboratory-comparison program, and the collocated-sampler program. Each program was designed to measure error contributed by specific components in the data-collection process. The intersite-comparison program, which was discontinued in 2004, was designed to assess the accuracy and reliability of field pH and specific-conductance measurements made by site operators. The blind-audit and sample-handling evaluation programs, which also were discontinued in 2002 and 2004, respectively, assessed contamination that may result from sampling equipment and routine handling and processing of the wet-deposition samples. The field-audit program assesses the effects of sample handling, processing, and field exposure. The interlaboratory-comparison program evaluates bias and precision of analytical results produced by the contract laboratory for NADP, the Illinois State Water Survey, Central Analytical Laboratory, and compares its performance with the performance of international laboratories. The collocated-sampler program assesses the overall precision of wet-deposition data collected by NADP/NTN. This report documents historical operations and the operating procedures for each of these external quality-assurance programs. USGS quality-assurance information allows NADP/NTN data users to discern between actual environmental trends and inherent measurement variability.

Advanced detection, isolation and accommodation of sensor failures: Real-time evaluation

NASA Technical Reports Server (NTRS)

Merrill, Walter C.; Delaat, John C.; Bruton, William M.

1987-01-01

The objective of the Advanced Detection, Isolation, and Accommodation (ADIA) Program is to improve the overall demonstrated reliability of digital electronic control systems for turbine engines by using analytical redundacy to detect sensor failures. The results of a real time hybrid computer evaluation of the ADIA algorithm are presented. Minimum detectable levels of sensor failures for an F100 engine control system are determined. Also included are details about the microprocessor implementation of the algorithm as well as a description of the algorithm itself.

Integrated technology rotor/flight research rotor hub concept definition

NASA Technical Reports Server (NTRS)

Dixon, P. G. C.

1983-01-01

Two variations of the helicopter bearingless main rotor hub concept are proposed as bases for further development in the preliminary design phase of the Integrated Technology Rotor/Flight Research Rotor (ITR/FRR) program. This selection was the result of an evaluation of three bearingless hub concepts and two articulated hub concepts with elastomeric bearings. The characteristics of each concept were evaluated by means of simplified methodology. These characteristics included the assessment of stability, vulnerability, weight, drag, cost, stiffness, fatigue life, maintainability, and reliability.

A pilot investigation of the Motivation Behaviors Checklist (MBC): An observational rating scale of effort towards testing for baseline sports-concussion assessment.

PubMed

Rabinowitz, Amanda R; Merritt, Victoria; Arnett, Peter A

2016-08-01

Baseline neuropsychological testing is commonly used in the management of sports-related concussion. However, underperformance due to poor effort could lead to invalid conclusions regarding postconcussion cognitive decline. We designed the Motivation Behaviors Checklist (MBC) as an observational rating scale to assess effort towards baseline neuropsychological testing. Here we present preliminary data in support of its reliability and validity. MBC items were generated based on the consensus of a panel of graduate students, undergraduates, and a clinical neuropsychologist who conduct neuropsychological evaluations for a sports concussion management program. A total of 261 college athletes were administered a standard neuropsychological test battery in addition to the MBC. A subset of evaluations (n= 101) was videotape and viewed by a second rater. Exploratory factor analysis (EFA) was used to refine the scale, and reliability and validity were evaluated. EFA revealed that the MBC items represent four latent factors-Complaints, Poor Focus, Psychomotor Agitation, and Impulsivity. Reliability analyses demonstrated that the MBC has good inter-rater reliability (intraclass correlation coefficient, ICC = .767) and internal consistency (α = .839). The construct validity of the MBC is supported by large correlations with examiners' ratings of effort (ρ = -.623) and medium-sized relationships with cognitive performance and self-ratings of effort (|ρ| between .263 and .345). Discriminant validity was supported by nonsignificant correlations with measures of depression and postconcussion symptoms (ρ = .056 and .082, respectively). These findings provide preliminary evidence that the MBC could be a useful adjunct to baseline neuropsychological evaluations for sports-concussion management.

Award-Winning CARES/Life Ceramics Durability Evaluation Software Is Making Advanced Technology Accessible

NASA Technical Reports Server (NTRS)

1997-01-01

Products made from advanced ceramics show great promise for revolutionizing aerospace and terrestrial propulsion and power generation. However, ceramic components are difficult to design because brittle materials in general have widely varying strength values. The CARES/Life software developed at the NASA Lewis Research Center eases this by providing a tool that uses probabilistic reliability analysis techniques to optimize the design and manufacture of brittle material components. CARES/Life is an integrated package that predicts the probability of a monolithic ceramic component's failure as a function of its time in service. It couples commercial finite element programs--which resolve a component's temperature and stress distribution - with reliability evaluation and fracture mechanics routines for modeling strength - limiting defects. These routines are based on calculations of the probabilistic nature of the brittle material's strength.

Enhanced Damage-Resistant Optics for Spaceflight Laser Systems: Workshop findings and recommendations

NASA Technical Reports Server (NTRS)

Schulze, Norman; Cimolino, Marc; Guenther, Arthur; Mcminn, Ted; Rainer, Frank; Schmid, Ansgar; Seitel, Steven C.; Soileau, M. J.; Theon, John S.; Walz, William

1991-01-01

NASA has defined a program to address critical laser-induced damage issues peculiar to its remote sensing systems. The Langley Research Center (LaRC), with input from the Goddard Space Flight Center (GSFC), has developed a program plan focusing on the certification of optical materials for spaceflight applications and the development of techniques to determine the reliability of such materials under extended laser exposures. This plan involves cooperative efforts between NASA and optics manufacturers to quantify the performance of optical materials for NASA systems and to ensure NASA's continued application of the highest quality optics possible for enhanced system reliability. A review panel was organized to assess NASA's optical damage concerns and to evaluate the effectiveness of the LaRC proposed program plan. This panel consisted of experts in the areas of laser-induced damage, optical coating manufacture, and the design and development of laser systems for space. The panel was presented information on NASA's current and planned laser remote sensing programs, laser-induced damage problems already encountered in NASA systems, and the proposed program plan to address these issues. Additionally, technical presentations were made on the state of the art in damage mechanisms, optical materials testing, and issues of coating manufacture germane to laser damage.

Design for reliability: NASA reliability preferred practices for design and test

NASA Technical Reports Server (NTRS)

Lalli, Vincent R.

1994-01-01

This tutorial summarizes reliability experience from both NASA and industry and reflects engineering practices that support current and future civil space programs. These practices were collected from various NASA field centers and were reviewed by a committee of senior technical representatives from the participating centers (members are listed at the end). The material for this tutorial was taken from the publication issued by the NASA Reliability and Maintainability Steering Committee (NASA Reliability Preferred Practices for Design and Test. NASA TM-4322, 1991). Reliability must be an integral part of the systems engineering process. Although both disciplines must be weighed equally with other technical and programmatic demands, the application of sound reliability principles will be the key to the effectiveness and affordability of America's space program. Our space programs have shown that reliability efforts must focus on the design characteristics that affect the frequency of failure. Herein, we emphasize that these identified design characteristics must be controlled by applying conservative engineering principles.

Medical student quality-of-life in the clerkships: a scale validation study.

PubMed

Brannick, Michael T; Horn, Gregory T; Schnaus, Michael J; Wahi, Monika M; Goldin, Steven B

2015-04-01

Many aspects of medical school are stressful for students. To empirically assess student reactions to clerkship programs, or to assess efforts to improve such programs, educators must measure the overall well-being of the students reliably and validly. The purpose of the study was to develop and validate a measure designed to achieve these goals. The authors developed a measure of quality of life for medical students by sampling (public domain) items tapping general happiness, fatigue, and anxiety. A quality-of-life scale was developed by factor analyzing responses to the items from students in two different clerkships from 2005 to 2008. Reliability was assessed using Cronbach's alpha. Validity was assessed by factor analysis, convergence with additional theoretically relevant scales, and sensitivity to change over time. The refined nine-item measure is a Likert scaled survey of quality-of-life items comprised of two domains: exhaustion and general happiness. The resulting scale demonstrated good reliability and factorial validity at two time points for each of the two samples. The quality-of-life measure also correlated with measures of depression and the amount of sleep reported during the clerkships. The quality-of-life measure appeared more sensitive to changes over time than did the depression measure. The measure is short and can be easily administered in a survey. The scale appears useful for program evaluation and more generally as an outcome variable in medical educational research.

Software reliability models for critical applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pham, H.; Pham, M.

This report presents the results of the first phase of the ongoing EG G Idaho, Inc. Software Reliability Research Program. The program is studying the existing software reliability models and proposes a state-of-the-art software reliability model that is relevant to the nuclear reactor control environment. This report consists of three parts: (1) summaries of the literature review of existing software reliability and fault tolerant software reliability models and their related issues, (2) proposed technique for software reliability enhancement, and (3) general discussion and future research. The development of this proposed state-of-the-art software reliability model will be performed in the secondmore » place. 407 refs., 4 figs., 2 tabs.« less

Software reliability models for critical applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pham, H.; Pham, M.

This report presents the results of the first phase of the ongoing EG&G Idaho, Inc. Software Reliability Research Program. The program is studying the existing software reliability models and proposes a state-of-the-art software reliability model that is relevant to the nuclear reactor control environment. This report consists of three parts: (1) summaries of the literature review of existing software reliability and fault tolerant software reliability models and their related issues, (2) proposed technique for software reliability enhancement, and (3) general discussion and future research. The development of this proposed state-of-the-art software reliability model will be performed in the second place.more » 407 refs., 4 figs., 2 tabs.« less

Bulk electric system reliability evaluation incorporating wind power and demand side management

NASA Astrophysics Data System (ADS)

Huang, Dange

Electric power systems are experiencing dramatic changes with respect to structure, operation and regulation and are facing increasing pressure due to environmental and societal constraints. Bulk electric system reliability is an important consideration in power system planning, design and operation particularly in the new competitive environment. A wide range of methods have been developed to perform bulk electric system reliability evaluation. Theoretically, sequential Monte Carlo simulation can include all aspects and contingencies in a power system and can be used to produce an informative set of reliability indices. It has become a practical and viable tool for large system reliability assessment technique due to the development of computing power and is used in the studies described in this thesis. The well-being approach used in this research provides the opportunity to integrate an accepted deterministic criterion into a probabilistic framework. This research work includes the investigation of important factors that impact bulk electric system adequacy evaluation and security constrained adequacy assessment using the well-being analysis framework. Load forecast uncertainty is an important consideration in an electrical power system. This research includes load forecast uncertainty considerations in bulk electric system reliability assessment and the effects on system, load point and well-being indices and reliability index probability distributions are examined. There has been increasing worldwide interest in the utilization of wind power as a renewable energy source over the last two decades due to enhanced public awareness of the environment. Increasing penetration of wind power has significant impacts on power system reliability, and security analyses become more uncertain due to the unpredictable nature of wind power. The effects of wind power additions in generating and bulk electric system reliability assessment considering site wind speed correlations and the interactive effects of wind power and load forecast uncertainty on system reliability are examined. The concept of the security cost associated with operating in the marginal state in the well-being framework is incorporated in the economic analyses associated with system expansion planning including wind power and load forecast uncertainty. Overall reliability cost/worth analyses including security cost concepts are applied to select an optimal wind power injection strategy in a bulk electric system. The effects of the various demand side management measures on system reliability are illustrated using the system, load point, and well-being indices, and the reliability index probability distributions. The reliability effects of demand side management procedures in a bulk electric system including wind power and load forecast uncertainty considerations are also investigated. The system reliability effects due to specific demand side management programs are quantified and examined in terms of their reliability benefits.

General Monte Carlo reliability simulation code including common mode failures and HARP fault/error-handling

NASA Technical Reports Server (NTRS)

Platt, M. E.; Lewis, E. E.; Boehm, F.

1991-01-01

A Monte Carlo Fortran computer program was developed that uses two variance reduction techniques for computing system reliability applicable to solving very large highly reliable fault-tolerant systems. The program is consistent with the hybrid automated reliability predictor (HARP) code which employs behavioral decomposition and complex fault-error handling models. This new capability is called MC-HARP which efficiently solves reliability models with non-constant failures rates (Weibull). Common mode failure modeling is also a specialty.

Teacher Version of the My Class Inventory-Short Form: An Accountability Tool for Elementary School Counselors

ERIC Educational Resources Information Center

Sink, Christopher A.; Spencer, Lisa R.

2007-01-01

This article reports on a psychometric study examining the validity and reliability of the My Class Inventory-Short Form for Teachers, an accountability measure for elementary school counselors to use as they evaluate aspects of their school counseling programs. As a companion inventory to the student version of the My Class Inventory-Short Form…

Primary Prevention of Pediatric Abusive Head Trauma: A Cost Audit and Cost-Utility Analysis

ERIC Educational Resources Information Center

Friedman, Joshua; Reed, Peter; Sharplin, Peter; Kelly, Patrick

2012-01-01

Objectives: To obtain comprehensive, reliable data on the direct cost of pediatric abusive head trauma in New Zealand, and to use this data to evaluate the possible cost-benefit of a national primary prevention program. Methods: A 5 year cohort of infants with abusive head trauma admitted to hospital in Auckland, New Zealand was reviewed. We…

A Growth Status Measurement Pilot in Four Calgary Area Schools: Perceptions of Grade 5 Students and Their Parents

ERIC Educational Resources Information Center

Johnston, J. Cyne T.; McNeil, Deborah A.; Best, Maureen; MacLeod, Cheryl

2011-01-01

Reliable measures of growth in children are necessary for planning and evaluating obesity prevention programs. Currently, measured growth data are unavailable in Calgary for school-age children. This single sample, cross-sectional study included Grade 5 students and their parents. Height and weight measurements of 305 students (68% of those…

The Role of Human Error in Design, Construction, and Reliability of Marine Structures.

DTIC Science & Technology

1994-10-01

The 1979 Three Mile Island nuclear plant accident was largely a result of a failure to properly sort out and recognize critically important information...determinating the goals and objectives of the program and by evaluating and interpreting the results in terms of structural design, construction, and...67 Checking Models in Structural Design ....................................... 69 Nuclear Power Plants

External validation of a forest inventory and analysis volume equation and comparisons with estimates from multiple stem-profile models

Treesearch

Christopher M. Oswalt; Adam M. Saunders

2009-01-01

Sound estimation procedures are desideratum for generating credible population estimates to evaluate the status and trends in resource conditions. As such, volume estimation is an integral component of the U.S. Department of Agriculture, Forest Service, Forest Inventory and Analysis (FIA) program's reporting. In effect, reliable volume estimation procedures are...

Evaluation of the stability of reference genes in bone mesenchymal stem cells from patients with avascular necrosis of the femoral head.

PubMed

Wang, X N; Yang, Q W; Du, Z W; Yu, T; Qin, Y G; Song, Y; Xu, M; Wang, J C

2016-05-25

This study aimed to evaluate 12 genes (18S, GAPDH, B2M, ACTB, ALAS1, GUSB, HPRT1, PBGD, PPIA, PUM1, RPL29, and TBP) for their reliability and stability as reference sequences for real-time quantitative PCR (RT-qPCR) in bone marrow-derived mesenchymal stem cells (BMSCs) isolated from patients with avascular necrosis of the femoral head (ANFH). BMSCs were isolated from 20 ANFH patients divided into four groups according to etiology, and four donors with femoral neck fractures. Total RNA was isolated from BMSCs and reverse transcribed into complementary DNA, which served as a template for RT-qPCR. Three commonly used programs were then used to analyze the results. Reference gene expression varied within each group, between specific groups, and among all five groups. Based on comparisons of all five groups, two of the programs used suggested that HPRT1 was the most stable reference gene, while 18S and ACTB were the most variable. Among the 12 candidate reference genes, HPRT1 exhibited the greatest reliability, followed by PPIA. Thus, these sequences could be used as references for the normalization of RT-qPCR results.

Interim Reliability Evaluation Program: analysis of the Browns Ferry, Unit 1, nuclear plant. Main report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Mays, S.E.; Poloski, J.P.; Sullivan, W.H.

1982-07-01

A probabilistic risk assessment (PRA) was made of the Browns Ferry, Unit 1, nuclear plant as part of the Nuclear Regulatory Commission's Interim Reliability Evaluation Program (IREP). Specific goals of the study were to identify the dominant contributors to core melt, develop a foundation for more extensive use of PRA methods, expand the cadre of experienced PRA practitioners, and apply procedures for extension of IREP analyses to other domestic light water reactors. Event tree and fault tree analyses were used to estimate the frequency of accident sequences initiated by transients and loss of coolant accidents. External events such as floods,more » fires, earthquakes, and sabotage were beyond the scope of this study and were, therefore, excluded. From these sequences, the dominant contributors to probable core melt frequency were chosen. Uncertainty and sensitivity analyses were performed on these sequences to better understand the limitations associated with the estimated sequence frequencies. Dominant sequences were grouped according to common containment failure modes and corresponding release categories on the basis of comparison with analyses of similar designs rather than on the basis of detailed plant-specific calculations.« less

Shuttle Upgrade Using 5-Segment Booster (FSB)

NASA Technical Reports Server (NTRS)

Sauvageau, Donald R.; Huppi, Hal D.; McCool, A. A. (Technical Monitor)

2000-01-01

In support of NASA's continuing effort to improve the over-all safety and reliability of the Shuttle system- a 5-segment booster (FSB) has been identified as an approach to satisfy that overall objective. To assess the feasibility of a 5-segment booster approach, NASA issued a feasibility study contract to evaluate the potential of a 5-segment booster to improve the overall capability of the Shuttle system, especially evaluating the potential to increase the system reliability and safety. In order to effectively evaluate the feasibility of the 5-segment concept, a four-member contractor team was established under the direction of NASA Marshall Space Flight Center (MSFC). MSFC provided the overall program oversight and integration as well as program contractual management. The contractor team consisted of Thiokol, Boeing North American Huntington Beach (BNA), Lockheed Martin Michoud Space Systems (LMMSS) and United Space Alliance (USA) and their subcontractor bd Systems (Control Dynamics Division, Huntsville, AL). United Space Alliance included the former members of United Space Booster Incorporated (USBI) who managed the booster element portion of the current Shuttle solid rocket boosters. Thiokol was responsible for the overall integration and coordination of the contractor team across all of the booster elements. They were also responsible for all of the motor modification evaluations. Boeing North American (BNA) was responsible for all systems integration analyses, generation of loads and environments. and performance and abort mode capabilities. Lockheed Martin Michoud Space Systems (LMMSS) was responsible for evaluating the impacts of any changes to the booster on the external tank (ET), and evaluating any design changes on the external tank necessary to accommodate the FSB. USA. including the former USBI contingent. was responsible for evaluating any modifications to facilities at the launch site as well as any booster component design modifications.

Evaluation of Pharmacy and Therapeutic (P&T) Committee member knowledge, attitudes and ability regarding the use of comparative effectiveness research (CER) in health care decision-making.

PubMed

Tang, D H; Warholak, T L; Hines, L E; Hurwitz, J; Brown, M; Taylor, A M; Brixner, D; Malone, D C

2014-01-01

Comparative effectiveness research (CER) is a constellation of research methods designed to improve health care decision making. Educational programs that improve health care decision makers' CER knowledge and awareness may ultimately lead to more cost-effective use of health care resources. This study was conducted to evaluate changes in CER knowledge, attitudes, and ability among Pharmacy and Therapeutics (P&T) Committee members and support staff after attending a tailored educational program. Physicians and pharmacists from two professional societies and the Indian Health Service who participated in the P&T process were invited via email to participate in this study. Participants completed a questionnaire, designed specifically for this study, prior to and following the 4-hour live, educational program on CER to determine the impact on their related knowledge, attitudes, and ability to use CER in decision-making. Rasch analysis was used to assess validity and reliability of subsections of the questionnaire and regression analysis was used to assess programmatic impact on CER knowledge, attitude, and ability. One hundred and forty of the 199 participants completed both the pre- and post-CER session questionnaires (response rate = 70.4%). Most participants (>75%) correctly answered eight of the ten knowledge items after attending the educational session. More than 60% of the respondents had a positive attitude toward CER both before and after the program. Compared to baseline (pretest), participants reported significant improvements in their perceived ability to use CER after attending the session in these areas: using CER reviews, knowledge of CER methods, identifying problems with randomized controlled trials, identifying threats to validity, understanding of evidence synthesis approaches, and evaluating the quality of CER (all P values < 0.001). The questionnaire demonstrated acceptable reliability and validity evidence (limited evidence of construct under-representation and construct irrelevant variance). The CER educational program was effective in increasing participants' CER knowledge and self-perceived ability to evaluate relevant evidence. Improving knowledge and awareness of CER and its applicability is a critical first step in improving its use in health care decision making. Copyright © 2014 Elsevier Inc. All rights reserved.

Demonstration and evaluation of gas turbine transit buses

NASA Technical Reports Server (NTRS)

1983-01-01

The Gas Turbine Transit Bus Demonstration Program was designed to demonstrate and evaluate the operation of gas turbine engines in transit coaches in revenue service compared with diesel powered coaches. The main objective of the program was to accelerate development and commercialization of automotive gas turbines. The benefits from the installation of this engine in a transit coach were expected to be reduced weight, cleaner exhaust emissions, lower noise levels, reduced engine vibration and maintenance requirements, improved reliability and vehicle performance, greater engine braking capability, and superior cold weather starting. Four RTS-II advanced design transit coaches were converted to gas turbine power using engines and transmissions. Development, acceptance, performance and systems tests were performed on the coaches prior to the revenue service demonstration.

Next-generation avionics packaging and cooling 'test results from a prototype system'

NASA Astrophysics Data System (ADS)

Seals, J. D.

The author reports on the design, material characteristics, and test results obtained under the US Air Force's advanced aircraft avionics packaging technologies (AAAPT) program, whose charter is to investigate new designs and technologies for reliable packaging, interconnection, and thermal management. Under this program, AT&T Bell Laboratories has completed the preliminary testing of and is evaluating a number of promising materials and technologies, including conformal encapsulation, liquid flow-through cooling, and a cyanate ester backplane. A fifty-two module system incorporating these and and other technologies has undergone preliminary cooling efficiency, shock, sine and random vibration, and maintenance testing. One of the primary objectives was to evaluate the interaction compatibility of new materials and designs with other components in the system.

Hybrid propulsion technology program: Phase 1. Volume 3: Thiokol Corporation Space Operations

NASA Technical Reports Server (NTRS)

Schuler, A. L.; Wiley, D. R.

1989-01-01

Three candidate hybrid propulsion (HP) concepts were identified, optimized, evaluated, and refined through an iterative process that continually forced improvement to the systems with respect to safety, reliability, cost, and performance criteria. A full scale booster meeting Advanced Solid Rocket Motor (ASRM) thrust-time constraints and a booster application for 1/4 ASRM thrust were evaluated. Trade studies and analyses were performed for each of the motor elements related to SRM technology. Based on trade study results, the optimum HP concept for both full and quarter sized systems was defined. The three candidate hybrid concepts evaluated are illustrated.

Monitoring and evaluation of mental health and psychosocial support programs in humanitarian settings: a scoping review of terminology and focus.

PubMed

Augustinavicius, Jura L; Greene, M Claire; Lakin, Daniel P; Tol, Wietse A

2018-01-01

Monitoring and evaluation of mental health and psychosocial support (MHPSS) programs is critical to facilitating learning and providing accountability to stakeholders. As part of an inter-agency effort to develop recommendations on MHPSS monitoring and evaluation, this scoping review aimed to identify the terminology and focus of monitoring and evaluation frameworks in this field. We collected program documents (logical frameworks (logframes) and theories of change) from members of the Inter-Agency Standing Committee Reference Group on MHPSS, and systematically searched the peer-reviewed literature across five databases. We included program documents and academic articles that reported on monitoring and evaluation of MHPSS in low- and middle-income countries describing original data. Inclusion and data extraction were conducted in parallel by independent reviewers. Thematic analysis was used to identify common language in the description of practices and the focus of each monitoring and evaluation framework. Logframe outcomes were mapped to MHPSS activity categories. We identified 38 program documents and 89 peer-reviewed articles, describing monitoring and evaluation of a wide range of MHPSS activities. In both program documents and peer-reviewed literature there was a lack of specificity and overlap in language used for goals and outcomes. Well-validated, reliable instruments were reported in the academic literature, but rarely used in monitoring and evaluation practices. We identified six themes in the terminology used to describe goals and outcomes. Logframe outcomes were more commonly mapped to generic program implementation activities (e.g. "capacity building") and those related to family and community support, while outcomes from academic articles were most frequently mapped to specialized psychological treatments. Inconsistencies between the language used in research and practice and discrepancies in measurement have broader implications for monitoring and evaluation in MHPSS programs in humanitarian settings within low- and middle-income countries. This scoping review of the terminology commonly used to describe monitoring and evaluation practices and their focus within MHPSS programming highlights areas of importance for the development of a more standardized approach to monitoring and evaluation.

Measuring the Process and Quality of Informed Consent for Clinical Research: Development and Testing

PubMed Central

Cohn, Elizabeth Gross; Jia, Haomiao; Smith, Winifred Chapman; Erwin, Katherine; Larson, Elaine L.

2013-01-01

Purpose/Objectives To develop and assess the reliability and validity of an observational instrument, the Process and Quality of Informed Consent (P-QIC). Design A pilot study of the psychometrics of a tool designed to measure the quality and process of the informed consent encounter in clinical research. The study used professionally filmed, simulated consent encounters designed to vary in process and quality. Setting A major urban teaching hospital in the northeastern region of the United States. Sample 63 students enrolled in health-related programs participated in psychometric testing, 16 students participated in test-retest reliability, and 5 investigator-participant dyads were observed for the actual consent encounters. Methods For reliability and validity testing, students watched and rated videotaped simulations of four consent encounters intentionally varied in process and content and rated them with the proposed instrument. Test-retest reliability was established by raters watching the videotaped simulations twice. Inter-rater reliability was demonstrated by two simultaneous but independent raters observing an actual consent encounter. Main Research Variables The essential elements of information and communication for informed consent. Findings The initial testing of the P-QIC demonstrated reliable and valid psychometric properties in both the simulated standardized consent encounters and actual consent encounters in the hospital setting. Conclusions The P-QIC is an easy-to-use observational tool that provides a quick assessment of the areas of strength and areas that need improvement in a consent encounter. It can be used in the initial trainings of new investigators or consent administrators and in ongoing programs of improvement for informed consent. Implications for Nursing The development of a validated observational instrument will allow investigators to assess the consent process more accurately and evaluate strategies designed to improve it. PMID:21708532

Measuring Acculturation Among Central American Women with the Use of a Brief Language Scale

PubMed Central

Wallen, Gwenyth R.; Feldman, Robert H.; Anliker, Jean

2015-01-01

The purpose of this study was to test the reliability and validity of a brief language usage scale as a measure of acculturation in 197 Central American immigrant women. This study presents an analysis of cross-sectional survey data collected during face-to-face interviews conducted in Spanish as part of the program evaluation of the Infant Feeding for Hispanic Supplemental Nutrition Program for Women, Infants, and Children (WIC) Populations a Peer Education Model. The Short Acculturation Scale, a four-item language usage scale exploring the participants’ language preferences, was used as a measure of acculturation. The participant’s age, length of time in the United States, and perceived social support for breastfeeding were used as validation measures. Results demonstrated good internal reliability for the acculturation summary scale. Consistent with previous studies, significant correlations (p < 0.01) were found between acculturation and mother’s age, perceived social support for breastfeeding, and mother’s length of time in the United States. The reliability and validity data from this group of Central American immigrants support the continued use of this brief measure of acculturation in diverse Latino subpopulations when multidimensional measures are neither practical nor feasible. PMID:16228765

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings

PubMed Central

2012-01-01

Background There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs. Methods Based on theoretical frameworks, including Rogers’ Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N = 243); test-retest reliability was assessed with 92 respondents. Results Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47–0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach’s α) ranged from 0.66–0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4. Conclusions The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings. PMID:22800294

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

PubMed

Stamatakis, Katherine A; McQueen, Amy; Filler, Carl; Boland, Elizabeth; Dreisinger, Mariah; Brownson, Ross C; Luke, Douglas A

2012-07-16

There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs. Based on theoretical frameworks, including Rogers' Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N=243); test-retest reliability was assessed with 92 respondents. Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47-0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach's α) ranged from 0.66-0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4. The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings.

Digital tooth-based superimposition method for assessment of alveolar bone levels on cone-beam computed tomography images.

PubMed

Romero-Delmastro, Alejandro; Kadioglu, Onur; Currier, G Frans; Cook, Tanner

2014-08-01

Cone-beam computed tomography images have been previously used for evaluation of alveolar bone levels around teeth before, during, and after orthodontic treatment. Protocols described in the literature have been vague, have used unstable landmarks, or have required several software programs, file conversions, or hand tracings, among other factors that could compromise the precision of the measurements. The purposes of this article are to describe a totally digital tooth-based superimposition method for the quantitative assessment of alveolar bone levels and to evaluate its reliability. Ultra cone-beam computed tomography images (0.1-mm reconstruction) from 10 subjects were obtained from the data pool of the University of Oklahoma; 80 premolars were measured twice by the same examiner and a third time by a second examiner to determine alveolar bone heights and thicknesses before and more than 6 months after orthodontic treatment using OsiriX (version 3.5.1; Pixeo, Geneva, Switzerland). Intraexaminer and interexaminer reliabilities were evaluated, and Dahlberg's formula was used to calculate the error of the measurements. Cross-sectional and longitudinal evaluations of alveolar bone levels were possible using a digital tooth-based superimposition method. The mean differences for buccal alveolar crest heights and thicknesses were below 0.10 mm for the same examiner and below 0.17 mm for all examiners. The ranges of errors for any measurement were between 0.02 and 0.23 mm for intraexaminer errors, and between 0.06 and 0.29 mm for interexaminer errors. This protocol can be used for cross-sectional or longitudinal assessment of alveolar bone levels with low interexaminer and intraexaminer errors, and it eliminates the use of less reliable or less stable landmarks and the need for multiple software programs and image printouts. Standardization of the methods for bone assessment in orthodontics is necessary; this method could be the answer to this need. Copyright © 2014 American Association of Orthodontists. Published by Mosby, Inc. All rights reserved.

Developing a quality assurance program for online services.

PubMed Central

Humphries, A W; Naisawald, G V

1991-01-01

A quality assurance (QA) program provides not only a mechanism for establishing training and competency standards, but also a method for continuously monitoring current service practices to correct shortcomings. The typical QA cycle includes these basic steps: select subject for review, establish measurable standards, evaluate existing services using the standards, identify problems, implement solutions, and reevaluate services. The Claude Moore Health Sciences Library (CMHSL) developed a quality assurance program for online services designed to evaluate services against specific criteria identified by research studies as being important to customer satisfaction. These criteria include reliability, responsiveness, approachability, communication, and physical factors. The application of these criteria to the library's existing online services in the quality review process is discussed with specific examples of the problems identified in each service area, as well as the solutions implemented to correct deficiencies. The application of the QA cycle to an online services program serves as a model of possible interventions. The use of QA principles to enhance online service quality can be extended to other library service areas. PMID:1909197

Developing a quality assurance program for online services.

PubMed

Humphries, A W; Naisawald, G V

1991-07-01

A quality assurance (QA) program provides not only a mechanism for establishing training and competency standards, but also a method for continuously monitoring current service practices to correct shortcomings. The typical QA cycle includes these basic steps: select subject for review, establish measurable standards, evaluate existing services using the standards, identify problems, implement solutions, and reevaluate services. The Claude Moore Health Sciences Library (CMHSL) developed a quality assurance program for online services designed to evaluate services against specific criteria identified by research studies as being important to customer satisfaction. These criteria include reliability, responsiveness, approachability, communication, and physical factors. The application of these criteria to the library's existing online services in the quality review process is discussed with specific examples of the problems identified in each service area, as well as the solutions implemented to correct deficiencies. The application of the QA cycle to an online services program serves as a model of possible interventions. The use of QA principles to enhance online service quality can be extended to other library service areas.

Community-Based Participatory Evaluation: The Healthy Start Approach

PubMed Central

Braithwaite, Ronald L.; McKenzie, Robetta D.; Pruitt, Vikki; Holden, Kisha B.; Aaron, Katrina; Hollimon, Chavone

2013-01-01

The use of community-based participatory research has gained momentum as a viable approach to academic and community engagement for research over the past 20 years. This article discusses an approach for extending the process with an emphasis on evaluation of a community partnership–driven initiative and thus advances the concept of conducting community-based participatory evaluation (CBPE) through a model used by the Healthy Start project of the Augusta Partnership for Children, Inc., in Augusta, Georgia. Application of the CBPE approach advances the importance of bilateral engagements with consumers and academic evaluators. The CBPE model shows promise as a reliable and credible evaluation approach for community-level assessment of health promotion programs. PMID:22461687

Community-based participatory evaluation: the healthy start approach.

PubMed

Braithwaite, Ronald L; McKenzie, Robetta D; Pruitt, Vikki; Holden, Kisha B; Aaron, Katrina; Hollimon, Chavone

2013-03-01

The use of community-based participatory research has gained momentum as a viable approach to academic and community engagement for research over the past 20 years. This article discusses an approach for extending the process with an emphasis on evaluation of a community partnership-driven initiative and thus advances the concept of conducting community-based participatory evaluation (CBPE) through a model used by the Healthy Start project of the Augusta Partnership for Children, Inc., in Augusta, Georgia. Application of the CBPE approach advances the importance of bilateral engagements with consumers and academic evaluators. The CBPE model shows promise as a reliable and credible evaluation approach for community-level assessment of health promotion programs.

The ACTIVATE study: results from a group-randomized controlled trial comparing a traditional worksite health promotion program with an activated consumer program.

PubMed

Terry, Paul E; Fowles, Jinnet Briggs; Xi, Min; Harvey, Lisa

2011-01-01

PURPOSE. This study compares a traditional worksite-based health promotion program with an activated consumer program and a control program DESIGN. Group randomized controlled trial with 18-month intervention. SETTING. Two large Midwestern companies. SUBJECTS. Three hundred and twenty employees (51% response). INTERVENTION. The traditional health promotion intervention offered population-level campaigns on physical activity, nutrition, and stress management. The activated consumer intervention included population-level campaigns for evaluating health information, choosing a health benefits plan, and understanding the risks of not taking medications as prescribed. The personal development intervention (control group) offered information on hobbies. The interventions also offered individual-level coaching for high risk individuals in both active intervention groups. MEASURES. Health risk status, general health status, consumer activation, productivity, and the ability to evaluate health information. ANALYSIS. Multivariate analyses controlled for baseline differences among the study groups. RESULTS. At the population level, compared with baseline performance, the traditional health promotion intervention improved health risk status, consumer activation, and the ability to recognize reliable health websites. Compared with baseline performance, the activated consumer intervention improved consumer activation, productivity, and the ability to recognize reliable health websites. At the population level, however, only the activated consumer intervention improved any outcome more than the control group did; that outcome was consumer activation. At the individual level for high risk individuals, both traditional health coaching and activated consumer coaching positively affected health risk status and consumer activation. In addition, both coaching interventions improved participant ability to recognize a reliable health website. Consumer activation coaching also significantly improved self-reported productivity. CONCLUSION. An effective intervention can change employee health risk status and activation both at the population level and at the individual high risk level. However, program engagement at the population level was low, indicating that additional promotional strategies, such as greater use of incentives, need to be examined. Less intensive coaching can be as effective as more intensive, albeit both interventions produced modest behavior change and retention in the consumer activation arm was most difficult. Further research is needed concerning recruitment and retention methods that will enable populations to realize the full potential of activated consumerism.

Summary of NASA Aerospace Flight Battery Systems Program activities

NASA Technical Reports Server (NTRS)

Manzo, Michelle; Odonnell, Patricia

1994-01-01

A summary of NASA Aerospace Flight Battery Systems Program Activities is presented. The NASA Aerospace Flight Battery Systems Program represents a unified NASA wide effort with the overall objective of providing NASA with the policy and posture which will increase the safety, performance, and reliability of space power systems. The specific objectives of the program are to: enhance cell/battery safety and reliability; maintain current battery technology; increase fundamental understanding of primary and secondary cells; provide a means to bring forth advanced technology for flight use; assist flight programs in minimizing battery technology related flight risks; and ensure that safe, reliable batteries are available for NASA's future missions.

An acceptance-oriented cognitive-behavioral therapy in multimodal rehabilitation: a pre-post test evaluation in highly distressed patients with rheumatic diseases.

PubMed

Vriezekolk, Johanna E; Eijsbouts, Agnes M M; van Lankveld, Wim G J M; Beenackers, Hanneke; Geenen, Rinie; van den Ende, Cornelia H M

2013-06-01

To examine the potential effectiveness of a multimodal rehabilitation program including an acceptance-oriented cognitive-behavioral therapy for highly distressed patients with rheumatic diseases. An observational study employing a one-group pre-post test design (N=25). The primary outcome was psychological distress. Secondary outcomes were quality of life, illness acceptance, and coping flexibility. Group pre-to-post and pre-to-12 months follow-up treatment changes were evaluated by paired-samples t-tests and Cohen's effect sizes (d). Individual changes were evaluated by the reliable change index (RCI) and clinically significant change (CSC) parameters. Significant effects were found post-treatment and maintained at 12 months in psychological distress (d>0.80), illness acceptance (d=1.48) and the SF-36 subscales role physical, vitality, and mental health (d ≥ 0.65). No significant effects were found for coping flexibility and the SF-36 subscales physical functioning, bodily pain, social functioning, and role emotional. Both a reliable (RCI) and clinically significant (CSC) improvement was observed for almost half of the highly distressed patients. The patients enrolled in the multimodal rehabilitation program showed improved psychological health status from pre to post-treatment. A randomized clinical trial is needed to confirm or refute the added value of an acceptance-oriented cognitive-behavioral therapy for highly distressed patients in rehabilitation. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

49 CFR Appendix E to Part 238 - General Principles of Reliability-Based Maintenance Programs

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 4 2010-10-01 2010-10-01 false General Principles of Reliability-Based... STANDARDS Pt. 238, App. E Appendix E to Part 238—General Principles of Reliability-Based Maintenance... maintenance programs are based on the following general principles. A failure is an unsatisfactory condition...

The impact of revised DSM-5 criteria on the relative distribution and inter-rater reliability of eating disorder diagnoses in a residential treatment setting.

PubMed

Thomas, Jennifer J; Eddy, Kamryn T; Murray, Helen B; Tromp, Marilou D P; Hartmann, Andrea S; Stone, Melissa T; Levendusky, Philip G; Becker, Anne E

2015-09-30

This study evaluated the relative distribution and inter-rater reliability of revised DSM-5 criteria for eating disorders in a residential treatment program. Consecutive adolescent and young adult females (N=150) admitted to a residential eating disorder treatment facility were assigned both DSM-IV and DSM-5 diagnoses by a clinician (n=14) via routine clinical interview and a research assessor (n=4) via structured interview. We compared the frequency of diagnostic assignments under each taxonomy and by type of assessor. We evaluated concordance between clinician and researcher assignment through inter-rater reliability kappa and percent agreement. Significantly fewer patients received either clinician or researcher diagnoses of a residual eating disorder under DSM-5 (clinician-12.0%; researcher-31.3%) versus DSM-IV (clinician-28.7%; researcher-59.3%), with the majority of reassigned DSM-IV residual cases reclassified as DSM-5 anorexia nervosa. Researcher and clinician diagnoses showed moderate inter-rater reliability under DSM-IV (κ=.48) and DSM-5 (κ=.57), though agreement for specific DSM-5 other specified feeding or eating disorder (OSFED) presentations was poor (κ=.05). DSM-5 revisions were associated with significantly less frequent residual eating disorder diagnoses, but not with reduced inter-rater reliability. Findings support specific dimensions of clinical utility for revised DSM-5 criteria for eating disorders. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

Do respiratory therapists receive training and education in smoking cessation? A national study of post-secondary training programs.

PubMed

Jordan, Timothy R; Khubchandani, Jagdish; Wiblishauser, Michael; Glassman, Tavis; Thompson, Amy

2011-10-01

To assess the tobacco-related education provided by post-secondary respiratory therapy training programs in the United States. A cross-sectional research design was used to survey the entire population of program directors of post-secondary, respiratory therapy training programs in the United States. A valid and reliable questionnaire was developed and mailed using a 2-wave mailing technique (73% return rate). Internal reliability coefficients (Cronbach alpha) for the various components of the questionnaire ranged from 0.78 to 0.91. More than half of programs (56%) offered no teaching on the 5R's. Nearly half (47%) offered no teaching on the 5A's. Of the 13 tobacco-related topics listed in the basic science and clinical science sections of the questionnaire, only one topic (i.e., diseases linked to tobacco use) received 3h or more of instruction by approximately a third of programs (35.8%). The majority of programs (>90%) spent no time teaching students about the socio-political aspects of tobacco use cessation. Moreover, 41% of programs did not formally evaluate students' competence in providing smoking cessation counseling to patients. Tobacco-related education is a very minor component of the education and training received by respiratory therapy students in the United States. Respiratory therapy training programs in the United States have great potential to strengthen the tobacco-related education that they provide to students. Practicing respiratory therapists would likely benefit from continuing medical education focused on how to use evidence-based smoking cessation counseling techniques with patients. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Flash Memory Reliability: Read, Program, and Erase Latency Versus Endurance Cycling

NASA Technical Reports Server (NTRS)

Heidecker, Jason

2010-01-01

This report documents the efforts and results of the fiscal year (FY) 2010 NASA Electronic Parts and Packaging Program (NEPP) task for nonvolatile memory (NVM) reliability. This year's focus was to measure latency (read, program, and erase) of NAND Flash memories and determine how these parameters drift with erase/program/read endurance cycling.

Reliability and construct validity of the Participation in Life Activities Scale for children and adolescents with asthma: an instrument evaluation study.

PubMed

Kintner, Eileen K; Sikorskii, Alla

2008-06-04

The purpose of this study was to evaluate the reliability and construct validity of the Participation in Life Activities Scale, an instrument designed to measure older school-age child and early adolescent level of involvement in chosen pursuits. A cross-sectional design was used. The convenience sample consisted of 313 school-age children and early adolescents with asthma, ages 9-15 years. The self-report summative scale of interest is a 3-indicator survey. Higher scores are reflective of higher levels of participation. Internal consistency reliability and construct validity for the entire sample and sub groups of the sample were evaluated. The instrument was deemed sound for the entire sample as well as sub groups based on sex, race, age, socioeconomic status, and severity of illness. Cronbach's alpha coefficient for internal consistency reliability for the entire sample was .74. Exploratory factor analysis indicated a single component solution (loadings .79-.85) accounting for 66% of the explained variance. Construct validity was established by testing the posed relationship between participation in life activities scores and severity of illness. Confirmatory factor analysis revealed a good fit between the data and specified model, chi2(10, n = 302) = 8.074, p = .62. This instrument could be used (a) in clinical settings to diagnose restricted participation in desired activities, guide decision-making about treatment plans to increase participation, and motivate behavioral change in the management of asthma; and (b) in research settings to explore factors influencing and consequences of restricted and unrestricted participation, and as an outcome measure to evaluate the effectiveness of programs designed to foster child and early adolescent management of asthma.

Development of a Behaviorally Anchored Rating Scale for Leadership

DTIC Science & Technology

2018-01-01

Research Product 2018-06 Development of a Behaviorally Anchored Rating Scale for Leadership Tatiana H. Toumbeva Krista L...anchored Rating Scale for Leadership 5a. CONTRACT NUMBER W5J9CQ-11-D-0004 5b. GRANT NUMBER 5c. PROGRAM ELEMENT NUMBER 62278 6...observer- based behavioral measure to help instructors more reliably and accurately evaluate the development of leadership attributes and competencies

Evaluation of the Reliability and Sensitivity of NDT Methods for Titanium Alloys

DTIC Science & Technology

1974-06-01

Specimens Several ’hand forged billets (Ti-6Al-6V-2Sn) containing porosity have teen collected dtueing past internal programs. The porosity is depicted...offectiveneess •cf the systems are discussed in Section i-k of Llh:i,; l’(, porn . It should be kept in mind that tile pcl etrantm (wN(l t1111i. ý:tud:y

Ferroelectric memory evaluation and development system

NASA Astrophysics Data System (ADS)

Bondurant, David W.

Attention is given to the Ramtron FEDS-1, an IBM PC/AT compatible single-board 16-b microcomputer with 8-kbyte program/data memory implemented with nonvolatile ferroelectric dynamic RAM. This is the first demonstration of a new type of solid state nonvolatile read/write memory, the ferroelectric RAM (FRAM). It is suggested that this memory technology will have a significant impact on avionics system performance and reliability.

COSMIC monthly progress report

NASA Technical Reports Server (NTRS)

1994-01-01

Activities of the Computer Software Management and Information Center (COSMIC) are summarized for the month of April 1994. Tables showing the current inventory of programs available from COSMIC are presented and program processing and evaluation activities are summarized. Five articles were prepared for publication in the NASA Tech Brief Journal. These articles (included in this report) describe the following software items: GAP 1.0 - Groove Analysis Program, Version 1.0; SUBTRANS - Subband/Transform MATLAB Functions for Image Processing; CSDM - COLD-SAT Dynamic Model; CASRE - Computer Aided Software Reliability Estimation; and XOPPS - OEL Project Planner/Scheduler Tool. Activities in the areas of marketing, customer service, benefits identification, maintenance and support, and disseminations are also described along with a budget summary.

Strain gage system evaluation program

NASA Technical Reports Server (NTRS)

Dolleris, G. W.; Mazur, H. J.; Kokoszka, E., Jr.

1978-01-01

A program was conducted to determine the reliability of various strain gage systems when applied to rotating compressor blades in an aircraft gas turbine engine. A survey of current technology strain gage systems was conducted to provide a basis for selecting candidate systems for evaluation. Testing and evaluation was conducted in an F 100 engine. Sixty strain gage systems of seven different designs were installed on the first and third stages of an F 100 engine fan. Nineteen strain gage failures occurred during 62 hours of engine operation, for a survival rate of 68 percent. Of the failures, 16 occurred at blade-to-disk leadwire jumps (84 percent), two at a leadwire splice (11 percent), and one at a gage splice (5 percent). Effects of erosion, temperature, G-loading, and stress levels are discussed. Results of a post-test analysis of the individual components of each strain gage system are presented.

NCMS PWB Surface Finishes Team project summary

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kokas, J.; DeSantis, C.; Wenger, G.

1996-04-01

The NCMS PWB Surface Finishes Consortium is just about at the end of the five year program. Dozens of projects related to surface finishes and PWB solder-ability were performed by the team throughout the program, and many of them are listed in this paper. They are listed with a cross reference to where and when a technical paper was presented describing the results of the research. However, due to time and space constraints, this paper can summarize the details of only three of the major research projects accomplished by the team. The first project described is an ``Evaluation of PWBmore » Surface Finishes.`` It describes the solderability, reliability, and wire bondability of numerous surface finishes. The second project outlined is an ``Evaluation of PWB Solderability Test Methods.`` The third project outlined is the ``Development and Evaluation of Organic Solderability Preservatives.``« less

Mixed method evaluation of a community-based physical activity program using the RE-AIM framework: practical application in a real-world setting.

PubMed

Koorts, Harriet; Gillison, Fiona

2015-11-06

Communities are a pivotal setting in which to promote increases in child and adolescent physical activity behaviours. Interventions implemented in these settings require effective evaluation to facilitate translation of findings to wider settings. The aims of this paper are to i) present findings from a RE-AIM evaluation of a community-based physical activity program, and ii) review the methodological challenges faced when applying RE-AIM in practice. A single mixed-methods case study was conducted based on a concurrent triangulation design. Five sources of data were collected via interviews, questionnaires, archival records, documentation and field notes. Evidence was triangulated within RE-AIM to assess individual and organisational-level program outcomes. Inconsistent availability of data and a lack of robust reporting challenged assessment of all five dimensions. Reach, Implementation and setting-level Adoption were less successful, Effectiveness and Maintenance at an individual and organisational level were moderately successful. Only community-level Adoption was highly successful, reflecting the key program goal to provide community-wide participation in sport and physical activity. This research highlighted important methodological constraints associated with the use of RE-AIM in practice settings. Future evaluators wishing to use RE-AIM may benefit from a mixed-method triangulation approach to offset challenges with data availability and reliability.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Goodwin, Malik

Reliable public lighting remains a critically important and valuable public service in Detroit, Michigan. The Downtown Detroit Energy Efficiency Lighting Program (the, “Program”) was designed and implemented to bring the latest advancements in lighting technology, energy efficiency, public safety and reliability to Detroit’s Central Business District, and the Program accomplished those goals successfully. Downtown’s nighttime atmosphere has been upgraded as a result of the installation of over 1000 new LED roadway lighting fixtures that were installed as part of the Program. The reliability of the lighting system has also improved.

Application of SAW method for multiple-criteria comparative analysis of the reliability of heat supply organizations

NASA Astrophysics Data System (ADS)

Akhmetova, I. G.; Chichirova, N. D.

2016-12-01

Heat supply is the most energy-consuming sector of the economy. Approximately 30% of all used primary fuel-and-energy resources is spent on municipal heat-supply needs. One of the key indicators of activity of heat-supply organizations is the reliability of an energy facility. The reliability index of a heat supply organization is of interest to potential investors for assessing risks when investing in projects. The reliability indices established by the federal legislation are actually reduced to a single numerical factor, which depends on the number of heat-supply outages in connection with disturbances in operation of heat networks and the volume of their resource recovery in the calculation year. This factor is rather subjective and may change in a wide range during several years. A technique is proposed for evaluating the reliability of heat-supply organizations with the use of the simple additive weighting (SAW) method. The technique for integrated-index determination satisfies the following conditions: the reliability level of the evaluated heat-supply system is represented maximum fully and objectively; the information used for the reliability-index evaluation is easily available (is located on the Internet in accordance with demands of data-disclosure standards). For reliability estimation of heat-supply organizations, the following indicators were selected: the wear of equipment of thermal energy sources, the wear of heat networks, the number of outages of supply of thermal energy (heat carrier due to technological disturbances on heat networks per 1 km of heat networks), the number of outages of supply of thermal energy (heat carrier due to technologic disturbances on thermal energy sources per 1 Gcal/h of installed power), the share of expenditures in the cost of thermal energy aimed at recovery of the resource (renewal of fixed assets), coefficient of renewal of fixed assets, and a coefficient of fixed asset retirement. A versatile program is developed and the analysis of heat-supply organizations is performed by the example of the Republic of Tatarstan. The assessment system is based on construction of comparative ratings of heat-supply organizations. A rating is the assessment of reliability of the organization, is characterized by a numerical value, and makes it possible to compare organizations engaged in the same kind of activity between each other.

The brief multidimensional students' life satisfaction scale-college version.

PubMed

Zullig, Keith J; Huebner, E Scott; Patton, Jon M; Murray, Karen A

2009-01-01

To investigate the psychometric properties of the BMSLSS-College among 723 college students. Internal consistency estimates explored scale reliability, factor analysis explored construct validity, and known-groups validity was assessed using the National College Youth Risk Behavior Survey and Harvard School of Public Health College Alcohol Study. Criterion-related validity was explored through analyses with the CDC's health-related quality of life scale and a social isolation scale. Acceptable internal consistency reliability, construct, known-groups, and criterion-related validity were established. Findings offer preliminary support for the BMSLSS-C; it could be useful in large-scale research studies, applied screening contexts, and for program evaluation purposes toward achieving Healthy People 2010 objectives.

Design and implementation of online automatic judging system

NASA Astrophysics Data System (ADS)

Liang, Haohui; Chen, Chaojie; Zhong, Xiuyu; Chen, Yuefeng

2017-06-01

For lower efficiency and poorer reliability in programming training and competition by currently artificial judgment, design an Online Automatic Judging (referred to as OAJ) System. The OAJ system including the sandbox judging side and Web side, realizes functions of automatically compiling and running the tested codes, and generating evaluation scores and corresponding reports. To prevent malicious codes from damaging system, the OAJ system utilizes sandbox, ensuring the safety of the system. The OAJ system uses thread pools to achieve parallel test, and adopt database optimization mechanism, such as horizontal split table, to improve the system performance and resources utilization rate. The test results show that the system has high performance, high reliability, high stability and excellent extensibility.

Probabilistic Structural Analysis Methods (PSAM) for select space propulsion system components, part 2

NASA Technical Reports Server (NTRS)

1991-01-01

The technical effort and computer code enhancements performed during the sixth year of the Probabilistic Structural Analysis Methods program are summarized. Various capabilities are described to probabilistically combine structural response and structural resistance to compute component reliability. A library of structural resistance models is implemented in the Numerical Evaluations of Stochastic Structures Under Stress (NESSUS) code that included fatigue, fracture, creep, multi-factor interaction, and other important effects. In addition, a user interface was developed for user-defined resistance models. An accurate and efficient reliability method was developed and was successfully implemented in the NESSUS code to compute component reliability based on user-selected response and resistance models. A risk module was developed to compute component risk with respect to cost, performance, or user-defined criteria. The new component risk assessment capabilities were validated and demonstrated using several examples. Various supporting methodologies were also developed in support of component risk assessment.

[Evaluating training programs on occupational health and safety: questionnaire development].

PubMed

Zhou, Xiao-Yan; Wang, Zhi-Ming; Wang, Mian-Zhen

2006-03-01

To develop a questionnaire to evaluate the quality of training programs on occupational health and safety. A questionnaire comprising five subscales and 21 items was developed. The reliability and validity of the questionnaire was tested. Final validation of the questionnaire was undertaken in 700 workers in an oil refining company. The Cronbach's alpha coefficients of the five subscales ranged from 0.6194 to 0.6611. The subscale-scale Pearson correlation coefficients ranged from 0.568 to 0.834 . The theta coefficients of the five subscales were greater than 0.7. The factor loadings of the five subscales in the principal component analysis ranged from 0.731 to 0.855. Use of the questionnaire in the 700 workers produced a good discriminability, with excellent, good, fair and poor comprising 22.2%, 31.2%, 32.4% and 14.1 respectively. Given the fact that 18.7% of workers had never been trained and 29.7% of workers got one-off training only, the training program scored an average of 57.2. The questionnaire is suitable to be used in evaluating the quality of training programs on occupational health and safety. The oil refining company needs to improve training for their workers on occupational health and safety.

Evaluation of the Iron Horse Peformance Optimization Physical Training Program (IHPOP) in a Light Infantry Brigade, October 2010-April 2011

DTIC Science & Technology

2014-06-19

cooked 150 35% 1.05 (0.83-1.33) 0.69 ≥4 cups raw or 2 cooked 56 39% 1.17 (0.83-1.64) 0.39 Eat a protein meal 30 minutes after working out Always 789...training and cross training that would effectively increase aerobic capacity and minimize injury risk. Weight loss programs may reduce excess body fat by...IHPOP in a Light Infantry Brigade, October 2010 - April 2011 24 According to the CDC, BMI is a fairly reliable indicator of body fatness for

Advanced detection, isolation, and accommodation of sensor failures in turbofan engines: Real-time microcomputer implementation

NASA Technical Reports Server (NTRS)

Delaat, John C.; Merrill, Walter C.

1990-01-01

The objective of the Advanced Detection, Isolation, and Accommodation Program is to improve the overall demonstrated reliability of digital electronic control systems for turbine engines. For this purpose, an algorithm was developed which detects, isolates, and accommodates sensor failures by using analytical redundancy. The performance of this algorithm was evaluated on a real time engine simulation and was demonstrated on a full scale F100 turbofan engine. The real time implementation of the algorithm is described. The implementation used state-of-the-art microprocessor hardware and software, including parallel processing and high order language programming.

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

Fortran programs for reliability analysis

Treesearch

John J. Zahn

1992-01-01

This report contains a set of FORTRAN subroutines written to calculate the Hasofer-Lind reliability index. Nonlinear failure criteria and correlated basic variables are permitted. Users may incorporate these routines into their own calling program (an example program, RELANAL, is included) and must provide a failure criterion subroutine (two example subroutines,...

Evaluation of the Consumer Assessment of Healthcare Providers and Systems In-Center Hemodialysis Survey

PubMed Central

Paoli, Carly J.; Hays, Ron D.; Taylor-Stokes, Gavin; Piercy, James; Gitlin, Matthew

2014-01-01

Background and objectives The US Centers for Medicare and Medicaid Services (CMS) End Stage Renal Disease Prospective Payment System and Quality Incentive Program requires that dialysis centers meet predefined criteria for quality of patient care to ensure future funding. The CMS selected the Consumer Assessment of Healthcare Providers and Systems In-Center Hemodialysis (CAHPS-ICH) survey for the assessment of patient experience of care. This analysis evaluated the psychometric properties of the CAHPS-ICH survey in a sample of hemodialysis patients. Design, setting, participants, & measurements Data were drawn from the Adelphi CKD Disease Specific Program (a retrospective, cross-sectional survey of nephrologists and patients). Selected United States–based nephrologists treating patients receiving hemodialysis completed patient record forms and provided information on their dialysis center. Patients (n=404) completed the CAHPS-ICH survey (comprising 58 questions) providing six scores for the assessment of patient experience of care. CAHPS-ICH item-scale convergence, discrimination, and reliability were evaluated for multi-item scales. Floor and ceiling effects were estimated for all six scores. Patient (demographics, dialysis history, vascular access method) and facility characteristics (size, ratio of patients-to-physicians, nurses, and technicians) associated with the CAHPS-ICH scores were also evaluated. Results Item-scale correlations and internal consistency reliability estimates provided support for the nephrologists’ communication (range, 0.16–0.71; α=0.81) and quality of care (range, 0.16–0.76; α=0.90) composites. However, the patient information composite had low internal consistency reliability (α=0.55). Provider-to-patient ratios (range, 2.37 for facilities with >36 patients per physician to 2.8 for those with <8 patients per physician) and time spent in the waiting room (3.44 for >15 minutes of waiting time to 3.75 for 5 to <10 minutes) were characteristics most consistently related to patients’ perceptions of dialysis care. Conclusions CAHPS-ICH is a potentially valuable and informative tool for the evaluation of patients’ experiences with dialysis care. Additional studies are needed to estimate clinically meaningful differences between care providers. PMID:24832092

Self-defense and martial arts evaluation for college women: preliminary validation of perceptions of dangerous situations scale.

PubMed

Hughes, Patricia Paulsen; Sherrill, Claudine; Myers, Bettye; Rowe, Nancy; Marshall, David

2003-06-01

Martial arts and self-defense programs train fearful people, especially women, to be more competent and confident to defend themselves in dangerous situations. However, there are no validated instruments to evaluate the effectiveness of programs purporting to teach self-protection. The Perceptions of Dangerous Situations Scale (PDSS), composed of fear, likelihood and confidence subscales, was developed and validated for university women. Participants were 368 university women, ages 17 to 45 years (M age = 20.7 years). Content validity of the PDSS was established through an expert panel, and construct validity was established through principal components analysis and determination of instructional sensitivity. Reliability was established through alpha coefficients. The PDSS, when used with university women, offers promising measurement opportunities in self-defense and martial arts settings.

Develop Advanced Nonlinear Signal Analysis Topographical Mapping System

NASA Technical Reports Server (NTRS)

Jong, Jen-Yi

1997-01-01

During the development of the SSME, a hierarchy of advanced signal analysis techniques for mechanical signature analysis has been developed by NASA and AI Signal Research Inc. (ASRI) to improve the safety and reliability for Space Shuttle operations. These techniques can process and identify intelligent information hidden in a measured signal which is often unidentifiable using conventional signal analysis methods. Currently, due to the highly interactive processing requirements and the volume of dynamic data involved, detailed diagnostic analysis is being performed manually which requires immense man-hours with extensive human interface. To overcome this manual process, NASA implemented this program to develop an Advanced nonlinear signal Analysis Topographical Mapping System (ATMS) to provide automatic/unsupervised engine diagnostic capabilities. The ATMS will utilize a rule-based Clips expert system to supervise a hierarchy of diagnostic signature analysis techniques in the Advanced Signal Analysis Library (ASAL). ASAL will perform automatic signal processing, archiving, and anomaly detection/identification tasks in order to provide an intelligent and fully automated engine diagnostic capability. The ATMS has been successfully developed under this contract. In summary, the program objectives to design, develop, test and conduct performance evaluation for an automated engine diagnostic system have been successfully achieved. Software implementation of the entire ATMS system on MSFC's OISPS computer has been completed. The significance of the ATMS developed under this program is attributed to the fully automated coherence analysis capability for anomaly detection and identification which can greatly enhance the power and reliability of engine diagnostic evaluation. The results have demonstrated that ATMS can significantly save time and man-hours in performing engine test/flight data analysis and performance evaluation of large volumes of dynamic test data.

Radioisotope-powered cardiac pacemaker program. Clinical studies of the nuclear pacemaker model NU-5. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1980-06-01

Beginning in February, 1970, the Nuclear Materials and Equipment Corporation (NUMEC) undertook a program to design, develop and manufacture a radioisotope powered cardiac pacemaker system. The scope of technical work was specified to be: establish system, component, and process cost reduction goals using the prototype Radioisotope Powered Cardiac Pacemaker (RCP) design and develop production techniques to achieve these cost reduction objectives; fabricate radioisotope powered fueled prototype cardiac pacemakers (RCP's) on a pilot production basis; conduct liaison with a Government-designated fueling facility for purposes of defining fueling requirements, fabrication and encapsulation procedures, safety design criteria and quality control and inspection requirements;more » develop and implement Quality Assurance and Reliability Programs; conduct performance, acceptance, lifetime and reliability tests of fueled RCP's in the laboratory; conduct liaison with the National Institutes of Health and with Government specified medical research institutions selected for the purpose of undertaking clinical evaluation of the RCP in humans; monitor and evaluate, on a continuing basis, all test data; and perform necessary safety analyses and tests. Pacemaker designs were developed and quality assurance and manufacturing procedures established. Prototype pacemakers were fabricated. A total of 126 radioisotope powered units were implanted and have been followed clinically for approximately seven years. Four (4) of these units have failed. Eighty-three (83) units remain implanted and satisfactorily operational. An overall failure rate of less than the target 0.15% per month has been achieved.« less

NASA-Ames workload research program

NASA Technical Reports Server (NTRS)

Hart, Sandra

1988-01-01

Research has been underway for several years to develop valid and reliable measures and predictors of workload as a function of operator state, task requirements, and system resources. Although the initial focus of this research was on aeronautics, the underlying principles and methodologies are equally applicable to space, and provide a set of tools that NASA and its contractors can use to evaluate design alternatives from the perspective of the astronauts. Objectives and approach of the research program are described, as well as the resources used in conducting research and the conceptual framework around which the program evolved. Next, standardized tasks are described, in addition to predictive models and assessment techniques and their application to the space program. Finally, some of the operational applications of these tasks and measures are reviewed.

Transit service reliability

DOT National Transportation Integrated Search

1978-12-01

This report presents a comprehensive overview of the subject of transit service reliability and provides a framework for a program of demonstrations and research studies which could be carried out under the Service and Methods Demonstration program. ...

The reliable multicast protocol application programming interface

NASA Technical Reports Server (NTRS)

Montgomery , Todd; Whetten, Brian

1995-01-01

The Application Programming Interface for the Berkeley/WVU implementation of the Reliable Multicast Protocol is described. This transport layer protocol is implemented as a user library that applications and software buses link against.

Program for computer aided reliability estimation

NASA Technical Reports Server (NTRS)

Mathur, F. P. (Inventor)

1972-01-01

A computer program for estimating the reliability of self-repair and fault-tolerant systems with respect to selected system and mission parameters is presented. The computer program is capable of operation in an interactive conversational mode as well as in a batch mode and is characterized by maintenance of several general equations representative of basic redundancy schemes in an equation repository. Selected reliability functions applicable to any mathematical model formulated with the general equations, used singly or in combination with each other, are separately stored. One or more system and/or mission parameters may be designated as a variable. Data in the form of values for selected reliability functions is generated in a tabular or graphic format for each formulated model.

Composite Overwrapped Pressure Vessels (COPV): Developing Flight Rationale for the Space Shuttle Program

NASA Technical Reports Server (NTRS)

Kezirian, Michael T.

2010-01-01

Introducing composite vessels into the Space Shuttle Program represented a significant technical achievement. Each Orbiter vehicle contains 24 (nominally) Kevlar tanks for storage of pressurized helium (for propulsion) and nitrogen (for life support). The use of composite cylinders saved 752 pounds per Orbiter vehicle compared with all-metal tanks. The weight savings is significant considering each Shuttle flight can deliver 54,000 pounds of payload to the International Space Station. In the wake of the Columbia accident and the ensuing Return to Flight activities, the Space Shuttle Program, in 2005, re-examined COPV hardware certification. Incorporating COPV data that had been generated over the last 30 years and recognizing differences between initial Shuttle Program requirements and current operation, a new failure mode was identified, as composite stress rupture was deemed credible. The Orbiter Project undertook a comprehensive investigation to quantify and mitigate this risk. First, the engineering team considered and later deemed as unfeasible the option to replace existing all flight tanks. Second, operational improvements to flight procedures were instituted to reduce the flight risk and the danger to personnel. Third, an Orbiter reliability model was developed to quantify flight risk. Laser profilometry inspection of several flight COPVs identified deep (up to 20 mil) depressions on the tank interior. A comprehensive analysis was performed and it confirmed that these observed depressions were far less than the criterion which was established as necessary to lead to liner buckling. Existing fleet vessels were exonerated from this failure mechanism. Because full validation of the Orbiter Reliability Model was not possible given limited hardware resources, an Accelerated Stress Rupture Test of a flown flight vessel was performed to provide increased confidence. A Bayesian statistical approach was developed to evaluate possible test results with respect to the model credibility and thus flight rationale for continued operation of the Space Shuttle with existing flight hardware. A non-destructive evaluation (NDE) technique utilizing Raman Spectroscopy was developed to directly measure the overwrap residual stress state. Preliminary results provide optimistic results that patterns of fluctuation in fiber elastic strains over the outside vessel surface could be directly correlated with increased fiber stress ratios and thus reduced reliability.

Bayesian accrual prediction for interim review of clinical studies: open source R package and smartphone application.

PubMed

Jiang, Yu; Guarino, Peter; Ma, Shuangge; Simon, Steve; Mayo, Matthew S; Raghavan, Rama; Gajewski, Byron J

2016-07-22

Subject recruitment for medical research is challenging. Slow patient accrual leads to increased costs and delays in treatment advances. Researchers need reliable tools to manage and predict the accrual rate. The previously developed Bayesian method integrates researchers' experience on former trials and data from an ongoing study, providing a reliable prediction of accrual rate for clinical studies. In this paper, we present a user-friendly graphical user interface program developed in R. A closed-form solution for the total subjects that can be recruited within a fixed time is derived. We also present a built-in Android system using Java for web browsers and mobile devices. Using the accrual software, we re-evaluated the Veteran Affairs Cooperative Studies Program 558- ROBOTICS study. The application of the software in monitoring and management of recruitment is illustrated for different stages of the trial. This developed accrual software provides a more convenient platform for estimation and prediction of the accrual process.

Psychometric properties of the Postgraduate Hospital Educational Environment Measure in an Iranian hospital setting.

PubMed

Shokoohi, Shahrzad; Emami, Amir Hossein; Mohammadi, Aeen; Ahmadi, Soleiman; Mojtahedzadeh, Rita

2014-01-01

Background Students' perceptions of the educational environment are an important construct in assessing and enhancing the quality of medical training programs. Reliable and valid measurement, however, can be problematic - especially as instruments developed and tested in one culture are translated for use in another. Materials and method This study sought to explore the psychometric properties of the Postgraduate Hospital Educational Environment Measure (PHEEM) for use in an Iranian hospital training setting. We translated the instrument into Persian and ensured its content validity by back translation and expert review prior to administering it to 127 residents of Urmia University of Medical Science. Results Overall internal consistency of the translated measure was good (a=0.94). Principal components analysis revealed five factors accounting for 52.8% of the variance. Conclusion The Persian version of the PHEEM appears to be a reliable and potentially valid instrument for use in Iranian medical schools and may find favor in evaluating the educational environments of residency programs nationwide.

Psychometric properties of the postgraduate hospital educational environment measure in an Iranian hospital setting.

PubMed

Shokoohi, Shahrzad; Hossein Emami, Amir; Mohammadi, Aeen; Ahmadi, Soleiman; Mojtahedzadeh, Rita

2014-01-01

Students' perceptions of the educational environment are an important construct in assessing and enhancing the quality of medical training programs. Reliable and valid measurement, however, can be problematic - especially as instruments developed and tested in one culture are translated for use in another. This study sought to explore the psychometric properties of the Postgraduate Hospital Educational Environment Measure (PHEEM) for use in an Iranian hospital training setting. We translated the instrument into Persian and ensured its content validity by back translation and expert review prior to administering it to 127 residents of Urmia University of Medical Science. Overall internal consistency of the translated measure was good (a=0.94). Principal components analysis revealed five factors accounting for 52.8% of the variance. The Persian version of the PHEEM appears to be a reliable and potentially valid instrument for use in Iranian medical schools and may find favor in evaluating the educational environments of residency programs nationwide.

Reliability and validity assessment of administrative databases in measuring the quality of rectal cancer management.

PubMed

Corbellini, Carlo; Andreoni, Bruno; Ansaloni, Luca; Sgroi, Giovanni; Martinotti, Mario; Scandroglio, Ildo; Carzaniga, Pierluigi; Longoni, Mauro; Foschi, Diego; Dionigi, Paolo; Morandi, Eugenio; Agnello, Mauro

2018-01-01

Measurement and monitoring of the quality of care using a core set of quality measures are increasing in health service research. Although administrative databases include limited clinical data, they offer an attractive source for quality measurement. The purpose of this study, therefore, was to evaluate the completeness of different administrative data sources compared to a clinical survey in evaluating rectal cancer cases. Between May 2012 and November 2014, a clinical survey was done on 498 Lombardy patients who had rectal cancer and underwent surgical resection. These collected data were compared with the information extracted from administrative sources including Hospital Discharge Dataset, drug database, daycare activity data, fee-exemption database, and regional screening program database. The agreement evaluation was performed using a set of 12 quality indicators. Patient complexity was a difficult indicator to measure for lack of clinical data. Preoperative staging was another suboptimal indicator due to the frequent missing administrative registration of tests performed. The agreement between the 2 data sources regarding chemoradiotherapy treatments was high. Screening detection, minimally invasive techniques, length of stay, and unpreventable readmissions were detected as reliable quality indicators. Postoperative morbidity could be a useful indicator but its agreement was lower, as expected. Healthcare administrative databases are large and real-time collected repositories of data useful in measuring quality in a healthcare system. Our investigation reveals that the reliability of indicators varies between them. Ideally, a combination of data from both sources could be used in order to improve usefulness of less reliable indicators.

Preliminary Analysis of LORAN-C System Reliability for Civil Aviation.

DTIC Science & Technology

1981-09-01

overviev of the analysis technique. Section 3 describes the computerized LORAN-C coverage model which is used extensively in the reliability analysis...Xth Plenary Assembly, Geneva, 1963, published by International Telecomunications Union. S. Braff, R., Computer program to calculate a Karkov Chain Reliability Model, unpublished york, MITRE Corporation. A-1 I.° , 44J Ili *Y 0E 00 ...F i8 1110 Prelim inary Analysis of Program Engineering & LORAN’C System ReliabilityMaintenance Service i ~Washington. D.C.

Managing Reliability in the 21st Century

DOE Office of Scientific and Technical Information (OSTI.GOV)

Dellin, T.A.

1998-11-23

The rapid pace of change at Ike end of the 20th Century should continue unabated well into the 21st Century. The driver will be the marketplace imperative of "faster, better, cheaper." This imperative has already stimulated a revolution-in-engineering in design and manufacturing. In contrast, to date, reliability engineering has not undergone a similar level of change. It is critical that we implement a corresponding revolution-in-reliability-engineering as we enter the new millennium. If we are still using 20th Century reliability approaches in the 21st Century, then reliability issues will be the limiting factor in faster, better, and cheaper. At the heartmore » of this reliability revolution will be a science-based approach to reliability engineering. Science-based reliability will enable building-in reliability, application-specific products, virtual qualification, and predictive maintenance. The purpose of this paper is to stimulate a dialogue on the future of reliability engineering. We will try to gaze into the crystal ball and predict some key issues that will drive reliability programs in the new millennium. In the 21st Century, we will demand more of our reliability programs. We will need the ability to make accurate reliability predictions that will enable optimizing cost, performance and time-to-market to meet the needs of every market segment. We will require that all of these new capabilities be in place prior to the stint of a product development cycle. The management of reliability programs will be driven by quantifiable metrics of value added to the organization business objectives.« less

Evaluation of urology residents' perception of surgical theater educational environment.

PubMed

Binsaleh, Saleh; Babaeer, Abdulrahman; Rabah, Danny; Madbouly, Khaled

2015-01-01

To evaluate surgical theater learning environment perception in urology residents in Saudi Arabia and to investigate association of learning environment perception and stages of residency program, sectors of health care system, and regions of Saudi Arabia. A cross-sectional survey using the surgical theater educational environment measure (STEEM) inventory. The STEEM inventory was used to measure theater learning environment perception of urology residents in Saudi Arabia. Respondents' perception was compared regarding different residency stages, sectors of the health care system, and regions of Saudi Arabia. Internal reliability of the inventory was assessed using the Cronbach α coefficient. Correlation analysis was done using the Spearman ρ coefficient. Of 72 registered residents, 33 (45.8%) completed the questionnaire. The residents perceived their environment less than acceptable (135.9 ± 16.7, 67.95%). No significant differences in perception were found among residents of different program stages, different sectors of health care system, or different regions in Saudi Arabia. Residents from the eastern region perceived the training and teaching domain better (p = 0.025). The inventory showed a high internal consistency with a Cronbach α of 0.862. STEEM survey is an applicable and reliable instrument for assessing the learning environment and training skills of urology residency program in Saudi Arabia. Urology residents in Saudi Arabia perceived the theater learning environment as less than ideal. The perceptions of theater learning environment did not change significantly among different stages of the program, different sectors of health care system, or different training regions of Saudi Arabia assuring the uniformity of urology training all over Saudi Arabia. The training programs should address significant concerns and pay close attention to areas in surgical theater educational environment, which need development and enhancement, mainly planned fashion of training, supportive supervision and hospital environment, and proper coverage and management of workloads. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Development and validation of a 6-point grading scale in patients undergoing correction of nasolabial folds with a collagen implant.

PubMed

Monheit, Gary D; Gendler, Ellen C; Poff, Bradley; Fleming, Laura; Bachtell, Nathan; Garcia, Emily; Burkholder, David

2010-11-01

Various scoring techniques prone to subjective interpretation have been used to evaluate soft tissue augmentation of nasolabial folds (NLFs). To design and validate a reliable wrinkle assessment scoring scale. Six photographed wrinkles of varying severity were electronically copied onto the same facial image to become a 6-point grading scale (GGS). A pilot training program (13 investigators) determined reliability, and a 12-week multicenter survey study validated the GGS scoring method. Pilot study inter- and intrarater scoring reliability were high (weighted kappa scores of 0.85 and 0.86, respectively). Seventy-five percent of survey investigators and independent review panel (IRP) members considered a GGS score difference of 0.5 to be a minimally perceivable difference. Interrater weighted kappa scores were 0.91 for the IRP and 0.80 for investigators. Intrarater agreements after repeat testing were 0.91 and 0.89, respectively. The baseline "live" assessment GGS mean score was 3.34, and the baseline blinded photographic assessment GGS mean score was 2.00 for the IRP and 2.16 for the investigators. The GGS is a reproducible method of grading the severity of NLF wrinkles. Treatment effectiveness of a dermal filler can be reliably evaluated using the GGS by comparing "live" assessments with the standard GGS photographic panel. © 2010 by the American Society for Dermatologic Surgery, Inc.

Development of KSC program for investigating and generating field failure rates. Volume 1: Summary and overview

NASA Technical Reports Server (NTRS)

Bean, E. E.; Bloomquist, C. E.

1972-01-01

A summary of the KSC program for investigating the reliability aspects of the ground support activities is presented. An analysis of unsatisfactory condition reports (RC), and the generation of reliability assessment of components based on the URC are discussed along with the design considerations for attaining reliable real time hardware/software configurations.

Adolescent and Young Adult Cancer Survivorship Educational Programming: A Qualitative Evaluation

PubMed Central

Fair, Kayla; Hong, Yan Alicia; Kellstedt, Debra; Ory, Marcia G

2017-01-01

Background This program evaluation considers the need for increased professional and patient education for adolescent and young adult (AYA) cancer survivorship. Due to the high incidence of late effects of cancer treatment among AYA cancer survivors, knowledge sharing and communications are needed throughout the transition from cancer care into community care. AYA survivors are likely to need developmentally appropriate psychosocial care as well as extensive follow-on surveillance by physicians who are educated and aware of the likely chronic conditions and late effects that may occur in these patients. Objective The objective of this study was to evaluate the outcomes of the After Cancer Care Ends, Survivorship Starts for Adolescent and Young Adults (ACCESS AYA) programming. The intent of the ACCESS AYA program was to build health literacy around AYA survivorship issues and to stimulate improved communications between survivors and health care providers. This paper addresses the central research question of “How did the ACCESS AYA program increase health literacy, communications, and understanding among AYA survivors and providers?” Methods The primarily qualitative evaluation included a brief introductory survey of participant awareness and effectiveness of the ACCESS AYA project serving as a recruitment tool. Survey respondents were invited to participate in in-depth interviews based on interview guides tailored to the different stakeholder groups. The evaluation used the Atlas Ti qualitative database and software for coding and key word analyses. Interrater reliability analyses were assessed using Cohen kappa analysis with Stata 12.1 (StataCorp LLC) software. Results The key themes, which included survivor wellbeing, health care professional education, cancer advocates role and education, hospital and community-based resources, and the role of societal support, are presented in a concept map. The interrater reliability scores (ranging from 1 to minus 1) were .893 for first cycle coding and .784 for the second cycle. In the brief quantitative survey based on a scale of 1 to 5 with 5 as high, the 22 respondents rated their level of awareness of the project with a mean 3.2 (CI 3.02-3.45) and project effectiveness with a mean of 4 (CI 3.72-4.27). Conclusions This study contributes to understanding of the ACCESS AYA survivor community in central Texas and the health care professionals and advocates who aid them in their efforts to a new normal life and wellbeing in their survivorship. The results of the evaluation highlight the need to continue to build both survivor and professional resources to address the unique impact of cancer on AYA cancer survivors. PMID:28410172

Application of a digital technique in evaluating the reliability of shade guides.

PubMed

Cal, E; Sonugelen, M; Guneri, P; Kesercioglu, A; Kose, T

2004-05-01

There appears to be a need for a reliable method for quantification of tooth colour and analysis of shade. Therefore, the primary objective of this study was to show the applicability of graphic software in colour analysis and secondly to investigate the reliability of commercial shade guides produced by the same manufacturer, using this digital technique. After confirming the reliability and reproducibility of the digital method by using self-assessed coloured images, three shade guides of the same manufacturer were photographed in daylight and in studio environments with a digital camera and saved in tagged image file format (TIFF) format. Colour analysis of each photograph was performed using the Adobe Photoshop 4.0 graphic program. Luminosity, and red, green, blue (L and RGB) values of each shade tab of each shade guide were measured and the data were subjected to statistical analysis using the repeated measure Anova test. The L and RGB values of the images taken in daylight differed significantly from those of the images taken in studio environment (P < 0.05). In both environments, the luminosity and red values of the shade tabs were significantly different from each other (P < 0.05). It was concluded that, when the environmental conditions were kept constant, the Adobe Photoshop 4.0 colour analysis program could be used to analyse the colour of images. On the other hand, the results revealed that the accuracy of shade tabs widely being used in colour matching should be readdressed.

Estimation by simulation of the efficiency of the French marker-assisted selection program in dairy cattle (Open Access publication)

PubMed Central

Guillaume, François; Fritz, Sébastien; Boichard, Didier; Druet, Tom

2008-01-01

The efficiency of the French marker-assisted selection (MAS) was estimated by a simulation study. The data files of two different time periods were used: April 2004 and 2006. The simulation method used the structure of the existing French MAS: same pedigree, same marker genotypes and same animals with records. The program simulated breeding values and new records based on this existing structure and knowledge on the QTL used in MAS (variance and frequency). Reliabilities of genetic values of young animals (less than one year old) obtained with and without marker information were compared to assess the efficiency of MAS for evaluation of milk, fat and protein yields and fat and protein contents. Mean gains of reliability ranged from 0.015 to 0.094 and from 0.038 to 0.114 in 2004 and 2006, respectively. The larger number of animals genotyped and the use of a new set of genetic markers can explain the improvement of MAS reliability from 2004 to 2006. This improvement was also observed by analysis of information content for young candidates. The gain of MAS reliability with respect to classical selection was larger for sons of sires with genotyped progeny daughters with records. Finally, it was shown that when superiority of MAS over classical selection was estimated with daughter yield deviations obtained after progeny test instead of true breeding values, the gain was underestimated. PMID:18096117

High-reliability gas-turbine combined-cycle development program: Phase II. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hecht, K.G.; Sanderson, R.A.; Smith, M.J.

This three-volume report presents the results of Phase II of the multiphase EPRI-sponsored High-Reliability Gas Turbine Combined-Cycle Development Program whose goal is to achieve a highly reliable gas turbine combined-cycle power plant, available by the mid-1980s, which would be an economically attractive baseload generation alternative for the electric utility industry. The Phase II program objective was to prepare the preliminary design of this power plant. This volume presents information of the reliability, availability, and maintainability (RAM) analysis of a representative plant and the preliminary design of the gas turbine, the gas turbine ancillaries, and the balance of plant including themore » steam turbine generator. To achieve the program goals, a gas turbine was incorporated which combined proven reliability characteristics with improved performance features. This gas turbine, designated the V84.3, is the result of a cooperative effort between Kraftwerk Union AG and United Technologies Corporation. Gas turbines of similar design operating in Europe under baseload conditions have demonstrated mean time between failures in excess of 40,000 hours. The reliability characteristics of the gas turbine ancillaries and balance-of-plant equipment were improved through system simplification and component redundancy and by selection of component with inherent high reliability. A digital control system was included with logic, communications, sensor redundancy, and mandual backup. An independent condition monitoring and diagnostic system was also included. Program results provide the preliminary design of a gas turbine combined-cycle baseload power plant. This power plant has a predicted mean time between failure of nearly twice the 3000-hour EPRI goal. The cost of added reliability features is offset by improved performance, which results in a comparable specific cost and an 8% lower cost of electricity compared to present market offerings.« less

Evaluation of the Military Functional Assessment Program: Inter rater Reliability of Task Scores

DTIC Science & Technology

2017-09-19

return-to-duty. Performance on the tasks is rated by a non-commissioned officer (NCO), occupational therapist, physical therapist, and mental health ...and additional ratings are provided on a subset of the tasks by an occupational therapist (OT), physical therapist (PT), and mental health (MH...3National Intrepid Center of Excellence United States Army Aeromedical Research Laboratory Aircrew Health and Performance Division September 2017

MSIX - A general and user-friendly platform for RAM analysis

NASA Astrophysics Data System (ADS)

Pan, Z. J.; Blemel, Peter

The authors present a CAD (computer-aided design) platform supporting RAM (reliability, availability, and maintainability) analysis with efficient system description and alternative evaluation. The design concepts, implementation techniques, and application results are described. This platform is user-friendly because of its graphic environment, drawing facilities, object orientation, self-tutoring, and access to the operating system. The programs' independency and portability make them generally applicable to various analysis tasks.

Evaluation program for secondary spacecraft cells

NASA Technical Reports Server (NTRS)

Christy, D. E.; Harkness, J. D.

1973-01-01

A life cycle test of secondary electric batteries for spacecraft applications was conducted. A sample number of nickel cadmium batteries were subjected to general performance tests to determine the limit of their actual capabilities. Weaknesses discovered in cell design are reported and aid in research and development efforts toward improving the reliability of spacecraft batteries. A statistical analysis of the life cycle prediction and cause of failure versus test conditions is provided.

Defense AT&L (Volume 37, Number 2, March-April 2008)

DTIC Science & Technology

2008-04-01

environment. Operational suit- ability is the degree to which a system can be satisfactorily placed in field use, with consideration given to reliability...devise the most effective test-and-evaluation strategy. Whenever possible, the program should be developed and fielded in small increments and provided... ability to control access to design-related informa- tion and availability of technology, and it will raise grave security considerations. Do you develop

Eliciting management action: Using THERP to highlight human factors deficiencies for trip reduction programs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Fuld, R.; Cybert, S.

Methods and criteria for performing human factors evaluations of plant systems and procedures are well developed and available. For a design review to produce a positive impact on operations, however, it is not enough to simply document deficiences and solutions. The results must be presented to management in a clear and compelling form that will direct attention to the heart of a problem and present proposed solutions in terms of explicit, quantified cost/benefits. A proactive program of trip reduction provides an excellent opportunity to accomplish human factors-related upgrades. As an evaluative context, trip reduction imposes a uniform goodness criterion onmore » all situations: the probability of inadvertent plant trip. This in turn means that findings can be compared in terms of a common quantitative reference point: the cost of an inadvertent shutdown. To interpret human factors deficiencies in terms of trip probabilities, the Technique for Human Error Rate Prediction (THERP) can be used. THERP provides an accessible compilation of human reliability data for generic, discrete task elements. Sequences of such values are combined in standard event trees to determine the probability of failure (e.g., trip) for a given evolution. THERP is widely accepted as one of the best available alternatives for assessing human reliability.« less

Identification and validation of nebulized aerosol devices for sputum induction

PubMed Central

Davidson, Warren J; Dennis, John; The, Stephanie; Litoski, Belinda; Pieron, Cora; Leigh, Richard

2014-01-01

Induced sputum cell count measurement has proven reliability for evaluating airway inflammation in patients with asthma and other airway diseases. Although the use of nebulizer devices for sputum induction is commonplace, they are generally labelled as single-patient devices by the manufacturer and, therefore, cannot be used for multiple patients in large clinical sputum induction programs due to infect ion-control requirements. Accordingly, this study investigated the aerosol characteristics of alternative devices that could be used in such programs. BACKGROUND: Induced sputum cell counts are a noninvasive and reliable method for evaluating the presence, type and degree of airway inflammation in patients with asthma. Currently, standard nebulizer devices used for sputum induction in multiple patients are labelled as single-patient devices by the manufacturer, which conflicts with infection prevention and control requirements. As such, these devices cannot feasibly be used in a clinical sputum induction program. Therefore, there is a need to identify alternative nebulizer devices that are either disposable or labelled for multi-patient use. OBJECTIVE: To apply validated rigorous, scientific testing methods to identify and validate commercially available nebulizer devices appropriate for use in a clinical sputum induction program. METHODS: Measurement of nebulized aerosol output and size for the selected nebulizer designs followed robust International Organization for Standardization methods. Sputum induction using two of these nebulizers was successfully performed on 10 healthy adult subjects. The cytotechnologist performing sputum cell counts was blinded to the type of nebulizer used. RESULTS: The studied nebulizers had variable aerosol outputs. The AeroNeb Solo (Aerogen, Ireland), Omron NE-U17 (Omron, Japan) and EASYneb II (Flaem Nuova, Italy) systems were found to have similar measurements of aerosol size. There was no significant difference in induced sputum cell results between the AeroNeb Solo and EASYneb II devices. DISCUSSION: There is a need for rigorous, scientific evaluation of nebulizer devices for clinical applications, including sputum induction, for measurement of cell counts. CONCLUSION: The present study was the most comprehensive analysis of different nebulizer devices for sputum induction to measure cell counts, and provides a framework for appropriate evaluation of nebulizer devices for induced sputum testing. PMID:24288700

Reliability and validity of a treatment adherence measure for child psychiatric rehabilitation.

PubMed

Williams, Nathaniel J; Green, Philip

2012-09-01

Treatment adherence, defined as the degree to which practitioners implemented prescribed program principles and activities and avoided proscribed activities, has been an area of growing interest in mental health services for children with severe emotional and behavioral disorders. This study evaluated the reliability and validity of a treatment adherence measure for child psychiatric rehabilitation (CPSR). Parents of children receiving CPSR (n = 79) or psychotherapy (n = 27) completed the Children's Psychosocial Rehabilitation Treatment Adherence Measure (CTAM) and a measure of 2-week session impact. Psychiatric rehabilitation (PSR) supervisors identified PSR practitioners with reputations for high or low adherence to the model. The CTAM's discriminant validity was assessed by using known-groups procedures and predictive validity by examining its relationship to 2-week session impact. The CTAM demonstrated excellent internal consistency (α = .92), discriminant validity (p = .002, d = .72; p = .021, d = .59), and predictive validity (B = 2.24, SE = .31, p < .001), accounting for 28% of the child-level variance in 2-week session impact. Findings suggest the CTAM is a reliable and valid measure of treatment adherence for CPSR programs with a skill-teaching focus. Providers and agencies should take steps to enhance treatment adherence because it may be an important predictor of children's short-term response to CPSR. (PsycINFO Database Record (c) 2012 APA, all rights reserved).

Escherichia coli sampling reliability at a frequently closed Chicago beach: monitoring and management implications

USGS Publications Warehouse

Whitman, Richard L.; Nevers, Meredith B.

2004-01-01

Monitoring beaches for recreational water quality is becoming more common, but few sampling designs or policy approaches have evaluated the efficacy of monitoring programs. The authors intensively sampled water for E. coli (N=1770) at 63rd Street Beach, Chicago for 6 months in 2000 in order to (1) characterize spatial-temporal trends, (2) determine between and within transect variation, and (3) estimate sample size requirements and determine sampling reliability.E. coli counts were highly variable within and between sampling sites but spatially and diurnally autocorrelated. Variation in counts decreased with water depth and time of day. Required number of samples was high for 70% precision around the critical closure level (i.e., 6 within or 24 between transect replicates). Since spatial replication may be cost prohibitive, composite sampling is an alternative once sources of error have been well defined. The results suggest that beach monitoring programs may be requiring too few samples to fulfill management objectives desired. As the recreational water quality national database is developed, it is important that sampling strategies are empirically derived from a thorough understanding of the sources of variation and the reliability of collected data. Greater monitoring efficacy will yield better policy decisions, risk assessments, programmatic goals, and future usefulness of the information.

Assessment, development, and testing of glass for blast environments.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Glass, Sarah Jill

2003-06-01

Glass can have lethal effects including fatalities and injuries when it breaks and then flies through the air under blast loading (''the glass problem''). One goal of this program was to assess the glass problem and solutions being pursued to mitigate it. One solution to the problem is the development of new glass technology that allows the strength and fragmentation to be controlled or selected depending on the blast performance specifications. For example the glass could be weak and fail, or it could be strong and survive, but it must perform reliably. Also, once it fails it should produce fragmentsmore » of a controlled size. Under certain circumstances it may be beneficial to have very small fragments, in others it may be beneficial to have large fragments that stay together. The second goal of this program was to evaluate the performance (strength, reliability, and fragmentation) of Engineered Stress Profile (ESP) glass under different loading conditions. These included pseudo-static strength and pressure tests and free-field blast tests. The ultimate goal was to provide engineers and architects with a glass whose behavior under blast loading is less lethal. A near-term benefit is a new approach for improving the reliability of glass and modifying its fracture behavior.« less

The Mexican experience in monitoring and evaluation of public policies addressing social determinants of health

PubMed Central

Valle, Adolfo Martinez

2016-01-01

Monitoring and evaluation (M&E) have gradually become important and regular components of the policy-making process in Mexico since, and even before, the World Health Organization (WHO) Commission on Social Determinants of Health (CSDH) called for interventions and policies aimed at tackling the social determinants of health (SDH). This paper presents two case studies to show how public policies addressing the SDH have been monitored and evaluated in Mexico using reliable, valid, and complete information, which is not regularly available. Prospera, for example, evaluated programs seeking to improve the living conditions of families in extreme poverty in terms of direct effects on health, nutrition, education and income. Monitoring of Prospera's implementation has also helped policy-makers identify windows of opportunity to improve the design and operation of the program. Seguro Popular has monitored the reduction of health inequalities and inequities evaluated the positive effects of providing financial protection to its target population. Useful and sound evidence of the impact of programs such as Progresa and Seguro Popular plus legal mandates, and a regulatory evaluation agency, the National Council for Social Development Policy Evaluation, have been fundamental to institutionalizing M&E in Mexico. The Mexican experience may provide useful lessons for other countries facing the challenge of institutionalizing the M&E of public policy processes to assess the effects of SDH as recommended by the WHO CSDH. PMID:26928215

The Mexican experience in monitoring and evaluation of public policies addressing social determinants of health.

PubMed

Valle, Adolfo Martinez

2016-01-01

Monitoring and evaluation (M&E) have gradually become important and regular components of the policy-making process in Mexico since, and even before, the World Health Organization (WHO) Commission on Social Determinants of Health (CSDH) called for interventions and policies aimed at tackling the social determinants of health (SDH). This paper presents two case studies to show how public policies addressing the SDH have been monitored and evaluated in Mexico using reliable, valid, and complete information, which is not regularly available. Prospera, for example, evaluated programs seeking to improve the living conditions of families in extreme poverty in terms of direct effects on health, nutrition, education and income. Monitoring of Prospera's implementation has also helped policy-makers identify windows of opportunity to improve the design and operation of the program. Seguro Popular has monitored the reduction of health inequalities and inequities evaluated the positive effects of providing financial protection to its target population. Useful and sound evidence of the impact of programs such as Progresa and Seguro Popular plus legal mandates, and a regulatory evaluation agency, the National Council for Social Development Policy Evaluation, have been fundamental to institutionalizing M&E in Mexico. The Mexican experience may provide useful lessons for other countries facing the challenge of institutionalizing the M&E of public policy processes to assess the effects of SDH as recommended by the WHO CSDH.

Video Monitoring a Simulation-Based Quality Improvement Program in Bihar, India.

PubMed

Dyer, Jessica; Spindler, Hilary; Christmas, Amelia; Shah, Malay Bharat; Morgan, Melissa; Cohen, Susanna R; Sterne, Jason; Mahapatra, Tanmay; Walker, Dilys

2018-04-01

Simulation-based training has become an accepted clinical training andragogy in high-resource settings with its use increasing in low-resource settings. Video recordings of simulated scenarios are commonly used by facilitators. Beyond using the videos during debrief sessions, researchers can also analyze the simulation videos to quantify technical and nontechnical skills during simulated scenarios over time. Little is known about the feasibility and use of large-scale systems to video record and analyze simulation and debriefing data for monitoring and evaluation in low-resource settings. This manuscript describes the process of designing and implementing a large-scale video monitoring system. Mentees and Mentors were consented and all simulations and debriefs conducted at 320 Primary Health Centers (PHCs) were video recorded. The system design, number of video recordings, and inter-rater reliability of the coded videos were assessed. The final dataset included a total of 11,278 videos. Overall, a total of 2,124 simulation videos were coded and 183 (12%) were blindly double-coded. For the double-coded sample, the average inter-rater reliability (IRR) scores were 80% for nontechnical skills, and 94% for clinical technical skills. Among 4,450 long debrief videos received, 216 were selected for coding and all were double-coded. Data quality of simulation videos was found to be very good in terms of recorded instances of "unable to see" and "unable to hear" in Phases 1 and 2. This study demonstrates that video monitoring systems can be effectively implemented at scale in resource limited settings. Further, video monitoring systems can play several vital roles within program implementation, including monitoring and evaluation, provision of actionable feedback to program implementers, and assurance of program fidelity.

Development and Evaluation of a Training Program for Organ Procurement Coordinators Using Standardized Patient Methodology.

PubMed

Odabasi, Orhan; Elcin, Melih; Uzun Basusta, Bilge; Gulkaya Anik, Esin; Aki, Tuncay F; Bozoklar, Ata

2015-12-01

The low rate of consent by next of kin of donor-eligible patients is a major limiting factor in organ transplant. Educating health care professionals about their role may lead to measurable improvements in the process. Our aim was to describe the developmental steps of a communication skills training program for health care professionals using standardized patients and to evaluate the results. We developed a rubric and 5 cases for standardized family interviews. The 20 participants interviewed standardized families at the beginning and at the end of the training course, with interviews followed by debriefing sessions. Participants also provided feedback before and after the course. The performance of each participant was assessed by his or her peers using the rubric. We calculated the generalizability coefficient to measure the reliability of the rubric and used the Wilcoxon signed rank test to compare achievement among participants. Statistical analyses were performed with SPSS software (SPSS: An IBM Company, version 17.0, IBM Corporation, Armonk, NY, USA). All participants received higher scores in their second interview, including novice participants who expressed great discomfort during their first interview. The participants rated the scenarios and the standardized patients as very representative of real-life situations, with feedback forms showing that the interviews, the video recording sessions, and the debriefing sessions contributed to their learning. Our program was designed to meet the current expectations and implications in the field of donor consent from next of kin. Results showed that our training program developed using standardized patient methodology was effective in obtaining the communication skills needed for family interviews during the consent process. The rubric developed during the study was a valid and reliable assessment tool that could be used in further educational activities. The participants showed significant improvements in communication skills.

50 CFR 600.1004 - Accepting a request for, and determinations about initiating, a financed program.

Code of Federal Regulations, 2011 CFR

2011-10-01

... design, propose, and adopt a timely and reliable implementation plan as well as propose and issue timely and reliable implementation regulations and otherwise complete the program in accordance with this...

The impact of intrinsic motivation on session attendance and reliable cognitive improvement in cognitive remediation in schizophrenia.

PubMed

Bryce, S D; Lee, S J; Ponsford, J L; Lawrence, R J; Tan, E J; Rossell, S L

2018-06-20

Cognitive remediation (CR) is considered a potentially effective method of improving cognitive function in people with schizophrenia. Few studies, however, have explored the role of intrinsic motivation on treatment utilization or training outcomes in CR in this population. This study explored the impact of task-specific intrinsic motivation on attendance and reliable cognitive improvement in a controlled trial comparing CR with a computer game (CG) playing control. Forty-nine participants with schizophrenia or schizoaffective disorder, allocated to 10 weeks of group-based CR (n = 25) or CG control (n = 24), provided complete outcome data at baseline. Forty-three participants completed their assigned intervention. Cognition, psychopathology and intrinsic motivation were measured at baseline and end-treatment. Regression analyses explored the relative contribution of baseline motivation and other clinical factors to session attendance as well as the association of baseline and change in intrinsic motivation with the odds of reliable cognitive improvement (calculated using reliable change indices). Baseline reports of perceived program value were the only significant multivariable predictor of session attendance when including global cognition and psychiatric symptomatology. The odds of reliable cognitive improvement significantly increased with greater improvements in program interest and value from baseline to end-treatment. Motivational changes over time were highly variable between participants. Task-specific intrinsic motivation in schizophrenia may represent an important patient-related factor that contributes to session attendance and cognitive improvements in CR. Regular evaluation and enhancement of intrinsic motivation in cognitively enhancing interventions may optimize treatment engagement and the likelihood of meaningful training outcomes. Copyright © 2018 Elsevier B.V. All rights reserved.

A Quantitative Reliability, Maintainability and Supportability Approach for NASA's Second Generation Reusable Launch Vehicle

NASA Technical Reports Server (NTRS)

Safie, Fayssal M.; Daniel, Charles; Kalia, Prince; Smith, Charles A. (Technical Monitor)

2002-01-01

The United States National Aeronautics and Space Administration (NASA) is in the midst of a 10-year Second Generation Reusable Launch Vehicle (RLV) program to improve its space transportation capabilities for both cargo and crewed missions. The objectives of the program are to: significantly increase safety and reliability, reduce the cost of accessing low-earth orbit, attempt to leverage commercial launch capabilities, and provide a growth path for manned space exploration. The safety, reliability and life cycle cost of the next generation vehicles are major concerns, and NASA aims to achieve orders of magnitude improvement in these areas. To get these significant improvements, requires a rigorous process that addresses Reliability, Maintainability and Supportability (RMS) and safety through all the phases of the life cycle of the program. This paper discusses the RMS process being implemented for the Second Generation RLV program.

Design for Reliability and Safety Approach for the New NASA Launch Vehicle

NASA Technical Reports Server (NTRS)

Safie, Fayssal M.; Weldon, Danny M.

2007-01-01

The United States National Aeronautics and Space Administration (NASA) is in the midst of a space exploration program intended for sending crew and cargo to the international Space Station (ISS), to the moon, and beyond. This program is called Constellation. As part of the Constellation program, NASA is developing new launch vehicles aimed at significantly increase safety and reliability, reduce the cost of accessing space, and provide a growth path for manned space exploration. Achieving these goals requires a rigorous process that addresses reliability, safety, and cost upfront and throughout all the phases of the life cycle of the program. This paper discusses the "Design for Reliability and Safety" approach for the NASA new launch vehicles, the ARES I and ARES V. Specifically, the paper addresses the use of an integrated probabilistic functional analysis to support the design analysis cycle and a probabilistic risk assessment (PRA) to support the preliminary design and beyond.

Lifetime Reliability Prediction of Ceramic Structures Under Transient Thermomechanical Loads

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Jadaan, Osama J.; Gyekenyesi, John P.

2005-01-01

An analytical methodology is developed to predict the probability of survival (reliability) of ceramic components subjected to harsh thermomechanical loads that can vary with time (transient reliability analysis). This capability enables more accurate prediction of ceramic component integrity against fracture in situations such as turbine startup and shutdown, operational vibrations, atmospheric reentry, or other rapid heating or cooling situations (thermal shock). The transient reliability analysis methodology developed herein incorporates the following features: fast-fracture transient analysis (reliability analysis without slow crack growth, SCG); transient analysis with SCG (reliability analysis with time-dependent damage due to SCG); a computationally efficient algorithm to compute the reliability for components subjected to repeated transient loading (block loading); cyclic fatigue modeling using a combined SCG and Walker fatigue law; proof testing for transient loads; and Weibull and fatigue parameters that are allowed to vary with temperature or time. Component-to-component variation in strength (stochastic strength response) is accounted for with the Weibull distribution, and either the principle of independent action or the Batdorf theory is used to predict the effect of multiaxial stresses on reliability. The reliability analysis can be performed either as a function of the component surface (for surface-distributed flaws) or component volume (for volume-distributed flaws). The transient reliability analysis capability has been added to the NASA CARES/ Life (Ceramic Analysis and Reliability Evaluation of Structures/Life) code. CARES/Life was also updated to interface with commercially available finite element analysis software, such as ANSYS, when used to model the effects of transient load histories. Examples are provided to demonstrate the features of the methodology as implemented in the CARES/Life program.

Availability of solar energy reports from the National Solar Data Program

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1981-07-01

This booklet discusses the various types of reports published by the National Solar Data Program, lists the reports issued prior to July 15, 1981, and provides order blanks for obtaining copies of reports. The reports identified in the following pages are segmented into nine types: monthly performance reports; solar energy performance evaluation reports; solar performance bulletins;environmental data reports;solar project description reports;solar project cost reports;program information reports;comparative reports; and reliability and material assessment reports. For convenience, available site-specific reports are listed alphabetically by site name, solar system type, and by state. These reports are disseminated through the US Department of Energy,more » Technical Information Center, P.O. Box 62, Oak Ridge, Tennessee 37830.« less

Validation of the SURE Program, phase 1

NASA Technical Reports Server (NTRS)

Dotson, Kelly J.

1987-01-01

Presented are the results of the first phase in the validation of the SURE (Semi-Markov Unreliability Range Evaluator) program. The SURE program gives lower and upper bounds on the death-state probabilities of a semi-Markov model. With these bounds, the reliability of a semi-Markov model of a fault-tolerant computer system can be analyzed. For the first phase in the validation, fifteen semi-Markov models were solved analytically for the exact death-state probabilities and these solutions compared to the corresponding bounds given by SURE. In every case, the SURE bounds covered the exact solution. The bounds, however, had a tendency to separate in cases where the recovery rate was slow or the fault arrival rate was fast.

Accuracy and Reliability Assessment of CT and MR Perfusion Analysis Software Using a Digital Phantom

PubMed Central

Christensen, Soren; Sasaki, Makoto; Østergaard, Leif; Shirato, Hiroki; Ogasawara, Kuniaki; Wintermark, Max; Warach, Steven

2013-01-01

Purpose: To design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom. Materials and Methods: A phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5–87.5 mL/100 g per minute), CBV (1.0–5.0 mL/100 g), MTT (3.4–24 seconds), and tracer delays (0–3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated. Results: In CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm. Conclusion: The digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values. © RSNA, 2012 Supplemental material: http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12112618/-/DC1 PMID:23220899

[Development of MEDUC-PG14 survey to assess postgraduate teaching in medical specialties].

PubMed

Pizarro, Margarita; Solís, Nancy; Rojas, Viviana; Díaz, Luis Antonio; Padilla, Oslando; Letelier, Luz María; Aizman, Andrés; Sarfatis, Alberto; Olivos, Trinidad; Soza, Alejandro; Delfino, Alejandro; Latorre, Gonzalo; Ivanovic-Zuvic, Danisa; Hoyl, Trinidad; Bitran, Marcela; Arab, Juan Pablo; Riquelme, Arnoldo

2015-08-01

Feedback is one of the most important tools to improve teaching in medical education. To develop an instrument to assess the performance of clinical postgraduate teachers in medical specialties. A qualitative methodology consisting in interviews and focus-groups followed by a quantitative methodology to generate consensus, was employed. After generating the instrument, psychometric tests were performed to assess the construct validity (factor analysis) and reliability (Cronbach’s alpha). Experts in medical education, teachers and residents of a medical school participated in interviews and focus groups. With this information, 26 categories (79 items) were proposed and reduced to 14 items (Likert scale 1-5) by an expert’s Delphi panel, generating the MEDUC-PG14 survey, which was answered by 123 residents from different programs of medical specialties. Construct validity was carried out. Factor analysis showed three domains: Teaching and evaluation, respectful behavior towards patients and health care team, and providing feedback. The global score was 4.46 ± 0.94 (89% of the maximum). One teachers’ strength, as evaluated by their residents was “respectful behavior” with 4.85 ± 0.42 (97% of the maximum). “Providing feedback” obtained 4.09 ± 1.0 points (81.8% of the maximum). MEDUC-PG14 survey had a Cronbach’s alpha coefficient of 0.947. MEDUC-PG14 survey is a useful and reliable guide for teacher evaluation in medical specialty programs. Also provides feedback to improve educational skills of postgraduate clinical teachers.

A study on reliability of power customer in distribution network

NASA Astrophysics Data System (ADS)

Liu, Liyuan; Ouyang, Sen; Chen, Danling; Ma, Shaohua; Wang, Xin

2017-05-01

The existing power supply reliability index system is oriented to power system without considering actual electricity availability in customer side. In addition, it is unable to reflect outage or customer’s equipment shutdown caused by instantaneous interruption and power quality problem. This paper thus makes a systematic study on reliability of power customer. By comparing with power supply reliability, reliability of power customer is defined and extracted its evaluation requirements. An indexes system, consisting of seven customer indexes and two contrast indexes, are designed to describe reliability of power customer from continuity and availability. In order to comprehensively and quantitatively evaluate reliability of power customer in distribution networks, reliability evaluation method is proposed based on improved entropy method and the punishment weighting principle. Practical application has proved that reliability index system and evaluation method for power customer is reasonable and effective.

Process evaluation of the Hunter Illawarra Kids Challenge Using Parent Support study: a multisite randomized controlled trial for the management of child obesity.

PubMed

Jones, Rachel A; Warren, Janet M; Okely, Anthony D; Collins, Clare E; Morgan, Philip J; Cliff, Dylan P; Burrows, Tracy; Cleary, Jane; Baur, Louise A

2010-11-01

The purposes of this article are to (a) outline findings from secondary or process outcome data of the Hunter Illawarra Kids Challenge Using Parent Support (HIKCUPS) study and (b) inform the design and development of future research interventions and practice in the management of child obesity. Data were collected by means of facilitator evaluations, independent session observation, attendance records, and parent questionnaires. Internal validity and reliability of the program delivery were high. All parents reported positive changes in their children as a result of the physical activity program, the dietary modification program, or both. Most participants completed the home activities, but more than half reported that finding time to do them was problematic. Facilitator review indicated that future programs should specifically cater to children of similar age or same sex, allow adequate time for explanation of complex nutritional concepts, and use intrinsic motivators for participants. Recommendations for future interventions, specifically the implementation of subsequent HIKCUPS or other multisite effectiveness studies, are detailed.

ScoreRel CI: An Excel Program for Computing Confidence Intervals for Commonly Used Score Reliability Coefficients

ERIC Educational Resources Information Center

Barnette, J. Jackson

2005-01-01

An Excel program developed to assist researchers in the determination and presentation of confidence intervals around commonly used score reliability coefficients is described. The software includes programs to determine confidence intervals for Cronbachs alpha, Pearson r-based coefficients such as those used in test-retest and alternate forms…

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions.

PubMed

Baumel, Amit; Faber, Keren; Mathur, Nandita; Kane, John M; Muench, Fred

2017-03-21

Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content-a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program's evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims. ©Amit Baumel, Keren Faber, Nandita Mathur, John M Kane, Fred Muench. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 21.03.2017.

Research program for experiment M133

NASA Technical Reports Server (NTRS)

Frost, J. D., Jr.

1972-01-01

The development of the automatic data-acquisition and sleep-analysis system is reported. The purpose was consultation and evaluation in the transition of the Skylab M133 Sleep-Monitoring Experiment equipment from prototype of flight status; review of problems associated with acquisition and on-line display of data in near-real time via spacecraft telemetry; and development of laboratory facilities and design of equipment to assure reliable playback and analysis of analog data. The existing prototype system modified, and the changes improve the performance of the analysis circuitry and increase its reliability. These modifications are useful for pre- and postflight analysis, but are not now proposed for the inflight system. There were improvements in the EEG recording cap, some of which will be incorporated into the flight hardware.

Examining the Quality of IEPs for Young Children with Autism

PubMed Central

McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2011-01-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool’s reliability; test the tool on a pilot sample of IEPs of young children; and examine associations between IEP quality and school, teacher, and child characteristics. IEPs for 35 students with autism (Mage = 6.1 years; SD = 1.6) from 35 different classrooms were examined. The IEP tool had adequate interrater reliability (ICC = .70). Results identified no statistically significant association between demographics and IEP quality, and IEPs contained relatively clear descriptions of present levels of performance. Weaknesses of IEPs were described and recommendations provided. PMID:20373007

Examining the quality of IEPs for young children with autism.

PubMed

Ruble, Lisa A; McGrew, John; Dalrymple, Nancy; Jung, Lee Ann

2010-12-01

The purpose of this study was to develop an Individual Education Program (IEP) evaluation tool based on Individuals with Disabilities Education Act (IDEA) requirements and National Research Council recommendations for children with autism; determine the tool's reliability; test the tool on a pilot sample of IEPs of young children; and examine associations between IEP quality and school, teacher, and child characteristics. IEPs for 35 students with autism (Mage = 6.1 years; SD = 1.6) from 35 different classrooms were examined. The IEP tool had adequate interrater reliability (ICC = .70). Results identified no statistically significant association between demographics and IEP quality, and IEPs contained relatively clear descriptions of present levels of performance. Weaknesses of IEPs were described and recommendations provided.

Study on evaluation of construction reliability for engineering project based on fuzzy language operator

NASA Astrophysics Data System (ADS)

Shi, Yu-Fang; Ma, Yi-Yi; Song, Ping-Ping

2018-03-01

System Reliability Theory is a research hotspot of management science and system engineering in recent years, and construction reliability is useful for quantitative evaluation of project management level. According to reliability theory and target system of engineering project management, the defination of construction reliability appears. Based on fuzzy mathematics theory and language operator, value space of construction reliability is divided into seven fuzzy subsets and correspondingly, seven membership function and fuzzy evaluation intervals are got with the operation of language operator, which provides the basis of corresponding method and parameter for the evaluation of construction reliability. This method is proved to be scientific and reasonable for construction condition and an useful attempt for theory and method research of engineering project system reliability.

Thin-film reliability and engineering overview

NASA Technical Reports Server (NTRS)

Ross, R. G., Jr.

1984-01-01

The reliability and engineering technology base required for thin film solar energy conversions modules is discussed. The emphasis is on the integration of amorphous silicon cells into power modules. The effort is being coordinated with SERI's thin film cell research activities as part of DOE's Amorphous Silicon Program. Program concentration is on temperature humidity reliability research, glass breaking strength research, point defect system analysis, hot spot heating assessment, and electrical measurements technology.