Valid and reliable authentic assessment of culminating student performance in the biomedical sciences.

PubMed

Oh, Deborah M; Kim, Joshua M; Garcia, Raymond E; Krilowicz, Beverly L

2005-06-01

There is increasing pressure, both from institutions central to the national scientific mission and from regional and national accrediting agencies, on natural sciences faculty to move beyond course examinations as measures of student performance and to instead develop and use reliable and valid authentic assessment measures for both individual courses and for degree-granting programs. We report here on a capstone course developed by two natural sciences departments, Biological Sciences and Chemistry/Biochemistry, which engages students in an important culminating experience, requiring synthesis of skills and knowledge developed throughout the program while providing the departments with important assessment information for use in program improvement. The student work products produced in the course, a written grant proposal, and an oral summary of the proposal, provide a rich source of data regarding student performance on an authentic assessment task. The validity and reliability of the instruments and the resulting student performance data were demonstrated by collaborative review by content experts and a variety of statistical measures of interrater reliability, including percentage agreement, intraclass correlations, and generalizability coefficients. The high interrater reliability reported when the assessment instruments were used for the first time by a group of external evaluators suggests that the assessment process and instruments reported here will be easily adopted by other natural science faculty.

Intraobserver reliability of contact pachymetry in children.

PubMed

Weise, Katherine K; Kaminski, Brett; Melia, Michele; Repka, Michael X; Bradfield, Yasmin S; Davitt, Bradley V; Johnson, David A; Kraker, Raymond T; Manny, Ruth E; Matta, Noelle S; Schloff, Susan

2013-04-01

Central corneal thickness (CCT) is an important measurement in the treatment and management of pediatric glaucoma and potentially of refractive error, but data regarding reliability of CCT measurement in children are limited. The purpose of this study was to evaluate the reliability of CCT measurement with the use of handheld contact pachymetry in children. We conducted a multicenter intraobserver test-retest reliability study of more than 3,400 healthy eyes in children aged from newborn to 17 years by using a handheld contact pachymeter (Pachmate DGH55; DGH Technology Inc, Exton, PA) in 2 clinical settings--with the use of topical anesthesia in the office and with the patient under general anesthesia in a surgical facility. The overall standard error of measurement, including only measurements with standard deviation ≤5 μm, was 8 μm; the corresponding coefficient of repeatability, or limits within which 95% of test-retest differences fell, was ±22.3 μm. However, standard error of measurement increased as CCT increased, from 6.8 μm for CCT less than 525 μm, to 12.9 μm for CCT 625 μm and greater. The standard error of measurement including measurements with standard deviation >5 μm was 10.5 μm. Age, sex, race/ethnicity group, and examination setting did not influence the magnitude of test-retest differences. CCT measurement reliability in children via the Pachmate DGH55 handheld contact pachymeter is similar to that reported for adults. Because thicker CCT measurements are less reliable than thinner measurements, a second measure may be helpful when the first exceeds 575 μm. Reliability is also improved by disregarding measurements with instrument-reported standard deviations >5 μm. Copyright © 2013 American Association for Pediatric Ophthalmology and Strabismus. Published by Mosby, Inc. All rights reserved.

Test-retest and between-site reliability in a multicenter fMRI study.

PubMed

Friedman, Lee; Stern, Hal; Brown, Gregory G; Mathalon, Daniel H; Turner, Jessica; Glover, Gary H; Gollub, Randy L; Lauriello, John; Lim, Kelvin O; Cannon, Tyrone; Greve, Douglas N; Bockholt, Henry Jeremy; Belger, Aysenil; Mueller, Bryon; Doty, Michael J; He, Jianchun; Wells, William; Smyth, Padhraic; Pieper, Steve; Kim, Seyoung; Kubicki, Marek; Vangel, Mark; Potkin, Steven G

2008-08-01

In the present report, estimates of test-retest and between-site reliability of fMRI assessments were produced in the context of a multicenter fMRI reliability study (FBIRN Phase 1, www.nbirn.net). Five subjects were scanned on 10 MRI scanners on two occasions. The fMRI task was a simple block design sensorimotor task. The impulse response functions to the stimulation block were derived using an FIR-deconvolution analysis with FMRISTAT. Six functionally-derived ROIs covering the visual, auditory and motor cortices, created from a prior analysis, were used. Two dependent variables were compared: percent signal change and contrast-to-noise-ratio. Reliability was assessed with intraclass correlation coefficients derived from a variance components analysis. Test-retest reliability was high, but initially, between-site reliability was low, indicating a strong contribution from site and site-by-subject variance. However, a number of factors that can markedly improve between-site reliability were uncovered, including increasing the size of the ROIs, adjusting for smoothness differences, and inclusion of additional runs. By employing multiple steps, between-site reliability for 3T scanners was increased by 123%. Dropping one site at a time and assessing reliability can be a useful method of assessing the sensitivity of the results to particular sites. These findings should provide guidance toothers on the best practices for future multicenter studies.

How to assess and compare inter-rater reliability, agreement and correlation of ratings: an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs

PubMed Central

Stolarova, Margarita; Wolf, Corinna; Rinker, Tanja; Brielmann, Aenne

2014-01-01

This report has two main purposes. First, we combine well-known analytical approaches to conduct a comprehensive assessment of agreement and correlation of rating-pairs and to dis-entangle these often confused concepts, providing a best-practice example on concrete data and a tutorial for future reference. Second, we explore whether a screening questionnaire developed for use with parents can be reliably employed with daycare teachers when assessing early expressive vocabulary. A total of 53 vocabulary rating pairs (34 parent–teacher and 19 mother–father pairs) collected for two-year-old children (12 bilingual) are evaluated. First, inter-rater reliability both within and across subgroups is assessed using the intra-class correlation coefficient (ICC). Next, based on this analysis of reliability and on the test-retest reliability of the employed tool, inter-rater agreement is analyzed, magnitude and direction of rating differences are considered. Finally, Pearson correlation coefficients of standardized vocabulary scores are calculated and compared across subgroups. The results underline the necessity to distinguish between reliability measures, agreement and correlation. They also demonstrate the impact of the employed reliability on agreement evaluations. This study provides evidence that parent–teacher ratings of children's early vocabulary can achieve agreement and correlation comparable to those of mother–father ratings on the assessed vocabulary scale. Bilingualism of the evaluated child decreased the likelihood of raters' agreement. We conclude that future reports of agreement, correlation and reliability of ratings will benefit from better definition of terms and stricter methodological approaches. The methodological tutorial provided here holds the potential to increase comparability across empirical reports and can help improve research practices and knowledge transfer to educational and therapeutic settings. PMID:24994985

Ceramic Technology for Advanced Heat Engines Project. Semiannual progress report, October 1984-March 1985

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1985-09-01

A five-year project plan was developed with extensive input from private industry. The objective of the project is to develop the industrial technology base required for reliable ceramics for application in advanced automotive heat engines. The project approach includes determining the mechanisms controlling reliability, improving processes for fabricating existing ceramics, developing new materials with increased reliability, and testing these materials in simulated engine environments to confirm reliability. Although this is a generic materials project, the focus is on structural ceramics for advanced gas turbine and diesel engines, ceramic bearings and attachments, and ceramic coatings for thermal barrier and wear applicationsmore » in these engines.« less

Ceramic technology for advanced heat engines project: Semiannual progress report for April through September 1986

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1987-03-01

An assessment of needs was completed, and a five-year project plan was developed with extensive input from private industry. Objective is to develop the industrial technology base required for reliable ceramics for application in advanced automotive heat engines. The project approach includes determining the mechanisms controlling reliability, improving processes for fabricating existing ceramics, developing new materials with increased reliability, and testing these materials in simulated engine environments to confirm reliability. Although this is a generic materials project, the focus is on structural ceramics for advanced gas turbine and diesel engines, ceramic bearings and attachments, and ceramic coatings for thermal barriermore » and wear applications in these engines.« less

Reliability, validity and responsiveness of the German self-reported foot and ankle score (SEFAS) in patients with foot or ankle surgery.

PubMed

Arbab, Dariusch; Kuhlmann, Katharina; Schnurr, Christoph; Bouillon, Bertil; Lüring, Christian; König, Dietmar

2017-10-10

Patient-reported outcome measures are a critical tool in evaluating the efficacy of orthopedic procedures and are increasingly used in clinical trials to assess outcomes of health care. The intention of this study was to develop and culturally adapt a German version of the Self-reported Foot and Ankle Score (SEFAS) and to evaluate reliability, validity and responsiveness. According to Cross Cultural Adaptation of Self-Reported Measure guidelines forward and backward translation has been performed. The German SEFAS was investigated in 177 consecutive patients. 177 Patients completed the German SEFAS, Foot and Ankle Outcome Score (FAOS), Short-Form 36 and numeric scales for pain and disability (NRS) before and 118 patients 6 months after foot or ankle surgery. Test-Retest reliability, internal consistency, floor and ceiling effects, construct validity and minimal important change were analyzed. The German SEFAS demonstrated excellent test-retest reliability with ICC values of 0.97. Cronbach's alpha (α) value of 0.89 demonstrated strong internal consistency. No floor or ceiling effects were observed for the German version of the SEFAS. As hypothesized SEFAS correlated strongly with FAOS and SF-36 domains. It showed moderate (ES/SRM > 0.5) responsiveness between preoperative assessment and postoperative follow-up. The German version of the SEFAS demonstrated good psychometric properties. It proofed to be a valid and reliable instrument for use in foot and ankle patients. DRKS00007585.

Software service history report

DOT National Transportation Integrated Search

2002-01-01

The safe and reliable operation of software within civil aviation systems and equipment has historically been assured through the application of rigorous design assurance applied during the software development process. Increasingly, manufacturers ar...

Enhanced Component Performance Study: Motor-Driven Pumps 1998–2014

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schroeder, John Alton

2016-02-01

This report presents an enhanced performance evaluation of motor-driven pumps at U.S. commercial nuclear power plants. The data used in this study are based on the operating experience failure reports from fiscal year 1998 through 2014 for the component reliability as reported in the Institute of Nuclear Power Operations (INPO) Consolidated Events Database (ICES). The motor-driven pump failure modes considered for standby systems are failure to start, failure to run less than or equal to one hour, and failure to run more than one hour; for normally running systems, the failure modes considered are failure to start and failure tomore » run. An eight hour unreliability estimate is also calculated and trended. The component reliability estimates and the reliability data are trended for the most recent 10-year period while yearly estimates for reliability are provided for the entire active period. Statistically significant increasing trends were identified in pump run hours per reactor year. Statistically significant decreasing trends were identified for standby systems industry-wide frequency of start demands, and run hours per reactor year for runs of less than or equal to one hour.« less

Mother-reported sleep, accelerometer-estimated sleep and weight status in Mexican American children: sleep duration is associated with increased adiposity and risk for overweight/obese status

USDA-ARS?s Scientific Manuscript database

We know of no studies comparing parent-reported sleep with accelerometer-estimated sleep in their relation to paediatric adiposity. We examined: (i) the reliability of mother-reported sleep compared with accelerometer-estimated sleep; and (ii) the relationship between both sleep measures and child a...

Interrater reliability of a Pilates movement-based classification system.

PubMed

Yu, Kwan Kenny; Tulloch, Evelyn; Hendrick, Paul

2015-01-01

To determine the interrater reliability for identification of a specific movement pattern using a Pilates Classification system. Videos of 5 subjects performing specific movement tasks were sent to raters trained in the DMA-CP classification system. Ninety-six raters completed the survey. Interrater reliability for the detection of a directional bias was excellent (Pi = 0.92, and K(free) = 0.89). Interrater reliability for classifying an individual into a specific subgroup was moderate (Pi = 0.64, K(free) = 0.55) however raters who had completed levels 1-4 of the DMA-CP training and reported using the assessment daily demonstrated excellent reliability (Pi = 0.89 and K(free) = 0.87). The reliability of the classification system demonstrated almost perfect agreement in determining the existence of a specific movement pattern and classifying into a subgroup for experienced raters. There was a trend for greater reliability associated with increased levels of training and experience of the raters. Copyright © 2014 Elsevier Ltd. All rights reserved.

Towards real-time verification of CO2 emissions

NASA Astrophysics Data System (ADS)

Peters, Glen P.; Le Quéré, Corinne; Andrew, Robbie M.; Canadell, Josep G.; Friedlingstein, Pierre; Ilyina, Tatiana; Jackson, Robert B.; Joos, Fortunat; Korsbakken, Jan Ivar; McKinley, Galen A.; Sitch, Stephen; Tans, Pieter

2017-12-01

The Paris Agreement has increased the incentive to verify reported anthropogenic carbon dioxide emissions with independent Earth system observations. Reliable verification requires a step change in our understanding of carbon cycle variability.

Educational Testing and Validity of Conclusions in the Scholarship of Teaching and Learning

PubMed Central

Beltyukova, Svetlana A.; Martin, Beth A.

2013-01-01

Validity and its integral evidence of reliability are fundamentals for educational and psychological measurement, and standards of educational testing. Herein, we describe these standards of educational testing, along with their subtypes including internal consistency, inter-rater reliability, and inter-rater agreement. Next, related issues of measurement error and effect size are discussed. This article concludes with a call for future authors to improve reporting of psychometrics and practical significance with educational testing in the pharmacy education literature. By increasing the scientific rigor of educational research and reporting, the overall quality and meaningfulness of SoTL will be improved. PMID:24249848

Impact of Distributed Energy Resources on the Reliability of a Critical Telecommunications Facility

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robinson, D.; Atcitty, C.; Zuffranieri, J.

2006-03-01

Telecommunications has been identified by the Department of Homeland Security as a critical infrastructure to the United States. Failures in the power systems supporting major telecommunications service nodes are a main contributor to major telecommunications outages, as documented by analyses of Federal Communications Commission (FCC) outage reports by the National Reliability Steering Committee (under auspices of the Alliance for Telecommunications Industry Solutions). There are two major issues that are having increasing impact on the sensitivity of the power distribution to telecommunication facilities: deregulation of the power industry, and changing weather patterns. A logical approach to improve the robustness of telecommunicationmore » facilities would be to increase the depth and breadth of technologies available to restore power in the face of power outages. Distributed energy resources such as fuel cells and gas turbines could provide one more onsite electric power source to provide backup power, if batteries and diesel generators fail. But does the diversity in power sources actually increase the reliability of offered power to the office equipment, or does the complexity of installing and managing the extended power system induce more potential faults and higher failure rates? This report analyzes a system involving a telecommunications facility consisting of two switch-bays and a satellite reception system.« less

LacI(Ts)-Regulated Expression as an In Situ Intracellular Biomolecular Thermometer▿

PubMed Central

McCabe, K. M.; Lacherndo, E. J.; Albino-Flores, I.; Sheehan, E.; Hernandez, M.

2011-01-01

In response to needs for in situ thermometry, a temperature-sensitive vector was adapted to report changes in the intracellular heat content of Escherichia coli in near-real time. This model system utilized vectors expressing increasing quantities of β-galactosidase in response to stepwise temperature increases through a biologically relevant range (22 to 45°C). As judged by calibrated fluorometric and colorimetric reporters, both whole E. coli cells and lysates expressed significant repeatable changes in β-galactosidase activity that were sensitive to temperature changes of less than 1°C (35 to 45°C). This model system suggests that changes in cellular heat content can be detected independently of the medium in which cells are maintained, a feature of particular importance where the medium is heterogeneous or nonaqueous, or otherwise has a low heat transfer capacity. We report here that the intracellular temperature can be reliably obtained in near-real time using reliable fluorescent reporting systems from cellular scales, with a 20°C range of detection and at least 0.7°C sensitivity between 35 and 45°C. PMID:21378059

Are Parents Getting it Right? A Survey of Parents' Internet Use for Children's Health Care Information.

PubMed

Pehora, Carolyne; Gajaria, Nisha; Stoute, Melyssa; Fracassa, Sonia; Serebale-O'Sullivan, Refilwe; Matava, Clyde T

2015-06-22

The use of the Internet to search for medical and health-related information is increasing and associated with concerns around quality and safety. We investigated the current use and perceptions on reliable websites for children's health information by parents. Following institutional ethics approval, we conducted a survey of parents/guardians of children presenting for day surgery. A 20-item survey instrument developed and tested by the investigators was administered. Ninety-eight percent of respondents reported that they used the Internet to search for information about their child's health. Many respondents reported beginning their search at public search engines (80%); less than 20% reported starting their search at university/hospital-based websites. Common conditions such as colds/flu, skin conditions and fever were the most frequently searched, and unique conditions directly affecting the child were second. Despite low usage levels of university/hospital-based websites for health information, the majority of respondents (74%) regarded these as providing safe, accurate, and reliable information. In contrast, only 24% of respondents regarded public search engines as providing safe and reliable information. Fifty percent of respondents reported that they cross-checked information found on the internet with a family physician. An unprecedented majority of parents and guardians are using the Internet for their child's health information. Of concern is that parents and guardians are currently not using reliable and safe sources of information. Health care providers should begin to focus on improving access to safe, accurate, and reliable information through various modalities including education, designing for multiplatform, and better search engine optimization.

A measure of state persecutory ideation for experimental studies.

PubMed

Freeman, Daniel; Pugh, Katherine; Green, Catherine; Valmaggia, Lucia; Dunn, Graham; Garety, Philippa

2007-09-01

Experimental research is increasingly important in developing the understanding of paranoid thinking. An assessment measure of persecutory ideation is necessary for such work. We report the reliability and validity of the first state measure of paranoia: The State Social Paranoia Scale. The items in the measure conform to a recent definition in which persecutory thinking has the 2 elements of feared harm and perpetrator intent. The measure was tested with 164 nonclinical participants and 21 individuals at high risk of psychosis with attenuated positive symptoms. The participants experienced a social situation presented in virtual reality and completed the new measure. The State Social Paranoia Scale was found to have excellent internal reliability, adequate test-retest reliability, clear convergent validity as assessed by both independent interviewer ratings and self-report measures, and showed divergent validity with measures of positive and neutral thinking. The measure of paranoia in a recent social situation has good psychometric properties.

Interrater reliability of the Volume-Viscosity Swallow Test; screening for dysphagia among hospitalized elderly medical patients.

PubMed

Jørgensen, Lise Walther; Søndergaard, Kasper; Melgaard, Dorte; Warming, Susan

2017-12-01

Oropharyngeal dysphagia (OD) is prevalent among medical and geriatric patients admitted due to acute illness and it is associated with malnutrition, increased length of stay and increased mortality. A valid and reliable bedside screening test for patients at risk of OD is essential in order to detect patients in need of further assessment. The Volume-Viscosity Swallow Test (V-VST) has been shown to be a valid screening test for OD in mixed outpatient populations. However, as reliability of the test has yet to be investigated in a population of medical and geriatric patients admitted due to acute illness, we aimed to determine the interrater reliability of the V-VST in this clinical setting. Reporting in this study is in accordance with proposed guidelines for the reporting of reliability and agreement studies (GRRAS). In three Danish hospitals (CRD-BFH, CRD-GH, NDR-H) 11 skilled occupational therapists examined an unselected group of 110 patients admitted to geriatric or medical wards. In an overall agreement phase raters reached ≥80% agreement before data collection phase was commenced. The V-VST was applied to patients twice within maximum one hour by raters who administrated the test in an order based on randomization, blinded to each other's results. Agreement, Kappa values, weighed Kappa values and Kappa adjusted for bias and prevalence are reported. The interrater reliability of V-VST as screening test for OD in patients admitted to geriatric or medical wards was substantial with an overall Kappa value of 0.77 (95% CI 0.65-0.89) however interrater reliability varied among hospitals ranging from 0.37 (95% CI -0.01 to 0.41) to 0.85 (95% CI 0.75-1.00). Interrater reliability of the accompanying recommendations of volume and viscosity was moderate with a weighted kappa value of 0.55 (95% CI 0.37-0.73) for viscosity and 0.53 (95% CI 0.36-0.7) for volume. The overall prevalence of OD was 34.5%, ranging from 8% to 53.6% across hospitals. The prevalence and bias adjusted Kappa value (PABAK) was 0.76 (range 0.6-0.85). Mean time to perform the test was 13.1 min (SD 6.924). The V-VST seems to be a moderately reliable screening tool for detecting OD among medical and geriatric patients. However, the recommendations of volume and viscosity add limited clinical value to the test. Copyright © 2017 European Society for Clinical Nutrition and Metabolism. Published by Elsevier Ltd. All rights reserved.

Evidence that transcranial direct current stimulation (tDCS) generates little-to-no reliable neurophysiologic effect beyond MEP amplitude modulation in healthy human subjects: A systematic review.

PubMed

Horvath, Jared Cooney; Forte, Jason D; Carter, Olivia

2015-01-01

Transcranial direct current stimulation (tDCS) is a form of neuromodulation that is increasingly being utilized to examine and modify a number of cognitive and behavioral measures. The theoretical mechanisms by which tDCS generates these changes are predicated upon a rather large neurophysiological literature. However, a robust systematic review of this neurophysiological data has not yet been undertaken. tDCS data in healthy adults (18-50) from every neurophysiological outcome measure reported by at least two different research groups in the literature was collected. When possible, data was pooled and quantitatively analyzed to assess significance. When pooling was not possible, data was qualitatively compared to assess reliability. Of the 30 neurophysiological outcome measures reported by at least two different research groups, tDCS was found to have a reliable effect on only one: MEP amplitude. Interestingly, the magnitude of this effect has been significantly decreasing over the last 14 years. Our systematic review does not support the idea that tDCS has a reliable neurophysiological effect beyond MEP amplitude modulation - though important limitations of this review (and conclusion) are discussed. This work raises questions concerning the mechanistic foundations and general efficacy of this device - the implications of which extend to the steadily increasing tDCS psychological literature. Copyright © 2014 Elsevier Ltd. All rights reserved.

Establishing Inter- and Intrarater Reliability for High-Stakes Testing Using Simulation.

PubMed

Kardong-Edgren, Suzan; Oermann, Marilyn H; Rizzolo, Mary Anne; Odom-Maryon, Tamara

This article reports one method to develop a standardized training method to establish the inter- and intrarater reliability of a group of raters for high-stakes testing. Simulation is used increasingly for high-stakes testing, but without research into the development of inter- and intrarater reliability for raters. Eleven raters were trained using a standardized methodology. Raters scored 28 student videos over a six-week period. Raters then rescored all videos over a two-day period to establish both intra- and interrater reliability. One rater demonstrated poor intrarater reliability; a second rater failed all students. Kappa statistics improved from the moderate to substantial agreement range with the exclusion of the two outlier raters' scores. There may be faculty who, for different reasons, should not be included in high-stakes testing evaluations. All faculty are content experts, but not all are expert evaluators.

Spanish version of Pregnancy Symptoms Inventory: transcultural adaptation and reliability.

PubMed

Oviedo-Caro, Miguel A; Bueno-Antequera, Javier; Munguía-Izquierdo, Diego

2017-09-01

To transcultural adapt and analyze the reliability of Spanish version of Pregnancy Symptoms Inventory (PSI) and assess the prevalence of pregnancy symptoms in Spanish pregnant women. A subsample of 120 healthy pregnant women answered the PSI twice and a sample of 280 report the prevalence and limitation of pregnancy symptoms. The reliability was examined by means of percent agreement and weighted Kappa coefficients. The prevalence of pregnancy symptoms was evaluated by the frequency of answers. Perfect and perfect-acceptable agreement was observed in 82% and 96% of the pregnant women, respectively. Weighted Kappa coefficients ranged from 0.589 to 0.889, indicating a good reliability. The most frequent symptoms perceived by Spanish pregnant women were urinary frequency, poor sleep, increased vaginal discharge and tiredness. Spanish Pregnancy Symptoms Inventory is a brief, conceptually equivalent and satisfactory reliable tool that allows an early assessment of the wide range of pregnancy symptoms in the health care practices.

Modification site localization scoring integrated into a search engine.

PubMed

Baker, Peter R; Trinidad, Jonathan C; Chalkley, Robert J

2011-07-01

Large proteomic data sets identifying hundreds or thousands of modified peptides are becoming increasingly common in the literature. Several methods for assessing the reliability of peptide identifications both at the individual peptide or data set level have become established. However, tools for measuring the confidence of modification site assignments are sparse and are not often employed. A few tools for estimating phosphorylation site assignment reliabilities have been developed, but these are not integral to a search engine, so require a particular search engine output for a second step of processing. They may also require use of a particular fragmentation method and are mostly only applicable for phosphorylation analysis, rather than post-translational modifications analysis in general. In this study, we present the performance of site assignment scoring that is directly integrated into the search engine Protein Prospector, which allows site assignment reliability to be automatically reported for all modifications present in an identified peptide. It clearly indicates when a site assignment is ambiguous (and if so, between which residues), and reports an assignment score that can be translated into a reliability measure for individual site assignments.

A Quantitative Assessment of Utility Reporting Practices for Reporting Electric Power Distribution Events

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hamachi La Commare, Kristina

Metrics for reliability, such as the frequency and duration of power interruptions, have been reported by electric utilities for many years. This study examines current utility practices for collecting and reporting electricity reliability information and discusses challenges that arise in assessing reliability because of differences among these practices. The study is based on reliability information for year 2006 reported by 123 utilities in 37 states representing over 60percent of total U.S. electricity sales. We quantify the effects that inconsistencies among current utility reporting practices have on comparisons of System Average Interruption Duration Index (SAIDI) and System Average Interruption Frequency Indexmore » (SAIFI) reported by utilities. We recommend immediate adoption of IEEE Std. 1366-2003 as a consistent method for measuring and reporting reliability statistics.« less

Approaches to virtual screening and screening library selection.

PubMed

Wildman, Scott A

2013-01-01

The ease of access to virtual screening (VS) software in recent years has resulted in a large increase in literature reports. Over 300 publications in the last year report the use of virtual screening techniques to identify new chemical matter or present the development of new virtual screening techniques. The increased use is accompanied by a corresponding increase in misuse and misinterpretation of virtual screening results. This review aims to identify many of the common difficulties associated with virtual screening and allow researchers to better assess the reliability of their virtual screening effort.

Reliability of Self-Reported Mobile Phone Ownership in Rural North-Central Nigeria: Cross-Sectional Study.

PubMed

Menson, William Nii Ayitey; Olawepo, John Olajide; Bruno, Tamara; Gbadamosi, Semiu Olatunde; Nalda, Nannim Fazing; Anyebe, Victor; Ogidi, Amaka; Onoka, Chima; Oko, John Okpanachi; Ezeanolue, Echezona Edozie

2018-03-01

mHealth practitioners seek to leverage the ubiquity of the mobile phone to increase the impact and robustness of their interventions, particularly in resource-limited settings. However, data on the reliability of self-reported mobile phone access is minimal. We sought to ascertain the reliability of self-reported ownership of and access to mobile phones among a population of rural dwellers in north-central Nigeria. We contacted participants in a community-based HIV testing program by phone to determine actual as opposed to self-reported mobile phone access. A phone script was designed to conduct these calls and descriptive analyses conducted on the findings. We dialed 349 numbers: 110 (31.5%) were answered by participants who self-reported ownership of the mobile phone; 123 (35.2%) of the phone numbers did not ring at all; 28 (8.0%) rang but were not answered; and 88 (25.2%) were answered by someone other than the participant. We reached a higher proportion of male participants (68/133, 51.1%) than female participants (42/216, 19.4%; P<.001). Self-reported access to mobile phones in rural and low-income areas in north-central Nigeria is higher than actual access. This has implications for mHealth programming, particularly for women's health. mHealth program implementers and researchers need to be cognizant of the low reliability of self-reported mobile phone access. These observations should therefore affect sample-size calculations and, where possible, alternative means of reaching research participants and program beneficiaries should be established. ©William Nii Ayitey Menson, John Olajide Olawepo, Tamara Bruno, Semiu Olatunde Gbadamosi, Nannim Fazing Nalda, Victor Anyebe, Amaka Ogidi, Chima Onoka, John Okpanachi Oko, Echezona Edozie Ezeanolue. Originally published in JMIR Mhealth and Uhealth (http://mhealth.jmir.org), 01.03.2018.

Software Reliability Issues Concerning Large and Safety Critical Software Systems

NASA Technical Reports Server (NTRS)

Kamel, Khaled; Brown, Barbara

1996-01-01

This research was undertaken to provide NASA with a survey of state-of-the-art techniques using in industrial and academia to provide safe, reliable, and maintainable software to drive large systems. Such systems must match the complexity and strict safety requirements of NASA's shuttle system. In particular, the Launch Processing System (LPS) is being considered for replacement. The LPS is responsible for monitoring and commanding the shuttle during test, repair, and launch phases. NASA built this system in the 1970's using mostly hardware techniques to provide for increased reliability, but it did so often using custom-built equipment, which has not been able to keep up with current technologies. This report surveys the major techniques used in industry and academia to ensure reliability in large and critical computer systems.

Modeling, simulation, and high-autonomy control of a Martian oxygen production plant

NASA Technical Reports Server (NTRS)

Schooley, L. C.; Cellier, F. E.; Wang, F.-Y.; Zeigler, B. P.

1992-01-01

Progress on a project for the development of a high-autonomy intelligent command and control architecture for process plants used to produce oxygen from local planetary resources is reported. A distributed command and control architecture is being developed and implemented so that an oxygen production plant, or other equipment, can be reliably commanded and controlled over an extended time period in a high-autonomy mode with high-level task-oriented teleoperation from one or several remote locations. During the reporting period, progress was made at all levels of the architecture. At the remote site, several remote observers can now participate in monitoring the plant. At the local site, a command and control center was introduced for increased flexibility, reliability, and robustness. The local control architecture was enhanced to control multiple tubes in parallel, and was refined for increased robustness. The simulation model was enhanced to full dynamics descriptions.

A Comparison of Reliability and Precision of Subscore Reporting Methods for a State English Language Proficiency Assessment

ERIC Educational Resources Information Center

Longabach, Tanya; Peyton, Vicki

2018-01-01

K-12 English language proficiency tests that assess multiple content domains (e.g., listening, speaking, reading, writing) often have subsections based on these content domains; scores assigned to these subsections are commonly known as subscores. Testing programs face increasing customer demands for the reporting of subscores in addition to the…

Marijuana abstinence effects in marijuana smokers maintained in their home environment.

PubMed

Budney, A J; Hughes, J R; Moore, B A; Novy, P L

2001-10-01

Although withdrawal symptoms are commonly reported by persons seeking treatment for marijuana dependence, the validity and clinical significance of a marijuana withdrawal syndrome has not been established. This controlled outpatient study examined the reliability and specificity of the abstinence effects that occur when daily marijuana users abruptly stop smoking marijuana. Twelve daily marijuana smokers were assessed on 16 consecutive days during which they smoked marijuana as usual (days 1-5), abstained from smoking marijuana (days 6-8), returned to smoking marijuana (days 9-13), and again abstained from smoking marijuana (days 14-16). An overall measure of withdrawal discomfort increased significantly during the abstinence phases and returned to baseline when marijuana smoking resumed. Craving for marijuana, decreased appetite, sleep difficulty, and weight loss reliably changed across the smoking and abstinence phases. Aggression, anger, irritability, restlessness, and strange dreams increased significantly during one abstinence phase, but not the other. Collateral observers confirmed participant reports of these symptoms. This study validated several specific effects of marijuana abstinence in heavy marijuana users, and showed they were reliable and clinically significant. These withdrawal effects appear similar in type and magnitude to those observed in studies of nicotine withdrawal.

Test-retest of self-reported exposure to artificial tanning devices, self-tanning creams, and sun sensitivity showed consistency.

PubMed

Beane Freeman, Laura E; Dennis, Leslie K; Lynch, Charles F; Lowe, John B; Clarke, William R

2005-04-01

Exposure to ultraviolet radiation has consistently been linked to an increased risk of melanoma. Epidemiologic studies are susceptible to measurement error, which can distort the magnitude of observed effects. Although the reliability of self-report of many sun exposure factors has been previously described in several studies, self-report of use of artificial tanning devices and self-tanning creams has been less well characterized. A mailed survey was re-administered 2-4 weeks after completion of the initial survey to 76 randomly selected participants in a case-control study of melanoma. Cases and controls were individuals diagnosed in 1999 and 2000 who were ascertained from the Iowa Cancer Registry in 2002. We assessed the consistency of self-reported use of sunlamps and self-tanning creams, sun sensitivity, and history of sunburns. There was substantial reliability in reporting the use of sunlamps or self-tanning creams (cases: Kappa (kappa)=1.0 for both exposures; controls: kappa=0.71 and 0.87, respectively). kappa estimates of 0.62-0.78 were found for overall reliability of several sun sensitivity factors. Overall, the survey instrument demonstrated substantial reproducibility for factors related to the use of sunlamps or tanning beds, self-tanning creams, and sun sensitivity factors.

Measuring deception: test-retest reliability of physicians' self-reported manipulation of reimbursement rules for patients.

PubMed

VanGeest, Jonathan B; Wynia, Matthew K; Cummins, Deborah S; Wilson, Ira B

2002-06-01

This study examined the test-retest reliability of physicians' self-reported manipulation of reimbursement rules for patients. The test-retest reliability of self-report of three specific tactics were examined: (1) exaggerating the severity of patients' conditions, (2) changing a patient's official (billing) diagnosis, and (3) reporting signs or symptoms that patients did not have. The reliability of a scaled summary measure of physicians' manipulation of reimbursement rules was also assessed. Overall, the authors found high levels of test-retest agreement across all three items and the summary measure. These findings suggest that self-report can be used to produce reliable data on this controversial issue. Specifically, the three items reported here can be used to produce a reliable summary measure of physicians' manipulation of reimbursement rules to help patients obtain care that physicians perceive as necessary.

Comparison of reliability and responsiveness of patient-reported clinical outcome measures in knee osteoarthritis rehabilitation.

PubMed

Williams, Valerie J; Piva, Sara R; Irrgang, James J; Crossley, Chad; Fitzgerald, G Kelley

2012-08-01

Secondary analysis, pretreatment-posttreatment observational study. To compare the reliability and responsiveness of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), the Knee Outcome Survey activities of daily living subscale (KOS-ADL), and the Lower Extremity Functional Scale (LEFS) in individuals with knee osteoarthritis (OA). The WOMAC is the current standard in patient-reported measures of function in patients with knee OA. The KOS-ADL and LEFS were designed for potential use in patients with knee OA. If the KOS-ADL and LEFS are to be considered viable alternatives to the WOMAC for measuring patient-reported function in individuals with knee OA, they should have measurement properties comparable to the WOMAC. It would also be important to determine whether either of these instruments may be superior to the WOMAC in terms of reliability or responsiveness in this population. Data from 168 subjects with knee OA, who participated in a rehabilitation program, were used in the analyses. Reliability and responsiveness of each outcome measure were estimated at follow-ups of 2, 6, and 12 months. Reliability was estimated by calculating the intraclass correlation coefficient (ICC2,1) for subjects who were unchanged in status from baseline at each follow-up time, based on a global rating of change score. To examine responsiveness, the standard error of the measurement, minimal detectable change, minimal clinically important difference, and the Guyatt responsiveness index were calculated for each outcome measure at each follow-up time. All 3 outcome measures demonstrated reasonable reliability and responsiveness to change. Reliability and responsiveness tended to decrease somewhat with increasing follow-up time. There were no substantial differences between outcome measures for reliability or any of the 3 measures of responsiveness at any follow-up time. The results do not indicate that one outcome measure is more reliable or responsive than another when applied to subjects with knee OA. We believe that all 3 instruments are appropriate outcome measures to examine change in functional status of patients with knee OA.

International classification of reliability for implanted cochlear implant receiver stimulators.

PubMed

Battmer, Rolf-Dieter; Backous, Douglas D; Balkany, Thomas J; Briggs, Robert J S; Gantz, Bruce J; van Hasselt, Andrew; Kim, Chong Sun; Kubo, Takeshi; Lenarz, Thomas; Pillsbury, Harold C; O'Donoghue, Gerard M

2010-10-01

To design an international standard to be used when reporting reliability of the implanted components of cochlear implant systems to appropriate governmental authorities, cochlear implant (CI) centers, and for journal editors in evaluating manuscripts involving cochlear implant reliability. The International Consensus Group for Cochlear Implant Reliability Reporting was assembled to unify ongoing efforts in the United States, Europe, Asia, and Australia to create a consistent and comprehensive classification system for the implanted components of CI systems across manufacturers. All members of the consensus group are from tertiary referral cochlear implant centers. None. A clinically relevant classification scheme adapted from principles of ISO standard 5841-2:2000 originally designed for reporting reliability of cardiac pacemakers, pulse generators, or leads. Standard definitions for device failure, survival time, clinical benefit, reduced clinical benefit, and specification were generated. Time intervals for reporting back to implant centers for devices tested to be "out of specification," categorization of explanted devices, the method of cumulative survival reporting, and content of reliability reports to be issued by manufacturers was agreed upon by all members. The methodology for calculating Cumulative survival was adapted from ISO standard 5841-2:2000. The International Consensus Group on Cochlear Implant Device Reliability Reporting recommends compliance to this new standard in reporting reliability of implanted CI components by all manufacturers of CIs and the adoption of this standard as a minimal reporting guideline for editors of journals publishing cochlear implant research results.

Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 5. Technical Report #1204

ERIC Educational Resources Information Center

Park, Bitnara Jasmine; Irvin, P. Shawn; Lai, Cheng-Fei; Alonzo, Julie; Tindal, Gerald

2012-01-01

In this technical report, we present the results of a reliability study of the fifth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 2. Technical Report #1201

ERIC Educational Resources Information Center

Lai, Cheng-Fei; Irvin, P. Shawn; Alonzo, Julie; Park, Bitnara Jasmine; Tindal, Gerald

2012-01-01

In this technical report, we present the results of a reliability study of the second-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 4. Technical Report #1203

ERIC Educational Resources Information Center

Park, Bitnara Jasmine; Irvin, P. Shawn; Alonzo, Julie; Lai, Cheng-Fei; Tindal, Gerald

2012-01-01

In this technical report, we present the results of a reliability study of the fourth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 6. Technical Report #1205

ERIC Educational Resources Information Center

Irvin, P. Shawn; Alonzo, Julie; Park, Bitnara Jasmine; Lai, Cheng-Fei; Tindal, Gerald

2012-01-01

In this technical report, we present the results of a reliability study of the sixth-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 7. Technical Report #1206

ERIC Educational Resources Information Center

Irvin, P. Shawn; Alonzo, Julie; Lai, Cheng-Fei; Park, Bitnara Jasmine; Tindal, Gerald

2012-01-01

In this technical report, we present the results of a reliability study of the seventh-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

Analyzing the Reliability of the easyCBM Reading Comprehension Measures: Grade 3. Technical Report #1202

ERIC Educational Resources Information Center

Lai, Cheng-Fei; Irvin, P. Shawn; Park, Bitnara Jasmine; Alonzo, Julie; Tindal, Gerald

2012-01-01

In this technical report, we present the results of a reliability study of the third-grade multiple choice reading comprehension measures available on the easyCBM learning system conducted in the spring of 2011. Analyses include split-half reliability, alternate form reliability, person and item reliability as derived from Rasch analysis,…

Does condom social marketing improve health outcomes and increase usage and equitable access?

PubMed

Knerr, Wendy

2011-05-01

Condom social marketing (CSM) has increased condom supplies, broadened commercial markets for condoms and introduced marketing innovations in developing countries. Yet rigorous and reliable evidence of the impact on condom usage and disease prevention is limited, as is evidence of the impact on equity of access to condoms for poor populations, women and people living with HIV. One strand of research on CSM reports mostly on output (e.g. sales and processes) and market growth; but these have been found to be highly unreliable measures of condom usage. Another strand of research reports primarily on changes in sexual behaviour, attitude or condom usage, using survey data. While random sampling is rare, these studies often use representative samples, which provide some measure of validity. There have been attempts to improve the reliability or results to good effect, but challenges remain for researchers, scholars and donors, including the need to supplement output data with measures of behaviour change, use rigorous designs which are built into programmes a priori, report on equity measures, report on potential harms of CSM programmes, and encourage external and systematic reviews. Copyright © 2011 Reproductive Health Matters. Published by Elsevier Ltd. All rights reserved.

Reliability of risk assessment measures used in sexually violent predator proceedings.

PubMed

Miller, Cailey S; Kimonis, Eva R; Otto, Randy K; Kline, Suzonne M; Wasserman, Adam L

2012-12-01

The field interrater reliability of three assessment tools frequently used by mental health professionals when evaluating sex offenders' risk for reoffending--the Psychopathy Checklist-Revised (PCL-R), the Minnesota Sex Offender Screening Tool-Revised (MnSOST-R) and the Static-99-was examined within the context of sexually violent predator program proceedings. Rater agreement was highest for the Static--99 (intraclass correlation coefficient [ICC₁] = .78) and lowest for the PCL-R (ICC₁ = .60; MnSOST-R ICC₁ = .74), although all instruments demonstrated lower field reliability than that reported in their test manuals. Findings raise concerns about the reliability of risk assessment tools that are used to inform judgments of risk in high-stake sexually violent predator proceedings. Implications for future research and suggestions for improving evaluator training to increase accuracy when informing legal decision making are discussed.

Development and validation of an exercise performance support system for people with lower extremity impairment.

PubMed

Minor, M A; Reid, J C; Griffin, J Z; Pittman, C B; Patrick, T B; Cutts, J H

1998-02-01

To identify innovative strategies to support appropriate, self-directed exercise that increase physical activity levels of people with arthritis. This article reports on one interactive, multimedia exercise performance support system (PSS) for people with lower extremity impairments in strength or flexibility. An interdisciplinary team developed the PSS using self-report of lower extremity musculoskeletal impairments (flexibility and strength) to produce an individualized exercise program with video and print educational materials. Initial evaluation has investigated the validity and reliability of program assessments and recommendations. PSS self-report and professional assessments were similar, with more impairments indicated by self-report. PSS exercise recommendations were similar to those made by 3 expert physical therapists using the same exercise data base. Results of PSS impairment assessments were stable over a 1-week period. PSS exercise recommendations appear to be reliable and a valid reflection of current exercise knowledge in rheumatology. Furthermore, users were able to complete the computer-based program with minimal assistance and reported it to be enjoyable and informative.

Surveying Florida MPO readiness to incorporate innovative technologies into long range transportation plans : draft final report.

DOT National Transportation Integrated Search

2016-08-01

There is optimism that Automated Vehicles (AVs) can improve the safety of the transportation system, : reduce congestion, increase reliability, offer improved mobility solutions to all segments of the population : including the transportation-disadva...

Examining the reliability of ADAS-Cog change scores.

PubMed

Grochowalski, Joseph H; Liu, Ying; Siedlecki, Karen L

2016-09-01

The purpose of this study was to estimate and examine ways to improve the reliability of change scores on the Alzheimer's Disease Assessment Scale, Cognitive Subtest (ADAS-Cog). The sample, provided by the Alzheimer's Disease Neuroimaging Initiative, included individuals with Alzheimer's disease (AD) (n = 153) and individuals with mild cognitive impairment (MCI) (n = 352). All participants were administered the ADAS-Cog at baseline and 1 year, and change scores were calculated as the difference in scores over the 1-year period. Three types of change score reliabilities were estimated using multivariate generalizability. Two methods to increase change score reliability were evaluated: reweighting the subtests of the scale and adding more subtests. Reliability of ADAS-Cog change scores over 1 year was low for both the AD sample (ranging from .53 to .64) and the MCI sample (.39 to .61). Reweighting the change scores from the AD sample improved reliability (.68 to .76), but lengthening provided no useful improvement for either sample. The MCI change scores had low reliability, even with reweighting and adding additional subtests. The ADAS-Cog scores had low reliability for measuring change. Researchers using the ADAS-Cog should estimate and report reliability for their use of the change scores. The ADAS-Cog change scores are not recommended for assessment of meaningful clinical change.

Educational testing validity and reliability in pharmacy and medical education literature.

PubMed

Hoover, Matthew J; Jung, Rose; Jacobs, David M; Peeters, Michael J

2013-12-16

To evaluate and compare the reliability and validity of educational testing reported in pharmacy education journals to medical education literature. Descriptions of validity evidence sources (content, construct, criterion, and reliability) were extracted from articles that reported educational testing of learners' knowledge, skills, and/or abilities. Using educational testing, the findings of 108 pharmacy education articles were compared to the findings of 198 medical education articles. For pharmacy educational testing, 14 articles (13%) reported more than 1 validity evidence source while 83 articles (77%) reported 1 validity evidence source and 11 articles (10%) did not have evidence. Among validity evidence sources, content validity was reported most frequently. Compared with pharmacy education literature, more medical education articles reported both validity and reliability (59%; p<0.001). While there were more scholarship of teaching and learning (SoTL) articles in pharmacy education compared to medical education, validity, and reliability reporting were limited in the pharmacy education literature.

Validity and Reliability of Field-Based Measures for Assessing Movement Skill Competency in Lifelong Physical Activities: A Systematic Review.

PubMed

Hulteen, Ryan M; Lander, Natalie J; Morgan, Philip J; Barnett, Lisa M; Robertson, Samuel J; Lubans, David R

2015-10-01

It has been suggested that young people should develop competence in a variety of 'lifelong physical activities' to ensure that they can be active across the lifespan. The primary aim of this systematic review is to report the methodological properties, validity, reliability, and test duration of field-based measures that assess movement skill competency in lifelong physical activities. A secondary aim was to clearly define those characteristics unique to lifelong physical activities. A search of four electronic databases (Scopus, SPORTDiscus, ProQuest, and PubMed) was conducted between June 2014 and April 2015 with no date restrictions. Studies addressing the validity and/or reliability of lifelong physical activity tests were reviewed. Included articles were required to assess lifelong physical activities using process-oriented measures, as well as report either one type of validity or reliability. Assessment criteria for methodological quality were adapted from a checklist used in a previous review of sport skill outcome assessments. Movement skill assessments for eight different lifelong physical activities (badminton, cycling, dance, golf, racquetball, resistance training, swimming, and tennis) in 17 studies were identified for inclusion. Methodological quality, validity, reliability, and test duration (time to assess a single participant), for each article were assessed. Moderate to excellent reliability results were found in 16 of 17 studies, with 71% reporting inter-rater reliability and 41% reporting intra-rater reliability. Only four studies in this review reported test-retest reliability. Ten studies reported validity results; content validity was cited in 41% of these studies. Construct validity was reported in 24% of studies, while criterion validity was only reported in 12% of studies. Numerous assessments for lifelong physical activities may exist, yet only assessments for eight lifelong physical activities were included in this review. Generalizability of results may be more applicable if more heterogeneous samples are used in future research. Moderate to excellent levels of inter- and intra-rater reliability were reported in the majority of studies. However, future work should look to establish test-retest reliability. Validity was less commonly reported than reliability, and further types of validity other than content validity need to be established in future research. Specifically, predictive validity of 'lifelong physical activity' movement skill competency is needed to support the assertion that such activities provide the foundation for a lifetime of activity.

Coal-Powered Electric Generating Unit Efficiency and Reliability Dialogue: Summary Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Taylor, Emmanuel

Coal continues to play a critical role in powering the Nation’s electricity generation, especially for baseload power plants. With aging coal generation assets facing decreased performance due to the state of the equipment, and with challenges exacerbated by the current market pressures on the coal sector, there are opportunities to advance early-stage technologies that can retrofit or replace equipment components. These changes will eventually result in significant improvements in plant performance once further developed and deployed by industry. Research and development in areas such as materials, fluid dynamics, fuel properties and preparation characteristics, and a new generation of plant controlsmore » can lead to new components and systems that can help improve the efficiency and reliability of coal-fired power plants significantly, allowing these assets to continue to provide baseload power. Coal stockpiles at electricity generation plants are typically large enough to provide 30 to 60 days of power prior to resupply—significantly enhancing the stability and reliability of the U.S. electricity sector. Falling prices for non-dispatchable renewable energy and mounting environmental regulations, among other factors, have stimulated efforts to improve the efficiency of these coal-fired electric generating units (EGUs). In addition, increased reliance on natural gas and non-dispatchable energy sources has spurred efforts to further increase the reliability of coal EGUs. The Coal Powered EGU Efficiency and Reliability Dialogue brought together stakeholders from across the coal EGU industry to discuss methods for improvement. Participants at the event reviewed performance-enhancing innovations in coal EGUs, discussed the potential for data-driven management practices to increase efficiency and reliability, investigated the impacts of regulatory compliance on coal EGU performance, and discussed upcoming challenges for the coal industry. This report documents the key findings and research suggestions discussed at the event. Discussions at the workshop will aid DOE in developing a set of distinct initiatives that can be pursued by government and industry to realize promising technological pursuits. DOE plans to use the results of the Dialogue coupled with ongoing technical analysis of efficiency opportunities within the coal-fired fleet, and additional studies to develop a comprehensive strategy for capitalizing on thermal efficiency improvements. Expected Power Plant Efficiency Improvements include developing cost-effective, efficient, and reliable technologies for boilers, turbines, and sensors and controls to improve the reliability and efficiency of existing coal-based power plants. The Office of Fossil Energy at DOE plans to work with industry to develop knowledge pertaining to advanced technologies and systems that industry can subsequently develop. These technologies and systems will increase reliability, add operational flexibility and improve efficiency, thereby providing more robust power generation infrastructure. The following table lists the research suggestions and questions for further investigation that were identified by participants in each session of the dialogue.« less

The patient-specific functional scale: psychometrics, clinimetrics, and application as a clinical outcome measure.

PubMed

Horn, Katyana Kowalchuk; Jennings, Sophie; Richardson, Gillian; Vliet, Ditte Van; Hefford, Cheryl; Abbott, J Haxby

2012-01-01

Systematic review of the literature. To summarize peer-reviewed literature on the reliability, validity, and responsiveness of the Patient-Specific Functional Scale (PSFS), and to identify its use as an outcome measure. Searches were performed of several electronic databases from 1995 to May 2010. Studies included were published articles containing (1) primary research investigating the psychometric and clinimetrics of the PSFS or (2) the implementation of the PSFS as an outcome measure. We assessed the methodological quality of studies included in the first category. Two hundred forty-two articles published from 1994 to May 2010 were identified. Of these, 66 met the inclusion criteria for this review, with 13 reporting the measurement properties of the PSFS, 55 implementing the PSFS as an outcome measure, and 2 doing both of the above. The PSFS was reported to be valid, reliable, and responsive in populations with knee dysfunction, cervical radiculopathy, acute low back pain, mechanical low back pain, and neck dysfunction. The PSFS was found to be reliable and responsive in populations with chronic low back pain. The PSFS was also reported to be valid, reliable, or responsive in individuals with a limited number of acute, subacute, and chronic conditions. This review found that the PSFS is also being used as an outcome measure in many other conditions, despite a lack of published evidence supporting its validity in these conditions. Although the use of the PSFS as an outcome measure is increasing in physiotherapy practice, there are gaps in the research literature regarding its validity, reliability, and responsiveness in many health conditions.

Can shoulder dystocia be reliably predicted?

PubMed

Dodd, Jodie M; Catcheside, Britt; Scheil, Wendy

2012-06-01

To evaluate factors reported to increase the risk of shoulder dystocia, and to evaluate their predictive value at a population level. The South Australian Pregnancy Outcome Unit's population database from 2005 to 2010 was accessed to determine the occurrence of shoulder dystocia in addition to reported risk factors, including age, parity, self-reported ethnicity, presence of diabetes and infant birth weight. Odds ratios (and 95% confidence interval) of shoulder dystocia was calculated for each risk factor, which were then incorporated into a logistic regression model. Test characteristics for each variable in predicting shoulder dystocia were calculated. As a proportion of all births, the reported rate of shoulder dystocia increased significantly from 0.95% in 2005 to 1.38% in 2010 (P = 0.0002). Using a logistic regression model, induction of labour and infant birth weight greater than both 4000 and 4500 g were identified as significant independent predictors of shoulder dystocia. The value of risk factors alone and when incorporated into the logistic regression model was poorly predictive of the occurrence of shoulder dystocia. While there are a number of factors associated with an increased risk of shoulder dystocia, none are of sufficient sensitivity or positive predictive value to allow their use clinically to reliably and accurately identify the occurrence of shoulder dystocia. © 2012 The Authors ANZJOG © 2012 The Royal Australian and New Zealand College of Obstetricians and Gynaecologists.

75 FR 5633 - Notice of Extension of Comment Period for NUREG-1921, EPRI/NRC-RES Fire Human Reliability...

Federal Register 2010, 2011, 2012, 2013, 2014

2010-02-03

..., EPRI/NRC- RES Fire Human Reliability Analysis Guidelines, Draft Report for Comment AGENCY: Nuclear... Human Reliability Analysis Guidelines, Draft Report for Comment'' (December 11, 2009; 74 FR 65810). This... Human Reliability Analysis Guidelines'' is available electronically under ADAMS Accession Number...

18 CFR 39.11 - Reliability reports.

Code of Federal Regulations, 2010 CFR

2010-04-01

... Electric Reliability Organization shall conduct assessments of the adequacy of the Bulk-Power System in... assessments as determined by the Commission of the reliability of the Bulk-Power System in North America and... 18 Conservation of Power and Water Resources 1 2010-04-01 2010-04-01 false Reliability reports. 39...

Hardwood price reporting.

Treesearch

Brent L. Sohngen; Richard W. Haynes

1994-01-01

Prices for red alder (Alnus rubra Bong.) hardwood logs are published and analyzed for reliability, consistency, and robustness. Timberland managers can use these prices to make decisions about land management. They show that values for red alder logs have been increasing steadily for the last 11 years.

Impact of a critical care postgraduate certificate course on nurses' self-reported competence and confidence: A quasi-experimental study.

PubMed

Baxter, Rebecca; Edvardsson, David

2018-06-01

Postgraduate education is said to support the development of nurses' professional competence and confidence, essential to the delivery of safe and effective care. However, there is a shortness of empirical evidence to demonstrate an increase to nurses' self-reported confidence and competence on completion of critical care postgraduate certificate-level education. To explore the impact of a critical care postgraduate certificate course on nurses' self-reported competence and confidence. To explore the psychometric properties and performance of the Critical Care Competence and Confidence Questionnaire. A quasi-experimental pre/post-test design. A total population sample of nurses completing a critical care postgraduate certificate course at an Australian University. The Critical Care Competence and Confidence Questionnaire was developed for this study to measure nurses' self-reported competence and confidence at baseline and follow up. Descriptive and inferential statistics were used to explore sample characteristics and changes between baseline and follow-up. Reliability of the questionnaire was explored using Cronbach's Alpha and item-total correlations. There was a statistically significant increase in competence and confidence between baseline and follow-up across all questionnaire domains. Satisfactory reliability estimates were found for the questionnaire. Completion of a critical care postgraduate certificate course significantly increased nurses' perceived competence and confidence. The Critical Care Competence and Confidence Questionnaire was found to be psychometrically sound for measuring nurses' self-reported competence and confidence. Copyright © 2018 Elsevier Ltd. All rights reserved.

Reliability of self-reported smoking history and age at initial tobacco use.

PubMed

Huerta, Michael; Chodick, Gabriel; Balicer, Ran D; Davidovitch, Nadav; Grotto, Itamar

2005-08-01

Many studies use questionnaires to determine smoking status and age of smoking onset. This study aimed to determine the reliability of self-reported smoking history and age of smoking initiation. The proportion of inconsistent answers and correlation coefficients of reported age of initial smoking were measured by an answer-reanswer analysis of questionnaires in an ongoing, two-step, population-based survey of health behavior. Interviews were conducted on the day of recruitment to and the day of discharge from mandatory military service in Israel among a sample of 25,437 young men and women recruited between 1986 and 2000. Of 7276 participants reporting current or past smoking upon recruitment, 559 (7.7%) reported never having smoked upon discharge, thus demonstrating prima facie inconsistency. Variables significantly associated with reliable reporting in a multivariate logistic regression model were female gender (P = 0.04) and more than 4 years of military service (P < 0.01). 6010 subjects who reported a positive smoking history at both recruitment and discharge were available for analysis of reliability of reported age at smoking onset. Intraclass correlation coefficients for recruitment/discharge consistency in reported age at first cigarette were 0.73 (95% CI: 0.71-0.74) and 0.76 (95% CI: 0.74-0.78) for men and women, respectively. Eastern origin, lower subject education level, and lower paternal education level were also associated with lower reliability. Our results showed a relatively high level of answer-reanswer reliability, with some variance attributable to personal characteristics. These results suggest that self-reported age at onset of tobacco use is practical and reliable in normative, young adult populations. However, time elapsed between questionnaires and demographic and lifestyle characteristics may affect reliability rates, and thus should be carefully regarded in future studies.

The effectiveness of a self-reporting bedside pain assessment tool for oncology inpatients.

PubMed

Kim, Eun Bi; Han, Hye-Suk; Chung, Jung Hwa; Park, Bo Ram; Lim, Sung-Nam; Yim, Kyoung Hoon; Shin, Young Duck; Lee, Ki Hyeong; Kim, Wun-Jae; Kim, Seung Taik

2012-11-01

Pain is common during cancer treatment, and patient self-reporting of pain is an essential first step for ideal cancer pain management. However, many studies on cancer pain management report that, because pain may be underestimated, it is often inadequately managed. The aim of this study was to evaluate the effectiveness of bedside self-assessment of pain intensity for inpatients using a self-reporting pain board. Fifty consecutive inpatients admitted to the Oncology Department of Chungbuk National University Hospital were included in this observational prospective study from February 2011 to December 2011. The medical staff performed pain assessments by asking patients questions and using verbal rated scales (VRS) over 3 consecutive days. Then, for 3 additional days, patients used a self-reporting pain board attached to the bed, which had movable indicators representing 0-10 on a numeric rating scale (NRS) and the frequency of breakthrough pain. Patient reliability over the medical staff's pain assessment increased from 74% to 96% after applying the self-reporting pain board (p=0.004). The gap (mean±standard deviation [SD]) between the NRS reported by patients and the NRS recorded on the medical records decreased from 3.16±2.08 to 1.00±1.02 (p<0.001), and the level of patient satisfaction with pain management increased from 54% to 82% (p=0.002). This study suggests that the self-reporting bedside pain assessment tool provides a reliable and effective means of assessing pain in oncology inpatients.

The kappa statistic in rehabilitation research: an examination.

PubMed

Tooth, Leigh R; Ottenbacher, Kenneth J

2004-08-01

The number and sophistication of statistical procedures reported in medical rehabilitation research is increasing. Application of the principles and methods associated with evidence-based practice has contributed to the need for rehabilitation practitioners to understand quantitative methods in published articles. Outcomes measurement and determination of reliability are areas that have experienced rapid change during the past decade. In this study, distinctions between reliability and agreement are examined. Information is presented on analytical approaches for addressing reliability and agreement with the focus on the application of the kappa statistic. The following assumptions are discussed: (1) kappa should be used with data measured on a categorical scale, (2) the patients or objects categorized should be independent, and (3) the observers or raters must make their measurement decisions and judgments independently. Several issues related to using kappa in measurement studies are described, including use of weighted kappa, methods of reporting kappa, the effect of bias and prevalence on kappa, and sample size and power requirements for kappa. The kappa statistic is useful for assessing agreement among raters, and it is being used more frequently in rehabilitation research. Correct interpretation of the kappa statistic depends on meeting the required assumptions and accurate reporting.

Reliability of concussion history in former professional football players.

PubMed

Kerr, Zachary Y; Marshall, Stephen W; Guskiewicz, Kevin M

2012-03-01

The reliability of athletes to recall and self-report a concussion history has never been quantified. This study examined the reliability of the self-report concussion history measure and explored determinants of recall in the number of self-reported concussions in a group of retired professional football players. In 2001, a short questionnaire was administered to a cohort of former professional football players to ascertain the number of self-reported concussions they sustained during their professional playing careers. In 2010, the same instrument was readministered to a subset (n = 899) of the original cohort to assess reliability. Overall reliability was moderate (weighted Cohen κ = 0.48). The majority (62.1%) reported the same number of concussions in both administrations (2001 and 2010); 31.4% reported more concussions in the second administration. Compared with the "same number reported" group, the "greater number reported" group had more deficits in the second administration in their Short Form 36 physical health (composite score combining physical functioning, role physical, bodily pain, general health) and mental health (e.g., composite score combining vitality, social functioning, role emotional) scales. The self-reported concussion history had moderate reliability in former professional football players, on the basis of two administrations of the same instrument, 9 yr apart. However, changes in health status may be differentially associated with recall of concussions.

Tackling reliability and construct validity: the systematic development of a qualitative protocol for skill and incident analysis.

PubMed

Savage, Trevor Nicholas; McIntosh, Andrew Stuart

2017-03-01

It is important to understand factors contributing to and directly causing sports injuries to improve the effectiveness and safety of sports skills. The characteristics of injury events must be evaluated and described meaningfully and reliably. However, many complex skills cannot be effectively investigated quantitatively because of ethical, technological and validity considerations. Increasingly, qualitative methods are being used to investigate human movement for research purposes, but there are concerns about reliability and measurement bias of such methods. Using the tackle in Rugby union as an example, we outline a systematic approach for developing a skill analysis protocol with a focus on improving objectivity, validity and reliability. Characteristics for analysis were selected using qualitative analysis and biomechanical theoretical models and epidemiological and coaching literature. An expert panel comprising subject matter experts provided feedback and the inter-rater reliability of the protocol was assessed using ten trained raters. The inter-rater reliability results were reviewed by the expert panel and the protocol was revised and assessed in a second inter-rater reliability study. Mean agreement in the second study improved and was comparable (52-90% agreement and ICC between 0.6 and 0.9) with other studies that have reported inter-rater reliability of qualitative analysis of human movement.

Sources of medicine information and their reliability evaluated by medicine users.

PubMed

Närhi, Ulla

2007-12-01

To study the medicine users' sources of medicine information and the perceived reliability of these sources in different age groups. A computer-aided telephone interview (CATI) to Finnish consumers (n = 1,004). Those respondents (n = 714) who reported using any prescription or self-medication medicines more than once a month were included in the study. The respondents were interviewed about their use of sources of medicine information during the previous 6 months. The reliability of sources in different age groups was estimated using a 4-point scale: very reliable, somewhat reliable, somewhat unreliable and very unreliable. The respondents also had the option of being unable to make an appraisal. A proportion of respondents reporting using the source, number of mentioned sources and their reliability evaluated by respondents. About half of the respondents in each age group mentioned two to four sources. The most common sources of information were Patient Information Leaflets (PILs) (74%), doctors (68%) and pharmacists (60%). Next came television (40%), newspapers and magazines (40%), drug advertisements (32%), nurses (28%), drug information leaflets (27%), relatives and friends (24%), medicine guides and books (22%) and the Internet (20%). There was a significant difference between age groups in reporting the Internet as a source of medicine information (15-34-year-old respondents reported the greatest Internet use). The three most reliable sources in every age group were reported to be PILs, doctors and pharmacists. Nurses, drug regulatory authorities, drug information leaflets and medicine guides and books were considered next most reliable. Relatives and friends, television, newspapers and magazines were considered the least reliable. The respondents were most uncertain about the reliability of the Internet, patient organisations and telephone services. There was a significant difference between age groups in evaluating the reliability of telephone services (15-34-year-olds found them more reliable). Medicine users reported receiving medicine information from many sources. The most commonly used sources were perceived as the most reliable, but their reliability did not seem to depend on age. The counsellors should take into account that patients have many sources of medicine information, with varying validity.

Reliability of self-reported childhood physical abuse by adults and factors predictive of inconsistent reporting.

PubMed

McKinney, Christy M; Harris, T Robert; Caetano, Raul

2009-01-01

Little is known about the reliability of self-reported child physical abuse (CPA) or CPA reporting practices. We estimated reliability and prevalence of self-reported CPA and identified factors predictive of inconsistent CPA reporting among 2,256 participants using surveys administered in 1995 and 2000. Reliability of CPA was fair to moderate (kappa = 0.41). Using a positive report from either survey, the prevalence of moderate (61.8%) and severe (12.0%) CPA was higher than at either survey alone. Compared to consistent reporters of having experienced CPA, inconsistent reporters were less likely to be > or = 30 years old (vs. 18-29) or Black (vs. White) and more likely to have < 12 years of education (vs. 12), have no alcohol-related problems (vs. having problems), or report one type (vs. > or = 2) of CPA. These findings may assist researchers conducting and interpreting studies of CPA.

Test-Retest Reliability of Self-Reported Sexual Behavior, Sexual Orientation, and Psychosexual Milestones Among Gay, Lesbian, and Bisexual Youths

PubMed Central

Schrimshaw, Eric W.; Rosario, Margaret; Meyer-Bahlburg, Heino F. L.; Scharf-Matlick, Alice A.

2011-01-01

Despite the importance of reliable self-reported sexual information for research on sexuality and sexual health, research has not examined reliability of information provided by gay, lesbian, and bisexual (GLB) youths. Test-retest reliability of self-reported sexual behaviors, sexual orientation, sexual identity, and psychosexual developmental milestones was examined among an ethnically diverse sample of 64 self-identified GLB youths. Two face-to-face interviews were conducted approximately two weeks apart using the Sexual Risk Behavior Assessment Schedule for Homosexual Youths (SERBAS-Y-HM). Overall, the mean of the test-retest reliability coefficients was substantial for 6 of the 7 domains: lifetime sexual behaviors (M = .89), sexual behavior in the past 3 months (M = .96), unprotected sexual behavior in the past 3 months (M = .93), sexual identity (κ = .89), sexual orientation (M = .82), and ages of various psychosexual developmental milestones (M = .77). Inconsistent reliability was found for reports of sexual behaviors while using substances. A small number of gender differences emerged, with lower reliability among female youths in the lifetime number of same-sex partners. The overall findings suggest that a wide range of self-reported sexual information can be reliably assessed among GLB youths by means of interviewer-administered questionnaires, such as the SERBAS-Y-HM. PMID:16752124

Updated Reliability Evaluation of V730 Transmission

DOT National Transportation Integrated Search

1983-11-01

This report culminates a two-year review of factors concerning the reliability of the Detroit Diesel Allison V730 automatic three-speed transmission for urban transit buses. This report is a continuing examination of the transmission's reliability. M...

Fifteen-Minute Comprehensive Alcohol Risk Survey: Reliability and Validity Across American Indian and White Adolescents

PubMed Central

Komro, Kelli A; Livingston, Melvin D; Kominsky, Terrence K; Livingston, Bethany J; Garrett, Brady A; Molina, Mildred Maldonado; Boyd, Misty L

2015-01-01

Objective: American Indians (AIs) suffer from significant alcohol-related health disparities, and increased risk begins early. This study examined the reliability and validity of measures to be used in a preventive intervention trial. Reliability and validity across racial/ethnic subgroups are crucial to evaluate intervention effectiveness and promote culturally appropriate evidence-based practice. Method: To assess reliability and validity, we used three baseline surveys of high school students participating in a preventive intervention trial within the jurisdictional service area of the Cherokee Nation in northeastern Oklahoma. The 15-minute alcohol risk survey included 16 multi-item scales and one composite score measuring key proximal, primary, and moderating variables. Forty-four percent of the students indicated that they were AI (of whom 82% were Cherokee), including 23% who reported being AI only (n = 435) and 18% both AI and White (n = 352). Forty-seven percent reported being White only (n = 901). Results: Scales were adequately reliable for the full sample and across race/ethnicity defined by AI, AI/White, and White subgroups. Among the full sample, all scales had acceptable internal consistency, with minor variation across race/ethnicity. All scales had extensive to exemplary test–retest reliability and showed minimal variation across race/ethnicity. The eight proximal and two primary outcome scales were each significantly associated with the frequency of alcohol use during the past month in both the cross-sectional and the longitudinal models, providing support for both criterion validity and predictive validity. For most scales, interpretation of the strength of association and statistical significance did not differ between the racial/ethnic subgroups. Conclusions: The results support the reliability and validity of scales of a brief questionnaire measuring risk and protective factors for alcohol use among AI adolescents, primarily members of the Cherokee Nation. PMID:25486402

Power transfer systems for future navy helicopters. Final report 25 Jun 70--28 Jun 72

DOE Office of Scientific and Technical Information (OSTI.GOV)

Bossler, R.B. Jr.

1972-11-01

The purpose of this program was to conduct an analysis of helicopter power transfer systems (pts), both conventional and advanced concept type, with the objective of reducing specific weights and improving reliability beyond present values. The analysis satisfied requirements specified for a 200,000 pound cargo transport helicopter (CTH), a 70,000 pound heavy assault helicopter, and a 15,000 pound non-combat search and rescue helicopter. Four selected gearing systems (out of seven studied), optimized for lightest weight and equal reliability for the CTH, using component proportioning via stress and stiffness equations, had no significant difference between their aircraft payloads. All optimized ptsmore » were approximately 70% of statistically predicted weight. Reliability increase is predicted via gearbox derating using Weibull relationships. Among advanced concepts, the Turbine Integrated Geared Rotor was competitive for weight, technology availability and reliability increase but handicapped by a special engine requirement. The warm cycle system was found not competitive. Helicopter parametric weight analysis is shown. Advanced development Plans are presented for the pts for the CTH, including total pts system, selected pts components, and scale model flight testing in a Kaman HH2 helicopter.« less

Measuring eating disorder attitudes and behaviors: a reliability generalization study

PubMed Central

2014-01-01

Background Although score reliability is a sample-dependent characteristic, researchers often only report reliability estimates from previous studies as justification for employing particular questionnaires in their research. The present study followed reliability generalization procedures to determine the mean score reliability of the Eating Disorder Inventory and its most commonly employed subscales (Drive for Thinness, Bulimia, and Body Dissatisfaction) and the Eating Attitudes Test as a way to better identify those characteristics that might impact score reliability. Methods Published studies that used these measures were coded based on their reporting of reliability information and additional study characteristics that might influence score reliability. Results Score reliability estimates were included in 26.15% of studies using the EDI and 36.28% of studies using the EAT. Mean Cronbach’s alphas for the EDI (total score = .91; subscales = .75 to .89), EAT-40 (total score = .81) and EAT-26 (total score = .86; subscales = .56 to .80) suggested variability in estimated internal consistency. Whereas some EDI subscales exhibited higher score reliability in clinical eating disorder samples than in nonclinical samples, other subscales did not exhibit these differences. Score reliability information for the EAT was primarily reported for nonclinical samples, making it difficult to characterize the effect of type of sample on these measures. However, there was a tendency for mean score reliability to be higher in the adult (vs. adolescent) samples and in female (vs. male) samples. Conclusions Overall, this study highlights the importance of assessing and reporting internal consistency during every test administration because reliability is affected by characteristics of the participants being examined. PMID:24764530

[Tools to enhance the quality and transparency of health research reports: reporting guidelines].

PubMed

Galvão, Taís Freire; Silva, Marcus Tolentino; Garcia, Leila Posenato

2016-01-01

Scientific writing is the cornestone for publishing the results of research. Reporting guidelines are important tools for all those involved in the process of research production and report writing. These guidelines detail what is expected to be found in each section of a report for a given study design. The EQUATOR Network (Enhancing the QUAlity and Transparency Of health Research) is an international initiative that seeks to improve the reliability and the value of health research literature by promoting transparent and accurate reporting and wider use of robust reporting guidelines. The use of reporting guidelines has contributed to improved reports as well as increased quality of research methods. Reporting guidelines need to be publicized in order to increase knowledge about these essential tools among health researchers. Encouraging their use by journals is key to enhancing the quality of scientific publications.

Reliability and validity of the Thai version of the Pediatric Quality of Life Inventory 4.0.

PubMed

Sritipsukho, Paskorn; Wisai, Matoorada; Thavorncharoensap, Montarat

2013-04-01

The study aimed to evaluate the reliability and validity of the Thai version of the Pediatric Quality of Life Inventory™ 4.0 Core Scales (PedsQL) as a measure of health-related quality of life (HRQOL). The PedsQL items were completed by 2,086 pupils aged 8-15 years and 1,914 parents from four schools, and 100 pediatric outpatients and 100 parents from a University Hospital. Test-retest reliability was conducted in a randomly selected of 150 pupils at a 1-month interval. Internal consistency reliability for the Total Scale score (α = 0.84 self-report, 0.88 proxy-report), Physical Health Summary score (α = 0.76 self-report, 0.79 proxy-report), and Psychosocial Health Summary score (α = 0.74 self-report, 0.85 proxy-report) exceeded the minimum reliability standard of 0.70. School children had significantly higher mean HRQOL scores compared to those with chronic health conditions for all subscales with the mean differences of 3.1-12.4 for self-report (p < 0.03) and 7.7-15.6 for proxy-report (p < 0.001). Test-retest reliability showed intraclass correlation coefficients above 0.60 in all subscales (p < 0.001). The Thai version of PedsQL had adequate reliability and validity and could be used as an outcome measure of HRQOL in Thai children aged 8-15 years.

Random Measurement Error as a Source of Discrepancies between the Reports of Wives and Husbands Concerning Marital Power and Task Allocation.

ERIC Educational Resources Information Center

Quarm, Daisy

1981-01-01

Findings for couples (N=119) show wife's work, money, and spare time low between-spouse correlations are due in part to random measurement error. Suggests that increasing reliability of measures by creating multi-item indices can also increase correlations. Car purchase, vacation, and child discipline were not accounted for by random measurement…

Spanish-language services assessment for children and adolescents (SACA): reliability of parent and adolescent reports.

PubMed

Bean, Donna L; Rotheram-Borus, Mary Jane; Leibowitz, Arleen; Horwitz, Sarah M; Weidmer, Beverly

2003-02-01

To assess test-retest reliability of the service utilization screening section of the Services Assessment for Children and Adolescents (SACA) interview among Spanish-speaking parents and adolescents, correspondence between parent and adolescent reports, and the correlation between reliability and participants' demographic and service use characteristics. The English SACA was translated and administered from September 1999 through January 2000 in Los Angeles County, California, on two separate occasions to eligible parents with a child (4-17 years old) who was a client of a local public mental health authority. Adolescents of these parents (12-17 years old) were also interviewed. Reliability was measured by the kappa statistic. Adult and adolescent reports about lifetime and previous year service setting use exhibited good reliability, but concordance of parents and adolescents did not. Children's service utilization appears to be correlated with reliability of parent reports, and child gender appears to be correlated with reliability of adolescent reports. The SACA appears to be a useful tool for screening Spanish-speaking families about child and adolescent mental health service use. These findings must be considered preliminary until replicated in a larger sample of culturally diverse Spanish-speaking families.

Quality Teaching: Means for Its Enhancement?

ERIC Educational Resources Information Center

Buchanan, John

2011-01-01

The pursuit of enhancing quality in tertiary education and educators is noble. Increasingly, however, universities are resorting to stark, reductionist representations of educational quality, such as decontextualised mean figures generated by student surveys, to measure and report on this. This paper questions the validity and reliability of such…

Beyond the Factor of Safety: Developing Fragility Curves to Characterize System Reliability

DTIC Science & Technology

2010-07-01

increasingly common compo- nents of flood risk assessments. This report introduces the concept of the fragility curve and shows how fragility curves are...curves are identified in the literature on structures and risk assessment to identify what methods have been used to develop fragility curves in...and disadvantages of the various approaches are considered. DISCLAIMER: The contents of this report are not to be used for advertising

How young can children reliably and validly self-report their health-related quality of life?: an analysis of 8,591 children across age subgroups with the PedsQL 4.0 Generic Core Scales.

PubMed

Varni, James W; Limbers, Christine A; Burwinkle, Tasha M

2007-01-03

The last decade has evidenced a dramatic increase in the development and utilization of pediatric health-related quality of life (HRQOL) measures in an effort to improve pediatric patient health and well-being and determine the value of healthcare services. The emerging paradigm shift toward patient-reported outcomes (PROs) in clinical trials has provided the opportunity to further emphasize the value and essential need for pediatric patient self-reported outcomes measurement. Data from the PedsQL DatabaseSM were utilized to test the hypothesis that children as young as 5 years of age can reliably and validly report their HRQOL. The sample analyzed represented child self-report age data on 8,591 children ages 5 to 16 years from the PedsQL 4.0 Generic Core Scales DatabaseSM. Participants were recruited from general pediatric clinics, subspecialty clinics, and hospitals in which children were being seen for well-child checks, mild acute illness, or chronic illness care (n = 2,603, 30.3%), and from a State Children's Health Insurance Program (SCHIP) in California (n = 5,988, 69.7%). Items on the PedsQL 4.0 Generic Core Scales had minimal missing responses for children as young as 5 years old, supporting feasibility. The majority of the child self-report scales across the age subgroups, including for children as young as 5 years, exceeded the minimum internal consistency reliability standard of 0.70 required for group comparisons, while the Total Scale Scores across the age subgroups approached or exceeded the reliability criterion of 0.90 recommended for analyzing individual patient scale scores. Construct validity was demonstrated utilizing the known groups approach. For each PedsQL scale and summary score, across age subgroups, including children as young as 5 years, healthy children demonstrated a statistically significant difference in HRQOL (better HRQOL) than children with a known chronic health condition, with most effect sizes in the medium to large effect size range. The results demonstrate that children as young as the 5 year old age subgroup can reliably and validly self-report their HRQOL when given the opportunity to do so with an age-appropriate instrument. These analyses are consistent with recent FDA guidelines which require instrument development and validation testing for children and adolescents within fairly narrow age groupings and which determine the lower age limit at which children can provide reliable and valid responses across age categories.

Software reliability models for critical applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pham, H.; Pham, M.

This report presents the results of the first phase of the ongoing EG G Idaho, Inc. Software Reliability Research Program. The program is studying the existing software reliability models and proposes a state-of-the-art software reliability model that is relevant to the nuclear reactor control environment. This report consists of three parts: (1) summaries of the literature review of existing software reliability and fault tolerant software reliability models and their related issues, (2) proposed technique for software reliability enhancement, and (3) general discussion and future research. The development of this proposed state-of-the-art software reliability model will be performed in the secondmore » place. 407 refs., 4 figs., 2 tabs.« less

Software reliability models for critical applications

DOE Office of Scientific and Technical Information (OSTI.GOV)

Pham, H.; Pham, M.

This report presents the results of the first phase of the ongoing EG&G Idaho, Inc. Software Reliability Research Program. The program is studying the existing software reliability models and proposes a state-of-the-art software reliability model that is relevant to the nuclear reactor control environment. This report consists of three parts: (1) summaries of the literature review of existing software reliability and fault tolerant software reliability models and their related issues, (2) proposed technique for software reliability enhancement, and (3) general discussion and future research. The development of this proposed state-of-the-art software reliability model will be performed in the second place.more » 407 refs., 4 figs., 2 tabs.« less

Reliability of physical examination for diagnosis of myofascial trigger points: a systematic review of the literature.

PubMed

Lucas, Nicholas; Macaskill, Petra; Irwig, Les; Moran, Robert; Bogduk, Nikolai

2009-01-01

Trigger points are promoted as an important cause of musculoskeletal pain. There is no accepted reference standard for the diagnosis of trigger points, and data on the reliability of physical examination for trigger points are conflicting. To systematically review the literature on the reliability of physical examination for the diagnosis of trigger points. MEDLINE, EMBASE, and other sources were searched for articles reporting the reliability of physical examination for trigger points. Included studies were evaluated for their quality and applicability, and reliability estimates were extracted and reported. Nine studies were eligible for inclusion. None satisfied all quality and applicability criteria. No study specifically reported reliability for the identification of the location of active trigger points in the muscles of symptomatic participants. Reliability estimates varied widely for each diagnostic sign, for each muscle, and across each study. Reliability estimates were generally higher for subjective signs such as tenderness (kappa range, 0.22-1.0) and pain reproduction (kappa range, 0.57-1.00), and lower for objective signs such as the taut band (kappa range, -0.08-0.75) and local twitch response (kappa range, -0.05-0.57). No study to date has reported the reliability of trigger point diagnosis according to the currently proposed criteria. On the basis of the limited number of studies available, and significant problems with their design, reporting, statistical integrity, and clinical applicability, physical examination cannot currently be recommended as a reliable test for the diagnosis of trigger points. The reliability of trigger point diagnosis needs to be further investigated with studies of high quality that use current diagnostic criteria in clinically relevant patients.

Quality of survey reporting in nephrology journals: a methodologic review.

PubMed

Li, Alvin Ho-Ting; Thomas, Sonia M; Farag, Alexandra; Duffett, Mark; Garg, Amit X; Naylor, Kyla L

2014-12-05

Survey research is an important research method used to determine individuals' attitudes, knowledge, and behaviors; however, as with other research methods, inadequate reporting threatens the validity of results. This study aimed to describe the quality of reporting of surveys published between 2001 and 2011 in the field of nephrology. The top nephrology journals were systematically reviewed (2001-2011: American Journal of Kidney Diseases, Nephrology Dialysis Transplantation, and Kidney International; 2006-2011: Clinical Journal of the American Society of Nephrology) for studies whose primary objective was to collect and report survey results. Included were nephrology journals with a heavy focus on clinical research and high impact factors. All titles and abstracts were screened in duplicate. Surveys were excluded if they were part of a multimethod study, evaluated only psychometric characteristics, or used semi-structured interviews. Information was collected on survey and respondent characteristics, questionnaire development (e.g., pilot testing), psychometric characteristics (e.g., validity and reliability), survey methods used to optimize response rate (e.g., system of multiple contacts), and response rate. After a screening of 19,970 citations, 216 full-text articles were reviewed and 102 surveys were included. Approximately 85% of studies reported a response rate. Almost half of studies (46%) discussed how they developed their questionnaire and only a quarter of studies (28%) mentioned the validity or reliability of the questionnaire. The only characteristic that improved over the years was the proportion of articles reporting missing data (2001-2004: 46.4%; 2005-2008: 61.9%; and 2009-2011: 84.8%; respectively) (P<0.01). The quality of survey reporting in nephrology journals remains suboptimal. In particular, reporting of the validity and reliability of the questionnaire must be improved. Guidelines to improve survey reporting and increase transparency are clearly needed. Copyright © 2014 by the American Society of Nephrology.

Virtual obstacle crossing: Reliability and differences in stroke survivors who prospectively experienced falls or no falls.

PubMed

Punt, Michiel; Bruijn, Sjoerd M; Wittink, Harriet; van de Port, Ingrid G; Wubbels, Gijs; van Dieën, Jaap H

2017-10-01

Stroke survivors often fall during walking. To reduce fall risk, gait testing and training with avoidance of virtual obstacles is gaining popularity. However, it is unknown whether and how virtual obstacle crossing is associated with fall risk. The present study assessed whether obstacle crossing characteristics are reliable and assessed differences in stroke survivors who prospectively experienced falls or no falls. We recruited twenty-nine community dwelling chronic stroke survivors. Participants crossed five virtual obstacles with increasing lengths. After a break, the test was repeated to assess test-retest reliability. For each obstacle length and trial, we determined; success rate, leading limb preference, pre and post obstacle distance, margins of stability, toe clearance, and crossing step length and speed. Subsequently, fall incidence was monitored using a fall calendar and monthly phone calls over a six-month period. Test-retest reliability was poor, but improved with increasing obstacle-length. Twelve participants reported at least one fall. No association of fall incidence with any of the obstacle crossing characteristics was found. Given the absence of height of the virtual obstacles, obstacle avoidance may have been relatively easy, allowing participants to cross obstacles in multiple ways, increasing variability of crossing characteristics and reducing the association with fall risk. These finding cast some doubt on current protocols for testing and training of obstacle avoidance in stroke rehabilitation. Copyright © 2017 Elsevier B.V. All rights reserved.

Report on Wind Turbine Subsystem Reliability - A Survey of Various Databases (Presentation)

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sheng, S.

2013-07-01

Wind industry has been challenged by premature subsystem/component failures. Various reliability data collection efforts have demonstrated their values in supporting wind turbine reliability and availability research & development and industrial activities. However, most information on these data collection efforts are scattered and not in a centralized place. With the objective of getting updated reliability statistics of wind turbines and/or subsystems so as to benefit future wind reliability and availability activities, this report is put together based on a survey of various reliability databases that are accessible directly or indirectly by NREL. For each database, whenever feasible, a brief description summarizingmore » database population, life span, and data collected is given along with its features & status. Then selective results deemed beneficial to the industry and generated based on the database are highlighted. This report concludes with several observations obtained throughout the survey and several reliability data collection opportunities in the future.« less

Concordance and Reliability of Photogrammetric Protocols for Measuring the Cervical Lordosis Angle: A Systematic Review of the Literature.

PubMed

de Albuquerque, Priscila Maria Nascimento Martins; de Alencar, Geisa Guimarães; de Oliveira, Daniela Araújo; de Siqueira, Gisela Rocha

2018-01-01

The aim of this study was to examine and interpret the concordance, accuracy, and reliability of photogrammetric protocols available in the literature for evaluating cervical lordosis in an adult population aged 18 to 59 years. A systematic search of 6 electronic databases (MEDLINE via PubMed, LILACS, CINAHL, Scopus, ScienceDirect, and Web of Science) located studies that assessed the reliability and/or concordance and/or accuracy of photogrammetric protocols for evaluating cervical lordosis, compared with radiography. Articles published through April 2016 were selected. Two independent reviewers used a critical appraisal tool (QUADAS and QAREL) to assess the quality of the selected studies. Two studies were included in the review and had high levels of reliability (intraclass correlation coefficient: 0.974-0.98). Only 1 study assessed the concordance between the methods, which was calculated using Pearson's correlation coefficient. To date, the accuracy of photogrammetry has not been investigated thoroughly. We encountered no study in the literature that investigated the accuracy of photogrammetry in diagnosing hyperlordosis of cervical spine. However, both current studies report high levels of intra- and interrater reliability. To increase the level of evidence of photogrammetry in the evaluation of cervical lordosis, it is necessary to conduct further studies using a larger sample to increase the external validity of the findings. Copyright © 2018. Published by Elsevier Inc.

Report: Studies Addressing EPA’s Organizational Structure

EPA Pesticide Factsheets

Report #2006-P-00029, August 16, 2006. The 13 studies, articles, publications, and reports we reviewed identified issues with cross-media management, regional offices, reliable information, and reliable science.

Boiling over: A Descriptive Analysis of Drinking Water Advisories in First Nations Communities in Ontario, Canada

PubMed Central

Galway, Lindsay P.

2016-01-01

Access to safe and reliable drinking water is commonplace for most Canadians. However, the right to safe and reliable drinking water is denied to many First Nations peoples across the country, highlighting a priority public health and environmental justice issue in Canada. This paper describes trends and characteristics of drinking water advisories, used as a proxy for reliable access to safe drinking water, among First Nations communities in the province of Ontario. Visual and statistical tools were used to summarize the advisory data in general, temporal trends, and characteristics of the drinking water systems in which advisories were issued. Overall, 402 advisories were issued during the study period. The number of advisories increased from 25 in 2004 to 75 in 2013. The average advisory duration was 294 days. Most advisories were reported in summer months and equipment malfunction was the most commonly reported reason for issuing an advisory. Nearly half of all advisories occurred in drinking water systems where additional operator training was needed. These findings underscore that the prevalence of drinking water advisories in First Nations communities is a problem that must be addressed. Concerted and multi-faceted efforts are called for to improve the provision of safe and reliable drinking water First Nations communities. PMID:27196919

Boiling over: A Descriptive Analysis of Drinking Water Advisories in First Nations Communities in Ontario, Canada.

PubMed

Galway, Lindsay P

2016-05-17

Access to safe and reliable drinking water is commonplace for most Canadians. However, the right to safe and reliable drinking water is denied to many First Nations peoples across the country, highlighting a priority public health and environmental justice issue in Canada. This paper describes trends and characteristics of drinking water advisories, used as a proxy for reliable access to safe drinking water, among First Nations communities in the province of Ontario. Visual and statistical tools were used to summarize the advisory data in general, temporal trends, and characteristics of the drinking water systems in which advisories were issued. Overall, 402 advisories were issued during the study period. The number of advisories increased from 25 in 2004 to 75 in 2013. The average advisory duration was 294 days. Most advisories were reported in summer months and equipment malfunction was the most commonly reported reason for issuing an advisory. Nearly half of all advisories occurred in drinking water systems where additional operator training was needed. These findings underscore that the prevalence of drinking water advisories in First Nations communities is a problem that must be addressed. Concerted and multi-faceted efforts are called for to improve the provision of safe and reliable drinking water First Nations communities.

Reliability of Diagnosing Clinical Hypothyroidism in Adults with Down Syndrome. Brief Report.

ERIC Educational Resources Information Center

Prasher, V. P.

1995-01-01

The accuracy of diagnosing hypothyroidism in 160 adults with Down syndrome was examined. A significant association between a clinical diagnosis of hypothyroidism and increasing age was found but no significant association was found between a clinical and a biochemical diagnosis. Regular biochemical screening is recommended. (Author/SW)

Understanding Mathematics and Science Matters. Studies in Mathematical Thinking and Learning Series

ERIC Educational Resources Information Center

Romberg, Thomas A., Ed.; Carpenter, Thomas P., Ed.; Dremock, Fae, Ed.

2005-01-01

The research reported in this book provides reliable evidence on and knowledge about mathematics and science instruction that emphasizes student understanding--instruction consistent with the needs of students who will be citizens in an increasingly demanding technological world. The National Center for Improving Student Learning in Mathematics…

Acute Respiratory Distress Syndrome Measurement Error. Potential Effect on Clinical Study Results

PubMed Central

Cooke, Colin R.; Iwashyna, Theodore J.; Hofer, Timothy P.

2016-01-01

Rationale: Identifying patients with acute respiratory distress syndrome (ARDS) is a recognized challenge. Experts often have only moderate agreement when applying the clinical definition of ARDS to patients. However, no study has fully examined the implications of low reliability measurement of ARDS on clinical studies. Objectives: To investigate how the degree of variability in ARDS measurement commonly reported in clinical studies affects study power, the accuracy of treatment effect estimates, and the measured strength of risk factor associations. Methods: We examined the effect of ARDS measurement error in randomized clinical trials (RCTs) of ARDS-specific treatments and cohort studies using simulations. We varied the reliability of ARDS diagnosis, quantified as the interobserver reliability (κ-statistic) between two reviewers. In RCT simulations, patients identified as having ARDS were enrolled, and when measurement error was present, patients without ARDS could be enrolled. In cohort studies, risk factors as potential predictors were analyzed using reviewer-identified ARDS as the outcome variable. Measurements and Main Results: Lower reliability measurement of ARDS during patient enrollment in RCTs seriously degraded study power. Holding effect size constant, the sample size necessary to attain adequate statistical power increased by more than 50% as reliability declined, although the result was sensitive to ARDS prevalence. In a 1,400-patient clinical trial, the sample size necessary to maintain similar statistical power increased to over 1,900 when reliability declined from perfect to substantial (κ = 0.72). Lower reliability measurement diminished the apparent effectiveness of an ARDS-specific treatment from a 15.2% (95% confidence interval, 9.4–20.9%) absolute risk reduction in mortality to 10.9% (95% confidence interval, 4.7–16.2%) when reliability declined to moderate (κ = 0.51). In cohort studies, the effect on risk factor associations was similar. Conclusions: ARDS measurement error can seriously degrade statistical power and effect size estimates of clinical studies. The reliability of ARDS measurement warrants careful attention in future ARDS clinical studies. PMID:27159648

On the reliability of seasonal climate forecasts.

PubMed

Weisheimer, A; Palmer, T N

2014-07-06

Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: how good are seasonal forecasts on a scale of 1-5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal forecasts are made from ensembles of integrations of numerical models of climate. We argue that 'goodness' should be assessed first and foremost in terms of the probabilistic reliability of these ensemble-based forecasts; reliable inputs are essential for any forecast-based decision-making. We propose that a '5' should be reserved for systems that are not only reliable overall, but where, in particular, small ensemble spread is a reliable indicator of low ensemble forecast error. We study the reliability of regional temperature and precipitation forecasts of the current operational seasonal forecast system of the European Centre for Medium-Range Weather Forecasts, universally regarded as one of the world-leading operational institutes producing seasonal climate forecasts. A wide range of 'goodness' rankings, depending on region and variable (with summer forecasts of rainfall over Northern Europe performing exceptionally poorly) is found. Finally, we discuss the prospects of reaching '5' across all regions and variables in 30 years time.

NEPP DDR Device Reliability FY13 Report

NASA Technical Reports Server (NTRS)

Guertin, Steven M.; Armbar, Mehran

2014-01-01

This document reports the status of the NEPP Double Data Rate (DDR) Device Reliability effort for FY2013. The task targeted general reliability of > 100 DDR2 devices from Hynix, Samsung, and Micron. Detailed characterization of some devices when stressed by several data storage patterns was studied, targeting ability of the data cells to store the different data patterns without refresh, highlighting the weakest bits. DDR2, Reliability, Data Retention, Temperature Stress, Test System Evaluation, General Reliability, IDD measurements, electronic parts, parts testing, microcircuits

Relapse Risk Assessment for Schizophrenia Patients (RASP): A New Self-Report Screening Tool.

PubMed

Velligan, Dawn; Carpenter, William; Waters, Heidi C; Gerlanc, Nicole M; Legacy, Susan N; Ruetsch, Charles

2018-01-01

The Relapse Assessment for Schizophrenia Patients (RASP) was developed as a six-question self-report screener that measures indicators of Increased Anxiety and Social Isolation to assess patient stability and predict imminent relapse. This paper describes the development and psychometric characteristics of the RASP. The RASP and Positive and Negative Syndrome Scale (PANSS) were administered to patients with schizophrenia (n=166) three separate times. Chart data were collected on a subsample of patients (n=81). Psychometric analyses of RASP included tests of reliability, construct validity, and concurrent validity of items. Factors from RASP were correlated with subscales from PANSS (sensitivity to change and criterion validity [agreement between RASP and evidence of relapse]). Test-retest reliability returned modest to strong agreement at the item level and strong agreement at the questionnaire level. RASP showed good item response curves and internal consistency for the total instrument and within each of the two subscales (Increased Anxiety and Social Isolation). RASP Total Score and subscales showed good concurrent validity when correlated with PANSS Total Score, Positive, Excitement, and Anxiety subscales. RASP correctly predicted relapse in 67% of cases, with good specificity and negative predictive power and acceptable positive predictive power and sensitivity. The reliability and validity data presented support the use of RASP in settings where addition of a brief self-report assessment of relapse risk among patients with schizophrenia may be of benefit. Ease of use and scoring, and the ability to administer without clinical supervision allows for routine administration and assessment of relapse risk.

Final Report: System Reliability Model for Solid-State Lighting (SSL) Luminaires

DOE Office of Scientific and Technical Information (OSTI.GOV)

Davis, J. Lynn

2017-05-31

The primary objectives of this project was to develop and validate reliability models and accelerated stress testing (AST) methodologies for predicting the lifetime of integrated SSL luminaires. This study examined the likely failure modes for SSL luminaires including abrupt failure, excessive lumen depreciation, unacceptable color shifts, and increased power consumption. Data on the relative distribution of these failure modes were acquired through extensive accelerated stress tests and combined with industry data and other source of information on LED lighting. This data was compiled and utilized to build models of the aging behavior of key luminaire optical and electrical components.

The Effectiveness of a Self-Reporting Bedside Pain Assessment Tool for Oncology Inpatients

PubMed Central

Kim, Eun Bi; Chung, Jung Hwa; Park, Bo Ram; Lim, Sung-nam; Yim, Kyoung Hoon; Shin, Young Duck; Lee, Ki Hyeong; Kim, Wun-Jae; Kim, Seung Taik

2012-01-01

Abstract Background Pain is common during cancer treatment, and patient self-reporting of pain is an essential first step for ideal cancer pain management. However, many studies on cancer pain management report that, because pain may be underestimated, it is often inadequately managed. Objective The aim of this study was to evaluate the effectiveness of bedside self-assessment of pain intensity for inpatients using a self-reporting pain board. Methods Fifty consecutive inpatients admitted to the Oncology Department of Chungbuk National University Hospital were included in this observational prospective study from February 2011 to December 2011. The medical staff performed pain assessments by asking patients questions and using verbal rated scales (VRS) over 3 consecutive days. Then, for 3 additional days, patients used a self-reporting pain board attached to the bed, which had movable indicators representing 0–10 on a numeric rating scale (NRS) and the frequency of breakthrough pain. Results Patient reliability over the medical staff's pain assessment increased from 74% to 96% after applying the self-reporting pain board (p=0.004). The gap (mean±standard deviation [SD]) between the NRS reported by patients and the NRS recorded on the medical records decreased from 3.16±2.08 to 1.00±1.02 (p<0.001), and the level of patient satisfaction with pain management increased from 54% to 82% (p=0.002). Conclusion This study suggests that the self-reporting bedside pain assessment tool provides a reliable and effective means of assessing pain in oncology inpatients. PMID:22974435

Ultra-short heart rate variability recording reliability: The effect of controlled paced breathing.

PubMed

Melo, Hiago M; Martins, Thiago C; Nascimento, Lucas M; Hoeller, Alexandre A; Walz, Roger; Takase, Emílio

2018-06-04

Recent studies have reported that Heart Rate Variability (HRV) indices remain reliable even during recordings shorter than 5 min, suggesting the ultra-short recording method as a valuable tool for autonomic assessment. However, the minimum time-epoch to obtain a reliable record for all HRV domains (time, frequency, and Poincare geometric measures), as well as the effect of respiratory rate on the reliability of these indices remains unknown. Twenty volunteers had their HRV recorded in a seated position during spontaneous and controlled respiratory rhythms. HRV intervals with 1, 2, and 3 min were correlated with the gold standard period (6-min duration) and the mean values of all indices were compared in the two respiratory rhythm conditions. rMSSD and SD1 were more reliable for recordings with ultra-short duration at all time intervals (r values from 0.764 to 0.950, p < 0.05) for spontaneous breathing condition, whereas the other indices require longer recording time to obtain reliable values. The controlled breathing rhythm evokes stronger r values for time domain indices (r values from 0.83 to 0.99, p < 0.05 for rMSSD), but impairs the mean values replicability of domains across most time intervals. Although the use of standardized breathing increases the correlations coefficients, all HRV indices showed an increase in mean values (t values from 3.79 to 14.94, p < 0.001) except the RR and HF that presented a decrease (t = 4.14 and 5.96, p < 0.0001). Our results indicate that proper ultra-short-term recording method can provide a quick and reliable source of cardiac autonomic nervous system assessment. © 2018 Wiley Periodicals, Inc.

Non-Weight-Bearing and Weight-Bearing Ultrasonography of Select Foot Muscles in Young, Asymptomatic Participants: A Descriptive and Reliability Study.

PubMed

Battaglia, Patrick J; Mattox, Ross; Winchester, Brett; Kettner, Norman W

The primary aim of this study was to determine the reliability of diagnostic ultrasound imaging for select intrinsic foot muscles using both non-weight-bearing and weight-bearing postures. Our secondary aim was to describe the change in muscle cross-sectional area (CSA) and dorsoplantar thickness when bearing weight. An ultrasound examination was performed with a linear ultrasound transducer operating between 9 and 12 MHz. Long-axis and short-axis ultrasound images of the abductor hallucis, flexor digitorum brevis, and quadratus plantae were obtained in both the non-weight-bearing and weight-bearing postures. Two examiners independently collected ultrasound images to allow for interexaminer and intraexaminer reliability calculation. The change in muscle CSA and dorsoplantar thickness when bearing weight was also studied. There were 26 participants (17 female) with a mean age of 25.5 ± 3.8 years and a mean body mass index of 28.0 ± 7.8 kg/m 2 . Inter-examiner reliability was excellent when measuring the muscles in short axis (intraclass correlation coefficient >0.75) and fair to good in long axis (intraclass correlation coefficient >0.4). Intraexaminer reliability was excellent for the abductor hallucis and flexor digitorum brevis and ranged from fair to good to excellent for the quadratus plantae. Bearing weight did not reduce interexaminer or intraexaminer reliability. All muscles exhibited a significant increase in CSA when bearing weight. This is the first report to describe weight-bearing diagnostic ultrasound of the intrinsic foot muscles. Ultrasound imaging is reliable when imaging these muscles bearing weight. Furthermore, muscle CSA increases in the weight-bearing posture. Copyright © 2016. Published by Elsevier Inc.

Validity, Reliability, and the Questionable Role of Psychometrics in Plastic Surgery

PubMed Central

2014-01-01

Summary: This report examines the meaning of validity and reliability and the role of psychometrics in plastic surgery. Study titles increasingly include the word “valid” to support the authors’ claims. Studies by other investigators may be labeled “not validated.” Validity simply refers to the ability of a device to measure what it intends to measure. Validity is not an intrinsic test property. It is a relative term most credibly assigned by the independent user. Similarly, the word “reliable” is subject to interpretation. In psychometrics, its meaning is synonymous with “reproducible.” The definitions of valid and reliable are analogous to accuracy and precision. Reliability (both the reliability of the data and the consistency of measurements) is a prerequisite for validity. Outcome measures in plastic surgery are intended to be surveys, not tests. The role of psychometric modeling in plastic surgery is unclear, and this discipline introduces difficult jargon that can discourage investigators. Standard statistical tests suffice. The unambiguous term “reproducible” is preferred when discussing data consistency. Study design and methodology are essential considerations when assessing a study’s validity. PMID:25289354

10 CFR 712.12 - HRP implementation.

Code of Federal Regulations, 2012 CFR

2012-01-01

... DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Establishment of and Procedures for the Human Reliability...) Report any observed or reported behavior or condition of another HRP-certified individual that could indicate a reliability concern, including those behaviors and conditions listed in § 712.13(c), to a...

Reliability and validity of two self-report measures of impairment and disability for MS. North American Research Consortium on Multiple Sclerosis Outcomes Study Group.

PubMed

Schwartz, C E; Vollmer, T; Lee, H

1999-01-01

To describe the results of a multicenter study that validated two new patient-reported measures of neurologic impairment and disability for use in MS clinical research. Self-reported data can provide a cost-effective means to assess patient functioning, and can be useful for screening patients who require additional evaluation. Thirteen MS centers from the United States and Canada implemented a cross-sectional validation study of two new measures of neurologic function. The Symptom Inventory is a measure of neurologic impairment with six subscales designed to correlate with localization of brain lesion. The Performance Scales measure disability in eight domains of function: mobility, hand function, vision, fatigue, cognition, bladder/bowel, sensory, and spasticity. Measures given for comparison included a neurologic examination (Expanded Disability Status Scale, Ambulation Index, Disease Steps) as well as the patient-reported Health Status Questionnaire and the Quality of Well-being Index. Participants included 274 MS patients and 296 healthy control subjects who were matched to patients on age, gender, and education. Both the Symptom Inventory and the Performance Scales showed high test-retest and internal consistency reliability. Correlational analyses supported the construct validity of both measures. Discriminant function analysis reduced the Symptom Inventory to 29 items without sacrificing reliability and increased its discriminant validity. The Performance Scales explained more variance in clinical outcomes and global quality of life than the Symptom Inventory, and there was some evidence that the two measures complemented each other in predicting Quality of Well-being Index scores. The Symptom Inventory and the Performance Scales are reliable and valid measures.

Conceptual transitions in methods of skull-photo superimposition that impact the reliability of identification: a review.

PubMed

Jayaprakash, Paul T

2015-01-01

Establishing identification during skull-photo superimposition relies on correlating the salient morphological features of an unidentified skull with those of a face-image of a suspected dead individual using image overlay processes. Technical progression in the process of overlay has included the incorporation of video cameras, image-mixing devices and software that enables real-time vision-mixing. Conceptual transitions occur in the superimposition methods that involve 'life-size' images, that achieve orientation of the skull to the posture of the face in the photograph and that assess the extent of match. A recent report on the reliability of identification using the superimposition method adopted the currently prevalent methods and suggested an increased rate of failures when skulls were compared with related and unrelated face images. The reported reduction in the reliability of the superimposition method prompted a review of the transition in the concepts that are involved in skull-photo superimposition. The prevalent popular methods for visualizing the superimposed images at less than 'life-size', overlaying skull-face images by relying on the cranial and facial landmarks in the frontal plane when orienting the skull for matching and evaluating the match on a morphological basis by relying on mix-mode alone are the major departures in the methodology that may have reduced the identification reliability. The need to reassess the reliability of the method that incorporates the concepts which have been considered appropriate by the practitioners is stressed. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

In-Service Inspection Approaches for Lead-Cooled Nuclear Reactors

DTIC Science & Technology

2017-06-01

Luscombe THIS PAGE INTENTIONALLY LEFT BLANK i REPORT DOCUMENTATION PAGE Form Approved OMB No. 0704–0188 Public reporting burden for this...5500 Standard Form 298 (Rev. 2–89) Prescribed by ANSI Std. 239–18 ii THIS PAGE INTENTIONALLY LEFT BLANK iii Approved for public release...INTRODUCTION A. MOTIVATION Despite growing demand and increasing restrictions on fossil fuels, there is a technology gap for reliable, safe and non-carbon

Score Reliability of Adolescent Alcohol Screening Measures: A Meta-Analytic Inquiry

ERIC Educational Resources Information Center

Shields, Alan L.; Campfield, Delia C.; Miller, Christopher S.; Howell, Ryan T.; Wallace, Kimberly; Weiss, Roger D.

2008-01-01

This study describes the reliability reporting practices in empirical studies using eight adolescent alcohol screening tools and characterizes and explores variability in internal consistency estimates across samples. Of 119 observed administrations of these instruments, 40 (34%) reported usable reliability information. The Personal Experience…

Discordant reporting of nonmedical opioid use in a nationally representative sample of US high school seniors.

PubMed

Palamar, Joseph J; Shearston, Jenni A; Cleland, Charles M

2016-09-01

Nonmedical opioid use has become a major public health concern due to increases in treatment admissions, overdoses, and deaths. Use has also been linked to heroin initiation. Reliable data on nonmedical opioid use are needed to continue to inform prevention. To determine the prevalence and correlates of discordant self-report of nonmedical use of opioids in a national sample. Utilizing a nationally representative sample of 31,149 American high school seniors in the Monitoring the Future study (2009-2013), discordant responses between self-reported 12-month nonmedical opioid use and self-reported 12-month nonmedical Vicodin and OxyContin use (reporting Vicodin/OxyContin use, but not reporting "opioid" use) were assessed. We also used multivariable logistic regression to determine the characteristics of students who were most likely to provide a discordant response. 37.1% of those reporting nonmedical Vicodin use and 28.2% of those reporting nonmedical OxyContin use did not report overall nonmedical opioid use. Prevalence of nonmedical opioid use (8.3%) would increase when factoring in Vicodin, OxyContin, or both, by 2.8%, 1.3%, and 3.3%, respectively. Females were more likely to provide a discordant response to Vicodin and highly religious students were more likely to provide a discordant response regarding OxyContin use. Those who reported cocaine or nonmedical tranquilizer use were at consistently low odds for discordant responses. Nonmedical amphetamine users were at low odds for providing a discordant Vicodin response. Prevalence of nonmedical opioid use may be underreported on some surveys, particularly among specific subpopulations. Further research on the effect of question order and skip-patterns (e.g., "gate" questions) is needed. Reliable data on nonmedical opioid use are needed to continue to accurately inform prevention.

Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting.

PubMed

Clayson, Peter E; Miller, Gregory A

2017-01-01

Failing to consider psychometric issues related to reliability and validity, differential deficits, and statistical power potentially undermines the conclusions of a study. In research using event-related brain potentials (ERPs), numerous contextual factors (population sampled, task, data recording, analysis pipeline, etc.) can impact the reliability of ERP scores. The present review considers the contextual factors that influence ERP score reliability and the downstream effects that reliability has on statistical analyses. Given the context-dependent nature of ERPs, it is recommended that ERP score reliability be formally assessed on a study-by-study basis. Recommended guidelines for ERP studies include 1) reporting the threshold of acceptable reliability and reliability estimates for observed scores, 2) specifying the approach used to estimate reliability, and 3) justifying how trial-count minima were chosen. A reliability threshold for internal consistency of at least 0.70 is recommended, and a threshold of 0.80 is preferred. The review also advocates the use of generalizability theory for estimating score dependability (the generalizability theory analog to reliability) as an improvement on classical test theory reliability estimates, suggesting that the latter is less well suited to ERP research. To facilitate the calculation and reporting of dependability estimates, an open-source Matlab program, the ERP Reliability Analysis Toolbox, is presented. Copyright © 2016 Elsevier B.V. All rights reserved.

Impact of High-Reliability Education on Adverse Event Reporting by Registered Nurses.

PubMed

McFarland, Diane M; Doucette, Jeffrey N

Adverse event reporting is one strategy to identify risks and improve patient safety, but, historically, adverse events are underreported by registered nurses (RNs) because of fear of retribution and blame. A program was provided on high reliability to examine whether education would impact RNs' willingness to report adverse events. Although the findings were not statistically significant, they demonstrated a positive impact on adverse event reporting and support the need to create a culture of high reliability.

Comparison of the reliability of parental reporting and the direct test of the Thai Speech and Language Test.

PubMed

Prathanee, Benjamas; Angsupakorn, Nipa; Pumnum, Tawitree; Seepuaham, Cholada; Jaiyong, Pechcharat

2012-11-01

To find reliability of parental or caregiver's report and testing of the Thai Speech and Language Test for Children Aged 0-4 Years Old. Five investigators assessed speech and language abilities from video both contexts: parental or caregivers' report and test forms of Thai Speech and Language Test for Children Aged 0-4 Years Old. Twenty-five normal and 30 children with delayed development or risk for delayed speech and language skills were assessed at age intervals of 3, 6, 9, 12, 15, 18, 24, 30, 36 and 48 months. Reliability of parental or caregivers' testing and reporting was at a moderate level (0.41-0.60). Inter-rater reliability among investigators was excellent (0.86-1.00). The parental or caregivers' report form of the Thai Speech and Language test for Children aged 0-4 years old was an indicator for success at a moderate level. Trained professionals could use both forms of this test as reliable tools at an excellent level.

Candida bloodstream infection: a clinical microbiology laboratory perspective.

PubMed

Pongrácz, Júlia; Kristóf, Katalin

2014-09-01

The incidence of Candida bloodstream infection (BSI) has been on the rise in several countries worldwide. Species distribution is changing; an increase in the percentage of non-albicans species, mainly fluconazole non-susceptible C. glabrata was reported. Existing microbiology diagnostic methods lack sensitivity, and new methods need to be developed or further evaluation for routine application is necessary. Although reliable, standardized methods for antifungal susceptibility testing are available, the determination of clinical breakpoints remains challenging. Correct species identification is important and provides information on the intrinsic susceptibility profile of the isolate. Currently, acquired resistance in clinical Candida isolates is rare, but reports indicate that it could be an issue in the future. The role of the clinical microbiology laboratory is to isolate and correctly identify the infective agent and provide relevant and reliable susceptibility data as soon as possible to guide antifungal therapy.

SPSS Macros for Assessing the Reliability and Agreement of Student Evaluations of Teaching

ERIC Educational Resources Information Center

Morley, Donald D.

2009-01-01

This article reports and demonstrates two SPSS macros for calculating Krippendorff's alpha and intraclass reliability coefficients in repetitive situations where numerous coefficients are needed. Specifically, the reported SPSS macros were used to evaluate the interrater agreement and reliability of student evaluations of teaching in thousands of…

78 FR 5837 - Cancellation of Environmental Impact Statement/Environmental Impact Report on the Sacramento...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-01-28

...: The Sacramento River Water Reliability Study (SRWRS) was a water supply plan consistent with the Water... supplies to meet growing water supply demands and reliability objectives in their respective service areas.../Environmental Impact Report on the Sacramento River Water Reliability Study, California AGENCY: Bureau of...

78 FR 63172 - Commission Information Collection Activities (FERC-733); Comment Request

Federal Register 2010, 2011, 2012, 2013, 2014

2013-10-23

... Electric Reliability Corporation (NERC) and EIA, to fielding and collecting data using a FERC designed... Commission in time to complete the 2014 report to Congress. NERC, as the Electric Reliability Organization... dispatchable and non-dispatchable resources that it needs to conduct its reliability work. Reporting demand...

Hawaii electric system reliability.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Silva Monroy, Cesar Augusto; Loose, Verne William

2012-09-01

This report addresses Hawaii electric system reliability issues; greater emphasis is placed on short-term reliability but resource adequacy is reviewed in reference to electric consumers' views of reliability %E2%80%9Cworth%E2%80%9D and the reserve capacity required to deliver that value. The report begins with a description of the Hawaii electric system to the extent permitted by publicly available data. Electrical engineering literature in the area of electric reliability is researched and briefly reviewed. North American Electric Reliability Corporation standards and measures for generation and transmission are reviewed and identified as to their appropriateness for various portions of the electric grid and formore » application in Hawaii. Analysis of frequency data supplied by the State of Hawaii Public Utilities Commission is presented together with comparison and contrast of performance of each of the systems for two years, 2010 and 2011. Literature tracing the development of reliability economics is reviewed and referenced. A method is explained for integrating system cost with outage cost to determine the optimal resource adequacy given customers' views of the value contributed by reliable electric supply. The report concludes with findings and recommendations for reliability in the State of Hawaii.« less

Hawaii Electric System Reliability

DOE Office of Scientific and Technical Information (OSTI.GOV)

Loose, Verne William; Silva Monroy, Cesar Augusto

2012-08-01

This report addresses Hawaii electric system reliability issues; greater emphasis is placed on short-term reliability but resource adequacy is reviewed in reference to electric consumers’ views of reliability “worth” and the reserve capacity required to deliver that value. The report begins with a description of the Hawaii electric system to the extent permitted by publicly available data. Electrical engineering literature in the area of electric reliability is researched and briefly reviewed. North American Electric Reliability Corporation standards and measures for generation and transmission are reviewed and identified as to their appropriateness for various portions of the electric grid and formore » application in Hawaii. Analysis of frequency data supplied by the State of Hawaii Public Utilities Commission is presented together with comparison and contrast of performance of each of the systems for two years, 2010 and 2011. Literature tracing the development of reliability economics is reviewed and referenced. A method is explained for integrating system cost with outage cost to determine the optimal resource adequacy given customers’ views of the value contributed by reliable electric supply. The report concludes with findings and recommendations for reliability in the State of Hawaii.« less

Conceptual and measurement issues in early parenting practices research: an epidemiologic perspective.

PubMed

Walker, Lorraine O; Kirby, Russell S

2010-11-01

Early parenting practices are significant to public health because of their linkages to child health outcomes. This paper focuses on the current state of the science regarding conceptual frameworks that incorporate early parenting practices in epidemiologic research and evidence supporting reliability and validity of self-report measures of such practices. Guided by a provisional definition of early parenting practices, literature searches were conducted using PubMed and Sociological Abstracts. Twenty-five published studies that included parent-report measures of early parenting practices met inclusion criteria. Findings on conceptual frameworks were analyzed qualitatively, whereas evidence of reliability and validity were organized into four domains (safety, feeding and oral health, development promotion, and discipline) and summarized in tabular form. Quantitative estimates of measures of reliability and validity were extracted, where available. We found two frameworks incorporating early parenting: one a program theory and the other a predictive model. We found no reported evidence of the reliability or validity of parent-report measures of safety or feeding and oral health practices. Evidence for reliability and validity were reported with greater frequency for development promotion and discipline practices, but report of the most pertinent type of reliability estimation, test-retest reliability, was rare. Failure to examine associations of early parenting practices with any child outcomes within most studies resulted in missed opportunities to indirectly estimate validity of parenting practice measures. Stronger evidence concerning specific measurement properties of early parenting practices is important to advancing maternal-child research, surveillance, and practice.

Geometric classification of scalp hair for valid drug testing, 6 more reliable than 8 hair curl groups.

PubMed

Mkentane, K; Van Wyk, J C; Sishi, N; Gumedze, F; Ngoepe, M; Davids, L M; Khumalo, N P

2017-01-01

Curly hair is reported to contain higher lipid content than straight hair, which may influence incorporation of lipid soluble drugs. The use of race to describe hair curl variation (Asian, Caucasian and African) is unscientific yet common in medical literature (including reports of drug levels in hair). This study investigated the reliability of a geometric classification of hair (based on 3 measurements: the curve diameter, curl index and number of waves). After ethical approval and informed consent, proximal virgin (6cm) hair sampled from the vertex of scalp in 48 healthy volunteers were evaluated. Three raters each scored hairs from 48 volunteers at two occasions each for the 8 and 6-group classifications. One rater applied the 6-group classification to 80 additional volunteers in order to further confirm the reliability of this system. The Kappa statistic was used to assess intra and inter rater agreement. Each rater classified 480 hairs on each occasion. No rater classified any volunteer's 10 hairs into the same group; the most frequently occurring group was used for analysis. The inter-rater agreement was poor for the 8-groups (k = 0.418) but improved for the 6-groups (k = 0.671). The intra-rater agreement also improved (k = 0.444 to 0.648 versus 0.599 to 0.836) for 6-groups; that for the one evaluator for all volunteers was good (k = 0.754). Although small, this is the first study to test the reliability of a geometric classification. The 6-group method is more reliable. However, a digital classification system is likely to reduce operator error. A reliable objective classification of human hair curl is long overdue, particularly with the increasing use of hair as a testing substrate for treatment compliance in Medicine.

Reliability and validity of the Chinese mandarin version of PedsQL™ 3.0 transplant module.

PubMed

Chang, Ying; Luo, Yanhui; Zhou, Yuchen; Wang, Ruixin; Song, Na; Zhu, Guanghua; Wang, Bin; Qin, Maoquan; Yang, Jun; Sun, Yuan; Li, Chunfu; Zhou, Xuan

2016-10-05

Long-term health-related quality of life (HRQoL) of pediatric patients after hematopoietic stem cell transplantation (HSCT) is increasingly studied worldwide. However, few studies have been performed in China, where no uniform scale is available; the PedsQL™ Cancer Module 3.0 Chinese Mandarin version has been used to evaluate HRQoL of patients after HSCT in China. This study aimed to assess the reliability and validity of the Chinese Mandarin version of PedsQL™ 3.0 Transplant Module. Patients between 2 and 18 years old, who underwent HSCT from January 2006 to June 2014, were recruited in Beijing Children's Hospital affiliated to Capital Medical University, the First Affiliated Hospital of Southern Medical University and Beijing Daopei Hospital. 207 parent reports and 182 child self-reports of the PedsQL™ 3.0 Transplant Module Chinese Mandarin version were assigned, of which 362 were returned. No missing item response was observed in the returned reports. Cronbach's alpha coefficient exceeded 0.7 in total scale and every dimension. The intraclass correlation coefficient exceeded 0.8 in all dimensions of child self-reports and parent reports. Spearman's rank correlation coefficients of items and their respective dimensions were 0.6-0.94 in parent reports, and 0.62-0.93 in child self-reports, while a weak association was found between the items and other dimensions. Exploratory factor analysis indicated a good extraction effect, and construct validity of the scale was >60 %. The Chinese Mandarin version of PedsQL™ 3.0 Transplant Module has good feasibility, reliability and validity. Its use may help improve the HRQoL of children after HSCT in China.

The history and reliability of the USDA Forest Service wildfire reports.

Treesearch

Linda R. Donoghue

1982-01-01

Traces the history of USDA Forest Service fire reports, examines the most recent report, Form 5100-29, and discusses the reliability of information recorded on the 5100-29, factors influencing data accuracy, and reactions of the Ranger District personnel to wildfire reporting.

A history of health-related quality of life outcomes in psychiatry.

PubMed

Revicki, Dennis A; Kleinman, Leah; Cella, David

2014-06-01

Health-related quality of life (HRQoL) is a multidimensional concept that includes subjective reports of symptoms, side effects, functioning in multiple life domains, and general perceptions of life satisfaction and quality. Rather than estimating it from external observations, interview, or clinical assessment, it is best measured by direct query. Due to a perception that respondents may not be reliable or credible, there has been some reluctance to use self-report outcomes in psychiatry. More recently, and increasingly, HRQoL assessment through direct patient query has become common when evaluating a range of psychiatric, psychological, and social therapies. With few exceptions, psychiatric patients are credible and reliable reporters of this information. This article summarizes studies that highlight the development, validation, and application of HRQoL measures in psychiatry. Thoughtful application of these tools in psychiatric research can provide a much-needed patient perspective in the future of comparative effectiveness research, patient-centered outcomes research, and clinical care.

NASCOM network: Ground communications reliability report

NASA Technical Reports Server (NTRS)

1973-01-01

A reliability performance analysis of the NASCOM Network circuits is reported. Network performance narrative summary is presented to include significant changes in circuit configurations, current figures, and trends in each trouble category with notable circuit totals specified. Lost time and interruption tables listing circuits which were affected by outages showing their totals category are submitted. A special analysis of circuits with low reliabilities is developed with tables depicting the performance and graphs for individual reliabilities.

Reliability reporting across studies using the Buss Durkee Hostility Inventory.

PubMed

Vassar, Matt; Hale, William

2009-01-01

Empirical research on anger and hostility has pervaded the academic literature for more than 50 years. Accurate measurement of anger/hostility and subsequent interpretation of results requires that the instruments yield strong psychometric properties. For consistent measurement, reliability estimates must be calculated with each administration, because changes in sample characteristics may alter the scale's ability to generate reliable scores. Therefore, the present study was designed to address reliability reporting practices for a widely used anger assessment, the Buss Durkee Hostility Inventory (BDHI). Of the 250 published articles reviewed, 11.2% calculated and presented reliability estimates for the data at hand, 6.8% cited estimates from a previous study, and 77.1% made no mention of score reliability. Mean alpha estimates of scores for BDHI subscales generally fell below acceptable standards. Additionally, no detectable pattern was found between reporting practices and publication year or journal prestige. Areas for future research are also discussed.

Detection and Characterization of Engineered Nanomaterials in the Environment: Current State-of-the-art and Future Directions Report, Annotated Bibliography, and Image Library

EPA Science Inventory

The increasing manufacture and implementation of engineered nanomaterials (ENMs) will continue to lead to the release of these materials into the environment. Reliably assessing the environmental exposure risk of ENMs will depend highly on the ability to quantify and characterize...

Predicting Human Thermal Comfort in Automobiles

DOE Office of Scientific and Technical Information (OSTI.GOV)

Rugh, J.; Bharathan, D.; Chaney, L.

The objects of this report are to: (1) increase national energy security by reducing fuel use for vehicle climate control systems; (2) show/demonstrate technology that can reduce the fuel used by LD vehicles' ancillary systems; and (3) develop tools to evaluate the effectiveness of energy-efficient systems including--comfort, cost, practicality, ease-of-use, and reliability.

The reliability and validity of patient-reported chronic obstructive pulmonary disease exacerbations.

PubMed

Mohan, Arjun; Sethi, Sanjay

2014-03-01

Despite the increasing awareness of their pathogenesis and clinical consequences, research on and clinical management of acute exacerbations of chronic obstructive lung disease (AECOPDs) have been hindered by the lack of a consistent and reliable definition. Symptom-based definitions of exacerbations are sensitive to events and account for unreported exacerbations. Event (healthcare utilization)-based definitions are somewhat more definitive but miss unreported events. Objective quantification of symptoms in AECOPD is now possible with the development of the Exacerbations of Chronic Obstructive Pulmonary Disease Tool (EXACT-PRO), a patient-reported outcome (PRO) measure. Several studies have revealed that unreported AECOPDs are more frequent than reported events and are associated with long-term adverse consequences. New antibiotic development for AECOPD has been hampered by the lack of validated measures for resolution of exacerbations. As a result of these observations, a unique collaborative effort between academia, industry and regulatory agencies resulted in the development of the EXACT-PRO. It consists of 14 questions that generate a score between 0 and 100, and it has been shown to have excellent reliability and validity. In the absence of a reliable biomarker, the definition and measurement of exacerbations has been subjective and imprecise. PRO measures such as EXACT can provide much needed objectivity in assessing symptom-defined exacerbations, which may translate into a uniform outcome measure in clinical trials. With further development and validation, it may have a role in clinical practice in the earlier detection of exacerbations, stratification of an exacerbation severity and the assessment of clinical response to treatment.

Sexual behaviors among club drug users: prevalence and reliability

PubMed Central

Shacham, Enbal; Cottler, Linda B.

2013-01-01

HIV prevention efforts require a focus on reducing high risk sexual behavior. Because these are self-reported, assessments that reduce memory bias and improve elicitation of data are needed. As part of a multi-site psychometric study of club drug use, abuse, and dependence, data were collected with a test-retest design that measured the reliability of the Washington University Risk Behavior Assessment for Club Drugs (WU-RBA-CD). Reliability was assessed separately by sex via kappa coefficients and intraclass correlation coefficients (ICC); z tests compared coefficients by sex. A total of 603 participants were interviewed by independent assessors with 5 days in between interviews. Reliability for all 51 items of the sexual activity section of the WU-RBA-CD ranged from .23 to 1.00; 71% (n = 36) of items resulted in moderate to high reliability (.55–1.00). Number of lifetime sex partners was consistently reported for same-sex partners for both men and women and opposite-sex partners. Items with high reliability included reporting ever being under the influence of ecstasy (.87) or GHB (.87) while having sex. Items with lower reliability included those that queried the determinants of condom use (.45–.82) and about behaviors and attitudes experienced while using drugs (.23–.87). Very few sex differences were revealed in the reliability of reported sexual activities. Overall, the WU-RBA-CD performed with fairly high reliability rates. Assessing situations of when, how, and why individuals use condoms may offer the clearest evaluation of determinants of sexual behaviors, yet those items are not as reliable. PMID:19757011

[Is the renal excretion of orally applied diatrizoate (Gastrografin) a reliable marker of gastrointestinal perforation or dehiscence of a gastrointestinal anastomosis?].

PubMed

Born, M; Axmann, C; Kader, R; von Falkenhausen, M; Manka, C; Willinek, W A; Schild, H

2004-11-01

Renal excretion of orally or rectally applied Gastrografin is reported to be a reliable indicator of a perforation or a postoperative anastomotic dehiscence of the GI-tract. The study was conducted to determine whether increased attenuation of the urine measured by CT after oral or rectal application of Gastrografin can give reliable evidence of any leakage from the gastrointestinal tract. Urine samples of 33 patients, who underwent a Gastrografin-enhanced fluoroscopic examination of the esophagus or the GI-tract for different clinical reasons, were examined by CT. The samples had been taken immediately before and 60 to 90 minutes after application of 100 ml Gastrografin. The results were compared with those of 5 healthy volunteers, who took urine samples before, 30, 60, 90, and 120 minutes after drinking 100 ml of Gastrografin. Maximal attenuation of the volunteers' urine samples was achieved 60 to 90 minutes after Gastrografin application with a mean of 50 Hounsfield units (HU), SD = 17 HU. The urine of three patients with radiologically proven fistula or dehiscence of a GI-tract anastomosis had no relevant increase in attenuation. Three other cases without any clinical or radiological evidence of an anastomotic leak had a substantial increase in the attenuation of the urine probes (87, 110, and 290 HU, respectively). The CT-measured urine samples as evidence of renal excretion of orally or rectally applied Gastrografin are not reliable for the detection of leaks from the GI-tract.

Rate of deaths due to child abuse and neglect in children 0-3 years of age in Germany.

PubMed

Banaschak, Sibylle; Janßen, Katharina; Schulte, Babette; Rothschild, Markus A

2015-09-01

In recent years, increasing attention has been paid to the issue of (fatal) child abuse and neglect, largely due to the media attention garnered by some headline-grabbing cases. If media statements are to be believed, such cases may be an increasing phenomenon. With these published accounts in mind, publicly available statistics should be analysed with respect to the question of whether reliable statements can be formulated based on these figures. It is hypothesised that certain data, e.g., the Innocenti report published by UNICEF in 2003, may be based on unreliable data sources. For this reason, the generation of such data, and the reliability of the data itself, should also be discussed. Our focus was on publicly available German mortality and police crime statistics (Polizeiliche Kriminalstatistik). These data were classified with respect to child age, data origin, and cause of death (murder, culpable homicide, etc.). In our opinion, the available data could not be considered in formulating reliable scientific statements about fatal child abuse and neglect, given the lack of detail and the flawed nature of the basic data. Increasing the number of autopsies of children 0-3 years of age should be considered as a means to ensure the capture of valid, practical, and reliable data. This could bring about some enlightenment and assist in the development of preemptive strategies to decrease the incidence of (fatal) child abuse and neglect.

Reliability of Real-time Ultrasound Imaging for the Assessment of Trunk Stabilizer Muscles: A Systematic Review of the Literature.

PubMed

Taghipour, Morteza; Mohseni-Bandpei, Mohammad Ali; Behtash, Hamid; Abdollahi, Iraj; Rajabzadeh, Fatemeh; Pourahmadi, Mohammad Reza; Emami, Mahnaz

2018-04-24

Rehabilitative ultrasound (US) imaging is one of the popular methods for investigating muscle morphologic characteristics and dimensions in recent years. The reliability of this method has been investigated in different studies. As studies have been performed with different designs and quality, reported values of rehabilitative US have a wide range. The objective of this study was to systematically review the literature conducted on the reliability of rehabilitative US imaging for the assessment of deep abdominal and lumbar trunk muscle dimensions. The PubMed/MEDLINE, Scopus, Google Scholar, Science Direct, Embase, Physiotherapy Evidence, Ovid, and CINAHL databases were searched to identify original research articles conducted on the reliability of rehabilitative US imaging published from June 2007 to August 2017. The articles were qualitatively assessed; reliability data were extracted; and the methodological quality was evaluated by 2 independent reviewers. Of the 26 included studies, 16 were considered of high methodological quality. Except for 2 studies, all high-quality studies reported intraclass correlation coefficients (ICCs) for intra-rater reliability of 0.70 or greater. Also, ICCs reported for inter-rater reliability in high-quality studies were generally greater than 0.70. Among low-quality studies, reported ICCs ranged from 0.26 to 0.99 and 0.68 to 0.97 for intra- and inter-rater reliability, respectively. Also, the reported standard error of measurement and minimal detectable change for rehabilitative US were generally in an acceptable range. Generally, the results of the reviewed studies indicate that rehabilitative US imaging has good levels of both inter- and intra-rater reliability. © 2018 by the American Institute of Ultrasound in Medicine.

Seeking high reliability in primary care: Leadership, tools, and organization.

PubMed

Weaver, Robert R

2015-01-01

Leaders in health care increasingly recognize that improving health care quality and safety requires developing an organizational culture that fosters high reliability and continuous process improvement. For various reasons, a reliability-seeking culture is lacking in most health care settings. Developing a reliability-seeking culture requires leaders' sustained commitment to reliability principles using key mechanisms to embed those principles widely in the organization. The aim of this study was to examine how key mechanisms used by a primary care practice (PCP) might foster a reliability-seeking, system-oriented organizational culture. A case study approach was used to investigate the PCP's reliability culture. The study examined four cultural artifacts used to embed reliability-seeking principles across the organization: leadership statements, decision support tools, and two organizational processes. To decipher their effects on reliability, the study relied on observations of work patterns and the tools' use, interactions during morning huddles and process improvement meetings, interviews with clinical and office staff, and a "collective mindfulness" questionnaire. The five reliability principles framed the data analysis. Leadership statements articulated principles that oriented the PCP toward a reliability-seeking culture of care. Reliability principles became embedded in the everyday discourse and actions through the use of "problem knowledge coupler" decision support tools and daily "huddles." Practitioners and staff were encouraged to report unexpected events or close calls that arose and which often initiated a formal "process change" used to adjust routines and prevent adverse events from recurring. Activities that foster reliable patient care became part of the taken-for-granted routine at the PCP. The analysis illustrates the role leadership, tools, and organizational processes play in developing and embedding a reliable-seeking culture across an organization. Progress toward a reliability-seeking, system-oriented approach to care remains ongoing, and movement in that direction requires deliberate and sustained effort by committed leaders in health care.

The Screening Test for Emotional Problems-Parent Report (STEP-P): Studies of Reliability and Validity

ERIC Educational Resources Information Center

Erford, Bradley T.; Alsamadi, Silvana C.

2012-01-01

Score reliability and validity of parent responses concerning their 10- to 17-year-old students were analyzed using the Screening Test for Emotional Problems-Parent Report (STEP-P), which assesses a variety of emotional problems classified under the Individuals with Disabilities Education Improvement Act. Score reliability, convergent, and…

Reliability of Wireless Sensor Networks

PubMed Central

Dâmaso, Antônio; Rosa, Nelson; Maciel, Paulo

2014-01-01

Wireless Sensor Networks (WSNs) consist of hundreds or thousands of sensor nodes with limited processing, storage, and battery capabilities. There are several strategies to reduce the power consumption of WSN nodes (by increasing the network lifetime) and increase the reliability of the network (by improving the WSN Quality of Service). However, there is an inherent conflict between power consumption and reliability: an increase in reliability usually leads to an increase in power consumption. For example, routing algorithms can send the same packet though different paths (multipath strategy), which it is important for reliability, but they significantly increase the WSN power consumption. In this context, this paper proposes a model for evaluating the reliability of WSNs considering the battery level as a key factor. Moreover, this model is based on routing algorithms used by WSNs. In order to evaluate the proposed models, three scenarios were considered to show the impact of the power consumption on the reliability of WSNs. PMID:25157553

Reliability of intracerebral hemorrhage classification systems: A systematic review.

PubMed

Rannikmäe, Kristiina; Woodfield, Rebecca; Anderson, Craig S; Charidimou, Andreas; Chiewvit, Pipat; Greenberg, Steven M; Jeng, Jiann-Shing; Meretoja, Atte; Palm, Frederic; Putaala, Jukka; Rinkel, Gabriel Je; Rosand, Jonathan; Rost, Natalia S; Strbian, Daniel; Tatlisumak, Turgut; Tsai, Chung-Fen; Wermer, Marieke Jh; Werring, David; Yeh, Shin-Joe; Al-Shahi Salman, Rustam; Sudlow, Cathie Lm

2016-08-01

Accurately distinguishing non-traumatic intracerebral hemorrhage (ICH) subtypes is important since they may have different risk factors, causal pathways, management, and prognosis. We systematically assessed the inter- and intra-rater reliability of ICH classification systems. We sought all available reliability assessments of anatomical and mechanistic ICH classification systems from electronic databases and personal contacts until October 2014. We assessed included studies' characteristics, reporting quality and potential for bias; summarized reliability with kappa value forest plots; and performed meta-analyses of the proportion of cases classified into each subtype. We included 8 of 2152 studies identified. Inter- and intra-rater reliabilities were substantial to perfect for anatomical and mechanistic systems (inter-rater kappa values: anatomical 0.78-0.97 [six studies, 518 cases], mechanistic 0.89-0.93 [three studies, 510 cases]; intra-rater kappas: anatomical 0.80-1 [three studies, 137 cases], mechanistic 0.92-0.93 [two studies, 368 cases]). Reporting quality varied but no study fulfilled all criteria and none was free from potential bias. All reliability studies were performed with experienced raters in specialist centers. Proportions of ICH subtypes were largely consistent with previous reports suggesting that included studies are appropriately representative. Reliability of existing classification systems appears excellent but is unknown outside specialist centers with experienced raters. Future reliability comparisons should be facilitated by studies following recently published reporting guidelines. © 2016 World Stroke Organization.

Wind turbine reliability database update.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Peters, Valerie A.; Hill, Roger Ray; Stinebaugh, Jennifer A.

2009-03-01

This report documents the status of the Sandia National Laboratories' Wind Plant Reliability Database. Included in this report are updates on the form and contents of the Database, which stems from a fivestep process of data partnerships, data definition and transfer, data formatting and normalization, analysis, and reporting. Selected observations are also reported.

Examining the accuracy of students' self-reported academic grades from a correlational and a discrepancy perspective: Evidence from a longitudinal study.

PubMed

Sticca, Fabio; Goetz, Thomas; Bieg, Madeleine; Hall, Nathan C; Eberle, Franz; Haag, Ludwig

2017-01-01

The present longitudinal study examined the reliability of self-reported academic grades across three phases in four subject domains for a sample of 916 high-school students. Self-reported grades were found to be highly positively correlated with actual grades in all academic subjects and across grades 9 to 11 underscoring the reliability of self-reported grades as an achievement indicator. Reliability of self-reported grades was found to differ across subject areas (e.g., mathematics self-reports more reliable than language studies), with a slight yet consistent tendency to over-report achievement levels also observed across grade levels and academic subjects. Overall, the absolute value of over- and underreporting was low and these patterns were not found to differ between mathematics and verbal subjects. In sum, study findings demonstrate the consistent predictive utility of students' self-reported achievement across grade levels and subject areas with the observed tendency to over-report academic grades and slight differences between domains nonetheless warranting consideration in future education research.

Examining the accuracy of students’ self-reported academic grades from a correlational and a discrepancy perspective: Evidence from a longitudinal study

PubMed Central

Goetz, Thomas

2017-01-01

The present longitudinal study examined the reliability of self-reported academic grades across three phases in four subject domains for a sample of 916 high-school students. Self-reported grades were found to be highly positively correlated with actual grades in all academic subjects and across grades 9 to 11 underscoring the reliability of self-reported grades as an achievement indicator. Reliability of self-reported grades was found to differ across subject areas (e.g., mathematics self-reports more reliable than language studies), with a slight yet consistent tendency to over-report achievement levels also observed across grade levels and academic subjects. Overall, the absolute value of over- and underreporting was low and these patterns were not found to differ between mathematics and verbal subjects. In sum, study findings demonstrate the consistent predictive utility of students’ self-reported achievement across grade levels and subject areas with the observed tendency to over-report academic grades and slight differences between domains nonetheless warranting consideration in future education research. PMID:29112979

High-Reliability Pump Module for Non-Planar Ring Oscillator Laser

NASA Technical Reports Server (NTRS)

Liu, Duncan T.; Qiu, Yueming; Wilson, Daniel W.; Dubovitsky, Serge; Forouhar, Siamak

2007-01-01

We propose and have demonstrated a prototype high-reliability pump module for pumping a Non-Planar Ring Oscillator (NPRO) laser suitable for space missions. The pump module consists of multiple fiber-coupled single-mode laser diodes and a fiber array micro-lens array based fiber combiner. The reported Single-Mode laser diode combiner laser pump module (LPM) provides a higher normalized brightness at the combined beam than multimode laser diode based LPMs. A higher brightness from the pump source is essential for efficient NPRO laser pumping and leads to higher reliability because higher efficiency requires a lower operating power for the laser diodes, which in turn increases the reliability and lifetime of the laser diodes. Single-mode laser diodes with Fiber Bragg Grating (FBG) stabilized wavelength permit the pump module to be operated without a thermal electric cooler (TEC) and this further improves the overall reliability of the pump module. The single-mode laser diode LPM is scalable in terms of the number of pump diodes and is capable of combining hundreds of fiber-coupled laser diodes. In the proof-of-concept demonstration, an e-beam written diffractive micro lens array, a custom fiber array, commercial 808nm single mode laser diodes, and a custom NPRO laser head are used. The reliability of the proposed LPM is discussed.

Evaluating the Performance of the IEEE Standard 1366 Method for Identifying Major Event Days

DOE Office of Scientific and Technical Information (OSTI.GOV)

Eto, Joseph H.; LaCommare, Kristina Hamachi; Sohn, Michael D.

IEEE Standard 1366 offers a method for segmenting reliability performance data to isolate the effects of major events from the underlying year-to-year trends in reliability. Recent analysis by the IEEE Distribution Reliability Working Group (DRWG) has found that reliability performance of some utilities differs from the expectations that helped guide the development of the Standard 1366 method. This paper proposes quantitative metrics to evaluate the performance of the Standard 1366 method in identifying major events and in reducing year-to-year variability in utility reliability. The metrics are applied to a large sample of utility-reported reliability data to assess performance of themore » method with alternative specifications that have been considered by the DRWG. We find that none of the alternatives perform uniformly 'better' than the current Standard 1366 method. That is, none of the modifications uniformly lowers the year-to-year variability in System Average Interruption Duration Index without major events. Instead, for any given alternative, while it may lower the value of this metric for some utilities, it also increases it for other utilities (sometimes dramatically). Thus, we illustrate some of the trade-offs that must be considered in using the Standard 1366 method and highlight the usefulness of the metrics we have proposed in conducting these evaluations.« less

On the reliability of seasonal climate forecasts

PubMed Central

Weisheimer, A.; Palmer, T. N.

2014-01-01

Seasonal climate forecasts are being used increasingly across a range of application sectors. A recent UK governmental report asked: how good are seasonal forecasts on a scale of 1–5 (where 5 is very good), and how good can we expect them to be in 30 years time? Seasonal forecasts are made from ensembles of integrations of numerical models of climate. We argue that ‘goodness’ should be assessed first and foremost in terms of the probabilistic reliability of these ensemble-based forecasts; reliable inputs are essential for any forecast-based decision-making. We propose that a ‘5’ should be reserved for systems that are not only reliable overall, but where, in particular, small ensemble spread is a reliable indicator of low ensemble forecast error. We study the reliability of regional temperature and precipitation forecasts of the current operational seasonal forecast system of the European Centre for Medium-Range Weather Forecasts, universally regarded as one of the world-leading operational institutes producing seasonal climate forecasts. A wide range of ‘goodness’ rankings, depending on region and variable (with summer forecasts of rainfall over Northern Europe performing exceptionally poorly) is found. Finally, we discuss the prospects of reaching ‘5’ across all regions and variables in 30 years time. PMID:24789559

A systematic review of the reliability and validity of discrete choice experiments in valuing non-market environmental goods.

PubMed

Rakotonarivo, O Sarobidy; Schaafsma, Marije; Hockley, Neal

2016-12-01

While discrete choice experiments (DCEs) are increasingly used in the field of environmental valuation, they remain controversial because of their hypothetical nature and the contested reliability and validity of their results. We systematically reviewed evidence on the validity and reliability of environmental DCEs from the past thirteen years (Jan 2003-February 2016). 107 articles met our inclusion criteria. These studies provide limited and mixed evidence of the reliability and validity of DCE. Valuation results were susceptible to small changes in survey design in 45% of outcomes reporting reliability measures. DCE results were generally consistent with those of other stated preference techniques (convergent validity), but hypothetical bias was common. Evidence supporting theoretical validity (consistency with assumptions of rational choice theory) was limited. In content validity tests, 2-90% of respondents protested against a feature of the survey, and a considerable proportion found DCEs to be incomprehensible or inconsequential (17-40% and 10-62% respectively). DCE remains useful for non-market valuation, but its results should be used with caution. Given the sparse and inconclusive evidence base, we recommend that tests of reliability and validity are more routinely integrated into DCE studies and suggest how this might be achieved. Copyright © 2016 The Authors. Published by Elsevier Ltd.. All rights reserved.

Evolution of Wholesale Electricity Market Design with Increasing Levels of Renewable Generation

DOE Office of Scientific and Technical Information (OSTI.GOV)

Ela, E.; Milligan, M.; Bloom, A.

2014-09-01

Variable generation such as wind and photovoltaic solar power has increased substantially in recent years. Variable generation has unique characteristics compared to the traditional technologies that supply energy in the wholesale electricity markets. These characteristics create unique challenges in planning and operating the power system, and they can also influence the performance and outcomes from electricity markets. This report focuses on two particular issues related to market design: revenue sufficiency for long-term reliability and incentivizing flexibility in short-term operations. The report provides an overview of current design and some designs that have been proposed by industry or researchers.

Exploring Differences in Measurement and Reporting of Classroom Observation Inter-Rater Reliability

ERIC Educational Resources Information Center

Wilhelm, Anne Garrison; Gillespie Rouse, Amy; Jones, Francesca

2018-01-01

Although inter-rater reliability is an important aspect of using observational instruments, it has received little theoretical attention. In this article, we offer some guidance for practitioners and consumers of classroom observations so that they can make decisions about inter-rater reliability, both for study design and in the reporting of data…

Reliability and cost analysis methods

NASA Technical Reports Server (NTRS)

Suich, Ronald C.

1991-01-01

In the design phase of a system, how does a design engineer or manager choose between a subsystem with .990 reliability and a more costly subsystem with .995 reliability? When is the increased cost justified? High reliability is not necessarily an end in itself but may be desirable in order to reduce the expected cost due to subsystem failure. However, this may not be the wisest use of funds since the expected cost due to subsystem failure is not the only cost involved. The subsystem itself may be very costly. We should not consider either the cost of the subsystem or the expected cost due to subsystem failure separately but should minimize the total of the two costs, i.e., the total of the cost of the subsystem plus the expected cost due to subsystem failure. This final report discusses the Combined Analysis of Reliability, Redundancy, and Cost (CARRAC) methods which were developed under Grant Number NAG 3-1100 from the NASA Lewis Research Center. CARRAC methods and a CARRAC computer program employ five models which can be used to cover a wide range of problems. The models contain an option which can include repair of failed modules.

Reliability and Validity of Prototype Diagnosis for Adolescent Psychopathology.

PubMed

Haggerty, Greg; Zodan, Jennifer; Mehra, Ashwin; Zubair, Ayyan; Ghosh, Krishnendu; Siefert, Caleb J; Sinclair, Samuel J; DeFife, Jared

2016-04-01

The current study investigated the interrater reliability and validity of prototype ratings of 5 common adolescent psychiatric disorders: attention-deficit/hyperactivity disorder, conduct disorder, major depressive disorder, generalized anxiety disorder, and posttraumatic stress disorder. One hundred fifty-seven adolescent inpatient participants consented to participate in this study. We compared ratings from 2 inpatient clinicians, blinded to each other's ratings and patient measures, after their separate initial diagnostic interview to assess interrater reliability. Prototype ratings completed by clinicians after their initial diagnostic interview with adolescent inpatients and outpatients were compared with patient-reported behavior problems and parents' report of their child's behavioral problems. Prototype ratings demonstrated good interrater reliability. Clinicians' prototype ratings showed predicted relationships with patient-reported behavior problems and parent-reported behavior problems. Prototype matching seems to be a possible alternative for psychiatric diagnosis. Prototype ratings showed good interrater reliability based on clinicians unique experiences with the patient (as opposed to video-/audio-recorded material) with no training.

Translation and Cross-Cultural Adaptation of Assessment Instruments Used in Psychological Research with Children and Families

ERIC Educational Resources Information Center

van Widenfelt, Brigit M.; Treffers, Philip D. A.; de Beurs, Edwin; Siebelink, Bart M.; Koudijs, Els

2005-01-01

With the increased globalization of psychology and related fields, having reliable and valid measures that can be used in a number of languages and cultures is critical. Few guidelines or standards have been established in psychology for the translation and cultural adaptation of instruments. Usually little is reported in research publications…

Development and Validation of the Guided Group Discussion Self-Estimate Inventory (GGD-SEI).

ERIC Educational Resources Information Center

Martin, David; Campbell, Bill

1998-01-01

A 19-item self-report measure was designed to promote increased self-awareness of a group leader's perceived ability to facilitate small group discussion. Results of analysis show high reliability and validity. The instrument, developed for use within education and training settings, provides a useful measure of guided small-group discussion…

Community-Based Broadband Solutions: The Benefits of Competition and Choice for Community Development and Highspeed Internet Access

ERIC Educational Resources Information Center

Executive Office of the President, 2015

2015-01-01

Affordable, reliable access to high speed broadband is critical to U.S. economic growth and competitiveness. Upgrading to higher-speed broadband lets consumers use the Internet in new ways, increases the productivity of American individuals and businesses, and drives innovation throughout the digital ecosystem. As this report describes, while the…

42 CFR 493.1282 - Standard: Corrective actions.

Code of Federal Regulations, 2011 CFR

2011-10-01

... a manner that ensures accurate and reliable patient test results and reports. (b) The laboratory... action necessary to ensure the reporting of accurate and reliable patient test results. (3) The criteria...

Reliability at the lower limits of HIV-1 RNA quantification in clinical samples: a comparison of RT-PCR versus bDNA assays.

PubMed

Lubelchek, Ronald J; Max, Blake; Sandusky, Caroline J; Hota, Bala; Barker, David E

2009-06-23

To explore whether an assay change was responsible for an increasing proportion of patients with undetectable HIV viral loads at our urban HIV clinic, we selected highly stable patients, examining their viral loads before and after changing assays. We compared the proportion with detectable viremia during RT-PCR vs. bDNA periods. We selected patients with > or =1 viral loads assessed during both RT-PCR and bDNA periods. We included patients with stable CD4 counts, excluding patients with viral loads > or =1,000 copies/ml or any significant changes in therapy. Out of 4500 clinic patients, 419 patients (1588 viral loads) were included. 39% of viral loads were reported as detectable by RT-PCR vs. 5% reported as detectable by bDNA. The mean coefficient of variation was higher before vs. after assay change. We found an odds' ratio of 16.7 for having a viral load >75 copies/ml during the RT-PCR vs. bDNA periods. These data support previous reports, suggesting that bDNA may more reliably discriminate between viral suppression and low level viremia in stable patients on therapy. Low-level viremia, noted more with RT-PCR, may promote unneeded testing, while differences in viral load reliability may impact antiretroviral trial and quality assurance endpoints. Commonly used plasma separator tubes may differentially affect RT-PCR and bDNA results.

Reliability Analysis and Reliability-Based Design Optimization of Circular Composite Cylinders Under Axial Compression

NASA Technical Reports Server (NTRS)

Rais-Rohani, Masoud

2001-01-01

This report describes the preliminary results of an investigation on component reliability analysis and reliability-based design optimization of thin-walled circular composite cylinders with average diameter and average length of 15 inches. Structural reliability is based on axial buckling strength of the cylinder. Both Monte Carlo simulation and First Order Reliability Method are considered for reliability analysis with the latter incorporated into the reliability-based structural optimization problem. To improve the efficiency of reliability sensitivity analysis and design optimization solution, the buckling strength of the cylinder is estimated using a second-order response surface model. The sensitivity of the reliability index with respect to the mean and standard deviation of each random variable is calculated and compared. The reliability index is found to be extremely sensitive to the applied load and elastic modulus of the material in the fiber direction. The cylinder diameter was found to have the third highest impact on the reliability index. Also the uncertainty in the applied load, captured by examining different values for its coefficient of variation, is found to have a large influence on cylinder reliability. The optimization problem for minimum weight is solved subject to a design constraint on element reliability index. The methodology, solution procedure and optimization results are included in this report.

Identification of Extracellular Segments by Mass Spectrometry Improves Topology Prediction of Transmembrane Proteins.

PubMed

Langó, Tamás; Róna, Gergely; Hunyadi-Gulyás, Éva; Turiák, Lilla; Varga, Julia; Dobson, László; Várady, György; Drahos, László; Vértessy, Beáta G; Medzihradszky, Katalin F; Szakács, Gergely; Tusnády, Gábor E

2017-02-13

Transmembrane proteins play crucial role in signaling, ion transport, nutrient uptake, as well as in maintaining the dynamic equilibrium between the internal and external environment of cells. Despite their important biological functions and abundance, less than 2% of all determined structures are transmembrane proteins. Given the persisting technical difficulties associated with high resolution structure determination of transmembrane proteins, additional methods, including computational and experimental techniques remain vital in promoting our understanding of their topologies, 3D structures, functions and interactions. Here we report a method for the high-throughput determination of extracellular segments of transmembrane proteins based on the identification of surface labeled and biotin captured peptide fragments by LC/MS/MS. We show that reliable identification of extracellular protein segments increases the accuracy and reliability of existing topology prediction algorithms. Using the experimental topology data as constraints, our improved prediction tool provides accurate and reliable topology models for hundreds of human transmembrane proteins.

Technical Concept Document. Central Archive for Reusable Defense Software (CARDS)

DTIC Science & Technology

1994-02-28

FeNbry 1994 INFORMAL TECHNICAL REPORT For The SOFTWARE TECHNOLOGY FOR ADAPTABLE, RELIABLE SYSTEMS (STARS) Technical Concept Document Central Archive for...February 1994 INFORMAL TECHNICAL REPORT For The SOFTWARE TECHNOLOGY FOR ADAPTABLE, RELIABLE SYSTEMS (STARS) Technical Concept Document Central Archive...accordance with the DFARS Special Works Clause Developed by: This document, developed under the Software Technology for Adaptable, Reliable Systems

Dynamic MRI to quantify musculoskeletal motion: A systematic review of concurrent validity and reliability, and perspectives for evaluation of musculoskeletal disorders.

PubMed

Borotikar, Bhushan; Lempereur, Mathieu; Lelievre, Mathieu; Burdin, Valérie; Ben Salem, Douraied; Brochard, Sylvain

2017-01-01

To report evidence for the concurrent validity and reliability of dynamic MRI techniques to evaluate in vivo joint and muscle mechanics, and to propose recommendations for their use in the assessment of normal and impaired musculoskeletal function. The search was conducted on articles published in Web of science, PubMed, Scopus, Academic search Premier, and Cochrane Library between 1990 and August 2017. Studies that reported the concurrent validity and/or reliability of dynamic MRI techniques for in vivo evaluation of joint or muscle mechanics were included after assessment by two independent reviewers. Selected articles were assessed using an adapted quality assessment tool and a data extraction process. Results for concurrent validity and reliability were categorized as poor, moderate, or excellent. Twenty articles fulfilled the inclusion criteria with a mean quality assessment score of 66% (±10.4%). Concurrent validity and/or reliability of eight dynamic MRI techniques were reported, with the knee being the most evaluated joint (seven studies). Moderate to excellent concurrent validity and reliability were reported for seven out of eight dynamic MRI techniques. Cine phase contrast and real-time MRI appeared to be the most valid and reliable techniques to evaluate joint motion, and spin tag for muscle motion. Dynamic MRI techniques are promising for the in vivo evaluation of musculoskeletal mechanics; however results should be evaluated with caution since validity and reliability have not been determined for all joints and muscles, nor for many pathological conditions.

Validity and reliability of the semi-quantitative self-report Home Food Availability Inventory Checklist (HFAI-C) in White and South Asian populations.

PubMed

Bryant, Maria; LeCroy, Madison; Sahota, Pinki; Cai, Jianwen; Stevens, June

2016-05-04

Despite interest in the importance of the home food environment and its potential influence on children's diets and social norms, there remain few self-report checklist methods that have been validated against the gold standard of researcher-conducted inventories. This study aimed to assess the criterion validity and reliability of the 'Home Food Availability Inventory Checklist' (HFAI-C), a 39-item checklist including categories of fruit, vegetables, snacks and drinks. The HFAI-C was completed by 97 participants of White and Pakistani origin in the UK. Validity was determined by comparing participant-reported HFAI-C responses to data from researcher observations of home food availability using PABAK and weighted kappa statistics. The validity of measuring the amount of items (in addition to presence/absence) available was also determined. Test-retest reliability compared repeated administrations of the HFAI-C using intra-class correlation coefficients. Validity and reliability was fair to moderate overall. For validity, the average category-level PABAK ranged from 0.31 (95% CI: 0.25, 0.37) for vegetables to 0.44 (95% CI: 0.40, 0.49) for fruits. Assessment of the presence/absence of items demonstrated higher validity compared to quantity measurements. Reliability was increased when the HFAI-C was repeated close to the time of the first administration. For example, ICCs for reliability of the measurement of fruits were 0.52 (95%CI: 0.47, 0.56) if re-administered within 5 months, 0.58 (95% CI: 0.51, 0.64) within 30 days and 0.97 (95%CI: 0.94, 1.00) if re-administered on the same day. Overall, the HFAI-C demonstrated fair to moderate validity and reliability in a population of White and South Asian participants. This evaluation is consistent with previous work on other checklists in less diverse, more affluent populations. Our research supports the use of the HFAI-C as a useful, albeit imperfect, representation of researcher-conducted inventories. The feasibility of collecting information using the HFAI-C in large, multi-ethnic samples can facilitate examination of home food availability in relation to exposures such as ethnicity and outcomes including behavioural, social and health outcomes. Future work using the HFAI-C could provide important insights into a modifiable influence with potential to impact health.

Use of a structured functional evaluation process for independent medical evaluations of claimants presenting with disabling mental illness: rationale and design for a multi-center reliability study.

PubMed

Bachmann, Monica; de Boer, Wout; Schandelmaier, Stefan; Leibold, Andrea; Marelli, Renato; Jeger, Joerg; Hoffmann-Richter, Ulrike; Mager, Ralph; Schaad, Heinz; Zumbrunn, Thomas; Vogel, Nicole; Bänziger, Oskar; Busse, Jason W; Fischer, Katrin; Kunz, Regina

2016-07-29

Work capacity evaluations by independent medical experts are widely used to inform insurers whether injured or ill workers are capable of engaging in competitive employment. In many countries, evaluation processes lack a clearly structured approach, standardized instruments, and an explicit focus on claimants' functional abilities. Evaluation of subjective complaints, such as mental illness, present additional challenges in the determination of work capacity. We have therefore developed a process for functional evaluation of claimants with mental disorders which complements usual psychiatric evaluation. Here we report the design of a study to measure the reliability of our approach in determining work capacity among patients with mental illness applying for disability benefits. We will conduct a multi-center reliability study, in which 20 psychiatrists trained in our functional evaluation process will assess 30 claimants presenting with mental illness for eligibility to receive disability benefits [Reliability of Functional Evaluation in Psychiatry, RELY-study]. The functional evaluation process entails a five-step structured interview and a reporting instrument (Instrument of Functional Assessment in Psychiatry [IFAP]) to document the severity of work-related functional limitations. We will videotape all evaluations which will be viewed by three psychiatrists who will independently rate claimants' functional limitations. Our primary outcome measure is the evaluation of claimant's work capacity as a percentage (0 to 100 %), and our secondary outcomes are the 12 mental functions and 13 functional capacities assessed by the IFAP-instrument. Inter-rater reliability of four psychiatric experts will be explored using multilevel models to estimate the intraclass correlation coefficient (ICC). Additional analyses include subgroups according to mental disorder, the typicality of claimants, and claimant perceived fairness of the assessment process. We hypothesize that a structured functional approach will show moderate reliability (ICC ≥ 0.6) of psychiatric evaluation of work capacity. Enrollment of actual claimants with mental disorders referred for evaluation by disability/accident insurers will increase the external validity of our findings. Finding moderate levels of reliability, we will continue with a randomized trial to test the reliability of a structured functional approach versus evaluation-as-usual.

Trends in Education-Specific Life Expectancy, Data Quality, and Shifting Education Distributions: A Note on Recent Research.

PubMed

Hendi, Arun S

2017-06-01

Several recent articles have reported conflicting conclusions about educational differences in life expectancy, and this is partly due to the use of unreliable data subject to a numerator-denominator bias previously reported as ranging from 20 % to 40 %. This article presents estimates of life expectancy and lifespan variation by education in the United States using more reliable data from the National Health Interview Survey. Contrary to prior conclusions in the literature, I find that life expectancy increased or stagnated since 1990 among all education-race-sex groups except for non-Hispanic white women with less than a high school education; there has been a robust increase in life expectancy among white high school graduates and a smaller increase among black female high school graduates; lifespan variation did not increase appreciably among high school graduates; and lifespan variation plays a very limited role in explaining educational gradients in mortality. I also discuss the key role that educational expansion may play in driving future changes in mortality gradients. Because of shifting education distributions, within an education-specific synthetic cohort, older age groups are less negatively selected than younger age groups. We could thus expect a greater concentration of mortality at younger ages among people with a high school education or less, which would be reflected in increasing lifespan variability for this group. Future studies of educational gradients in mortality should use more reliable data and should be mindful of the effects of shifting education distributions.

10 CFR 712.22 - Hearing officer's report and recommendation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false Hearing officer's report and recommendation. 712.22 Section 712.22 Energy DEPARTMENT OF ENERGY HUMAN RELIABILITY PROGRAM Establishment of and Procedures for the Human Reliability Program Procedures § 712.22 Hearing officer's report and recommendation. Within...

Evaluation of deer-vehicle collision rates in West Virginia and a review of available mitigation techniques.

DOT National Transportation Integrated Search

2014-08-01

This project reviewed police crash reports involving deer and carcass data reported by the West Virginia Department : of Transportation from 2008-2012. The police crash reports were deemed the most reliable in terms of location : reliability and cons...

Accuracy and reliability of self-reported weight and height in the Sister Study

PubMed Central

Lin, Cynthia J; DeRoo, Lisa A; Jacobs, Sara R; Sandler, Dale P

2012-01-01

Objective To assess accuracy and reliability of self-reported weight and height and identify factors associated with reporting accuracy. Design Analysis of self-reported and measured weight and height from participants in the Sister Study (2003–2009), a nationwide cohort of 50,884 women aged 35–74 in the United States with a sister with breast cancer. Setting Weight and height were reported via computer-assisted telephone interview (CATI) and self-administered questionnaires, and measured by examiners. Subjects Early enrollees in the Sister Study. There were 18,639 women available for the accuracy analyses and 13,316 for the reliability analyses. Results Using weighted kappa statistics, comparisons were made between CATI responses and examiner measures to assess accuracy and CATI and questionnaire responses to assess reliability. Polytomous logistic regression evaluated factors associated with over- or under-reporting. Compared to measured values, agreement was 96% for reported height (±1 inch; weighted kappa 0.84) and 67% for weight (±3 pounds; weighted kappa 0.92). Obese women [body mass index (BMI) ≥30 kg/m2)] were more likely than normal weight women to under-report weight by ≥5% and underweight women (BMI <18.5 kg/m2) were more likely to over-report. Among normal and overweight women (18.5 kgm2≤ BMI <30 kgm2), weight cycling and lifetime weight difference ≥50 pounds were associated with over-reporting. Conclusions U.S. women in the Sister Study were reasonably reliable and accurate in reporting weight and height. Women with normal-range BMI reported most accurately. Overweight and obese women and those with weight fluctuations were less accurate, but even among obese women, few under-reported their weight by >10%. PMID:22152926

The Gross Motor Function Classification System Family Report Questionnaire: reliability between special-education teachers and caregivers.

PubMed

Ramrit, Sirinun; Yonglitthipagon, Ponlapat; Janyacharoen, Taweesak; Emasithi, Alongkot; Siritaratiwat, Wantana

2017-05-01

The aim of this study was to investigate the reliability of the Thai Gross Motor Function Classification System Family Report Questionnaire (GMFCS-FR) and the possibility of special-education teachers and caregivers in the community using this system in children with cerebral palsy (CP). The reliability was examined by two teachers and two caregivers who classified 21 children with CP aged 2 to 12 years. A GMFCS-FR workshop was organized for raters. The teachers and caregivers classified the mobility of 362 children. The rater reliability was analysed using the weighted kappa coefficient. The possibility of using the GMFCS-FR is reported. The reliability of using the GMFCS-FR in the community was analysed by the intraclass correlation coefficient. The intrarater reliability ranged from 0.91 to 1.00. The interrater reliability between teachers was 0.85 (95% confidence interval [CI] 0.69-0.97) and between caregivers was 0.84 (95% CI 0.70-0.97). Ninety-seven percent of raters used the Thai GMFCS-FR correctly. The overall intraclass correlation coefficient between raters was 0.90 (95% CI 0.88-0.92). The Thai GMFCS-FR is a reliable system for classifying the motor function of young children with CP by teachers and caregivers in the community. © 2016 Mac Keith Press.

Apollo experience report: Reliability and quality assurance

NASA Technical Reports Server (NTRS)

Sperber, K. P.

1973-01-01

The reliability of the Apollo spacecraft resulted from the application of proven reliability and quality techniques and from sound management, engineering, and manufacturing practices. Continual assessment of these techniques and practices was made during the program, and, when deficiencies were detected, adjustments were made and the deficiencies were effectively corrected. The most significant practices, deficiencies, adjustments, and experiences during the Apollo Program are described in this report. These experiences can be helpful in establishing an effective base on which to structure an efficient reliability and quality assurance effort for future space-flight programs.

Ceramic technology for advanced heat engines project. Semiannual progress report, October 1985-March 1986

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1986-08-01

Significant accomplishments in fabricating cermaic components for the Department of Energy (DOE), National Aeronautics and Space Administration (NASA), and Department of Defense (DOD) advanced heat engine programs have provided evidence that the operation of ceramic parts in high-temperature engine environments is feasible. However, additional research is needed in materials and processing development, design methodology, and data base and life prediction. An assessment of needs was completed, and a five-year project plan was developed with extensive input from private industry. The objective of the project is to develop the industrial technology base required for reliable ceramics for application in advanced automotivemore » heat engines. The project approach includes determining the mechanisms controlling reliability, improving processes for fabricating existing ceramics, developing new materials with increased reliability, and testing these materials in simulated engine environments to confirm reliability. although this is a generic materials project, the focus is on structural ceramics for advanced gas turbine and diesel engines, ceramic bearings and attachments, and ceramic coatings for thermal barrier and wear applications in these engines.« less

NATO IST 124 Experimentation Instructions

DTIC Science & Technology

2016-11-10

more reliable and predictable network performance through adaptive and efficient control schemes . This report provides guidance and instructions for...tactical heterogeneous networks for more reliable and predictable network performance through adaptive and efficient control schemes . This report

Selection and Reporting of Statistical Methods to Assess Reliability of a Diagnostic Test: Conformity to Recommended Methods in a Peer-Reviewed Journal

PubMed Central

Park, Ji Eun; Han, Kyunghwa; Sung, Yu Sub; Chung, Mi Sun; Koo, Hyun Jung; Yoon, Hee Mang; Choi, Young Jun; Lee, Seung Soo; Kim, Kyung Won; Shin, Youngbin; An, Suah; Cho, Hyo-Min

2017-01-01

Objective To evaluate the frequency and adequacy of statistical analyses in a general radiology journal when reporting a reliability analysis for a diagnostic test. Materials and Methods Sixty-three studies of diagnostic test accuracy (DTA) and 36 studies reporting reliability analyses published in the Korean Journal of Radiology between 2012 and 2016 were analyzed. Studies were judged using the methodological guidelines of the Radiological Society of North America-Quantitative Imaging Biomarkers Alliance (RSNA-QIBA), and COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative. DTA studies were evaluated by nine editorial board members of the journal. Reliability studies were evaluated by study reviewers experienced with reliability analysis. Results Thirty-one (49.2%) of the 63 DTA studies did not include a reliability analysis when deemed necessary. Among the 36 reliability studies, proper statistical methods were used in all (5/5) studies dealing with dichotomous/nominal data, 46.7% (7/15) of studies dealing with ordinal data, and 95.2% (20/21) of studies dealing with continuous data. Statistical methods were described in sufficient detail regarding weighted kappa in 28.6% (2/7) of studies and regarding the model and assumptions of intraclass correlation coefficient in 35.3% (6/17) and 29.4% (5/17) of studies, respectively. Reliability parameters were used as if they were agreement parameters in 23.1% (3/13) of studies. Reproducibility and repeatability were used incorrectly in 20% (3/15) of studies. Conclusion Greater attention to the importance of reporting reliability, thorough description of the related statistical methods, efforts not to neglect agreement parameters, and better use of relevant terminology is necessary. PMID:29089821

Developing an Internet-based Communication System for Residency Training Programs

PubMed Central

Fortin, Auguste H; Luzzi, Kristina; Galaty, Leslie; Wong, Jeffrey G; Huot, Stephen J

2002-01-01

Administrative communication is increasingly challenging for residency programs as the number of training sites expands. The Internet provides a cost-effective opportunity to address these needs. Using the World Wide Web, we developed a single, reliable, accurate, and accessible source of administrative information for residents, faculty, and staff in a multisite internal medicine residency at reduced costs. Evaluation of the effectiveness of the website was determined by tracking website use, materials and personnel costs, and resident, staff, and faculty satisfaction. Office supply and personnel costs were reduced by 89% and personnel effort by 85%. All users were highly satisfied with the web communication tool and all reported increased knowledge of program information and a greater sense of “connectedness.” We conclude that an internet-based communication system that provides a single, reliable, accurate, and accessible source of information for residents, faculty, and staff can be developed with minimum resources and reduced costs. PMID:11972724

The impact of symptom stability on time frame and recall reliability in CFS.

PubMed

Evans, Meredyth; Jason, Leonard A

This study is an investigation of the potential impact of perceived symptom stability on the recall reliability of symptom severity and frequency as reported by individuals with chronic fatigue syndrome (CFS). Symptoms were recalled using three different recall timeframes (the past week, the past month, and the past six months) and at two assessment points (with one week in between each assessment). Participants were 51 adults (45 women and 6 men), between the ages of 29 and 66 with a current diagnosis of CFS. Multilevel Model (MLM) Analyses were used to determine the optimal recall timeframe (in terms of test-retest reliability) for reporting symptoms perceived as variable and as stable over time. Headaches were recalled more reliably when they were reported as stable over time. Furthermore, the optimal timeframe in terms of test-retest reliability for stable symptoms was highly uniform, such that all Fukuda 1 CFS symptoms were more reliably recalled at the six month timeframe. Furthermore, the optimal timeframe for CFS symptoms perceived as variable, differed across symptoms. Symptom stability and recall timeframe are important to consider in order to improve the accuracy and reliability of the current methods for diagnosing this illness.

USSR Report, International Economic Relations, No. 58.

DTIC Science & Technology

1983-07-01

Import Federal Turnover 1644,1 1754,3 Iraq Turnover 420,1 54,0 Republic Export 920,2 839,0 Export 418,3 1,8 53,8 0,2 of Germany Import 723,9 915,3...in Magdeburg (GDR) made it possible to increase labor productivity at many sectors by two-three times, and even by ten times at the plasma casting...filled with a new content. They are not only a means of mutually advantageous exchange, but are acting increasingly as the most reliable bridge leading

Development of high-speed rolling-element bearings. A historical and technical perspective

NASA Technical Reports Server (NTRS)

Zaretsky, E. V.

1982-01-01

Research on large-bore ball and roller bearings for aircraft engines is described. Tapered roller bearings and small-bore bearings are discussed. Temperature capabilities of rolling element bearings for aircraft engines have moved from 450 to 589 K (350 to 600 F) with increased reliability. High bearing speeds to 3 million DN can be achieved with a reliability exceeding that which was common in commercial aircraft. Capabilities of available bearing steels and lubricants were defined and established. Computer programs for the analysis and design of rolling element bearings were developed and experimentally verified. The reported work is a summary of NASA contributions to high performance engine and transmission bearing capabilities.

Extending the wavelength range in the Oclaro high-brightness broad area modules

NASA Astrophysics Data System (ADS)

Pawlik, Susanne; Guarino, Andrea; Sverdlov, Boris; Müller, Jürgen; Button, Christopher; Arlt, Sebastian; Jaeggi, Dominik; Lichtenstein, Norbert

2010-02-01

The demand for high power laser diode modules in the wavelength range between 793 nm and 1060 nm has been growing continuously over the last several years. Progress in eye-safe fiber lasers requires reliable pump power at 793 nm, modules at 808 nm are used for small size DPSSL applications and fiber-coupled laser sources at 830 nm are used in printing industry. However, power levels achieved in this wavelength range have remained lower than for the 9xx nm range. Here we report on approaches to increasing the reliable power in our latest generations of high power pump modules in the wavelength range between 793 nm and 1060 nm.

Defining Morphology: Hands and Feet

PubMed Central

Biesecker, Leslie G.; Aase, Jon M.; Clericuzio, Carol; Gurrieri, Fiorella; Temple, I. Karen; Toriello, Helga

2009-01-01

An international group of clinicians working in the field of Dysmorphology has initiated the (re-) definition of all terms used to describe the external human phenotype. The goal is that through standardization of all terms and consensus regarding their definitions the reliability of description of features in humans will increase, comparisons of findings between patients will become more reliable, and discussions with other workers in the field such as developmental biologists and molecular geneticists will become more accurate. Here we report on the (re-) definition of terms needed to describe the major characteristics of the hands and feet. We provide a limited description of the anatomy of this region, limited background anthropometry, and an illustrated list of definitions. PMID:19125433

How Reliable Are Informal Reading Inventories?

ERIC Educational Resources Information Center

Spector, Janet E.

2005-01-01

Informal Reading Inventories (IRI) are often recommended as instructionally relevant measures of reading. However, they have also been criticized for inattention to technical quality. Examination of reliability evidence in nine recently revised IRIs revealed that fewer than half report reliability. Several appear to have sufficient reliability for…

Autism Spectrum Disorders and Self-Reports: Testing Validity and Reliability Using the NEO-PI-R

ERIC Educational Resources Information Center

Hesselmark, Eva; Eriksson, Jonna M.; Westerlund, Joakim; Bejerot, Susanne

2015-01-01

Although self-reported measures are frequently used to assess adults with autism spectrum disorders (ASD), the validity of self-reports is under-researched in ASD. The core symptoms of ASD may negatively affect the psychometric properties of self-reported measures. The aim of the present study was to test the validity and reliability of…

The Florida Community College Accountability Plan: An Analysis of Institutional Characteristics and Success at Meeting State Defined Performance Measures.

ERIC Educational Resources Information Center

Windham, Patricia W.; Hackett, E. Raymond

In response to the increasing use of state-based performance indicators for postsecondary education, a study was undertaken to review the reliability and validity of state-level indicators in the Florida Community College System (FCCS). Data were collected from literature reviews and the 1996 FCCS Accountability Report, detailing outcomes for 17…

Avoiding Assessment Anarchy. Quality Test Administration Strategies: Communicate Expectations, Reduce Variation, Increase Quality, Improve Relationships, Reward Excellence, Recognize Success.

ERIC Educational Resources Information Center

Matter, M. Kevin

This paper presents strategies that address the needs of the school district assessment office for standardized procedures to support reliable and efficient test processing and reporting and that meet the needs of school staff for test administration guidelines. The key to test administration and processing quality is a knowledgeable test…

Evaluating test-retest reliability in patient-reported outcome measures for older people: A systematic review.

PubMed

Park, Myung Sook; Kang, Kyung Ja; Jang, Sun Joo; Lee, Joo Yun; Chang, Sun Ju

2018-03-01

This study aimed to evaluate the components of test-retest reliability including time interval, sample size, and statistical methods used in patient-reported outcome measures in older people and to provide suggestions on the methodology for calculating test-retest reliability for patient-reported outcomes in older people. This was a systematic literature review. MEDLINE, Embase, CINAHL, and PsycINFO were searched from January 1, 2000 to August 10, 2017 by an information specialist. This systematic review was guided by both the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist and the guideline for systematic review published by the National Evidence-based Healthcare Collaborating Agency in Korea. The methodological quality was assessed by the Consensus-based Standards for the selection of health Measurement Instruments checklist box B. Ninety-five out of 12,641 studies were selected for the analysis. The median time interval for test-retest reliability was 14days, and the ratio of sample size for test-retest reliability to the number of items in each measure ranged from 1:1 to 1:4. The most frequently used statistical methods for continuous scores was intraclass correlation coefficients (ICCs). Among the 63 studies that used ICCs, 21 studies presented models for ICC calculations and 30 studies reported 95% confidence intervals of the ICCs. Additional analyses using 17 studies that reported a strong ICC (>0.09) showed that the mean time interval was 12.88days and the mean ratio of the number of items to sample size was 1:5.37. When researchers plan to assess the test-retest reliability of patient-reported outcome measures for older people, they need to consider an adequate time interval of approximately 13days and the sample size of about 5 times the number of items. Particularly, statistical methods should not only be selected based on the types of scores of the patient-reported outcome measures, but should also be described clearly in the studies that report the results of test-retest reliability. Copyright © 2017 Elsevier Ltd. All rights reserved.

Circulating microRNA Biomarkers as Liquid Biopsy for Cancer Patients: Pros and Cons of Current Assays

PubMed Central

Ono, Shigeshi; Lam, Stella; Nagahara, Makoto; Hoon, Dave S. B.

2015-01-01

An increasing number of studies have focused on circulating microRNAs (cmiRNA) in cancer patients’ blood for their potential as minimally-invasive biomarkers. Studies have reported the utility of assessing specific miRNAs in blood as diagnostic/prognostic biomarkers; however, the methodologies are not validated or standardized across laboratories. Unfortunately, there is often minimum limited overlap in techniques between results reported even in similar type studies on the same cancer. This hampers interpretation and reliability of cmiRNA as potential cancer biomarkers. Blood collection and processing, cmiRNA extractions, quality and quantity control of assays, defined patient population assessment, reproducibility, and reference standards all affect the cmiRNA assay results. To date, there is no reported definitive method to assess cmiRNAs. Therefore, appropriate and reliable methodologies are highly necessary in order for cmiRNAs to be used in regulated clinical diagnostic laboratories. In this review, we summarize the developments made over the past decade towards cmiRNA detection and discuss the pros and cons of the assays. PMID:26512704

Excellent reliability of the Hamilton Depression Rating Scale (HDRS-21) in Indonesia after training.

PubMed

Istriana, Erita; Kurnia, Ade; Weijers, Annelies; Hidayat, Teddy; Pinxten, Lucas; de Jong, Cor; Schellekens, Arnt

2013-09-01

The Hamilton Depression Rating Scale (HDRS) is the most widely used depression rating scale worldwide. Reliability of HDRS has been reported mainly from Western countries. The current study tested the reliability of HDRS ratings among psychiatric residents in Indonesia, before and after HDRS training. The hypotheses were that: (i) prior to the training reliability of HDRS ratings is poor; and (ii) HDRS training can improve reliability of HDRS ratings to excellent levels. Furthermore, we explored cultural validity at item level. Videotaped HDRS interviews were rated by 30 psychiatric residents before and after 1 day of HDRS training. Based on a gold standard rating, percentage correct ratings and deviation from the standard were calculated. Correct ratings increased from 83% to 99% at item level and from 70% to 100% for the total rating. The average deviation from the gold standard rating improved from 0.07 to 0.02 at item level and from 2.97 to 0.46 for the total rating. HDRS assessment by psychiatric trainees in Indonesia without prior training is unreliable. A short, evidence-based HDRS training improves reliability to near perfect levels. The outlined training program could serve as a template for HDRS trainings. HDRS items that may be less valid for assessment of depression severity in Indonesia are discussed. Copyright © 2013 Wiley Publishing Asia Pty Ltd.

The development and psychometric testing of a Disaster Response Self-Efficacy Scale among undergraduate nursing students.

PubMed

Li, Hong-Yan; Bi, Rui-Xue; Zhong, Qing-Ling

2017-12-01

Disaster nurse education has received increasing importance in China. Knowing the abilities of disaster response in undergraduate nursing students is beneficial to promote teaching and learning. However, there are few valid and reliable tools that measure the abilities of disaster response in undergraduate nursing students. To develop a self-report scale of self-efficacy in disaster response for Chinese undergraduate nursing students and test its psychometric properties. Nursing students (N=318) from two medical colleges were chosen by purposive sampling. The Disaster Response Self-Efficacy Scale (DRSES) was developed and psychometrically tested. Reliability and content validity were studied. Construct validity was tested by exploratory and confirmatory factor analysis. Reliability was tested by internal consistency and test-retest reliability. The DRSES consisted of 3 factors and 19 items with a 5-point rating. The content validity was 0.91, Cronbach's alpha coefficient was 0.912, and the intraclass correlation coefficient for test-retest reliability was 0.953. The construct validity was good (χ 2 /df=2.440, RMSEA=0.068, NFI=0.907, CFI=0.942, IFI=0.430, p<0.001). The newly developed DRSES has proven good reliability and validity. It could therefore be used as an assessment tool to evaluate self-efficacy in disaster response for Chinese undergraduate nursing students. Copyright © 2017. Published by Elsevier Ltd.

The reliability of a modified Kalamazoo Consensus Statement Checklist for assessing the communication skills of multidisciplinary clinicians in the simulated environment.

PubMed

Peterson, Eleanor B; Calhoun, Aaron W; Rider, Elizabeth A

2014-09-01

With increased recognition of the importance of sound communication skills and communication skills education, reliable assessment tools are essential. This study reports on the psychometric properties of an assessment tool based on the Kalamazoo Consensus Statement Essential Elements Communication Checklist. The Gap-Kalamazoo Communication Skills Assessment Form (GKCSAF), a modified version of an existing communication skills assessment tool, the Kalamazoo Essential Elements Communication Checklist-Adapted, was used to assess learners in a multidisciplinary, simulation-based communication skills educational program using multiple raters. 118 simulated conversations were available for analysis. Internal consistency and inter-rater reliability were determined by calculating a Cronbach's alpha score and intra-class correlation coefficients (ICC), respectively. The GKCSAF demonstrated high internal consistency with a Cronbach's alpha score of 0.844 (faculty raters) and 0.880 (peer observer raters), and high inter-rater reliability with an ICC of 0.830 (faculty raters) and 0.89 (peer observer raters). The Gap-Kalamazoo Communication Skills Assessment Form is a reliable method of assessing the communication skills of multidisciplinary learners using multi-rater methods within the learning environment. The Gap-Kalamazoo Communication Skills Assessment Form can be used by educational programs that wish to implement a reliable assessment and feedback system for a variety of learners. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Dynamic MRI to quantify musculoskeletal motion: A systematic review of concurrent validity and reliability, and perspectives for evaluation of musculoskeletal disorders

PubMed Central

Lempereur, Mathieu; Lelievre, Mathieu; Burdin, Valérie; Ben Salem, Douraied; Brochard, Sylvain

2017-01-01

Purpose To report evidence for the concurrent validity and reliability of dynamic MRI techniques to evaluate in vivo joint and muscle mechanics, and to propose recommendations for their use in the assessment of normal and impaired musculoskeletal function. Materials and methods The search was conducted on articles published in Web of science, PubMed, Scopus, Academic search Premier, and Cochrane Library between 1990 and August 2017. Studies that reported the concurrent validity and/or reliability of dynamic MRI techniques for in vivo evaluation of joint or muscle mechanics were included after assessment by two independent reviewers. Selected articles were assessed using an adapted quality assessment tool and a data extraction process. Results for concurrent validity and reliability were categorized as poor, moderate, or excellent. Results Twenty articles fulfilled the inclusion criteria with a mean quality assessment score of 66% (±10.4%). Concurrent validity and/or reliability of eight dynamic MRI techniques were reported, with the knee being the most evaluated joint (seven studies). Moderate to excellent concurrent validity and reliability were reported for seven out of eight dynamic MRI techniques. Cine phase contrast and real-time MRI appeared to be the most valid and reliable techniques to evaluate joint motion, and spin tag for muscle motion. Conclusion Dynamic MRI techniques are promising for the in vivo evaluation of musculoskeletal mechanics; however results should be evaluated with caution since validity and reliability have not been determined for all joints and muscles, nor for many pathological conditions. PMID:29232401

A bill to require the Consumer Product Safety Commission to study and report on the impact on consumers of permitting an increase in the amount of ethanol blended with gasoline for use in gasoline-powered engines used in vehicles operated in interstate commerce, on public streets and roads, or offroad, appliances such as lawn mowers and other nonvehicular devices, and marine engines, and to require the National Highway Traffic Safety Administration to study and report on any safety or reliability impact of such an increase on motor vehicle engines and fuel systems.

THOMAS, 111th Congress

Sen. Hutchison, Kay Bailey [R-TX

2010-09-29

Senate - 09/29/2010 Read twice and referred to the Committee on Commerce, Science, and Transportation. (All Actions) Tracker: This bill has the status IntroducedHere are the steps for Status of Legislation:

Reliability of risk-adjusted outcomes for profiling hospital surgical quality.

PubMed

Krell, Robert W; Hozain, Ahmed; Kao, Lillian S; Dimick, Justin B

2014-05-01

Quality improvement platforms commonly use risk-adjusted morbidity and mortality to profile hospital performance. However, given small hospital caseloads and low event rates for some procedures, it is unclear whether these outcomes reliably reflect hospital performance. To determine the reliability of risk-adjusted morbidity and mortality for hospital performance profiling using clinical registry data. A retrospective cohort study was conducted using data from the American College of Surgeons National Surgical Quality Improvement Program, 2009. Participants included all patients (N = 55,466) who underwent colon resection, pancreatic resection, laparoscopic gastric bypass, ventral hernia repair, abdominal aortic aneurysm repair, and lower extremity bypass. Outcomes included risk-adjusted overall morbidity, severe morbidity, and mortality. We assessed reliability (0-1 scale: 0, completely unreliable; and 1, perfectly reliable) for all 3 outcomes. We also quantified the number of hospitals meeting minimum acceptable reliability thresholds (>0.70, good reliability; and >0.50, fair reliability) for each outcome. For overall morbidity, the most common outcome studied, the mean reliability depended on sample size (ie, how high the hospital caseload was) and the event rate (ie, how frequently the outcome occurred). For example, mean reliability for overall morbidity was low for abdominal aortic aneurysm repair (reliability, 0.29; sample size, 25 cases per year; and event rate, 18.3%). In contrast, mean reliability for overall morbidity was higher for colon resection (reliability, 0.61; sample size, 114 cases per year; and event rate, 26.8%). Colon resection (37.7% of hospitals), pancreatic resection (7.1% of hospitals), and laparoscopic gastric bypass (11.5% of hospitals) were the only procedures for which any hospitals met a reliability threshold of 0.70 for overall morbidity. Because severe morbidity and mortality are less frequent outcomes, their mean reliability was lower, and even fewer hospitals met the thresholds for minimum reliability. Most commonly reported outcome measures have low reliability for differentiating hospital performance. This is especially important for clinical registries that sample rather than collect 100% of cases, which can limit hospital case accrual. Eliminating sampling to achieve the highest possible caseloads, adjusting for reliability, and using advanced modeling strategies (eg, hierarchical modeling) are necessary for clinical registries to increase their benchmarking reliability.

78 FR 18333 - North American Electric Reliability Corporation; Notice of Filing

Federal Register 2010, 2011, 2012, 2013, 2014

2013-03-26

... Electric Reliability Corporation; Notice of Filing Take notice that on March 15, 2013, the North American Electric Reliability Corporation (NERC) submitted a compliance filing and report in accordance with the Federal Energy Regulatory Commission's Order (FERC or Commission) in North American Electric Reliability...

Sonar Transducer Reliability Improvement Program (STRIP)

DTIC Science & Technology

1981-01-01

Fair *[51] EPDM NORDOL 1370 - Poor *[511 NATURAL 1155- Poor *[51] NITRILE 6100 - Good *[51] VITON CTBN (BF635075) - Poor *[511 CORK- RUBBER ... aging problems have been found. A report entitled "Reliability and Service Life Concepts for Sonar Transducer Applications" has been completed. - A draft...or aging problems have been found. See Section 9. * A report entitled "Reliability and Service Life Concepts for Sonar Transducer Applications" has

easyCBM Beginning Reading Measures: Grades K-1 Alternate Form Reliability and Criterion Validity with the SAT-10. Technical Report #1403

ERIC Educational Resources Information Center

Wray, Kraig; Lai, Cheng-Fei; Sáez, Leilani; Alonzo, Julie; Tindal, Gerald

2013-01-01

We report the results of an alternate form reliability and criterion validity study of kindergarten and grade 1 (N = 84-199) reading measures from the easyCBM© assessment system and Stanford Early School Achievement Test/Stanford Achievement Test, 10th edition (SESAT/SAT-­10) across 5 time points. The alternate form reliabilities ranged from…

Reliability of reports of childhood trauma in bipolar disorder: A test-retest study over 18 months.

PubMed

Shannon, Ciaran; Hanna, Donncha; Tumelty, Leo; Waldron, Daniel; Maguire, Chrissie; Mowlds, William; Meenagh, Ciaran; Mulholland, Ciaran

2016-01-01

This study aimed to explore the reliability of self-reported trauma histories in a population with a diagnosis of bipolar disorder using the Childhood Trauma Questionnaire. Previous studies in other populations suggest high reliability of trauma histories over time, and it was postulated that a similar high reliability would be demonstrated in this population. A total of 39 patients with a confirmed diagnosis (Diagnostic and Statistical Manual of Mental Disorders, 4th Edition, criteria) were followed up and readministered the Childhood Trauma Questionnaire after 18 months. Cohen's kappa scores and intraclass correlations suggested reasonable test-retest reliability over the 18-month time period of the study for all types of childhood abuse, namely, emotional, physical, and sexual abuse and physical and emotional neglect. Intraclass correlations ranged from r = .50 (sexual abuse) to r = .96 (physical abuse). Cohen's kappas ranged from .44 (sexual abuse) to .76 (physical abuse). Retrospective reports of childhood trauma can be seen as reliable and are in keeping with results found with other mental health populations.

International FItness Scale (IFIS): Construct Validity and Reliability in Women With Fibromyalgia: The al-Ándalus Project.

PubMed

Álvarez-Gallardo, Inmaculada C; Soriano-Maldonado, Alberto; Segura-Jiménez, Víctor; Carbonell-Baeza, Ana; Estévez-López, Fernando; McVeigh, Joseph G; Delgado-Fernández, Manuel; Ortega, Francisco B

2016-03-01

To examine the construct validity of the International FItness Scale (IFIS) (ie, self-reported fitness) against objectively measured physical fitness in women with fibromyalgia and in healthy women; and to study the test-retest reliability of the IFIS in women with fibromyalgia. Cross-sectional study. Fibromyalgia patient support groups. Women with fibromyalgia (n=413) and healthy women (controls) (n=195) for validity purposes and women with fibromyalgia (n=101) for the reliability study. The total sample was N=709. Not applicable. Fitness level was both self-reported (IFIS) and measured using performance-based fitness tests. For the reliability study the IFIS was completed on 2 occasions, 1 week apart. Women with fibromyalgia who reported average fitness had better measured fitness than those reporting very poor fitness (all P<.001, except 6-minute walk test where P<.05), with similar trends observed in healthy control women. The test-retest reliability of the IFIS, as measured by the average weighted κ, was .45. The IFIS was able to identify women with fibromyalgia who had very low fitness and distinguish them from those with higher fitness levels. Furthermore, the IFIS was moderately reliable in women with fibromyalgia. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research.

PubMed

Koo, Terry K; Li, Mae Y

2016-06-01

Intraclass correlation coefficient (ICC) is a widely used reliability index in test-retest, intrarater, and interrater reliability analyses. This article introduces the basic concept of ICC in the content of reliability analysis. There are 10 forms of ICCs. Because each form involves distinct assumptions in their calculation and will lead to different interpretations, researchers should explicitly specify the ICC form they used in their calculation. A thorough review of the research design is needed in selecting the appropriate form of ICC to evaluate reliability. The best practice of reporting ICC should include software information, "model," "type," and "definition" selections. When coming across an article that includes ICC, readers should first check whether information about the ICC form has been reported and if an appropriate ICC form was used. Based on the 95% confident interval of the ICC estimate, values less than 0.5, between 0.5 and 0.75, between 0.75 and 0.9, and greater than 0.90 are indicative of poor, moderate, good, and excellent reliability, respectively. This article provides a practical guideline for clinical researchers to choose the correct form of ICC and suggests the best practice of reporting ICC parameters in scientific publications. This article also gives readers an appreciation for what to look for when coming across ICC while reading an article.

Temporal Stability of Strength-Based Assessments: Test-Retest Reliability of Student and Teacher Reports

ERIC Educational Resources Information Center

Romer, Natalie; Merrell, Kenneth W.

2013-01-01

This study focused on evaluating the temporal stability of self-reported and teacher-reported perceptions of students' social and emotional skills and assets. We used a test-retest reliability procedure over repeated administrations of the child, adolescent, and teacher versions of the "Social-Emotional Assets and Resilience Scales".…

An assessment of the inter-rater reliability of the ASA physical status score in the orthopaedic trauma population.

PubMed

Ihejirika, Rivka C; Thakore, Rachel V; Sathiyakumar, Vasanth; Ehrenfeld, Jesse M; Obremskey, William T; Sethi, Manish K

2015-04-01

Although recent literature has demonstrated the utility of the ASA score in predicting postoperative length of stay, complication risk and potential utilization of other hospital resources, the ASA score has been inconsistently assigned by anaesthesia providers. This study tested the reliability of assignment of the ASA score classification by both attending anaesthesiologists and anaesthesia residents specifically among the orthopaedic trauma patient population. Nine case-based scenarios were created involving preoperative patients with isolated operative orthopaedic trauma injuries. The cases were created and assigned a reference score by both an attending anaesthesiologist and orthopaedic trauma surgeon. Attending and resident anaesthesiologists were asked to assign an ASA score for each case. Rater versus reference and inter-rater agreement amongst respondents was then analyzed utilizing Fleiss's Kappa and weighted and unweighted Cohen's Kappa. Thirty three individuals provided ASA scores for each of the scenarios. The average rater versus reference reliability was substantial (Kw=0.78, SD=0.131, 95% CI=0.73-0.83). The average rater versus reference Kuw was also substantial (Kuw=0.64, SD=0.21, 95% CI=0.56-0.71). The inter-rater reliability as evaluated by Fleiss's Kappa was moderate (K=0.51, p<.001). An inter-rater comparison within the group of attendings (K=0.50, p<.001) and within the group of residents were both moderate (K=0.55, p<.001). There was a significant increase in the level of inter-rater reliability from the self-reported 'very uncomfortable' participants to the 'very comfortable' participants (uncomfortable K=0.43, comfortable K=0.59, p<.001). This study shows substantial agreement strength for reliability of the ASA score among anaesthesiologists when evaluating orthopaedic trauma patients. The significant increase in inter-rater reliability based on anaesthesiologists' comfort with the ASA scoring method implies a need for further evaluation of ASA assessment training and routine use on the ground. These findings support the use of the ASA score as a statistically reliable tool in orthopaedic trauma. Copyright © 2014 Elsevier Ltd. All rights reserved.

Enhanced methods for determining operational capabilities and support costs of proposed space systems

NASA Technical Reports Server (NTRS)

Ebeling, Charles

1993-01-01

This report documents the work accomplished during the first two years of research to provide support to NASA in predicting operational and support parameters and costs of proposed space systems. The first year's research developed a methodology for deriving reliability and maintainability (R & M) parameters based upon the use of regression analysis to establish empirical relationships between performance and design specifications and corresponding mean times of failure and repair. The second year focused on enhancements to the methodology, increased scope of the model, and software improvements. This follow-on effort expands the prediction of R & M parameters and their effect on the operations and support of space transportation vehicles to include other system components such as booster rockets and external fuel tanks. It also increases the scope of the methodology and the capabilities of the model as implemented by the software. The focus is on the failure and repair of major subsystems and their impact on vehicle reliability, turn times, maintenance manpower, and repairable spares requirements. The report documents the data utilized in this study, outlines the general methodology for estimating and relating R&M parameters, presents the analyses and results of application to the initial data base, and describes the implementation of the methodology through the use of a computer model. The report concludes with a discussion on validation and a summary of the research findings and results.

Reliability of reported breastfeeding duration among reproductive-aged women from Mexico

PubMed Central

Cupul-Uicab, Lea A.; Gladen, Beth C.; Hernández-Ávila, Mauricio; Longnecker, Matthew P.

2010-01-01

Breastfed children have lower risk of infectious diseases, post-neonatal mortality and chronic diseases later in life. Because epidemiologic studies usually rely on reported history of previous breastfeeding, data on the accuracy and precision of recalled histories allow improved interpretation of the epidemiologic findings. We evaluated the reliability of two reported breastfeeding durations in 567 reproductive-aged women from Mexico using information obtained from nearly identical sets of questions applied at different times after weaning. We compared differences between reports, and examined the intra-class correlation coefficient (ICC) for any and for exclusive breastfeeding (EBF). Logistic regression was used to evaluate the determinants of poor recall (difference between reports of >20%). The reliability of duration of any breastfeeding was high (ICC 0.94). Overall, differences between reports of duration were usually <1 month, and for 385/567, the difference was ≤0.5 months. Predictors of poorer recall were having ≥4 children, and time between reports of >2 months. The only predictor of better recall was greater age of the baby at weaning. The reliability of EBF duration was lower (ICC 0.49). In this population with a relatively long duration of breastfeeding, reliability of any breast-feeding duration was high. Age, education and previous breastfeeding were not important predictors of recall, in contrast to findings in earlier studies. Consistent with previous reports, however, parity and length of recall were associated with poorer recall of duration of any breastfeeding. Future studies that use reported breastfeeding duration may want to consider the effect of these variables on recall. PMID:19292747

Geometric classification of scalp hair for valid drug testing, 6 more reliable than 8 hair curl groups

PubMed Central

Mkentane, K.; Gumedze, F.; Ngoepe, M.; Davids, L. M.; Khumalo, N. P.

2017-01-01

Introduction Curly hair is reported to contain higher lipid content than straight hair, which may influence incorporation of lipid soluble drugs. The use of race to describe hair curl variation (Asian, Caucasian and African) is unscientific yet common in medical literature (including reports of drug levels in hair). This study investigated the reliability of a geometric classification of hair (based on 3 measurements: the curve diameter, curl index and number of waves). Materials and methods After ethical approval and informed consent, proximal virgin (6cm) hair sampled from the vertex of scalp in 48 healthy volunteers were evaluated. Three raters each scored hairs from 48 volunteers at two occasions each for the 8 and 6-group classifications. One rater applied the 6-group classification to 80 additional volunteers in order to further confirm the reliability of this system. The Kappa statistic was used to assess intra and inter rater agreement. Results Each rater classified 480 hairs on each occasion. No rater classified any volunteer’s 10 hairs into the same group; the most frequently occurring group was used for analysis. The inter-rater agreement was poor for the 8-groups (k = 0.418) but improved for the 6-groups (k = 0.671). The intra-rater agreement also improved (k = 0.444 to 0.648 versus 0.599 to 0.836) for 6-groups; that for the one evaluator for all volunteers was good (k = 0.754). Conclusions Although small, this is the first study to test the reliability of a geometric classification. The 6-group method is more reliable. However, a digital classification system is likely to reduce operator error. A reliable objective classification of human hair curl is long overdue, particularly with the increasing use of hair as a testing substrate for treatment compliance in Medicine. PMID:28570555

Application of Probability of Crack Detection to Aircraft Systems Reliability.

DOT National Transportation Integrated Search

1993-08-31

This report describes three tasks related to probability of crack detection (POD) and aircraft systems reliablity. All three consider previous work in which crack growth simulations and crack detection data in the Service Difficulty Report (SDR) data...

Psychometric properties of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales in early adolescents in Sri Lanka.

PubMed

Danansuriya, Manjula Nishanthi; Rajapaksa, Lalini C

2012-09-04

The concept Health related Quality of life (HRQOL) is increasingly recognized as an important health outcome measure in clinical and research fields. The present study attempted to evaluate the psychometric properties of the Sinhala version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales among adolescents in Sri Lanka. The original US PedsQL™ was translated into Sinhala and conceptually validated according to international guidelines. A cross-sectional study was conducted among 142 healthy school going adolescents (12-14 years), their parents (n = 120) and a group of adolescents with asthma who attended asthma clinics (n = 115). Reliability was assessed using Cronbach's alpha and validity by examining scale structure, exploring inter-scale correlations and comparing across known groups (healthy vs. chronically ill). The PedsQL™ Sinhala version was found to be acceptable with minimal missing responses. All scales demonstrated satisfactory reliability. Cronbach's alpha for the total scale scores was 0.85 for adolescent self-report while for the parent proxy-report for the healthy group it was 0.86. No floor effects were observed. Ceiling effects were noticed in self-report and parent proxy-report for the healthy group. Overall results of the multi trait scaling analysis confirmed the scale structure with 74% item-convergent validity, 88% item-discriminant validity and an overall scaling success of 72%. Moderate to high correlations were shown among the domains of teen self-report (Spearman rho = .37-.54) and between teen self-report and parent proxy-reports (Spearman rho = .41-.57). The PedsQL™ tool was able to discriminate between the quality of life in healthy adolescents and adolescents with asthma. The findings support the reliability and validity of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales as a generic instrument to measure HRQOL among early adolescents in Sri Lanka in a population setting.

Which symptom assessments and approaches are uniquely appropriate for paediatric concussion?

PubMed

Gioia, G A; Schneider, J C; Vaughan, C G; Isquith, P K

2009-05-01

To (a) identify post-concussion symptom scales appropriate for children and adolescents in sports; (b) review evidence for reliability and validity; and (c) recommend future directions for scale development. Quantitative and qualitative literature review of symptom rating scales appropriate for children and adolescents aged 5 to 22 years. Literature identified via search of Medline, Ovid-Medline and PsycInfo databases; review of reference lists in identified articles; querying sports concussion specialists. 29 articles met study inclusion criteria. 5 symptom scales examined in 11 studies for ages 5-12 years and in 25 studies for ages 13-22. 10 of 11 studies for 5-12-year-olds presented validity evidence for three scales; 7 studies provided reliability evidence for two scales; 7 studies used serial administrations but no reliable change metrics. Two scales included parent-reports and one included a teacher report. 24 of 25 studies for 13-22 year-olds presented validity evidence for five measures; seven studies provided reliability evidence for four measures with 18 studies including serial administrations and two examining Reliable Change. Psychometric evidence for symptom scales is stronger for adolescents than for younger children. Most scales provide evidence of concurrent validity, discriminating concussed and non-concussed groups. Few report reliability and evidence for validity is narrow. Two measures include parent/teacher reports. Few scales examine reliable change statistics, limiting interpretability of temporal changes. Future studies are needed to fully define symptom scale psychometric properties with the greatest need in younger student-athletes.

Evaluation of tools used to measure calcium and/or dairy consumption in children and adolescents.

PubMed

Magarey, Anthea; Yaxley, Alison; Markow, Kylie; Baulderstone, Lauren; Miller, Michelle

2014-08-01

To identify and critique tools that assess Ca and/or dairy intake in children to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles were included on the basis that they reported on a tool measuring Ca and/or dairy intake in children in Western countries and reported on originally developed tools or tested the validity or reliability of existing tools. Defined criteria for reporting reliability and validity properties were applied. Studies in Western countries. Children. Eighteen papers reporting on two tools that assessed dairy intake, ten that assessed Ca intake and five that assessed both dairy and Ca were identified. An examination of tool testing revealed high reliance on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful significance. Only half of the tools were tested for reliability and results indicated that only one Ca tool and one dairy tool were reliable. Validation studies showed acceptable levels of agreement (<100 mg difference) and/or sensitivity (62-83 %) and specificity (55-77 %) in three Ca tools. With reference to the testing methodology and results, no tools were considered both valid and reliable for the assessment of dairy intake and only one tool proved valid and reliable for the assessment of Ca intake. These results clearly indicate the need for development and rigorous testing of tools to assess Ca and/or dairy intake in children and adolescents.

Robust signals of future projections of Indian summer monsoon rainfall by IPCC AR5 climate models: Role of seasonal cycle and interannual variability

NASA Astrophysics Data System (ADS)

Jayasankar, C. B.; Surendran, Sajani; Rajendran, Kavirajan

2015-05-01

Coupled Model Intercomparison Project phase 5 (Fifth Assessment Report of Intergovernmental Panel on Climate Change) coupled global climate model Representative Concentration Pathway 8.5 simulations are analyzed to derive robust signals of projected changes in Indian summer monsoon rainfall (ISMR) and its variability. Models project clear future temperature increase but diverse changes in ISMR with substantial intermodel spread. Objective measures of interannual variability (IAV) yields nearly equal chance for future increase or decrease. This leads to discrepancy in quantifying changes in ISMR and variability. However, based primarily on the physical association between mean changes in ISMR and its IAV, and objective methods such as k-means clustering with Dunn's validity index, mean seasonal cycle, and reliability ensemble averaging, projections fall into distinct groups. Physically consistent groups of models with the highest reliability project future reduction in the frequency of light rainfall but increase in high to extreme rainfall and thereby future increase in ISMR by 0.74 ± 0.36 mm d-1, along with increased future IAV. These robust estimates of future changes are important for useful impact assessments.

The Design of Integrated Information System for High Voltage Metering Lab

NASA Astrophysics Data System (ADS)

Ma, Yan; Yang, Yi; Xu, Guangke; Gu, Chao; Zou, Lida; Yang, Feng

2018-01-01

With the development of smart grid, intelligent and informatization management of high-voltage metering lab become increasingly urgent. In the paper we design an integrated information system, which automates the whole transactions from accepting instruments, make experiments, generating report, report signature to instrument claims. Through creating database for all the calibrated instruments, using two-dimensional code, integrating report templates in advance, establishing bookmarks and online transmission of electronical signatures, our manual procedures reduce largely. These techniques simplify the complex process of account management and report transmission. After more than a year of operation, our work efficiency improves about forty percent averagely, and its accuracy rate and data reliability are much higher as well.

Interrater reliability of the injury reporting of the injury surveillance system used in international athletics championships.

PubMed

Edouard, Pascal; Junge, Astrid; Kiss-Polauf, Marianna; Ramirez, Christophe; Sousa, Monica; Timpka, Toomas; Branco, Pedro

2018-03-01

The quality of epidemiological injury data depends on the reliability of reporting to an injury surveillance system. Ascertaining whether all physicians/physiotherapists report the same information for the same injury case is of major interest to determine data validity. The aim of this study was therefore to analyse the data collection reliability through the analysis of the interrater reliability. Cross-sectional survey. During the 2016 European Athletics Advanced Athletics Medicine Course in Amsterdam, all national medical teams were asked to complete seven virtual case reports on a standardised injury report form using the same definitions and classifications of injuries as the international athletics championships injury surveillance protocol. The completeness of data and the Fleiss' kappa coefficients for the inter-rater reliability were calculated for: sex, age, event, circumstance, location, type, assumed cause and estimated time-loss. Forty-one team physicians and physiotherapists of national medical teams participated in the study (response rate 89.1%). Data completeness was 96.9%. The Fleiss' kappa coefficients were: almost perfect for sex (k=1), injury location (k=0.991), event (k=0.953), circumstance (k=0.942), and age (k=0.870), moderate for type (k=0.507), fair for assumed cause (k=0.394), and poor for estimated time-loss (k=0.155). The injury surveillance system used during international athletics championships provided reliable data for "sex", "location", "event", "circumstance", and "age". More caution should be taken for "assumed cause" and "type", and even more for "estimated time-loss". This injury surveillance system displays satisfactory data quality (reliable data and high data completeness), and thus, can be recommended as tool to collect epidemiology information on injuries during international athletics championships. Copyright © 2018 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Transit Reliability Information Program (TRIP) : Final Technical Report

DOT National Transportation Integrated Search

1984-05-01

The Transit Reliability Information Program (TRIP) is a government-initiated program to assist the transit industry in satisfying its need for rail transit car subsystem reliability information. TRIP provided this assistance through the operation of ...

Transit Reliability Information Program (TRIP) Phase I Report

DOT National Transportation Integrated Search

1981-06-01

The Transit Reliability Information Program (TRIP) is a government initiated program to assist the transit industry in satisfying its need for transit reliability information. TRIP provides this assistance through the operation of a national reliabil...

Interformat reliability of digital psychiatric self-report questionnaires: a systematic review.

PubMed

Alfonsson, Sven; Maathz, Pernilla; Hursti, Timo

2014-12-03

Research on Internet-based interventions typically use digital versions of pen and paper self-report symptom scales. However, adaptation into the digital format could affect the psychometric properties of established self-report scales. Several studies have investigated differences between digital and pen and paper versions of instruments, but no systematic review of the results has yet been done. This review aims to assess the interformat reliability of self-report symptom scales used in digital or online psychotherapy research. Three databases (MEDLINE, Embase, and PsycINFO) were systematically reviewed for studies investigating the reliability between digital and pen and paper versions of psychiatric symptom scales. From a total of 1504 publications, 33 were included in the review, and interformat reliability of 40 different symptom scales was assessed. Significant differences in mean total scores between formats were found in 10 of 62 analyses. These differences were found in just a few studies, which indicates that the results were due to study effects and sample effects rather than unreliable instruments. The interformat reliability ranged from r=.35 to r=.99; however, the majority of instruments showed a strong correlation between format scores. The quality of the included studies varied, and several studies had insufficient power to detect small differences between formats. When digital versions of self-report symptom scales are compared to pen and paper versions, most scales show high interformat reliability. This supports the reliability of results obtained in psychotherapy research on the Internet and the comparability of the results to traditional psychotherapy research. There are, however, some instruments that consistently show low interformat reliability, suggesting that these conclusions cannot be generalized to all questionnaires. Most studies had at least some methodological issues with insufficient statistical power being the most common issue. Future studies should preferably provide information about the transformation of the instrument into digital format and the procedure for data collection in more detail.

Reliability Impacts in Life Support Architecture and Technology Selection

NASA Technical Reports Server (NTRS)

Lange, Kevin E.; Anderson, Molly S.

2011-01-01

Equivalent System Mass (ESM) and reliability estimates were performed for different life support architectures based primarily on International Space Station (ISS) technologies. The analysis was applied to a hypothetical 1-year deep-space mission. High-level fault trees were initially developed relating loss of life support functionality to the Loss of Crew (LOC) top event. System reliability was then expressed as the complement (nonoccurrence) this event and was increased through the addition of redundancy and spares, which added to the ESM. The reliability analysis assumed constant failure rates and used current projected values of the Mean Time Between Failures (MTBF) from an ISS database where available. Results were obtained showing the dependence of ESM on system reliability for each architecture. Although the analysis employed numerous simplifications and many of the input parameters are considered to have high uncertainty, the results strongly suggest that achieving necessary reliabilities for deep-space missions will add substantially to the life support system mass. As a point of reference, the reliability for a single-string architecture using the most regenerative combination of ISS technologies without unscheduled replacement spares was estimated to be less than 1%. The results also demonstrate how adding technologies in a serial manner to increase system closure forces the reliability of other life support technologies to increase in order to meet the system reliability requirement. This increase in reliability results in increased mass for multiple technologies through the need for additional spares. Alternative parallel architecture approaches and approaches with the potential to do more with less are discussed. The tall poles in life support ESM are also reexamined in light of estimated reliability impacts.

Reliability at the Lower Limits of HIV-1 RNA Quantification in Clinical Samples: A Comparison of RT-PCR versus bDNA Assays

PubMed Central

Lubelchek, Ronald J.; Max, Blake; Sandusky, Caroline J.; Hota, Bala; Barker, David E.

2009-01-01

Introduction To explore whether an assay change was responsible for an increasing proportion of patients with undetectable HIV viral loads at our urban HIV clinic, we selected highly stable patients, examining their viral loads before and after changing assays. We compared the proportion with detectable viremia during RT-PCR vs. bDNA periods. Methodology/Principal Findings We selected patients with ≥1 viral loads assessed during both RT-PCR and bDNA periods. We included patients with stable CD4 counts, excluding patients with viral loads ≥1,000 copies/ml or any significant changes in therapy. Out of 4500 clinic patients, 419 patients (1588 viral loads) were included. 39% of viral loads were reported as detectable by RT-PCR vs. 5% reported as detectable by bDNA. The mean coefficient of variation was higher before vs. after assay change. We found an odds' ratio of 16.7 for having a viral load >75 copies/ml during the RT-PCR vs. bDNA periods. Discussion These data support previous reports, suggesting that bDNA may more reliably discriminate between viral suppression and low level viremia in stable patients on therapy. Low-level viremia, noted more with RT-PCR, may promote unneeded testing, while differences in viral load reliability may impact antiretroviral trial and quality assurance endpoints. Commonly used plasma separator tubes may differentially affect RT-PCR and bDNA results. PMID:19547711

Influences on the Test-Retest Reliability of Functional Connectivity MRI and its Relationship with Behavioral Utility.

PubMed

Noble, Stephanie; Spann, Marisa N; Tokoglu, Fuyuze; Shen, Xilin; Constable, R Todd; Scheinost, Dustin

2017-11-01

Best practices are currently being developed for the acquisition and processing of resting-state magnetic resonance imaging data used to estimate brain functional organization-or "functional connectivity." Standards have been proposed based on test-retest reliability, but open questions remain. These include how amount of data per subject influences whole-brain reliability, the influence of increasing runs versus sessions, the spatial distribution of reliability, the reliability of multivariate methods, and, crucially, how reliability maps onto prediction of behavior. We collected a dataset of 12 extensively sampled individuals (144 min data each across 2 identically configured scanners) to assess test-retest reliability of whole-brain connectivity within the generalizability theory framework. We used Human Connectome Project data to replicate these analyses and relate reliability to behavioral prediction. Overall, the historical 5-min scan produced poor reliability averaged across connections. Increasing the number of sessions was more beneficial than increasing runs. Reliability was lowest for subcortical connections and highest for within-network cortical connections. Multivariate reliability was greater than univariate. Finally, reliability could not be used to improve prediction; these findings are among the first to underscore this distinction for functional connectivity. A comprehensive understanding of test-retest reliability, including its limitations, supports the development of best practices in the field. © The Author 2017. Published by Oxford University Press.

Teletoxicology: Patient Assessment Using Wearable Audiovisual Streaming Technology.

PubMed

Skolnik, Aaron B; Chai, Peter R; Dameff, Christian; Gerkin, Richard; Monas, Jessica; Padilla-Jones, Angela; Curry, Steven

2016-12-01

Audiovisual streaming technologies allow detailed remote patient assessment and have been suggested to change management and enhance triage. The advent of wearable, head-mounted devices (HMDs) permits advanced teletoxicology at a relatively low cost. A previously published pilot study supports the feasibility of using the HMD Google Glass® (Google Inc.; Mountain View, CA) for teletoxicology consultation. This study examines the reliability, accuracy, and precision of the poisoned patient assessment when performed remotely via Google Glass®. A prospective observational cohort study was performed on 50 patients admitted to a tertiary care center inpatient toxicology service. Toxicology fellows wore Google Glass® and transmitted secure, real-time video and audio of the initial physical examination to a remote investigator not involved in the subject's care. High-resolution still photos of electrocardiograms (ECGs) were transmitted to the remote investigator. On-site and remote investigators recorded physical examination findings and ECG interpretation. Both investigators completed a brief survey about the acceptability and reliability of the streaming technology for each encounter. Kappa scores and simple agreement were calculated for each examination finding and electrocardiogram parameter. Reliability scores and reliability difference were calculated and compared for each encounter. Data were available for analysis of 17 categories of examination and ECG findings. Simple agreement between on-site and remote investigators ranged from 68 to 100 % (median = 94 %, IQR = 10.5). Kappa scores could be calculated for 11/17 parameters and demonstrated slight to fair agreement for two parameters and moderate to almost perfect agreement for nine parameters (median = 0.653; substantial agreement). The lowest Kappa scores were for pupil size and response to light. On a 100-mm visual analog scale (VAS), mean comfort level was 93 and mean reliability rating was 89 for on-site investigators. For remote users, the mean comfort and reliability ratings were 99 and 86, respectively. The average difference in reliability scores between on-site and remote investigators was 2.6, with the difference increasing as reliability scores decreased. Remote evaluation of poisoned patients via Google Glass® is possible with a high degree of agreement on examination findings and ECG interpretation. Evaluation of pupil size and response to light is limited, likely by the quality of streaming video. Users of Google Glass® for teletoxicology reported high levels of comfort with the technology and found it reliable, though as reported reliability decreased, remote users were most affected. Further study should compare patient-centered outcomes when using HMDs for consultation to those resulting from telephone consultation.

The Return to Final Paper Examining in English National Curriculum Assessment and School Examinations: Issues of Validity, Accountability and Politics

ERIC Educational Resources Information Center

Torrance, Harry

2018-01-01

There are sound educational and examining reasons for the use of coursework assessment and practical assessment of student work by teachers in schools for purposes of reporting examination grades. Coursework and practical work test a range of different curriculum goals to final papers and increase the validity and reliability of the result.…

Reliability Generalization: The Importance of Considering Sample Specificity, Confident Intervals, and Subgroup Differences.

ERIC Educational Resources Information Center

Onwuegbuzie, Anthony J.; Daniel, Larry G.

The purposes of this paper are to identify common errors made by researchers when dealing with reliability coefficients and to outline best practices for reporting and interpreting reliability coefficients. Common errors that researchers make are: (1) stating that the instruments are reliable; (2) incorrectly interpreting correlation coefficients;…

Testing the Difference between Reliability Coefficients Alpha and Omega

ERIC Educational Resources Information Center

Deng, Lifang; Chan, Wai

2017-01-01

Reliable measurements are key to social science research. Multiple measures of reliability of the total score have been developed, including coefficient alpha, coefficient omega, the greatest lower bound reliability, and others. Among these, the coefficient alpha has been most widely used, and it is reported in nearly every study involving the…

Test-retest reliability of the trauma and life events self-report inventory.

PubMed

Hovens, J E; Bramsen, I; van der Ploeg, H M; Reuling, I E

2000-12-01

Three groups of first-year male and female medical students (total N = 90) completed the Trauma and Life Events Self-report Inventory twice. Test-retest reliability for the three different time periods was .82, .89, and .75, respectively.

Predicting students' perceptions of academic misconduct on the Hogan Personality Inventory Reliability Scale.

PubMed

Stone, Thomas H; Kisamore, Jennifer L; Jawahar, I M

2008-04-01

Interest and research on academic misconduct has become more salient in part due to recent publicized academic and organizational scandals. The current study investigated a possible interaction between perception of the university's academic culture and personality, conceptualized as Reliability, on students' perceptions of academic misconduct. A convenience sample of 217 university business students (91 men, 126 women), whose average age was 22.3 yr. (SD = 4.4) was tested. Reliability was measured with an occupational scale included in the Hogan Personality Inventory. Two hierarchical regression analyses were conducted using Cheating Intentions and Likelihood of Reporting Cheating as criteria. Age, Reliability, Integrity Culture, and the interaction between scores on Reliability and Integrity Culture were entered as predictors. Only Age and Reliability scores were significant predictors of Cheating Intentions, while all variables were significant predictors for Likelihood of Reporting Cheating. Suggestions for practice and research are provided.

Development of an Extreme High Temperature n-type Ohmic Contact to Silicon Carbide

NASA Technical Reports Server (NTRS)

Evans, Laura J.; Okojie, Robert S.; Lukco, Dorothy

2011-01-01

We report on the initial demonstration of a tungsten-nickel (75:25 at. %) ohmic contact to silicon carbide (SiC) that performed for up to fifteen hours of heat treatment in argon at 1000 C. The transfer length method (TLM) test structure was used to evaluate the contacts. Samples showed consistent ohmic behavior with specific contact resistance values averaging 5 x 10-4 -cm2. The development of this contact metallization should allow silicon carbide devices to operate more reliably at the present maximum operating temperature of 600 C while potentially extending operations to 1000 C. Introduction Silicon Carbide (SiC) is widely recognized as one of the materials of choice for high temperature, harsh environment sensors and electronics due to its ability to survive and continue normal operation in such environments [1]. Sensors and electronics in SiC have been developed that are capable of operating at temperatures of 600 oC. However operating these devices at the upper reliability temperature threshold increases the potential for early degradation. Therefore, it is important to raise the reliability temperature ceiling higher, which would assure increased device reliability when operated at nominal temperature. There are also instances that require devices to operate and survive for prolonged periods of time above 600 oC [2, 3]. This is specifically needed in the area of hypersonic flight where robust sensors are needed to monitor vehicle performance at temperature greater than 1000 C, as well as for use in the thermomechanical characterization of high temperature materials (e.g. ceramic matrix composites). While SiC alone can withstand these temperatures, a major challenge is to develop reliable electrical contacts to the device itself in order to facilitate signal extraction

Test-retest reliability of resting-state magnetoencephalography power in sensor and source space.

PubMed

Martín-Buro, María Carmen; Garcés, Pilar; Maestú, Fernando

2016-01-01

Several studies have reported changes in spontaneous brain rhythms that could be used as clinical biomarkers or in the evaluation of neuropsychological and drug treatments in longitudinal studies using magnetoencephalography (MEG). There is an increasing necessity to use these measures in early diagnosis and pathology progression; however, there is a lack of studies addressing how reliable they are. Here, we provide the first test-retest reliability estimate of MEG power in resting-state at sensor and source space. In this study, we recorded 3 sessions of resting-state MEG activity from 24 healthy subjects with an interval of a week between each session. Power values were estimated at sensor and source space with beamforming for classical frequency bands: delta (2-4 Hz), theta (4-8 Hz), alpha (8-13 Hz), low beta (13-20 Hz), high beta (20-30 Hz), and gamma (30-45 Hz). Then, test-retest reliability was evaluated using the intraclass correlation coefficient (ICC). We also evaluated the relation between source power and the within-subject variability. In general, ICC of theta, alpha, and low beta power was fairly high (ICC > 0.6) while in delta and gamma power was lower. In source space, fronto-posterior alpha, frontal beta, and medial temporal theta showed the most reliable profiles. Signal-to-noise ratio could be partially responsible for reliability as low signal intensity resulted in high within-subject variability, but also the inherent nature of some brain rhythms in resting-state might be driving these reliability patterns. In conclusion, our results described the reliability of MEG power estimates in each frequency band, which could be considered in disease characterization or clinical trials. © 2015 Wiley Periodicals, Inc.

RICOR's new development of a highly reliable integral rotary cooler: engineering and reliability aspects

NASA Astrophysics Data System (ADS)

Filis, Avishai; Pundak, Nachman; Barak, Moshe; Porat, Ze'ev; Jaeger, Mordechai

2011-06-01

The growing demand for EO applications that work around the clock 24hr/7days a week, such as in border surveillance systems, emphasizes the need for a highly reliable cryocooler having increased operational availability and decreased integrated system Life Cycle (ILS) cost. In order to meet this need RICOR has developed a new rotary Stirling cryocooler, model K508N, intended to double the K508's operating MTTF achieving 20,000 operating MTTF hours. The K508N employs RICOR's latest mechanical design technologies such as optimized bearings and greases, bearings preloading, advanced seals, laser welded cold finger and robust design structure with increased natural frequency compared to the K508 model. The cooler enhanced MTTF was demonstrated by a Validation and Verification (V&V) plan comprising analytical means and a comparative accelerated life test between the standard K508 and the K508N models. Particularly, point estimate and confidence interval for the MTTF improvement factor where calculated periodically during and after the test. The (V&V) effort revealed that the K508N meets its MTTF design goal. The paper will focus on the technical and engineering aspects of the new design. In addition it will discuss the market needs and expectations, investigate the reliability data of the present reference K508 model; and report the accelerate life test data and the statistical analysis methodology as well as its underlying assumptions and results.

The reliability of the Australasian Triage Scale: a meta-analysis

PubMed Central

Ebrahimi, Mohsen; Heydari, Abbas; Mazlom, Reza; Mirhaghi, Amir

2015-01-01

BACKGROUND: Although the Australasian Triage Scale (ATS) has been developed two decades ago, its reliability has not been defined; therefore, we present a meta-analyis of the reliability of the ATS in order to reveal to what extent the ATS is reliable. DATA SOURCES: Electronic databases were searched to March 2014. The included studies were those that reported samples size, reliability coefficients, and adequate description of the ATS reliability assessment. The guidelines for reporting reliability and agreement studies (GRRAS) were used. Two reviewers independently examined abstracts and extracted data. The effect size was obtained by the z-transformation of reliability coefficients. Data were pooled with random-effects models, and meta-regression was done based on the method of moment’s estimator. RESULTS: Six studies were included in this study at last. Pooled coefficient for the ATS was substantial 0.428 (95%CI 0.340–0.509). The rate of mis-triage was less than fifty percent. The agreement upon the adult version is higher than the pediatric version. CONCLUSION: The ATS has shown an acceptable level of overall reliability in the emergency department, but it needs more development to reach an almost perfect agreement. PMID:26056538

Research program for experiment M133

NASA Technical Reports Server (NTRS)

Frost, J. D., Jr.

1972-01-01

The development of the automatic data-acquisition and sleep-analysis system is reported. The purpose was consultation and evaluation in the transition of the Skylab M133 Sleep-Monitoring Experiment equipment from prototype of flight status; review of problems associated with acquisition and on-line display of data in near-real time via spacecraft telemetry; and development of laboratory facilities and design of equipment to assure reliable playback and analysis of analog data. The existing prototype system modified, and the changes improve the performance of the analysis circuitry and increase its reliability. These modifications are useful for pre- and postflight analysis, but are not now proposed for the inflight system. There were improvements in the EEG recording cap, some of which will be incorporated into the flight hardware.

Ferroelectric nanoparticle-embedded sponge structure triboelectric generators

NASA Astrophysics Data System (ADS)

Park, Daehoon; Shin, Sung-Ho; Yoon, Ick-Jae; Nah, Junghyo

2018-05-01

We report high-performance triboelectric nanogenerators (TENGs) employing ferroelectric nanoparticles (NPs) embedded in a sponge structure. The ferroelectric BaTiO3 NPs inside the sponge structure play an important role in increasing surface charge density by polarized spontaneous dipoles, enabling the packaging of TENGs even with a minimal separation gap. Since the friction surfaces are encapsulated in the packaged device structure, it suffers negligible performance degradation even at a high relative humidity of 80%. The TENGs also demonstrated excellent mechanical durability due to the elasticity and flexibility of the sponge structure. Consequently, the TENGs can reliably harvest energy even under harsh conditions. The approach introduced here is a simple, effective, and reliable way to fabricate compact and packaged TENGs for potential applications in wearable energy-harvesting devices.

Ferroelectric nanoparticle-embedded sponge structure triboelectric generators.

PubMed

Park, Daehoon; Shin, Sung-Ho; Yoon, Ick-Jae; Nah, Junghyo

2018-05-04

We report high-performance triboelectric nanogenerators (TENGs) employing ferroelectric nanoparticles (NPs) embedded in a sponge structure. The ferroelectric BaTiO 3 NPs inside the sponge structure play an important role in increasing surface charge density by polarized spontaneous dipoles, enabling the packaging of TENGs even with a minimal separation gap. Since the friction surfaces are encapsulated in the packaged device structure, it suffers negligible performance degradation even at a high relative humidity of 80%. The TENGs also demonstrated excellent mechanical durability due to the elasticity and flexibility of the sponge structure. Consequently, the TENGs can reliably harvest energy even under harsh conditions. The approach introduced here is a simple, effective, and reliable way to fabricate compact and packaged TENGs for potential applications in wearable energy-harvesting devices.

Clinical instruments: reliability and validity critical appraisal.

PubMed

Brink, Yolandi; Louw, Quinette A

2012-12-01

RATIONALE, AIM AND OBJECTIVES: There is a lack of health care practitioners using objective clinical tools with sound psychometric properties. There is also a need for researchers to improve their reporting of the validity and reliability results of these clinical tools. Therefore, to promote the use of valid and reliable tools or tests for clinical evaluation, this paper reports on the development of a critical appraisal tool to assess the psychometric properties of objective clinical tools. A five-step process was followed to develop the new critical appraisal tool: (1) preliminary conceptual decisions; (2) defining key concepts; (3) item generation; (4) assessment of face validity; and (5) formulation of the final tool. The new critical appraisal tool consists of 13 items, of which five items relate to both validity and reliability studies, four items to validity studies only and four items to reliability studies. The 13 items could be scored as 'yes', 'no' or 'not applicable'. This critical appraisal tool will aid both the health care practitioner to critically appraise the relevant literature and researchers to improve the quality of reporting of the validity and reliability of objective clinical tools. © 2011 Blackwell Publishing Ltd.

Earth Observing System/Advanced Microwave Sounding Unit-A (EOS/AMSU-A): Reliability prediction report for module A1 (channels 3 through 15) and module A2 (channels 1 and 2)

NASA Technical Reports Server (NTRS)

Geimer, W.

1995-01-01

This report documents the final reliability prediction performed on the Earth Observing System/Advanced Microwave Sounding Unit-A (EOS/AMSU-A). The A1 Module contains Channels 3 through 15, and is referred to herein as 'EOS/AMSU-A1'. The A2 Module contains Channels 1 and 2, and is referred herein as 'EOS/AMSU-A2'. The 'specified' figures were obtained from Aerojet Reports 8897-1 and 9116-1. The predicted reliability figure for the EOS/AMSU-A1 meets the specified value and provides a Mean Time Between Failures (MTBF) of 74,390 hours. The predicted reliability figure for the EOS/AMSU-A2 meets the specified value and provides a MTBF of 193,110 hours.

Evaluation of the Transit Reliability Information Program

DOT National Transportation Integrated Search

1982-06-01

This report presents an evaluation of the rail portion of the Transit Reliability Information Program (TRIP), which was designed to collect and analyze equipment reliability data on U.S. transit systems. This assessment was conducted at the end of it...

Incorporating travel time reliability into the Highway Capacity Manual.

DOT National Transportation Integrated Search

2014-01-01

This final report documents the activities performed during SHRP 2 Reliability Project L08: Incorporating Travel Time Reliability into the Highway Capacity Manual. It serves as a supplement to the proposed chapters for incorporating travel time relia...

Development of a self-report questionnaire designed for population-based surveillance of gingivitis in adolescents: assessment of content validity and reliability.

PubMed

Quiroz, Viviana; Reinero, Daniela; Hernández, Patricia; Contreras, Johanna; Vernal, Rolando; Carvajal, Paola

2017-01-01

This study aimed to develop and assess the content validity and reliability of a cognitively adapted self-report questionnaire designed for surveillance of gingivitis in adolescents. Ten predetermined self-report questions evaluating early signs and symptoms of gingivitis were preliminary assessed by a panel of clinical experts. Eight questions were selected and cognitively tested in 20 adolescents aged 12 to 18 years from Santiago de Chile. The questionnaire was then conducted and answered by 178 Chilean adolescents. Internal consistency was measured using the Cronbach's alpha and temporal stability was calculated using the Kappa-index. A reliable final self-report questionnaire consisting of 5 questions was obtained, with a total Cronbach's alpha of 0.73 and a Kappa-index ranging from 0.41 to 0.77 between the different questions. The proposed questionnaire is reliable, with an acceptable internal consistency and a temporal stability from moderate to substantial, and it is promising for estimating the prevalence of gingivitis in adolescents.

Electrical characteristics of high-power AlGaN-GaN high electron mobility transistors irradiated with protons and heavy ions

NASA Astrophysics Data System (ADS)

Sin, Yongkun; Bonsall, Jeremy; Lingley, Zachary; Brodie, Miles; Mason, Maribeth

2017-02-01

High electron mobility transistors (HEMTs) based on AlGaN-GaN hetero-structures are finding an increasing number of commercial and military applications that require high voltage, high power, and high efficiency operation. In recent years, leading GaN HEMT manufacturers have reported excellent RF power characteristics and encouraging reliability, but long-term reliability in the space environment still remains a major concern due to a large number of defects and traps present both in the bulk as well as at the surface, leading to undesirable characteristics including current collapse. Furthermore, degradation mechanisms in GaN HEMTs are still not well understood. Thus, reliability and radiation effects of GaN HEMTs should be studied before solid state power amplifiers (SSPAs) based on GaN HEMT technology are successfully deployed in space satellite systems. For the present study, we investigated electrical characteristics of high-power GaN HEMTs irradiated with protons and heavy ions under various irradiation and biasing conditions.

Some Aspects of the Failure Mechanisms in BaTiO3-Based Multilayer Ceramic Capacitors

NASA Technical Reports Server (NTRS)

Liu, David Donhang; Sampson, Michael J.

2012-01-01

The objective of this presentation is to gain insight into possible failure mechanisms in BaTiO3-based ceramic capacitors that may be associated with the reliability degradation that accompanies a reduction in dielectric thickness, as reported by Intel Corporation in 2010. The volumetric efficiency (microF/cm3) of a multilayer ceramic capacitor (MLCC) has been shown to not increase limitlessly due to the grain size effect on the dielectric constant of ferroelectric ceramic BaTiO3 material. The reliability of an MLCC has been discussed with respect to its structure. The MLCCs with higher numbers of dielectric layers will pose more challenges for the reliability of dielectric material, which is the case for most base-metal-electrode (BME) capacitors. A number of MLCCs manufactured using both precious-metal-electrode (PME) and BME technology, with 25 V rating and various chip sizes and capacitances, were tested at accelerated stress levels. Most of these MLCCs had a failure behavior with two mixed failure modes: the well-known rapid dielectric wearout, and so-called 'early failures." The two failure modes can be distinguished when the testing data were presented and normalized at use-level using a 2-parameter Weibull plot. The early failures had a slope parameter of Beta >1, indicating that the early failures are not infant mortalities. Early failures are triggered due to external electrical overstress and become dominant as dielectric layer thickness decreases, accompanied by a dramatic reduction in reliability. This indicates that early failures are the main cause of the reliability degradation in MLCCs as dielectric layer thickness decreases. All of the early failures are characterized by an avalanche-like breakdown leakage current. The failures have been attributed to the extrinsic minor construction defects introduced during fabrication of the capacitors. A reliability model including dielectric thickness and extrinsic defect feature size is proposed in this presentation. The model can be used to explain the Intel-reported reliability degradation in MLCCs with respect to the reduction of dielectric thickness. It can also be used to estimate the reliability of a MLCC based on its construction and microstructure parameters such as dielectric thickness, average grain size, and number of dielectric layers. Measures for preventing early failures are also discussed in this document.

Reliability and validity of the symptoms of major depressive illness.

PubMed

Mazure, C; Nelson, J C; Price, L H

1986-05-01

In two consecutive studies, we examined the interrater reliability and then the concurrent validity of interview ratings for individual symptoms of major depressive illness. The concurrent validity of symptoms was determined by assessing the degree to which symptoms observed or reported during an interview were observed in daily behavior. Results indicated that most signs and symptoms of major depression and melancholia can be reliably rated by clinicians during a semistructured interview. Ratings of observable symptoms (signs) assessed during the interview were valid indicators of dysfunction observed in daily behavior. Several but not all ratings based on patient report of symptoms were at variance with observation. These discordant patient-reported symptoms may have value as subjective reports but were not accurate descriptions of observed dysfunction.

Interrater reliability of schizoaffective disorder compared with schizophrenia, bipolar disorder, and unipolar depression - A systematic review and meta-analysis.

PubMed

Santelmann, Hanno; Franklin, Jeremy; Bußhoff, Jana; Baethge, Christopher

2016-10-01

Schizoaffective disorder is a common diagnosis in clinical practice but its nosological status has been subject to debate ever since it was conceptualized. Although it is key that diagnostic reliability is sufficient, schizoaffective disorder has been reported to have low interrater reliability. Evidence based on systematic review and meta-analysis methods, however, is lacking. Using a highly sensitive literature search in Medline, Embase, and PsycInfo we identified studies measuring the interrater reliability of schizoaffective disorder in comparison to schizophrenia, bipolar disorder, and unipolar disorder. Out of 4126 records screened we included 25 studies reporting on 7912 patients diagnosed by different raters. The interrater reliability of schizoaffective disorder was moderate (meta-analytic estimate of Cohen's kappa 0.57 [95% CI: 0.41-0.73]), and substantially lower than that of its main differential diagnoses (difference in kappa between 0.22 and 0.19). Although there was considerable heterogeneity, analyses revealed that the interrater reliability of schizoaffective disorder was consistently lower in the overwhelming majority of studies. The results remained robust in subgroup and sensitivity analyses (e.g., diagnostic manual used) as well as in meta-regressions (e.g., publication year) and analyses of publication bias. Clinically, the results highlight the particular importance of diagnostic re-evaluation in patients diagnosed with schizoaffective disorder. They also quantify a widely held clinical impression of lower interrater reliability and agree with earlier meta-analysis reporting low test-retest reliability. Copyright © 2016. Published by Elsevier B.V.

Diagnostic methods for assessing maxillary skeletal and dental transverse deficiencies: A systematic review

PubMed Central

Sawchuk, Dena; Currie, Kris; Vich, Manuel Lagravere; Palomo, Juan Martin

2016-01-01

Objective To evaluate the accuracy and reliability of the diagnostic tools available for assessing maxillary transverse deficiencies. Methods An electronic search of three databases was performed from their date of establishment to April 2015, with manual searching of reference lists of relevant articles. Articles were considered for inclusion if they reported the accuracy or reliability of a diagnostic method or evaluation technique for maxillary transverse dimensions in mixed or permanent dentitions. Risk of bias was assessed in the included articles, using the Quality Assessment of Diagnostic Accuracy Studies tool-2. Results Nine articles were selected. The studies were heterogeneous, with moderate to low methodological quality, and all had a high risk of bias. Four suggested that the use of arch width prediction indices with dental cast measurements is unreliable for use in diagnosis. Frontal cephalograms derived from cone-beam computed tomography (CBCT) images were reportedly more reliable for assessing intermaxillary transverse discrepancies than posteroanterior cephalograms. Two studies proposed new three-dimensional transverse analyses with CBCT images that were reportedly reliable, but have not been validated for clinical sensitivity or specificity. No studies reported sensitivity, specificity, positive or negative predictive values or likelihood ratios, or ROC curves of the methods for the diagnosis of transverse deficiencies. Conclusions Current evidence does not enable solid conclusions to be drawn, owing to a lack of reliable high quality diagnostic studies evaluating maxillary transverse deficiencies. CBCT images are reportedly more reliable for diagnosis, but further validation is required to confirm CBCT's accuracy and diagnostic superiority. PMID:27668196

Rater methodology for stroboscopy: a systematic review.

PubMed

Bonilha, Heather Shaw; Focht, Kendrea L; Martin-Harris, Bonnie

2015-01-01

Laryngeal endoscopy with stroboscopy (LES) remains the clinical gold standard for assessing vocal fold function. LES is used to evaluate the efficacy of voice treatments in research studies and clinical practice. LES as a voice treatment outcome tool is only as good as the clinician interpreting the recordings. Research using LES as a treatment outcome measure should be evaluated based on rater methodology and reliability. The purpose of this literature review was to evaluate the rater-related methodology from studies that use stroboscopic findings as voice treatment outcome measures. Systematic literature review. Computerized journal databases were searched for relevant articles using terms: stroboscopy and treatment. Eligible articles were categorized and evaluated for the use of rater-related methodology, reporting of number of raters, types of raters, blinding, and rater reliability. Of the 738 articles reviewed, 80 articles met inclusion criteria. More than one-third of the studies included in the review did not report the number of raters who participated in the study. Eleven studies reported results of rater reliability analysis with only two studies reporting good inter- and intrarater reliability. The comparability and use of results from treatment studies that use LES are limited by a lack of rigor in rater methodology and variable, mostly poor, inter- and intrarater reliability. To improve our ability to evaluate and use the findings from voice treatment studies that use LES features as outcome measures, greater consistency of reporting rater methodology characteristics across studies and improved rater reliability is needed. Copyright © 2015 The Voice Foundation. Published by Elsevier Inc. All rights reserved.

Reliability and statistical power analysis of cortical and subcortical FreeSurfer metrics in a large sample of healthy elderly.

PubMed

Liem, Franziskus; Mérillat, Susan; Bezzola, Ladina; Hirsiger, Sarah; Philipp, Michel; Madhyastha, Tara; Jäncke, Lutz

2015-03-01

FreeSurfer is a tool to quantify cortical and subcortical brain anatomy automatically and noninvasively. Previous studies have reported reliability and statistical power analyses in relatively small samples or only selected one aspect of brain anatomy. Here, we investigated reliability and statistical power of cortical thickness, surface area, volume, and the volume of subcortical structures in a large sample (N=189) of healthy elderly subjects (64+ years). Reliability (intraclass correlation coefficient) of cortical and subcortical parameters is generally high (cortical: ICCs>0.87, subcortical: ICCs>0.95). Surface-based smoothing increases reliability of cortical thickness maps, while it decreases reliability of cortical surface area and volume. Nevertheless, statistical power of all measures benefits from smoothing. When aiming to detect a 10% difference between groups, the number of subjects required to test effects with sufficient power over the entire cortex varies between cortical measures (cortical thickness: N=39, surface area: N=21, volume: N=81; 10mm smoothing, power=0.8, α=0.05). For subcortical regions this number is between 16 and 76 subjects, depending on the region. We also demonstrate the advantage of within-subject designs over between-subject designs. Furthermore, we publicly provide a tool that allows researchers to perform a priori power analysis and sensitivity analysis to help evaluate previously published studies and to design future studies with sufficient statistical power. Copyright © 2014 Elsevier Inc. All rights reserved.

Score Reliability: A Retrospective Look Back at 12 Years of Reliability Generalization Studies

ERIC Educational Resources Information Center

Vacha-Haase, Tammi; Thompson, Bruce

2011-01-01

The present study was conducted to characterize (a) the features of the thousands of primary reports synthesized in 47 reliability generalization (RG) measurement meta-analysis studies and (b) typical methodological practice within the RG literature to date. With respect to the treatment of score reliability in the literature, in an astounding…

Longitudinal Reliability of Self-Reported Age at Menarche in Adolescent Girls: Variability across Time and Setting

ERIC Educational Resources Information Center

Dorn, Lorah D.; Sontag-Padilla, Lisa M.; Pabst, Stephanie; Tissot, Abbigail; Susman, Elizabeth J.

2013-01-01

Age at menarche is critical in research and clinical settings, yet there is a dearth of studies examining its reliability in adolescents. We examined age at menarche during adolescence, specifically, (a) average method reliability across 3 years, (b) test-retest reliability between time points and methods, (c) intraindividual variability of…

A Dialogue about MCQs, Reliability, and Item Response Modelling

ERIC Educational Resources Information Center

Wright, Daniel B.; Skagerberg, Elin M.

2006-01-01

Multiple choice questions (MCQs) are becoming more common in UK psychology departments and the need to assess their reliability is apparent. Having examined the reliability of MCQs in our department we faced many questions from colleagues about why we were examining reliability, what it was that we were doing, and what should be reported when…

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations

PubMed Central

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2016-01-01

Aim To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. Methods The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. Results A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90–0.97) in Brazil and 0.81 (95% confidence interval 0.66–0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. Conclusions These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective perfor mance measures. PMID:24666718

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations.

PubMed

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2014-10-01

To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90-0.97) in Brazil and 0.81 (95% confidence interval 0.66-0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective performance measures. © 2013 Japan Geriatrics Society.

Development and psychometric evaluation of the Decisional Engagement Scale (DES-10): A patient-reported psychosocial survey for quality cancer care.

PubMed

Hoerger, Michael; Chapman, Benjamin P; Mohile, Supriya G; Duberstein, Paul R

2016-09-01

In light of recent health care reforms, we have provided an illustrative example of new opportunities available for psychologists to develop patient-reported measures related to health care quality. Patient engagement in health care decision making has been increasingly acknowledged as a vital component of quality cancer care. We developed the 10-item Decisional Engagement Scale (DES-10), a patient-reported measure of engagement in decision making in cancer care that assesses patients' awareness of their diagnosis, sense of empowerment and involvement, and level of information seeking and planning. The National Institutes of Health's ResearchMatch recruitment tool was used to facilitate Internet-mediated data collection from 376 patients with cancer. DES-10 scores demonstrated good internal consistency reliability (α = .80), and the hypothesized unidimensional factor structure fit the data well. The reliability and factor structure were supported across subgroups based on demographic, socioeconomic, and health characteristics. Higher DES-10 scores were associated with better health-related quality of life (r = .31). In concurrent validity analyses controlling for age, socioeconomic status, and health-related quality of life, higher DES-10 scores were associated with higher scores on quality-of-care indices, including greater awareness of one's treatments, greater preferences for shared decision making, and clearer preferences about end-of-life care. A mini-measure, the DES-3, also performed well psychometrically. In conclusion, DES-10 and DES-3 scores showed evidence of reliability and validity, and these brief patient-reported measures can be used by researchers, clinicians, nonprofits, hospitals, insurers, and policymakers interested in evaluating and improving the quality of cancer care. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Portfolio Assessment: Increasing Reliability and Validity.

ERIC Educational Resources Information Center

Griffee, Dale

2002-01-01

Addresses the traditional understanding of reliability as it pertains to writing portfolio assessments. Offers a list of practical actions that can be taken to increase assessment reliability, including explicit definitions of what a portfolio holds, rater training, rater burnout, and consistent rating procedures. (Contains 26 references.) (NB)

Gearbox Reliability Collaborative Phase 3 Gearbox 3 Test Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Keller, Jonathan; Wallen, Robb

Many gearboxes in wind turbines do not achieve their expected design life; they do, however, commonly meet or exceed the design criteria specified in current standards in the gear, bearing, and wind turbine industry as well as third-party certification criteria. The cost of gearbox replacements and rebuilds, as well as the downtime associated with these failures, increases the cost of wind energy. In 2007, the U.S. Department of Energy established the National Renewable Energy Laboratory (NREL) Gearbox Reliability Collaborative (GRC). Its goals are to understand the root causes of premature gearbox failures and to improve their reliability. The GRC ismore » examining a hypothesis that the gap between design-estimated and actual wind turbine gearbox reliability is caused by underestimation of loads, inaccurate design tools, the absence of critical elements in the design process, or insufficient testing. This report describes the recently completed tests of GRC Gearbox 3 in the National Wind Technology Center dynamometer and documents any modifications to the original test plan. In this manner, it serves as a guide for interpreting the publicly released data sets with brief analyses to illustrate the data. The primary test objective was to measure the planetary load-sharing characteristics in the same conditions as the original GRC gearbox design. If the measured load-sharing characteristics are close to the design model, the projected improvement in planetary section fatigue life and the efficacy of preloaded TRBs in mitigating the planetary bearing fatigue failure mode will have been demonstrated. Detailed analysis of that test objective will be presented in subsequent publications.« less

Development of Valid and Reliable Measures of Patient and Family Experiences of Hospice Care for Public Reporting.

PubMed

Anhang Price, Rebecca; Stucky, Brian; Parast, Layla; Elliott, Marc N; Haas, Ann; Bradley, Melissa; Teno, Joan M

2018-03-20

Increasingly, dying patients and their families have a choice of hospice providers. Care quality varies considerably across providers; informing consumers of these differences may help to improve their selection of hospices. To develop and evaluate standardized survey measures of hospice care experiences for the purpose of comparing and publicly reporting hospice performance. We assessed item performance and constructed composite measures by factor analysis, evaluating item-scale correlations and estimating reliability. To assess key drivers of overall experiences, we regressed overall rating and willingness to recommend the hospice on each composite. Data submitted by 2500 hospices participating in national implementation of the Consumer Assessment of Healthcare Providers and Systems (CAHPS ® ) Hospice Survey for April through September 2015. Composite measures of Hospice Team Communication, Getting Timely Care, Treating Family Member with Respect, Getting Emotional and Religious Support, Getting Help for Symptoms, and Getting Hospice Care Training. Cronbach's alpha estimates for the composite measures range from 0.61 to 0.85; hospice-level reliability for the measures range from 0.67 to 0.81 assuming 200 completed surveys per hospice. Together, the composites are responsible for 48% of the variance in caregivers' overall ratings of hospices. Hospice Team Communication is the strongest predictor of overall rating of care. Our analyses provide evidence of the reliability and validity of CAHPS Hospice Survey measure scores. Results also highlight important opportunities to improve the quality of hospice care, particularly with regard to addressing symptoms of anxiety and sadness, discussing side effects of pain medicine, and keeping family informed of the patient's condition.

Utility of computer-assisted approaches for population surveillance of physical activity.

PubMed

Creamer, MeLisa; Bowles, Heather R; von Hofe, Belinda; Pettee Gabriel, Kelley; Kohl, Harold W; Bauman, Adrian

2014-08-01

Computer-assisted techniques may be a useful way to enhance physical activity surveillance and increase accuracy of reported behaviors. Evaluate the reliability and validity of a physical activity (PA) self-report instrument administered by telephone and internet. The telephone-administered Active Australia Survey was adapted into 2 forms for internet self-administration: survey questions only (internet-text) and with videos demonstrating intensity (internet-video). Data were collected from 158 adults (20-69 years, 61% female) assigned to telephone (telephone-interview) (n = 56), internet-text (n = 51), or internet-video (n = 51). Participants wore an accelerometer and completed a logbook for 7 days. Test-retest reliability was assessed using intraclass correlation coefficients (ICC). Convergent validity was assessed using Spearman correlations. Strong test-retest reliability was observed for PA variables in the internet-text (ICC = 0.69 to 0.88), internet-video (ICC = 0.66 to 0.79), and telephone-interview (ICC = 0.69 to 0.92) groups (P-values < 0.001). For total PA, correlations (ρ) between the survey and Actigraph+logbook were ρ = 0.47 for the internet-text group, ρ = 0.57 for the internet-video group, and ρ = 0.65 for the telephone-interview group. For vigorous-intensity activity, the correlations between the survey and Actigraph+logbook were 0.52 for internet-text, 0.57 for internet-video, and 0.65 for telephone-interview (P < .05). Internet-video of the survey had similar test-retest reliability and convergent validity when compared with the telephone-interview, and should continue to be developed.

Digital Sensor Technology

DOE Office of Scientific and Technical Information (OSTI.GOV)

Thomas, Ken D.; Quinn, Edward L.; Mauck, Jerry L.

The nuclear industry has been slow to incorporate digital sensor technology into nuclear plant designs due to concerns with digital qualification issues. However, the benefits of digital sensor technology for nuclear plant instrumentation are substantial in terms of accuracy and reliability. This paper, which refers to a final report issued in 2013, demonstrates these benefits in direct comparisons of digital and analog sensor applications. Improved accuracy results from the superior operating characteristics of digital sensors. These include improvements in sensor accuracy and drift and other related parameters which reduce total loop uncertainty and thereby increase safety and operating margins. Anmore » example instrument loop uncertainty calculation for a pressure sensor application is presented to illustrate these improvements. This is a side-by-side comparison of the instrument loop uncertainty for both an analog and a digital sensor in the same pressure measurement application. Similarly, improved sensor reliability is illustrated with a sample calculation for determining the probability of failure on demand, an industry standard reliability measure. This looks at equivalent analog and digital temperature sensors to draw the comparison. The results confirm substantial reliability improvement with the digital sensor, due in large part to ability to continuously monitor the health of a digital sensor such that problems can be immediately identified and corrected. This greatly reduces the likelihood of a latent failure condition of the sensor at the time of a design basis event. Notwithstanding the benefits of digital sensors, there are certain qualification issues that are inherent with digital technology and these are described in the report. One major qualification impediment for digital sensor implementation is software common cause failure (SCCF).« less

Test-Retest Reliability of Pediatric Heart Rate Variability: A Meta-Analysis.

PubMed

Weiner, Oren M; McGrath, Jennifer J

2017-01-01

Heart rate variability (HRV), an established index of autonomic cardiovascular modulation, is associated with health outcomes (e.g., obesity, diabetes) and mortality risk. Time- and frequency-domain HRV measures are commonly reported in longitudinal adult and pediatric studies of health. While test-retest reliability has been established among adults, less is known about the psychometric properties of HRV among infants, children, and adolescents. The objective was to conduct a meta-analysis of the test-retest reliability of time- and frequency-domain HRV measures from infancy to adolescence. Electronic searches (PubMed, PsycINFO; January 1970-December 2014) identified studies with nonclinical samples aged ≤ 18 years; ≥ 2 baseline HRV recordings separated by ≥ 1 day; and sufficient data for effect size computation. Forty-nine studies ( N = 5,170) met inclusion criteria. Methodological variables coded included factors relevant to study protocol, sample characteristics, electrocardiogram (ECG) signal acquisition and preprocessing, and HRV analytical decisions. Fisher's Z was derived as the common effect size. Analyses were age-stratified (infant/toddler < 5 years, n = 3,329; child/adolescent 5-18 years, n = 1,841) due to marked methodological differences across the pediatric literature. Meta-analytic results revealed HRV demonstrated moderate reliability; child/adolescent studies ( Z = 0.62, r = 0.55) had significantly higher reliability than infant/toddler studies ( Z = 0.42, r = 0.40). Relative to other reported measures, HF exhibited the highest reliability among infant/toddler studies ( Z = 0.42, r = 0.40), while rMSSD exhibited the highest reliability among child/adolescent studies ( Z = 1.00, r = 0.76). Moderator analyses indicated greater reliability with shorter test-retest interval length, reported exclusion criteria based on medical illness/condition, lower proportion of males, prerecording acclimatization period, and longer recording duration; differences were noted across age groups. HRV is reliable among pediatric samples. Reliability is sensitive to pertinent methodological decisions that require careful consideration by the researcher. Limited methodological reporting precluded several a priori moderator analyses. Suggestions for future research, including standards specified by Task Force Guidelines, are discussed.

Test-Retest Reliability of Pediatric Heart Rate Variability

PubMed Central

Weiner, Oren M.; McGrath, Jennifer J.

2017-01-01

Heart rate variability (HRV), an established index of autonomic cardiovascular modulation, is associated with health outcomes (e.g., obesity, diabetes) and mortality risk. Time- and frequency-domain HRV measures are commonly reported in longitudinal adult and pediatric studies of health. While test-retest reliability has been established among adults, less is known about the psychometric properties of HRV among infants, children, and adolescents. The objective was to conduct a meta-analysis of the test-retest reliability of time- and frequency-domain HRV measures from infancy to adolescence. Electronic searches (PubMed, PsycINFO; January 1970–December 2014) identified studies with nonclinical samples aged ≤ 18 years; ≥ 2 baseline HRV recordings separated by ≥ 1 day; and sufficient data for effect size computation. Forty-nine studies (N = 5,170) met inclusion criteria. Methodological variables coded included factors relevant to study protocol, sample characteristics, electrocardiogram (ECG) signal acquisition and preprocessing, and HRV analytical decisions. Fisher’s Z was derived as the common effect size. Analyses were age-stratified (infant/toddler < 5 years, n = 3,329; child/adolescent 5–18 years, n = 1,841) due to marked methodological differences across the pediatric literature. Meta-analytic results revealed HRV demonstrated moderate reliability; child/adolescent studies (Z = 0.62, r = 0.55) had significantly higher reliability than infant/toddler studies (Z = 0.42, r = 0.40). Relative to other reported measures, HF exhibited the highest reliability among infant/toddler studies (Z = 0.42, r = 0.40), while rMSSD exhibited the highest reliability among child/adolescent studies (Z = 1.00, r = 0.76). Moderator analyses indicated greater reliability with shorter test-retest interval length, reported exclusion criteria based on medical illness/condition, lower proportion of males, prerecording acclimatization period, and longer recording duration; differences were noted across age groups. HRV is reliable among pediatric samples. Reliability is sensitive to pertinent methodological decisions that require careful consideration by the researcher. Limited methodological reporting precluded several a priori moderator analyses. Suggestions for future research, including standards specified by Task Force Guidelines, are discussed. PMID:29307951

Development and evaluation of an office ergonomic risk checklist: ROSA--rapid office strain assessment.

PubMed

Sonne, Michael; Villalta, Dino L; Andrews, David M

2012-01-01

The Rapid Office Strain Assessment (ROSA) was designed to quickly quantify risks associated with computer work and to establish an action level for change based on reports of worker discomfort. Computer use risk factors were identified in previous research and standards on office design for the chair, monitor, telephone, keyboard and mouse. The risk factors were diagrammed and coded as increasing scores from 1 to 3. ROSA final scores ranged in magnitude from 1 to 10, with each successive score representing an increased presence of risk factors. Total body discomfort and ROSA final scores for 72 office workstations were significantly correlated (R = 0.384). ROSA final scores exhibited high inter- and intra-observer reliability (ICCs of 0.88 and 0.91, respectively). Mean discomfort increased with increasing ROSA scores, with a significant difference occurring between scores of 3 and 5 (out of 10). A ROSA final score of 5 might therefore be useful as an action level indicating when immediate change is necessary. ROSA proved to be an effective and reliable method for identifying computer use risk factors related to discomfort. Copyright © 2011 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Development of an Output-based Adaptive Method for Multi-Dimensional Euler and Navier-Stokes Simulations

NASA Technical Reports Server (NTRS)

Darmofal, David L.

2003-01-01

The use of computational simulations in the prediction of complex aerodynamic flows is becoming increasingly prevalent in the design process within the aerospace industry. Continuing advancements in both computing technology and algorithmic development are ultimately leading to attempts at simulating ever-larger, more complex problems. However, by increasing the reliance on computational simulations in the design cycle, we must also increase the accuracy of these simulations in order to maintain or improve the reliability arid safety of the resulting aircraft. At the same time, large-scale computational simulations must be made more affordable so that their potential benefits can be fully realized within the design cycle. Thus, a continuing need exists for increasing the accuracy and efficiency of computational algorithms such that computational fluid dynamics can become a viable tool in the design of more reliable, safer aircraft. The objective of this research was the development of an error estimation and grid adaptive strategy for reducing simulation errors in integral outputs (functionals) such as lift or drag from from multi-dimensional Euler and Navier-Stokes simulations. In this final report, we summarize our work during this grant.

Incident learning in pursuit of high reliability: implementing a comprehensive, low-threshold reporting program in a large, multisite radiation oncology department.

PubMed

Gabriel, Peter E; Volz, Edna; Bergendahl, Howard W; Burke, Sean V; Solberg, Timothy D; Maity, Amit; Hahn, Stephen M

2015-04-01

Incident learning programs have been recognized as cornerstones of safety and quality assurance in so-called high reliability organizations in industries such as aviation and nuclear power. High reliability organizations are distinguished by their drive to continuously identify and proactively address a broad spectrum of latent safety issues. Many radiation oncology institutions have reported on their experience in tracking and analyzing adverse events and near misses but few have incorporated the principles of high reliability into their programs. Most programs have focused on the reporting and retrospective analysis of a relatively small number of significant adverse events and near misses. To advance a large, multisite radiation oncology department toward high reliability, a comprehensive, cost-effective, electronic condition reporting program was launched to enable the identification of a broad spectrum of latent system failures, which would then be addressed through a continuous quality improvement process. A comprehensive program, including policies, work flows, and information system, was designed and implemented, with use of a low reporting threshold to focus on precursors to adverse events. In a 46-month period from March 2011 through December 2014, a total of 8,504 conditions (average, 185 per month, 1 per patient treated, 3.9 per 100 fractions [individual treatments]) were reported. Some 77.9% of clinical staff members reported at least 1 condition. Ninety-eight percent of conditions were classified in the lowest two of four severity levels, providing the opportunity to address conditions before they contribute to adverse events. Results after approximately four years show excellent employee engagement, a sustained rate of reporting, and a focus on low-level issues leading to proactive quality improvement interventions.

Understanding and Measuring Coach–Teacher Alliance: A Glimpse Inside the ‘Black Box’

PubMed Central

Pas, Elise T.; Bradshaw, Catherine P.

2016-01-01

Coaching models are increasingly used in schools to enhance fidelity and effectiveness of evidence-based interventions; yet, little is known about the relationship between the coach and teacher (i.e., coach–teacher alliance), which may indirectly enhance teacher and student outcomes through improved implementation quality. There is also limited research on measures of coach–teacher alliance, further hindering the field from understanding the active components for successful coaching. The current study examined the factor structure and psychometric characteristics of a measure of coach–teacher alliance as reported by both teachers and coaches and explored the extent to which teachers and coaches reliably rate their alliance. Data come from a sample of 147 teachers who received implementation support from one of four coaches; both the teacher and the coach completed an alliance questionnaire. Separate confirmatory factor analyses for each informant revealed four factors (relationship, process, investment, and perceived benefits) as well as an additional coach-rated factor (perceived teacher barriers). A series of analyses, including cross-rater correlations, intraclass correlation coefficients, and Kuder-Richardson reliability estimates suggested that teachers and coaches provide reliable, though not redundant, information about the alliance. Implications for future research and the utilization of the parallel coach–teacher alliance measures to increase the effectiveness of coaching are discussed. PMID:26872479

Reliability and Validity of a New Physical Activity Self-Report Measure for Younger Children

ERIC Educational Resources Information Center

Belton, Sarahjane; Mac Donncha, Ciaran

2010-01-01

The purpose of this study was to assess the test-retest reliability and validity of a new Youth Physical Activity Self-Report measure. Heart rate and direct observation were employed as criterion measures with a sample of 79 children (aged 7-9 years). Spearman's rho correlation between self reported activity intensity and heart rate was 0.87 for…

Reliability of rapid reporting of cancers in New Hampshire.

PubMed

Celaya, Maria O; Riddle, Bruce L; Cherala, Sai S; Armenti, Karla R; Rees, Judy R

2010-01-01

The New Hampshire State Cancer Registry (NHSCR) has a 2-phase reporting system. An abbreviated, "rapid" report of cancer diagnosis or treatment is due to the central registry within 45 days of diagnosis and a more detailed, definitive report is due within 180 days. Rapid reports are used for various research studies, but researchers who contact patients are warned that the rapid reports may contain inaccuracies. This study aimed to assess the reliability of rapid cancer reports. For diagnosis years 2000-2004, we compared the rapid and definitive reports submitted to NHSCR. We calculated the sensitivity and positive predictive value of rapid reports; the reliability of key data items overall and for major sites; and the time between diagnosis and submission of the report. Rapid reports identified incident cancer cases with a sensitivity of 88.5%. The overall accuracy of key data items was high. The accuracy of primary sites identified by rapid reports was high generally but lower for ovarian and unknown primaries. A subset analysis showed that 47% of cancers were reported within 90 days of diagnosis. Rapid reports submitted to NHSCR are generally of high quality and present a useful opportunity for research investigations in New Hampshire.

Development of an Integrated, Computer-Based, Bibliographical Data System for a Large University Library. Annual Report to the National Science Foundation from the University of Chicago Library, 1967-68.

ERIC Educational Resources Information Center

Fussler, Herman H.; Payne, Charles T.

The project's second year (1967/68) was devoted to upgrading the computer operating software and programs to increase versatility and reliability. General conclusions about the program after 24 months of operation are that the project's objectives are sound and that effective utilization of computer-aided bibliographic data processing is essential…

Report to Congress on Sustainable Ranges, 2013

DTIC Science & Technology

2013-04-01

to renewable energy, particularly wind turbines offshore. DoD and BOEM have assessed over 2,000 lease blocks on the Atlantic Outer Continental Shelf... wind turbines off-range affects the accuracy and reliability of radar systems used on the range. An emerging challenge on ranges is the increased...adversely affect range operations. Concerns are site-specific but often include wind turbine impacts to radar, the impact of excessive lighting on

Using patient acuity data to manage patient care outcomes and patient care costs.

PubMed

Van Slyck, A; Johnson, K R

2001-01-01

This article describes actual reported uses for patient acuity data that go beyond historical uses in determining staffing allocations. These expanded uses include managing patient care outcomes and health care costs. The article offers the patient care executive examples of how objective, valid, and reliable data are used to drive approaches to effectively influence decision making in an increasingly competitive health care environment.

Review of Literature on Probability of Detection for Liquid Penetrant Nondestructive Testing

DTIC Science & Technology

2011-11-01

increased maintenance costs , or catastrophic failure of safety- critical structure. Knowledge of the reliability achieved by NDT methods, including...representative components to gather data for statistical analysis, which can be prohibitively expensive. To account for sampling variability inherent in any...Sioux City and Pensacola. (Those recommendations were discussed in Section 3.4.) Drury et al report on a factorial experiment aimed at identifying the

Determinants and Effects of Voice Disorders among Secondary School Teachers in Peninsular Malaysia Using a Validated Malay Version of VHI-10

PubMed Central

Moy, Foong Ming; Hoe, Victor Chee Wai; Hairi, Noran Naqiah; Chu, Anne Hin Yee; Bulgiba, Awang; Koh, David

2015-01-01

Objectives To establish the prevalence of voice disorder using the Malay-Voice Handicap Index 10 (Malay-VHI-10) and to study the determinants, quality of life, depression, anxiety and stress associated with voice disorder among secondary school teachers in Peninsular Malaysia. Methods This study was divided into two phases. Phase I tested the reliability of the Malay-VHI-10 while Phase II was a cross-sectional study with two-stage sampling. In Phase II, a self-administered questionnaire was used to collect socio-demographic and teaching characteristics, depression, anxiety and stress scale (Malay version of DASS-21); and health-related quality of life (Malay version of SF12-v2). Complex sample analysis was conducted using multivariate Poisson regression with robust variance. Results In Phase I, the Spearman correlation coefficient and Cronbach alpha for total VHI-10 score was 0.72 (p < 0.001) and 0.77 respectively; showing good correlation and internal consistency. The ICCs ranged from 0.65 to 0.78 showing fair to good reliability and demonstrating the subscales to be reliable and stable. A total of 6039 teachers participated in Phase II. They were primarily Malays, females, married, had completed tertiary education and aged between 30 to 50 years. A total of 10.4% (95% CI 7.1, 14.9) of the teachers had voice disorder (VHI-10 score > 11). Compared to Malays, a greater proportion of ethnic Chinese teachers reported voice disorder while ethnic Indian teachers were less likely to report this problem. There was a higher prevalence ratio (PR) of voice disorder among single or divorced/widowed teachers. Teachers with voice disorder were more likely to report higher rates of absenteeism (PR: 1.70, 95% CI 1.33, 2.19), lower quality of life with lower SF12-v2 physical (0.98, 95% CI 0.96, 0.99) and mental (0.97, 95% CI 0.96, 0.98) component summary scales; and higher anxiety levels (1.04, 95% CI 1.02, 1.06). Conclusions The Malay-VHI-10 is valid and reliable. Voice disorder was associated with increased absenteeism, marginally associated with reduced health-related quality of life as well as increased anxiety among teachers. PMID:26540291

Reliability and sensitivity of the self-report of physician-diagnosed gout in the campaign against cancer and heart disease and the atherosclerosis risk in the community cohorts.

PubMed

McAdams, Mara A; Maynard, Janet W; Baer, Alan N; Köttgen, Anna; Clipp, Sandra; Coresh, Josef; Gelber, Allan C

2011-01-01

gout is often defined by self-report in epidemiologic studies. Yet the validity of self-reported gout is uncertain. We evaluated the reliability and sensitivity of the self-report of physician-diagnosed gout in the Campaign Against Cancer and Heart Disease (CLUE II) and the Atherosclerosis Risk in the Community (ARIC) cohorts. the CLUE II cohort comprises 12,912 individuals who self-reported gout status on either the 2000, 2003, or 2007 questionnaires. We calculated reliability as the percentage of participants reporting having gout on more than 1 questionnaire using Cohen's κ statistic. The ARIC cohort comprises 11,506 individuals who self-reported gout status at visit 4. We considered a hospital discharge diagnosis of gout or use of a gout-specific medication as the standard against which to calculate the sensitivity of self-reported, physician-diagnosed gout. of the 437 CLUE II participants who self-reported physician-diagnosed gout in 2000, and subsequently answered the 2003 questionnaire, 75% reported gout in 2003 (κ = 0.73). Of the 271 participants who reported gout in 2000, 73% again reported gout at the 2007 followup questionnaire (κ = 0.63). In ARIC, 196 participants met the definition for gout prior to visit 4 and self-reported their gout status at visit 4. The sensitivity of a self-report of physician-diagnosed gout was 84%. Accuracy was similar across sex and race subgroups, but differed across hyperuricemia and education strata. these 2 population-based US cohorts suggest that self-report of physician-diagnosed gout has good reliability and sensitivity. Thus, self-report of a physician diagnosis of gout is appropriate for epidemiologic studies.

RELIABILITY OF REPORTING ON LIFESTYLE AND AGRICULTURAL FACTORS BY A SAMPLE OF PARTICIPANTS IN THE AGRICULTURAL HEALTH STUDY FROM IOWA

EPA Science Inventory

Repeat interviews from 4,088 Iowa pesticide applicators participating in the Agricultural Health Study provided the opportunity to evaluate the reliability of self-reported information on pesticide use and various demographic and lifestyle factors. Self-completed questionnaire...

Internal Consistency Reliability of the Self-Report Antisocial Process Screening Device

ERIC Educational Resources Information Center

Poythress, Norman G.; Douglas, Kevin S.; Falkenbach, Diana; Cruise, Keith; Lee, Zina; Murrie, Daniel C.; Vitacco, Michael

2006-01-01

The self-report version of the Antisocial Process Screening Device (APSD) has become a popular measure for assessing psychopathic features in justice-involved adolescents. However, the internal consistency reliability of its component scales (Narcissism, Callous-Unemotional, and Impulsivity) has been questioned in several studies. This study…

Report: Eleven Years After Agreement, EPA Has Not Developed Reliable Emission Estimation Methods to Determine Whether Animal Feeding Operations Comply With Clean Air Act and Other Statutes

EPA Pesticide Factsheets

Report #17-P-0396, September 19, 2017. Until the EPA develops sound methods to estimate emissions, the agency cannot reliably determine whether animal feeding operations comply with applicable Clean Air Act requirements.

Assessing segment- and corridor-based travel-time reliability on urban freeways : final report.

DOT National Transportation Integrated Search

2016-09-01

Travel time and its reliability are intuitive performance measures for freeway traffic operations. The objective of this project was to quantify segment-based and corridor-based travel time reliability measures on urban freeways. To achieve this obje...

Human Reliability Analysis in Support of Risk Assessment for Positive Train Control

DOT National Transportation Integrated Search

2003-06-01

This report describes an approach to evaluating the reliability of human actions that are modeled in a probabilistic risk assessment : (PRA) of train control operations. This approach to human reliability analysis (HRA) has been applied in the case o...

Psychometrics and the neuroscience of individual differences: Internal consistency limits between-subjects effects.

PubMed

Hajcak, Greg; Meyer, Alexandria; Kotov, Roman

2017-08-01

In the clinical neuroscience literature, between-subjects differences in neural activity are presumed to reflect reliable measures-even though the psychometric properties of neural measures are almost never reported. The current article focuses on the critical importance of assessing and reporting internal consistency reliability-the homogeneity of "items" that comprise a neural "score." We demonstrate how variability in the internal consistency of neural measures limits between-subjects (i.e., individual differences) effects. To this end, we utilize error-related brain activity (i.e., the error-related negativity or ERN) in both healthy and generalized anxiety disorder (GAD) participants to demonstrate options for psychometric analyses of neural measures; we examine between-groups differences in internal consistency, between-groups effect sizes, and between-groups discriminability (i.e., ROC analyses)-all as a function of increasing items (i.e., number of trials). Overall, internal consistency should be used to inform experimental design and the choice of neural measures in individual differences research. The internal consistency of neural measures is necessary for interpreting results and guiding progress in clinical neuroscience-and should be routinely reported in all individual differences studies. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Reliability Abstracts and Technical Reviews January - December 1970. Volume 10, Nos. 1-12; R70-14805 - R70-15438

NASA Technical Reports Server (NTRS)

1970-01-01

Reliability Abstracts and Technical Reviews is an abstract and critical analysis service covering published and report literature on reliability. The service is designed to provide information on theory and practice of reliability as applied to aerospace and an objective appraisal of the quality, significance, and applicability of the literature abstracted.

Seven Reliability Indices for High-Stakes Decision Making: Description, Selection, and Simple Calculation

ERIC Educational Resources Information Center

Smith, Stacey L.; Vannest, Kimberly J.; Davis, John L.

2011-01-01

The reliability of data is a critical issue in decision-making for practitioners in the school. Percent Agreement and Cohen's kappa are the two most widely reported indices of inter-rater reliability, however, a recent Monte Carlo study on the reliability of multi-category scales found other indices to be more trustworthy given the type of data…

VFS interjudge reliability using a free and directed search.

PubMed

Bryant, Karen N; Finnegan, Eileen; Berbaum, Kevin

2012-03-01

Reports in the literature suggest that clinicians demonstrate poor reliability in rating videofluoroscopic swallow (VFS) variables. Contemporary perception theories suggest that the methods used in VFS reliability studies constrain subjects to make judgments in an abnormal way. The purpose of this study was to determine whether a directed search or a free search approach to rating swallow studies results in better interjudge reliability. Ten speech pathologists served as judges. Five clinical judges were assigned to the directed search group (use checklist) and five to the free search group (unguided observations). Clinical judges interpreted 20 VFS examinations of swallowing. Interjudge reliability of ratings of dysphagia severity, affected stage of swallow, dysphagia symptoms, and attributes identified by clinical judges using a directed search was compared with that using a free search approach. Interjudge reliability for rating the presence of aspiration and penetration was significantly better using a free search ("substantial" to "almost perfect" agreement) compared to a directed search ("moderate" agreement). Reliability of dysphagia severity ratings ranged from "moderate" to "almost perfect" agreement for both methods of search. Reliability for reporting all other symptoms and attributes of dysphagia was variable and was not significantly different between the groups.

The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals.

PubMed

Skinner, Ian W; Hübscher, Markus; Moseley, G Lorimer; Lee, Hopin; Wand, Benedict M; Traeger, Adrian C; Gustin, Sylvia M; McAuley, James H

2017-08-15

Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test-retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test-retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test-retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from -.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test-retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.

Reliability and validity of the McDonald Play Inventory.

PubMed

McDonald, Ann E; Vigen, Cheryl

2012-01-01

This study examined the ability of a two-part self-report instrument, the McDonald Play Inventory, to reliably and validly measure the play activities and play styles of 7- to 11-yr-old children and to discriminate between the play of neurotypical children and children with known learning and developmental disabilities. A total of 124 children ages 7-11 recruited from a sample of convenience and a subsample of 17 parents participated in this study. Reliability estimates yielded moderate correlations for internal consistency, total test intercorrelations, and test-retest reliability. Validity estimates were established for content and construct validity. The results suggest that a self-report instrument yields reliable and valid measures of a child's perceived play performance and discriminates between the play of children with and without disabilities. Copyright © 2012 by the American Occupational Therapy Association, Inc.

The reliability of manual reporting of clinical events in an anesthesia information management system (AIMS).

PubMed

Simpao, Allan F; Pruitt, Eric Y; Cook-Sather, Scott D; Gurnaney, Harshad G; Rehman, Mohamed A

2012-12-01

Manual incident reports significantly under-report adverse clinical events when compared with automated recordings of intraoperative data. Our goal was to determine the reliability of AIMS and CQI reports of adverse clinical events that had been witnessed and recorded by research assistants. The AIMS and CQI records of 995 patients aged 2-12 years were analyzed to determine if anesthesia providers had properly documented the emesis events that were observed and recorded by research assistants who were present in the operating room at the time of induction. Research assistants recorded eight cases of emesis during induction that were confirmed with the attending anesthesiologist at the time of induction. AIMS yielded a sensitivity of 38 % (95 % confidence interval [CI] 8.5-75.5 %), while the sensitivity of CQI reporting was 13 % (95 % CI 0.3-52.7 %). The low sensitivities of the AIMS and CQI reports suggest that user-reported AIMS and CQI data do not reliably include significant clinical events.

Reliability and validity of the parent efficacy for child healthy weight behaviour (PECHWB) scale.

PubMed

Palmer, F; Davis, M C

2014-05-01

Interventions for childhood overweight and obesity that target parents as the agents of change by increasing parent self-efficacy for facilitating their child's healthy weight behaviours require a reliable and valid tool to measure parent self-efficacy before and after interventions. Nelson and Davis developed the Parent Efficacy for Child Healthy Weight Behaviour (PECHWB) scale with good preliminary evidence of reliability and validity. The aim of this research was to provide further psychometric evidence from an independent Australian sample. Data were provided by a convenience sample of 261 primary caregivers of children aged 4-17 years via an online survey. PECHWB scores were correlated with scores on other self-report measures of parenting efficacy and 2- to 4-week test-retest reliability of the PECHWB was assessed. The results of the study confirmed the four-factor structure of the PECHWB (Fat and Sugar, Sedentary Behaviours, Physical Activity, and Fruit and Vegetables) and provided strong evidence of internal consistency and test-retest reliability, as well as good evidence of convergent validity. Future research should investigate the properties of the PECHWB in a sample of parents of overweight or obese children, including measures of child weight and actual child healthy weight behaviours to provide evidence of the concurrent and predictive validity of PECHWB scores. © 2013 John Wiley & Sons Ltd.

eHealth literacy in chronic disease patients: An item response theory analysis of the eHealth literacy scale (eHEALS).

PubMed

Paige, Samantha R; Krieger, Janice L; Stellefson, Michael; Alber, Julia M

2017-02-01

Chronic disease patients are affected by low computer and health literacy, which negatively affects their ability to benefit from access to online health information. To estimate reliability and confirm model specifications for eHealth Literacy Scale (eHEALS) scores among chronic disease patients using Classical Test (CTT) and Item Response Theory techniques. A stratified sample of Black/African American (N=341) and Caucasian (N=343) adults with chronic disease completed an online survey including the eHEALS. Item discrimination was explored using bi-variate correlations and Cronbach's alpha for internal consistency. A categorical confirmatory factor analysis tested a one-factor structure of eHEALS scores. Item characteristic curves, in-fit/outfit statistics, omega coefficient, and item reliability and separation estimates were computed. A 1-factor structure of eHEALS was confirmed by statistically significant standardized item loadings, acceptable model fit indices (CFI/TLI>0.90), and 70% variance explained by the model. Item response categories increased with higher theta levels, and there was evidence of acceptable reliability (ω=0.94; item reliability=89; item separation=8.54). eHEALS scores are a valid and reliable measure of self-reported eHealth literacy among Internet-using chronic disease patients. Providers can use eHEALS to help identify patients' eHealth literacy skills. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Feasibility study of shared-ride auto transit. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kocur, G.; Zaelke, D.; Neumann, L.

1977-09-01

The report examines the feasibility of the implementation of shared-ride auto transit (SRAT), which is an innovative approach for increasing auto occupancy in rural and urban areas. The report focuses on operational concepts, potential usage, legal and regulatory issues, and institutional issues. Formulation of the SRAT concept was motivated by several concerns, such as: (1) energy conservation; (2) transit service to areas unable to economically justify conventional transit services, and to travel disadvantaged groups; (3) transit service replacement to achieve greater efficiency and to reduce transit deficits; (4) provision of inexpensive transit service; and (5) the increase of safety andmore » reliability of hitchhiking. Four case study sites (Boulder, Colorado; Boston, Massachusetts; Portland, Oregon; and Tidewater, Virginia), were used to identify the specific institutional issues likely to impact SRAT implementation for that site, and to identify the opportunities for designing, implementing and operating SRAT in a variety of institutional settings.« less

Method matters: Understanding diagnostic reliability in DSM-IV and DSM-5.

PubMed

Chmielewski, Michael; Clark, Lee Anna; Bagby, R Michael; Watson, David

2015-08-01

Diagnostic reliability is essential for the science and practice of psychology, in part because reliability is necessary for validity. Recently, the DSM-5 field trials documented lower diagnostic reliability than past field trials and the general research literature, resulting in substantial criticism of the DSM-5 diagnostic criteria. Rather than indicating specific problems with DSM-5, however, the field trials may have revealed long-standing diagnostic issues that have been hidden due to a reliance on audio/video recordings for estimating reliability. We estimated the reliability of DSM-IV diagnoses using both the standard audio-recording method and the test-retest method used in the DSM-5 field trials, in which different clinicians conduct separate interviews. Psychiatric patients (N = 339) were diagnosed using the SCID-I/P; 218 were diagnosed a second time by an independent interviewer. Diagnostic reliability using the audio-recording method (N = 49) was "good" to "excellent" (M κ = .80) and comparable to the DSM-IV field trials estimates. Reliability using the test-retest method (N = 218) was "poor" to "fair" (M κ = .47) and similar to DSM-5 field-trials' estimates. Despite low test-retest diagnostic reliability, self-reported symptoms were highly stable. Moreover, there was no association between change in self-report and change in diagnostic status. These results demonstrate the influence of method on estimates of diagnostic reliability. (c) 2015 APA, all rights reserved).

Validity and reliability of a new ankle dorsiflexion measurement device.

PubMed

Gatt, Alfred; Chockalingam, Nachiappan

2013-08-01

The assessment of the maximum ankle dorsiflexion angle is an important clinical examination procedure. Evidence shows that the traditional goniometer is highly unreliable, and various designs of goniometers to measure the maximum ankle dorsiflexion angle rely on the application of a known force to obtain reliable results. Hence, an innovative ankle dorsiflexion measurement device was designed to make this measurement more reliable by holding the foot in a selected posture without the application of a known moment. To report on the comprehensive validity and reliability testing carried out on the new device. Following validity testing, four different trials to test reliability of the ankle dorsiflexion measurement device were performed. These trials included inter-rater and intra-rater testings with a controlled moment, intra-rater reliability testing with knees flexed and extended without a controlled moment, intra-rater testing with a patient population, and inter-rater reliability testing between four raters of varying experience without controlling moment. All raters were blinded. A series of trials to test intra-rater and inter-rater reliabilities. Intra-rater reliability intraclass correlation coefficient was 0.98 and inter-rater reliability intraclass correlation coefficient (2,1) was 0.953 with a controlled moment. With uncontrolled moment, very high reliability for intra-tester was also achieved (intraclass correlation coefficient = 0.94 with knees extended and intraclass correlation coefficient = 0.95 with knees flexed). For the trial investigating test-retest reliability with actual patients, intraclass correlation coefficient of 0.99 was obtained. In the trial investigating four different raters with uncontrolled moment, intraclass correlation coefficient of 0.91 was achieved. The new ankle dorsiflexion measurement device is a valid and reliable device for measuring ankle dorsiflexion in both healthy subjects and patients, with both controlled and uncontrolled moments, even by multiple raters of varying experience when the foot is dorsiflexed to its end of range of motion. An ankle dorsiflexion measuring device has been designed to increase the reliability of ankle dorsiflexion measurement and replace the traditional goniometer. While the majority of similar devices rely on application of a known moment to perform this measurement, it has been shown that this is not required with the new ankle dorsiflexion measurement device and, rather, foot posture should be taken into consideration as this affects the maximum ankle dorsiflexion angle.

Reporting of occupational injury and illness in the semiconductor manufacturing industry.

PubMed

McCurdy, S A; Schenker, M B; Samuels, S J

1991-01-01

In the United States, occupational illness and injury cases meeting specific reporting criteria are recorded on company Occupational Safety and Health Administration (OSHA) 200 logs; case description data are submitted to participating state agencies for coding and entry in the national Supplementary Data System (SDS). We evaluated completeness of reporting (the percentage of reportable cases that were recorded in the company OSHA 200 log) in the semiconductor manufacturing industry by reviewing company health clinic records for 1984 of 10 manufacturing sites of member companies of a national semiconductor manufacturing industry trade association. Of 416 randomly selected work-related cases, 101 met OSHA reporting criteria. Reporting completeness was 60 percent and was lowest for occupational illnesses (44 percent). Case-description data from 150 reported cases were submitted twice to state coding personnel to evaluate coding reliability. Reliability was high (kappa 0.82-0.93) for "nature," "affected body part," "source," and "type" variables. Coding for the SDS appears reliable; reporting completeness may be improved by use of a stepwise approach by company personnel responsible for reporting decisions.

Reliability of the Cardiff Test of basic life support and automated external defibrillation version 3.1.

PubMed

Whitfield, Richard H; Newcombe, Robert G; Woollard, Malcolm

2003-12-01

The introduction of the European Resuscitation Guidelines (2000) for cardiopulmonary resuscitation (CPR) and automated external defibrillation (AED) prompted the development of an up-to-date and reliable method of assessing the quality of performance of CPR in combination with the use of an AED. The Cardiff Test of basic life support (BLS) and AED version 3.1 was developed to meet this need and uses standardised checklists to retrospectively evaluate performance from analyses of video recordings and data drawn from a laptop computer attached to a training manikin. This paper reports the inter- and intra-observer reliability of this test. Data used to assess reliability were obtained from an investigation of CPR and AED skill acquisition in a lay responder AED training programme. Six observers were recruited to evaluate performance in 33 data sets, repeating their evaluation after a minimum interval of 3 weeks. More than 70% of the 42 variables considered in this study had a kappa score of 0.70 or above for inter-observer reliability or were drawn from computer data and therefore not subject to evaluator variability. 85% of the 42 variables had kappa scores for intra-observer reliability of 0.70 or above or were drawn from computer data. The standard deviations for inter- and intra-observer measures of time to first shock were 11.6 and 7.7 s, respectively. The inter- and intra-observer reliability for the majority of the variables in the Cardiff Test of BLS and AED version 3.1 is satisfactory. However, reliability is less acceptable with respect to shaking when checking for responsiveness, initial check/clearing of the airway, checks for signs of circulation, time to first shock and performance of interventions in the correct sequence. Further research is required to determine if modifications to the method of assessing these variables can increase reliability.

Standardization of reliability reporting for cochlear implants: an interim report.

PubMed

Backous, Douglas D; Watson, Stacey D

2007-04-01

To propose a standard definition of "out of specification" for cochlear implants and a paradigm for inclusion of category C of the ISO standard 5841-2:2000 for reporting in cumulative survival statistics. A standard definition of "out of specification" and consistent reporting by manufacturers of cochlear implants will create a fair and consistent representation of cumulative survival. This will allow discernment of differences between manufacturers for reliability and for detection of trends in reliability between model types from the same manufacturer. Three separate meetings with representatives of the three manufacturers of cochlear implants marketed in the United States were staged over a 13-mo period. Standard questions, created by the authors, were addressed by each representative to determine the current state of device reliability reporting. Results were presented to clinicians at the William House Cochlear Implant study Group and the Implantable devices sub-committee of the American Academy of Otolaryngology (2004, 2005) and at the 8th International Cochlear Implant Conference (2004) for feedback. After assimilation of feedback by all parties, the standard was written and reviewed by representatives from each manufacturer for accuracy of data. A complaint-driven standard was developed. A "cochlear implant" as an internal device placed and skin closed in surgery. An internal device is "out of specification" when one or more technical characteristics is outside the limits of normal function and results in explantation or non-use by the patient." Children will be reported separately from adults, each model of device will be reported on annually, a minimum of 200 devices must be in each model group for Cumulative Survival Reporting (CSR). Confidence limits are set at 95%. Explants will be determined to be "biological" or "technical." Technical explants are included in CSR reports. Devices failing to meet specifications set by the manufacturer, not in use but still in situ due to patient choice not to be re-implanted are considered category C and included in CSR reports. Implants that cannot be classified at explant are placed in an "under investigation" category while evaluation is completed. If no classification is made by 6 months, these devices will be included in the CSR report. Notification to the implant center regarding "in" or "out of specification" will be made within 60 d of the explant arriving at the manufacturer with final root cause of failure reported to centers when complete. Information will be passed on to patients by members of the implant team. A standardized form will be created to provide the manufacturers with necessary patient information to guide reliability analysis, including performance after re-implant. The standard for reliability reporting described in this paper improves patient care by presenting data which are understandable to clinicians delivering cochlear implant services. It fosters fair and accurate reporting without discriminating or granting perceived advantage to any manufacturer. This standard provides a basis for reporting research related to or including device reliability in the medical literature.

Validity and reliability of a structured interview for early detection and risk assessment of parenting and developmental problems in young children: a cross-sectional study

PubMed Central

2012-01-01

Background Preventive child health care is well suited for the early detection of parenting and developmental problems. However, as far as the younger age group is concerned, there are no validated early detection instruments which cover both the child and its environment. Therefore, we have developed a broad-scope structured interview which assesses parents’ concerns and their need for support, using both the parental perspective and the experience of the child health care nurse: the Structured Problem Analysis of Raising Kids (SPARK). This study reports the psychometric characteristics of the SPARK. Method A cross-sectional study of 2012 18-month-old children, living in Zeeland, a province of the Netherlands. Inter-rater reliability was assessed in 67 children. Convergent validity was assessed by comparing SPARK-domains with domains in self-report questionnaires on child development and parenting stress. Discriminative validity was assessed by comparing different outcomes of the SPARK between groups with different levels of socio-economic status and by performing an extreme-groups comparison. The user experience of both parents and nurses was assessed with the aid of an online survey. Results The response rate was 92.1% for the SPARK. Self-report questionnaires were returned in the case of 66.9% of the remaining 1721 children. There was selective non-reporting: 33.1% of the questionnaires were not returned, covering 65.2% of the children with a high-risk label according to the SPARK (p < 0.001). Inter-rater reliability was good to excellent with intraclass correlations between 0.85 and 1.0 for physical topics; between 0.61 and 0.8 for social-emotional topics and 0.92 for the overall risk assessment. Convergent validity was unexpectedly low (all correlations ≤0.3) although the pattern was as expected. Discriminative validity was good. Users were satisfied with the SPARK and identified some topics for improvement. Conclusion The SPARK discriminates between children with a high, increased and low risk of parenting and developmental problems. It does so in a reliable way, but more research is needed on aspects of validity and in other populations. PMID:22697218

Professionalism among paramedic students: achieving the measure or missing the mark?

PubMed Central

Bowen, L Michael; Williams, Brett; Stanke, Luke

2017-01-01

Background Professionalism is a pillar of paramedicine. Internationally paramedic curricula emphasize valid assessment of three domains: cognitive, psychomotor, and affective domains (professionalism). Little is reported on competency measures for professionalism specific to paramedicine. Literature suggests that paramedic students, paramedic practitioners, medical directors, and patients believe that professional attributes should have an increased focus. Objective The objective of this scoping review is to outline valid and reliable assessments that evaluate professional behaviors. Method This review used Arksey and O’Malley’s six-stage scoping methodology. In September 2016, five databases were searched for articles of relevance; these were MEDLINE, Scopus, Google Scholar, PsycINFO/APA, and EMBASE. Results A total of 1587 articles were identified after removal of 468 duplicates. Five articles met the inclusion criteria, two of the articles were from the US and three from UK. The studies range from 2004 to 2014. Three different scales were identified but only two were recommended for use. A US-based scale is composed of 11 items and one generic form of professionalism. The UK scale has 77 items and identified 11 factors within 68 items. Conclusions This scoping review serves to describe valid and reliable measures for professionalism among paramedicine by outlining the quantity of instruments evident in the literature. The scoping review aimed to report the scales supporting evidence of validity and reliability. Three scales were identified in a total of five different studies that specifically measured professional attributes in paramedicine. Currently, two scales are available: an evaluation with 11 items and a self-reported questionnaire with 77 items. PMID:29118588

Reliability and validity of the PedsQL™ Multidimensional Fatigue Scale in Japan.

PubMed

Kobayashi, Kyoko; Okano, Yoshiyuki; Hohashi, Naohiro

2011-09-01

To examine the reliability and validity of the Japanese-language version of the PedsQL™ Multidimensional Fatigue Scale and to investigate the agreement between child self-reported fatigue and parent proxy-reported fatigue. The Japanese-language version of the PedsQL™ Multidimensional Fatigue Scale was administered to 652 preschoolers and schoolchildren aged 5-12 and their parents, and to 91 parents of preschool children aged 1-4. Internal consistency reliability was 0.62-0.87 for children and 0.81-0.93 for parents. Known-group validity was examined between a group of healthy samples (n = 530) and chronic condition sample (n = 102); the chronically ill group reported a significantly higher perceived fatigue problem. Correlations between child self- and parent proxy reports ranged from poor to fair. In subgroups identified by cluster analysis based on child self-reported scores, the greatest agreement between child and parent reports was seen in the good HRQOL group, while the least occurred in the poor HRQOL group. The parents overestimated their child's fatigue more when the child's HRQOL was low. The Japanese-language version of the PedsQL™ Multidimensional Fatigue Scale demonstrated good reliability and validity and could be useful in evaluating Japanese children in school and health care settings.

Suicide reporting content analysis: abstract development and reliability.

PubMed

Gould, Madelyn S; Midle, Jennifer Bassett; Insel, Beverly; Kleinman, Marjorie

2007-01-01

Despite substantial research on media influences and the development of media guidelines on suicide reporting, research on the specifics of media stories that facilitate suicide contagion has been limited. The goal of the present study was to develop a content analytic strategy to code features in media suicide reports presumed to be influential in suicide contagion and determine the interrater reliability of the qualitative characteristics abstracted from newspaper stories. A random subset of 151 articles from a database of 1851 newspaper suicide stories published during 1988 through 1996, which were collected as part of a national study in the United States to identify factors associated with the initiation of youth suicide clusters, were evaluated. Using a well-defined content-analysis procedure, the agreement between raters in scoring key concepts of suicide reports from the headline, the pictorial presentation, and the text were evaluated. The results show that while the majority of variables in the content analysis were very reliable, assessed using the kappa statistic, and obtained excellent percentages of agreement, the reliability of complicated constructs, such as sensationalizing, glorifying, or romanticizing the suicide, was comparatively low. The data emphasize that before effective guidelines and responsible suicide reporting can ensue, further explication of suicide story constructs is necessary to ensure the implementation and compliance of responsible reporting on behalf of the media.

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

Reliability and Measurement Error of Tensiomyography to Assess Mechanical Muscle Function: A Systematic Review.

PubMed

Martín-Rodríguez, Saúl; Loturco, Irineu; Hunter, Angus M; Rodríguez-Ruiz, David; Munguia-Izquierdo, Diego

2017-12-01

Martín-Rodríguez, S, Loturco, I, Hunter, AM, Rodríguez-Ruiz, D, and Munguia-Izquierdo, D. Reliability and measurement error of tensiomyography to assess mechanical muscle function: A systematic review. J Strength Cond Res 31(12): 3524-3536, 2017-Interest in studying mechanical skeletal muscle function through tensiomyography (TMG) has increased in recent years. This systematic review aimed to (a) report the reliability and measurement error of all TMG parameters (i.e., maximum radial displacement of the muscle belly [Dm], contraction time [Tc], delay time [Td], half-relaxation time [½ Tr], and sustained contraction time [Ts]) and (b) to provide critical reflection on how to perform accurate and appropriate measurements for informing clinicians, exercise professionals, and researchers. A comprehensive literature search was performed of the Pubmed, Scopus, Science Direct, and Cochrane databases up to July 2017. Eight studies were included in this systematic review. Meta-analysis could not be performed because of the low quality of the evidence of some studies evaluated. Overall, the review of the 9 studies involving 158 participants revealed high relative reliability (intraclass correlation coefficient [ICC]) for Dm (0.91-0.99); moderate-to-high ICC for Ts (0.80-0.96), Tc (0.70-0.98), and ½ Tr (0.77-0.93); and low-to-high ICC for Td (0.60-0.98), independently of the evaluated muscles. In addition, absolute reliability (coefficient of variation [CV]) was low for all TMG parameters except for ½ Tr (CV = >20%), whereas measurement error indexes were high for this parameter. In conclusion, this study indicates that 3 of the TMG parameters (Dm, Td, and Tc) are highly reliable, whereas ½ Tr demonstrate insufficient reliability, and thus should not be used in future studies.

"Reliability generalization of the Multigroup Ethnic Identity Measure-Revised (MEIM-R)": Correction to Herrington et al. (2016).

PubMed

2016-10-01

Reports an error in "Reliability Generalization of the Multigroup Ethnic Identity Measure-Revised (MEIM-R)" by Hayley M. Herrington, Timothy B. Smith, Erika Feinauer and Derek Griner ( Journal of Counseling Psychology , Advanced Online Publication, Mar 17, 2016, np). The name of author Erika Feinauer was misspelled as Erika Feinhauer. All versions of this article have been corrected. (The following abstract of the original article appeared in record 2016-13160-001.) Individuals' strength of ethnic identity has been linked with multiple positive indicators, including academic achievement and overall psychological well-being. The measure researchers use most often to assess ethnic identity, the Multigroup Ethnic Identity Measure (MEIM), underwent substantial revision in 2007. To inform scholars investigating ethnic identity, we performed a reliability generalization analysis on data from the revised version (MEIM-R) and compared it with data from the original MEIM. Random-effects weighted models evaluated internal consistency coefficients (Cronbach's alpha). Reliability coefficients for the MEIM-R averaged α = .88 across 37 samples, a statistically significant increase over the average of α = .84 for the MEIM across 75 studies. Reliability coefficients for the MEIM-R did not differ across study and participant characteristics such as sample gender and ethnic composition. However, consistently lower reliability coefficients averaging α = .81 were found among participants with low levels of education, suggesting that greater attention to data reliability is warranted when evaluating the ethnic identity of individuals such as middle-school students. Future research will be needed to ascertain whether data with other measures of aspects of personal identity (e.g., racial identity, gender identity) also differ as a function of participant level of education and associated cognitive or maturation processes. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

A Statewide Quality Improvement Collaborative to Increase Breastfeeding Rates in Tennessee.

PubMed

Ware, Julie L; Schetzina, Karen E; Morad, Anna; Barker, Brenda; Scott, Theresa A; Grubb, Peter H

2018-05-01

Tennessee has low breastfeeding rates and has identified opportunities for improvement to enhance maternity practices to support breastfeeding mothers. We sought a 10% relative increase in the aggregate Joint Commission measure of breastfeeding exclusivity at discharge (TJC PC-05) by focusing on high-reliability (≥90%) implementation of processes that promote breastfeeding in the delivery setting. A statewide, multidisciplinary development team reviewed evidence from the WHO-UNICEF "Ten Steps to Successful Breastfeeding" to create a consensus toolkit of process indicators aligned with the Ten Steps. Hospitals submitted monthly TJC PC-05 data for 6 months while studying local implementation of the Ten Steps to identify improvement opportunities, and for an additional 11 months while conducting tests of change to improve Ten Steps implementation using Plan-Do-Study-Act cycles, local process audits, and control charts. Data were aggregated at the state level and presented at 12 monthly webinars, 3 regional learning sessions, and 1 statewide meeting where teams shared their local data and implementation experiences. Thirteen hospitals accounting for 47% of live births in Tennessee submitted data on 31,183 mother-infant dyads from August 1, 2012, to December 31, 2013. Aggregate monthly mean PC-05 demonstrated "special cause" improvement increasing from 37.1% to 41.2%, an 11.1% relative increase. Five hospitals reported implementation of ≥5 of the Ten Steps and two hospitals reported ≥90% reliability on ≥5 of the Ten Steps using locally designed process audits. Using large-scale improvement methodology, a successful statewide collaborative led to >10% relative increase in breastfeeding exclusivity at discharge in participating Tennessee hospitals. Further opportunities for improvement in implementing breastfeeding supportive practices were identified.

A study of automotive workers anthropometric physical characteristics from Mexico Northwest.

PubMed

Lucero-Duarte, Karla; de la Vega-Bustillos, Enrique; López-Millán, Francisco

2012-01-01

Due to the lack of anthropometric information in northwest Mexico, we did an anthropometric study that represents the population physical characteristics and that is reliable for the design or redesign of workstations. The study was divided in two phases. The first one was the anthropometric study of 2900 automotive industry workers in northwest of Mexico. The study includes 40 body dimensions of 2345 males and 555 females personalized to be used in future researches. Second phase includes compared anthropometric characteristics of population reported in four Mexican studies and a Colombian study against the current study. Benefits of this project are: a reliable database of anthropometric characteristic of automotive industry population for workstations design or redesign that match with the users, increase product quality and reduce economic, medical and union complains.

Test-Retest Reliability of Self-Reported Sexual Health Measures among US Hispanic Adolescents

ERIC Educational Resources Information Center

Jerman, Petra; Berglas, Nancy F.; Rohrbach, Louise A.; Constantine, Norman A.

2016-01-01

Objective: Although Hispanic adolescents in the USA are often the focus of sexual health interventions, their response to survey measures has rarely been assessed within evaluation studies. This study documents the test-retest reliability of a wide range of self-reported sexual health values, attitudes, knowledge and behaviours among Hispanic…

Reliability Prediction for Aerospace Electronics

DTIC Science & Technology

2015-04-20

RESEARCH AUTHORITY 3 KIRYAT HAMADA ARIEL ISRAEL EOARD GRANT FA9550-14-1-0216 Report Date: April 2015 Final Report for 15 July 2014 to 14... Ariel , Israel Period of Performance 15 July 2014 – 14 April 2015   Abstract...AFRL-AFOSR-UK-TR-2015-0028 Reliability Prediction for Aerospace Electronics Joseph B. Bernstein ARIEL UNIVERSITY

Fiscal Year 2005 Performance and Accountability Report

ERIC Educational Resources Information Center

US Department of Education, 2005

2005-01-01

As the Department looks back on FY 2005, it reflects on successes like the national sample of 9-year-olds whose reading scores are higher this year than in any previous assessment year and challenges like those with collecting reliable, valid, and timely data. This report presents complete, reliable information that demonstrates the Department's…

Recent Reliability Reporting Practices in "Psychological Assessment": Recognizing the People behind the Data

ERIC Educational Resources Information Center

Green, Carlton E.; Chen, Cynthia E.; Helms, Janet E.; Henze, Kevin T.

2011-01-01

Helms, Henze, Sass, and Mifsud (2006) defined good practices for internal consistency reporting, interpretation, and analysis consistent with an alpha-as-data perspective. Their viewpoint (a) expands on previous arguments that reliability coefficients are group-level summary statistics of samples' responses rather than stable properties of scales…

Reliability and Validity of the Yale Global Tic Severity Scale

ERIC Educational Resources Information Center

Storch, Eric A.; Murphy, Tanya K.; Geffken, Gary R.; Sajid, Muhammad; Allen, Pam; Roberti, Jonathan W.; Goodman, Wayne K.

2005-01-01

To investigate the reliability and validity of the Yale Global Tic Severity Scale (YGTSS), 28 youth aged 6 to 17 years with Tourette's syndrome (TS) participated in the study. Data included clinician reports of tics and obsessive-compulsive disorder (OCD) severity, parent reports of tics, internalizing and externalizing problems, and child reports…

Technical Adequacy of the easyCBM Grade 2 Reading Measures. Technical Report #1004

ERIC Educational Resources Information Center

Jamgochian, Elisa; Park, Bitnara Jasmine; Nese, Joseph F. T.; Lai, Cheng-Fei; Saez, Leilani; Anderson, Daniel; Alonzo, Julie; Tindal, Gerald

2010-01-01

In this technical report, we provide reliability and validity evidence for the easyCBM[R] Reading measures for grade 2 (word and passage reading fluency and multiple choice reading comprehension). Evidence for reliability includes internal consistency and item invariance. Evidence for validity includes concurrent, predictive, and construct…

2nd Generation Reusable Launch Vehicle (2G RLV). Revised

NASA Technical Reports Server (NTRS)

Matlock, Steve; Sides, Steve; Kmiec, Tom; Arbogast, Tim; Mayers, Tom; Doehnert, Bill

2001-01-01

This is a revised final report and addresses all of the work performed on this program. Specifically, it covers vehicle architecture background, definition of six baseline engine cycles, reliability baseline (space shuttle main engine QRAS), and component level reliability/performance/cost for the six baseline cycles, and selection of 3 cycles for further study. This report further addresses technology improvement selection and component level reliability/performance/cost for the three cycles selected for further study, as well as risk reduction plans, and recommendation for future studies.

Reliability generalization study of the Yale-Brown Obsessive-Compulsive Scale for children and adolescents.

PubMed

López-Pina, José Antonio; Sánchez-Meca, Julio; López-López, José Antonio; Marín-Martínez, Fulgencio; Núñez-Núñez, Rosa Ma; Rosa-Alcázar, Ana I; Gómez-Conesa, Antonia; Ferrer-Requena, Josefa

2015-01-01

The Yale-Brown Obsessive-Compulsive Scale for children and adolescents (CY-BOCS) is a frequently applied test to assess obsessive-compulsive symptoms. We conducted a reliability generalization meta-analysis on the CY-BOCS to estimate the average reliability, search for reliability moderators, and propose a predictive model that researchers and clinicians can use to estimate the expected reliability of the CY-BOCS scores. A total of 47 studies reporting a reliability coefficient with the data at hand were included in the meta-analysis. The results showed good reliability and a large variability associated to the standard deviation of total scores and sample size.

Reliability program requirements for aeronautical and space system contractors

NASA Technical Reports Server (NTRS)

1987-01-01

General reliability program requirements for NASA contracts involving the design, development, fabrication, test, and/or use of aeronautical and space systems including critical ground support equipment are prescribed. The reliability program requirements require (1) thorough planning and effective management of the reliability effort; (2) definition of the major reliability tasks and their place as an integral part of the design and development process; (3) planning and evaluating the reliability of the system and its elements (including effects of software interfaces) through a program of analysis, review, and test; and (4) timely status indication by formal documentation and other reporting to facilitate control of the reliability program.

Arterial Stiffness and Renal Replacement Therapy: A Controversial Topic

PubMed Central

Fischer, Edmundo Cabrera; Zócalo, Yanina; Galli, Cintia; Bia, Daniel

2015-01-01

The increase of arterial stiffness has been to have a significant impact on predicting mortality in end-stage renal disease patients. Pulse wave velocity (PWV) is a noninvasive, reliable parameter of regional arterial stiffness that integrates the vascular geometry and arterial wall intrinsic elasticity and is capable of predicting cardiovascular mortality in this patient population. Nevertheless, reports on PWV in dialyzed patients are contradictory and sometimes inconsistent: some reports claim the arterial wall stiffness increases (i.e., PWV increase), others claim that it is reduced, and some even state that it augments in the aorta while it simultaneously decreases in the brachial artery pathway. The purpose of this study was to analyze the literature in which longitudinal or transversal studies were performed in hemodialysis and/or peritoneal dialysis patients, in order to characterize arterial stiffness and the responsiveness to renal replacement therapy. PMID:26064684

Computational Process Modeling for Additive Manufacturing

NASA Technical Reports Server (NTRS)

Bagg, Stacey; Zhang, Wei

2014-01-01

Computational Process and Material Modeling of Powder Bed additive manufacturing of IN 718. Optimize material build parameters with reduced time and cost through modeling. Increase understanding of build properties. Increase reliability of builds. Decrease time to adoption of process for critical hardware. Potential to decrease post-build heat treatments. Conduct single-track and coupon builds at various build parameters. Record build parameter information and QM Meltpool data. Refine Applied Optimization powder bed AM process model using data. Report thermal modeling results. Conduct metallography of build samples. Calibrate STK models using metallography findings. Run STK models using AO thermal profiles and report STK modeling results. Validate modeling with additional build. Photodiode Intensity measurements highly linear with power input. Melt Pool Intensity highly correlated to Melt Pool Size. Melt Pool size and intensity increase with power. Applied Optimization will use data to develop powder bed additive manufacturing process model.

Thermal Fatigue Evaluation of Pb-Free Solder Joints: Results, Lessons Learned, and Future Trends

NASA Astrophysics Data System (ADS)

Coyle, Richard J.; Sweatman, Keith; Arfaei, Babak

2015-09-01

Thermal fatigue is a major source of failure of solder joints in surface mount electronic components and it is critically important in high reliability applications such as telecommunication, military, and aeronautics. The electronic packaging industry has seen an increase in the number of Pb-free solder alloy choices beyond the common near-eutectic Sn-Ag-Cu alloys first established as replacements for eutectic SnPb. This paper discusses the results from Pb-free solder joint reliability programs sponsored by two industry consortia. The characteristic life in accelerated thermal cycling is reported for 12 different Pb-free solder alloys and a SnPb control in 9 different accelerated thermal cycling test profiles in terms of the effects of component type, accelerated thermal cycling profile and dwell time. Microstructural analysis on assembled and failed samples was performed to investigate the effect of initial microstructure and its evolution during accelerated thermal cycling test. A significant finding from the study is that the beneficial effect of Ag on accelerated thermal cycling reliability (measured by characteristic lifetime) diminishes as the severity of the accelerated thermal cycling, defined by greater ΔT, higher peak temperature, and longer dwell time increases. The results also indicate that all the Pb-free solders are more reliable in accelerated thermal cycling than the SnPb alloy they have replaced. Suggestions are made for future work, particularly with respect to the continued evolution of alloy development for emerging application requirements and the value of using advanced analytical methods to provide a better understanding of the effect of microstructure and its evolution on accelerated thermal cycling performance.

A pulse-width modulated, high reliability charge controller for small photovoltaic systems

DOE Office of Scientific and Technical Information (OSTI.GOV)

Gerken, K.; Welsh, D.

1997-02-01

This report presents the results of a development effort to design, test and begin production of a new class of small photovoltaic (PV) charge controllers. Sandia National Laboratories provided technical support, test data and financial support through a Balance-of-System Development contract. One of the objectives of the development was to increase user confidence in small PV systems by improving the reliability and operating life of the system controllers. Another equally important objective was to improve the economics of small PV systems by extending the battery lifetimes. Using new technology and advanced manufacturing techniques, these objectives were accomplished. Because small stand-alonemore » PV systems account for over one third of all PV modules shipped, the positive impact of improving the reliability and economics of PV systems in this market segment will be felt throughout the industry. The results of verification testing of the new product are also included in this report. The initial design goals and specifications were very aggressive, but the extensive testing demonstrates that all the goals were achieved. Production of the product started in May at a rate of 2,000 units per month. Over 40 Morningstar distributors (5 US and 35 overseas) have taken delivery in the first 2 months of shipments. Initial customer reactions to the new controller have been very favorable.« less

The development and validation of a questionnaire for rotator cuff disorders: The Functional Shoulder Score

PubMed Central

Ibrahim, Edward F; Petrou, Charalambos; Galanos, Antonis

2015-01-01

Background The purpose of the present study was to validate the Functional Shoulder Score (FSS), a new patient-reported outcome score specifically designed to evaluate patients with rotator cuff disorders. Methods One hundred and nineteen patients were assessed using two shoulder scoring systems [the FSS and the Constant–Murley Score (CMS)] at 3 weeks pre- and 6 months post-arthroscopic rotator cuff surgery. The reliability, validity, responsiveness and interpretability of the FSS were evaluated. Results Reliability analysis (test–retest) showed an intraclass correlation coefficient value of 0.96 [95% confidence interval (CI) = 0.92 to 0.98]. Internal consistency analysis revealed a Cronbach's alpha coefficient of 0.93. The Pearson correlation coefficient FSS-CMS was 0.782 pre-operatively and 0.737 postoperatively (p < 0.0005). There was a statistically significant increase in FSS scores postoperatively, an effect size of 3.06 and standardized response mean of 2.80. The value for minimal detectable change was ±8.38 scale points (based on a 90% CI) and the minimal clinically important difference for improvement was 24.7 ± 5.4 points. Conclusions The FSS is a patient-reported outcome measure that can easily be incorporated into clinical practice, providing a quick, reliable, valid and practical measure for rotator cuff problems. The questionnaire is highly sensitive to clinical change. PMID:27582986

Validation of Persian Version of PedsQL™ 4.0™ Generic Core Scales in Toddlers and Children

PubMed Central

Gheissari, Alaleh; Farajzadegan, Ziba; Heidary, Maryam; Salehi, Fatemeh; Masaeli, Ali; Mazrooei, Amin; Varni, James W; Fallah, Zahra; Zandieh, Fariborz

2012-01-01

Introduction: To evaluate the reliability, validity and feasibility of the Persian version of the Pediatric Quality of Life inventory (PedsQL™ 4.0™ 4.0) Generic Core Scales in Iranian healthy students ages 7-15 and chronically ill children ages 2-18. Methods: We followed the translation methodology proposed by developer to validate Persian version of PedsQL™ 4.0™ 4.0 Generic Core Scales for children. Six hundred and sixty children and adolescents and their parents were enrolled. Sample of 160 healthy students were chosen by random cluster method between 4 regions of Isfahan education offices and 60 chronically ill children were recruited from St. Alzahra hospital private clinics. The questionnaires were fulfilled by the participants. Results: The Persian version of PedsQL™ 4.0™ 4.0 Generic Core Scales discriminated between healthy and chronically ill children (healthy students mean score was 12.3 better than chronically ill children, P<0.001). Cronbachs’ alpha internal consistency values exceeded 0.7 for children self reports and proxy reports of children 5-7 years old and 13-18 years old. Reliability of proxy reports for 2-4 years old was much lower than 0.7. Although, proxy reports for chronically ill children 8-12 years old was more than 0.7, these reports for healthy children with same age group was slightly lower than 0.7. Constructive, criterion face and content validity were acceptable. In addition, the Persian version of PedsQL™ 4.0™ 4.0 Generic Core Scales was feasible and easy to complete. Conclusion: Results showed that Persian version of PedsQL™ 4.0™ 4.0 Generic Core Scales is valid and acceptable for pediatric health researches. It is necessary to alternate scoring for 2-4 years old questionnaire and to find a way to increase reliability for healthy children aged 8-12 years especially, according to Iranian culture. PMID:22701775

Brief report: reporting practices of methodological information in four journals of pediatric and child psychology.

PubMed

Raad, Jennifer M; Bellinger, Skylar; McCormick, Erica; Roberts, Michael C; Steele, Ric G

2008-08-01

To replicate Sifers, Puddy, Warren, and Roberts (2002) examining reporting rates of demographic, methodological, and ethical information in articles published during 1997, and to compare these rates to those found in articles published during 2005, in order to determine whether and how reporting practices of these variables have changed over time. We examined reporting demographic, methodological, and ethical information in articles in four journals: Journal of Pediatric Psychology, Journal of Clinical Child and Adolescent Psychology, Journal of Abnormal Child Psychology, and Child Development. Reporting rates during 2005 were compared to articles published during 1997. These four journals improved on many of the 23 variables compared to Sifers et al. including increases in the reporting of ethnicity, attrition, child assent procedures, socioeconomic status, reliability, and reward/incentive offered to participants. Improvements in descriptive information have implications for interpretation, replication, and generalizability of research findings.

Reliability and validity of the international physical activity questionnaire for assessing walking.

PubMed

van der Ploeg, Hidde P; Tudor-Locke, Catrine; Marshall, Alison L; Craig, Cora; Hagströmer, Maria; Sjöström, Michael; Bauman, Adrian

2010-03-01

Physical inactivity and its accompanying adverse sequelae (e.g., obesity and diabetes) are global health concerns. The single most commonly reported physical activity in public health surveys is walking (Centers for Disease Control and Prevention, 2000; Rafferty, Reeves, McGee, & Pivarnik, 2002). As evidence accumulates that walking is important for preventing weight gain (Levine et al., 2008) and reducing the risk of diabetes (Jeon, Lokken, Hu, & van Dam, 2007), there is increased need to capture this behavior in a valid and reliable manner. Although the disadvantages of a self-report methodology are well known (Sallis, & Saelens, 2000), it still represents the most feasible approach for conducting population-level surveillance across developed and developing countries. The International Physical Activity Questionnaire (IPAQ) was created and evaluated as a standardized instrument for this purpose. Although two versions of the IPAQwere designed and evaluated (short: nine items; and long: 31 items), the short form was recommended for population monitoring (Craig et al., 2003). However, it has not been recommended for intervention or research studies that require precise physical activity quantification to examine changes in physical activity at the individual level. IPAQ was also not intended to replace instruments that are more responsive to individual changes in activity level, such as objective measures. In addition to walking behaviors, IPAQ also assesses time spent in moderate- and vigorous-intensity activity as well as sitting behaviors, although the latter is not the focus of this analysis. Aggregated IPAQ data have been previously validated compared to accelerometers, and overall reliability was confirmed across 12 countries (Craig et al., 2003). Previous research showed criterion validity Spearman correlations with a median of 0.30 and test-retest reliability Spearman correlations clustered around 0.8 (Craig et al., 2003). The purpose of this study, however, was to reanalyze these data with respect to validity (again compared to an accelerometer) and test-retest reliability specifically for population monitoring of walking.

The validity and reliability of diagnoses of work-related mental ill-health.

PubMed

O'Neill, E; McNamee, R; Agius, R; Gittins, M; Hussey, L; Turner, S

2008-11-01

To establish the reliability and validity of work-related mental ill-health diagnoses. A UK-based surveillance scheme for work-related ill-health involving occupational physicians (OPs) reporting suggests that mental ill-health incidence is increasing by around 13% per year, with anxiety, depression and "other work-related stress" being the most common diagnoses. There have been no studies of the validity and reliability of such diagnoses. Given the existence of a large network of psychiatrists (PSYs) also involved in surveillance of work-related ill-health, an opportunity arose to measure the concurrent validity and reliability of work-related mental ill-health diagnoses. 100 anonymised summaries of cases previously reported by OPs or PSYs were collected; each was sent to 5 PSYs and 5 OPs, who assigned a diagnosis and judged whether the case was work-related. Concurrent validity of the ill-health aspect of the diagnoses, and of the opinion as to work-relatedness, was assessed by comparing the overall classifications of cases by OPs and PSYs. Reliability of the diagnostic classification was measured by kappa matrices. Diagnostic proportions for PSYs and OPs demonstrated good agreement for anxiety, depression, anxiety plus depression and "stress" (11%, 34%, 27%, 14%) and (14%, 30%, 27%, 17%), respectively. In both groups, kappa coefficients were high for a psychotic diagnosis (0.78, 95% CI: 0.74 to 0.83), but not as high for anxiety (0.27, 95% CI: 0.23 to 0.32), depression (0.34, 95% CI: 0.29 to 0.38) and "stress" (0.15, 95% CI: 0.10 to 0.19). The odds ratio of classifying a case as work-related among PSYs compared to OPs was 2.39 (95% CI: 1.68 to 3.38), p<0.001. The overall agreement between OPs and PSYs on mental ill-health diagnoses suggests that OP diagnoses are valid for epidemiological purposes. However, the within-group reliability of the diagnosis "stress" is low. Given differences in judgements about work-relatedness, further research is needed to investigate this aspect of a diagnosis.

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

Reliability generalization of the Multigroup Ethnic Identity Measure-Revised (MEIM-R).

PubMed

Herrington, Hayley M; Smith, Timothy B; Feinauer, Erika; Griner, Derek

2016-10-01

[Correction Notice: An Erratum for this article was reported in Vol 63(5) of Journal of Counseling Psychology (see record 2016-33161-001). The name of author Erika Feinauer was misspelled as Erika Feinhauer. All versions of this article have been corrected.] Individuals' strength of ethnic identity has been linked with multiple positive indicators, including academic achievement and overall psychological well-being. The measure researchers use most often to assess ethnic identity, the Multigroup Ethnic Identity Measure (MEIM), underwent substantial revision in 2007. To inform scholars investigating ethnic identity, we performed a reliability generalization analysis on data from the revised version (MEIM-R) and compared it with data from the original MEIM. Random-effects weighted models evaluated internal consistency coefficients (Cronbach's alpha). Reliability coefficients for the MEIM-R averaged α = .88 across 37 samples, a statistically significant increase over the average of α = .84 for the MEIM across 75 studies. Reliability coefficients for the MEIM-R did not differ across study and participant characteristics such as sample gender and ethnic composition. However, consistently lower reliability coefficients averaging α = .81 were found among participants with low levels of education, suggesting that greater attention to data reliability is warranted when evaluating the ethnic identity of individuals such as middle-school students. Future research will be needed to ascertain whether data with other measures of aspects of personal identity (e.g., racial identity, gender identity) also differ as a function of participant level of education and associated cognitive or maturation processes. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Software reliability through fault-avoidance and fault-tolerance

NASA Technical Reports Server (NTRS)

Vouk, Mladen A.; Mcallister, David F.

1992-01-01

Accomplishments in the following research areas are summarized: structure based testing, reliability growth, and design testability with risk evaluation; reliability growth models and software risk management; and evaluation of consensus voting, consensus recovery block, and acceptance voting. Four papers generated during the reporting period are included as appendices.

A Meta-Analysis of Reliability Coefficients in Second Language Research

ERIC Educational Resources Information Center

Plonsky, Luke; Derrick, Deirdre J.

2016-01-01

Ensuring internal validity in quantitative research requires, among other conditions, reliable instrumentation. Unfortunately, however, second language (L2) researchers often fail to report and even more often fail to interpret reliability estimates beyond generic benchmarks for acceptability. As a means to guide interpretations of such estimates,…

A methodology for producing reliable software, volume 1

NASA Technical Reports Server (NTRS)

Stucki, L. G.; Moranda, P. B.; Foshee, G.; Kirchoff, M.; Omre, R.

1976-01-01

An investigation into the areas having an impact on producing reliable software including automated verification tools, software modeling, testing techniques, structured programming, and management techniques is presented. This final report contains the results of this investigation, analysis of each technique, and the definition of a methodology for producing reliable software.

Psychometric properties of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales in early adolescents in Sri Lanka

PubMed Central

2012-01-01

Background The concept Health related Quality of life (HRQOL) is increasingly recognized as an important health outcome measure in clinical and research fields. The present study attempted to evaluate the psychometric properties of the Sinhala version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales among adolescents in Sri Lanka. Methods The original US PedsQL™ was translated into Sinhala and conceptually validated according to international guidelines. A cross-sectional study was conducted among 142 healthy school going adolescents (12-14 years), their parents (n = 120) and a group of adolescents with asthma who attended asthma clinics (n = 115). Reliability was assessed using Cronbach’s alpha and validity by examining scale structure, exploring inter-scale correlations and comparing across known groups (healthy vs. chronically ill). Results The PedsQL™ Sinhala version was found to be acceptable with minimal missing responses. All scales demonstrated satisfactory reliability. Cronbach’s alpha for the total scale scores was 0.85 for adolescent self-report while for the parent proxy-report for the healthy group it was 0.86. No floor effects were observed. Ceiling effects were noticed in self-report and parent proxy-report for the healthy group. Overall results of the multi trait scaling analysis confirmed the scale structure with 74% item-convergent validity, 88% item-discriminant validity and an overall scaling success of 72%. Moderate to high correlations were shown among the domains of teen self-report (Spearman rho = .37-.54) and between teen self-report and parent proxy-reports (Spearman rho = .41-.57). The PedsQL™ tool was able to discriminate between the quality of life in healthy adolescents and adolescents with asthma. Conclusion The findings support the reliability and validity of the Sinhala version of the PedsQL™ 4.0 Generic Core Scales as a generic instrument to measure HRQOL among early adolescents in Sri Lanka in a population setting. PMID:22947113

TEST–RETEST RELIABILITY OF CAPABILITY MEASUREMENT IN THE UK GENERAL POPULATION

PubMed Central

Al-Janabi, Hareth; Flynn, Terry N; Peters, Tim J; Bryan, Stirling; Coast, Joanna

2015-01-01

Although philosophically attractive, it may be difficult, in practice, to measure individuals' capabilities (what they are able to do in their lives) as opposed to their functionings (what they actually do). To examine whether capability information could be reliably self-reported, we administered a measure of self-reported capability (the Investigating Choice Experiments Capability Measure for Adults, ICECAP-A) on two occasions, 2 weeks apart, alongside a self-reported health measure (the EuroQol Five Dimensional Questionnaire with 3 levels, EQ-5D-3L). We found that respondents were able to report capabilities with a moderate level of consistency, although somewhat less reliably than their health status. The more socially orientated nature of some of the capability questions may account for the difference. © 2014 The Authors Health Economics Published by John Wiley & Sons Ltd. PMID:25204621

Development, Validation, and Deployment of an Occupational Test of Color Vision for Air Traffic Control Specialists

DTIC Science & Technology

2011-05-01

Medical Institute’s publications Web site: www.faa.gov/library/reports/medical/oamtechreports i Technical Report Documentation Page 1. Report No. 2...Study One provided evidence of the reliability of the subtests, established performance norms for subjects with normal color vision ( NCV ) on each...Two provided evidence of the reliability of second operational ATCOV subtests, established performance norms for NCV subjects on each subtest

Probabilistic Structural Analysis and Reliability Using NESSUS With Implemented Material Strength Degradation Model

NASA Technical Reports Server (NTRS)

Bast, Callie C.; Jurena, Mark T.; Godines, Cody R.; Chamis, Christos C. (Technical Monitor)

2001-01-01

This project included both research and education objectives. The goal of this project was to advance innovative research and education objectives in theoretical and computational probabilistic structural analysis, reliability, and life prediction for improved reliability and safety of structural components of aerospace and aircraft propulsion systems. Research and education partners included Glenn Research Center (GRC) and Southwest Research Institute (SwRI) along with the University of Texas at San Antonio (UTSA). SwRI enhanced the NESSUS (Numerical Evaluation of Stochastic Structures Under Stress) code and provided consulting support for NESSUS-related activities at UTSA. NASA funding supported three undergraduate students, two graduate students, a summer course instructor and the Principal Investigator. Matching funds from UTSA provided for the purchase of additional equipment for the enhancement of the Advanced Interactive Computational SGI Lab established during the first year of this Partnership Award to conduct the probabilistic finite element summer courses. The research portion of this report presents the cumulation of work performed through the use of the probabilistic finite element program, NESSUS, Numerical Evaluation and Structures Under Stress, and an embedded Material Strength Degradation (MSD) model. Probabilistic structural analysis provided for quantification of uncertainties associated with the design, thus enabling increased system performance and reliability. The structure examined was a Space Shuttle Main Engine (SSME) fuel turbopump blade. The blade material analyzed was Inconel 718, since the MSD model was previously calibrated for this material. Reliability analysis encompassing the effects of high temperature and high cycle fatigue, yielded a reliability value of 0.99978 using a fully correlated random field for the blade thickness. The reliability did not change significantly for a change in distribution type except for a change in distribution from Gaussian to Weibull for the centrifugal load. The sensitivity factors determined to be most dominant were the centrifugal loading and the initial strength of the material. These two sensitivity factors were influenced most by a change in distribution type from Gaussian to Weibull. The education portion of this report describes short-term and long-term educational objectives. Such objectives serve to integrate research and education components of this project resulting in opportunities for ethnic minority students, principally Hispanic. The primary vehicle to facilitate such integration was the teaching of two probabilistic finite element method courses to undergraduate engineering students in the summers of 1998 and 1999.

Comparison of Reliability Measures under Factor Analysis and Item Response Theory

ERIC Educational Resources Information Center

Cheng, Ying; Yuan, Ke-Hai; Liu, Cheng

2012-01-01

Reliability of test scores is one of the most pervasive psychometric concepts in measurement. Reliability coefficients based on a unifactor model for continuous indicators include maximal reliability rho and an unweighted sum score-based omega, among many others. With increasing popularity of item response theory, a parallel reliability measure pi…

Applicability and Limitations of Reliability Allocation Methods

NASA Technical Reports Server (NTRS)

Cruz, Jose A.

2016-01-01

Reliability allocation process may be described as the process of assigning reliability requirements to individual components within a system to attain the specified system reliability. For large systems, the allocation process is often performed at different stages of system design. The allocation process often begins at the conceptual stage. As the system design develops, more information about components and the operating environment becomes available, different allocation methods can be considered. Reliability allocation methods are usually divided into two categories: weighting factors and optimal reliability allocation. When properly applied, these methods can produce reasonable approximations. Reliability allocation techniques have limitations and implied assumptions that need to be understood by system engineers. Applying reliability allocation techniques without understanding their limitations and assumptions can produce unrealistic results. This report addresses weighting factors, optimal reliability allocation techniques, and identifies the applicability and limitations of each reliability allocation technique.

Reliability of the Raven Colored Progressive Matrices Test: Age and Ethnic Group Comparisons.

ERIC Educational Resources Information Center

Carlson, Jerry S.; Jensen, C. Mark

1981-01-01

Reliabilities for the Raven Colored Progressive Matrices Test (CPM) are reported for three age groups (ages 5 1/2- 6 1/2, 6 1/2-7 1/2, and 7 1/2-8 1/2 years) and three ethnic groups (Anglo, Black, and Hispanic). Results indicate CPM is not equally reliable for all age groups, but appears equally reliable for the three ethnic groups. (Author)

The Author’s Guide To Writing 412th Test Wing Technical Reports

DTIC Science & Technology

2014-12-01

control CAD computer aided design cc cubic centimeters C.O. carry-over c/o checkout USAF United States Air Force C1 rolling moment coefficient...cooling air. Mission Impact: Results in maintenance inability to reliably duplicate and isolate valid aircraft failures, and degrades reliability...air. Mission Impact: Results in maintenance inability to reliably duplicate and isolate valid aircraft failures, and degrades reliability of system

The Reliability and Validity of Discrete and Continuous Measures of Psychopathology: A Quantitative Review

ERIC Educational Resources Information Center

Markon, Kristian E.; Chmielewski, Michael; Miller, Christopher J.

2011-01-01

In 2 meta-analyses involving 58 studies and 59,575 participants, we quantitatively summarized the relative reliability and validity of continuous (i.e., dimensional) and discrete (i.e., categorical) measures of psychopathology. Overall, results suggest an expected 15% increase in reliability and 37% increase in validity through adoption of a…

Modifying the Clinical Outcomes in Routine Evaluation Measure for Use with People Who Have a Learning Disability

ERIC Educational Resources Information Center

Marshall, Keith; Willoughby-Booth, Simon

2007-01-01

There are few reliable self-report measures suitable for people with a learning disability in reporting psychological distress. This study examines the modification of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM), exploring its reliability, using two different presentation styles. One style included a sequencing task then…

Diet Measurement in Vietnamese Youth: Concurrent Reliability of a Self-Administered Food Frequency Questionnaire.

ERIC Educational Resources Information Center

Wiecha, John M.; And Others

1994-01-01

Vietnamese high school students completed a food frequency questionnaire (FFQ) and completed daily diet reports for seven weeks. Data from the FFQ were compared to the food reports. The results indicated a few simple FFQ items, particularly for indicator foods such as rice, were reliable for dietary assessment for that population. (SM)

The Chinese Version of the Self-Report Family Inventory: Reliability and Validity.

ERIC Educational Resources Information Center

Shek, Daniel T. L.; Lai, Kelly Y. C.

2001-01-01

Reliability and validity of Chinese Self-Report Family Inventory (C-SFI) were examined in three studies. Study 1 showed C-SFI was temporally stable and internally consistent. Study 2 indicated C-SFI could discriminate between clinical and nonclinical groups. Study 3 gave support for internal consistency, concurrent validity and construct validity.…

Reliability and Maintainability model (RAM) user and maintenance manual. Part 2

NASA Technical Reports Server (NTRS)

Ebeling, Charles E.

1995-01-01

This report documents the procedures for utilizing and maintaining the Reliability and Maintainability Model (RAM) developed by the University of Dayton for the NASA Langley Research Center (LaRC). The RAM model predicts reliability and maintainability (R&M) parameters for conceptual space vehicles using parametric relationships between vehicle design and performance characteristics and subsystem mean time between maintenance actions (MTBM) and manhours per maintenance action (MH/MA). These parametric relationships were developed using aircraft R&M data from over thirty different military aircraft of all types. This report describes the general methodology used within the model, the execution and computational sequence, the input screens and data, the output displays and reports, and study analyses and procedures. A source listing is provided.

Reliability and validity of two multidimensional self-reported physical activity questionnaires in people with chronic low back pain.

PubMed

Carvalho, Flávia A; Morelhão, Priscila K; Franco, Marcia R; Maher, Chris G; Smeets, Rob J E M; Oliveira, Crystian B; Freitas Júnior, Ismael F; Pinto, Rafael Z

2017-02-01

Although there is some evidence for reliability and validity of self-report physical activity (PA) questionnaires in the general adult population, it is unclear whether we can assume similar measurement properties in people with chronic low back pain (LBP). To determine the test-retest reliability of the International Physical Activity Questionnaire (IPAQ) long-version and the Baecke Physical Activity Questionnaire (BPAQ) and their criterion-related validity against data derived from accelerometers in patients with chronic LBP. Cross-sectional study. Patients with non-specific chronic LBP were recruited. Each participant attended the clinic twice (one week interval) and completed self-report PA. Accelerometer measures >7 days included time spent in moderate-and-vigorous physical activity, steps/day, counts/minute, and vector magnitude counts/minute. Intraclass Correlation Coefficients (ICC) and Bland and Altman method were used to determine reliability and spearman rho correlation were used for criterion-related validity. A total of 73 patients were included in our analyses. The reliability analyses revealed that the BPAQ and its subscales have moderate to excellent reliability (ICC 2,1 : 0.61 to 0.81), whereas IPAQ and most IPAQ domains (except walking) showed poor reliability (ICC 2,1 : 0.20 to 0.40). The Bland and Altman method revealed larger discrepancies for the IPAQ. For the validity analysis, questionnaire and accelerometer measures showed at best fair correlation (rho < 0.37). Although the BPAQ showed better reliability than the IPAQ long-version, both questionnaires did not demonstrate acceptable validity against accelerometer data. These findings suggest that questionnaire and accelerometer PA measures should not be used interchangeably in this population. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reliability of self-reported antisocial personality disorder symptoms among substance abusers.

PubMed

Cottler, L B; Compton, W M; Ridenour, T A; Ben Abdallah, A; Gallagher, T

1998-02-01

It is estimated that from 20 to 60% of substance abusers meet criteria for Antisocial Personality Disorder (APD). An accurate and reliable diagnosis is important because persons meeting criteria for APD, by the nature of their disorder, are less likely to change behaviors and more likely to relapse to both substance abuse and high risk behaviors. To understand more about the reliability of the disorder and symptoms of APD, the Diagnostic Interview Schedule Version III-R (DIS) was administered to 453 substance abusers ascertained from treatment programs and from the general population (St Louis Epidemiological Catchment Area (ECA) follow-up study). Estimates of the 1 week, test-retest reliability for the childhood conduct disorder criterion, the adult antisocial behavior criterion, and APD diagnosis fell in the good agreement range, as measured by kappa. The internal consistency of these DIS symptoms was adequate to acceptable. Individual DIS criteria designed to measure childhood conduct disorder ranged from fair to good for most items; reliability was slightly higher for the adult antisocial behavior symptom items. Finally, self-reported 'liars' were no more unreliable in their reports of their behaviors than 'non-liars'.

Unreliability as a Threat to Understanding Psychopathology: The Cautionary Tale of Attentional Bias

PubMed Central

Rodebaugh, Thomas L.; Scullin, Rachel B.; Langer, Julia K.; Dixon, David J.; Huppert, Jonathan D.; Bernstein, Amit; Zvielli, Ariel; Lenze, Eric J.

2016-01-01

The use of unreliable measures constitutes a threat to our understanding of psychopathology, because advancement of science using both behavioral and biologically-oriented measures can only be certain if such measurements are reliable. Two pillars of NIMH’s portfolio – the Research Domain Criteria (RDoC) initiative for psychopathology and the target engagement initiative in clinical trials – cannot succeed without measures that possess the high reliability necessary for tests involving mediation and selection based on individual differences. We focus on the historical lack of reliability of attentional bias measures as an illustration of how reliability can pose a threat to our understanding. Our own data replicate previous findings of poor reliability for traditionally-used scores, which suggests a serious problem with the ability to test theories regarding attentional bias. This lack of reliability may also suggest problems with the assumption (in both theory and the formula for the scores) that attentional bias is consistent and stable across time. In contrast, measures accounting for attention as a dynamic process in time show good reliability in our data. The field is sorely in need of research reporting findings and reliability for attentional bias scores using multiple methods, including those focusing on dynamic processes over time. We urge researchers to test and report reliability of all measures, considering findings of low reliability not just as a nuisance but as an opportunity to modify and improve upon the underlying theory. Full assessment of reliability of measures will maximize the possibility that RDoC (and psychological science more generally) will succeed. PMID:27322741

The somatic symptom scale-8 (SSS-8): a brief measure of somatic symptom burden.

PubMed

Gierk, Benjamin; Kohlmann, Sebastian; Kroenke, Kurt; Spangenberg, Lena; Zenger, Markus; Brähler, Elmar; Löwe, Bernd

2014-03-01

Somatic symptoms are the core features of many medical diseases, and they are used to evaluate the severity and course of illness. The 8-item Somatic Symptom Scale (SSS-8) was recently developed as a brief, patient-reported outcome measure of somatic symptom burden, but its reliability, validity, and usefulness have not yet been tested. To investigate the reliability, validity, and severity categories as well as the reference scores of the SSS-8. A national, representative general-population survey was performed between June 15, 2012, and July 15, 2012, in Germany, including 2510 individuals older than 13 years. The SSS-8 mean (SD), item-total correlations, Cronbach α, factor structure, associations with measures of construct validity (Patient Health Questionnaire-2 depression scale, Generalized Anxiety Disorder-2 scale, visual analog scale for general health status, 12-month health care use), severity categories, and percentile rank reference scores. The SSS-8 had excellent item characteristics and good reliability (Cronbach α = 0.81). The factor structure reflects gastrointestinal, pain, fatigue, and cardiopulmonary aspects of the general somatic symptom burden. Somatic symptom burden as measured by the SSS-8 was significantly associated with depression (r = 0.57 [95% CI, 0.54 to 0.60]), anxiety (r = 0.55 [95% CI, 0.52 to 0.58]), general health status (r = -0.24 [95% CI, -0.28 to -0.20]), and health care use (incidence rate ratio, 1.12 [95% CI, 1.10 to 1.14]). The SSS-8 severity categories were calculated in accordance with percentile ranks: no to minimal (0-3 points), low (4-7 points), medium (8-11 points), high (12-15 points), and very high (16-32 points) somatic symptom burden. For every SSS-8 severity category increase, there was a 53% (95% CI, 44% to 63%) increase in health care visits. The SSS-8 is a reliable and valid self-report measure of somatic symptom burden. Cutoff scores identify individuals with low, medium, high, and very high somatic symptom burden.

Parent proxy-report of their children's health-related quality of life: an analysis of 13,878 parents' reliability and validity across age subgroups using the PedsQL 4.0 Generic Core Scales.

PubMed

Varni, James W; Limbers, Christine A; Burwinkle, Tasha M

2007-01-03

Health-related quality of life (HRQOL) measurement has emerged as an important health outcome in clinical trials, clinical practice improvement strategies, and healthcare services research and evaluation. While pediatric patient self-report should be considered the standard for measuring perceived HRQOL, there are circumstances when children are too young, too cognitively impaired, too ill or fatigued to complete a HRQOL instrument, and reliable and valid parent proxy-report instruments are needed in such cases. Further, it is typically parents' perceptions of their children's HRQOL that influences healthcare utilization. Data from the PedsQL DatabaseSM were utilized to test the reliability and validity of parent proxy-report at the individual age subgroup level for ages 2-16 years as recommended by recent FDA guidelines. The sample analyzed represents parent proxy-report age data on 13,878 children ages 2 to 16 years from the PedsQL 4.0 Generic Core Scales DatabaseSM. Parents were recruited from general pediatric clinics, subspecialty clinics, and hospitals in which their children were being seen for well-child checks, mild acute illness, or chronic illness care (n = 3,718, 26.8%), and from a State Children's Health Insurance Program (SCHIP) in California (n = 10,160, 73.2%). The percentage of missing item responses for the parent proxy-report sample as a whole was 2.1%, supporting feasibility. The majority of the parent proxy-report scales across the age subgroups exceeded the minimum internal consistency reliability standard of 0.70 required for group comparisons, while the Total Scale Scores across the age subgroups approached or exceeded the reliability criterion of 0.90 recommended for analyzing individual patient scale scores. Construct validity was demonstrated utilizing the known groups approach. For each PedsQL scale and summary score, across age subgroups, healthy children demonstrated a statistically significant difference in HRQOL (better HRQOL) than children with a known chronic health condition, with most effect sizes in the medium to large effect size range. The results demonstrate the feasibility, reliability, and validity of parent proxy-report at the individual age subgroup for ages 2-16 years. These analyses are consistent with recent FDA guidelines which require instrument development and validation testing for children and adolescents within fairly narrow age groupings and which determine the lower age limit at which reliable and valid responses across age categories are achievable. Even as pediatric patient self-report is advocated, there remains a fundamental role for parent proxy-report in pediatric clinical trials and health services research.

Reliability of joint count assessment in rheumatoid arthritis: a systematic literature review.

PubMed

Cheung, Peter P; Gossec, Laure; Mak, Anselm; March, Lyn

2014-06-01

Joint counts are central to the assessment of rheumatoid arthritis (RA) but reliability is an issue. To evaluate the reliability and agreement of joint counts (intra-observer and inter-observer) by health care professionals (physicians, nurses, and metrologists) and patients in RA, and the impact of training and standardization on joint count reliability through a systematic literature review. Articles reporting joint count reliability or agreement in RA in PubMed, EMBase, and the Cochrane library between 1960 and 2012 were selected. Data were extracted regarding tender joint counts (TJCs) and swollen joint counts (SJCs) derived by physicians, metrologists, or patients for intra-observer and inter-observer reliability. In addition, methods and effects of training or standardization were extracted. Statistics expressing reliability such as intraclass correlation coefficients (ICCs) were extracted. Data analysis was primarily descriptive due to high heterogeneity. Twenty-eight studies on health care professionals (HCP) and 20 studies on patients were included. Intra-observer reliability for TJCs and SJCs was good for HCPs and patients (range of ICC: 0.49-0.98). Inter-observer reliability between HCPs for TJCs was higher than for SJCs (range of ICC: 0.64-0.88 vs. 0.29-0.98). Patient inter-observer reliability with HCPs as comparators was better for TJCs (range of ICC: 0.31-0.91) compared to SJCs (0.16-0.64). Nine studies (7 with HCPs and 2 with patients) evaluated consensus or training, with improvement in reliability of TJCs but conflicting evidence for SJCs. Intra- and inter-observer reliability was high for TJCs for HCPs and patients: among all groups, reliability was better for TJCs than SJCs. Inter-observer reliability of SJCs was poorer for patients than HCPs. Data were inconclusive regarding the potential for training to improve SJC reliability. Overall, the results support further evaluation for patient-reported joint counts as an outcome measure. © 2013 Published by Elsevier Inc.

Reliability and Validity of 2 Self-Report Measures to Assess Sedentary Behavior in Older Adults.

PubMed

Gennuso, Keith P; Matthews, Charles E; Colbert, Lisa H

2015-05-01

The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults. Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin's concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity. Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = -0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin's r = .005; 95% CI, -0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53). Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.

Field-Induced Crystalline-to-Amorphous Phase Transformation on the Si Nano-Apex and the Achieving of Highly Reliable Si Nano-Cathodes

PubMed Central

Huang, Yifeng; Deng, Zexiang; Wang, Weiliang; Liang, Chaolun; She, Juncong; Deng, Shaozhi; Xu, Ningsheng

2015-01-01

Nano-scale vacuum channel transistors possess merits of higher cutoff frequency and greater gain power as compared with the conventional solid-state transistors. The improvement in cathode reliability is one of the major challenges to obtain high performance vacuum channel transistors. We report the experimental findings and the physical insight into the field induced crystalline-to-amorphous phase transformation on the surface of the Si nano-cathode. The crystalline Si tip apex deformed to amorphous structure at a low macroscopic field (0.6~1.65 V/nm) with an ultra-low emission current (1~10 pA). First-principle calculation suggests that the strong electrostatic force exerting on the electrons in the surface lattices would take the account for the field-induced atomic migration that result in an amorphization. The arsenic-dopant in the Si surface lattice would increase the inner stress as well as the electron density, leading to a lower amorphization field. Highly reliable Si nano-cathodes were obtained by employing diamond like carbon coating to enhance the electron emission and thus decrease the surface charge accumulation. The findings are crucial for developing highly reliable Si-based nano-scale vacuum channel transistors and have the significance for future Si nano-electronic devices with narrow separation. PMID:25994377

Parent-reported social support for child's fruit and vegetable intake: validity of measures.

PubMed

Dave, Jayna M; Evans, Alexandra E; Condrasky, Marge D; Williams, Joel E

2012-01-01

To develop and validate measures of parental social support to increase their child's fruit and vegetable (FV) consumption. Cross-sectional study design. School and home. Two hundred three parents with at least 1 elementary school-aged child. Parents completed a questionnaire that included instrumental social support scale (ISSPS), emotional social support scale (ESSPS), household FV availability and accessibility index, and demographics. Exploratory factor analysis with promax rotation was conducted to obtain the psychometric properties of ISSPS and ESSPS. Internal consistency and test-retest reliabilities were also assessed. Factor analysis indicated a 4-factor model for ESSPS: positive encouragement, negative role modeling, discouragement, and an item cluster called reinforcement. Psychometric properties indicated that ISSPS performed best as independent single scales with α = .87. Internal consistency reliabilities were acceptable, and test-retest reliabilities ranged from low to acceptable. Correlations between scales, subscales, and item clusters were significant (P < .05). In addition, ISSPS and the positive encouragement subscale were significantly correlated with household FV availability. The ISSPS and ESSPS subscales demonstrated good internal consistency reliability and are suitable for impact assessment of an intervention designed to target parents to help their children eat more fruit and vegetables. Copyright © 2012 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Development and psychometric properties of the Ethics Environment Questionnaire.

PubMed

McDaniel, C

1997-09-01

The author reports on the development and the psychometric properties of the Ethics Environment Questionnaire (EEQ), an instrument by which to measure the opinions of health-care providers about ethics in their clinical practice organizations. The EEQ was developed to increase the number of valid and reliable measures pertaining to ethics in health-care delivery. The EEQ is a 20-item self-administered questionnaire using a Likert-type 5-point format, offering ease of administration. It is applicable to a cross-section of health-care practitioners and health-care facilities. The mean administration time is 10 minutes. The EEQ represents testing on 450 respondents in acute care settings among a cross-section of acute care facilities. Internal consistency reliability using Cronbach's alpha coefficient is 0.93, and the test-retest reliability is 0.88. Construct, content, and criterion validity are established. The scale is unidimensional, with factor loadings exceeding the minimum preset criterion. Mean score is 3.1 out of 5.0, with scores of 3.5 and above interpreted as reflective of a positive ethics environment. The EEQ provides a measure of ethics in health-care organizations among multi-practitioners in clinical practice on a valid, reliable, cost effective, and easily administered instrument that requires minimum investment of personnel time.

Identification of Reliable Components in Multivariate Curve Resolution-Alternating Least Squares (MCR-ALS): a Data-Driven Approach across Metabolic Processes.

PubMed

Motegi, Hiromi; Tsuboi, Yuuri; Saga, Ayako; Kagami, Tomoko; Inoue, Maki; Toki, Hideaki; Minowa, Osamu; Noda, Tetsuo; Kikuchi, Jun

2015-11-04

There is an increasing need to use multivariate statistical methods for understanding biological functions, identifying the mechanisms of diseases, and exploring biomarkers. In addition to classical analyses such as hierarchical cluster analysis, principal component analysis, and partial least squares discriminant analysis, various multivariate strategies, including independent component analysis, non-negative matrix factorization, and multivariate curve resolution, have recently been proposed. However, determining the number of components is problematic. Despite the proposal of several different methods, no satisfactory approach has yet been reported. To resolve this problem, we implemented a new idea: classifying a component as "reliable" or "unreliable" based on the reproducibility of its appearance, regardless of the number of components in the calculation. Using the clustering method for classification, we applied this idea to multivariate curve resolution-alternating least squares (MCR-ALS). Comparisons between conventional and modified methods applied to proton nuclear magnetic resonance ((1)H-NMR) spectral datasets derived from known standard mixtures and biological mixtures (urine and feces of mice) revealed that more plausible results are obtained by the modified method. In particular, clusters containing little information were detected with reliability. This strategy, named "cluster-aided MCR-ALS," will facilitate the attainment of more reliable results in the metabolomics datasets.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kisner, R.; Melin, A.; Burress, T.

The objective of this project is to demonstrate improved reliability and increased performance made possible by deeply embedding instrumentation and controls (I&C) in nuclear power plant (NPP) components and systems. The project is employing a highly instrumented canned rotor, magnetic bearing, fluoride salt pump as its I&C technology demonstration platform. I&C is intimately part of the basic millisecond-by-millisecond functioning of the system; treating I&C as an integral part of the system design is innovative and will allow significant improvement in capabilities and performance. As systems become more complex and greater performance is required, traditional I&C design techniques become inadequate andmore » more advanced I&C needs to be applied. New I&C techniques enable optimal and reliable performance and tolerance of noise and uncertainties in the system rather than merely monitoring quasistable performance. Traditionally, I&C has been incorporated in NPP components after the design is nearly complete; adequate performance was obtained through over-design. By incorporating I&C at the beginning of the design phase, the control system can provide superior performance and reliability and enable designs that are otherwise impossible. This report describes the progress and status of the project and provides a conceptual design overview for the platform to demonstrate the performance and reliability improvements enabled by advanced embedded I&C.« less

Statistical issues in reporting quality data: small samples and casemix variation.

PubMed

Zaslavsky, A M

2001-12-01

To present two key statistical issues that arise in analysis and reporting of quality data. Casemix variation is relevant to quality reporting when the units being measured have differing distributions of patient characteristics that also affect the quality outcome. When this is the case, adjustment using stratification or regression may be appropriate. Such adjustments may be controversial when the patient characteristic does not have an obvious relationship to the outcome. Stratified reporting poses problems for sample size and reporting format, but may be useful when casemix effects vary across units. Although there are no absolute standards of reliability, high reliabilities (interunit F > or = 10 or reliability > or = 0.9) are desirable for distinguishing above- and below-average units. When small or unequal sample sizes complicate reporting, precision may be improved using indirect estimation techniques that incorporate auxiliary information, and 'shrinkage' estimation can help to summarize the strength of evidence about units with small samples. With broader understanding of casemix adjustment and methods for analyzing small samples, quality data can be analysed and reported more accurately.

Enhanced Component Performance Study: Air-Operated Valves 1998-2014

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schroeder, John Alton

2015-11-01

This report presents a performance evaluation of air-operated valves (AOVs) at U.S. commercial nuclear power plants. The data used in this study are based on the operating experience failure reports from fiscal year 1998 through 2014 for the component reliability as reported in the Institute of Nuclear Power Operations (INPO) Consolidated Events Database (ICES). The AOV failure modes considered are failure-to-open/close, failure to operate or control, and spurious operation. The component reliability estimates and the reliability data are trended for the most recent 10-year period, while yearly estimates for reliability are provided for the entire active period. One statistically significantmore » trend was observed in the AOV data: The frequency of demands per reactor year for valves recording the fail-to-open or fail-to-close failure modes, for high-demand valves (those with greater than twenty demands per year), was found to be decreasing. The decrease was about three percent over the ten year period trended.« less

A Benefit Analysis of Infusing Wireless into Aircraft and Fleet Operations - Report to Seedling Project Efficient Reconfigurable Cockpit Design and Fleet Operations Using Software Intensive, Network Enabled, Wireless Architecture (ECON)

NASA Technical Reports Server (NTRS)

Alexandrov, Natalia; Holmes, Bruce J.; Hahn, Andrew S.

2016-01-01

We report on an examination of potential benefits of infusing wireless technologies into various areas of aircraft and airspace operations. The analysis is done in support of a NASA seedling project Efficient Reconfigurable Cockpit Design and Fleet Operations Using Software Intensive, Network Enabled Wireless Architecture (ECON). The study has two objectives. First, we investigate one of the main benefit hypotheses of the ECON proposal: that the replacement of wired technologies with wireless would lead to significant weight reductions on an aircraft, among other benefits. Second, we advance a list of wireless technology applications and discuss their system benefits. With regard to the primary hypothesis, we conclude that the promise of weight reduction is premature. Specificity of the system domain and aircraft, criticality of components, reliability of wireless technologies, the weight of replacement or augmentation equipment, and the cost of infusion must all be taken into account among other considerations, to produce a reliable estimate of weight savings or increase.

Methodological, technical, and ethical issues of a computerized data system.

PubMed

Rice, C A; Godkin, M A; Catlin, R J

1980-06-01

This report examines some methodological, technical, and ethical issues which need to be addressed in designing and implementing a valid and reliable computerized clinical data base. The report focuses on the data collection system used by four residency based family health centers, affiliated with the University of Massachusetts Medical Center. It is suggested that data reliability and validity can be maximized by: (1) standardizing encounter forms at affiliated health centers to eliminate recording biases and ensure data comparability; (2) using forms with a diagnosis checklist to reduce coding errors and increase the number of diagnoses recorded per encounter; (3) developing uniform diagnostic criteria; (4) identifying sources of error, including discrepancies of clinical data as recorded in medical records, encounter forms, and the computer; and (5) improving provider cooperation in recording data by distributing data summaries which reinforce the data's applicability to service provision. Potential applications of the data for research purposes are restricted by personnel and computer costs, confidentiality considerations, programming related issues, and, most importantly, health center priorities, largely focused on patient care, not research.

Narrative review: should teaching of the respiratory physical examination be restricted only to signs with proven reliability and validity?

PubMed

Benbassat, Jochanan; Baumal, Reuben

2010-08-01

To review the reported reliability (reproducibility, inter-examiner agreement) and validity (sensitivity, specificity and likelihood ratios) of respiratory physical examination (PE) signs, and suggest an approach to teaching these signs to medical students. Review of the literature. We searched Paper Chase between 1966 and June 2009 to identify and evaluate published studies on the diagnostic accuracy of respiratory PE signs. Most studies have reported low to fair reliability and sensitivity values. However, some studies have found high specificites for selected PE signs. None of the studies that we reviewed adhered to all of the STARD criteria for reporting diagnostic accuracy. Possible flaws in study designs may have led to underestimates of the observed diagnostic accuracy of respiratory PE signs. The reported poor reliabilities may have been due to differences in the PE skills of the participating examiners, while the sensitivities may have been confounded by variations in the severity of the diseases of the participating patients. IMPLICATION FOR PRACTICE AND MEDICAL EDUCATION: Pending the results of properly controlled studies, the reported poor reliability and sensitivity of most respiratory PE signs do not necessarily detract from their clinical utility. Therefore, we believe that a meticulously performed respiratory PE, which aims to explore a diagnostic hypothesis, as opposed to a PE that aims to detect a disease in an asymptomatic person, remains a cornerstone of clinical practice. We propose teaching the respiratory PE signs according to their importance, beginning with signs of life-threatening conditions and those that have been reported to have a high specificity, and ending with signs that are "nice to know," but are no longer employed because of the availability of more easily performed tests.

Narrative Review: Should Teaching of the Respiratory Physical Examination Be Restricted Only to Signs with Proven Reliability and Validity?

PubMed Central

Baumal, Reuben

2010-01-01

OBJECTIVE To review the reported reliability (reproducibility, inter-examiner agreement) and validity (sensitivity, specificity and likelihood ratios) of respiratory physical examination (PE) signs, and suggest an approach to teaching these signs to medical students. METHODS Review of the literature. We searched Paper Chase between 1966 and June 2009 to identify and evaluate published studies on the diagnostic accuracy of respiratory PE signs. RESULTS Most studies have reported low to fair reliability and sensitivity values. However, some studies have found high specificites for selected PE signs. None of the studies that we reviewed adhered to all of the STARD criteria for reporting diagnostic accuracy. CONCLUSIONS Possible flaws in study designs may have led to underestimates of the observed diagnostic accuracy of respiratory PE signs. The reported poor reliabilities may have been due to differences in the PE skills of the participating examiners, while the sensitivities may have been confounded by variations in the severity of the diseases of the participating patients. IMPLICATION FOR PRACTICE AND MEDICAL EDUCATION Pending the results of properly controlled studies, the reported poor reliability and sensitivity of most respiratory PE signs do not necessarily detract from their clinical utility. Therefore, we believe that a meticulously performed respiratory PE, which aims to explore a diagnostic hypothesis, as opposed to a PE that aims to detect a disease in an asymptomatic person, remains a cornerstone of clinical practice. We propose teaching the respiratory PE signs according to their importance, beginning with signs of life-threatening conditions and those that have been reported to have a high specificity, and ending with signs that are "nice to know," but are no longer employed because of the availability of more easily performed tests. PMID:20349154

Validity and reliability of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™) Generic Core Scales in children

PubMed Central

2012-01-01

Background This study aimed to investigate the reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales in children. Methods A standard forward and backward translation procedure was used to translate the US English version of the PedsQL™ 4.0 Generic Core Scales for children into the Iranian language (Persian). The Iranian version of the PedsQL™ 4.0 Generic Core Scales was completed by 503 healthy and 22 chronically ill children aged 8-12 years and their parents. The reliability was evaluated using internal consistency. Known-groups discriminant comparisons were made, and exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted. Results The internal consistency, as measured by Cronbach's alpha coefficients, exceeded the minimum reliability standard of 0.70. All monotrait-multimethod correlations were higher than multitrait-multimethod correlations. The intraclass correlation coefficients (ICC) between the children self-report and parent proxy-reports showed moderate to high agreement. Exploratory factor analysis extracted six factors from the PedsQL™ 4.0 for both self and proxy reports, accounting for 47.9% and 54.8% of total variance, respectively. The results of the confirmatory factor analysis for 6-factor models for both self-report and proxy-report indicated acceptable fit for the proposed models. Regarding health status, as hypothesized from previous studies, healthy children reported significantly higher health-related quality of life than those with chronic illnesses. Conclusions The findings support the initial reliability and validity of the Iranian version of the PedsQL™ 4.0 as a generic instrument to measure health-related quality of life of children in Iran. PMID:22221765

Validity and reliability of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™) Generic Core Scales in children.

PubMed

Amiri, Parisa; Eslamian, Ghazaleh; Mirmiran, Parvin; Shiva, Niloofar; Jafarabadi, Mohammad Asghari; Azizi, Fereidoun

2012-01-05

This study aimed to investigate the reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales in children. A standard forward and backward translation procedure was used to translate the US English version of the PedsQL™ 4.0 Generic Core Scales for children into the Iranian language (Persian). The Iranian version of the PedsQL™ 4.0 Generic Core Scales was completed by 503 healthy and 22 chronically ill children aged 8-12 years and their parents. The reliability was evaluated using internal consistency. Known-groups discriminant comparisons were made, and exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were conducted. The internal consistency, as measured by Cronbach's alpha coefficients, exceeded the minimum reliability standard of 0.70. All monotrait-multimethod correlations were higher than multitrait-multimethod correlations. The intraclass correlation coefficients (ICC) between the children self-report and parent proxy-reports showed moderate to high agreement. Exploratory factor analysis extracted six factors from the PedsQL™ 4.0 for both self and proxy reports, accounting for 47.9% and 54.8% of total variance, respectively. The results of the confirmatory factor analysis for 6-factor models for both self-report and proxy-report indicated acceptable fit for the proposed models. Regarding health status, as hypothesized from previous studies, healthy children reported significantly higher health-related quality of life than those with chronic illnesses. The findings support the initial reliability and validity of the Iranian version of the PedsQL™ 4.0 as a generic instrument to measure health-related quality of life of children in Iran.

Telling tails explain the discrepancy in sexual partner reports.

PubMed

Morris, M

1993-09-30

An anomaly often noted in surveys of sexual behaviour is that the number of female sexual partners reported by men exceeds the number of male partners reported by women. This discrepancy is sometimes interpreted as evidence that surveys produce unreliable data due to sex-linked response and sampling bias. We report here that among the 90% of respondents reporting fewer than 20 lifetime partners, however, the ratio of male to female reports drops from 3.2:1 to 1.2:1. The anomaly thus appears to be driven by the upper tail of the contact distribution, an example of the general principle of outlier influence in data analysis. The implication is that sexual behaviour surveys provide reliable data in the main, and that simple improvements can increase precision in the upper tail to make these data more useful for modelling the spread of AIDS and other sexually transmitted diseases.

Interventions for Age-Related Macular Degeneration: Are Practice Guidelines Based on Systematic Reviews?

PubMed Central

Lindsley, Kristina; Li, Tianjing; Ssemanda, Elizabeth; Virgili, Gianni; Dickersin, Kay

2016-01-01

Topic Are existing systematic reviews of interventions for age-related macular degeneration incorporated into clinical practice guidelines? Clinical relevance High-quality systematic reviews should be used to underpin evidence-based clinical practice guidelines and clinical care. We have examined the reliability of systematic reviews of interventions for age-related macular degeneration (AMD) and described the main findings of reliable reviews in relation to clinical practice guidelines. Methods Eligible publications are systematic reviews of the effectiveness of treatment interventions for AMD. We searched a database of systematic reviews in eyes and vision and employed no language or date restrictions; the database is up-to-date as of May 6, 2014. Two authors independently screened records for eligibility and abstracted and assessed the characteristics and methods of each review. We classified reviews as “reliable” when they reported eligibility criteria, comprehensive searches, appraisal of methodological quality of included studies, appropriate statistical methods for meta-analysis, and conclusions based on results. We mapped treatment recommendations from the American Academy of Ophthalmology Preferred Practice Patterns (AAO PPP) for AMD to the identified systematic reviews and assessed whether any reliable systematic review was cited or could have been cited to support each treatment recommendation. Results Of 1,570 systematic reviews in our database, 47 met our inclusion criteria. Most of the systematic reviews targeted neovascular AMD and investigated anti-vascular endothelial growth factor (anti-VEGF) interventions, dietary supplements or photodynamic therapy. We classified over two-thirds (33/47) of the reports as reliable. The quality of reporting varied, with criteria for reliable reporting met more often for Cochrane reviews and for reviews whose authors disclosed conflicts of interest. Although most systematic reviews were reliable, anti-VEGF agents and photodynamic therapy were the only interventions identified as effective by reliable reviews. Of 35 treatment recommendations extracted from the AAO PPP, 15 could have been supported with reliable systematic reviews; however, only one recommendation had an accompanying intervention systematic review citation, which we assessed as a reliable systematic review. No reliable systematic review was identified for 20 treatment recommendations, highlighting areas of evidence gaps. Conclusions For AMD, reliable systematic reviews exist for many treatment recommendations in the AAO PPP and should be used to support these recommendations. We also identified areas where no high-level evidence exists. Mapping clinical practice guidelines to existing systematic reviews is one way to highlight areas where evidence generation or evidence synthesis is either available or needed. PMID:26804762

Handling Internet-Based Health Information: Improving Health Information Web Site Literacy Among Undergraduate Nursing Students.

PubMed

Wang, Weiwen; Sun, Ran; Mulvehill, Alice M; Gilson, Courtney C; Huang, Linda L

2017-02-01

Patient care problems arise when health care consumers and professionals find health information on the Internet because that information is often inaccurate. To mitigate this problem, nurses can develop Web literacy and share that skill with health care consumers. This study evaluated a Web-literacy intervention for undergraduate nursing students to find reliable Web-based health information. A pre- and postsurvey queried undergraduate nursing students in an informatics course; the intervention comprised lecture, in-class practice, and assignments about health Web site evaluation tools. Data were analyzed using Wilcoxon and ANOVA signed-rank tests. Pre-intervention, 75.9% of participants reported using Web sites to obtain health information. Postintervention, 87.9% displayed confidence in using an evaluation tool. Both the ability to critique health Web sites (p = .005) and confidence in finding reliable Internet-based health information (p = .058) increased. Web-literacy education guides nursing students to find, evaluate, and use reliable Web sites, which improves their ability to deliver safer patient care. [J Nurs Educ. 2017;56(2):110-114.]. Copyright 2017, SLACK Incorporated.

Deformation of Cases in High Capacitance Value Wet Tantalum Capacitors under Environmental Stresses

NASA Technical Reports Server (NTRS)

Teverovsky, Alexander

2016-01-01

Internal gas pressure in hermetic wet tantalum capacitors is created by air, electrolyte vapor, and gas generated by electrochemical reactions at the electrodes. This pressure increases substantially with temperature and time of operation due to excessive leakage currents. Deformation of the case occurs when the internal pressure exceeds pressure of the environments and can raise significantly when a part operates in space. Contrary to the cylinder case wet tantalum capacitors that have external sealing by welding and internal sealing provided by the Teflon bushing and crimping of the case, no reliable internal sealing exists in the button case capacitors. Single seal design capacitors are used for high capacitance value wet tantalum capacitors manufactured per DLA L&M drawings #04003, 04005, and 10011, and require additional analysis to assure their reliable application in space systems. In this work, leakage currents and case deformation of button case capacitors were measured during different environmental test conditions. Recommendations for derating, screening and qualification testing are given. This work is a continuation of a series of NEPP reports related to quality and reliability of wet tantalum capacitors.

The Elbow-EpiTrainer: a method of delivering graded resistance to the extensor carpi radialis brevis. Effectiveness of a prototype device in a healthy population.

PubMed

Navsaria, Rishi; Ryder, Dionne M; Lewis, Jeremy S; Alexander, Caroline M

2015-03-01

Tennis elbow or lateral epicondylopathy (LE) is experienced as the lateral elbow has a reported prevalence of 1.3%, with symptoms lasting up to 18 months. LE is most commonly attributed to tendinopathy involving the extensor carpi radialis brevis (ECRB) tendon. The aim of tendinopathy management is to alleviate symptoms and restore function that initially involves relative rest followed by progressive therapeutic exercise. To assess the effectiveness of two prototype exercises using commonly available clinical equipment to progressively increase resistance and activity of the ECRB. Eighteen healthy participants undertook two exercise progressions. Surface electromyography was used to record ECRB activity during the two progressions, involving eccentric exercises of the wrist extensors and elbow pronation exercises using a prototype device. The two progressions were assessed for their linearity of progression using repeated ANOVA and linear regression analysis. Five participants repeated the study to assess reliability. The exercise progressions led to an increase in ECRB electromyographic (EMG) activity (p<0.001). A select progression of exercises combining the two protocols increased EMG activity in a linear fashion (p<0.001). The ICC values indicated good reliability (ICC>0.7) between the first and second tests for five participants. Manipulation of resistance and leverage with the prototype exercises was effective in creating significant increases of ECRB normalised EMG activity in a linear manner that may, with future research, become useful to clinicians treating LE. In addition, between trial reliability for the device to generate a consistent load was acceptable. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Reliability and validity of young adults’ anonymous online reports of marijuana use and thoughts about use

PubMed Central

Ramo, Danielle E.; Liu, Howard; Prochaska, Judith J.

2012-01-01

With growing interest in online assessment of substance abuse behaviors, there is a need to formally evaluate the validity of the data gathered. The current investigation evaluated the reliability and validity of anonymous, online reports of young adults’ marijuana use and related cognitions. Young adults age 18 to 25 who had smoked at least one cigarette in the past 30 days were recruited over 14 months to complete an anonymous online survey. Of 3106 eligible cases, 1617 (52%) completed the entire survey. Of those, 54% (n = 884) reported past-month marijuana use (65% male, 70% Caucasian, mean age was 20.4 years [SD = 2.0]). Prevalence of marijuana use was reported reliably across three similar items, and inter-item correlations ranged from fair to excellent for measures of marijuana dependence symptoms and thoughts about marijuana use. Marijuana use frequency demonstrated good construct validity through expected correlations with marijuana use constructs, and non-significant correlations with thoughts about tobacco use. Marijuana frequency distinguished among stages of change for marijuana use and goals for use, but not among gender, ethnicity, or employment groups. Marijuana use and thoughts about use differed by stage of change in the hypothesized directions. Self-reported marijuana use and associated cognitions reported anonymously online from young adults are generally reliable and valid. Online assessments of substance use broaden the reach of addictions research. PMID:22082344

Abdominal pain endpoints currently recommended by the FDA and EMA for adult patients with irritable bowel syndrome may not be reliable in children.

PubMed

Saps, M; Lavigne, J V

2015-06-01

The Food and Drug Administration (FDA) recommended ≥30% decrease on patient-reported outcomes for pain be considered clinically significant in clinical trials for adults with irritable bowel syndrome. This percent change approach may not be appropriate for children. We compared three alternate approaches to determining clinically significant reductions in pain among children. 80 children with functional abdominal pain participated in a study of the efficacy of amitriptyline. Endpoints included patient-reported estimates of feeling better, and pain Visual Analog Scale (VAS). The minimum clinically important difference in pain report was calculated as (i) mean change in VAS score for children reporting being 'better'; (ii) percent changes in pain (≥30% and ≥50%) on the VAS; and (iii) statistically reliable changes on the VAS for 68% and 95% confidence intervals. There was poor agreement between the three approaches. 43.6% of the children who met the FDA ≥30% criterion for clinically significant change did not achieve a reliable level of improvement (95% confidence interval). Children's self-reported ratings of being better may not be statistically reliable. A combined approach in which children must report improvement as better and achieve a statistically significant change may be more appropriate for outcomes in clinical trials. © 2015 John Wiley & Sons Ltd.

Night-to-night arousal variability and interscorer reliability of arousal measurements.

PubMed

Loredo, J S; Clausen, J L; Ancoli-Israel, S; Dimsdale, J E

1999-11-01

Measurement of arousals from sleep is clinically important, however, their definition is not well standardized, and little data exist on reliability. The purpose of this study is to determine factors that affect arousal scoring reliability and night-to-night arousal variability. The night-to-night arousal variability and interscorer reliability was assessed in 20 subjects with and without obstructive sleep apnea undergoing attended polysomnography during two consecutive nights. Five definitions of arousal were studied, assessing duration of electroencephalographic (EEG) frequency changes, increases in electromyographic (EMG) activity and leg movement, association with respiratory events, as well as the American Sleep Disorders Association (ASDA) definition of arousals. NA. NA. NA. Interscorer reliability varied with the definition of arousal and ranged from an Intraclass correlation (ICC) of 0.19 to 0.92. Arousals that included increases in EMG activity or leg movement had the greatest reliability, especially when associated with respiratory events (ICC 0.76 to 0.92). The ASDA arousal definition had high interscorer reliability (ICC 0.84). Reliability was lowest for arousals consisting of EEG changes lasting <3 seconds (ICC 0.19 to 0.37). The within subjects night-to-night arousal variability was low for all arousal definitions In a heterogeneous population, interscorer arousal reliability is enhanced by increases in EMG activity, leg movements, and respiratory events and decreased by short duration EEG arousals. The arousal index night-to-night variability was low for all definitions.

Reliability of the Test of Integrated Language and Literacy Skills (TILLS)

ERIC Educational Resources Information Center

Mailend, Marja-Liisa; Plante, Elena; Anderson, Michele A.; Applegate, E. Brooks; Nelson, Nickola W.

2016-01-01

Background: As new standardized tests become commercially available, it is critical that clinicians have access to the information about a test's psychometric properties, including aspects of reliability. Aims: The purpose of the three studies reported in this article was to investigate the reliability of a new test, the Test of Integrated…

Large Sample Confidence Intervals for Item Response Theory Reliability Coefficients

ERIC Educational Resources Information Center

Andersson, Björn; Xin, Tao

2018-01-01

In applications of item response theory (IRT), an estimate of the reliability of the ability estimates or sum scores is often reported. However, analytical expressions for the standard errors of the estimators of the reliability coefficients are not available in the literature and therefore the variability associated with the estimated reliability…

Final Report to the National Energy Technology Laboratory on FY09-FY13 Cooperative Research with the Consortium for Electric Reliability Technology Solutions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Vittal, Vijay

2015-11-04

The Consortium for Electric Reliability Technology Solutions (CERTS) was formed in 1999 in response to a call from U.S. Congress to restart a federal transmission reliability R&D program to address concerns about the reliability of the U.S. electric power grid. CERTS is a partnership between industry, universities, national laboratories, and government agencies. It researches, develops, and disseminates new methods, tools, and technologies to protect and enhance the reliability of the U.S. electric power system and the efficiency of competitive electricity markets. It is funded by the U.S. Department of Energy’s Office of Electricity Delivery and Energy Reliability (OE). This reportmore » provides an overview of PSERC and CERTS, of the overall objectives and scope of the research, a summary of the major research accomplishments, highlights of the work done under the various elements of the NETL cooperative agreement, and brief reports written by the PSERC researchers on their accomplishments, including research results, publications, and software tools.« less

Variation of Time Domain Failure Probabilities of Jack-up with Wave Return Periods

NASA Astrophysics Data System (ADS)

Idris, Ahmad; Harahap, Indra S. H.; Ali, Montassir Osman Ahmed

2018-04-01

This study evaluated failure probabilities of jack up units on the framework of time dependent reliability analysis using uncertainty from different sea states representing different return period of the design wave. Surface elevation for each sea state was represented by Karhunen-Loeve expansion method using the eigenfunctions of prolate spheroidal wave functions in order to obtain the wave load. The stochastic wave load was propagated on a simplified jack up model developed in commercial software to obtain the structural response due to the wave loading. Analysis of the stochastic response to determine the failure probability in excessive deck displacement in the framework of time dependent reliability analysis was performed by developing Matlab codes in a personal computer. Results from the study indicated that the failure probability increases with increase in the severity of the sea state representing a longer return period. Although the results obtained are in agreement with the results of a study of similar jack up model using time independent method at higher values of maximum allowable deck displacement, it is in contrast at lower values of the criteria where the study reported that failure probability decreases with increase in the severity of the sea state.

2nd Generation RLV Risk Reduction Definition Program: Pratt & Whitney Propulsion Risk Reduction Requirements Program (TA-3 & TA-4)

NASA Technical Reports Server (NTRS)

Matlock, Steve

2001-01-01

This is the final report and addresses all of the work performed on this program. Specifically, it covers vehicle architecture background, definition of six baseline engine cycles, reliability baseline (space shuttle main engine QRAS), and component level reliability/performance/cost for the six baseline cycles, and selection of 3 cycles for further study. This report further addresses technology improvement selection and component level reliability/performance/cost for the three cycles selected for further study, as well as risk reduction plans, and recommendation for future studies.

Measurement of breast density with digital breast tomosynthesis—a systematic review

PubMed Central

McEntee, M F

2014-01-01

Digital breast tomosynthesis (DBT) has gained acceptance as an adjunct to digital mammography in screening. Now that breast density reporting is mandated in several states in the USA, it is increasingly important that the methods of breast density measurement be robust, reliable and consistent. Breast density assessment with DBT needs some consideration since quantitative methods are modelled for two-dimensional (2D) mammography. A review of methods used for breast density assessment with DBT was performed. Existing evidence shows Cumulus has better reproducibility than that of the breast imaging reporting and data system (BI-RADS®) but still suffers from subjective variability; MedDensity is limited by image noise, whilst Volpara and Quantra are robust and consistent. The reported BI-RADs inter-reader breast density agreement (k) ranged from 0.65 to 0.91, with inter-reader correlation (r) ranging from 0.70 to 0.93. The correlation (r) between BI-RADS and Cumulus ranged from 0.54–0.94, whilst that of BI-RADs and MedDensity ranged from 0.48–0.78. The reported agreement (k) between BI-RADs and Volpara is 0.953. Breast density correlation between DBT and 2D mammography ranged from 0.73 to 0.97, with agreement (k) ranging from 0.56 to 0.96. To avoid variability and provide more reliable breast density information for clinicians, automated volumetric methods are preferred. PMID:25146640

Method for evaluating the reliability of compressor impeller of turbocharger for vehicle application in plateau area

NASA Astrophysics Data System (ADS)

Wang, Zheng; Wang, Zengquan; Wang, A.-na; Zhuang, Li; Wang, Jinwei

2016-10-01

As turbocharging diesel engines for vehicle application are applied in plateau area, the environmental adaptability of engines has drawn more attention. For the environmental adaptability problem of turbocharging diesel engines for vehicle application, the present studies almost focus on the optimization of performance match between turbocharger and engine, and the reliability problem of turbocharger is almost ignored. The reliability problem of compressor impeller of turbocharger for vehicle application when diesel engines operate in plateau area is studied. Firstly, the rule that the rotational speed of turbocharger changes with the altitude height is presented, and the potential failure modes of compressor impeller are analyzed. Then, the failure behavior models of compressor impeller are built, and the reliability models of compressor impeller operating in plateau area are developed. Finally, the rule that the reliability of compressor impeller changes with the altitude height is studied, the measurements for improving the reliability of the compressor impellers of turbocharger operating in plateau area are given. The results indicate that when the operating speed of diesel engine is certain, the rotational speed of turbocharger increases with the increase of altitude height, and the failure risk of compressor impeller with the failure modes of hub fatigue and blade resonance increases. The reliability of compressor impeller decreases with the increase of altitude height, and it also decreases as the increase of number of the mission profile cycle of engine. The method proposed can not only be used to evaluating the reliability of compressor impeller when diesel engines operate in plateau area but also be applied to direct the structural optimization of compressor impeller.

Improvement of the Reliability of Dielectrics for MLCC

NASA Astrophysics Data System (ADS)

Nakamura, Tomoyuki; Yao, Takayuki; Ikeda, Jun; Kubodera, Noriyuki; Takagi, Hiroshi

2011-10-01

To achieve enough reliability of monolithic ceramic capacitor, it is important to know the contribution of grain boundary and grain interior to its reliability and insulation resistance. As the number of grain boundaries per layer increased, mean time to failure (MTTF) increased. In addition, as the number of grain boundaries per layer increased, samples showed lower current leakage in the measured electric field range. Using these data, the grain boundary E-J curves were determined by simulation. As a result, temperature and electric field dependence of insulation resistance of grain boundary were very low. The insulation characteristics of one BaTiO3 grain per layer were examined. The resistance and reliability of grain interior were very low. To improve the degradation resistance of grain interior, Ca-doped BaTiO3-based dielectrics were developed. The influence of Ca substitution on MTTF was investigated and it was found out that MTTF increased with the increase of Ca substitution.

The Design, Development, and Reliability Testing of a New Innovative Device to Measure Ankle Joint Dorsiflexion.

PubMed

Charles, James

2016-09-02

In clinical and research settings, ankle joint dorsiflexion needs to be reliably measured. Dorsiflexion is often measured by goniometry, but the intrarater and interrater reliability of this technique have been reported to be poor. Many devices to measure dorsiflexion have been developed for clinical and research use. An evaluation of 12 current tools showed that none met all of the desirable criteria. The purpose of this study was to design and develop a device that rates highly in all of the criteria and that can be proved to be highly reliable. While supine on a treatment table, 14 participants had a foot placed in the Charles device and ankle joint dorsiflexion measured and recorded three times with a digital inclinometer. The mean of the three readings was determined to be the ankle joint dorsiflexion. The analysis used was intraclass correlation coefficient (ICC). There was very little difference in ICC single or average measures between left and right feet, so data were pooled (N = 28). The single-measure ICC was 0.998 (95% confidence interval, 0.996-0.998). The average-measure ICC was 0.998 (95% confidence interval, 0.995-0.999). Limits of agreement for the average measure were also very good: -1.30° to 1.65°. The Charles device meets all of the desirable criteria and has many innovative features, increasing its appropriateness for clinical and research applications. It has a suitable design for measuring dorsiflexion and high intrarater and interrater reliability.

The psychometric properties of Observer OPTION(5), an observer measure of shared decision making.

PubMed

Barr, Paul J; O'Malley, Alistair James; Tsulukidze, Maka; Gionfriddo, Michael R; Montori, Victor; Elwyn, Glyn

2015-08-01

Observer OPTION(5) was designed as a more efficient version of OPTION(12), the most commonly used measure of shared decision making (SDM). The current paper assesses the psychometric properties of OPTION(5). Two raters used OPTION(5) to rate recordings of clinical encounters from two previous patient decision aid (PDA) trials (n=201; n=110). A subsample was re-rated two weeks later. We assessed discriminative validity, inter-rater reliability, intra-rater reliability, and concurrent validity. OPTION(5) demonstrated discriminative validity, with increases in SDM between usual care and PDA arms. OPTION(5) also demonstrated concurrent validity with OPTION(12), r=0.61 (95%CI 0.54, 0.68) and intra-rater reliability, r=0.93 (0.83, 0.97). The mean difference in rater score was 8.89 (95% Credibility Interval, 7.5, 10.3), with intraclass correlation (ICC) of 0.67 (95% Credibility Interval, 0.51, 0.91) for the accuracy of rater scores and 0.70 (95% Credibility Interval, 0.56, 0.94) for the consistency of rater scores across encounters, indicating good inter-rater reliability. Raters reported lower cognitive burden when using OPTION(5) compared to OPTION(12). OPTION(5) is a brief, theoretically grounded observer measure of SDM with promising psychometric properties in this sample and low burden on raters. OPTION(5) has potential to provide reliable, valid assessment of SDM in clinical encounters. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

A Methodological Critique of the ProPublica Surgeon Scorecard

PubMed Central

Friedberg, Mark W.; Pronovost, Peter J.; Shahian, David M.; Safran, Dana Gelb; Bilimoria, Karl Y.; Elliott, Marc N.; Damberg, Cheryl L.; Dimick, Justin B.; Zaslavsky, Alan M.

2016-01-01

Abstract On July 14, 2015, ProPublica published its Surgeon Scorecard, which displays “Adjusted Complication Rates” for individual, named surgeons for eight surgical procedures performed in hospitals. Public reports of provider performance have the potential to improve the quality of health care that patients receive. A valid performance report can drive quality improvement and usefully inform patients' choices of providers. However, performance reports with poor validity and reliability are potentially damaging to all involved. This article critiques the methods underlying the Scorecard and identifies opportunities for improvement. Until these opportunities are addressed, the authors advise users of the Scorecard—most notably, patients who might be choosing their surgeons—not to consider the Scorecard a valid or reliable predictor of the health outcomes any individual surgeon is likely to provide. The authors hope that this methodological critique will contribute to the development of more-valid and more-reliable performance reports in the future. PMID:28083411

Reliable structural interpretation of small-angle scattering data from bio-molecules in solution--the importance of quality control and a standard reporting framework.

PubMed

Jacques, David A; Guss, Jules Mitchell; Trewhella, Jill

2012-05-17

Small-angle scattering is becoming an increasingly popular tool for the study of bio-molecular structures in solution. The large number of publications with 3D-structural models generated from small-angle solution scattering data has led to a growing consensus for the need to establish a standard reporting framework for their publication. The International Union of Crystallography recently established a set of guidelines for the necessary information required for the publication of such structural models. Here we describe the rationale for these guidelines and the importance of standardising the way in which small-angle scattering data from bio-molecules and associated structural interpretations are reported.

Enhancing nurses' ethical practice: development of a clinical ethics program.

PubMed

McDaniel, C

1998-06-01

There is increasing attention paid to ethics under managed care; however, few clinical-based ethics programs are reported. This paper reports the assessment and outcomes of one such program. A quasi-experimental research design with t-tests is used to assess the outcome differences between participants and control groups. There are twenty nurses in each; they are assessed for comparability. Differences are predicted on two outcomes using reliable and valid measures: nurses' time with their patients in ethics discussions, and nurses' opinions regarding their clinical ethics environments. Results reveal a statistically significant difference (p <.05) between the two groups, with modest positive change in the participants. Additional exploratory analyses are reported on variables influential in health care services.

The Emotional Responses of Married Women Receiving Oral Contraceptives

PubMed Central

Ringrose, C. A. Douglas

1965-01-01

One hundred women taking oral contraceptives were questioned concerning their opinions about personal and sociological effects of this method of conception control. Fifty-three per cent reported improved coital satisfaction while 4% noted the opposite effect. Libido was increased in 22% and decreased in 13%. One woman in five believed that an increase in premarital and extramarital sexual activity would take place in the general population as a result of tablet-induced infertility. The problem of population control is discussed. It is paradoxical that the incidence of unplanned pregnancies continues to increase despite the availability of completely reliable conception control. This reflects present inability to communicate contraceptive knowledge to the appropriate people. PMID:14292887

Mother reports of maternal support following child sexual abuse: Preliminary psychometric data on the Maternal Self-report Support Questionnaire (MSSQ).

PubMed

Smith, Daniel W; Sawyer, Genelle K; Jones, Lisa M; Cross, Theodore; McCart, Michael R; Ralston, M Elizabeth

2010-10-01

Maternal support is an important factor in predicting outcomes following disclosure of child sexual abuse; however, definition of the construct has been unclear and existing measures of maternal support are utilized inconsistently and have limited psychometric data. The purpose of this study was to develop a reliable and valid mother-report measure for assessing maternal support following the disclosure of child sexual abuse. Data from 2 very similar samples of mother-child pairs seeking forensic evaluation following the discovery of child sexual abuse were combined, resulting in a final sample of 246. Exploratory factor analysis resulted in two reliable 7-item factors labeled "Emotional Support" and "Blame/Doubt," each of which had acceptable internal consistency. Analyses with a child-report measure of general maternal support the construct validity of the MSSQ. Concurrent validity analyses revealed unique relations with maternal ratings of child behavior problems and case characteristic data. The study resulted in the development of a brief, easily scored self-report measure of maternal support with reasonable preliminary psychometric properties that could easily be utilized in other studies of sexually abused children. Adoption of this promising measure in future research will reduce the lack of cross-study measurement comparability that has characterized the maternal support literature to date, increase the feasibility of expanding upon current literature on maternal support, and may produce important information leading to clinical and theoretical innovation. Copyright © 2010. Published by Elsevier Ltd.

Rapid identification of pneumococci, enterococci, beta-haemolytic streptococci and S. aureus from positive blood cultures enabling early reports.

PubMed

Larsson, Marie C; Karlsson, Ewa; Woksepp, Hanna; Frölander, Kerstin; Mårtensson, Agneta; Rashed, Foad; Annika, Wistedt; Schön, Thomas; Serrander, Lena

2014-03-19

The aim of this study was to evaluate diagnostic tests in order to introduce a diagnostic strategy to identify the most common gram-positive bacteria (pneumococci, enterococci, β-haemolytic streptococci and S. aureus) found in blood cultures within 6 hours after signalling growth. The tube coagulase test was optimized and several latex agglutination tests were compared and evaluated before a validation period of 11 months was performed on consecutive positive blood culture patient samples from Kalmar County Hospital, Sweden. During the validation period 150 (91%) of a total of 166 gram-positive cocci (119 in clusters, 45 in chains or pairs and 2 undefined morphology) were correctly identified as S. aureus, CoNS, Pneumococci, Enterococci or group A streptococci (GAS), group B streptococci (GBS), group G streptococci (GGS) within 6 hours with a minimal increase in work-load and costs. The remaining samples (9%) were correctly identified during the next day. No samples were incorrectly grouped with this diagnostic strategy and no patient came to risk by early reporting. A simple strategy gives reliable and cost-effective reporting of >90% of the most common gram-positive cocci within 6 hours after a blood cultures become positive. The high specificity of the tests used makes preliminary reports reliable. The reports can be used to indicate the focus of infection and not the least, support faster administration of proper antimicrobial treatment for patients with serious bacterial infections.

The Healthcare Complaints Analysis Tool: development and reliability testing of a method for service monitoring and organisational learning

PubMed Central

Gillespie, Alex; Reader, Tom W

2016-01-01

Background Letters of complaint written by patients and their advocates reporting poor healthcare experiences represent an under-used data source. The lack of a method for extracting reliable data from these heterogeneous letters hinders their use for monitoring and learning. To address this gap, we report on the development and reliability testing of the Healthcare Complaints Analysis Tool (HCAT). Methods HCAT was developed from a taxonomy of healthcare complaints reported in a previously published systematic review. It introduces the novel idea that complaints should be analysed in terms of severity. Recruiting three groups of educated lay participants (n=58, n=58, n=55), we refined the taxonomy through three iterations of discriminant content validity testing. We then supplemented this refined taxonomy with explicit coding procedures for seven problem categories (each with four levels of severity), stage of care and harm. These combined elements were further refined through iterative coding of a UK national sample of healthcare complaints (n= 25, n=80, n=137, n=839). To assess reliability and accuracy for the resultant tool, 14 educated lay participants coded a referent sample of 125 healthcare complaints. Results The seven HCAT problem categories (quality, safety, environment, institutional processes, listening, communication, and respect and patient rights) were found to be conceptually distinct. On average, raters identified 1.94 problems (SD=0.26) per complaint letter. Coders exhibited substantial reliability in identifying problems at four levels of severity; moderate and substantial reliability in identifying stages of care (except for ‘discharge/transfer’ that was only fairly reliable) and substantial reliability in identifying overall harm. Conclusions HCAT is not only the first reliable tool for coding complaints, it is the first tool to measure the severity of complaints. It facilitates service monitoring and organisational learning and it enables future research examining whether healthcare complaints are a leading indicator of poor service outcomes. HCAT is freely available to download and use. PMID:26740496

Texting while driving: the development and validation of the distracted driving survey and risk score among young adults.

PubMed

Bergmark, Regan W; Gliklich, Emily; Guo, Rong; Gliklich, Richard E

Texting while driving and other cell-phone reading and writing activities are high-risk activities associated with motor vehicle collisions and mortality. This paper describes the development and preliminary evaluation of the Distracted Driving Survey (DDS) and score. Survey questions were developed by a research team using semi-structured interviews, pilot-tested, and evaluated in young drivers for validity and reliability. Questions focused on texting while driving and use of email, social media, and maps on cellular phones with specific questions about the driving speeds at which these activities are performed. In 228 drivers 18-24 years old, the DDS showed excellent internal consistency (Cronbach's alpha = 0.93) and correlations with reported 12-month crash rates. The score is reported on a 0-44 scale with 44 being highest risk behaviors. For every 1 unit increase of the DDS score, the odds of reporting a car crash increases 7 %. The survey can be completed in two minutes, or less than five minutes if demographic and background information is included. Text messaging was common; 59.2 and 71.5 % of respondents said they wrote and read text messages, respectively, while driving in the last 30 days. The DDS is an 11-item scale that measures cell phone-related distracted driving risk and includes reading/viewing and writing subscores. The scale demonstrated strong validity and reliability in drivers age 24 and younger. The DDS may be useful for measuring rates of cell-phone related distracted driving and for evaluating public health interventions focused on reducing such behaviors.

Texting while driving: the development and validation of the distracted driving survey and risk score among young adults.

PubMed

Bergmark, Regan W; Gliklich, Emily; Guo, Rong; Gliklich, Richard E

2016-12-01

Texting while driving and other cell-phone reading and writing activities are high-risk activities associated with motor vehicle collisions and mortality. This paper describes the development and preliminary evaluation of the Distracted Driving Survey (DDS) and score. Survey questions were developed by a research team using semi-structured interviews, pilot-tested, and evaluated in young drivers for validity and reliability. Questions focused on texting while driving and use of email, social media, and maps on cellular phones with specific questions about the driving speeds at which these activities are performed. In 228 drivers 18-24 years old, the DDS showed excellent internal consistency (Cronbach's alpha = 0.93) and correlations with reported 12-month crash rates. The score is reported on a 0-44 scale with 44 being highest risk behaviors. For every 1 unit increase of the DDS score, the odds of reporting a car crash increases 7 %. The survey can be completed in two minutes, or less than five minutes if demographic and background information is included. Text messaging was common; 59.2 and 71.5 % of respondents said they wrote and read text messages, respectively, while driving in the last 30 days. The DDS is an 11-item scale that measures cell phone-related distracted driving risk and includes reading/viewing and writing subscores. The scale demonstrated strong validity and reliability in drivers age 24 and younger. The DDS may be useful for measuring rates of cell-phone related distracted driving and for evaluating public health interventions focused on reducing such behaviors.

Use of an Airway Exchange Catheter-Assisted Extubation With Continuous End-Tidal Carbon Dioxide Monitoring in a Pediatric Patient With a Known Difficult Airway: A Case Report.

PubMed

Yegian, Courtney C; Volz, Lana M; Galgon, Richard E

2018-05-11

Tracheal extubation in children with known difficult airways is associated with an increased risk of adverse events. Currently, there is no reliable measure to predict the need for emergent reintubation due to airway inadequacy. Airway exchange catheter-assisted extubation has been shown to be a useful adjunct in decreasing the risk of adverse events due to failed extubation. We report a case of using an airway exchange catheter-assisted extubation with continuous end-tidal carbon dioxide monitoring for a pediatric patient with a known difficult airway.

Intra-Subject Consistency and Reliability of Response Following 2 mA Transcranial Direct Current Stimulation.

PubMed

Dyke, Katherine; Kim, Soyoung; Jackson, Georgina M; Jackson, Stephen R

Transcranial direct current stimulation (tDCS) is a popular non-invasive brain stimulation technique that has been shown to influence cortical excitability. While polarity specific effects have often been reported, this is not always the case, and variability in both the magnitude and direction of the effects have been observed. We aimed to explore the consistency and reliability of the effects of tDCS by investigating changes in cortical excitability across multiple testing sessions in the same individuals. A within subjects design was used to investigate the effects of anodal and cathodal tDCS applied to the motor cortex. Four experimental sessions were tested for each polarity in addition to two sham sessions. Transcranial magnetic stimulation (TMS) was used to measure cortical excitability (TMS recruitment curves). Changes in excitability were measured by comparing baseline measures and those taken immediately following 20 minutes of 2 mA stimulation or sham stimulation. Anodal tDCS significantly increased cortical excitability at a group level, whereas cathodal tDCS failed to have any significant effects. The sham condition also failed to show any significant changes. Analysis of intra-subject responses to anodal stimulation across four sessions suggest that the amount of change in excitability across sessions was only weakly associated, and was found to have poor reliability across sessions (ICC = 0.276). The effects of cathodal stimulation show even poorer reliability across sessions (ICC = 0.137). In contrast ICC analysis for the two sessions of sham stimulation reflect a moderate level of reliability (ICC = .424). Our findings indicate that although 2 mA anodal tDCS is effective at increasing cortical excitability at group level, the effects are unreliable across repeated testing sessions within individual participants. Our results suggest that 2 mA cathodal tDCS does not significantly alter cortical excitability immediately following stimulation and that there is poor reliability of the effect within the same individual across different testing sessions. Copyright © 2016. Published by Elsevier Inc.

Systematic Review of Self-Report Measures of Pain Intensity in 3- and 4-Year-Old Children: Bridging a Period of Rapid Cognitive Development.

PubMed

von Baeyer, Carl L; Jaaniste, Tiina; Vo, Henry L T; Brunsdon, Georgie; Lao, Hsuan-Chih; Champion, G David

2017-09-01

Claims are made for the validity of some self-report pain scales for 3- and 4-year-old children, but little is known about their ability to use such tools. This systematic review identified self-report pain intensity measures used with 3- and/or 4- year-old participants (3-4yo) and considered their reliability and validity within this age span. The search protocol identified research articles that included 3-4yo, reported use of any pain scale, and included self-reported pain intensity ratings. A total of 1,590 articles were screened and 617 articles met inclusion criteria. Of the included studies, 98% aggregated self-report data for 3-4yo with data for older children, leading to overestimates of the reliability and validity of self-report in the younger age group. In the 14 studies that provided nonaggregated data for 3-4yo, there was no evidence for 3-year-old and weak evidence for 4-year-old children being able to use published self-report pain intensity tools in a valid or reliable way. Preschool-age children have been reported to do better with fewer than the 6 response options offered on published faces scales. Simplified tools are being developed for young children; however, more research is needed before these are adopted. Some self-report pain scales have been promoted for use with 3- and 4-year-old children, but this is on the basis of studies that aggregated data for younger and older children, resulting in overestimates of reliability and validity for the preschool-age children. Scales with fewer response options show promise, at least for 4-year-old children. Copyright © 2017 American Pain Society. Published by Elsevier Inc. All rights reserved.

Social Desirability, Non-Response Bias and Reliability in a Long Self-Report Measure: Illustrations from the MMPI-2 Administered to Brunei Student Teachers

ERIC Educational Resources Information Center

Mundia, Lawrence

2011-01-01

The survey investigated the problems of social desirability (SD), non-response bias (NRB) and reliability in the Minnesota Multiphasic Personality Inventory--Revised (MMPI-2) self-report inventory administered to Brunei student teachers. Bruneians scored higher on all the validity scales than the normative US sample, thereby threatening the…

Digital Avionics Information System (DAIS): Reliability and Maintainability Model Users Guide. Final Report, May 1975-July 1977.

ERIC Educational Resources Information Center

Czuchry, Andrew J.; And Others

This report provides a complete guide to the stand alone mode operation of the reliability and maintenance (R&M) model, which was developed to facilitate the performance of design versus cost trade-offs within the digital avionics information system (DAIS) acquisition process. The features and structure of the model, its input data…

Report on the Audit of Performnce and Reliability of Cobra Helicopter Rotor Blades

DTIC Science & Technology

1991-05-21

We are providing this final report for your information and use. The audit was made from January to March 1991. The audit objective was to evaluate...internal controls. The audit was made in response to concerns raised by personnel at the Sharpe Army Depot about the K747 blade’s performance, maintenance, and reliability.

Reliability and Validity of the Psychoeducational Profile-Third Edition Caregiver Report in Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Fu, Chung-Pei; Chen, Kuan-Lin; Tseng, Mei-Hui; Chiang, Fu-Mei; Hsieh, Ching-Lin

2012-01-01

The aim of this study was to examine the internal consistency, inter-respondent reliability, and convergent and divergent validity of the Psychoeducational Profile-third edition Caregiver Report (PEP3-CR) in children with Autism Spectrum Disorders (ASD). We examined the internal consistency on 66 mothers of children with ASD who completed the…

Brief Report: Preliminary Reliability, Construct Validity and Standardization of the Auditory Behavior Questionnaire (ABQ) for Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Egelhoff, Kelsey; Lane, Alison E.

2013-01-01

The Auditory Behavior Questionnaire (ABQ) evaluates abnormal behavioral responses to auditory stimulation in children with Autism Spectrum Disorder (ASD). This study reports preliminary reliability, construct validity and standardization of the ABQ. Parents of children with ASD aged 7-21 years (n = 165) completed the ABQ on-line. Cronbach's alpha…

FALCON Remote Laser Alignment System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hamilton, T.W.; Hebner, G.A.

1993-01-01

The FALCON Remote Laser Alignment System is used in a high radiation environment to adjust an optical assembly. The purpose of this report is to provide a description of the hardware used and to present the system configuration. Use of the system has increased the reliability and reproducibility of data as well as significantly reducing personnel radiation exposure. Based upon measured radiation dose, radiation exposure was reduced by at least a factor of two after implementing the remote alignment system.

FALCON Remote Laser Alignment System

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hamilton, T.W.; Hebner, G.A.

1993-02-01

The FALCON Remote Laser Alignment System is used in a high radiation environment to adjust an optical assembly. The purpose of this report is to provide a description of the hardware used and to present the system configuration. Use of the system has increased the reliability and reproducibility of data as well as significantly reducing personnel radiation exposure. Based upon measured radiation dose, radiation exposure was reduced by at least a factor of two after implementing the remote alignment system.

Desire for penile girth enhancement and the effects of the self-injection of hyaluronic Acid gel.

PubMed

Coskuner, Enis Rauf; Canter, Halil Ibrahim

2012-07-01

Penile girth enhancement is a controversial subject but demands for enhancement are increasing steadily. Although various fillers have been widely used for soft tissue augmentation, there is no reliable material for this particular situation. Here we report a case of an acute hypersensitivity reaction in a man after his first self-injection of a filler material, which, he claimed, was hyaluronic acid gel for penile girth enhancement and glans penis augmentation.

Galileo battery testing and the impact of test automation

NASA Technical Reports Server (NTRS)

Pertuch, W. T.; Dils, C. T.

1985-01-01

Test complexity, changes of test specifications, and the demand for tight control of tests led to the development of automated testing used for Galileo and other projects. The use of standardized interfacing, i.e., IEEE-488, with desktop computers and test instruments, resulted in greater reliability, repeatability, and accuracy of both control and data reporting. Increased flexibility of test programming has reduced costs by permitting a wide spectrum of test requirements at one station rather than many stations.

FY2017 Analysis Annual Progress Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

None, None

During fiscal year 2017, the U.S. Department of Energy Vehicle Technologies Office (VTO) funded analysis projects supportive of VTO’s goals to pursue early stage research in vehicle and mobility system technologies to reduce petroleum dependence, increase energy reliability and security, improve transportation affordability, and promote economic growth. VTO analysis projects result in a foundation of data, analytical models, and applied analyses that provide insights into critical transportation energy problems and assist in research investment prioritization and portfolio planning.

NASA Research Bearing on Jet Engine Reliability

NASA Technical Reports Server (NTRS)

Mason, S. S.; Ault, G. M.; Pinkel, B.

1959-01-01

Turbojet engine reliability has long been an intense interest to the military users of this type of aircraft propulsion. With the recent inauguration of commercial jet transport this subject has assumed a new dimension of importance. In January l96 the Lewis Research Center of the NASA (then the MACA) published the results of an extensive study on the factors that affect the opera- center dot tional reliability of turbojet engines (ref. 1). At that time the report was classified Confidential. In July l98 this report was declassified. It is thus appropriate at this time to present some of the highlights of the studies described in the NASA report. In no way is it intended to outline the complete contents of the report; rather it is hoped to direct attention to it among those who are center dot directly concerned with this problem. Since the publication of our study over three years ago, the NASA has completed a number of additional investigations that bear significantly on this center dot subject. A second object of this paper, therefore, is to summarize the results of these recent studies and to interpret their significance in relation to turbojet operational reliability.

Data Used in Quantified Reliability Models

NASA Technical Reports Server (NTRS)

DeMott, Diana; Kleinhammer, Roger K.; Kahn, C. J.

2014-01-01

Data is the crux to developing quantitative risk and reliability models, without the data there is no quantification. The means to find and identify reliability data or failure numbers to quantify fault tree models during conceptual and design phases is often the quagmire that precludes early decision makers consideration of potential risk drivers that will influence design. The analyst tasked with addressing a system or product reliability depends on the availability of data. But, where is does that data come from and what does it really apply to? Commercial industries, government agencies, and other international sources might have available data similar to what you are looking for. In general, internal and external technical reports and data based on similar and dissimilar equipment is often the first and only place checked. A common philosophy is "I have a number - that is good enough". But, is it? Have you ever considered the difference in reported data from various federal datasets and technical reports when compared to similar sources from national and/or international datasets? Just how well does your data compare? Understanding how the reported data was derived, and interpreting the information and details associated with the data is as important as the data itself.

Riding the wave or paddling in the shallows? Understanding older Australians' use of the internet.

PubMed

Burns, Pippa; Jones, Sandra C; Iverson, Don; Caputi, Peter

2012-08-01

Australia's ageing population is set to become an increasing burden on an already over-stretched primary health care system. Potential strategies to alleviate this pressure need to be investigated. Increased knowledge of older Australians' use of the internet would allow the appropriateness of online health intervention to be assessed. This initial, exploratory study examined the proportion of people aged 55 years and older who accessed the internet. It investigated their duration of use, level of comfort, use of the internet to seek health information and perceived reliability of information found on the internet. A paper based survey was distributed to a purposive sample of adults in metropolitan New South Wales. Complete data was received from 115 respondents. Sixty-two per cent of respondents reported internet use, with use decreasing with age. The majority of respondents who used the internet reported high confidence levels and long-term use. The majority had used the internet to search for health information which was generally perceived to be reliable. Logistic regression showed tertiary education and household income greater than $40,000 per year predicted use of a computer to access the internet. The majority of older Australians surveyed were successfully riding the internet wave. They have both the skills and equipment to access health information online and many were already doing so.

Developing and testing new smoking measures for the Health Plan Employer Data and Information Set.

PubMed

Pbert, Lori; Vuckovic, Nancy; Ockene, Judith K; Hollis, Jack F; Riedlinger, Karen

2003-04-01

To develop and test items for the Health Plan Employee Data and Information Set (HEDIS) that assess delivery of the full range of provider-delivered tobacco interventions. The authors identified potential items via literature review; items were reviewed by national experts. Face validity of candidate items was tested in focus groups. The final survey was sent to a random sample of 1711 adult primary care patients; the re-test survey was sent to self-identified smokers. The process identified reliable items to capture provider assessment of motivation and provision of assistance and follow-up. One can reliably assess patient self-report of provider delivery of the full range of brief tobacco interventions. Such assessment and feedback to health plans and providers may increase use of evidence-based brief interventions.

High-reliability computing for the smarter planet

DOE Office of Scientific and Technical Information (OSTI.GOV)

Quinn, Heather M; Graham, Paul; Manuzzato, Andrea

2010-01-01

The geometric rate of improvement of transistor size and integrated circuit performance, known as Moore's Law, has been an engine of growth for our economy, enabling new products and services, creating new value and wealth, increasing safety, and removing menial tasks from our daily lives. Affordable, highly integrated components have enabled both life-saving technologies and rich entertainment applications. Anti-lock brakes, insulin monitors, and GPS-enabled emergency response systems save lives. Cell phones, internet appliances, virtual worlds, realistic video games, and mp3 players enrich our lives and connect us together. Over the past 40 years of silicon scaling, the increasing capabilities ofmore » inexpensive computation have transformed our society through automation and ubiquitous communications. In this paper, we will present the concept of the smarter planet, how reliability failures affect current systems, and methods that can be used to increase the reliable adoption of new automation in the future. We will illustrate these issues using a number of different electronic devices in a couple of different scenarios. Recently IBM has been presenting the idea of a 'smarter planet.' In smarter planet documents, IBM discusses increased computer automation of roadways, banking, healthcare, and infrastructure, as automation could create more efficient systems. A necessary component of the smarter planet concept is to ensure that these new systems have very high reliability. Even extremely rare reliability problems can easily escalate to problematic scenarios when implemented at very large scales. For life-critical systems, such as automobiles, infrastructure, medical implantables, and avionic systems, unmitigated failures could be dangerous. As more automation moves into these types of critical systems, reliability failures will need to be managed. As computer automation continues to increase in our society, the need for greater radiation reliability is necessary. Already critical infrastructure is failing too frequently. In this paper, we will introduce the Cross-Layer Reliability concept for designing more reliable computer systems.« less

Self-motion perception: assessment by computer-generated animations

NASA Technical Reports Server (NTRS)

Parker, D. E.; Harm, D. L.; Sandoz, G. R.; Skinner, N. C.

1998-01-01

The goal of this research is more precise description of adaptation to sensory rearrangements, including microgravity, by development of improved procedures for assessing spatial orientation perception. Thirty-six subjects reported perceived self-motion following exposure to complex inertial-visual motion. Twelve subjects were assigned to each of 3 perceptual reporting procedures: (a) animation movie selection, (b) written report selection and (c) verbal report generation. The question addressed was: do reports produced by these procedures differ with respect to complexity and reliability? Following repeated (within-day and across-day) exposures to 4 different "motion profiles," subjects either (a) selected movies presented on a laptop computer, or (b) selected written descriptions from a booklet, or (c) generated self-motion verbal descriptions that corresponded most closely with their motion experience. One "complexity" and 2 reliability "scores" were calculated. Contrary to expectations, reliability and complexity scores were essentially equivalent for the animation movie selection and written report selection procedures. Verbal report generation subjects exhibited less complexity than did subjects in the other conditions and their reports were often ambiguous. The results suggest that, when selecting from carefully written descriptions and following appropriate training, people may be better able to describe their self-motion experience with words than is usually believed.

Reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 Generic Core Scales in adolescents.

PubMed

Amiri, Parisa; M Ardekani, Emad; Jalali-Farahani, Sara; Hosseinpanah, Farhad; Varni, James W; Ghofranipour, Fazlollah; Montazeri, Ali; Azizi, Fereidoun

2010-12-01

The objective of this study was to investigate the reliability and validity of the Iranian version of the Pediatric Quality of Life Inventory™ 4.0 (PedsQL™ 4.0) Generic Core Scales in adolescents After linguistic validation, the Iranian version of the PedsQL™ 4.0 was completed by 848 healthy and 26 chronically ill adolescents aged 13-18 years and their parents. The internal consistency as measured by Cronbach's alpha coefficients exceeded the minimum reliability standard of .70. No floor effects were observed. Ceiling effects detected ranged from 1.5% for adolescent self-report total scale score to 42.2% for self-report social functioning. All monotrait-multimethod correlations were higher than multitrait-multimethod correlations. The intraclass correlation coefficients (ICC) between adolescent self-report and parent proxy-report showed good to excellent agreement. Exploratory factor analysis supported mainly comparable results with the original US English dialect version. The results of the confirmatory factor analysis for 5-factor models for both self-report and proxy-report indicated acceptable fit for the proposed models. Regarding gender and health status, as hypothesized from previous studies, girls reported lower health-related quality of life than boys on the total score, physical and emotional functioning, and healthy adolescents reported significantly higher health-related quality of life than those with chronic illnesses. The findings support the initial reliability and validity of the Iranian version of the PedsQL™ 4.0 as a generic instrument to measure HRQOL of adolescents in Iran.

An analysis of more than 1,400 articles, 900 scales, and 17 years of research: the state of scales in cyberpsychology, behavior, and social networking.

PubMed

Howard, Matt C; Jayne, Bradley S

2015-03-01

Cyberpsychology is a recently emergent field that examines the impact of technology upon human cognition and behavior. Given its infancy, authors have rapidly created new measures to gauge their constructs of interest. Unfortunately, few of these authors have had the opportunity to test their scales' psychometric properties and validity. This is concerning, as many theoretical assumptions may be founded upon scales with inadequate attributes. If this were found to be true, then previous findings in cyberpsychology studies would need to be retested, and future research would need to shift its focus to creating psychometrically sound and valid measures. To provide inferences on this concern, the current study examines the article reporting, scale creation, and scale reliabilities of every article published in Cyberpsychology, Behavior, and Social Networking from its inception to July 2014. The final data set encompassed the coding of 1,478 individual articles, including 921 scales, and spanning 17 years. The results demonstrate that the simple survey methodology has become more popular over time. Authors are gradually applying empirically tested scales. However, self-created measures are still the most popular, leading to concerns about the measures' validity. Also, the use of multi-item measures has increased over time, but many articles still fail to report adequate information to assess the reliability of the applied scales. Lastly, the average scale reliability is 0.81, which barely meets standard cutoffs. Overall, these results are not overly concerning, but suggestions are given on methods to improve the reporting of measures, the creation of scales, and the state of cyberpsychology.

The Faculty Self-Reported Assessment Survey (FRAS): Differentiating Faculty Knowledge and Experience in Assessment

PubMed Central

Hanauer, David I.; Bauerle, Cynthia

2015-01-01

Science, technology, engineering, and mathematics education reform efforts have called for widespread adoption of evidence-based teaching in which faculty members attend to student outcomes through assessment practice. Awareness about the importance of assessment has illuminated the need to understand what faculty members know and how they engage with assessment knowledge and practice. The Faculty Self-Reported Assessment Survey (FRAS) is a new instrument for evaluating science faculty assessment knowledge and experience. Instrument validation was composed of two distinct studies: an empirical evaluation of the psychometric properties of the FRAS and a comparative known-groups validation to explore the ability of the FRAS to differentiate levels of faculty assessment experience. The FRAS was found to be highly reliable (α = 0.96). The dimensionality of the instrument enabled distinction of assessment knowledge into categories of program design, instrumentation, and validation. In the known-groups validation, the FRAS distinguished between faculty groups with differing levels of assessment experience. Faculty members with formal assessment experience self-reported higher levels of familiarity with assessment terms, higher frequencies of assessment activity, increased confidence in conducting assessment, and more positive attitudes toward assessment than faculty members who were novices in assessment. These results suggest that the FRAS can reliably and validly differentiate levels of expertise in faculty knowledge of assessment. PMID:25976653

Medicare claims data reliably identify treatments for basal cell carcinoma and squamous cell carcinoma: a prospective cohort study.

PubMed

Thompson, Bridie S; Olsen, Catherine M; Subramaniam, Padmini; Neale, Rachel E; Whiteman, David C

2016-04-01

To investigate the accuracy of Medical Benefit Schedule (MBS) item numbers to identify treatments for basal cell carcinomas (BCC) and squamous cell carcinomas (SCC). We linked records from QSkin Study participants (n=37,103) to Medicare. We measured the proportion of Medicare claims for primary excision of BCC/SCC that had corresponding claims for histopathology services. In subsets of participants, we estimated the sensitivity and external concordance of MBS item numbers for identifying BCC/SCC diagnoses by comparing against 'gold-standard' histopathology reports. A total of 2,821 (7.6%) participants had 4,830 separate Medicare claims for BCC/SCC excision; almost all (97%) had contemporaneous Medicare claims for histopathology services. Among participants with BCC/SCC confirmed by histology reports, 76% had a corresponding Medicare claim for primary surgical excision of BCC/SCC. External concordance for Medicare claims for primary BCC/SCC excision was 68%, increasing to 97% when diagnoses for intra-epidermal carcinomas and keratoacanthomas were included. MBS item numbers for primary excision of BCC/SCC are reasonably reliable for determining incident cases of keratinocyte skin cancers, but may underestimate incidence by up to 24%. Medicare claims data may have utility in monitoring trends in conditions for which there is no mandatory reporting. © 2015 Public Health Association of Australia.

Evaluation of tools used to measure calcium and/or dairy consumption in adults.

PubMed

Magarey, Anthea; Baulderstone, Lauren; Yaxley, Alison; Markow, Kylie; Miller, Michelle

2015-05-01

To identify and critique tools for the assessment of Ca and/or dairy intake in adults, in order to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles reporting on originally developed tools or testing the reliability or validity of existing tools that measure Ca and/or dairy intake in adults were included. Author-defined criteria for reporting reliability and validity properties were applied. Studies conducted in Western countries. Adults. Thirty papers, utilising thirty-six tools assessing intake of dairy, Ca or both, were identified. Reliability testing was conducted on only two dairy and five Ca tools, with results indicating that only one dairy and two Ca tools were reliable. Validity testing was conducted for all but four Ca-only tools. There was high reliance in validity testing on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful differences. Results of the validity testing suggest one dairy and five Ca tools are valid. Thus one tool was considered both reliable and valid for the assessment of dairy intake and only two tools proved reliable and valid for the assessment of Ca intake. While several tools are reliable and valid, their application across adult populations is limited by the populations in which they were tested. These results indicate a need for tools that assess Ca and/or dairy intake in adults to be rigorously tested for reliability and validity.

Synaptic and Network Mechanisms of Sparse and Reliable Visual Cortical Activity during Nonclassical Receptive Field Stimulation

PubMed Central

Haider, Bilal; Krause, Matthew R.; Duque, Alvaro; Yu, Yuguo; Touryan, Jonathan; Mazer, James A.; McCormick, David A.

2011-01-01

SUMMARY During natural vision, the entire visual field is stimulated by images rich in spatiotemporal structure. Although many visual system studies restrict stimuli to the classical receptive field (CRF), it is known that costimulation of the CRF and the surrounding nonclassical receptive field (nCRF) increases neuronal response sparseness. The cellular and network mechanisms underlying increased response sparseness remain largely unexplored. Here we show that combined CRF + nCRF stimulation increases the sparseness, reliability, and precision of spiking and membrane potential responses in classical regular spiking (RSC) pyramidal neurons of cat primary visual cortex. Conversely, fast-spiking interneurons exhibit increased activity and decreased selectivity during CRF + nCRF stimulation. The increased sparseness and reliability of RSC neuron spiking is associated with increased inhibitory barrages and narrower visually evoked synaptic potentials. Our experimental observations were replicated with a simple computational model, suggesting that network interactions among neuronal subtypes ultimately sharpen recurrent excitation, producing specific and reliable visual responses. PMID:20152117

Specialist availability in emergencies: contributions of response times and the use of ad hoc coverage in New York State.

PubMed

Rabin, Elaine; Patrick, Lisa

2016-04-01

Nationwide, hospitals struggle to maintain specialist on-call coverage for emergencies. We seek to further understand the issue by examining reliability of scheduled coverage and the role of ad hoc coverage when none is scheduled. An anonymous electronic survey of all emergency department (ED) directors of a large state. Overall and for 10 specialties, respondents were asked to estimate on-call coverage extent and "reliability" (frequency of emergency response in a clinically useful time frame: 2 hours), and use and effect of ad hoc emergency coverage to fill gaps. Descriptive statistics were performed using Fisher exact and Wilcoxon sign rank tests for significance. Contact information was obtained for 125 of 167 ED directors. Sixty responded (48%), representing 36% of EDs. Forty-six percent reported full on-call coverage scheduled for all specialties. Forty-six percent reported consistent reliability. Coverage and reliability were strongly related (P<.01; 33% reported both), and larger ED volume correlated with both (P<.01). Ninety percent of hospitals that had gaps in either employed ad hoc coverage, significantly improving coverage for 8 of 10 specialties. For all but 1 specialty, more than 20% of hospitals reported that specialists are "Never", "Rarely" or "Sometimes" reliable (more than 50% for cardiovascular surgery, hand surgery and ophthalmology). Significant holes in scheduled on-call specialist coverage are compounded by frequent unreliability of on-call specialists, but partially ameliorated by ad hoc specialist coverage. Regionalization may help because a 2-tiered system may exist: larger hospitals have more complete, reliable coverage. Better understanding of specialists' willingness to treat emergencies ad hoc without taking formal call will suggest additional remedies. Copyright © 2015 Elsevier Inc. All rights reserved.

The Cambridge Otology Quality of Life Questionnaire: an otology-specific patient-recorded outcome measure. A paper describing the instrument design and a report of preliminary reliability and validity.

PubMed

Martin, T P C; Moualed, D; Paul, A; Ronan, N; Tysome, J R; Donnelly, N P; Cook, R; Axon, P R

2015-04-01

The Cambridge Otology Quality of Life Questionnaire (COQOL) is a patient-recorded outcome measurement (PROM) designed to quantify the quality of life of patients attending otology clinics. Item-reduction model. A systematically designed long-form version (74 items) was tested with patient focus groups before being presented to adult otology patients (n. 137). Preliminary item analysis tested reliability, reducing the COQOL to 24 questions. This was then presented in conjunction with the SF-36 (V1) questionnaire to a total of 203 patients. Subsequently, these were re-presented at T + 3 months, and patients recorded whether they felt their condition had improved, deteriorated or remained the same. Non-responders were contacted by post. A correlation between COQOL scores and patient perception of change was examined to analyse content validity. Teaching hospital and university psychology department. Adult patients attending otology clinics with a wide range of otological conditions. Item reliability measured by item–total correlation, internal consistency and test– retest reliability. Validity measured by correlation between COQOL scores and patient-reported symptom change. Reliability: the COQOL showed excellent internal consistency at both initial presentation (a = 0.90) and 3 months later (a = 0.93). Validity: One-way analysis of variance showed a significant difference between groups reporting change and those reporting no change in quality of life (F(2, 80) = 5.866, P < 0.01). The COQOL is the first otology-specific PROM. Initial studies demonstrate excellent reliability and encouraging preliminary criterion validity: further studies will allow a deeper validation of the instrument.

Adolescent self-report and parent proxy-report of health-related quality of life: an analysis of validity and reliability of PedsQL 4.0 among a sample of Malaysian adolescents and their parents.

PubMed

Kaartina, Sanker; Chin, Yit Siew; Fara Wahida, Rezali; Woon, Fui Chee; Hiew, Chu Chien; Zalilah, Mohd Shariff; Mohd Nasir, Mohd Taib

2015-04-08

The Pediatric Quality of Life Inventory Generic Core Scales (PedsQL) 4.0 is a generalized assessment of health-related quality of life (HRQoL) based on adolescent self-report and parent proxy-report. This study aims to determine the construct validity and reliability of PedsQL 4.0 among a sample of Malaysian adolescents and parents. A cross-sectional study was carried out at three selected public schools in the state of Selangor. A total of 379 Malaysian adolescents completed the PedsQL 4.0 adolescent self-report and 218 (55.9%) parents completed the PedsQL 4.0 parent proxy-report. Weight and height of adolescents were measured and BMI-for-age by sex was used to determine their body weight status. There were 50.8% male and 49.2% female adolescents who participated in this study (14.25 ± 1.23 years). The prevalence of overweight and obesity (25.8%) was four times higher than the prevalence of severe thinness and thinness (6.1%). Construct validity was analyzed using Confirmatory Factor Analysis (CFA). Based on CFA, adolescent self-report and parent proxy-report met the criteria of convergent validity (factor loading > 0.5, Average Variance Extracted (AVE) > 0.5, Construct Reliability > 0.7) and showed good fit to the data. The adolescent self-report and parent proxy-report exhibited discriminant validity as the AVE values were larger than the R(2) values. Cronbach's alpha coefficients of the adolescent self-report (α = 0.862) and parent proxy-report (α = 0.922) showed these instruments are reliable. Parents perceived the HRQoL of adolescents was poorer compared to the perception of the adolescent themselves (t = 5.92, p < 0.01). There was no significant difference in total HRQoL score between male and female adolescents (t = 0.858, p > 0.05). Parent proxy-report was negatively associated with the adolescents' BMI-for-age (r = -0.152, p < 0.05) whereas no significant association was found between adolescent self-report and BMI-for-age (r = 0.001, p > 0.05). Adolescent self-report and parent proxy-report of the PedsQL 4.0 are valid and reliable to assess HRQoL of Malaysian adolescents. Future studies are recommended to use both adolescent self-report and parent-proxy report of HRQoL as adolescents and parents can provide different perspectives on HRQoL of adolescents.

Microcircuit Reliability Bibliography. Volume 3. 1975 Annual Reference Supplement (Document Numbers 10417-11044)

DTIC Science & Technology

1975-04-01

to 2-16 Category 3: Fabrie’ition Methods and Techniques 3-01 to 3-21 Category 4: ReliabiLity Studies 4-01 to 4-15 Category 5: C,,rputeiized Analysis...RAC icrodrcuit Thesaurus. The ternis are arranged in alphabetical order with sub-term description followinti each main term. Cosvreferencing is...Reliability aspects of vrocircuit manufacturi’. 4. Reliability Studies : Technics) reports !:datig to ;ormal ve isbbty studies and investi- sations

Software Reliability, Measurement, and Testing. Volume 2. Guidebook for Software Reliability Measurement and Testing

DTIC Science & Technology

1992-04-01

contractor’s existing data collection, analysis and corrective action system shall be utilized, with modification only as necessary to meet the...either from test or from analysis of field data . The procedures of MIL-STD-756B assume that the reliability of a 18 DEFINE IDENTIFY SOFTWARE LIFE CYCLE...to generate sufficient data to report a statistically valid reliability figure for a class of software. Casual data gathering accumulates data more

Anomaly Trends for Missions to Mars: Mars Global Surveyor and Mars Odyssey

NASA Technical Reports Server (NTRS)

Green, Nelson W.; Hoffman, Alan R.

2008-01-01

Conducted as a part of NASA Ultra-Reliability effort: Goal is to design for increased reliability in all NASA missions. Desire is to increase reliability by a factor of 10. Study provides a baseline for current technology. Analyzed anomalies for spacecraft orbiting Mars. Long lived spacecraft. Comparison with current rover missions and past orbiters. Looked for trends to assist design of future missions.

Estimating the Effect of Changes in Criterion Score Reliability on the Power of the "F" Test of Equality of Means

ERIC Educational Resources Information Center

Feldt, Leonard S.

2011-01-01

This article presents a simple, computer-assisted method of determining the extent to which increases in reliability increase the power of the "F" test of equality of means. The method uses a derived formula that relates the changes in the reliability coefficient to changes in the noncentrality of the relevant "F" distribution. A readily available…

DOE Office of Scientific and Technical Information (OSTI.GOV)

Baranowski, Ruth; Oteri, Frank; Baring-Gould, Ian

The wind industry and the U.S. Department of Energy (DOE) are addressing technical challenges to increasing wind energy's contribution to the national grid (such as reducing turbine costs and increasing energy production and reliability), and they recognize that public acceptance issues can be challenges for wind energy deployment. Wind project development decisions are best made using unbiased information about the benefits and impacts of wind energy. In 2014, DOE established six wind Regional Resource Centers (RRCs) to provide information about wind energy, focusing on regional qualities. This document summarizes the status and drivers for U.S. wind energy development on regionalmore » and state levels. It is intended to be a companion to DOE's 2014 Distributed Wind Market Report, 2014 Wind Technologies Market Report, and 2014 Offshore Wind Market and Economic Analysis that provide assessments of the national wind markets for each of these technologies.« less

A methodological analysis of chaplaincy research: 2000-2009.

PubMed

Galek, Kathleen; Flannelly, Kevin J; Jankowski, Katherine R B; Handzo, George F

2011-01-01

The present article presents a comprehensive review and analysis of quantitative research conducted in the United States on chaplaincy and closely related topics published between 2000 and 2009. A combined search strategy identified 49 quantitative studies in 13 journals. The analysis focuses on the methodological sophistication of the studies, compared to earlier research on chaplaincy and pastoral care. Cross-sectional surveys of convenience samples still dominate the field, but sample sizes have increased somewhat over the past three decades. Reporting of the validity and reliability of measures continues to be low, although reporting of response rates has improved. Improvements in the use of inferential statistics and statistical controls were also observed, compared to previous research. The authors conclude that more experimental research is needed on chaplaincy, along with an increased use of hypothesis testing, regardless of the research designs that are used.

Supervision strategies for improved reliability of bus routes. Final report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Not Available

1991-09-01

The synthesis will be of interest to transit agency managers and supervisors, as well as to operating and planning personnel who are concerned with the reliability and scheduling of buses. Information is provided on service monitoring, service supervision and control, and supervision strategies. Reliability of transit service is critical to bus transit ridership. The extent of service supervision has an important bearing on reliability. The report describes the various procedures that are used by transit agencies to monitor and maintain bus service reliability. Most transit systems conduct checks of the number of riders at maximum load points and monitor schedulemore » adherence at these locations. Other supervisory actions include service restoration techniques, and strategies such as schedule control, headway control, load control, extraboard management, and personnel selection and training. More sophisticated technologies, such as automatic passenger counting (APC) systems and automatic vehicle location and control (AVLC), have been employed by some transit agencies and are described in the synthesis.« less

[The reliability of a questionnaire regarding Colombian children's physical activity].

PubMed

Herazo-Beltrán, Aliz Y; Domínguez-Anaya, Regina

2012-10-01

Reporting the Physical Activity Questionnaire for school children's (PAQ-C) test-retest reliability and internal consistency. This was a descriptive study of 100 school-aged children aged 9 to 11 years old attending a school in Cartagena, Colombia. The sample was randomly selected. The PAQ-C was given twice, one week apart, after the informed consent forms had been signing by the children's parents and school officials. Cronbach's alpha coefficient of reliability was used for assessing internal consistency and an intra-class correlation coefficient for test-retest reliability SPSS (version 17.0) was used for statistical analysis. The questionnaire scored 0.73 internal consistencies during the first measurement and 0.78 on the second; intra-class correlation coefficient was 0.60. There were differences between boys and girls regarding both measurements. The PAQ-C had acceptable internal consistency and test-retest reliability, thereby making it useful for measuring children's self-reported physical activity and a valuable tool for population studies in Colombia.

Statistical Considerations in Choosing a Test Reliability Coefficient. ACT Research Report Series, 2012 (10)

ERIC Educational Resources Information Center

Woodruff, David; Wu, Yi-Fang

2012-01-01

The purpose of this paper is to illustrate alpha's robustness and usefulness, using actual and simulated educational test data. The sampling properties of alpha are compared with the sampling properties of several other reliability coefficients: Guttman's lambda[subscript 2], lambda[subscript 4], and lambda[subscript 6]; test-retest reliability;…

Reliability of Summed Item Scores Using Structural Equation Modeling: An Alternative to Coefficient Alpha

ERIC Educational Resources Information Center

Green, Samuel B.; Yang, Yanyun

2009-01-01

A method is presented for estimating reliability using structural equation modeling (SEM) that allows for nonlinearity between factors and item scores. Assuming the focus is on consistency of summed item scores, this method for estimating reliability is preferred to those based on linear SEM models and to the most commonly reported estimate of…

Emotional and Behavioral Screener: Test-Retest Reliability, Inter-Rater Reliability, and Convergent Validity

ERIC Educational Resources Information Center

Nordness, Philip D.; Epstein, Michael H.; Cullinan, Douglas; Pierce, Corey D.

2014-01-01

The Emotional and Behavioral Screener (EBS) is a universal screening instrument designed to identify students whose excessive problem behaviors put them at risk of the education disability category of emotional disturbance (ED). This article reports findings from three studies that address the reliability and validity of the EBS. Studies 1 and 2…

A rater training protocol to assess team performance.

PubMed

Eppich, Walter; Nannicelli, Anna P; Seivert, Nicholas P; Sohn, Min-Woong; Rozenfeld, Ranna; Woods, Donna M; Holl, Jane L

2015-01-01

Simulation-based methodologies are increasingly used to assess teamwork and communication skills and provide team training. Formative feedback regarding team performance is an essential component. While effective use of simulation for assessment or training requires accurate rating of team performance, examples of rater-training programs in health care are scarce. We describe our rater training program and report interrater reliability during phases of training and independent rating. We selected an assessment tool shown to yield valid and reliable results and developed a rater training protocol with an accompanying rater training handbook. The rater training program was modeled after previously described high-stakes assessments in the setting of 3 facilitated training sessions. Adjacent agreement was used to measure interrater reliability between raters. Nine raters with a background in health care and/or patient safety evaluated team performance of 42 in-situ simulations using post-hoc video review. Adjacent agreement increased from the second training session (83.6%) to the third training session (85.6%) when evaluating the same video segments. Adjacent agreement for the rating of overall team performance was 78.3%, which was added for the third training session. Adjacent agreement was 97% 4 weeks posttraining and 90.6% at the end of independent rating of all simulation videos. Rater training is an important element in team performance assessment, and providing examples of rater training programs is essential. Articulating key rating anchors promotes adequate interrater reliability. In addition, using adjacent agreement as a measure allows differentiation between high- and low-performing teams on video review. © 2015 The Alliance for Continuing Education in the Health Professions, the Society for Academic Continuing Medical Education, and the Council on Continuing Medical Education, Association for Hospital Medical Education.

Reliability of Sn/Pb and Lead-Free (SnAgCu) Solders of Surface Mounted Miniaturized Passive Components for Extreme Temperature (-185 C to +125 C) Space Missions

NASA Technical Reports Server (NTRS)

Ramesham, Rajeshuni

2011-01-01

Surface mount electronic package test boards have been assembled using tin/lead (Sn/Pb) and lead-free (Pb-free or SnAgCu or SAC305) solders. The soldered surface mount packages include ball grid arrays (BGA), flat packs, various sizes of passive chip components, etc. They have been optically inspected after assembly and subsequently subjected to extreme temperature thermal cycling to assess their reliability or future deep space, long-term, extreme temperature environmental missions. In this study, the employed temperature range (-185oC to +125oC) covers military specifications (-55oC to +100oC), extreme old Martian (-120oC to +115oC), asteroid Nereus (-180oC to +25oC) and JUNO (-150oC to +120oC) environments. The boards were inspected at room temperature and at various intervals as a function of extreme temperature thermal cycling and bake duration. Electrical resistance measurements made at room temperature are reported and the tests to date have shown some change in resistance as a function of extreme temperature thermal cycling and some showed increase in resistance. However, the change in interconnect resistance becomes more noticeable with increasing number of thermal cycles. Further research work will be carried out to understand the reliability of packages under extreme temperature applications (-185oC to +125oC) via continuously monitoring the daisy chain resistance for BGA, Flat-packs, lead less chip packages, etc. This paper will describe the experimental reliability results of miniaturized passive components (01005, 0201, 0402, 0603, 0805, and 1206) assembled using surface mounting processes with tin-lead and lead-free solder alloys under extreme temperature environments.

Reliability of Sn/Pb and lead-free (SnAgCu) solders of surface mounted miniaturized passive components for extreme temperature (-185°C to +125°C) space missions

NASA Astrophysics Data System (ADS)

Ramesham, Rajeshuni

2011-02-01

Surface mount electronic package test boards have been assembled using tin/lead (Sn/Pb) and lead-free (Pb-free or SnAgCu or SAC305) solders. The soldered surface mount packages include ball grid arrays (BGA), flat packs, various sizes of passive chip components, etc. They have been optically inspected after assembly and subsequently subjected to extreme temperature thermal cycling to assess their reliability for future deep space, long-term, extreme temperature environmental missions. In this study, the employed temperature range (-185°C to +125°C) covers military specifications (-55°C to +100°C), extreme cold Martian (-120°C to +115°C), asteroid Nereus (-180°C to +25°C) and JUNO (-150°C to +120°C) environments. The boards were inspected at room temperature and at various intervals as a function of extreme temperature thermal cycling and bake duration. Electrical resistance measurements made at room temperature are reported and the tests to date have shown some change in resistance as a function of extreme temperature thermal cycling and some showed increase in resistance. However, the change in interconnect resistance becomes more noticeable with increasing number of thermal cycles. Further research work will be carried out to understand the reliability of packages under extreme temperature applications (-185°C to +125°C) via continuously monitoring the daisy chain resistance for BGA, Flat-packs, lead less chip packages, etc. This paper will describe the experimental reliability results of miniaturized passive components (01005, 0201, 0402, 0603, 0805, and 1206) assembled using surface mounting processes with tin-lead and lead-free solder alloys under extreme temperature environments.

Prognostic indicators of 6-month mortality in elderly people with advanced dementia: A systematic review

PubMed Central

Brown, Meghan A; Sampson, Elizabeth L; Jones, Louise

2013-01-01

Background: For end-of-life dementia patients, palliative care offers a better quality of life than continued aggressive or burdensome medical interventions. To provide the best care options to dementia sufferers, validated, reliable, sensitive, and accurate prognostic tools to identify end-of-life dementia stages are necessary. Aim: To identify accurate prognosticators of mortality in elderly advanced dementia patients consistently reported in the literature. Design: Systematic literature review. Data sources: PubMed, Embase, and PsycINFO databases were searched up to September 2012. Reference lists of included studies were also searched. Inclusion criteria were studies measuring factors specifically related to 6-month outcome in patients diagnosed with dementia in any residential or health-care setting. Results: Seven studies met the inclusion criteria, five of which were set in the United States and two in Israel. Methodology and prognostic outcomes varied greatly between the studies. All but one study found that Functional Assessment Staging phase 7c, currently widely used to assess hospice admission eligibility in the United States, was not a reliable predictor of 6-month mortality. The most common prognostic variables identified related to nutrition/nourishment, or eating habits, followed by increased risk on dementia severity scales and comorbidities. Conclusions: Although the majority of studies agreed that the Functional Assessment Staging 7c criterion was not a reliable predictor of 6-month mortality, we found a lack of prognosticator concordance across the literature. Further studies are essential to identify reliable, sensitive, and specific prognosticators, which can be applied to the clinical setting and allow increased availability of palliative care to dementia patients. PMID:23175514

Characterization of tobacco withdrawal: physiological and subjective effects.

PubMed

Hatsukami, D; Hughes, J R; Pickens, R

1985-01-01

In total, our studies show that changes which occur reliably and consistently in chronic smokers after tobacco deprivation include: decreased heart rate, increased caloric intake/eating, increased number of awakenings during sleep, increased craving for tobacco, and increased confusion, as measured by the POMS. Other changes that were found to occur after tobacco deprivation in some but not all of our studies include decreased orthostatic heart rate, increased irritability, and decreased vigor score on the POMS. Previous investigators have found a consistent effect of tobacco deprivation on heart rate (Gilbert and Pope 1982; Knapp et al. 1963; Parsons and Hamme 1975; Weybrew and Stark 1967; Glauser et al. 1970; Myrsten et al. 1977; Murphee and Schultz 1968). Although decreased blood pressure (Knapp et al. 1963; Murphee and Schultz 1968) and changes in other vital signs such as temperature (Gilbert and Pope 1982; Myrsten et al. 1977; Ague 1974) have been reported, our present studies and studies by others (Weybrew and Stark 1967; Glauser et al. 1970) failed to find a significant deprivation effect on these measures. Perhaps the contradictory findings are a function of the reliability of the measures themselves or of the population tested. Caloric intake has been found to increase in both animals and humans after nicotine or smoking cessation (Gruneberg 1982; Myrsten et al. 1977; Wack and Rodin 1982). These results are consistent with studies which have found that smoking cessation causes an increase in body weight (Wack and Rodin 1982). However, previous studies disagree on how smoking cessation causes weight gain. Our inpatient study is believed to be the first to simultaneously measure changes in caloric intake, fluid retention, and physical activity after tobacco deprivation. In the study, caloric intake increased but fluid retention and physical activity did not change. The increases in weight may not be accounted for solely by increases in caloric intake. There may be other factors such as decreased basal metabolic rate which cause the increase in weight. Other studies have also reported sleep disturbance or insomnia among tobacco-deprived smokers (Larson et al. 1961; Weybrew and Stark 1967). Studies directly monitoring sleep have found a decrease in duration awake (Soldatos et al. 1980), increased REM sleep (Soldatos et al. 1980; Kales et al. 1970; Parsons et al. 1975), and increased Stage IV (greater than 50% delta waves) sleep (Parson et al. 1975; Parsons and Hamme 1975). Thus, objective data indicate that after tobacco deprivation smokers actually sleep longer, which contradicts subjective reports of insomnia.(ABSTRACT TRUNCATED AT 400 WORDS)

Adaptation and reliability of neighborhood environment walkability scale (NEWS) for Iran: A questionnaire for assessing environmental correlates of physical activity

PubMed Central

Hakimian, Pantea; Lak, Azadeh

2016-01-01

Background: In spite of the increased range of inactivity and obesity among Iranian adults, insufficient research has been done on environmental factors influencing physical activity. As a result adapting a subjective (self-report) measurement tool for assessment of physical environment in Iran is critical. Accordingly, in this study Neighborhood Environment Walkability Scale (NEWS) was adapted for Iran and also its reliability was evaluated. Methods: This study was conducted using a systematic adaptation method consisting of 3 steps: translate-back translation procedures, revision by a multidisciplinary panel of local experts and a cognitive study. Then NEWS-Iran was completed among adults aged 18 to 65 years (N=19) with an interval of 15 days. Intra-Class Coefficient (ICC) was used to evaluate the reliability of the adapted questionnaire. Results: NEWS-Iran is an adapted version of NEWS-A (abbreviated) and in the adaptation process five items were added from other versions of NEWS, two subscales were significantly modified for a shorter and more effective questionnaire, and five new items were added about climate factors and site-specific uses. NEWS-Iran showed almost perfect reliability (ICCs: more than 0.8) for all subscales, with items having moderate to almost perfect reliability scores (ICCs: 0.56-0.96). Conclusion: This study introduced NEWS-Iran, which is a reliable version of NEWS for measuring environmental perceptions related to physical activity behavior adapted for Iran. It is the first adapted version of NEWS which demonstrates a systematic adaptation process used by earlier studies. It can be used for other developing countries with similar environmental, social and cultural context. PMID:28210592

Adaptation and reliability of neighborhood environment walkability scale (NEWS) for Iran: A questionnaire for assessing environmental correlates of physical activity.

PubMed

Hakimian, Pantea; Lak, Azadeh

2016-01-01

Background: In spite of the increased range of inactivity and obesity among Iranian adults, insufficient research has been done on environmental factors influencing physical activity. As a result adapting a subjective (self-report) measurement tool for assessment of physical environment in Iran is critical. Accordingly, in this study Neighborhood Environment Walkability Scale (NEWS) was adapted for Iran and also its reliability was evaluated. Methods: This study was conducted using a systematic adaptation method consisting of 3 steps: translate-back translation procedures, revision by a multidisciplinary panel of local experts and a cognitive study. Then NEWS-Iran was completed among adults aged 18 to 65 years (N=19) with an interval of 15 days. Intra-Class Coefficient (ICC) was used to evaluate the reliability of the adapted questionnaire. Results: NEWS-Iran is an adapted version of NEWS-A (abbreviated) and in the adaptation process five items were added from other versions of NEWS, two subscales were significantly modified for a shorter and more effective questionnaire, and five new items were added about climate factors and site-specific uses. NEWS-Iran showed almost perfect reliability (ICCs: more than 0.8) for all subscales, with items having moderate to almost perfect reliability scores (ICCs: 0.56-0.96). Conclusion: This study introduced NEWS-Iran, which is a reliable version of NEWS for measuring environmental perceptions related to physical activity behavior adapted for Iran. It is the first adapted version of NEWS which demonstrates a systematic adaptation process used by earlier studies. It can be used for other developing countries with similar environmental, social and cultural context.

Validation of electronic systems to collect patient-reported outcome (PRO) data-recommendations for clinical trial teams: report of the ISPOR ePRO systems validation good research practices task force.

PubMed

Zbrozek, Arthur; Hebert, Joy; Gogates, Gregory; Thorell, Rod; Dell, Christopher; Molsen, Elizabeth; Craig, Gretchen; Grice, Kenneth; Kern, Scottie; Hines, Sheldon

2013-06-01

Outcomes research literature has many examples of high-quality, reliable patient-reported outcome (PRO) data entered directly by electronic means, ePRO, compared to data entered from original results on paper. Clinical trial managers are increasingly using ePRO data collection for PRO-based end points. Regulatory review dictates the rules to follow with ePRO data collection for medical label claims. A critical component for regulatory compliance is evidence of the validation of these electronic data collection systems. Validation of electronic systems is a process versus a focused activity that finishes at a single point in time. Eight steps need to be described and undertaken to qualify the validation of the data collection software in its target environment: requirements definition, design, coding, testing, tracing, user acceptance testing, installation and configuration, and decommissioning. These elements are consistent with recent regulatory guidance for systems validation. This report was written to explain how the validation process works for sponsors, trial teams, and other users of electronic data collection devices responsible for verifying the quality of the data entered into relational databases from such devices. It is a guide on the requirements and documentation needed from a data collection systems provider to demonstrate systems validation. It is a practical source of information for study teams to ensure that ePRO providers are using system validation and implementation processes that will ensure the systems and services: operate reliably when in practical use; produce accurate and complete data and data files; support management control and comply with any existing regulations. Furthermore, this short report will increase user understanding of the requirements for a technology review leading to more informed and balanced recommendations or decisions on electronic data collection methods. Copyright © 2013 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Measuring and managing radiologist workload: application of lean and constraint theories and production planning principles to planning radiology services in a major tertiary hospital.

PubMed

MacDonald, Sharyn L S; Cowan, Ian A; Floyd, Richard; Mackintosh, Stuart; Graham, Rob; Jenkins, Emma; Hamilton, Richard

2013-10-01

We describe how techniques traditionally used in the manufacturing industry (lean management, the theory of constraints and production planning) can be applied to planning radiology services to reduce the impact of constraints such as limited radiologist hours, and to subsequently reduce delays in accessing imaging and in report turnaround. Targets for imaging and reporting were set aligned with clinical needs. Capacity was quantified for each modality and for radiologists and recorded in activity lists. Demand was quantified and forecasting commenced based on historical referral rates. To try and mitigate the impact of radiologists as a constraint, lean management processes were applied to radiologist workflows. A production planning process was implemented. Outpatient waiting times to access imaging steadily decreased. Report turnaround times improved with the percentage of overnight/on-call reports completed by a 1030 target time increased from approximately 30% to 80 to 90%. The percentage of emergency and inpatient reports completed within one hour increased from approximately 15% to approximately 50% with 80 to 90% available within 4 hours. The number of unreported cases on the radiologist work-list at the end of the working day reduced. The average weekly accuracy for demand forecasts for emergency and inpatient CT, MRI and plain film imaging was 91%, 83% and 92% respectively. For outpatient CT, MRI and plain film imaging the accuracy was 60%, 55% and 77% respectively. Reliable routine weekly and medium to longer term service planning is now possible. Tools from industry can be successfully applied to diagnostic imaging services to improve performance. They allow an accurate understanding of the demands on a service, capacity, and can reliably predict the impact of changes in demand or capacity on service delivery. © 2013 The Royal Australian and New Zealand College of Radiologists.

Immersion in Cold-Water Evaluation (ICE) and self-reported cold intolerance are reliable but unrelated measures.

PubMed

Traynor, Robyn; MacDermid, Joy C

2008-09-01

Intolerance to the cold is common following peripheral nerve injury and surgery of the upper extremity. Despite its prevalence, the exact pathophysiology and natural history of this condition are not well understood. Subjective, self-report questionnaires have been created and validated as reliable measures of post-traumatic cold intolerance. The difficulty currently lies in assigning an objective measure to this predominantly subjective phenomenon. The present study evaluated the test-retest reliability of a proposed objective measure of cold intolerance, the Immersion in Cold-water Evaluation (ICE), and its correlation with subjective measures in healthy control subjects. Two age groups were also compared to investigate the effect of age on cold intolerance and temperature recovery. On two separate testing days, subjects completed three health-related questionnaires and submersed their dominant hands in cold water. The temperature of their second and fifth digits was monitored during recovery. Both the objective cold-provocation testing and the subjective self-report questionnaires were highly reliable albeit not significantly correlated. No significant temperature recovery trend was noted between the age groups. Post-traumatic cold intolerance is postulated to have both a vascular and neural etiology among other contributing causes. The protocol studied here was centered predominantly on the former etiology, examining peripheral blood flow and associated temperature recovery. This study established ICE as a reliable means to objectively measure cold response, supplementing information provided by previously validated self-report methods.

A Method to Increase Drivers' Trust in Collision Warning Systems Based on Reliability Information of Sensor

NASA Astrophysics Data System (ADS)

Tsutsumi, Shigeyoshi; Wada, Takahiro; Akita, Tokihiko; Doi, Shun'ichi

Driver's workload tends to be increased during driving under complicated traffic environments like a lane change. In such cases, rear collision warning is effective for reduction of cognitive workload. On the other hand, it is pointed out that false alarm or missing alarm caused by sensor errors leads to decrease of driver' s trust in the warning system and it can result in low efficiency of the system. Suppose that reliability information of the sensor is provided in real-time. In this paper, we propose a new warning method to increase driver' s trust in the system even with low sensor reliability utilizing the sensor reliability information. The effectiveness of the warning methods is shown by driving simulator experiments.

Reliability of Children’s Testimony in the Era of Developmental Reversals

PubMed Central

Brainerd, C. J.; Reyna, V. F.

2012-01-01

A hoary assumption of the law is that children are more prone to false-memory reports than adults, and hence, their testimony is less reliable than adults’. Since the 1980s, that assumption has been buttressed by numerous studies that detected declines in false memory between early childhood and young adulthood under controlled conditions. Fuzzy-trace theory predicted reversals of this standard developmental pattern in circumstances that are directly relevant to testimony because they involve using the gist of experience to remember events. That prediction has been investigated during the past decade, and a large number of experiments have been published in which false memories have indeed been found to increase between early childhood and young adulthood. Further, experimentation has tied age increases in false memory to improvements in children’s memory for semantic gist. According to current scientific evidence, the principle that children’s testimony is necessarily more infected with false memories than adults’ and that, other things being equal, juries should regard adult’s testimony as necessarily more faithful to actual events is untenable. PMID:23139439

From bedside to bench and back again: research issues in animal models of human disease.

PubMed

Tkacs, Nancy C; Thompson, Hilaire J

2006-07-01

To improve outcomes for patients with many serious clinical problems, multifactorial research approaches by nurse scientists, including the use of animal models, are necessary. Animal models serve as analogies for clinical problems seen in humans and must meet certain criteria, including validity and reliability, to be useful in moving research efforts forward. This article describes research considerations in the development of rodent models. As the standard of diabetes care evolves to emphasize intensive insulin therapy, rates of severe hypoglycemia are increasing among patients with type 1 and type 2 diabetes mellitus. A consequence of this change in clinical practice is an increase in rates of two hypoglycemia-related diabetes complications: hypoglycemia-associated autonomic failure (HAAF) and resulting hypoglycemia unawareness. Work on an animal model of HAAF is in an early developmental stage, with several labs reporting different approaches to model this complication of type 1 diabetes mellitus. This emerging model serves as an example illustrating how evaluation of validity and reliability is critically important at each stage of developing and testing animal models to support inquiry into human disease.

Impact of distributed energy resources on the reliability of a critical telecommunications facility.

DOE Office of Scientific and Technical Information (OSTI.GOV)

Robinson, David; Zuffranieri, Jason V.; Atcitty, Christopher B.

2006-03-01

This report documents a probabilistic risk assessment of an existing power supply system at a large telecommunications office. The focus is on characterizing the increase in the reliability of power supply through the use of two alternative power configurations. Telecommunications has been identified by the Department of Homeland Security as a critical infrastructure to the United States. Failures in the power systems supporting major telecommunications service nodes are a main contributor to major telecommunications outages. A logical approach to improve the robustness of telecommunication facilities would be to increase the depth and breadth of technologies available to restore power inmore » the face of power outages. Distributed energy resources such as fuel cells and gas turbines could provide one more onsite electric power source to provide backup power, if batteries and diesel generators fail. The analysis is based on a hierarchical Bayesian approach and focuses on the failure probability associated with each of three possible facility configurations, along with assessment of the uncertainty or confidence level in the probability of failure. A risk-based characterization of final best configuration is presented.« less

Reliability and Cost Impacts for Attritable Systems

DTIC Science & Technology

2017-03-23

and cost risk metrics to convey the value of reliability and reparability trades. Investigation of the benefit of trading system reparability...illustrates the benefit that reliability engineering can have on total cost . 2.3.1 Contexts of System Reliability Hogge (2012) identifies two distinct...reliability and reparability trades. Investigation of the benefit of trading system reparability shows a marked increase in cost risk. Yet, trades in

Reliability of history of acetaminophen ingestion in intentional drug overdose patients.

PubMed

Bentur, Yedidia; Lurie, Yael; Tamir, Ada; Keyes, Daniel C; Basis, Fuad

2011-01-01

The objective of this study was to determine the reliability of denial of acetaminophen ingestion in intentional drug overdose patients. All intentional drug overdose patients admitted to an emergency department who were able to provide a history were included. A detailed history was obtained on names, timing and number of medications ingested, and serum acetaminophen was assayed. Multidrug ingestion was defined as the reporting of ≥2 medications. Patients were considered 'reliable' if they reported acetaminophen ingestion and had detectable acetaminophen levels or the other way around. Validity parameters of acetaminophen history were assessed by sensitivity, specificity and positive and negative predictive values. A total of 154 patients were included. History was significantly more reliable in patients who denied ingestion of acetaminophen (n = 107) compared with patients who reported it (n = 47; 95.3% vs 65.9%, respectively; p < 0.0001, 95% CI of the difference 17.5%-41.2%). No suicidal patient who denied both acetaminophen and multidrug ingestions had a detectable acetaminophen level (negative predictive value 1, 95% CI 0.93-1.0). It is suggested that denial of both acetaminophen and multidrug ingestions by intentional drug overdose patients after a thorough history taking can be considered reliable for acetaminophen history. In facilities with limited resources, these patients may not require routine acetaminophen screening.

Development and psychometric evaluation of the PROMIS Pediatric Life Satisfaction item banks, child-report, and parent-proxy editions.

PubMed

Forrest, Christopher B; Devine, Janine; Bevans, Katherine B; Becker, Brandon D; Carle, Adam C; Teneralli, Rachel E; Moon, JeanHee; Tucker, Carole A; Ravens-Sieberer, Ulrike

2018-01-01

To describe the psychometric evaluation and item response theory calibration of the PROMIS Pediatric Life Satisfaction item banks, child-report, and parent-proxy editions. A pool of 55 life satisfaction items was administered to 1992 children 8-17 years old and 964 parents of children 5-17 years old. Analyses included descriptive statistics, reliability, factor analysis, differential item functioning, and assessment of construct validity. Thirteen items were deleted because of poor psychometric performance. An 8-item short form was administered to a national sample of 996 children 8-17 years old, and 1294 parents of children 5-17 years old. The combined sample (2988 children and 2258 parents) was used in item response theory (IRT) calibration analyses. The final item banks were unidimensional, the items were locally independent, and the items were free from impactful differential item functioning. The 8-item and 4-item short form scales showed excellent reliability, convergent validity, and discriminant validity. Life satisfaction decreased with declining socio-economic status, presence of a special health care need, and increasing age for girls, but not boys. After IRT calibration, we found that 4- and 8-item short forms had a high degree of precision (reliability) across a wide range (>4 SD units) of the latent variable. The PROMIS Pediatric Life Satisfaction item banks and their short forms provide efficient, precise, and valid assessments of life satisfaction in children and youth.

The assessment of pathologists/laboratory medicine physicians through a multisource feedback tool.

PubMed

Lockyer, Jocelyn M; Violato, Claudio; Fidler, Herta; Alakija, Pauline

2009-08-01

There is increasing interest in ensuring that physicians demonstrate the full range of Accreditation Council for Graduate Medical Education competencies. To determine whether it is possible to develop a feasible and reliable multisource feedback instrument for pathologists and laboratory medicine physicians. Surveys with 39, 30, and 22 items were developed to assess individual physicians by 8 peers, 8 referring physicians, and 8 coworkers (eg, technologists, secretaries), respectively, using 5-point scales and an unable-to-assess category. Physicians completed a self-assessment survey. Items addressed key competencies related to clinical competence, collaboration, professionalism, and communication. Data from 101 pathologists and laboratory medicine physicians were analyzed. The mean number of respondents per physician was 7.6, 7.4, and 7.6 for peers, referring physicians, and coworkers, respectively. The reliability of the internal consistency, measured by Cronbach alpha, was > or = .95 for the full scale of all instruments. Analysis indicated that the medical peer, referring physician, and coworker instruments achieved a generalizability coefficient of .78, .81, and .81, respectively. Factor analysis showed 4 factors on the peer questionnaire accounted for 68.8% of the total variance: reports and clinical competency, collaboration, educational leadership, and professional behavior. For the referring physician survey, 3 factors accounted for 66.9% of the variance: professionalism, reports, and clinical competency. Two factors on the coworker questionnaire accounted for 59.9% of the total variance: communication and professionalism. It is feasible to assess this group of physicians using multisource feedback with instruments that are reliable.

Self-Motion Perception: Assessment by Real-Time Computer Generated Animations

NASA Technical Reports Server (NTRS)

Parker, Donald E.

1999-01-01

Our overall goal is to develop materials and procedures for assessing vestibular contributions to spatial cognition. The specific objective of the research described in this paper is to evaluate computer-generated animations as potential tools for studying self-orientation and self-motion perception. Specific questions addressed in this study included the following. First, does a non- verbal perceptual reporting procedure using real-time animations improve assessment of spatial orientation? Are reports reliable? Second, do reports confirm expectations based on stimuli to vestibular apparatus? Third, can reliable reports be obtained when self-motion description vocabulary training is omitted?

Transit service reliability

DOT National Transportation Integrated Search

1978-12-01

This report presents a comprehensive overview of the subject of transit service reliability and provides a framework for a program of demonstrations and research studies which could be carried out under the Service and Methods Demonstration program. ...

@NWTC Newsletter: Summer 2015 | Wind | NREL

Science.gov Websites

Structural Testing of the Blade Reliability Collaborative Effect of Defect Wind Turbine Blades Gearbox Reliability Collaborative Phase 3 Gearbox 2 Test Report Modeling Dynamic Stall on Wind Turbine Blades Under

Development of reliable pavement models.

DOT National Transportation Integrated Search

2011-05-01

The current report proposes a framework for estimating the reliability of a given pavement structure as analyzed by : the Mechanistic-Empirical Pavement Design Guide (MEPDG). The methodology proposes using a previously fit : response surface, in plac...

Basis And Application Of The CARES/LIFE Computer Program

NASA Technical Reports Server (NTRS)

Nemeth, Noel N.; Janosik, Lesley A.; Gyekenyesi, John P.; Powers, Lynn M.

1996-01-01

Report discusses physical and mathematical basis of Ceramics Analysis and Reliability Evaluation of Structures LIFE prediction (CARES/LIFE) computer program, described in "Program for Evaluation of Reliability of Ceramic Parts" (LEW-16018).

Quantifying the test-retest reliability of cerebral blood flow measurements in a clinical model of on-going post-surgical pain: A study using pseudo-continuous arterial spin labelling.

PubMed

Hodkinson, Duncan J; Krause, Kristina; Khawaja, Nadine; Renton, Tara F; Huggins, John P; Vennart, William; Thacker, Michael A; Mehta, Mitul A; Zelaya, Fernando O; Williams, Steven C R; Howard, Matthew A

2013-01-01

Arterial spin labelling (ASL) is increasingly being applied to study the cerebral response to pain in both experimental human models and patients with persistent pain. Despite its advantages, scanning time and reliability remain important issues in the clinical applicability of ASL. Here we present the test-retest analysis of concurrent pseudo-continuous ASL (pCASL) and visual analogue scale (VAS), in a clinical model of on-going pain following third molar extraction (TME). Using ICC performance measures, we were able to quantify the reliability of the post-surgical pain state and ΔCBF (change in CBF), both at the group and individual case level. Within-subject, the inter- and intra-session reliability of the post-surgical pain state was ranked good-to-excellent (ICC > 0.6) across both pCASL and VAS modalities. The parameter ΔCBF (change in CBF between pre- and post-surgical states) performed reliably (ICC > 0.4), provided that a single baseline condition (or the mean of more than one baseline) was used for subtraction. Between-subjects, the pCASL measurements in the post-surgical pain state and ΔCBF were both characterised as reliable (ICC > 0.4). However, the subjective VAS pain ratings demonstrated a significant contribution of pain state variability, which suggests diminished utility for interindividual comparisons. These analyses indicate that the pCASL imaging technique has considerable potential for the comparison of within- and between-subjects differences associated with pain-induced state changes and baseline differences in regional CBF. They also suggest that differences in baseline perfusion and functional lateralisation characteristics may play an important role in the overall reliability of the estimated changes in CBF. Repeated measures designs have the important advantage that they provide good reliability for comparing condition effects because all sources of variability between subjects are excluded from the experimental error. The ability to elicit reliable neural correlates of on-going pain using quantitative perfusion imaging may help support the conclusions derived from subjective self-report.

Reliable Prescreening of Candidate NerveAgent Prophylaxes via 3D QSAR

DTIC Science & Technology

2005-12-31

recognize and predict prospective toxicity among covalent -binding AChE inhibitors of potential application to nerve agent prophylaxis and...is below since many authors do not follow the 200 word limit 14. SUBJECT TERMS nerve agents , acetylcholinesterase, prophylaxis, QSAR, virtual...Report: Reliable Prescreening of Candidate NerveAgent Prophylaxes via 3D QSAR Report Title ABSTRACT Organophosphorus (OP) nerve agents are among the

Why the Major Field Test in Business Does Not Report Subscores: Reliability and Construct Validity Evidence. Research Report. ETS RR-12-11

ERIC Educational Resources Information Center

Ling, Guangming

2012-01-01

To assess the value of individual students' subscores on the Major Field Test in Business (MFT Business), I examined the test's internal structure with factor analysis and structural equation model methods, and analyzed the subscore reliabilities using the augmented scores method. Analyses of the internal structure suggested that the MFT Business…

Concordance of the Mini-Psychiatric Assessment Schedule for Adults Who Have Developmental Disabilities (PASADD) and the Brief Symptom Inventory

ERIC Educational Resources Information Center

Beail, N.; Mitchell, K.; Vlissides, N.; Jackson, T.

2015-01-01

Background: When assessing the mental health needs of people who have intellectual disabilities (ID) it is important to use measures that have good validity and reliability to ensure accurate case recognition and reliable and valid outcome data. Measures developed for this purpose tend to be self-report or by informant report. Multi-trait…

Reliability of conditioned pain modulation: a systematic review

PubMed Central

Kennedy, Donna L.; Kemp, Harriet I.; Ridout, Deborah; Yarnitsky, David; Rice, Andrew S.C.

2016-01-01

Abstract A systematic literature review was undertaken to determine if conditioned pain modulation (CPM) is reliable. Longitudinal, English language observational studies of the repeatability of a CPM test paradigm in adult humans were included. Two independent reviewers assessed the risk of bias in 6 domains; study participation; study attrition; prognostic factor measurement; outcome measurement; confounding and analysis using the Quality in Prognosis Studies (QUIPS) critical assessment tool. Intraclass correlation coefficients (ICCs) less than 0.4 were considered to be poor; 0.4 and 0.59 to be fair; 0.6 and 0.75 good and greater than 0.75 excellent. Ten studies were included in the final review. Meta-analysis was not appropriate because of differences between studies. The intersession reliability of the CPM effect was investigated in 8 studies and reported as good (ICC = 0.6-0.75) in 3 studies and excellent (ICC > 0.75) in subgroups in 2 of those 3. The assessment of risk of bias demonstrated that reporting is not comprehensive for the description of sample demographics, recruitment strategy, and study attrition. The absence of blinding, a lack of control for confounding factors, and lack of standardisation in statistical analysis are common. Conditioned pain modulation is a reliable measure; however, the degree of reliability is heavily dependent on stimulation parameters and study methodology and this warrants consideration for investigators. The validation of CPM as a robust prognostic factor in experimental and clinical pain studies may be facilitated by improvements in the reporting of CPM reliability studies. PMID:27559835

Physical examination tests for screening and diagnosis of cervicogenic headache: A systematic review.

PubMed

Rubio-Ochoa, J; Benítez-Martínez, J; Lluch, E; Santacruz-Zaragozá, S; Gómez-Contreras, P; Cook, C E

2016-02-01

It has been suggested that differential diagnosis of headaches should consist of a robust subjective examination and a detailed physical examination of the cervical spine. Cervicogenic headache (CGH) is a form of headache that involves referred pain from the neck. To our knowledge, no studies have summarized the reliability and diagnostic accuracy of physical examination tests for CGH. The aim of this study was to summarize the reliability and diagnostic accuracy of physical examination tests used to diagnose CGH. A systematic review following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines was performed in four electronic databases (MEDLINE, Web of Science, Embase and Scopus). Full text reports concerning physical tests for the diagnosis of CGH which reported the clinometric properties for assessment of CGH, were included and screened for methodological quality. Quality Appraisal for Reliability Studies (QAREL) and Quality Assessment of Studies of Diagnostic Accuracy (QUADAS-2) scores were completed to assess article quality. Eight articles were retrieved for quality assessment and data extraction. Studies investigating diagnostic reliability of physical examination tests for CGH scored poorer on methodological quality (higher risk of bias) than those of diagnostic accuracy. There is sufficient evidence showing high levels of reliability and diagnostic accuracy of the selected physical examination tests for the diagnosis of CGH. The cervical flexion-rotation test (CFRT) exhibited both the highest reliability and the strongest diagnostic accuracy for the diagnosis of CGH. Copyright © 2015 Elsevier Ltd. All rights reserved.

Comment on Hall et al. (2017), "How to Choose Between Measures of Tinnitus Loudness for Clinical Research? A Report on the Reliability and Validity of an Investigator-Administered Test and a Patient-Reported Measure Using Baseline Data Collected in a Phase IIa Drug Trial".

PubMed

Sabour, Siamak

2018-03-08

The purpose of this letter, in response to Hall, Mehta, and Fackrell (2017), is to provide important knowledge about methodology and statistical issues in assessing the reliability and validity of an audiologist-administered tinnitus loudness matching test and a patient-reported tinnitus loudness rating. The author uses reference textbooks and published articles regarding scientific assessment of the validity and reliability of a clinical test to discuss the statistical test and the methodological approach in assessing validity and reliability in clinical research. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess reliability and validity. The qualitative variables of sensitivity, specificity, positive predictive value, negative predictive value, false positive and false negative rates, likelihood ratio positive and likelihood ratio negative, as well as odds ratio (i.e., ratio of true to false results), are the most appropriate estimates to evaluate validity of a test compared to a gold standard. In the case of quantitative variables, depending on distribution of the variable, Pearson r or Spearman rho can be applied. Diagnostic accuracy (validity) and diagnostic precision (reliability or agreement) are two completely different methodological issues. Depending on the type of the variable (qualitative or quantitative), well-known statistical tests can be applied to assess validity.

Transcutaneous Electrical Nerve Stimulation for Treating Neurogenic Lower Urinary Tract Dysfunction: A Systematic Review.

PubMed

Gross, Tobias; Schneider, Marc P; Bachmann, Lucas M; Blok, Bertil F M; Groen, Jan; Hoen, Lisette A 't; Castro-Diaz, David; Padilla Fernández, Bárbara; Del Popolo, Giulio; Musco, Stefania; Hamid, Rizwan; Ecclestone, Hazel; Karsenty, Gilles; Phé, Véronique; Pannek, Jürgen; Kessler, Thomas M

2016-06-01

Transcutaneous electrical nerve stimulation (TENS) is a promising therapy for non-neurogenic lower urinary tract dysfunction and might also be a valuable option in patients with an underlying neurological disorder. We systematically reviewed all available evidence on the efficacy and safety of TENS for treating neurogenic lower urinary tract dysfunction. The review was performed according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement. After screening 1943 articles, 22 studies (two randomised controlled trials, 14 prospective cohort studies, five retrospective case series, and one case report) enrolling 450 patients were included. Eleven studies reported on acute TENS and 11 on chronic TENS. In acute TENS and chronic TENS, the mean increase of maximum cystometric capacity ranged from 69ml to 163ml and from 4ml to 156ml, the mean change of bladder volume at first detrusor overactivity from a decrease of 13ml to an increase of 175ml and from an increase of 10ml to 120ml, a mean decrease of maximum detrusor pressure at first detrusor overactivity from 18 cmH20 to 72 cmH20 and 8 cmH20, and a mean decrease of maximum storage detrusor pressure from 20 cmH20 to 58 cmH2O and from 3 cmH20 to 8 cmH2O, respectively. In chronic TENS, a mean decrease in the number of voids and leakages per 24h ranged from 1 to 3 and from 0 to 4, a mean increase of maximum flow rate from 2ml/s to 7ml/s, and a mean change of postvoid residual from an increase of 26ml to a decrease of 85ml. No TENS-related serious adverse events have been reported. Risk of bias and confounding was high in most studies. Although preliminary data suggest TENS might be effective and safe for treating neurogenic lower urinary tract dysfunction, the evidence base is poor and more reliable data from well-designed randomised controlled trials are needed to make definitive conclusions. Early data suggest that transcutaneous electrical nerve stimulation might be effective and safe for treating neurogenic lower urinary tract dysfunction, but more reliable evidence is required. Copyright © 2016 European Association of Urology. Published by Elsevier B.V. All rights reserved.

Effects of automated immunization registry reporting via an electronic health record deployed in community practice settings.

PubMed

Merrill, J; Phillips, A; Keeling, J; Kaushal, R; Senathirajah, Y

2013-01-01

Among the expected benefits of electronic health records (EHRs) is increased reporting of public health information, such as immunization status. State and local immunization registries aid control of vaccine-preventable diseases and help offset fragmentation in healthcare, but reporting is often slow and incomplete. The Primary Care Information Project (PCIP), an initiative of the NYC Department of Health and Mental Hygiene, has implemented EHRs with immunization reporting capability in community settings. To evaluate the effect of automated reporting via an EHR on use and efficiency of reporting to the NY Citywide Immunization Registry, we conducted a secondary analysis of 1.7 million de-identified records submitted between January 2007 and June 2011 by 217 primary care practices enrolled in PCIP, pre and post launch of automated reporting via an EHR. We examined differences in records submitted per day, lag time, and documentation of eligibility for subsidized vaccines. Mean submissions per day did not change. Automated submissions of new and historical records increased by 18% and 98% respectively. Submissions within 14 days increased from 84% to 87%, and within 2 days increased from 60% to 77%. Median lag time decreased from 13 to 10 days. Documentation of eligibility decreased. Results are significant at p<0.001. Significant improvements in registry use and efficiency of reporting were found after launch of automated reporting via an EHR. A decrease in eligibility documentation was attributed to EHR workflow. The limitations to comprehensive evaluation found in these data, which were extracted from a registry initiated prior to widespread EHR implementation suggests that reliable evaluation of immunization reporting via the EHR may require modifications to legacy registry databases.

Technical information report: Plasma melter operation, reliability, and maintenance analysis

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hendrickson, D.W.

1995-03-14

This document provides a technical report of operability, reliability, and maintenance of a plasma melter for low-level waste vitrification, in support of the Hanford Tank Waste Remediation System (TWRS) Low-Level Waste (LLW) Vitrification Program. A process description is provided that minimizes maintenance and downtime and includes material and energy balances, equipment sizes and arrangement, startup/operation/maintence/shutdown cycle descriptions, and basis for scale-up to a 200 metric ton/day production facility. Operational requirements are provided including utilities, feeds, labor, and maintenance. Equipment reliability estimates and maintenance requirements are provided which includes a list of failure modes, responses, and consequences.

The Impact of a Videogame-Based Pilot Physical Activity Program in Older Adults with Schizophrenia on Subjectively and Objectively Measured Physical Activity.

PubMed

Leutwyler, Heather; Hubbard, Erin; Cooper, Bruce; Dowling, Glenna

2015-01-01

The purpose of this report is to describe the impact of a videogame-based pilot physical activity program using the Kinect for Xbox 360 game system (Microsoft, Redmond, WA, USA) on physical activity in older adults with schizophrenia. In this one group pre-test, post-test pilot study, 20 participants played an active videogame for 30 min, once a week for 6 weeks. Physical activity was measured by self-report with the Yale Physical Activity Survey and objectively with the Sensewear Pro armband at enrollment and at the end of the 6-week program. There was a significant increase in frequency of self-reported vigorous physical activity. We did not detect a statistically significant difference in objectively measured physical activity although increase in number of steps and sedentary activity were in the desired direction. These results suggest participants' perception of physical activity intensity differs from the intensity objectively captured with a valid and reliable physical activity monitor.

Setting and changing feature priorities in visual short-term memory.

PubMed

Kalogeropoulou, Zampeta; Jagadeesh, Akshay V; Ohl, Sven; Rolfs, Martin

2017-04-01

Many everyday tasks require prioritizing some visual features over competing ones, both during the selection from the rich sensory input and while maintaining information in visual short-term memory (VSTM). Here, we show that observers can change priorities in VSTM when, initially, they attended to a different feature. Observers reported from memory the orientation of one of two spatially interspersed groups of black and white gratings. Using colored pre-cues (presented before stimulus onset) and retro-cues (presented after stimulus offset) predicting the to-be-reported group, we manipulated observers' feature priorities independently during stimulus encoding and maintenance, respectively. Valid pre-cues reliably increased observers' performance (reduced guessing, increased report precision) as compared to neutral ones; invalid pre-cues had the opposite effect. Valid retro-cues also consistently improved performance (by reducing random guesses), even if the unexpected group suddenly became relevant (invalid-valid condition). Thus, feature-based attention can reshape priorities in VSTM protecting information that would otherwise be forgotten.

Intra- and interobserver reliability of quantitative ultrasound measurement of the plantar fascia.

PubMed

Rathleff, Michael Skovdal; Moelgaard, Carsten; Lykkegaard Olesen, Jens

2011-01-01

To determine intra- and interobserver reliability and measurement precision of sonographic assessment of plantar fascia thickness when using one, the mean of two, or the mean of three measurements. Two experienced observers scanned 20 healthy subjects twice with 60 minutes between test and retest. A GE LOGIQe ultrasound scanner was used in the study. The built-in software in the scanner was used to measure the thickness of the plantar fascia (PF). Reliability was calculated using intraclass correlation coefficient (ICC) and limits of agreement (LOA). Intraobserver reliability (ICC) using one measurement was 0.50 for one observer and 0.52 for the other, and using the mean of three measurements intraobserver reliability increased up to 0.77 and 0.67, respectively. Interobserver reliability (ICC) when using one measurement was 0.62 and increased to 0.82 when using the average of three measurements. LOA showed that when using the average of three measurements, LOA decreased to 0.6 mm, corresponding to 17.5% of the mean thickness of the PF. The results showed that reliability increases when using the mean of three measurements compared with one. Limits of agreement based on intratester reliability shows that changes in thickness that are larger than 0.6 mm can be considered actual changes in thickness and not a result of measurement error. Copyright © 2011 Wiley Periodicals, Inc.

Nuclear electric propulsion operational reliability and crew safety study: NEP systems/modeling report

NASA Technical Reports Server (NTRS)

Karns, James

1993-01-01

The objective of this study was to establish the initial quantitative reliability bounds for nuclear electric propulsion systems in a manned Mars mission required to ensure crew safety and mission success. Finding the reliability bounds involves balancing top-down (mission driven) requirements and bottom-up (technology driven) capabilities. In seeking this balance we hope to accomplish the following: (1) provide design insights into the achievability of the baseline design in terms of reliability requirements, given the existing technology base; (2) suggest alternative design approaches which might enhance reliability and crew safety; and (3) indicate what technology areas require significant research and development to achieve the reliability objectives.

The reliability, validity, and accuracy of self-reported absenteeism from work: a meta-analysis.

PubMed

Johns, Gary; Miraglia, Mariella

2015-01-01

Because of a variety of access limitations, self-reported absenteeism from work is often employed in research concerning health, organizational behavior, and economics, and it is ubiquitous in large scale population surveys in these domains. Several well established cognitive and social-motivational biases suggest that self-reports of absence will exhibit convergent validity with records-based measures but that people will tend to underreport the behavior. We used meta-analysis to summarize the reliability, validity, and accuracy of absence self-reports. The results suggested that self-reports of absenteeism offer adequate test-retest reliability and that they exhibit reasonably good rank order convergence with organizational records. However, people have a decided tendency to underreport their absenteeism, although such underreporting has decreased over time. Also, self-reports were more accurate when sickness absence rather than absence for any reason was probed. It is concluded that self-reported absenteeism might serve as a valid measure in some correlational research designs. However, when accurate knowledge of absolute absenteeism levels is essential, the tendency to underreport could result in flawed policy decisions. PsycINFO Database Record (c) 2014 APA, all rights reserved.

Identification of Classified Information in Unclassified DoD Systems During the Audit of Internal Controls and Data Reliability in the Deployable Disbursing System

DTIC Science & Technology

2009-02-17

Identification of Classified Information in Unclassified DoD Systems During the Audit of Internal Controls and Data Reliability in the Deployable...TITLE AND SUBTITLE Identification of Classified Information in Unclassified DoD Systems During the Audit of Internal Controls and Data Reliability...Systems During the Audit ofInternal Controls and Data Reliability in the Deployable Disbursing System (Report No. D-2009-054) Weare providing this

Seeing is believing? A mixed-methods study exploring the quality and perceived trustworthiness of online information about chronic conditions aimed at children and young people.

PubMed

McPherson, Amy C; Gofine, Miriam L; Stinson, Jennifer

2014-01-01

The numbers of children and young people with chronic conditions are increasing. While their information needs may vary, providing health care information can have considerable benefits, including better emotional health, less distress during treatments, and greater satisfaction with medical care. The Internet is increasingly being used to communicate health-related information to children about a range of chronic conditions. However, the quality of such websites is underexplored. Thus, the objectives of this study were to evaluate the reliability and quality of online information for children about chronic conditions using a standardized evaluation tool, and to explore children's and young people's perceptions of quality and trustworthiness regarding online health information. The study consisted of two phases. In Phase 1, websites about common pediatric chronic conditions aimed at children and containing treatment or management options were identified and the quality assessment tool DISCERN was completed. Test-retest and interrater reliability were calculated. In Phase 2, two focus groups with laptop computers were conducted with children and young people with a chronic condition to explore their perceptions of trustworthiness of online health information. In Phase 1, 165 websites were identified and 100 met the criteria and were assessed. The mean DISCERN score of all sites was 48.16 out of 75 (SD = 7.97, range 28-71, min 15 to max 75). Quality scores varied widely across the sample. The internal consistency and interrater reliability scores were both lower than previously reported in studies using the DISCERN to assess information for adults. In Phase 2, two focus groups with a total of six participants aged 11-23 years revealed a relative lack of concern about the quality and trustworthiness of online health information. Older participants reported judging the source and authorship of websites, but other participants did not question the source of the information they found online. Although personal websites were perceived to be less reliable than those from well-known medical institutions, they were still valued by many of the participants. Overall, there were relatively few websites about pediatric chronic conditions aimed at children, with variable quality and reliability. However, DISCERN's use with pediatric websites across a broad spectrum of developmental stages is limited. Children and young people demonstrated a need for more guidance around assessing trustworthiness of online information. A more appropriate quality assessment tool is warranted, which could usefully be employed by health care professionals, children, and parents.

Impact of data source on travel time reliability assessment.

DOT National Transportation Integrated Search

2014-08-01

Travel time reliability measures are becoming an increasingly important input to the mobility and : congestion management studies. In the case of Maryland State Highway Administration, reliability : measures are key elements in the agencys Annual ...

"Stormy waters ahead": global emergence of carbapenemases.

PubMed

Patel, Gopi; Bonomo, Robert A

2013-01-01

Carbapenems, once considered the last line of defense against of serious infections with Enterobacteriaceae, are threatened with extinction. The increasing isolation of carbapenem-resistant Gram-negative pathogens is forcing practitioners to rely on uncertain alternatives. As little as 5 years ago, reports of carbapenem resistance in Enterobacteriaceae, common causes of both community and healthcare-associated infections, were sporadic and primarily limited to case reports, tertiary care centers, intensive care units, and outbreak settings. Carbapenem resistance mediated by β-lactamases, or carbapenemases, has become widespread and with the paucity of reliable antimicrobials available or in development, international focus has shifted to early detection and infection control. However, as reports of Klebsiella pneumoniae carbapenemases, New Delhi metallo-β-lactamase-1, and more recently OXA-48 (oxacillinase-48) become more common and with the conveniences of travel, the assumption that infections with highly resistant Gram-negative pathogens are limited to the infirmed and the heavily antibiotic and healthcare exposed are quickly being dispelled. Herein, we provide a status report describing the increasing challenges clinicians are facing and forecast the "stormy waters" ahead.

“Stormy waters ahead”: global emergence of carbapenemases

PubMed Central

Patel, Gopi; Bonomo, Robert A.

2013-01-01

Carbapenems, once considered the last line of defense against of serious infections with Enterobacteriaceae, are threatened with extinction. The increasing isolation of carbapenem-resistant Gram-negative pathogens is forcing practitioners to rely on uncertain alternatives. As little as 5 years ago, reports of carbapenem resistance in Enterobacteriaceae, common causes of both community and healthcare-associated infections, were sporadic and primarily limited to case reports, tertiary care centers, intensive care units, and outbreak settings. Carbapenem resistance mediated by β-lactamases, or carbapenemases, has become widespread and with the paucity of reliable antimicrobials available or in development, international focus has shifted to early detection and infection control. However, as reports of Klebsiella pneumoniae carbapenemases, New Delhi metallo-β-lactamase-1, and more recently OXA-48 (oxacillinase-48) become more common and with the conveniences of travel, the assumption that infections with highly resistant Gram-negative pathogens are limited to the infirmed and the heavily antibiotic and healthcare exposed are quickly being dispelled. Herein, we provide a status report describing the increasing challenges clinicians are facing and forecast the “stormy waters” ahead. PMID:23504089

Measuring health-related quality of life in children living in HIV/AIDS-affected families in rural areas in Yunnan, China: Preliminary reliability and validity of the Chinese version of PedsQL 4.0 generic core scales.

PubMed

Xu, Tao; Wu, Zunyou; Yan, Zhihua; Rou, Keming; Duan, Song

2010-02-01

To investigate the preliminary reliability and validity of the Chinese Mandarin version of the Pediatric Quality of Life Inventory (PedsQL) 4.0 Generic Core Scales in a sample of general children and children living in HIV/AIDS-affected families. The PedsQL 4.0 was administered to 116 children aged 8-18 years from HIV/AIDS-affected families and 115 of their caregivers. The questionnaire was also administered to a control group of 109 children and 107 of their caregivers. Most of the self-report and proxy-report scales in both groups exceeded the reliability standard of 0.70, whereas the self-report emotional functioning and school functioning subscales were slightly less than 0.70. On average, children living in HIV/AIDS-affected families scored significantly lower than the control group. The level of agreement between self-reports and proxy reports was low. Correlations were higher on average for the younger age group than for the older age group. The Chinese Mandarin version of PedsQL 4.0 is a valid and reliable instrument for use with children living in HIV families. The health-related quality of life for children living in HIV families is lower than children from ordinary families.

Evaluating cognition in individuals with Huntington disease: Neuro-QoL cognitive functioning measures.

PubMed

Lai, Jin-Shei; Goodnight, Siera; Downing, Nancy R; Ready, Rebecca E; Paulsen, Jane S; Kratz, Anna L; Stout, Julie C; McCormack, Michael K; Cella, David; Ross, Christopher; Russell, Jenna; Carlozzi, Noelle E

2018-03-01

Cognitive functioning impacts health-related quality of life (HRQOL) for individuals with Huntington disease (HD). The Neuro-QoL includes two patient-reported outcome (PRO) measures of cognition-Executive Function (EF) and General Concerns (GC). These measures have not previously been validated for use in HD. The purpose of this analysis is to evaluate the reliability and validity of the Neuro-QoL Cognitive Function measures for use in HD. Five hundred ten individuals with prodromal or manifest HD completed the Neuro-QoL Cognition measures, two other PRO measures of HRQOL (WHODAS 2.0 and EQ5D), and a depression measure (PROMIS Depression). Measures of functioning The Total Functional Capacity and behavior (Problem Behaviors Assessment) were completed by clinician interview. Objective measures of cognition were obtained using clinician-administered Symbol Digit Modalities Test and the Stroop Test (Word, Color, and Interference). Self-rated, clinician-rated, and objective composite scores were developed. We examined the Neuro-QoL measures for reliability, convergent validity, discriminant validity, and known-groups validity. Excellent reliabilities (Cronbach's alphas ≥ 0.94) were found. Convergent validity was supported, with strong relationships between self-reported measures of cognition. Discriminant validity was supported by less robust correlations between self-reported cognition and other constructs. Prodromal participants reported fewer cognitive problems than manifest groups, and early-stage HD participants reported fewer problems than late-stage HD participants. The Neuro-QoL Cognition measures provide reliable and valid assessments of self-reported cognitive functioning for individuals with HD. Findings support the utility of these measures for assessing self-reported cognition.

Construct validity and test-retest reliability of the International Fitness Scale (IFIS) in Colombian children and adolescents aged 9-17.9 years: the FUPRECOL study.

PubMed

Ramírez-Vélez, Robinson; Cruz-Salazar, Sandra Milena; Martínez, Myriam; Cadore, Eduardo L; Alonso-Martinez, Alicia M; Correa-Bautista, Jorge E; Izquierdo, Mikel; Ortega, Francisco B; García-Hermoso, Antonio

2017-01-01

There is a lack of instruments and studies written in Spanish evaluating physical fitness, impeding the determination of the current status of this important health indicator in the Latin population, especially in Colombia. The aim of the study was two-fold: to examine the validity of the International Fitness Scale (IFIS) with a population-based sample of schoolchildren from Bogota, Colombia and to examine the reliability of the IFIS with children and adolescents from Engativa, Colombia. The sample comprised 1,873 Colombian youths (54.5% girls) aged 9-17.9 years. We measured their adiposity markers (waist-to-height ratio, skinfold thickness, percentage of body fat and body mass index), blood pressure, lipids profile, fasting glucose, and physical fitness level (self-reported and measured). A validated cardiometabolic risk index score was also used. An age- and sex-matched subsample of 229 schoolchildren who were not originally included in the sample completed the IFIS twice for reliability purposes. Our data suggest that both measured and self-reported overall physical fitness levels were inversely associated with percentage of body fat indicators and the cardiometabolic risk index score. Overall, schoolchildren who self-reported "good" or "very good" fitness had better measured fitness levels than those who reported "very poor/poor" fitness (all p  < 0.001). The test-retest reliability of the IFIS items was also good, with an average weighted kappa of 0.811. Our findings suggest that self-reported fitness, as assessed by the IFIS, is a valid, reliable, and health-related measure. Furthermore, it can be a good alternative for future use in large studies with Latin schoolchildren from Colombia.

Construct validity and test–retest reliability of the International Fitness Scale (IFIS) in Colombian children and adolescents aged 9–17.9 years: the FUPRECOL study

PubMed Central

Correa-Bautista, Jorge E.; Izquierdo, Mikel

2017-01-01

Background There is a lack of instruments and studies written in Spanish evaluating physical fitness, impeding the determination of the current status of this important health indicator in the Latin population, especially in Colombia. The aim of the study was two-fold: to examine the validity of the International Fitness Scale (IFIS) with a population-based sample of schoolchildren from Bogota, Colombia and to examine the reliability of the IFIS with children and adolescents from Engativa, Colombia. Methods The sample comprised 1,873 Colombian youths (54.5% girls) aged 9–17.9 years. We measured their adiposity markers (waist-to-height ratio, skinfold thickness, percentage of body fat and body mass index), blood pressure, lipids profile, fasting glucose, and physical fitness level (self-reported and measured). A validated cardiometabolic risk index score was also used. An age- and sex-matched subsample of 229 schoolchildren who were not originally included in the sample completed the IFIS twice for reliability purposes. Results Our data suggest that both measured and self-reported overall physical fitness levels were inversely associated with percentage of body fat indicators and the cardiometabolic risk index score. Overall, schoolchildren who self-reported “good” or “very good” fitness had better measured fitness levels than those who reported “very poor/poor” fitness (all p < 0.001). The test-retest reliability of the IFIS items was also good, with an average weighted kappa of 0.811. Discussion Our findings suggest that self-reported fitness, as assessed by the IFIS, is a valid, reliable, and health-related measure. Furthermore, it can be a good alternative for future use in large studies with Latin schoolchildren from Colombia. PMID:28560104

A succinct rating scale for radiology report quality

PubMed Central

Yang, Chengwu; Ouyang, Tao; Peterson, Christine M; Sarwani, Nabeel I; Tappouni, Rafel; Bruno, Michael

2014-01-01

Context: Poorly written radiology reports are common among residents and are a significant challenge for radiology education. While training may improve report quality, a professionally developed reliable and valid scale to measure report quality does not exist. Objectives: To develop a measurement tool for report quality, the quality of report scale, with rigorous validation through empirical data. Methods: A research team of an experienced psychometrician and six senior radiologists conducted qualitative and quantitative studies. Five items were identified for the quality of report scale, each measuring a distinct aspect of report quality. Two dedicated training sessions were designed and implemented to help residents generate high-quality reports. In a blinded fashion, the quality of report scale was applied to 804 randomly selected reports issued before (n = 403) and after (n = 401) training. Full-scale psychometrical assessments were implemented onto the quality of report scale’s item- and scale-scores from the reports. The quality of report scale scores were correlated with report professionalism and attendings’ preference and were compared pre-/post-training. Results: The quality of report scale showed sound psychometrical properties, with high validity and reliability. Reports with higher quality of report scale score were more professional and preferable by attendings. Training improved the quality of report scale score, empirically validating the quality of report scale further. Conclusion: While succinct and practitioner friendly, the quality of report scale is a reliable and valid measure of radiology report quality and has the potential to be easily adapted to other fields such as pathology, where similar training would be beneficial. PMID:26770756

Improving the governance of patient safety in emergency care: a systematic review of interventions

PubMed Central

Hesselink, Gijs; Berben, Sivera; Beune, Thimpe

2016-01-01

Objectives To systematically review interventions that aim to improve the governance of patient safety within emergency care on effectiveness, reliability, validity and feasibility. Design A systematic review of the literature. Methods PubMed, EMBASE, Cumulative Index to Nursing and Allied Health Literature, the Cochrane Database of Systematic Reviews and PsychInfo were searched for studies published between January 1990 and July 2014. We included studies evaluating interventions relevant for higher management to oversee and manage patient safety, in prehospital emergency medical service (EMS) organisations and hospital-based emergency departments (EDs). Two reviewers independently selected candidate studies, extracted data and assessed study quality. Studies were categorised according to study quality, setting, sample, intervention characteristics and findings. Results Of the 18 included studies, 13 (72%) were non-experimental. Nine studies (50%) reported data on the reliability and/or validity of the intervention. Eight studies (44%) reported on the feasibility of the intervention. Only 4 studies (22%) reported statistically significant effects. The use of a simulation-based training programme and well-designed incident reporting systems led to a statistically significant improvement of safety knowledge and attitudes by ED staff and an increase of incident reports within EDs, respectively. Conclusions Characteristics of the interventions included in this review (eg, anonymous incident reporting and validation of incident reports by an independent party) could provide useful input for the design of an effective tool to govern patient safety in EMS organisations and EDs. However, executives cannot rely on a robust set of evidence-based and feasible tools to govern patient safety within their emergency care organisation and in the chain of emergency care. Established strategies from other high-risk sectors need to be evaluated in emergency care settings, using an experimental design with valid outcome measures to strengthen the evidence base. PMID:26826151

Feasibility study report for distribution dispatching center project 2nd stage for the Provincial Electricity Authority (PEA), Bangkok, Thailand, June 1998. Export trade information

DOE Office of Scientific and Technical Information (OSTI.GOV)

NONE

The study concerns the Provincial Electricity Authority, a state agency within the Ministry of Interior that supplies electricity to 73 of Thailand`s provinces. The primary objective of this study is to help increase the ability of the Authority to meet the rapidly increasing demand for electric power within the Kingdom of Thailand in a reliable, safe and economic manner. This is Volume 1 and it consists of the following: (1) introduction; (2) assessment; (3) conceptual design; (4) economic and financial evaluation; (5) project plan; (6) Thailand impact; (7) industry review; (8) conclusion; and appendices.

A case of persistent visual hallucinations of faces following LSD abuse: a functional Magnetic Resonance Imaging study.

PubMed

Iaria, Giuseppe; Fox, Christopher J; Scheel, Michael; Stowe, Robert M; Barton, Jason J S

2010-04-01

In this study, we report the case of a patient experiencing hallucinations of faces that could be reliably precipitated by looking at trees. Using functional Magnetic Resonance Imaging (fMRI), we found that face hallucinations were associated with increased and decreased neural activity in a number of cortical regions. Within the same fusiform face area, however, we found significant decreased and increased neural activity according to whether the patient was experiencing hallucinations or veridical perception of faces, respectively. These findings may indicate key differences in how hallucinatory and veridical perceptions lead to the same phenomenological experience of seeing faces.

[Individual responses of arterial pressure to geomagnetic activity in practically healthy subjects].

PubMed

Zenchenko, T A; Dimitrova, S; Stoilova, I; Breus, T K

2009-01-01

Dynamic analysis of arterial blood pressure in relation to the Earth's magnetic field perturbations was performed in 77 practically healthy volunteers (staff of Bulgarian Academy of Sciences). Almost half of them proved magneto-sensitive, i.e. experienced AP elevation with increased geomagnetic activity. The probability of development of magnetic sensitivity was independent of age and gender but increased in volunteers having even mild cardiovascular pathology. These subjects complained of worsened health condition upon a rise in geomagnetic activity. However, some volunteers reported deteriorated well-being without AD elevation. It means that AD measurement may be insufficient for reliable monitoring magnetic sensitivity.

Recovery Act - LADWP Smart Grid Regional Demonstration Program Final Technical Report

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chiu, Sungly; Vohra, Surendra; Abdelshehid, Emil

LADWP collaborated with its project partners to carry out this demonstration in the designated areas to include two university campuses – the University of California, Los Angeles (UCLA) and the University of Southern California (USC) – surrounding neighborhoods, City of Los Angeles facilities, and LADWP power system test labs. The last project partner, Jet Propulsion Laboratory (JPL) was responsible for the cyber security aspects of the project. The program’s use cases provided insightful information to understand triggers for customers, distributors, and generators to adapt their behavior which aid in reducing system demands and costs, increasing energy efficiency, and increasing gridmore » reliability.« less

Development of KSC program for investigating and generating field failure rates. Volume 1: Summary and overview

NASA Technical Reports Server (NTRS)

Bean, E. E.; Bloomquist, C. E.

1972-01-01

A summary of the KSC program for investigating the reliability aspects of the ground support activities is presented. An analysis of unsatisfactory condition reports (RC), and the generation of reliability assessment of components based on the URC are discussed along with the design considerations for attaining reliable real time hardware/software configurations.

Body of Knowledge (BOK) for Leadless Quad Flat No-Lead/bottom Termination Components (QFN/BTC) Package Trends and Reliability

NASA Technical Reports Server (NTRS)

Ghaffarian, Reza

2014-01-01

Bottom terminated components and quad flat no-lead (BTC/QFN) packages have been extensively used by commercial industry for more than a decade. Cost and performance advantages and the closeness of the packages to the boards make them especially unique for radio frequency (RF) applications. A number of high-reliability parts are now available in this style of package configuration. This report presents a summary of literature surveyed and provides a body of knowledge (BOK) gathered on the status of BTC/QFN and their advanced versions of multi-row QFN (MRQFN) packaging technologies. The report provides a comprehensive review of packaging trends and specifications on design, assembly, and reliability. Emphasis is placed on assembly reliability and associated key design and process parameters because they show lower life than standard leaded package assembly under thermal cycling exposures. Inspection of hidden solder joints for assuring quality is challenging and is similar to ball grid arrays (BGAs). Understanding the key BTC/QFN technology trends, applications, processing parameters, workmanship defects, and reliability behavior is important when judicially selecting and narrowing the follow-on packages for evaluation and testing, as well as for the low risk insertion in high-reliability applications.

Reliability and concurrent validity of the computer workstation checklist.

PubMed

Baker, Nancy A; Livengood, Heather; Jacobs, Karen

2013-01-01

Self-report checklists are used to assess computer workstation set up, typically by workers not trained in ergonomic assessment or checklist interpretation.Though many checklists exist, few have been evaluated for reliability and validity. This study examined reliability and validity of the Computer Workstation Checklist (CWC) to identify mismatches between workers' self-reported workstation problems. The CWC was completed at baseline and at 1 month to establish reliability. Validity was determined with CWC baseline data compared to an onsite workstation evaluation conducted by an expert in computer workstation assessment. Reliability ranged from fair to near perfect (prevalence-adjusted bias-adjusted kappa, 0.38-0.93); items with the strongest agreement were related to the input device, monitor, computer table, and document holder. The CWC had greater specificity (11 of 16 items) than sensitivity (3 of 16 items). The positive predictive value was greater than the negative predictive value for all questions. The CWC has strong reliability. Sensitivity and specificity suggested workers often indicated no problems with workstation setup when problems existed. The evidence suggests that while the CWC may not be valid when used alone, it may be a suitable adjunct to an ergonomic assessment completed by professionals.

Reliability of temporal summation and diffuse noxious inhibitory control

PubMed Central

Cathcart, Stuart; Winefield, Anthony H; Rolan, Paul; Lushington, Kurt

2009-01-01

BACKGROUND: The test-retest reliability of temporal summation (TS) and diffuse noxious inhibitory control (DNIC) has not been reported to date. Establishing such reliability would support the possibility of future experimental studies examining factors affecting TS and DNIC. Similarly, the use of manual algometry to induce TS, or an occlusion cuff to induce DNIC of TS to mechanical stimuli, has not been reported to date. Such devices may offer a simpler method than current techniques for inducing TS and DNIC, affording assessment at more anatomical locations and in more varied research settings. METHOD: The present study assessed the test-retest reliability of TS and DNIC using the above techniques. Sex differences on these measures were also investigated. RESULTS: Repeated measures ANOVA indicated successful induction of TS and DNIC, with no significant differences across test-retest occasions. Sex effects were not significant for any measure or interaction. Intraclass correlations indicated high test-retest reliability for all measures; however, there was large interindividual variation between test and retest measurements. CONCLUSION: The present results indicate acceptable within-session test-retest reliability of TS and DNIC. The results support the possibility of future experimental studies examining factors affecting TS and DNIC. PMID:20011713

The quality of orthodontic practice websites.

PubMed

Parekh, J; Gill, D S

2014-05-01

To evaluate orthodontic practice websites for the reliability of information presented, accessibility, usability for patients and compliance to General Dental Council (GDC) regulations on ethical advertising. World Wide Web. The term 'orthodontic practice' was entered into three separate search engines. The 30 websites from the UK were selected and graded according to the LIDA tool (a validated method of evaluating healthcare websites) for accessibility, usability of the website and reliability of information on orthodontic treatment. The websites were then evaluated against the GDC's Principles for ethical advertising in nine different criteria. On average, each website fulfilled six out of nine points of the GDC's criteria, with inclusion of a complaints policy being the most poorly fulfilled criteria. The mean LIDA score (a combination of usability, reliability and accessibility) was 102/144 (standard deviation 8.38). The websites scored most poorly on reliability (average 43% SD 11.7), with no single website reporting a clear, reliable method of content production. Average accessibility was 81% and usability 73%. In general, websites did not comply with GDC guidelines on ethical advertising. Furthermore, practitioners should consider reporting their method of information production, particularly when making claims about efficiency and speed of treatment in order to improve reliability.

Body of Knowledge (BOK) for Leadless Quad Flat No-Lead/Bottom Termination Components (QFN/BTC) Package Trends and Reliability

NASA Technical Reports Server (NTRS)

Ghaffarian, Reza

2014-01-01

Bottom terminated components and quad flat no-lead (BTC/QFN) packages have been extensively used by commercial industry for more than a decade. Cost and performance advantages and the closeness of the packages to the boards make them especially unique for radio frequency (RF) applications. A number of high-reliability parts are now available in this style of package configuration. This report presents a summary of literature surveyed and provides a body of knowledge (BOK) gathered on the status of BTC/QFN and their advanced versions of multi-row QFN (MRQFN) packaging technologies. The report provides a comprehensive review of packaging trends and specifications on design, assembly, and reliability. Emphasis is placed on assembly reliability and associated key design and process parameters because they show lower life than standard leaded package assembly under thermal cycling exposures. Inspection of hidden solder joints for assuring quality is challenging and is similar to ball grid arrays (BGAs). Understanding the key BTC/QFN technology trends, applications, processing parameters, workmanship defects, and reliability behavior is important when judicially selecting and narrowing the follow-on packages for evaluation and testing, as well as for the low risk insertion in high-reliability applications.

Problems associated with practices that increase the reported recoveries of waterfowl bands

USGS Publications Warehouse

Atwood, E.L.; Geis, A.D.

1960-01-01

The reliability of information based upon banded birds bagged which are reported depends upon the extent to which the following conditions are met: ....1. The reported ratio is the same between years with the same areas of interest....2. The reported ratio is essentially the same between different areas of interest....3. The reported ratio is known for each area of interest....If the first two conditions are met, the banded birds bagged which are reported will always have the same relationship to total banded birds which are bagged. Under these conditions the reported ratio is substantially a constant, and, once it is determined, the investigator could use this ratio for estimating the total number of banded birds bagged. Currently, the necessary conditions leading to the above relationships are not being met, and the situation with respect to reported ratios is as follows:...1. The reported ratio is different between years within the same area of interest. This situation is common but its limit is unknown....2. The reported ratio is different within the same year between different areas of interest. This situation is very common but its limit is unknown. ...3. The reported ratio is different between waterfowl species. The difference between several species has been demonstrated. ....4. The reported ratio is not known for each area of interest. Because of item 2 above, the potential number for different reported ratios is as large as the number of areas of interest. The large number coupled with their lack of constancy (item 1 above) has created a very difficult problem relative to determining reported ratios for all areas of interest....A number of activities which contribute to increased variability in the proportion of bands taken that are reported include:....(1) band reports from those conservation agency employees who make particular efforts to report all the bands they note at checking stations, or in other special bandcollecting programs in which efforts vary from area to area and from year to year; ...(2) publicity campaigns, which are sporadic and not uniform: efforts of writers of some sports columns have had serious effects because of their strong influence..... (3) reward-band programs, which are difficult to administer and finance. and which are almost certain to have variable effects in different areas and different years;....(4) lucky-band contests which have the disadvantages of both (1) and (2). There is some evidence, also, that color-marking programs may have an effect on band returns, and it is suggested that these effects be evaluated.....In view of the above, the chances appear good for obtaining a substantially constant reported ratio in the same area of reference between years by removing these activities. It is believed that the reliability of information based upon banded birds bagged which are reported will be increased in proportion to the degree to which the above practices are decreased.

Is One Trial Sufficient to Obtain Excellent Pressure Pain Threshold Reliability in the Low Back of Asymptomatic Individuals? A Test-Retest Study.

PubMed

Balaguier, Romain; Madeleine, Pascal; Vuillerme, Nicolas

2016-01-01

The assessment of pressure pain threshold (PPT) provides a quantitative value related to the mechanical sensitivity to pain of deep structures. Although excellent reliability of PPT has been reported in numerous anatomical locations, its absolute and relative reliability in the lower back region remains to be determined. Because of the high prevalence of low back pain in the general population and because low back pain is one of the leading causes of disability in industrialized countries, assessing pressure pain thresholds over the low back is particularly of interest. The purpose of this study study was (1) to evaluate the intra- and inter- absolute and relative reliability of PPT within 14 locations covering the low back region of asymptomatic individuals and (2) to determine the number of trial required to ensure reliable PPT measurements. Fifteen asymptomatic subjects were included in this study. PPTs were assessed among 14 anatomical locations in the low back region over two sessions separated by one hour interval. For the two sessions, three PPT assessments were performed on each location. Reliability was assessed computing intraclass correlation coefficients (ICC), standard error of measurement (SEM) and minimum detectable change (MDC) for all possible combinations between trials and sessions. Bland-Altman plots were also generated to assess potential bias in the dataset. Relative reliability for both intra- and inter- session was almost perfect with ICC ranged from 0.85 to 0.99. With respect to the intra-session, no statistical difference was reported for ICCs and SEM regardless of the conducted comparisons between trials. Conversely, for inter-session, ICCs and SEM values were significantly larger when two consecutive PPT measurements were used for data analysis. No significant difference was observed for the comparison between two consecutive measurements and three measurements. Excellent relative and absolute reliabilities were reported for both intra- and inter-session. Reliable measurements can be equally achieved when using the mean of two or three consecutive PPT measurements, as usually proposed in the literature, or with only the first one. Although reliability was almost perfect regardless of the conducted comparison between PPT assessments, our results suggest using two consecutive measurements to obtain higher short term absolute reliability.

Interventions for Age-Related Macular Degeneration: Are Practice Guidelines Based on Systematic Reviews?

PubMed

Lindsley, Kristina; Li, Tianjing; Ssemanda, Elizabeth; Virgili, Gianni; Dickersin, Kay

2016-04-01

Are existing systematic reviews of interventions for age-related macular degeneration incorporated into clinical practice guidelines? High-quality systematic reviews should be used to underpin evidence-based clinical practice guidelines and clinical care. We examined the reliability of systematic reviews of interventions for age-related macular degeneration (AMD) and described the main findings of reliable reviews in relation to clinical practice guidelines. Eligible publications were systematic reviews of the effectiveness of treatment interventions for AMD. We searched a database of systematic reviews in eyes and vision without language or date restrictions; the database was up to date as of May 6, 2014. Two authors independently screened records for eligibility and abstracted and assessed the characteristics and methods of each review. We classified reviews as reliable when they reported eligibility criteria, comprehensive searches, methodologic quality of included studies, appropriate statistical methods for meta-analysis, and conclusions based on results. We mapped treatment recommendations from the American Academy of Ophthalmology (AAO) Preferred Practice Patterns (PPPs) for AMD to systematic reviews and citations of reliable systematic reviews to support each treatment recommendation. Of 1570 systematic reviews in our database, 47 met inclusion criteria; most targeted neovascular AMD and investigated anti-vascular endothelial growth factor (VEGF) interventions, dietary supplements, or photodynamic therapy. We classified 33 (70%) reviews as reliable. The quality of reporting varied, with criteria for reliable reporting met more often by Cochrane reviews and reviews whose authors disclosed conflicts of interest. Anti-VEGF agents and photodynamic therapy were the only interventions identified as effective by reliable reviews. Of 35 treatment recommendations extracted from the PPPs, 15 could have been supported with reliable systematic reviews; however, only 1 recommendation cited a reliable intervention systematic review. No reliable systematic review was identified for 20 treatment recommendations, highlighting areas of evidence gaps. For AMD, reliable systematic reviews exist for many treatment recommendations in the AAO PPPs and should be cited to support these recommendations. We also identified areas where no high-level evidence exists. Mapping clinical practice guidelines to existing systematic reviews is one way to highlight areas where evidence generation or evidence synthesis is either available or needed. Copyright © 2016 American Academy of Ophthalmology. Published by Elsevier Inc. All rights reserved.

"Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias": Correction to Rodebaugh et al. (2016).

PubMed

2016-10-01

Reports an error in "Unreliability as a threat to understanding psychopathology: The cautionary tale of attentional bias" by Thomas L. Rodebaugh, Rachel B. Scullin, Julia K. Langer, David J. Dixon, Jonathan D. Huppert, Amit Bernstein, Ariel Zvielli and Eric J. Lenze ( Journal of Abnormal Psychology , 2016[Aug], Vol 125[6], 840-851). There was an error in the Author Note concerning the support of the MacBrain Face Stimulus Set. The correct statement is provided. (The following abstract of the original article appeared in record 2016-30117-001.) The use of unreliable measures constitutes a threat to our understanding of psychopathology, because advancement of science using both behavioral and biologically oriented measures can only be certain if such measurements are reliable. Two pillars of the National Institute of Mental Health's portfolio-the Research Domain Criteria (RDoC) initiative for psychopathology and the target engagement initiative in clinical trials-cannot succeed without measures that possess the high reliability necessary for tests involving mediation and selection based on individual differences. We focus on the historical lack of reliability of attentional bias measures as an illustration of how reliability can pose a threat to our understanding. Our own data replicate previous findings of poor reliability for traditionally used scores, which suggests a serious problem with the ability to test theories regarding attentional bias. This lack of reliability may also suggest problems with the assumption (in both theory and the formula for the scores) that attentional bias is consistent and stable across time. In contrast, measures accounting for attention as a dynamic process in time show good reliability in our data. The field is sorely in need of research reporting findings and reliability for attentional bias scores using multiple methods, including those focusing on dynamic processes over time. We urge researchers to test and report reliability of all measures, considering findings of low reliability not just as a nuisance but as an opportunity to modify and improve upon the underlying theory. Full assessment of reliability of measures will maximize the possibility that RDoC (and psychological science more generally) will succeed. (PsycINFO Database Record (c) 2016 APA, all rights reserved).

Development of a Flyable Acousto-Optic Laser Beam Deflection System for a Head Up Display of the Future.

DTIC Science & Technology

Rayleigh criteria). The system was designed for stroke writing but was demonstrated with lissajous writing. The acousto - optic deflectors employed...The report describes a laser display which is to be used in a Head-Up Display of the future. The uniqueness of the display is that it uses acousto ... optic components for the modulation and deflection of the laser beam. As a result, there are no moving parts, which increases the reliability and life

THE CONCEPT OF A COMMUNITY INFORMATION SYSTEM TO MEASURE THE QUALITY OF PUBLIC SERVICES,

DTIC Science & Technology

The community information system would consist of the collection of data relevant to public service quality , the periodic reporting of this data in a summarized, sharply focused form, and the application of reliable performance measures to it. The primary purpose of the CIS...groups in forming balanced judgments and making decisions concerning the service they receive. A secondary purpose would be to increase service quality by making it more visible to the public. (Author)

Desire for Penile Girth Enhancement and the Effects of the Self-Injection of Hyaluronic Acid Gel

PubMed Central

Coskuner, Enis Rauf; Canter, Halil Ibrahim

2012-01-01

Penile girth enhancement is a controversial subject but demands for enhancement are increasing steadily. Although various fillers have been widely used for soft tissue augmentation, there is no reliable material for this particular situation. Here we report a case of an acute hypersensitivity reaction in a man after his first self-injection of a filler material, which, he claimed, was hyaluronic acid gel for penile girth enhancement and glans penis augmentation. PMID:23112518

Selection of UAS Personnel (SUPer) Phase I Report: Identification of Critical Skills, Abilities, and Other Characteristics and Recommendations for Test Battery Development

DTIC Science & Technology

2014-11-20

also considered, it was excluded because the SMEs felt it did not measure any personality traits not covered by current Navy tests (Navy Computer...Adaptive Personality Scales [NCAPS] or the Naval Aviation Trait Facet Inventory [NATFI] 5 ). Descriptions of the tests and their subtests are... personality trait tests (e.g., NAFTI, SDI+, and NCAPS) to reduce fakeability and increase reliability. 4. Of the tests considered here, the MTT

Trends in software reliability for digital flight control

NASA Technical Reports Server (NTRS)

Hecht, H.; Hecht, M.

1983-01-01

Software error data of major recent Digital Flight Control Systems Development Programs. The report summarizes the data, compare these data with similar data from previous surveys and identifies trends and disciplines to improve software reliability.

Reliability of Visual Inspection for Highway Bridges, Volume I : Final Report

DOT National Transportation Integrated Search

2001-06-01

This technical summary announces the findings of an investigation by the Federal Highway Administrations Nondestructive Evaluation Validation Center (NDEVC) concerning the reliability of Visual Inspection for highway bridges. Details and results a...

Validity and reliability of self-reported diabetes in the Atherosclerosis Risk in Communities Study.

PubMed

Schneider, Andrea L C; Pankow, James S; Heiss, Gerardo; Selvin, Elizabeth

2012-10-15

The objective of this study was to assess the validity of prevalent and incident self-reported diabetes compared with multiple reference definitions and to assess the reliability (repeatability) of a self-reported diagnosis of diabetes. Data from 10,321 participants in the Atherosclerosis Risk in Communities (ARIC) Study who attended visit 4 (1996-1998) were analyzed. Prevalent self-reported diabetes was compared with reference definitions defined by fasting glucose and medication use obtained at visit 4. Incident self-reported diabetes was assessed during annual follow-up telephone calls and was compared with reference definitions defined by fasting glucose, hemoglobin A1c, and medication use obtained during an in-person visit attended by a subsample of participants (n = 1,738) in 2004-2005. The sensitivity of prevalent self-reported diabetes ranged from 58.5% to 70.8%, and specificity ranged from 95.6% to 96.8%, depending on the reference definition. Similarly, the sensitivity of incident self-reported diabetes ranged from 55.9% to 80.4%, and specificity ranged from 84.5% to 90.6%. Percent positive agreement of self-reported diabetes during 9 years of repeat assessments ranged from 92.7% to 95.4%. Both prevalent self-reported diabetes and incident self-reported diabetes were 84%-97% specific and 55%-80% sensitive as compared with reference definitions using glucose and medication criteria. Self-reported diabetes was >92% reliable over time.

Reliability of perceived neighbourhood conditions and the effects of measurement error on self-rated health across urban and rural neighbourhoods.

PubMed

Pruitt, Sandi L; Jeffe, Donna B; Yan, Yan; Schootman, Mario

2012-04-01

Limited psychometric research has examined the reliability of self-reported measures of neighbourhood conditions, the effect of measurement error on associations between neighbourhood conditions and health, and potential differences in the reliabilities between neighbourhood strata (urban vs rural and low vs high poverty). We assessed overall and stratified reliability of self-reported perceived neighbourhood conditions using five scales (social and physical disorder, social control, social cohesion, fear) and four single items (multidimensional neighbouring). We also assessed measurement error-corrected associations of these conditions with self-rated health. Using random-digit dialling, 367 women without breast cancer (matched controls from a larger study) were interviewed twice, 2-3 weeks apart. Test-retest (intraclass correlation coefficients (ICC)/weighted κ) and internal consistency reliability (Cronbach's α) were assessed. Differences in reliability across neighbourhood strata were tested using bootstrap methods. Regression calibration corrected estimates for measurement error. All measures demonstrated satisfactory internal consistency (α ≥ 0.70) and either moderate (ICC/κ=0.41-0.60) or substantial (ICC/κ=0.61-0.80) test-retest reliability in the full sample. Internal consistency did not differ by neighbourhood strata. Test-retest reliability was significantly lower among rural (vs urban) residents for two scales (social control, physical disorder) and two multidimensional neighbouring items; test-retest reliability was higher for physical disorder and lower for one multidimensional neighbouring item among the high (vs low) poverty strata. After measurement error correction, the magnitude of associations between neighbourhood conditions and self-rated health were larger, particularly in the rural population. Research is needed to develop and test reliable measures of perceived neighbourhood conditions relevant to the health of rural populations.

Reliability Analysis and Modeling of ZigBee Networks

NASA Astrophysics Data System (ADS)

Lin, Cheng-Min

The architecture of ZigBee networks focuses on developing low-cost, low-speed ubiquitous communication between devices. The ZigBee technique is based on IEEE 802.15.4, which specifies the physical layer and medium access control (MAC) for a low rate wireless personal area network (LR-WPAN). Currently, numerous wireless sensor networks have adapted the ZigBee open standard to develop various services to promote improved communication quality in our daily lives. The problem of system and network reliability in providing stable services has become more important because these services will be stopped if the system and network reliability is unstable. The ZigBee standard has three kinds of networks; star, tree and mesh. The paper models the ZigBee protocol stack from the physical layer to the application layer and analyzes these layer reliability and mean time to failure (MTTF). Channel resource usage, device role, network topology and application objects are used to evaluate reliability in the physical, medium access control, network, and application layers, respectively. In the star or tree networks, a series system and the reliability block diagram (RBD) technique can be used to solve their reliability problem. However, a division technology is applied here to overcome the problem because the network complexity is higher than that of the others. A mesh network using division technology is classified into several non-reducible series systems and edge parallel systems. Hence, the reliability of mesh networks is easily solved using series-parallel systems through our proposed scheme. The numerical results demonstrate that the reliability will increase for mesh networks when the number of edges in parallel systems increases while the reliability quickly drops when the number of edges and the number of nodes increase for all three networks. More use of resources is another factor impact on reliability decreasing. However, lower network reliability will occur due to network complexity, more resource usage and complex object relationship.

Electronic synoptic operative reporting: assessing the reliability and completeness of synoptic reports for pancreatic resection.

PubMed

Park, Jason; Pillarisetty, Venu G; Brennan, Murray F; Jarnagin, William R; D'Angelica, Michael I; Dematteo, Ronald P; G Coit, Daniel; Janakos, Maria; Allen, Peter J

2010-09-01

Electronic synoptic operative reports (E-SORs) have replaced dictated reports at many institutions, but whether E-SORs adequately document the components and findings of an operation has received limited study. This study assessed the reliability and completeness of E-SORs for pancreatic surgery developed at our institution. An attending surgeon and surgical fellow prospectively and independently completed an E-SOR after each of 112 major pancreatic resections (78 proximal, 29 distal, and 5 central) over a 10-month period (September 2008 to June 2009). Reliability was assessed by calculating the interobserver agreement between attending physician and fellow reports. Completeness was assessed by comparing E-SORs to a case-matched (surgeon and procedure) historical control of dictated reports, using a 39-item checklist developed through an internal and external query of 13 high-volume pancreatic surgeons. Interobserver agreement between attending and fellow was moderate to very good for individual categorical E-SOR items (kappa = 0.65 to 1.00, p < 0.001 for all items). Compared with dictated reports, E-SORs had significantly higher completeness checklist scores (mean 88.8 +/- 5.4 vs 59.6 +/- 9.2 [maximum possible score, 100], p < 0.01) and were available in patients' electronic records in a significantly shorter interval of time (median 0.5 vs 5.8 days from case end, p < 0.01). The mean time taken to complete E-SORs was 4.0 +/- 1.6 minutes per case. E-SORs for pancreatic surgery are reliable, complete in data collected, and rapidly available, all of which support their clinical implementation. The inherent strengths of E-SORs offer real promise of a new standard for operative reporting and health communication. Copyright 2010 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Mammography image quality and evidence based practice: Analysis of the demonstration of the inframammary angle in the digital setting.

PubMed

Spuur, Kelly; Webb, Jodi; Poulos, Ann; Nielsen, Sharon; Robinson, Wayne

2018-03-01

The aim of this study is to determine the clinical rates of the demonstration of the inframammary angle (IMA) on the mediolateral oblique (MLO) view of the breast on digital mammograms and to compare the outcomes with current accreditation standards for compliance. Relationships between the IMA, age, the posterior nipple line (PNL) and compressed breast thickness will be identified and the study outcomes validated using appropriate analyses of inter-reader and inter-rater reliability and variability. Differences in left versus right data were also investigated. A quantitative retrospective study of 2270 randomly selected paired digital mammograms performed by BreastScreen NSW was undertaken. Data was collected by direct measurement and visual analysis. Intra-class correlation analyses were used to evaluate inter- and intra-rater reliability. The IMA was demonstrated on 52.4% of individual and 42.6% of paired mammograms. A linear relationship was found between the posterior nipple line (PNL) and age (p-value <0.001). The PNL was predicted to increase by 0.48 mm for every one year increment in age. The odds of demonstrating the IMA reduced by 2% for every one year increase in age (p-value = 0.001); are 0.4% higher for every 1 mm increase in PNL (p-value = 0.001) and 1.6% lower for every 1 mm increase in compressed breast thickness, (p-value<0.001). There was high inter- and intra-rater reliability for the PNL while there was 100% agreement for the demonstration of the IMA. Analysis of the demonstration of the IMA indicates clinically achievable rates (42.6%) well below that required for compliance (50%-75%) to known worldwide accreditation standards for screening mammography. These standards should be aligned to the reported evidence base. Visualisation of the IMA is impacted negatively by increasing age and compressed breast thickness but positively by breast size (PNL). Copyright © 2018 Elsevier B.V. All rights reserved.

Is laser speckle contrast analysis (LASCA) the new kid on the block in systemic sclerosis? A systematic literature review and pilot study to evaluate reliability of LASCA to measure peripheral blood perfusion in scleroderma patients.

PubMed

Cutolo, Maurizio; Vanhaecke, Amber; Ruaro, Barbara; Deschepper, Ellen; Ickinger, Claudia; Melsens, Karin; Piette, Yves; Trombetta, Amelia Chiara; De Keyser, Filip; Smith, Vanessa

2018-06-06

A reliable tool to evaluate flow is paramount in systemic sclerosis (SSc). We describe herein on the one hand a systematic literature review on the reliability of laser speckle contrast analysis (LASCA) to measure the peripheral blood perfusion (PBP) in SSc and perform an additional pilot study, investigating the intra- and inter-rater reliability of LASCA. A systematic search was performed in 3 electronic databases, according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. In the pilot study, 30 SSc patients and 30 healthy subjects (HS) underwent LASCA assessment. Intra-rater reliability was assessed by having a first anchor rater performing the measurements at 2 time-points and inter-rater reliability by having the anchor rater and a team of second raters performing the measurements in 15 SSc and 30 HS. The measurements were repeated with a second anchor rater in the other 15 SSc patients, as external validation. Only 1 of the 14 records of interest identified through the systematic search was included in the final analysis. In the additional pilot study: intra-class correlation coefficient (ICC) for intra-rater reliability of the first anchor rater was 0.95 in SSc and 0.93 in HS, the ICC for inter-rater reliability was 0.97 in SSc and 0.93 in HS. Intra- and inter-rater reliability of the second anchor rater was 0.78 and 0.87. The identified literature regarding the reliability of LASCA measurements reports good to excellent inter-rater agreement. This very pilot study could confirm the reliability of LASCA measurements with good to excellent inter-rater agreement and found additionally good to excellent intra-rater reliability. Furthermore, similar results were found in the external validation. Copyright © 2018. Published by Elsevier B.V.

“It Depends on What You Mean by ‘Disagree’”: Differences between Parent and Child Perceptions of Parent–Child Conflict

PubMed Central

Thomas, Sarah A.; Swan, Anna J.; Ehrlich, Katherine B.; Reynolds, Elizabeth K.; Suarez, Liza; Dougherty, Lea R.; MacPherson, Laura; Pabón, Shairy C.

2014-01-01

We examined a new structured interview of parent–child conflict that assesses parent and child perceptions of behavioral conflict about daily life topics (e.g., doing chores, homework), and whether discrepancies exist on beliefs about these topics. In a sample of 100 parents and children ages 10 to 17 years (M=13.5 years, 52 males, 57 % African-American), informants could reliably distinguish between perceived behavioral conflicts and perceived discrepant beliefs about topics. These scores were also significantly related to questionnaire reports of parent–child conflict. Parent and child questionnaire reports did not significantly differ, yet on the structured interview, parents reported significantly greater levels of perceived conflict and discrepant beliefs relative to child reports. Additionally, structured interview reports of conflict demonstrated incremental validity by relating to child self-reports of delinquent behaviors, when accounting for questionnaire conflict reports. The findings have implications for increasing understanding of the links between parent–child conflict and psychosocial outcomes. PMID:25210227

"It Depends on What You Mean by 'Disagree'": Differences between Parent and Child Perceptions of Parent-Child Conflict.

PubMed

De Los Reyes, Andres; Thomas, Sarah A; Swan, Anna J; Ehrlich, Katherine B; Reynolds, Elizabeth K; Suarez, Liza; Dougherty, Lea R; MacPherson, Laura; Pabón, Shairy C

2012-09-01

We examined a new structured interview of parent-child conflict that assesses parent and child perceptions of behavioral conflict about daily life topics (e.g., doing chores, homework), and whether discrepancies exist on beliefs about these topics. In a sample of 100 parents and children ages 10 to 17 years ( M =13.5 years, 52 males, 57 % African-American), informants could reliably distinguish between perceived behavioral conflicts and perceived discrepant beliefs about topics. These scores were also significantly related to questionnaire reports of parent-child conflict. Parent and child questionnaire reports did not significantly differ, yet on the structured interview, parents reported significantly greater levels of perceived conflict and discrepant beliefs relative to child reports. Additionally, structured interview reports of conflict demonstrated incremental validity by relating to child self-reports of delinquent behaviors, when accounting for questionnaire conflict reports. The findings have implications for increasing understanding of the links between parent-child conflict and psychosocial outcomes.

The Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM): An assessment of validity, reliability, and responsiveness.

PubMed

Bryant, Elizabeth; Murtagh, Shemane; Finucane, Laura; McCrum, Carol; Mercer, Christopher; Smith, Toby; Canby, Guy; Rowe, David A; Moore, Ann P

2018-05-11

In response for the need of a freely available, stand-alone, validated outcome measure for use within musculoskeletal (MSK) physiotherapy practice, sensitive enough to measure clinical effectiveness, we developed an MSK patient reported outcome measure. This study examined the validity and reliability of the newly developed Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM) within physiotherapy outpatient settings. Two hundred twenty-four patients attending physiotherapy outpatient departments in South East England with an MSK condition participated in this study. The BmPROM was assessed for user friendliness (rated feedback, N = 224), reliability (internal consistency and test-retest reliability, n = 42), validity (internal and external construct validity, N = 224), and responsiveness (internal, n = 25). Exploratory factor analysis indicated that a two-factor model provides a good fit to the data. Factors were representative of "Functionality" and "Wellbeing". Correlations observed between the BmPROM and SF-36 domains provided evidence of convergent validity. Reliability results indicated that both subscales were internally consistent with alphas above the acceptable limits for both "Functionality" (α = .85, 95% CI [.81, .88]) and 'Wellbeing' (α = .80, 95% CI [.75, .84]). Test-retest analyses (n = 42) demonstrated a high degree of reliability between "Functionality" (ICC = .84; 95% CI [.72, .91]) and "Wellbeing" scores (ICC = .84; 95% CI [.72, .91]). Further examination of test-retest reliability through the Bland-Altman analysis demonstrated that the difference between "Functionality" and "Wellbeing" test scores did not vary as a function of absolute test score. Large treatment effect sizes were found for both subscales (Functionality d = 1.10; Wellbeing 1.03). The BmPROM is a reliable and valid outcome measure for use in evaluating physiotherapy treatment of MSK conditions. Copyright © 2018 John Wiley & Sons, Ltd.

Reliability and Validity of Two Self-report Measures to Assess Sedentary Behavior in Older Adults

PubMed Central

Gennuso, Keith P.; Matthews, Charles E.; Colbert, Lisa H.

2015-01-01

Background The purpose of this study was to examine the reliability and validity of two currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults. Methods Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity. Results Both surveys had moderate test-retest reliability (ICC: YPAS=0.59 (P<0.001), CHAMPS=0.64 (P<0.001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ=−0.0003); however, there was a linear increase (P< 0.01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r=0.005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (p=0.53). Conclusions Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research. PMID:25110344

Inferring Domain-Domain Interactions from Protein-Protein Interactions with Formal Concept Analysis

PubMed Central

Khor, Susan

2014-01-01

Identifying reliable domain-domain interactions will increase our ability to predict novel protein-protein interactions, to unravel interactions in protein complexes, and thus gain more information about the function and behavior of genes. One of the challenges of identifying reliable domain-domain interactions is domain promiscuity. Promiscuous domains are domains that can occur in many domain architectures and are therefore found in many proteins. This becomes a problem for a method where the score of a domain-pair is the ratio between observed and expected frequencies because the protein-protein interaction network is sparse. As such, many protein-pairs will be non-interacting and domain-pairs with promiscuous domains will be penalized. This domain promiscuity challenge to the problem of inferring reliable domain-domain interactions from protein-protein interactions has been recognized, and a number of work-arounds have been proposed. This paper reports on an application of Formal Concept Analysis to this problem. It is found that the relationship between formal concepts provides a natural way for rare domains to elevate the rank of promiscuous domain-pairs and enrich highly ranked domain-pairs with reliable domain-domain interactions. This piggybacking of promiscuous domain-pairs onto less promiscuous domain-pairs is possible only with concept lattices whose attribute-labels are not reduced and is enhanced by the presence of proteins that comprise both promiscuous and rare domains. PMID:24586450