Science.gov

Sample records for adequate inter-rater reliability

  1. The inter-rater reliability of Strain Index and OCRA Checklist task assessments in cheese processing.

    PubMed

    Paulsen, Robert; Gallu, Tommaso; Gilkey, David; Reiser, Raoul; Murgia, Lelia; Rosecrance, John

    2015-11-01

    The purpose of this study was to characterize the inter-rater reliability of two physical exposure assessment methods of the upper extremity, the Strain Index (SI) and Occupational Repetitive Actions (OCRA) Checklist. These methods are commonly used in occupational health studies and by occupational health practitioners. Seven raters used the SI and OCRA Checklist to assess task-level physical exposures to the upper extremity of workers performing 21 cheese manufacturing tasks. Inter-rater reliability was characterized using a single-measure, agreement-based intraclass correlation coefficient (ICC). Inter-rater reliability of SI assessments was moderate to good (ICC = 0.59, 95% CI: 0.45-0.73), a similar finding to prior studies. Inter-rater reliability of OCRA Checklist assessments was excellent (ICC = 0.80, 95% CI: 0.70-0.89). Task complexity had a small, but non-significant, effect on inter-rater reliability SI and OCRA Checklist scores. Both the SI and OCRA Checklist assessments possess adequate inter-rater reliability for the purposes of occupational health research and practice. The OCRA Checklist inter-rater reliability scores were among the highest reported in the literature for semi-quantitative physical exposure assessment tools of the upper extremity. The OCRA Checklist however, required more training time and time to conduct the risk assessments compared to the SI.

  2. Inter-rater Reliability Assessment of ASPECT-R

    PubMed Central

    Bossie, Cynthia A.; Williamson, David; Mao, Lian; Kurut, Clennon

    2016-01-01

    Objective: The increasing importance of real-world data for clinical and policy decision making is driving a need for close attention to the pragmatic versus explanatory features of trial designs. ASPECT-R (A Study Pragmatic-Explanatory Characterization Tool-Rating) is an instrument informed by the PRECIS tool, which was developed to assist researchers in designing trials that are more pragmatic or explanatory. ASPECT-R refined the PRECIS domains and includes a detailed anchored rating system. This analysis established the inter-rater reliability of ASPECT-R. Design: Nine raters (identified from a convenience sample of persons knowledgeable about psychiatry clinical research/study design) received ASPECT-R training materials and 12 study publications. Selected studies assessed antipsychotic treatment in schizophrenia, were published in peer-reviewed journals, and represented a range of studies across a pragmatic-explanatory continuum as determined by authors (CB/LA). After completing training, raters reviewed the 12 studies and rated the study domains using ASPECT-R. Intraclass correlation coefficients were estimated for total and domain scores. Qualitative ratings then were assigned to describe the inter-rater reliability. Results: ASPECT-R scores for the 12 studies were completed by seven raters. The ASPECT-R total score intraclass correlation coefficient was 0.87, corresponding to an excellent inter-rater reliability. Domain intraclass correlation coefficients ranged from 0.85 to 0.31, corresponding to excellent to poor inter-rater reliability. Conclusion: The inter-rater reliability of the ASPECT-R total score was excellent, with excellent to good inter-rater reliability for most domains. The fair to poor inter-rater reliability for two domains may reflect a need for improved domain definition, anchoring, or training materials. ASPECT-R can be used to help understand the pragmaticexplanatory nature of completed or planned trials. PMID:27354926

  3. Inter-Rater Reliability of an Electronic Discussion Coding System.

    ERIC Educational Resources Information Center

    MacKinnon, Gregory R.

    A "cognote" system was developed for coding electronic discussion groups and promoting critical thinking. Previous literature has provided an account of the strategy as applied to several academic settings. This paper addresses the research around establishing the inter-rater reliability of the cognote system. The findings suggest three indicators…

  4. Grant Peer Review: Improving Inter-Rater Reliability with Training

    SciTech Connect

    Sattler, David N.; McKnight, Patrick E.; Naney, Linda; Mathis, Randy

    2015-06-15

    In this study, we developed and evaluated a brief training program for grant reviewers that aimed to increase inter-rater reliability, rating scale knowledge, and effort to read the grant review criteria. Enhancing reviewer training may improve the reliability and accuracy of research grant proposal scoring and funding recommendations. Seventy-five Public Health professors from U.S. research universities watched the training video we produced and assigned scores to the National Institutes of Health scoring criteria proposal summary descriptions. For both novice and experienced reviewers, the training video increased scoring accuracy (the percentage of scores that reflect the true rating scale values), inter-rater reliability, and the amount of time reading the review criteria compared to the no video condition. The increase in reliability for experienced reviewers is notable because it is commonly assumed that reviewers—especially those with experience—have good understanding of the grant review rating scale. Our findings suggest that both experienced and novice reviewers who had not received the type of training developed in this study may not have appropriate understanding of the definitions and meaning for each value of the rating scale and that experienced reviewers may overestimate their knowledge of the rating scale. Lastly, the results underscore the benefits of and need for specialized peer reviewer training.

  5. Variance Estimation of Nominal-Scale Inter-Rater Reliability with Random Selection of Raters

    ERIC Educational Resources Information Center

    Gwet, Kilem Li

    2008-01-01

    Most inter-rater reliability studies using nominal scales suggest the existence of two populations of inference: the population of subjects (collection of objects or persons to be rated) and that of raters. Consequently, the sampling variance of the inter-rater reliability coefficient can be seen as a result of the combined effect of the sampling…

  6. Grant Peer Review: Improving Inter-Rater Reliability with Training

    DOE PAGES

    Sattler, David N.; McKnight, Patrick E.; Naney, Linda; ...

    2015-06-15

    In this study, we developed and evaluated a brief training program for grant reviewers that aimed to increase inter-rater reliability, rating scale knowledge, and effort to read the grant review criteria. Enhancing reviewer training may improve the reliability and accuracy of research grant proposal scoring and funding recommendations. Seventy-five Public Health professors from U.S. research universities watched the training video we produced and assigned scores to the National Institutes of Health scoring criteria proposal summary descriptions. For both novice and experienced reviewers, the training video increased scoring accuracy (the percentage of scores that reflect the true rating scale values), inter-ratermore » reliability, and the amount of time reading the review criteria compared to the no video condition. The increase in reliability for experienced reviewers is notable because it is commonly assumed that reviewers—especially those with experience—have good understanding of the grant review rating scale. Our findings suggest that both experienced and novice reviewers who had not received the type of training developed in this study may not have appropriate understanding of the definitions and meaning for each value of the rating scale and that experienced reviewers may overestimate their knowledge of the rating scale. Lastly, the results underscore the benefits of and need for specialized peer reviewer training.« less

  7. Inter-rater reliability of the STEP protocol.

    PubMed

    Edman, A; Mahnfeldt, M; Wallin, A

    2001-01-01

    An inter-rater reliability test of the Stepwise Comparative Status Analysis (STEP) is presented. The STEP is a protocol for the clinical examination of patients with dementia, within the scope of a neuropsychiatric investigation. It combines psychiatric and neurologic bedside examination methods. The analysis is made in three steps where primary, observable symptom variables are successively aggregated via compound variables to the final determination of one of seven possible dominant regional brain syndromes (global, frontal, subcortical, parietal, frontosubcortical, frontoparietal, other), here also called complex variables. In the present study, two senior physicians assessed 50 patients independently and simultaneously. None of the patients was known to both physicians. In 42 patients (84%), the same dominant brain syndrome was determined by the two clinicians. The probability (P value) of this (or better) agreement was calculated at 2.0 x 10(-12). Kappa coefficients were calculated as a measure of assessment agreement regarding the 50 STEP variables. For 20 variables, the coefficient was 0.75 or above, indicating excellent agreement; for 22 variables, the coefficient was below 0.75 and above 0.40, indicating moderate agreement; and for 4 variables, the value was 0.40 or below, indicating poor agreement. Kappa calculations regarding the assessments of four variables were either not possible or were considered inappropriate.

  8. Intra- and Inter-Rater Reliability of the Modified Tuck Jump Assessment

    PubMed Central

    Fort-Vanmeerhaeghe, Azahara; Montalvo, Alicia M.; Lloyd, Rhodri S.; Read, Paul; Myer, Gregory D.

    2017-01-01

    The Tuck Jump Assessment (TJA) is a clinician-friendly screening tool that was designed to support practitioners with identification of neuromuscular deficits associated with anterior cruciate ligament injury. This study aimed to evaluate the inter- and intra-rater reliability of the modified scoring (0 to 2) TJA to add an additional range of objectivity for each criterion. A total of 24 elite youth volleyball athletes (12 males and 12 females) were included in this study. Each participant’s recorded performance of the TJA was scored independently by two raters across ten criteria using the modified scale. The two raters then scored the same videos one week later. Another investigator who was blind to the identity of the raters analyzed the scores from both raters for each participant. Kappa coefficient (k) and percentage of exact agreement (PEA) for both intra- and inter-rater reliability were analyzed for each item. Intraclass correlation coefficients (ICC) were calculated to determine intra- and inter-rater reliability of the modified TJA total score. Intra- and inter-rater k was good to excellent for most items (0.65-0.91). Average PEA between the two raters and two sessions ranged from 83.3 to 100% in all scored items. The ICC for the total score was excellent in both inter- and inter-rater correlations (0.94-0.96). This research demonstrated that the modified version of the TJA predominantly shows good to excellent intra- and inter-rater reliability in all analyzed criteria. Key points The modified TJA shows good to excellent intra- and inter-rater reliability. This test is useful for assessing repeated jump-landing technique. This test provides a user-friendly option for assessing high-risk movement patterns. PMID:28344460

  9. Inter-rater reliability of muscle contractile property measurements using non-invasive tensiomyography.

    PubMed

    Tous-Fajardo, Julio; Moras, Gerard; Rodríguez-Jiménez, Sergio; Usach, Robert; Doutres, Daniel Moreno; Maffiuletti, Nicola A

    2010-08-01

    Tensiomyography (TMG) is a relatively novel technique to assess muscle mechanical response based on radial muscle belly displacement consecutive to a single electrical stimulus. Although intra-session reliability has been found to be good, inter-rater reliability and the influence of sensor repositioning and electrodes placement on TMG measurements is unknown. The purpose of this study was to analyze the inter-rater reliability of vastus medialis muscle contractile property measurements obtained with TMG as well as the effect of inter-electrode distance (IED). Five contractile parameters were analyzed from vastus medialis muscle belly displacement-time curves: maximal displacement (Dm), contraction time (Tc), sustain time (Ts), delay time (Td), and half-relaxation time (Tr). The inter-rater reliability and IED effect on these measurements were evaluated in 18 subjects. Intra-class correlation coefficients, standard errors of measurement, Bland and Altman systematic bias and random error as well as coefficient of variations were used as measures of reliability. Overall, a good to excellent inter-rater reliability was found for all contractile parameters, except Tr, which showed insufficient reliability. Alterations in IED significantly affected Dm with a trend for all the other parameters. The present results legitimate the use of TMG for the assessment of vastus medialis muscle contractile properties, particularly for Dm and Tc. It is recommended to avoid Tr quantification and IED modifications during multiple TMG measurements.

  10. Inter-rater Reliability of Sustained Aberrant Movement Patterns as a Clinical Assessment of Muscular Fatigue

    PubMed Central

    Aerts, Frank; Carrier, Kathy; Alwood, Becky

    2016-01-01

    Background: The assessment of clinical manifestation of muscle fatigue is an effective procedure in establishing therapeutic exercise dose. Few studies have evaluated physical therapist reliability in establishing muscle fatigue through detection of changes in quality of movement patterns in a live setting. Objective: The purpose of this study is to evaluate the inter-rater reliability of physical therapists’ ability to detect altered movement patterns due to muscle fatigue. Design: A reliability study in a live setting with multiple raters. Participants: Forty-four healthy individuals (ages 19-35) were evaluated by six physical therapists in a live setting. Methods: Participants were evaluated by physical therapists for altered movement patterns during resisted shoulder rotation. Each participant completed a total of four tests: right shoulder internal rotation, right shoulder external rotation, left shoulder internal rotation and left shoulder external rotation. Results: For all tests combined, the inter-rater reliability for a single rater scoring ICC (2,1) was .65 (95%, .60, .71) This corresponds to moderate inter-rater reliability between physical therapists. Limitations: The results of this study apply only to healthy participants and therefore cannot be generalized to a symptomatic population. Conclusion: Moderate inter-rater reliability was found between physical therapists in establishing muscle fatigue through the observation of sustained altered movement patterns during dynamic resistive shoulder internal and external rotation. PMID:27347241

  11. Introducing a new definition of a near fall: intra-rater and inter-rater reliability.

    PubMed

    Maidan, I; Freedman, T; Tzemah, R; Giladi, N; Mirelman, A; Hausdorff, J M

    2014-01-01

    Near falls (NFs) are more frequent than falls, and may occur before falls, potentially predicting fall risk. As such, identification of a NF is important. We aimed to assess intra and inter-rater reliability of the traditional definition of a NF and to demonstrate the potential utility of a new definition. To this end, 10 older adults, 10 idiopathic elderly fallers, and 10 patients with Parkinson's disease (PD) walked in an obstacle course while wearing a safety harness. All walks were videotaped. Forty-nine video segments were extracted to create 2 clips each of 8.48 min. Four raters scored each event using the traditional definition and, two weeks later, using the new definition. A fifth rater used only the new definition. Intra-rater reliability was determined using Kappa (K) statistics and inter-rater reliability was determined using ICC. Using the traditional definition, three raters had poor intra-rater reliability (K<0.054, p>0.137) and one rater had moderate intra-rater reliability (K=0.624, p<0.001). With the traditional definition, inter-rater reliability between the four raters was moderate (ICC=0.667, p<0.001). In contrast, the new NF definition showed high intra-rater (K>0.601, p<0.001) and excellent inter-rater reliability (ICC=0.815, p<0.001). A priori, it is easy to distinguish falls from usual walking and NFs, but it is more challenging to distinguish NFs from obstacle negotiation and usual walking. Therefore, a more precise definition of NF is required. The results of the present study suggest that the proposed new definition increases intra and inter-rater reliability, a critical step for using NFs to quantify fall risk.

  12. IRR (Inter-Rater Reliability) of a COP (Classroom Observation Protocol)--A Critical Appraisal

    ERIC Educational Resources Information Center

    Rui, Ning; Feldman, Jill M.

    2012-01-01

    Notwithstanding broad utility of COPs (classroom observation protocols), there has been limited documentation of the psychometric properties of even the most popular COPs. This study attempted to fill this void by closely examining the item and domain-level IRR (inter-rater reliability) of a COP that was used in a federally funded striving readers…

  13. Leveraging Data Sampling and Practical Knowledge: Field Instructors' Perceptions about Inter-Rater Reliability Data

    ERIC Educational Resources Information Center

    Soslau, Elizabeth; Lewis, Kandia

    2014-01-01

    For accreditation and programmatic decision making, education school administrators use inter-rater reliability analyses to judge credibility of student-teacher assessments. Although weak levels of agreement between university-appointed supervisors and cooperating teachers are usually interpreted to indicate that the process is not being…

  14. Ultrasound assessment for grading structural tendon changes in supraspinatus tendinopathy: an inter-rater reliability study

    PubMed Central

    Hjarbaek, John; Eshoej, Henrik; Larsen, Camilla Marie; Vobbe, Jette; Juul-Kristensen, Birgit

    2016-01-01

    Aim To evaluate the inter-rater reliability of measuring structural changes in the tendon of patients, clinically diagnosed with supraspinatus tendinopathy (cases) and healthy participants (controls), on ultrasound (US) images captured by standardised procedures. Methods A total of 40 participants (24 patients) were included for assessing inter-rater reliability of measurements of fibrillar disruption, neovascularity, as well as the number and total length of calcifications and tendon thickness. Linear weighted κ, intraclass correlation (ICC), SEM, limits of agreement (LOA) and minimal detectable change (MDC) were used to evaluate reliability. Results ‘Moderate—almost perfect’ κ was found for grading fibrillar disruption, neovascularity and number of calcifications (k 0.60–0.96). For total length of calcifications and tendon thickness, ICC was ‘excellent’ (0.85–0.90), with SEM(Agreement) ranging from 0.63 to 2.94 mm and MDC(group) ranging from 0.28 to 1.29 mm. In general, SEM, LOA and MDC showed larger variation for calcifications than for tendon thickness. Conclusions Inter-rater reliability was moderate to almost perfect when a standardised procedure was applied for measuring structural changes on captured US images and movie sequences of relevance for patients with supraspinatus tendinopathy. Future studies should test intra-rater and inter-rater reliability of the method in vivo for use in clinical practice, in addition to validation against a gold standard, such as MRI. Trial registration number NCT01984203; Pre-results. PMID:27221128

  15. Inter-Rater Reliability of Total Body Score-A Scale for Quantification of Corpse Decomposition.

    PubMed

    Nawrocka, Marta; Frątczak, Katarzyna; Matuszewski, Szymon

    2016-05-01

    The degree of body decomposition can be quantified using Total Body Score (TBS), a scale frequently used in taphonomic or entomological studies of decomposition. Here, the inter-rater reliability of the scale is analyzed. The study was made on 120 laymen, which were trained in the use of the scale. Participants scored decomposition of pig carcasses from photographs. It was found that the scale, when used by different people, gives homogeneous results irrespective of the user qualifications (the Krippendorff's alfa for all participants was 0.818). The study also indicated that carcasses in advanced decomposition receive significantly less accurate scores. Moreover, it was found that scores for cadavers in mosaic decomposition (i.e., representing signs of at least two stages of decomposition) are less accurate. These results demonstrate that the scale may be regarded as inter-rater reliable. Some propositions for refinement of the scale were also discussed.

  16. Inter-rater reliability of select physical examination procedures in patients with neck pain.

    PubMed

    Hanney, William J; George, Steven Z; Kolber, Morey J; Young, Ian; Salamh, Paul A; Cleland, Joshua A

    2014-07-01

    This study evaluated the inter-rater reliability of select examination procedures in patients with neck pain (NP) conducted over a 24- to 48-h period. Twenty-two patients with mechanical NP participated in a standardized examination. One examiner performed standardized examination procedures and a second blinded examiner repeated the procedures 24-48 h later with no treatment administered between examinations. Inter-rater reliability was calculated with the Cohen Kappa and weighted Kappa for ordinal data while continuous level data were calculated using an intraclass correlation coefficient model 2,1 (ICC2,1). Coefficients for categorical variables ranged from poor to moderate agreement (-0.22 to 0.70 Kappa) and coefficients for continuous data ranged from slight to moderate (ICC2,1 0.28-0.74). The standard error of measurement for cervical range of motion ranged from 5.3° to 9.9° while the minimal detectable change ranged from 12.5° to 23.1°. This study is the first to report inter-rater reliability values for select components of the cervical examination in those patients with NP performed 24-48 h after the initial examination. There was considerably less reliability when compared to previous studies, thus clinicians should consider how the passage of time may influence variability in examination findings over a 24- to 48-h period.

  17. [Inter-rater reliability and validity of the OPD-CA axes structure and conflict].

    PubMed

    Benecke, Cord; Bock, Astrid; Wieser, Elke; Tschiesner, Reinhard; Lochmann, Martha; Küspert, Felicia; Schorn, Robert; Viertler, Bernhard; Steinmayr-Gensluckner, Maria

    2011-01-01

    The manual of the Operationalized Psychodynamic Diagnostics in childhood and adolescence (OPD-CA) is an instrument meanwhile widespread in the clinical practice to assess psychodynamic dimensions. Publications of inter-rater agreement and validity are still outstanding. This study assessed the interrater-reliability and validity for the axis structure and the axis conflict. 60 adolescents between 14 and 17 years, with and without psychic disorders, were diagnosed with the Operationalized Psychodynamic Diagnostics in childhood and adolescence (Arbeitskreis OPD-KJ, 2007) and SCID-II-interviews and questionnaires. A partial sample of 36 OPD-CA-interviews was the data basis for the assessment of inter-rater agreement. Calculations of validity for axis structure and axis conflict were made with the whole sample. Inter-rater agreement for the axis structure and the axis conflict showed good to very good weighted Kappa coefficients among the trained raters. Validity of the axis structure showed good results. The Operationalized Psychodynamic Diagnostics in childhood and adolescence (OPD-CA) allows a reliable diagnostic of axis structure and axis conflict, if the ratings are done on the basis of semistructured videotaped interviews by trained raters. The axis structure shows validity, while the results concerning the validity of the axis conflict remain unclear.

  18. Intra and inter-rater reliability study of pelvic floor muscle dynamometric measurements

    PubMed Central

    Martinho, Natalia M.; Marques, Joseane; Silva, Valéria R.; Silva, Silvia L. A.; Carvalho, Leonardo C.; Botelho, Simone

    2015-01-01

    OBJECTIVE: The aim of this study was to evaluate the intra and inter-rater reliability of pelvic floor muscle (PFM) dynamometric measurements for maximum and average strengths, as well as endurance. METHOD: A convenience sample of 18 nulliparous women, without any urogynecological complaints, aged between 19 and 31 (mean age of 25.4±3.9) participated in this study. They were evaluated using a pelvic floor dynamometer based on load cell technology. The dynamometric evaluations were repeated in three successive sessions: two on the same day with a rest period of 30 minutes between them, and the third on the following day. All participants were evaluated twice in each session; first by examiner 1 followed by examiner 2. The vaginal dynamometry data were analyzed using three parameters: maximum strength, average strength, and endurance. The Intraclass Correlation Coefficient (ICC) was applied to estimate the PFM dynamometric measurement reliability, considering a good level as being above 0.75. RESULTS: The intra and inter-raters' analyses showed good reliability for maximum strength (ICCintra-rater1=0.96, ICCintra-rater2=0.95, and ICCinter-rater=0.96), average strength (ICCintra-rater1=0.96, ICCintra-rater2=0.94, and ICCinter-rater=0.97), and endurance (ICCintra-rater1=0.88, ICCintra-rater2=0.86, and ICCinter-rater=0.92) dynamometric measurements. CONCLUSIONS: The PFM dynamometric measurements showed good intra- and inter-rater reliability for maximum strength, average strength and endurance, which demonstrates that this is a reliable device that can be used in clinical practice. PMID:25993624

  19. Feasibility and Inter-Rater Reliability of Physical Performance Measures in Acutely Admitted Older Medical Patients

    PubMed Central

    Bodilsen, Ann Christine; Juul-Larsen, Helle Gybel; Petersen, Janne; Beyer, Nina; Andersen, Ove; Bandholm, Thomas

    2015-01-01

    Objective Physical performance measures can be used to predict functional decline and increased dependency in older persons. However, few studies have assessed the feasibility or reliability of such measures in hospitalized older patients. Here we assessed the feasibility and inter-rater reliability of four simple measures of physical performance in acutely admitted older medical patients. Design During the first 24 hours of hospitalization, the following were assessed twice by different raters in 52 (≥ 65 years) patients admitted for acute medical illness: isometric hand grip strength, 4-meter gait speed, 30-s chair stand and Cumulated Ambulation Score. Relative reliability was expressed as weighted kappa for the Cumulated Ambulation Score or as intra-class correlation coefficient (ICC1,1) and lower limit of the 95%-confidence interval (LL95%) for grip strength, gait speed, and 30-s chair stand. Absolute reliability was expressed as the standard error of measurement and the smallest real difference as a percentage of their respective means (SEM% and SRD%). Results The primary reasons for admission of the 52 included patients were infectious disease and cardiovascular illness. The mean± SD age was 78±8.3 years, and 73.1% were women. All patients performed grip strength and Cumulated Ambulation Score testing, 81% performed the gait speed test, and 54% completed the 30-s chair stand test (46% were unable to rise without using the armrests). No systematic bias was found between first and second tests or between raters. The weighted kappa for the Cumulated Ambulation Score was 0.76 (0.60–0.92). The ICC1,1 values were as follows: grip strength, 0.95 (LL95% 0.92); gait speed, 0.92 (LL95% 0.73), and 30-s chair stand, 0.82 (LL95% 0.67). The SEM% values for grip strength, gait speed, and 30-s chair stand were 8%, 7%, and 18%, and the SRD95% values were 22%, 17%, and 49%. Conclusion In acutely admitted older medical patients, grip strength, gait speed, and the

  20. Intra- and inter-rater reliability of digital image analysis for skin color measurement

    PubMed Central

    Sommers, Marilyn; Beacham, Barbara; Baker, Rachel; Fargo, Jamison

    2013-01-01

    Background We determined the intra- and inter-rater reliability of data from digital image color analysis between an expert and novice analyst. Methods Following training, the expert and novice independently analyzed 210 randomly ordered images. Both analysts used Adobe® Photoshop lasso or color sampler tools based on the type of image file. After color correction with Pictocolor® in camera software, they recorded L*a*b* (L*=light/dark; a*=red/green; b*=yellow/blue) color values for all skin sites. We computed intra-rater and inter-rater agreement within anatomical region, color value (L*, a*, b*), and technique (lasso, color sampler) using a series of one-way intra-class correlation coefficients (ICCs). Results Results of ICCs for intra-rater agreement showed high levels of internal consistency reliability within each rater for the lasso technique (ICC ≥ 0.99) and somewhat lower, yet acceptable, level of agreement for the color sampler technique (ICC = 0.91 for expert, ICC = 0.81 for novice). Skin L*, skin b*, and labia L* values reached the highest level of agreement (ICC ≥ 0.92) and skin a*, labia b*, and vaginal wall b* were the lowest (ICC ≥ 0.64). Conclusion Data from novice analysts can achieve high levels of agreement with data from expert analysts with training and the use of a detailed, standard protocol. PMID:23551208

  1. THE INTRA- AND INTER-RATER RELIABILITY OF THE SOCCER INJURY MOVEMENT SCREEN (SIMS)

    PubMed Central

    aus der Fünten, Karen; Govus, Andrew; Julian, Ross; Schimpchen, Jan; Meyer, Tim

    2017-01-01

    Background/purpose The growing volume of movement screening research reveals a belief among practitioners and researchers alike that movement quality may have an association with injury risk. However, existing movement screening tools have not considered the sport-specific movement and injury patterns relevant to soccer. The present study introduces the Soccer Injury Movement Screen (SIMS), which has been designed specifically for use within soccer. Furthermore, the purpose of the present study was to assess the intra- and inter-rater reliability of the SIMS and determine its suitability for use in further research. Methods The study utilized a test-retest design to discern reliablility. Twenty-five (11 males, 14 females) healthy, recreationally active university students (age 25.5 ± 4.0 years, height 171 ± 9 cm, weight 64.7 ± 12.6 kg) agreed to participate. The SIMS contains five sub-tests: the anterior reach, single-leg deadlift, in-line lunge, single-leg hop for distance and tuck jump. Each movement was scored out of 10 points and summed to produce a composite score out of 50. The anterior reach and single-leg hop for distance were scored in real-time while the remaining tests were filmed and scored retrospectively. Three raters conducted the SIMS with each participant on three occasions separated by an average of three and a half days (minimum one day, maximum seven days). Rater 1 re-scored the filmed movements for all participants on all occasions six months later to establish the ‘pure’ intra-rater (intra-occasion) reliability for those movements. Results Intraclass correlation coefficient (ICC) values for intra- and inter-rater composite score reliability ranged from 0.66-0.72 and 0.79-0.86 respectively. Weighted kappa values representing the intra- and inter-rater reliability of the individual sub-tests ranged from 0.35-0.91 indicating fair to almost perfect agreement. Conclusions Establishing the reliability of the SIMS is a

  2. Cultural adaptation, content validity and inter-rater reliability of the "STAR Skin Tear Classification System"1

    PubMed Central

    Strazzieri-Pulido, Kelly Cristina; Santos, Vera Lúcia Conceição de Gouveia; Carville, Keryln

    2015-01-01

    AIMS: to perform the cultural adaptation of the STAR Skin Tear Classification System into the Portuguese language and to test the content validity and inter-rater reliability of the adapted version. METHODS: methodological study with a quantitative approach. The cultural adaptation was developed in three phases: translation, evaluation by a committee of judges and back-translation. The instrument was tested regarding content validity and inter-rater reliability. RESULTS: the adapted version obtained a regular level of concordance when it was applied by nurses using photographs of friction injuries. Regarding its application in clinical practice, the adapted version obtained a moderate and statistically significant level of concordance. CONCLUSION: the study tested the content validity and inter-rater reliability of the version adapted into the Portuguese language. Its inclusion in clinical practice will enable the correct identification of this type of injury, as well as the implementation of protocols for the prevention and treatment of friction injuries. PMID:25806644

  3. [A systematic social observation tool: methods and results of inter-rater reliability].

    PubMed

    Freitas, Eulilian Dias de; Camargos, Vitor Passos; Xavier, César Coelho; Caiaffa, Waleska Teixeira; Proietti, Fernando Augusto

    2013-10-01

    Systematic social observation has been used as a health research methodology for collecting information from the neighborhood physical and social environment. The objectives of this article were to describe the operationalization of direct observation of the physical and social environment in urban areas and to evaluate the instrument's reliability. The systematic social observation instrument was designed to collect information in several domains. A total of 1,306 street segments belonging to 149 different neighborhoods in Belo Horizonte, Minas Gerais, Brazil, were observed. For the reliability study, 149 segments (1 per neighborhood) were re-audited, and Fleiss kappa was used to access inter-rater agreement. Mean agreement was 0.57 (SD = 0.24); 53% had substantial or almost perfect agreement, and 20.4%, moderate agreement. The instrument appears to be appropriate for observing neighborhood characteristics that are not time-dependent, especially urban services, property characterization, pedestrian environment, and security.

  4. Validity and inter-rater reliability of inertial gait measurements in Parkinson's disease: a pilot study.

    PubMed

    Esser, Patrick; Dawes, Helen; Collett, Johnny; Feltham, Max G; Howells, Ken

    2012-03-30

    Walking models driven by centre of mass (CoM) data obtained from inertial measurement units (IMU) or optical motion capture systems (OMCS) can be used to objectively measure gait. However current models have only been validated within typical developed adults (TDA). The purpose of this study was to compare the projected CoM movement within Parkinson's disease (PD) measured by an IMU with data collected from an OMCS after which spatio-temporal gait measures were derived using an inverted pendulum model. The inter-rater reliability of spatio-temporal parameters was explored between expert researchers and clinicians using the IMU processed data. Participants walked 10 m with an IMU attached over their centre of mass which was simultaneously recorded by an OMCS. Data was collected on two occasions, each by an expert researcher and clinician. Ten people with PD showed no difference (p=0.13) for vertical, translatory acceleration, velocity and relative position of the projected centre of mass between IMU and OMCS data. Furthermore no difference (p=0.18) was found for the derived step time, stride length and walking speed for people with PD. Measurements of step time (p=0.299), stride length (p=0.883) and walking speed (p=0.751) did not differ between experts and clinicians. There was good inter-rater reliability for these parameters (ICC3.1=0.979, ICC3.1=0.958 and ICC3.1=0.978, respectively). The findings are encouraging and support the use of IMUs by clinicians to measure CoM movement in people with PD.

  5. Intra-Rater and Inter-Rater Reliability of the Balance Error Scoring System in Pre-Adolescent School Children

    ERIC Educational Resources Information Center

    Sheehan, Dwayne P.; Lafave, Mark R.; Katz, Larry

    2011-01-01

    This study was designed to test the intra- and inter-rater reliability of the University of North Carolina's Balance Error Scoring System in 9- and 10-year-old children. Additionally, a modified version of the Balance Error Scoring System was tested to determine if it was more sensitive in this population ("raw scores"). Forty-six…

  6. Inter-Rater Reliability of the Modified Ashworth Scale and Modified Modified Ashworth Scale in Assessing Poststroke Elbow Flexor Spasticity

    ERIC Educational Resources Information Center

    Kaya, Taciser; Goksel Karatepe, Altinay; Gunaydin, Rezzan; Koc, Aysegul; Altundal Ercan, Ulku

    2011-01-01

    The Modified Ashworth Scale (MAS) is commonly used in clinical practice for grading spasticity. However, it was modified recently by omitting grade "1+" of the MAS and redefining grade "2". The aim of this study was to investigate the inter-rater reliability of MAS and modified MAS (MMAS) for the assessment of poststroke elbow flexor spasticity.…

  7. Tool for Assessing Responsibility-Based Education (TARE): Instrument Development, Content Validity, and Inter-Rater Reliability

    ERIC Educational Resources Information Center

    Wright, Paul M.; Craig, Mark W.

    2011-01-01

    Numerous scholars have stressed the importance of personal and social responsibility in physical activity settings; however, there is a lack of instrumentation to study the implementation of responsibility-based teaching strategies. The development, content validity, and initial inter-rater reliability testing of the Tool for Assessing…

  8. Inter-rater reliability of the Shoulder Symptom Modification Procedure in people with shoulder pain

    PubMed Central

    Lewis, Jeremy S; McCreesh, Karen; Barratt, Eva; Hegedus, Eric J; Sim, Julius

    2016-01-01

    Background Musculoskeletal conditions involving the shoulder are common and, because of the importance of the upper limb and hand in daily function, symptoms in this region are commonly associated with functional impairment in athletic and non-athletic populations. Deriving a definitive diagnosis as to the cause of shoulder symptoms is fraught with difficulty. Limitations have been recognised for imaging and for orthopaedic special tests. 1 solution is to partially base management on the response to tests aimed at reducing the severity of the patient's perception of symptoms. 1 (of many) such tests is the Shoulder Symptom Modification Procedure (SSMP). The reliability of this procedure is unknown. Methods 37 clinician participants independently watched the videos of 11 patient participants undergoing the SSMP and recorded each patient's response as improved (partially or completely), no change or worse. Inter-rater reliability was assessed by Krippendorff's α, which ranges from 0 to 1. Results Krippendorff's α was found to range from 0.762 to 1.000, indicating moderate to substantial reliability. In addition, short (3-hour) and longer (1-day) durations of training were associated with similar levels of reliability across the techniques. Conclusions Deriving a definitive structural diagnosis for a person presenting with a musculoskeletal condition involving the shoulder is difficult. The findings of the present study suggest that the SSMP demonstrates a high level of reliability. More research is needed to better understand the relevance of such procedures. Trial registration number ISRCTN95412360. PMID:27900200

  9. Inter-rater reliability of the Sødring Motor Evaluation of Stroke patients (SMES).

    PubMed

    Halsaa, K E; Sødring, K M; Bjelland, E; Finsrud, K; Bautz-Holter, E

    1999-12-01

    The Sødring Motor Evaluation of Stroke patients is an instrument for physiotherapists to evaluate motor function and activities in stroke patients. The rating reflects quality as well as quantity of the patient's unassisted performance within three domains: leg, arm and gross function. The inter-rater reliability of the method was studied in a sample of 30 patients admitted to a stroke rehabilitation unit. Three therapists were involved in the study; two therapists assessed the same patient on two consecutive days in a balanced design. Cohen's weighted kappa and McNemar's test of symmetry were used as measures of item reliability, and the intraclass correlation coefficient was used to express the reliability of the sumscores. For 24 out of 32 items the weighted kappa statistic was excellent (0.75-0.98), while 7 items had a kappa statistic within the range 0.53-0.74 (fair to good). The reliability of one item was poor (0.13). The intraclass correlation coefficient for the three sumscores was 0.97, 0.91 and 0.97. We conclude that the Sødring Motor Evaluation of Stroke patients is a reliable measure of motor function in stroke patients undergoing rehabilitation.

  10. Field Inter-Rater Reliability of the Psychopathy Checklist-Revised.

    PubMed

    Ismail, Ghena; Looman, Jan

    2016-06-01

    Strong inter-rater reliability has been established for the Hare Psychopathy Checklist-Revised (PCL-R), specifically by examiners in research contexts. However, there is less support for inter-reliability in applied settings. This study examined archival data that included a sample of sex offenders (n = 178) who entered federal custody between 1992 and 1998. The offenders were assessed using the PCL-R on two occasions. The first assessment occurred at Millhaven Institution, the intake unit for federally incarcerated offenders in the province of Ontario. The second assessment took place upon inmates' transfer to the Regional Treatment Center, which admits federal inmates with intense psychological and psychiatric needs. Intra-class correlation coefficients (ICCs) were calculated for item, total, factor, and facet scores. The ICC absolute agreement for the PCL-R total and factor scores from raters across both settings was slightly better than what has been previously reported by Hare. Results of this study show that the reliability of PCL-R scores in field settings can be comparable to those in research settings. Authors conclude by highlighting the importance of training, consultation, considering different scores for a given item, following the guidelines of the manual in addition to considering measures that enhance neutrality and reliability of findings in the criminal justice system.

  11. The inter-rater reliability of the Risk Instrument for Screening in the Community.

    PubMed

    Weathers, Elizabeth; O'Caoimh, Rónán; O'Sullivan, Ronan; Paúl, Constança; Orfilia, Frances; Clarnette, Roger; Fitzgerald, Carol; Svendrovski, Anton; Cornally, Nicola; Leahy-Warren, Patricia; Molloy, D William

    2016-09-01

    Predicting risk of adverse healthcare outcomes is important to enable targeted delivery of interventions. The Risk Instrument for Screening in the Community (RISC), designed for use by public health nurses (PHNs), measures the 1-year risk of hospitalisation, institutionalisation and death in community-dwelling older adults according to a five-point global risk score: from low (score 1,2) to medium (3) to high (4,5). We examined the inter-rater reliability (IRR) of the RISC between student PHNs (n=32) and expert raters using six cases (two low, medium and high-risk), scored before and after RISC training. Correlations increased for each adverse outcome, statistically significantly for institutionalisation (r=0.72 to 0.80, p=0.04) and hospitalisation (r=0.51 to 0.71, p<0.01) but not death. Training improved accuracy for low-risk but not all high-risk cases. Overall, the RISC showed good IRR, which increased after RISC training. That reliability fell for some high-risk cases suggests that the training programme requires adjustment to improve IRR further.

  12. Inter-Rater Reliability and Intra-Rater Reliability of Assessing the 2-Minute Push-Up Test.

    PubMed

    Fielitz, Lynn; Coelho, Jeffrey; Horne, Thomas; Brechue, William

    2016-02-01

    The purpose of this study was to assess inter-rater reliability and intra-rater reliability of the 2-minute, 90° push-up test as utilized in the Army Physical Fitness Test. Analysis of rater assessment reliability included both total score agreement and agreement across individual push-up repetitions. This study utilized 8 Raters who assessed 15 different videotaped push-up performances over 4 iterations separated by a minimum of 1 week. The 15 push-up participants were videotaped during the semiannual Army Physical Fitness Test. Each Rater randomly viewed the 15 push-up and verbally responded with a "yes" or "no" to each push-up repetition. The data generated were analyzed using the Pearson product-moment correlation as well as the kappa, modified kappa and the intra-class correlation coefficient (3,1). An attribute agreement analysis was conducted to determine the percent of inter-rater and intra-rater agreement across individual push-ups.The results indicated that Raters varied a great deal in assessing push-ups. Over the 4 trials of 15 participants, the overall scores of the Raters varied between 3.0 and 35.7 push-ups. Post hoc comparisons found that there was significant increase in the grand mean of push-ups from trials 1-3 to trial 4 (p < 0.05). Also, there was a significant difference among raters over the 4 trials (p < 0.05). Pearson correlation coefficients for inter-rater and intra-rater reliability identified inter-rater reliability coefficients were between 0.10 and 0.97. Intra-rater coefficients were between 0.48 and 0.99. Intra-rater agreement for individual push-up repetitions ranged from 41.8% to 84.8%. The results indicated that the raters failed to assess the same push-up repetition with the same score (below 70% agreement) as well as failed to agree when viewed between raters (29%). Interestingly, as previously mentioned, scores on trial 4 increased significantly which might have been caused by rater drift or that the Raters did not maintain

  13. The intra- and inter-rater reliabilities of the Short Form Berg Balance Scale in institutionalized elderly people.

    PubMed

    Kim, Seong-Gil; Kim, Myoung-Kwon

    2015-09-01

    [Purpose] The purpose of this study was to examine the intra- and inter-rater reliabilities of the Short Form Berg Balance Scale in institutionalized elderly people. [Subjects and Methods] A total of 30 elderly people in a nursing facility in Y city, South Korea, participated in this study. Two examiners administered the Short Form Berg Balance Scale to one subject to investigate inter-rater reliability. After a week, the same examiners administered the Short Form Berg Balance Scale once more to investigate intra-rater reliability. [Results] The intra-rater reliability was 0.83. The inter-rater reliability was 0.79. Both reliabilities were high (more than 0.7). [Conclusion] The Short Form Berg Balance Scale is a version of the Berg Balance Scale shortened by reducing the number of items, but its reliabilities were not lower than those of the Berg Balance Scale. The Short Form Berg Balance Scale can be useful clinically due to its short measurement time.

  14. Intra-rater and Inter-rater Reliability of Mandibular Range of Motion Measures Considering a Neutral Craniocervical Position

    PubMed Central

    Beltran-Alacreu, Hector; López-de-Uralde-Villanueva, Ibai; Paris-Alemany, Alba; Angulo-Díaz-Parreño, Santiago; La Touche, Roy

    2014-01-01

    [Purpose] The aim of this study was to determine the inter-rater and intra-rater reliability of the mandibular range of motion (ROM) considering the neutral craniocervical position when performing the measurements. [Subjects and Methods] The sample consisted of 50 asymptomatic subjects. Two raters measured four mandibular ROMs (maximal mouth opening (MMO), laterals, and protrusion) using the craniomandibular scale. Subjects alternated between raters, receiving two complete trials per day, two days apart. Intra- and inter-rater reliability was determined using intra-class correlation coefficients (ICCs). Bland-Altman analysis was used to assess reliability, bias, and variability. Finally, the standard error of measurement (SEM) and minimal detectable change (MDC) were analyzed to measure responsiveness. [Results] Reliability was good for MMO (inter-rater, ICC= 0.95−0.96; intra-rater, ICC= 0.95−0.96) and for protrusion (inter-rater, ICC= 0.92−0.94; intra-rater, ICC= 0.93−0.96). Reliability was moderate for lateral excursions. The MMO and protrusion SEM ranged from 0.74 to 0.82 mm and from 0.29 to 0.49 mm, while the MDCs ranged from 1.73 to 1.91 mm and from 0.69 to 0.14 mm respectively. The analysis showed no random or systematic error, suggesting that effect learning did not affect reliability. [Conclusion] A standardized protocol for assessment of mandibular ROM in a neutral craniocervical position obtained good inter- and intra-rater reliability for MMO and protrusion and moderate inter- and intra-rater reliability for lateral excursions. PMID:25013296

  15. Content validity and inter-rater reliability of the Halliwick-concept-based instrument 'Swimming with Independent Measure'.

    PubMed

    Sršen, Katja Groleger; Vidmar, Gaj; Pikl, Maša; Vrečar, Irena; Burja, Cirila; Krušec, Klavdija

    2012-06-01

    The Halliwick concept is widely used in different settings to promote joyful movement in water and swimming. To assess the swimming skills and progression of an individual swimmer, a valid and reliable measure should be used. The Halliwick-concept-based Swimming with Independent Measure (SWIM) was introduced for this purpose. We aimed to determine its content validity and inter-rater reliability. Fifty-four healthy children, 3.5-11 years old, from a mainstream swimming program participated in a content validity study. They were evaluated with SWIM and the national evaluation system of swimming abilities (classifying children into seven categories). To study the inter-rater reliability of SWIM, we included 37 children and youth from a Halliwick swimming program, aged 7-22 years, who were evaluated by two Halliwick instructors independently. The average SWIM score differed between national evaluation system categories and followed the expected order (P<0.001), whereby a ceiling effect was observed in the higher categories. High inter-rater reliability was found for all 11 SWIM items. The lowest reliability was observed for item G (sagittal rotation), although the estimates were still above 0.9. As expected, the highest reliability was observed for the total score (intraclass correlation 0.996). The validity of SWIM with respect to the national evaluation system of swimming abilities is high until the point where a swimmer is well adapted to water and already able to learn some swimming techniques. The inter-rater reliability of SWIM is very high; thus, we believe that SWIM can be used in further research and practice to follow the progress of swimmers.

  16. The Development and Inter-Rater Reliability of the Department of Defense Human Factors Analysis and Classification System, Version 7.0

    DTIC Science & Technology

    2015-04-09

    of improving inter-rater reliability while retaining the value of the tool. Additional requirements included preserving compatibility with existing... databases and having inter-operability across the services. The steps involved included determining which “nanocodes” were rarely or never used and...goal of improving inter-rater reliability while retaining the value of the tool. Additional requirements included preserving compatibility with

  17. The Inter-rater Reliability of the Functional Movement Screen Within an Athletic Population Using Untrained Raters.

    PubMed

    Leeder, Jade E; Horsley, Ian G; Herrington, Lee C

    2016-09-01

    Elias JE. The inter-rater reliability of the functional movement screen within an athletic population using untrained raters. J Strength Cond Res 30(9): 2591-2599, 2016-The functional movement screen (FMS) is a commonly used screening tool designed to identify restrictions to movement patterns and increased injury risk using 7 predesigned tests. The purpose of this study was to analyze the inter-rater reliability of scoring of the FMS using a group of "untrained" subjects. Additionally, the study also examined if clinical experience level had any effect on reliability. Twenty fully qualified Physiotherapists working at the English Institute of Sport, with elite athletes, volunteered to participate in the study. The group comprised both level 2 and level 3 physiotherapists based on clinical experience levels. Five elite athletes, free from injury, were recruited and videoed completing 6 of the 7 FMS tests using a 3 camera system. The videos were scored by each Physiotherapist using the standardized scoring sheet, as developed by Cook et al. Each practitioner marked each athlete completing the 6 tests. The total scores were calculated for each athlete (maximum score of 18). The inter-rater reliability of the test was shown to be high, intraclass coefficient 0.906. An independent t test showed no significant differences between the level 2 and level 3 practitioners in the total scores (p = 0.502). The results of the test indicate that the FMS is a reliable screening tool when used by untrained practitioners in determining faulty movement patterns and that clinical experience level does not affect the reliability, therefore it may be a useful tool in the screening of athletic populations.

  18. The Intra- and Inter-rater Reliabilities of the Forward Head Posture Assessment of Normal Healthy Subjects

    PubMed Central

    Nam, Seok Hyun; Son, Sung Min; Kwon, Jung Won; Lee, Na Kyung

    2013-01-01

    [Purpose] Assessment of posture is an important goal of physical therapy interventions for preventing the progression of forward head posture (FHP). The purpose of this study was to determine the inter- and intra-rater reliabilities of the assessment of FHP. [Subjects and Methods] We recruited 45 participants (20 male subjects, 25 female subjects) from a university student population. Two physical therapists assessed FHP using images of head extension. FHP is characterized by the measurement of angles and distances between anatomical landmarks. Forward shoulder angle of 54° or less was defined as FHP. Intra- and inter-rater reliabilities were estimated using Kendall’s Taub correlation coefficients. [Results] Intra-class correlation of intra-rater measurements indicated an excellent level of reliability (0.91), and intra-class correlation of inter-rater measurements showed a good level of reliability in the assessment of FHP (0.75). [Conclusion] Assessment of FHP is an important component of evaluation and affects the design of the treatment regimen. The assessment of FHP was reliably measured by two physical therapists. It could therefore become a useful method for assessing FHP in the clinical setting. Future studies will be needed to provide more detailed quantitative data for accurate assessment of posture. PMID:24259842

  19. The Intra- and Inter-rater Reliabilities of the Forward Head Posture Assessment of Normal Healthy Subjects.

    PubMed

    Nam, Seok Hyun; Son, Sung Min; Kwon, Jung Won; Lee, Na Kyung

    2013-06-01

    [Purpose] Assessment of posture is an important goal of physical therapy interventions for preventing the progression of forward head posture (FHP). The purpose of this study was to determine the inter- and intra-rater reliabilities of the assessment of FHP. [Subjects and Methods] We recruited 45 participants (20 male subjects, 25 female subjects) from a university student population. Two physical therapists assessed FHP using images of head extension. FHP is characterized by the measurement of angles and distances between anatomical landmarks. Forward shoulder angle of 54° or less was defined as FHP. Intra- and inter-rater reliabilities were estimated using Kendall's Taub correlation coefficients. [Results] Intra-class correlation of intra-rater measurements indicated an excellent level of reliability (0.91), and intra-class correlation of inter-rater measurements showed a good level of reliability in the assessment of FHP (0.75). [Conclusion] Assessment of FHP is an important component of evaluation and affects the design of the treatment regimen. The assessment of FHP was reliably measured by two physical therapists. It could therefore become a useful method for assessing FHP in the clinical setting. Future studies will be needed to provide more detailed quantitative data for accurate assessment of posture.

  20. Increasing the Reliability of the Grading System for Voiding Cystourethrograms Using Ultrasonography: An Inter-Rater Comparison

    PubMed Central

    Ozaydin, Seyithan; Celebi, Suleyman; Caymaz, Ismail; Besik, Cemile; Karaaslan, Birgul; Kuzdan, Ozgur; Sander, Serdar

    2016-01-01

    Background To assess the effectiveness of the current vesicoureteral reflux (VUR) grading system according to the international classification of VUR (ICVUR) and to evaluate whether VUR grading accuracy could be improved by renal ultrasonography (RU) according to the Society for Fetal Urology (SFU) grading system. Objectives Therefore, this study assessed the accuracy of the current VCUG staging system by assessing inter-rater reliability among pediatric radiologists and urologists; it also evaluated whether accuracy is increased by RU without consensus (with respect to VCUG grading). Methods Four pediatric urologists and four pediatric radiologists independently graded 120 voiding cystourethrograms (VCUGs). Middle VUR grades were divided into the following three groups: VUR consensus grade III (group 1), VUR consensus grade IV (group 3), and VUR non-consensus grades III and IV (group 2). All groups were compared with respect to hydronephrosis grade using RU. Results The intraclass correlation coefficient (ICC) values ranging from 0.86 to 0.89 reflected good reliability. The lowest agreement was associated with middle grades (III and IV). A marked difference in sensitivity was observed between groups 1 and 3 (35% and 95%, respectively, P < 0.05), indexed by SFU hydronephrosis grade, suggesting that VCUG cases in group 2 (n = 16 at SFU 0 or 1) could be accepted as grade III, and SFU scores of 2, 3, or 4 could be considered grade IV. Conclusions Inter-rater accuracy could be improved at middle grades using renal ultrasonography (USG), which could promote communication between different specialists. PMID:27878111

  1. The intra- and inter-rater reliability of five clinical muscle performance tests in patients with and without neck pain

    PubMed Central

    2013-01-01

    Background This study investigates the reliability of muscle performance tests using cost- and time-effective methods similar to those used in clinical practice. When conducting reliability studies, great effort goes into standardising test procedures to facilitate a stable outcome. Therefore, several test trials are often performed. However, when muscle performance tests are applied in the clinical setting, clinicians often only conduct a muscle performance test once as repeated testing may produce fatigue and pain, thus variation in test results. We aimed to investigate whether cervical muscle performance tests, which have shown promising psychometric properties, would remain reliable when examined under conditions similar to those of daily clinical practice. Methods The intra-rater (between-day) and inter-rater (within-day) reliability was assessed for five cervical muscle performance tests in patients with (n = 33) and without neck pain (n = 30). The five tests were joint position error, the cranio-cervical flexion test, the neck flexor muscle endurance test performed in supine and in a 45°-upright position and a new neck extensor test. Results Intra-rater reliability ranged from moderate to almost perfect agreement for joint position error (ICC ≥ 0.48-0.82), the cranio-cervical flexion test (ICC ≥ 0.69), the neck flexor muscle endurance test performed in supine (ICC ≥ 0.68) and in a 45°-upright position (ICC ≥ 0.41) with the exception of a new test (neck extensor test), which ranged from slight to moderate agreement (ICC = 0.14-0.41). Likewise, inter-rater reliability ranged from moderate to almost perfect agreement for joint position error (ICC ≥ 0.51-0.75), the cranio-cervical flexion test (ICC ≥ 0.85), the neck flexor muscle endurance test performed in supine (ICC ≥ 0.70) and in a 45°-upright position (ICC ≥ 0.56). However, only slight to fair agreement was found for the neck extensor test (ICC

  2. The Intra- and Inter-Rater Reliability of an Instrumented Spasticity Assessment in Children with Cerebral Palsy

    PubMed Central

    Schless, Simon-Henri; Desloovere, Kaat; Aertbeliën, Erwin; Molenaers, Guy; Huenaerts, Catherine; Bar-On, Lynn

    2015-01-01

    Aim Despite the impact of spasticity, there is a lack of objective, clinically reliable and valid tools for its assessment. This study aims to evaluate the reliability of various performance- and spasticity-related parameters collected with a manually controlled instrumented spasticity assessment in four lower limb muscles in children with cerebral palsy (CP). Method The lateral gastrocnemius, medial hamstrings, rectus femoris and hip adductors of 12 children with spastic CP (12.8 years, ±4.13 years, bilateral/unilateral involvement n=7/5) were passively stretched in the sagittal plane at incremental velocities. Muscle activity, joint motion, and torque were synchronously recorded using electromyography, inertial sensors, and a force/torque load-cell. Reliability was assessed on three levels: (1) intra- and (2) inter-rater within session, and (3) intra-rater between session. Results Parameters were found to be reliable in all three analyses, with 90% containing intra-class correlation coefficients >0.6, and 70% of standard error of measurement values <20% of the mean values. The most reliable analysis was intra-rater within session, followed by intra-rater between session, and then inter-rater within session. The Adds evaluation had a slightly lower level of reliability than that of the other muscles. Conclusions Limited intrinsic/extrinsic errors were introduced by repeated stretch repetitions. The parameters were more reliable when the same rater, rather than different raters performed the evaluation. Standardisation and training should be further improved to reduce extrinsic error when different raters perform the measurement. Errors were also muscle specific, or related to the measurement set-up. They need to be accounted for, in particular when assessing pre-post interventions or longitudinal follow-up. The parameters of the instrumented spasticity assessment demonstrate a wide range of applications for both research and clinical environments in the

  3. Emotional and Behavioral Screener: Test-Retest Reliability, Inter-Rater Reliability, and Convergent Validity

    ERIC Educational Resources Information Center

    Nordness, Philip D.; Epstein, Michael H.; Cullinan, Douglas; Pierce, Corey D.

    2014-01-01

    The Emotional and Behavioral Screener (EBS) is a universal screening instrument designed to identify students whose excessive problem behaviors put them at risk of the education disability category of emotional disturbance (ED). This article reports findings from three studies that address the reliability and validity of the EBS. Studies 1 and 2…

  4. Intra- and inter-rater reliability of maximum inspiratory pressure measured using a portable capsule-sensing pressure gauge device in healthy adults

    PubMed Central

    Jalan, Nikita S; Daftari, Sonam S; Retharekar, Seemi S; Rairikar, Savita A; Shyam, Ashok M; Sancheti, Parag K

    2015-01-01

    BACKGROUND: Measurement of maximum inspiratory pressure is the most prevalent method used in clinical practice to assess the strength of the inspiratory muscles. Although there are many devices available for the assessment of inspiratory muscle strength, there is a dearth of literature describing the reliability of devices that can be used in clinical patient assessment. The capsule-sensing pressure gauge (CSPG-V) is a new tool that measures the strength of inspiratory muscles; it is easy to use, noninvasive, inexpensive and lightweight. OBJECTIVE: To test the intra- and inter-rater reliability of a CSPG-V device in healthy adults. METHODS: A cross-sectional study involving 80 adult subjects with a mean (± SD) age of 22±3 years was performed. Using simple randomization, 40 individuals (20 male, 20 female) were used for intrarater and 40 (20 male, 20 female) were used for inter-rater reliability testing of the CSPG-V device. The subjects performed three inspiratory efforts, which were sustained for at least 3 s; the best of the three readings was used for intra- and inter-rater comparison. The intra- and inter-rater reliability were calculated using intraclass correlation coefficients (ICCs). RESULTS: The intrarater reliability ICC was 0.962 and the inter-rater reliability ICC was 0.922. CONCLUSION: Results of the present study suggest that maximum inspiratory pressure measured using a CSPG-V device has excellent intraand inter-rater reliability, and can be used as a diagnostic and prognostic tool in patients with respiratory muscle impairment. PMID:26089737

  5. Test-re-test reliability and inter-rater reliability of a digital pelvic inclinometer in young, healthy males and females.

    PubMed

    Beardsley, Chris; Egerton, Tim; Skinner, Brendon

    2016-01-01

    Objective. The purpose of this study was to investigate the reliability of a digital pelvic inclinometer (DPI) for measuring sagittal plane pelvic tilt in 18 young, healthy males and females. Method. The inter-rater reliability and test-re-test reliabilities of the DPI for measuring pelvic tilt in standing on both the right and left sides of the pelvis were measured by two raters carrying out two rating sessions of the same subjects, three weeks apart. Results. For measuring pelvic tilt, inter-rater reliability was designated as good on both sides (ICC = 0.81-0.88), test-re-test reliability within a single rating session was designated as good on both sides (ICC = 0.88-0.95), and test-re-test reliability between two rating sessions was designated as moderate on the left side (ICC = 0.65) and good on the right side (ICC = 0.85). Conclusion. Inter-rater reliability and test-re-test reliability within a single rating session of the DPI in measuring pelvic tilt were both good, while test-re-test reliability between rating sessions was moderate-to-good. Caution is required regarding the interpretation of the test-re-test reliability within a single rating session, as the raters were not blinded. Further research is required to establish validity.

  6. Inter-rater reliability of surgical reviews for AREN03B2: A COG renal tumor committee study✩

    PubMed Central

    Hamilton, Thomas E.; Barnhart, Douglas; Gow, Kenneth; Ferrer, Fernando; Kandel, Jessica; Glick, Richard; Dasgupta, Roshni; Naranjo, Arlene; He, Ying; Gratias, Eric; Geller, James; Mullen, Elizabeth; Ehrlich, Peter

    2014-01-01

    Purpose The Children's Oncology Group (COG) renal tumor study (AREN03B2) requires real-time central review of radiology, pathology, and the surgical procedure to determine appropriate risk-based therapy. The purpose of this study was to determine the inter-rater reliability of the surgical reviews. Methods Of the first 3200 enrolled AREN03B2 patients, a sample of 100 enriched for blood vessel involvement, spill, rupture, and lymph node involvement was selected for analysis. The surgical assessment was then performed independently by two blinded surgical reviewers and compared to the original assessment, which had been completed by another of the committee surgeons. Variables assessed included surgeon-determined local tumor stage, overall disease stage, type of renal procedure performed, presence of tumor rupture, occurrence of intraoperative tumor spill, blood vessel involvement, presence of peritoneal implants, and interpretation of residual disease. Inter-rater reliability was measured using the Fleiss' Kappa statistic two-sided hypothesis tests (Kappa, p-value). Results Local tumor stage correlated in all 3 reviews except in one case (Kappa = 0.9775, p < 0.001). Similarly, overall disease stage had excellent correlation (0.9422, p < 0.001). There was strong correlation for type of renal procedure (0.8357, p < 0.001), presence of tumor rupture (0.6858, p < 0.001), intraoperative tumor spill (0.6493, p < 0.001), and blood vessel involvement (0.6470, p < 0.001). Variables that had lower correlation were determination of the presence of peritoneal implants (0.2753, p < 0.001) and interpretation of residual disease status (0.5310, p < 0.001). Conclusion The inter-rater reliability of the surgical review is high based on the great consistency in the 3 independent review results. This analysis provides validation and establishes precedent for real-time central surgical review to determine treatment assignment in a risk-based stratagem for multimodal cancer therapy

  7. Inter-rater reliability of manual and automated region-of-interest delineation for PiB PET.

    PubMed

    Rosario, Bedda L; Weissfeld, Lisa A; Laymon, Charles M; Mathis, Chester A; Klunk, William E; Berginc, Michael D; James, Jeffrey A; Hoge, Jessica A; Price, Julie C

    2011-04-01

    A major challenge in positron emission tomography (PET) amyloid imaging studies of Alzheimer's disease (AD) is the reliable detection of early amyloid deposition in human brain. Manual region-of-interest (ROI) delineation on structural magnetic resonance (MR) images is generally the reference standard for the extraction of count-rate data from PET images, as compared to automated MR-template(s) methods that utilize spatial normalization and a single set of ROIs. The goal of this work was to assess the inter-rater reliability of manual ROI delineation for PiB PET amyloid retention measures and the impact of CSF dilution correction (CSF) on this reliability for data acquired in elderly control (n=5) and AD (n=5) subjects. The intraclass correlation coefficient (ICC) was used to measure reliability. As a secondary goal, ICC scores were also computed for PiB outcome measures obtained by an automated MR-template ROI method and one manual rater; to assess the level of reliability that could be achieved using different processing methods. Fourteen ROIs were evaluated that included anterior cingulate (ACG), precuneus (PRC) and cerebellum (CER). The PiB outcome measures were the volume of distribution (V(T)), summed tissue uptake (SUV), and corresponding ratios that were computed using CER as reference (DVR and SUVR). Substantial reliability (ICC≥0.932) was obtained across 3 manual raters for V(T) and SUV measures when CSF correction was applied across all outcomes and regions and was similar in the absence of CSF correction. The secondary analysis revealed substantial reliability in primary cortical areas between the automated and manual SUV [ICC≥0.979 (ACG/PRC)] and SUVR [ICC≥0.977/0.952 (ACG/PRC)] outcomes. The current study indicates the following rank order among the various reliability results in primary cortical areas and cerebellum (high to low): 1) V(T) or SUV manual delineation, with or without CSF correction; 2) DVR or SUVR manual delineation, with or

  8. The impact of revised DSM-5 criteria on the relative distribution and inter-rater reliability of eating disorder diagnoses in a residential treatment setting.

    PubMed

    Thomas, Jennifer J; Eddy, Kamryn T; Murray, Helen B; Tromp, Marilou D P; Hartmann, Andrea S; Stone, Melissa T; Levendusky, Philip G; Becker, Anne E

    2015-09-30

    This study evaluated the relative distribution and inter-rater reliability of revised DSM-5 criteria for eating disorders in a residential treatment program. Consecutive adolescent and young adult females (N=150) admitted to a residential eating disorder treatment facility were assigned both DSM-IV and DSM-5 diagnoses by a clinician (n=14) via routine clinical interview and a research assessor (n=4) via structured interview. We compared the frequency of diagnostic assignments under each taxonomy and by type of assessor. We evaluated concordance between clinician and researcher assignment through inter-rater reliability kappa and percent agreement. Significantly fewer patients received either clinician or researcher diagnoses of a residual eating disorder under DSM-5 (clinician-12.0%; researcher-31.3%) versus DSM-IV (clinician-28.7%; researcher-59.3%), with the majority of reassigned DSM-IV residual cases reclassified as DSM-5 anorexia nervosa. Researcher and clinician diagnoses showed moderate inter-rater reliability under DSM-IV (κ=.48) and DSM-5 (κ=.57), though agreement for specific DSM-5 other specified feeding or eating disorder (OSFED) presentations was poor (κ=.05). DSM-5 revisions were associated with significantly less frequent residual eating disorder diagnoses, but not with reduced inter-rater reliability. Findings support specific dimensions of clinical utility for revised DSM-5 criteria for eating disorders.

  9. Inter-Rater Reliability and Concurrent Validity of the Goodenough-Harris and McCarthy Draw-A-Child Scoring Systems.

    ERIC Educational Resources Information Center

    Naglieri, Jack A.; Maxwell, Susanna

    1981-01-01

    Inter-rater reliability of the Goodenough-Harris and McCarthy Draw-A-Child scoring systems was examined for a sample of 60 children, including 20 school-labeled learning disabled, 20 mentally retarded, and 20 normal children between the ages of six and eight-and-one-half years. (Author)

  10. Inter-rater reliability of cyclic and non-cyclic task assessment using the hand activity level in appliance manufacturing

    PubMed Central

    Paulsen, Robert; Schwatka, Natalie; Gober, Jennifer; Gilkey, David; Anton, Dan; Gerr, Fred; Rosecrance, John

    2015-01-01

    This study evaluated the inter-rater reliability of the American Conference of Governmental Industrial Hygienists (ACGIH®) hand activity level (HAL), an observational ergonomic assessment method used to estimate physical exposure to repetitive exertions during task performance. Video recordings of 858 cyclic and non-cyclic appliance manufacturing tasks were assessed by sixteen pairs of raters using the HAL visual-analog scale. A weighted Pearson Product Moment-Correlation Coefficient was used to evaluate the agreement between the HAL scores recorded by each rater pair, and the mean weighted correlation coefficients for cyclic and non-cyclic tasks were calculated. Results indicated that the HAL is a reliable exposure assessment method for cyclic (r̄-barw = 0.69) and non-cyclic work tasks (r̄-barw = 0.68). When the two reliability scores were compared using a two-sample Student's t-test, no significant difference in reliability (p = 0.63) between these work task categories was found. This study demonstrated that the HAL may be a useful measure of exposure to repetitive exertions during cyclic and non-cyclic tasks. Relevance to industry Exposure to hazardous levels of repetitive action during non-cyclic task completion has traditionally been difficult to assess using simple observational techniques. The present study suggests that ergonomists could use the HAL to reliably and easily evaluate exposures associated with some non-cyclic work tasks. PMID:26120222

  11. Inter-rater reliability of cyclic and non-cyclic task assessment using the hand activity level in appliance manufacturing.

    PubMed

    Paulsen, Robert; Schwatka, Natalie; Gober, Jennifer; Gilkey, David; Anton, Dan; Gerr, Fred; Rosecrance, John

    2014-01-01

    This study evaluated the inter-rater reliability of the American Conference of Governmental Industrial Hygienists (ACGIH(®)) hand activity level (HAL), an observational ergonomic assessment method used to estimate physical exposure to repetitive exertions during task performance. Video recordings of 858 cyclic and non-cyclic appliance manufacturing tasks were assessed by sixteen pairs of raters using the HAL visual-analog scale. A weighted Pearson Product Moment-Correlation Coefficient was used to evaluate the agreement between the HAL scores recorded by each rater pair, and the mean weighted correlation coefficients for cyclic and non-cyclic tasks were calculated. Results indicated that the HAL is a reliable exposure assessment method for cyclic (r̄-bar w = 0.69) and non-cyclic work tasks (r̄-bar w = 0.68). When the two reliability scores were compared using a two-sample Student's t-test, no significant difference in reliability (p = 0.63) between these work task categories was found. This study demonstrated that the HAL may be a useful measure of exposure to repetitive exertions during cyclic and non-cyclic tasks.

  12. The inter-rater reliability of the diagnosis of surgical site infection in the context of a clinical trial

    PubMed Central

    Nuttall, J.; Evaniew, N.; Thornley, P.; Griffin, A.; Deheshi, B.; O’Shea, T.; Wunder, J.; Ferguson, P.; Randall, R. L.; Turcotte, R.; Schneider, P.; McKay, P.; Bhandari, M.

    2016-01-01

    , A. Griffin, B. Deheshi, T. O’Shea, J. Wunder, P. Ferguson, R. L. Randall, R. Turcotte, P. Schneider, P. McKay, M. Bhandari, M. Ghert. The inter-rater reliability of the diagnosis of surgical site infection in the context of a clinical trial. Bone Joint Res 2016;5:347–352. DOI: 10.1302/2046-3758.58.BJR-2016-0036.R1. PMID:27528711

  13. Inter-rater reliability for movement pattern analysis (MPA): measuring patterning of behaviors versus discrete behavior counts as indicators of decision-making style

    PubMed Central

    Connors, Brenda L.; Rende, Richard; Colton, Timothy J.

    2014-01-01

    The unique yield of collecting observational data on human movement has received increasing attention in a number of domains, including the study of decision-making style. As such, interest has grown in the nuances of core methodological issues, including the best ways of assessing inter-rater reliability. In this paper we focus on one key topic – the distinction between establishing reliability for the patterning of behaviors as opposed to the computation of raw counts – and suggest that reliability for each be compared empirically rather than determined a priori. We illustrate by assessing inter-rater reliability for key outcome measures derived from movement pattern analysis (MPA), an observational methodology that records body movements as indicators of decision-making style with demonstrated predictive validity. While reliability ranged from moderate to good for raw counts of behaviors reflecting each of two Overall Factors generated within MPA (Assertion and Perspective), inter-rater reliability for patterning (proportional indicators of each factor) was significantly higher and excellent (ICC = 0.89). Furthermore, patterning, as compared to raw counts, provided better prediction of observable decision-making process assessed in the laboratory. These analyses support the utility of using an empirical approach to inform the consideration of measuring patterning versus discrete behavioral counts of behaviors when determining inter-rater reliability of observable behavior. They also speak to the substantial reliability that may be achieved via application of theoretically grounded observational systems such as MPA that reveal thinking and action motivations via visible movement patterns. PMID:24999336

  14. Inter-rater and Intra-rater Reliability of the Occupational Therapy Diagnosis.

    ERIC Educational Resources Information Center

    Driessen, Marie-Jose; And Others

    1995-01-01

    Two occupational therapists in an interrater test and 9 in an intrarater test used a form based on the International Classification of Impairments, Disabilities, and Handicaps to evaluate 50 patients in a psychiatric hospital and 50 in a rehabilitation center. Based on percentage of agreement and Cohen's kappa, the reliability of the diagnoses was…

  15. Inter-rater Reliability of the Wolf Motor Function Test-Functional Ability Scale: Why it Matters

    PubMed Central

    Duff, Susan V.; He, Jiaxiu; Nelsen, Monica A.; Lane, Christianne J.; Rowe, Veronica T.; Wolf, Steven L.; Dromerick, Alexander W.; Winstein, Carolee J.

    2014-01-01

    Background One important objective for clinical trialists in rehabilitation is determining efficacy of interventions to enhance motor behavior. In part, limitation in the precision of measurement presents a challenge. The few valid, low-cost observational tools available to assess motor behavior cannot escape the variability inherent in test administration and scoring. This is especially true when there are multiple evaluators and raters as in the case of multi-site randomized controlled trials (RCT). One way to enhance reliability and reduce variability is to implement rigorous quality control (QC) procedures. Objective This paper describes a systematic QC process used to refine the administration and scoring procedures for the Wolf Motor Function Test (WMFT)-Functional Ability Scale (FAS). Methods The QC process, a systematic focus-group collaboration was developed and used for a phase III RCT, which enlisted multiple evaluators and an experienced WMFT-FAS Rater Panel. Results After three staged refinements to the administration and scoring instructions, we achieved a sufficiently high inter-rater reliability (weighted kappa = 0.8). Conclusions/Implications A systematic focus-group process was shown to be an effective method to improve reliability of observational assessment tools for motor behavior in neurorehabilitation. A reduction in noise-related variability in performance assessments will increase power and potentially lower the number needed to treat. Improved precision of measurement can lead to more cost effective and efficient clinical trials. Finally, we suggest that improved precision in measures of motor behavior may provide more insight into recovery mechanisms than a single measure of movement time alone. PMID:25323459

  16. Intra- and inter-rater reliability of isometric shoulder extensor and internal rotator strength measurements performed using a hand-held dynamometer.

    PubMed

    Awatani, Takenori; Morikita, Ikuhiro; Shinohara, Junji; Mori, Seigo; Nariai, Miki; Tatsumi, Yasutaka; Nagata, Akinori; Koshiba, Hiroya

    2016-11-01

    [Purpose] The purpose of the present study was to establish the intra- and inter-rater reliability of measurement of extensor strength in the maximum shoulder abducted position and internal rotator strength in the 90° abducted and the 90° external rotated position using a hand-held dynamometer. [Subjects and Methods] Twelve healthy volunteers (12 male; mean ± SD: age 19.0 ± 1.1 years) participated in the study. The examiners were two students who had nonclinical experience with a hand-held dynamometer measurement. The examiners and participants were blinded to measurement results by the recorder. Participants in the prone position were instructed to hold the contraction against the ground reaction force, and peak isometric force was recorded using the hand-held dynamometer on the floor. Reliability was determined using intraclass correlation coefficients. [Results] The intra- and inter-rater reliability data were found to be "almost perfect". [Conclusion] This study investigated intra- and inter-rater reliability and reveald high reliability. Thus, the measurement method used in the present study can evaluate muscle strength by a simple measurement technique.

  17. Daily life dialogue assessment in psychiatric care-face validity and inter-rater reliability of a tool based on the International Classification of Functioning, Disability and Health.

    PubMed

    Johansson, Catrin; Åström, Sture; Kauffeldt, Anders; Carlström, Eric

    2013-12-01

    This article describes the development of an assessment tool based on the International Classification of Functioning Disability and Health (ICF) adapted to a psychiatric nursing context where both the patient and the nurse assess the patient's ability to participate in various spheres of life. The aim was to test psychometric properties, focusing on face validity and inter-rater reliability. Three Swedish expert groups participated. Analysis of inter-rater reliability was conducted through simulated patient cases. The results of an unweighted kappa value of 0.38, a linear weighted kappa value of 0.65 and a quadratic weighted kappa value of 0.73 were considered as acceptable when using simulated patient cases.

  18. The Outdoor MEDIA DOT: The Development and Inter-Rater Reliability of a Tool Designed to Measure Food and Beverage Outlets and Outdoor Advertising

    PubMed Central

    Poulos, Natalie S.; Pasch, Keryn E.

    2015-01-01

    Few studies of the food environment have collected primary data, and even fewer have reported reliability of the tool used. This study focused on the development of an innovative electronic data collection tool used to document outdoor food and beverage (FB) advertising and establishments near 43 middle and high schools in the Outdoor MEDIA Study. Tool development used GIS based mapping, an electronic data collection form on handheld devices, and an easily adaptable interface to efficiently collect primary data within the food environment. For the reliability study, two teams of data collectors documented all FB advertising and establishments within one half-mile of six middle schools. Inter-rater reliability was calculated overall and by advertisement or establishment category using percent agreement. A total of 824 advertisements (n=233), establishment advertisements (n=499), and establishments (n=92) were documented (range=8–229 per school). Overall inter-rater reliability of the developed tool ranged from 69–89% for advertisements and establishments. Results suggest that the developed tool is highly reliable and effective for documenting the outdoor FB environment. PMID:26022774

  19. The Outdoor MEDIA DOT: The development and inter-rater reliability of a tool designed to measure food and beverage outlets and outdoor advertising.

    PubMed

    Poulos, Natalie S; Pasch, Keryn E

    2015-07-01

    Few studies of the food environment have collected primary data, and even fewer have reported reliability of the tool used. This study focused on the development of an innovative electronic data collection tool used to document outdoor food and beverage (FB) advertising and establishments near 43 middle and high schools in the Outdoor MEDIA Study. Tool development used GIS based mapping, an electronic data collection form on handheld devices, and an easily adaptable interface to efficiently collect primary data within the food environment. For the reliability study, two teams of data collectors documented all FB advertising and establishments within one half-mile of six middle schools. Inter-rater reliability was calculated overall and by advertisement or establishment category using percent agreement. A total of 824 advertisements (n=233), establishment advertisements (n=499), and establishments (n=92) were documented (range=8-229 per school). Overall inter-rater reliability of the developed tool ranged from 69-89% for advertisements and establishments. Results suggest that the developed tool is highly reliable and effective for documenting the outdoor FB environment.

  20. The intra- and inter-rater reliabilities of lower extremity muscle strength assessment of healthy adults using a hand held dynamometer.

    PubMed

    Kim, Seong-Gil; Lee, Yun-Seob

    2015-06-01

    [Purpose] The purpose of this study was to examine the intra- and inter-rater reliabilities of lower extremity muscle strength assessment of healthy adults using hand held dynamometer. [Subjects and Methods] A total of 55 students (19 males and 36 females) in Y University in Gyeongsangnam-do, South Korea participated in this study. Lower extremity muscle strength was measured using a hand-held dynamometer (Commander Muscle Tester, JTech, USA). Flexion and extension strengths of the hip joint, the knee joint, and the ankle joint were measured. [Results] The intra-rater reliabilities were excellent (above 0.9) for the flexion and extension strengths of the ankle, knee, and hip joints. The inter-rater reliabilities were also excellent (above 0.8) for the flexion and extension strengths of the ankle, knee, and hip joint. [Conclusion] Lower extremity muscle strength assessment using a hand-held dynamometer provided consistent results when conducted by different examiners and when measured several times. Therefore, this method is a useful way of deriving objective and quantitative measurement values.

  1. The Scarbase Duo(®): Intra-rater and inter-rater reliability and validity of a compact dual scar assessment tool.

    PubMed

    Fell, Matthew; Meirte, Jill; Anthonissen, Mieke; Maertens, Koen; Pleat, Jonathon; Moortgat, Peter

    2016-03-01

    Objective scar assessment tools were designed to help identify problematic scars and direct clinical management. Their use has been restricted by their measurement of a single scar property and the bulky size of equipment. The Scarbase Duo(®) was designed to assess both trans-epidermal water loss (TEWL) and colour of a burn scar whilst being compact and easy to use. Twenty patients with a burn scar were recruited and measurements taken using the Scarbase Duo(®) by two observers. The Scarbase Duo(®) measures TEWL via an open-chamber system and undertakes colorimetry via narrow-band spectrophotometry, producing values for relative erythema and melanin pigmentation. Validity was assessed by comparing the Scarbase Duo(®) against the Dermalab(®) and the Minolta Chromameter(®) respectively for TEWL and colorimetry measurements. The intra-class correlation coefficient (ICC) was used to assess reliability with standard error of measurement (SEM) used to assess reproducibility of measurements. The Pearson correlation coefficient (r) was used to assess the convergent validity. The Scarbase Duo(®) TEWL mode had excellent reliability when used on scars for both intra- (ICC=0.95) and inter-rater (ICC=0.96) measurements with moderate SEM values. The erythema component of the colorimetry mode showed good reliability for use on scars for both intra-(ICC=0.81) and inter-rater (ICC=0.83) measurements with low SEM values. Pigmentation values showed excellent reliability on scar tissue for both intra- (ICC=0.97) and inter-rater (ICC=0.97) with moderate SEM values. The Scarbase Duo(®) TEWL function had excellent correlation with the Dermalab(®) (r=0.93) whilst the colorimetry erythema value had moderate correlation with the Minolta Chromameter (r=0.72). The Scarbase Duo(®) is a reliable and objective scar assessment tool, which is specifically designed for burn scars. However, for clinical use, standardised measurement conditions are recommended.

  2. Inter-rater reliability between nurses for a new paediatric triage system based primarily on vital parameters: the Paediatric Triage Instrument (PETI)

    PubMed Central

    Karjala, Jaana; Eriksson, Staffan

    2017-01-01

    Introduction The major paediatric triage systems are primarily based on flow charts involving signs and symptoms for orientation and subjective estimates of the patient's condition. In contrast, the 4-level Paediatric Triage Instrument (PETI) is primarily based on vital parameters and was developed exclusively for paediatric triage in patients with medical symptoms. The aim of this study was to assess the inter-rater reliability of this triage system in children when used by nurses. Methods A design was employed in which triage was performed simultaneously and independently by a research nurse and an emergency department (ED) nurse using the PETI. All patients aged ≤12 years who presented at the ED with a medical symptom were considered eligible for participation. Results The 89 participants exhibited a median age of 2 years and were triaged by 28 different nurses. The inter-rater reliability between nurses calculated with the quadratic-weighted κ was 0.78 (95% CI 0.67 to 0.89); the linear-weighted κ was 0.67 (95% CI 0.56 to 0.80) and the unweighted κ was 0.59 (95% CI 0.44 to 0.73). For the patients aged <1, 1–3 and >3 years, the quadratic-weighted κ values were 0.67 (95% CI 0.39 to 0.94), 0.86 (95% CI 0.75 to 0.97) and 0.73 (95% CI 0.49 to 0.97), respectively. The median triage duration was 6 min. Conclusions The PETI exhibited substantial reliability when used in children aged ≤12 years and almost perfect reliability among children aged 1–3 years. Moreover, rapid application of the PETI was demonstrated. This study has some limitations, including sample size and generalisability, but the PETI exhibited promise regarding reliability, and the next step could be either a larger reliability study or a validation study. PMID:28235966

  3. Inter-rater reliability of the PCL-R total and factor scores among psychopathic sex offenders: are personality features more prone to disagreement than behavioral features?

    PubMed

    Edens, John F; Boccaccini, Marcus T; Johnson, Darryl W

    2010-01-01

    Despite considerable support for the inter-rater reliability of the Hare Psychopathy Checklist--Revised (PCL-R; Hare, 1991, 2003) in research contexts, there is increasing concern that scores from this instrument may be considerably less stable across examiners in applied contexts, particularly when scoring is based on separate interviews. The present study examines archival data from a sample of imprisoned sex offenders (n = 20) who obtained relatively high PCL-R total scores (> or =25) and were administered this instrument on a second occasion by a different examiner. Intraclass correlations for the total and Factor 2 score were lower than those generally reported in research studies. Of greater concern, Factor 1 scores were only negligibly related to each other (ICC(A,1) = .16). Correcting for potential range restriction among these high scoring individuals resulted in total and Factor 2 score measures of agreement that were somewhat more consistent with published research, but Factor 1 continued to display exceedingly poor agreement across examiners.

  4. Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers.

    PubMed

    Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

    2015-01-01

    The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82-0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers' muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload.

  5. Content Validity Index and Intra- and Inter-Rater Reliability of a New Muscle Strength/Endurance Test Battery for Swedish Soldiers

    PubMed Central

    Larsson, Helena; Tegern, Matthias; Monnier, Andreas; Skoglund, Jörgen; Helander, Charlotte; Persson, Emelie; Malm, Christer; Broman, Lisbet; Aasa, Ulrika

    2015-01-01

    The objective of this study was to examine the content validity of commonly used muscle performance tests in military personnel and to investigate the reliability of a proposed test battery. For the content validity investigation, thirty selected tests were those described in the literature and/or commonly used in the Nordic and North Atlantic Treaty Organization (NATO) countries. Nine selected experts rated, on a four-point Likert scale, the relevance of these tests in relation to five different work tasks: lifting, carrying equipment on the body or in the hands, climbing, and digging. Thereafter, a content validity index (CVI) was calculated for each work task. The result showed excellent CVI (≥0.78) for sixteen tests, which comprised of one or more of the military work tasks. Three of the tests; the functional lower-limb loading test (the Ranger test), dead-lift with kettlebells, and back extension, showed excellent content validity for four of the work tasks. For the development of a new muscle strength/endurance test battery, these three tests were further supplemented with two other tests, namely, the chins and side-bridge test. The inter-rater reliability was high (intraclass correlation coefficient, ICC2,1 0.99) for all five tests. The intra-rater reliability was good to high (ICC3,1 0.82–0.96) with an acceptable standard error of mean (SEM), except for the side-bridge test (SEM%>15). Thus, the final suggested test battery for a valid and reliable evaluation of soldiers’ muscle performance comprised the following four tests; the Ranger test, dead-lift with kettlebells, chins, and back extension test. The criterion-related validity of the test battery should be further evaluated for soldiers exposed to varying physical workload. PMID:26177030

  6. Content Validity and Inter-Rater Reliability of the Halliwick-Concept-Based Instrument "Swimming with Independent Measure"

    ERIC Educational Resources Information Center

    Srsen, Katja Groleger; Vidmar, Gaj; Pikl, Masa; Vrecar, Irena; Burja, Cirila; Krusec, Klavdija

    2012-01-01

    The Halliwick concept is widely used in different settings to promote joyful movement in water and swimming. To assess the swimming skills and progression of an individual swimmer, a valid and reliable measure should be used. The Halliwick-concept-based Swimming with Independent Measure (SWIM) was introduced for this purpose. We aimed to determine…

  7. The occurrence and inter-rater reliability of myofascial trigger points in the quadratus lumborum and gluteus medius: a prospective study in non-specific low back pain patients and controls in general practice.

    PubMed

    Njoo, K H; Van der Does, E

    1994-09-01

    The presence of a trigger point is essential to the myofascial pain syndrome. This study centres on identifying clearer criteria for the presence of trigger points in the quadratus lumborum and gluteus medius muscle by investigating the occurrence and inter-rater reliability of trigger point symptoms. Using the symptoms and signs as described by Simons' 1990 definition and two other former sets of criteria, 61 non-specific low back pain patients and 63 controls were examined in general practice by 5 observers, working in pairs. From the two major criteria of Simons' 1990 definition only 'localized tenderness' has good discriminative ability and inter-rater reliability (kappa > 0.5). This study does not find proof for the clinical usefulness of 'referred pain', which has neither of these two abilities. The criteria 'jump sign' and 'recognition', on the condition that localized tenderness is present, also have good discriminative ability and inter-rater reliability. Trigger points defined by the criteria found eligible in this study allow significant distinction between non-specific low back pain patients and controls. This is not the case with trigger points defined by Simons' 1990 criteria. Concerning reliability there is also a significant difference between the two different criteria sets. This study suggests that the clinical usefulness of trigger points is increased when localized tenderness and the presence of either jump sign or patient's recognition of his pain complaint are used as criteria for the presence of trigger points in the M. quadratus lumborum and the M. gluteus medius.

  8. Low inter-rater reliability in grading of rectal bleeding using NCI CTC and RTOG toxicity scales: a survey of radiation oncologists

    PubMed Central

    Huynh-Le, Minh-Phuong; Zhang, Zhe; Tran, Phuoc T.; DeWeese, Theodore L.; Song, Danny Y.

    2014-01-01

    Purpose/Objective(s) Rectal bleeding is one of the most common toxicities following prostate radiotherapy (RT), and both NCI CTC and RTOG grading scales are frequently used to report outcomes. We measured concordance among genitourinary radiation oncologists in using these scales to grade rectal bleeding. Methods and Materials From 6/2013–1/2014, a web-based survey was sent to 250 American and Canadian academic radiation oncologists who treat prostate cancer. Participants were provided 4 case vignettes where patients received RT and developed rectal bleeding and were asked for management plans and to rate the bleeding according to NCI CTC v.4 and RTOG late toxicity grading (scales provided). In 2 cases, participants were also asked if they would send the patient for colonoscopy. A multilevel, random intercept modeling approach was used to assess sources of variation (case, respondent) in toxicity grading to calculate the intraclass correlation coefficient (ICC). Agreement on a dichotomous grading scale (low grades 1–2 vs. high grades 3–4) was also assessed, using kappa statistic for multiple respondents. Results Seventy-two radiation oncologists (28%) completed the survey. Forty-seven (65%) reported having either written or been principal investigator on a study using these scales. Agreement between respondents was moderate (ICC=0.52, 95% CI 0.47–0.58) when using NCI CTC and fair using the RTOG scale (ICC=0.28, 95% CI 0.20–0.40). Respondents who chose an invasive management were more likely to select a higher toxicity grade (p<0.0001). Using the dichotomous scale, we observed moderate agreement (kappa=0.42, 95% CI 0.40–0.44) with the NCI CTC scale, but only slight agreement with the RTOG scale (kappa=0.19, 95% CI 0.17–0.21). Conclusion Low inter-rater reliability was observed among radiation oncologists grading rectal bleeding using two common scales. Clearer definitions of late rectal bleeding toxicity should be constructed to reduce this variability

  9. How to assess and compare inter-rater reliability, agreement and correlation of ratings: an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs

    PubMed Central

    Stolarova, Margarita; Wolf, Corinna; Rinker, Tanja; Brielmann, Aenne

    2014-01-01

    This report has two main purposes. First, we combine well-known analytical approaches to conduct a comprehensive assessment of agreement and correlation of rating-pairs and to dis-entangle these often confused concepts, providing a best-practice example on concrete data and a tutorial for future reference. Second, we explore whether a screening questionnaire developed for use with parents can be reliably employed with daycare teachers when assessing early expressive vocabulary. A total of 53 vocabulary rating pairs (34 parent–teacher and 19 mother–father pairs) collected for two-year-old children (12 bilingual) are evaluated. First, inter-rater reliability both within and across subgroups is assessed using the intra-class correlation coefficient (ICC). Next, based on this analysis of reliability and on the test-retest reliability of the employed tool, inter-rater agreement is analyzed, magnitude and direction of rating differences are considered. Finally, Pearson correlation coefficients of standardized vocabulary scores are calculated and compared across subgroups. The results underline the necessity to distinguish between reliability measures, agreement and correlation. They also demonstrate the impact of the employed reliability on agreement evaluations. This study provides evidence that parent–teacher ratings of children's early vocabulary can achieve agreement and correlation comparable to those of mother–father ratings on the assessed vocabulary scale. Bilingualism of the evaluated child decreased the likelihood of raters' agreement. We conclude that future reports of agreement, correlation and reliability of ratings will benefit from better definition of terms and stricter methodological approaches. The methodological tutorial provided here holds the potential to increase comparability across empirical reports and can help improve research practices and knowledge transfer to educational and therapeutic settings. PMID:24994985

  10. High intra- and inter-rater chance variation of the movement assessment battery for children 2, ageband 2.

    PubMed

    Holm, Inger; Tveter, Anne Therese; Aulie, Vibeke Smith; Stuge, Britt

    2013-02-01

    The aim of the present study was to evaluate the intra- and inter-tester reliability of the movement assessment battery for children-second edition (MABC-2), ageband 2. We wanted to analyze the collected data, with adequate statistical methods, to provide relevant recommendations for physical therapists who are interpreting changes in the context of daily clinical practice. Forty-five healthy children, 23 girls and 22 boys with a mean age of 8.7±0.7 years, participated in the study, the inter-tester procedures were performed the same day and the intra-tester procedures within a one to two week interval. The statistical methods used were intra-class correlation coefficient (ICC), standard error of measurement (SEM), and smallest detectable change (SDC). The children had no failed items during the tests. The ICC values ranged from 0.23 to 0.76. The items "treading lace" and "one-board balance" showed the highest measurement errors both for the intra- and inter-rater reliability. The SDC(90%) values were 9.7 and 18.5 for the intra- and inter-rater reliability, respectively. The present study showed high intra- and inter-rater chance variation MABC-2, ageband 2. A change of more than ±9.7 and ±18.5 on the total test score (TTS) should be required to state (with a 90% confidence) that a real change in a single individual has occurred, for intra- and inter-rater testing, respectively. These findings may indicate that the MABC-2 might be more suitable for diagnostic or clinical decision making purposes, than for evaluation of change over time.

  11. Internal Consistency and Inter-Rater Reliability of the Questions about Behavioral Function (QABF) Rating Scale When Used by Teachers and Paraprofessionals

    ERIC Educational Resources Information Center

    May, Michael E.; Sheng, Yanyan; Chitiyo, Morgan; Brandt, Rachel C.; Howe, Abigail P.

    2014-01-01

    There has been considerable emphasis on indirect functional behavior assessments in school settings. However, little research has evaluated the reliability of these methods to identify behavioral function. One indirect measure, the Questions About Behavioral Function (QABF) scale, has yet to be extensively studied in school settings, though…

  12. Another Look at Inter-Rater Agreement. Research Report.

    ERIC Educational Resources Information Center

    Zwick, Rebecca

    Most currently used measures of inter-rater agreement for the nominal case incorporate a correction for "chance agreement." The definition of chance agreement is not the same for all coefficients, however. Three chance-corrected coefficients are Cohen's Kappa; Scott's Pi; and the S index of Bennett, Goldstein, and Alpert, which has…

  13. Inter-rater agreement in evaluation of disability: systematic review of reproducibility studies

    PubMed Central

    Barth, Jürgen; de Boer, Wout E L; Busse, Jason W; Hoving, Jan L; Kedzia, Sarah; Couban, Rachel; Fischer, Katrin; von Allmen, David Y; Spanjer, Jerry

    2017-01-01

    Objectives To explore agreement among healthcare professionals assessing eligibility for work disability benefits. Design Systematic review and narrative synthesis of reproducibility studies. Data sources Medline, Embase, and PsycINFO searched up to 16 March 2016, without language restrictions, and review of bibliographies of included studies. Eligibility criteria Observational studies investigating reproducibility among healthcare professionals performing disability evaluations using a global rating of working capacity and reporting inter-rater reliability by a statistical measure or descriptively. Studies could be conducted in insurance settings, where decisions on ability to work include normative judgments based on legal considerations, or in research settings, where decisions on ability to work disregard normative considerations.Teams of paired reviewers identified eligible studies, appraised their methodological quality and generalisability, and abstracted results with pretested forms. As heterogeneity of research designs and findings impeded a quantitative analysis, a descriptive synthesis stratified by setting (insurance or research) was performed. Results From 4562 references, 101 full text articles were reviewed. Of these, 16 studies conducted in an insurance setting and seven in a research setting, performed in 12 countries, met the inclusion criteria. Studies in the insurance setting were conducted with medical experts assessing claimants who were actual disability claimants or played by actors, hypothetical cases, or short written scenarios. Conditions were mental (n=6, 38%), musculoskeletal (n=4, 25%), or mixed (n=6, 38%). Applicability of findings from studies conducted in an insurance setting to real life evaluations ranged from generalisable (n=7, 44%) and probably generalisable (n=3, 19%) to probably not generalisable (n=6, 37%). Median inter-rater reliability among experts was 0.45 (range intraclass correlation coefficient 0.86 to κ−0

  14. Inter-rater Agreement of Nasal Endoscopy in Patients with a Prior History of Endoscopic Sinus Surgery

    PubMed Central

    McCoul, Edward D.; Smith, Timothy L.; Mace, Jess C.; Anand, Vijay K.; Senior, Brent A.; Hwang, Peter H.; Stankiewicz, James A.; Tabaee, Abtin

    2012-01-01

    OBJECTIVE Nasal endoscopy is an important part of the clinical evaluation of patients with chronic rhinosinusitis. However, its objectivity and inter-rater agreement have not been well studied, especially in patients who have previously had sinus surgery. METHODS Patients with a history of endoscopic sinus surgery for chronic rhinosinusitis were prospectively enrolled from a tertiary rhinology practice. Fourteen endoscopic nasal examinations were recorded using digital video capture software. Each patient also underwent computerized tomography (CT) and completed the Sinonasal Outcome Test (SNOT-22). Blinded review of inflammatory and anatomic findings for each video was independently performed by 5 academic rhinologists at separate institutions. Comparisons were performed using the unweighted Fleiss’ kappa statistic (Kf) and the prevalence- and bias-adjusted kappa (PABAK). RESULTS There were no significant correlations between age, Lund-Mackay score or SNOT-22 score. Inter-rater agreement was variable across the characteristics studied. Mean PABAK was excellent for the assessment of polyps (Kf =0.886); moderate for the assessments of middle turbinate (MT) integrity (Kf =0.543), MT position (Kf =0.443), maxillary sinus patency (Kf =0.593) and ethmoid sinus patency (Kf =0.429); fair for discharge (Kf =0.314), synechiae (Kf =0.257) and middle meatus patency (Kf =0.229); and poor for MT mucosal changes (Kf =0.148) and uncinate process (Kf =0.126). CONCLUSIONS The current study was notable for variability in the inter-rater agreement among the inflammatory and anatomic attributes that were examined. Further standardization of nasal endoscopy with regard to interpretation may improve the reliability of this procedure in clinical practice. PMID:22696506

  15. Mean Deviation of Inter-rater Scoring (MDIS): a simple tool for introducing conformity into groups of clinical investigators.

    PubMed

    Bourin, Michel; Deplanque, Dominique; Zins-Ritter, Marcel

    2004-07-01

    In spite of considerable progress over the past decade, training investigators for inter-rater reliability for clinical trials remains a major problem. The aim of the present study was to promote a new tool to increase data homogeneity by introducing conformity into groups of clinical investigators. The investigators scoring grid we are proposing-the Mean Deviation of Inter-rater Scoring (MDIS)-involves the calculation of the score deviation for each investigator relative to the median score of an expert group who had evaluated the same videotape-recorded clinical case. Whatever the scale, the score deviation is calculated as the absolute deviation value from the median score obtained by the experts for each item. The MDIS value is then evaluated from all the scores given by an investigator by dividing the total sum of the previously defined values by the number of items of the scale. Some examples from practice are given using several rating scales: (i) Hamilton Anxiety Rating Scale; (ii) Hamilton Depression Rating Scale; (iii) Montgomery Asberg Depression Rating Scale; and (iv) Positive And Negative Symptoms Scale. Finally, such a method could also be employed by experts to evaluate the quality of videotape-recorded clinical cases used in clinical trials, as well as by teachers to evaluate initial or continuous medical training.

  16. The Problem of Limited Inter-rater Agreement in Modelling Music Similarity

    PubMed Central

    Flexer, Arthur; Grill, Thomas

    2016-01-01

    One of the central goals of Music Information Retrieval (MIR) is the quantification of similarity between or within pieces of music. These quantitative relations should mirror the human perception of music similarity, which is however highly subjective with low inter-rater agreement. Unfortunately this principal problem has been given little attention in MIR so far. Since it is not meaningful to have computational models that go beyond the level of human agreement, these levels of inter-rater agreement present a natural upper bound for any algorithmic approach. We will illustrate this fundamental problem in the evaluation of MIR systems using results from two typical application scenarios: (i) modelling of music similarity between pieces of music; (ii) music structure analysis within pieces of music. For both applications, we derive upper bounds of performance which are due to the limited inter-rater agreement. We compare these upper bounds to the performance of state-of-the-art MIR systems and show how the upper bounds prevent further progress in developing better MIR systems. PMID:28190932

  17. The Problem of Limited Inter-rater Agreement in Modelling Music Similarity.

    PubMed

    Flexer, Arthur; Grill, Thomas

    2016-07-02

    One of the central goals of Music Information Retrieval (MIR) is the quantification of similarity between or within pieces of music. These quantitative relations should mirror the human perception of music similarity, which is however highly subjective with low inter-rater agreement. Unfortunately this principal problem has been given little attention in MIR so far. Since it is not meaningful to have computational models that go beyond the level of human agreement, these levels of inter-rater agreement present a natural upper bound for any algorithmic approach. We will illustrate this fundamental problem in the evaluation of MIR systems using results from two typical application scenarios: (i) modelling of music similarity between pieces of music; (ii) music structure analysis within pieces of music. For both applications, we derive upper bounds of performance which are due to the limited inter-rater agreement. We compare these upper bounds to the performance of state-of-the-art MIR systems and show how the upper bounds prevent further progress in developing better MIR systems.

  18. Comparability and Reliability Considerations of Adequate Yearly Progress

    ERIC Educational Resources Information Center

    Maier, Kimberly S.; Maiti, Tapabrata; Dass, Sarat C.; Lim, Chae Young

    2012-01-01

    The purpose of this study is to develop an estimate of Adequate Yearly Progress (AYP) that will allow for reliable and valid comparisons among student subgroups, schools, and districts. A shrinkage-type estimator of AYP using the Bayesian framework is described. Using simulated data, the performance of the Bayes estimator will be compared to…

  19. Structured interview for mild traumatic brain injury after military blast: inter-rater agreement and development of diagnostic algorithm.

    PubMed

    Walker, William C; Cifu, David X; Hudak, Anne M; Goldberg, Gary; Kunz, Richard D; Sima, Adam P

    2015-04-01

    The existing gold standard for diagnosing a suspected previous mild traumatic brain injury (mTBI) is clinical interview. But it is prone to bias, especially for parsing the physical versus psychological effects of traumatic combat events, and its inter-rater reliability is unknown. Several standardized TBI interview instruments have been developed for research use but have similar limitations. Therefore, we developed the Virginia Commonwealth University (VCU) retrospective concussion diagnostic interview, blast version (VCU rCDI-B), and undertook this cross-sectional study aiming to 1) measure agreement among clinicians' mTBI diagnosis ratings, 2) using clinician consensus develop a fully structured diagnostic algorithm, and 3) assess accuracy of this algorithm in a separate sample. Two samples (n = 66; n = 37) of individuals within 2 years of experiencing blast effects during military deployment underwent semistructured interview regarding their worst blast experience. Five highly trained TBI physicians independently reviewed and interpreted the interview content and gave blinded ratings of whether or not the experience was probably an mTBI. Paired inter-rater reliability was extremely variable, with kappa ranging from 0.194 to 0.825. In sample 1, the physician consensus prevalence of probable mTBI was 84%. Using these diagnosis ratings, an algorithm was developed and refined from the fully structured portion of the VCU rCDI-B. The final algorithm considered certain symptom patterns more specific for mTBI than others. For example, an isolated symptom of "saw stars" was deemed sufficient to indicate mTBI, whereas an isolated symptom of "dazed" was not. The accuracy of this algorithm, when applied against the actual physician consensus in sample 2, was almost perfect (correctly classified = 97%; Cohen's kappa = 0.91). In conclusion, we found that highly trained clinicians often disagree on historical blast-related mTBI determinations. A fully structured interview

  20. Inter-rater agreement for diagnoses of epilepsy in pregnant women.

    PubMed

    Khoshbin, Shahram; Herring, Amy; Holmes, Gregory L; Schomer, Donald; Hoch, Daniel; Dooling, Elizabeth C; Vining, Eileen P G; Holmes, Lewis B

    2013-04-01

    We report on inter-rater agreement in assessing the types of seizures exhibited by one hundred mothers ascertained in a study of the teratogenicity of maternal epilepsy and antiepileptic drugs. A summary of each woman's medical record and a one-page report of her responses to questions about her epilepsy were reviewed independently by six neurologists, three in pediatric neurology and three in adult neurology. Agreement was measured by the kappa statistic and log-linear modeling techniques. The adult neurologists agreed with each other 59% of the time, with the agreement higher when all three used information from the patients' records, such as an EEG, rather than when depending on the patients' responses to questions about their epilepsy. The pediatric neurologists agreed with each other 44% of the time and tended to rely more heavily on information in the patients' records, such as an EEG or a prior diagnosis, compared with the adult neurologists.

  1. Reproducibility of range of motion and muscle strength measurements in patients with hip osteoarthritis – an inter-rater study

    PubMed Central

    2012-01-01

    Background Assessment of range of motion (ROM) and muscle strength is fundamental in the clinical diagnosis of hip osteoarthritis (OA) but reproducibility of these measurements has mostly involved clinicians from secondary care and has rarely reported agreement parameters. Therefore, the primary objective of the study was to determine the inter-rater reproducibility of ROM and muscle strength measurements. Furthermore, the reliability of the overall assessment of clinical hip OA was evaluated. Reporting is in accordance with proposed guidelines for the reporting of reliability and agreement studies (GRRAS). Methods In a university hospital, four blinded raters independently examined patients with unilateral hip OA; two hospital orthopaedists independently examined 48 (24 men) patients and two primary care chiropractors examined 61 patients (29 men). ROM was measured in degrees (deg.) with a standard two-arm goniometer and muscle strength in Newton (N) using a hand-held dynamometer. Reproducibility is reported as agreement and reliability between paired raters of the same profession. Agreement is reported as limits of agreement (LoA) and reliability is reported with intraclass correlation coefficients (ICC). Reliability of the overall assessment of clinical OA is reported as weighted kappa. Results Between orthopaedists, agreement for ROM ranged from LoA [-28–12 deg.] for internal rotation to [-8–13 deg.] for extension. ICC ranged between 0.53 and 0.73, highest for flexion. For muscle strength between orthopaedists, LoA ranged from [-65–47N] for external rotation to [-10 –59N] for flexion. ICC ranged between 0.52 and 0.85, highest for abduction. Between chiropractors, agreement for ROM ranged from LoA [-25–30 deg.] for internal rotation to [-13–21 deg.] for flexion. ICC ranged between 0.14 and 0.79, highest for flexion. For muscle strength between chiropractors, LoA ranged between [-80–20N] for external rotation to [-146–55N] for abduction. ICC

  2. Inter-rater Agreement on Identification of Electrographic Seizures and Periodic Discharges in ICU EEG Recordings

    PubMed Central

    Halford, J.J.; Shiau, D.; Desrochers, J.A.; Kolls, B.J.; Dean, B.C.; Waters, C.G.; Azar, N.J.; Haas, K.F.; Kutluay, E.; Martz, G.U.; Sinha, S.R.; Kern, R.T.; Kelly, K.M.; Sackellares, J.C.; LaRoche, S.M.

    2015-01-01

    Objective This study investigated inter-rater agreement (IRA) among EEG experts for the identification of electrographic seizures and periodic discharges (PDs) in continuous ICU EEG recordings. Methods Eight board-certified EEG experts independently identified seizures and PDs in thirty 1-hour EEG segments which were selected from ICU EEG recordings collected from three medical centers. IRA was compared between seizure and PD identifications, as well as among rater groups that have passed an ICU EEG Certification Test, developed by the Critical Care EEG Monitoring Research Consortium (CCEMRC). Results Both kappa and event-based IRA statistics showed higher mean values in identification of seizures compared to PDs (k = 0.58 vs. 0.38; p < 0.001). The group of rater pairs who had both passed the ICU EEG Certification Test had a significantly higher mean IRA in comparison to rater pairs in which neither had passed the test. Conclusions IRA among experts is significantly higher for identification of electrographic seizures compared to PDs. Additional instruction, such as the training module and certification test developed by the CCEMRC, could enhance this IRA. Significance This study demonstrates more disagreement in the labeling of PDs in comparison to seizures. This may be improved by education about standard EEG nomenclature. PMID:25481336

  3. Inter-Rater Reliability of the Diagnoses of Psychosis and Depression in Individuals with Intellectual Disabilities

    ERIC Educational Resources Information Center

    Einfeld, S.; Tonge, B.; Chapman, L.; Mohr, C.; Taffe, J.; Horstead, S.

    2007-01-01

    Background: There is a history of over-prescription of antipsychotics to individuals with intellectual disability (ID), while antidepressants may be under-prescribed. However, appropriate treatment is best supported when the diagnosis of psychosis or depression is valid and carries good predictive validity. The present authors report a study…

  4. Inter-rater reliability (IRR): A Valuable Metric for Qualitative Research | Smokefree.gov

    Cancer.gov

    Most people who do qualitative research, which analyzes non-numerical information, such as interviews, open-ended questionnaires, and observations, know that it includes a lot of coding. Coding is a standardized process of classifying qualitative data (i.e., non-numerical data) by using one unified model, or “coding scheme,” to analyze numerous sets of data. Coding aims to reduce subjective opinion and analysis of qualitative data, and instead ensure a more objective analytical process with limited bias in results. 

  5. Validation of a modified Bristol stool scale - inter-rater reliability amongst pediatric gastroenterologists

    Technology Transfer Automated Retrieval System (TEKTRAN)

    Stool form and changes in stool form are important criteria in both clinical practice and clinical research. However, descriptions of stool form from both patients and physicians alike may be subjective and objective measurements of stool form are not well developed. Although the Bristol stool scale...

  6. The Reliability of Environmental Measures of the College Alcohol Environment.

    ERIC Educational Resources Information Center

    Clapp, John D.; Whitney, Mike; Shillington, Audrey M.

    2002-01-01

    Assesses the inter-rater reliability of two environmental scanning tools designed to identify alcohol-related advertisements targeting college students. Inter-rater reliability for these forms varied across different rating categories and ranged from poor to excellent. Suggestions for future research are addressed. (Contains 26 references and 6…

  7. A reliability study of the Spanish version of the social behaviour schedule (SBS) in a population of adults with learning disabilities.

    PubMed

    Salvador-Carulla, L; Garcia-Mellado, M J; Velazquez, R; Romero, C; Alonso, F

    1998-02-01

    The reliability of the Spanish version of the Social Behaviour Schedule (SBS) was tested in a vocational setting on a sample of 64 subjects with learning disabilities. Test-retest assessment showed a good percentage of agreement (80%) and adequate kappa values for most SBS items. The overall percentage of agreement of inter-rater reliability was 85% and kappa values were moderate to nearly perfect for 52% of items. Inter-informant analyses produced poorer results, with an average agreement of 43% and inadequate kappa values on 42% of items. The intraclass correlation coefficient (ICC) was 0.64 for test-retest, 0.76 for inter-rater assessment and 0.94 for inter-informant assessment. The Spearman correlation coefficient was adequate on the test-retest and inter-rater analyses, but not on inter-informant analysis. This low inter-informant agreement could be attributed to environmental factors which alter the reliability of reports from different informants in community settings with high levels of normalization. In such environments, an interview with a key informant may not suffice, and both a careful review of the clinical record and a direct interview with subjects may enhance the reliability of the information attained.

  8. RELIABILITY OF THE SITTING HAND PRESS-UP TEST FOR IDENTIFYING AND QUANTIFYING THE LEVEL OF SCAPULAR MEDIAL BORDER POSTERIOR DISPLACEMENT IN OVERHEAD ATHLETES

    PubMed Central

    Barnes, Meredith J.; Leddon, Charles E.; Van Ryssegem, Guido; Alamar, Benjamin

    2011-01-01

    Background: The lack of proper scapular kinematics can limit the function of the entire shoulder complex.1,3 Many forms of scapular dyskinesis have been proposed along with tests to measure for the position and motion associated with those positional and movement faults (2,4-6). While scapular internal rotation has been listed among the forms of scapular dyskinesis there has not been a reliable test documented in the literature that examines this motion. The purpose of this study was to determine whether an innovative scapular medial border posterior displacement measurement device has adequate inter-rater and intra-rater reliability when used at rest and during the sitting hand press up test. Methods: 16 male Division III baseball players free of upper limb injury for the previous 12 months participated in the study. Posterior scapular displacement measures were taken on each subject in a resting static posture and while performing a sitting hand press up test. Subjects were tested twice within 24 hours by two separate examiners. Intraclass correlation coefficients (ICC) were calculated to determine intra-rater and inter-rater reliability. Results: The intra-rater reliability for rater 1 was .97 (95% confidence interval [CI]= .91-.98), for the rest position and .95 (95% CI= .86-.98) for the sitting hand press-up position. Intra-rater reliability for rater 2 was .99 (95% CI= .97-.99) for the rest position and .98 (95% CI=. 95-.99) for the sitting hand press-up position. The ICCs for inter-rater reliability of the scapular medial border posterior displacement measurement in at the rest position and the sitting hand press-up position were .89 (95% CI= .81-.96) and .89 (95% CI= .80-.96) respectively. Conclusions: The findings of this study indicate that the measurement of medial border posterior displacement using this device demonstrates good to excellent inter-rater and intra-rater reliability. PMID:22163092

  9. Inter-rater agreement, sensitivity, and specificity of the prone hip extension test and active straight leg raise test

    PubMed Central

    2014-01-01

    Background Two clinical tests used to assess for neuromuscular control deficits in low back pain (LBP) patients are the prone hip extension (PHE) test and active straight leg raise (ASLR) test. For these tests, it has been suggested examiners classify patients as “positive” or “negative” based on the presence or absence (respectively) of specific “abnormal” lumbopelvic motion patterns. The inter-rater agreement of such a classification scheme has been reported for the PHE test, but not for the ASLR test. In addition, the sensitivity and specificity of such classification schemes have not been reported for either test. The primary objectives of the current study were to investigate: 1) the inter-rater agreement of the examiner-reported classification schemes for these two tests, and 2) the sensitivity and specificity of the classification schemes. Methods Thirty participants with LBP and 40 asymptomatic controls took part in this cross-sectional observational study. Participants performed 3–4 repetitions of each test whilst two examiners classified them as “positive” or “negative” based on the presence or absence (respectively) of specific “abnormal” lumbopelvic motion patterns. The inter-rater agreement (Kappa statistic), sensitivity (LBP patients), and specificity (controls) were calculated for each test. Results Both tests demonstrated substantial inter-rater agreement (PHE test: Kappa = 0.76, 95% CI = 0.57-0.95, p < 0.001; ASLR test: Kappa = 0.76, 95% CI = 0.57-0.96, p < 0.001). For the PHE test, the sensitivity was 0.18-0.27 and the specificity was 0.63-0.78; the odds ratio (OR) of “positive” classifications in the LBP group was 1.25 (95% CI = 0.58-2.72; Examiner 1) and 1.27 (95% CI = 0.52-3.12; Examiner 2). For the ASLR test, the sensitivity was 0.20-0.25 and the specificity was 0.84-0.86; the OR of “positive” classifications in the LBP group was 1.72 (95% CI = 0.75-3.95; Examiner 1) and 1

  10. Grading Osteoarthritic Changes of the Zygapophyseal Joints from Radiographs: A Reliability Study

    PubMed Central

    Little, Joshua W.; Grieve, Thomas J.; Cramer, Gregory D.; Rich, Jeffrey A.; Laptook, Evelyn E.; Stiefel, Joseph P.D.; Linaker, Kathleen

    2015-01-01

    Objective This study tested the reliability of a 5-point ordinal scale used to grade the severity of degenerative changes of zygapophyseal (Z) joints on standard radiographs. Methods Modifications were made to Kellgren’s grading system to improve agreement for grading the severity of osteoarthritic changes in lumbar Z joints. These included adding 1 grade of no degeneration, multiple radiographic views, and structured examiner training. Thirty packets of radiographic files were obtained, which included representation of all 5 grades including no degeneration (0) and Kellgren’s 4-point (1 to 4) joint degeneration classification criteria. Radiographs were digitized to create a radiographic atlas that was given to examiners for individual study and blinded evaluation sessions. Intra-rater and inter-rater agreement was determined by weighted kappa (κw) from the examination of 79 Z joints (25 packets). Results Using the modified scale and following training, examiners demonstrated a moderate to substantial level of inter-rater agreement (κw = 0.57, 0.60, and 0.68). Intra-rater agreement was moderate (κw = 0.42 and 0.54). Conclusions The modified Kellgren 5-point grading system provides acceptable intra- and inter-rater reliability when examiners are adequately trained. This grading system may be a useful method for future investigations assessing radiographic osteoarthritis of the Z joints. v PMID:26118786

  11. A two-stage inter-rater approach for enrichment testing of variants associated with multiple traits

    PubMed Central

    Asimit, Jennifer L; Payne, Felicity; Morris, Andrew P; Cordell, Heather J; Barroso, Inês

    2017-01-01

    Shared genetic aetiology may explain the co-occurrence of diseases in individuals more often than expected by chance. On identifying associated variants shared between two traits, one objective is to determine whether such overlap may be explained by specific genomic characteristics (eg, functional annotation). In clinical studies, inter-rater agreement approaches assess concordance among expert opinions on the presence/absence of a complex disease for each subject. We adapt a two-stage inter-rater agreement model to the genetic association setting to identify features predictive of overlap variants, while accounting for their marginal trait associations. The resulting corrected overlap and marginal enrichment test (COMET) also assesses enrichment at the individual trait level. Multiple categories may be tested simultaneously and the method is computationally efficient, not requiring permutations to assess significance. In an extensive simulation study, COMET identifies features predictive of enrichment with high power and has well-calibrated type I error. In contrast, testing for overlap with a single-trait enrichment test has inflated type I error. COMET is applied to three glycaemic traits using a set of functional annotation categories as predictors, followed by further analyses that focus on tissue-specific regulatory variants. The results support previous findings that regulatory variants in pancreatic islets are enriched for fasting glucose-associated variants, and give insight into differences/similarities between characteristics of variants associated with glycaemic traits. Also, despite regulatory variants in pancreatic islets being enriched for variants that are marginally associated with fasting glucose and fasting insulin, there is no enrichment of shared variants between the traits. PMID:28000695

  12. High Intra- and Inter-Rater Chance Variation of the Movement Assessment Battery for Children 2, Ageband 2

    ERIC Educational Resources Information Center

    Holm, Inger; Tveter, Anne Therese; Aulie, Vibeke Smith; Stuge, Britt

    2013-01-01

    The aim of the present study was to evaluate the intra- and inter-tester reliability of the movement assessment battery for children-second edition (MABC-2), ageband 2. We wanted to analyze the collected data, with adequate statistical methods, to provide relevant recommendations for physical therapists who are interpreting changes in the context…

  13. Reliability and factorial validity of the Observer Alexithymia Scale-Chinese translation.

    PubMed

    Yao, Shuqiao; Yi, Jinyao; Zhu, Xiongzhao; Haviland, Mark G

    2005-03-30

    The purpose of the present study was to develop a Chinese translation of the Observer Alexithymia Scale (OAS-C) and evaluate its reliability and factorial validity. The original English-version of the Observer Alexithymia Scale (OAS) was translated into Chinese and given to 468 Chinese undergraduate students. Students were asked to rate a person (other than themselves) whom they knew well (e.g., a parent, sibling, another relative, or friend). We evaluated internal consistency, test-retest and inter-rater reliability, and factorial validity. Average OAS-C scores were slightly higher than, but comparable to, OAS scores in the normative samples (English-speaking/nonclinical). The OAS-C showed adequate internal consistency (Cronbach's alpha coefficient was 0.84, and the mean inter-item correlation coefficient was 0.14), good stability (test-retest reliability with a 2-week interval was 0.90), and inter-rater reliability (intra-class correlation coefficient was 0.78). Moreover, the OAS five-factor model (Distant, Uninsightful, Somatizing, Humorless, and Rigid) was confirmed: incremental fit index=0.905, comparative fit index=0.904, and root mean square error of approximation=0.086; each represented an adequate model fit. The OAS-C appears to be a reliable and valid observer-rated alexithymia measure. We recommend that researchers collect both self- and observer-rated alexithymia data and, when possible, obtain observer reports from more than one person.

  14. Feasibility and reliability of pain pressure threshold measurements in patellar tendinopathy.

    PubMed

    van Wilgen, Paul; van der Noord, Robert; Zwerver, Johannes

    2011-11-01

    Patellar tendinopathy is a common and often difficult to treat overuse injury which is characterized by activity-related anterior knee and focal palpation tenderness of the patellar tendon. The clinical diagnosis is mainly based on clinical examination, in which the yardstick is a non-standardized manual palpation. To standardize this palpation procedure the use of an algometer seems applicable. The purpose of this study was to investigate the feasibility and reliability of the algometer in patellar tendinopathy. A cross sectional study was carried out.The algometer was applied to the patellar tendon in 20 asymptomatic volleyball players to measure the 'normal' pressure pain threshold. The inter-rater reliability was analyzed in 54 athletes with symptomatic patellar tendinopathy, the intra-rater reliability was analyzed in 48 athletes with symptomatic patellar tendinopathy. During the procedure difficulties were described, the SEM, intra class correlations and limits of agreement were determined using the Bland and Altman method. The feasibility of the algometer is adequate. The PPT of asymptomatic athletes differs significantly (p<.001) from athletes with a diagnosis of patellar tendinopathy. The inter-rater (ICC 0.93) and intra-rater (ICC 0.60) reliability of the pain pressure threshold are adequate to moderate. Although further research is warranted PPT algometry seems to be a feasible, reliable and useful tool in the diagnosis and treatment evaluation of athletes with patellar tendinopathy.

  15. [Inter-rater reliability of healthcare professional skills' portfolio assessments: The Andalusian Agency for Healthcare Quality model].

    PubMed

    Almuedo-Paz, Antonio; Herrera-Usagre, Manuel; Buiza-Camacho, Begoña; Julián-Carrión, José; Carrascosa-Salmoral, María del Pilar; Martín-García, Sheila María; Salguero-Cabalgante, Rocío

    2014-07-17

    El objetivo de este estudio es analizar la fiabilidad inter-jueces de las calificaciones realizadas por el equipo de evaluadores, pertenecientes al programa de certificación de competencias profesionales de la Agencia de Calidad Sanitaria de Andalucía (ACSA). Se estudiaron todos los procesos de certificación de competencias profesionales durante el periodo 2010-2011, independientemente de su disciplina. Se han analizado tres tipos de pruebas: 368 certificados, 17.895 informes de reflexión y 22.642 informes de práctica clínica (N = 3.010 profesionales). El porcentaje de acuerdo en las evaluaciones de certificados fue de un 89,9% (k = 0,711); 85,1% para los informes de práctica clínica (k = 0,455); y 81,7% para los informes de reflexión (k = 0,468). Los resultados de este macro-estudio muestran que la fiabilidad inter-jueces de las evaluaciones varía de ajustada a buena. En comparación con otros estudios similares, los resultados sitúan la fiabilidad del modelo en una posición cómoda. Entre las mejoras incorporadas, se incluyen la revisión de criterios y una progresiva automatización de las evaluaciones.

  16. Establishing intra- and inter-rater agreement of the Face, Legs, Activity, Cry, Consolability scale for evaluating pain in toddlers during immunization

    PubMed Central

    Gomez, Rebecca J; Barrowman, Nick; Elia, Sonja; Manias, Elizabeth; Royle, Jenny; Harrison, Denise

    2013-01-01

    BACKGROUND: The Face, Legs, Activity, Cry, Consolability (FLACC) scale is a five-item tool that was developed to assess postoperative pain in young children. The tool is frequently used as an outcome measure in studies investigating acute procedural pain in young children; however, there are limited published psychometric data in this context. OBJECTIVE: To establish inter-rater and intrarater agreement of the FLACC scale in toddlers during immunization. METHODS: Participants comprised a convenience sample of toddlers recruited from an immunization drop-in service, who were part of a larger pilot randomized controlled trial. Toddlers were video- and audiotaped during immunization procedures. The first rater scored each video twice in random order over a period of three weeks (intrarater agreement), while the second rater scored each video once and was blinded to the first rater’s scores (inter-rater agreement). The FLACC scale was scored at four time-points throughout the procedure. Intraclass correlation coefficients were used to assess agreement of the FLACC scale. RESULTS: Thirty toddlers between 12 and 18 months of age were recruited, and video data were available for 29. Intrarater agreement coefficients were 0.88 at baseline, 0.97 at insertion of first needle, and 0.80 and 0.81 at 15 s and 30 s following the final injection, respectively. Inter-rater coefficients were 0.40 at baseline, 0.95 at insertion of first needle, and 0.81 and 0.78 at 15 s and 30 s following the final injection, respectively. CONCLUSIONS: The FLACC scale has sufficient agreement in assessing pain in toddlers during immunizations, especially during the most painful periods of the procedure. PMID:24308028

  17. Validity, Reliability and Acceptability of the Team Standardized Assessment of Clinical Encounter Report*

    PubMed Central

    Wong, Camilla L.; Norris, Mireille; Sinha, Samir S.; Zorzitto, Maria L.; Madala, Sushma; Hamid, Jemila S.

    2016-01-01

    Background The Team Standardized Assessment of a Clinical Encounter Report (StACER) was designed for use in Geriatric Medicine residency programs to evaluate Communicator and Collaborator competencies. Methods The Team StACER was completed by two geriatricians and interdisciplinary team members based on observations during a geriatric medicine team meeting. Postgraduate trainees were recruited from July 2010–November 2013. Inter-rater reliability between two geriatricians and between all team members was determined. Internal consistency of items for the constructs Communicator and Collaborator competencies was calculated. Raters completed a survey previously administered to Canadian geriatricians to assess face validity. Trainees completed a survey to determine the usefulness of this instrument as a feedback tool. Results Thirty postgraduate trainees participated. The prevalence-adjusted bias-adjusted kappa range inter-rater reliability for Communicator and Collaborator items were 0.87–1.00 and 0.86–1.00, respectively. The Cronbach’s alpha coefficient for Communicator and Collaborator items was 0.997 (95% CI: 0.993–1.00) and 0.997 (95% CI: 0.997–1.00), respectively. The instrument lacked discriminatory power, as all trainees scored “meets requirements” in the overall assessment. Niney-three per cent and 86% of trainees found feedback useful for developing Communicator and Collaborator competencies, respectively. Conclusions The Team StACER has adequate inter-rater reliability and internal consistency. Poor discriminatory power and face validity challenge the merit of using this evaluation tool. Trainees felt the tool provided useful feedback on Collaborator and Communicator competencies. PMID:28050222

  18. Inter-rater agreement for a retrospective exposure assessment of asbestos, chromium, nickel and welding fumes in a study of lung cancer and ionizing radiation.

    PubMed

    Seel, E A; Zaebst, D D; Hein, M J; Liu, J; Nowlin, S J; Chen, P

    2007-10-01

    A retrospective exposure assessment of asbestos, welding fumes, chromium and nickel (in welding fumes) was conducted at the Portsmouth Naval Shipyard for a nested case-control study of lung cancer risk from external ionizing radiation. These four contaminants were included because of their potential to confound or modify the effect of a lung cancer-radiation relationship. The exposure assessment included three experienced industrial hygienists from the shipyard who independently assessed exposures for 3519 shop/job/time period combinations. A consensus process was used to resolve estimates with large differences. Final exposure estimates were linked to employment histories of the 4388 study subjects to calculate their cumulative exposures. Inter-rater agreement analyses were performed on the original estimates to better understand the estimation process. Although concordance was good to excellent (78-99%) for intensity estimates and excellent (96-99%) for frequency estimates, overall simple kappa statistics indicated only slight agreement beyond chance (kappa < 0.2). Unbalanced distributions of exposure estimates partly contributed to the weak observed overall inter-rater agreement. Pairwise weighted kappa statistics revealed better agreement between two of the three panelists (kappa = 0.19-0.65). The final consensus estimates were similar to the estimates made by these same two panelists. Overall welding fume exposures were fairly stable across time at the shipyard while asbestos exposures were higher in the early years and fell in the mid-1970s. Mean cumulative exposure for all study subjects was 520 fiber-days cc(-1) for asbestos and 1000 mg-days m(-3) for welding fumes. Mean exposure was much lower for nickel (140 microg-days m(-3)) and chromium (45 microg-days m(-3)). Asbestos and welding fume exposure estimates were positively associated with lung cancer in the nested case-control study. The radiation-lung cancer relationship was attenuated by the inclusion

  19. Reliability of Multi-Category Rating Scales

    ERIC Educational Resources Information Center

    Parker, Richard I.; Vannest, Kimberly J.; Davis, John L.

    2013-01-01

    The use of multi-category scales is increasing for the monitoring of IEP goals, classroom and school rules, and Behavior Improvement Plans (BIPs). Although they require greater inference than traditional data counting, little is known about the inter-rater reliability of these scales. This simulation study examined the performance of nine…

  20. Shadow Moiré technique for postural assessment: qualitative assessment protocol by intra- and inter-rater evaluation

    PubMed Central

    Filho, José Nunes da Silva; Batista, Luiz Alberto; Gurgel, Jonas Lírio; Porto, Flávia

    2017-01-01

    [Purpose] This study aimed to develop and validate an assessment tool for Moiré topogram made specifically with the Shadow Moiré technique of the dorsum. [Subjects and Methods] In the analysis of topograms, frontal, sagittal, and transverse planes of individuals’ dorsal were considered. Two instructor evaluators analyzed the topograms at different times in the day and on different days. The measurements of intra- and inter- (intra- and interday) reliability were calculated. [Results] Of the three planes analyzed, in all analyses, good (0.61 to 0.80) and/or excellent (0.81 to 1) concordances were observed. [Conclusion] This analysis framework can be recommended to evaluate the topograms obtained with SMT. PMID:28265173

  1. Seven Reliability Indices for High-Stakes Decision Making: Description, Selection, and Simple Calculation

    ERIC Educational Resources Information Center

    Smith, Stacey L.; Vannest, Kimberly J.; Davis, John L.

    2011-01-01

    The reliability of data is a critical issue in decision-making for practitioners in the school. Percent Agreement and Cohen's kappa are the two most widely reported indices of inter-rater reliability, however, a recent Monte Carlo study on the reliability of multi-category scales found other indices to be more trustworthy given the type of data…

  2. Translation, cross-cultural adaptation to Brazilian- Portuguese and reliability analysis of the instrument Rapid Entire Body Assessment-REBA

    PubMed Central

    Lamarão, Andressa M.; Costa, Lucíola C. M.; Comper, Maria L. C.; Padula, Rosimeire S.

    2014-01-01

    Background: Observational instruments, such as the Rapid Entire Body Assessment, quickly assess biomechanical risks present in the workplace. However, in order to use these instruments, it is necessary to conduct the translational/cross-cultural adaptation of the instrument and test its measurement properties. Objectives: To perform the translation and the cross-cultural adaptation to Brazilian-Portuguese and test the reliability of the REBA instrument. Method: The procedures of translation and cross-cultural adaptation to Brazilian-Portuguese were conducted following proposed guidelines that involved translation, synthesis of translations, back translation, committee review and testing of the pre-final version. In addition, reliability and the intra- and inter-rater percent agreement were obtained with the Linear Weighted Kappa Coefficient that was associated with the 95% Confidence Interval and the cross tabulation 2×2. Results : The procedures for translation and adaptation were adequate and the necessary adjustments were conducted on the instrument. The intra- and inter-rater reliability showed values of 0.104 to 0.504, respectively, ranging from very poor to moderate. The percentage agreement values ranged from 5.66% to 69.81%. The percentage agreement was closer to 100% at the item 'upper arm' (69.81%) for the Intra-rater 1 and at the items 'legs' and 'upper arm' for the Intra-rater 2 (62.26%). Conclusions: The processes of translation and cross-cultural adaptation were conducted on the REBA instrument and the Brazilian version of the instrument was obtained. However, despite the reliability of the tests used to correct the translated and adapted version, the reliability values are unacceptable according to the guidelines standard, indicating that the reliability must be re-evaluated. Therefore, caution in the interpretation of the biomechanical risks measured by this instrument should be taken. PMID:25003273

  3. Rating Format Effects on Rater Agreement and Reliability.

    ERIC Educational Resources Information Center

    Littlefield, John H.; Troendle, G. Roger

    This study compares intra- and inter-rater agreement and reliability when using three different rating form formats to assess the same stimuli. One format requests assessment by marking detailed criteria without an overall judgement; the second format requests only an overall judgement without the use of detailed criteria; and the third format…

  4. Analysis of the reliability of the make test in young adults by using a hand-held dynamometer.

    PubMed

    Kim, Seong-Gil; Lim, Dong-Ho; Cho, Yong Ho

    2016-08-01

    [Purpose] The purpose of this study was to analyze intra-rater and inter-rater reliabilities of the make test, a manual muscle testing measurement method, using a hand-held dynamometer in Korean young adults. [Subjects and Methods] A total of 42 university students participated in this study. The make test, a manual muscle testing method, was conducted. A hand-held dynamometer was used to measure elbow joint flexion during the make test. [Results] Both intra-rater (the intraclass correlation coefficient=0.992) and inter-rater reliabilities (the intraclass correlation coefficient=0.949) were excellent, with values over 0.9. [Conclusion] The make test is a useful manual muscle testing method with high intra-rater and inter-rater reliability.

  5. The Behavior Flexibility Rating Scale-Revised (BFRS-R): Factor Analysis, Internal Consistency, Inter-Rater and Intra-Rater Reliability, and Convergent Validity

    ERIC Educational Resources Information Center

    Peters-Scheffer, Nienke; Didden, Robert; Green, Vanessa A.; Sigafoos, Jeff; Korzilius, Hubert; Pituch, Keenan; O'Reilly, Mark F.; Lancioni, Giulio

    2008-01-01

    We examined the psychometric properties of the behavior flexibility rating scale-revised (BFRS-R), a new scale intended for assessing behavioral flexibility in individuals with developmental disabilities. Seventy-six direct care staff members and 56 parents completed the BFRS-R for 70 children with developmental disabilities. Factor analysis…

  6. Inter-Rater Reliability and Generalizability of Patient Note Scores Using a Scoring Rubric Based on the USMLE Step-2 CS Format

    ERIC Educational Resources Information Center

    Park, Yoon Soo; Hyderi, Abbas; Bordage, Georges; Xing, Kuan; Yudkowsky, Rachel

    2016-01-01

    Recent changes to the patient note (PN) format of the United States Medical Licensing Examination have challenged medical schools to improve the instruction and assessment of students taking the Step-2 clinical skills examination. The purpose of this study was to gather validity evidence regarding response process and internal structure, focusing…

  7. Dynamometry for the measurement of grip, pinch, and trunk muscles strength in subjects with subacute stroke: reliability and different number of trials

    PubMed Central

    Aguiar, Larissa T.; Martins, Júlia C.; Lara, Eliza M.; Albuquerque, Julianna A.; Teixeira-Salmela, Luci F.; Faria, Christina D. C. M.

    2016-01-01

    ABSTRACT Background Muscle strength is usually measured in individuals with stroke with Portable dynamometers (gold standard). However, no studies have investigated the reliability, the standard error of measurement (SEM) and the minimal detectable difference (MDD95%) of the dynamometry for the measurement of hand grip, pinch grip and trunk strength in subjects with subacute stroke. Objective 1) To investigate the intra and inter-rater reliability, the SEM and the MDD95% of the portable dynamometers for the measurement of grip, pinch and trunk strength in subjects with subacute stroke, and 2) to verify whether the use of different number of trials (first trial and the average of the first two and three trials) affected the results. Method 32 subjects with subacute stroke (time since stroke onset: 3.6 months, SD=0.66 months) were evaluated. Hand grip, 3 pinch grips (i.e. pulp-to-pulp/palmar/lateral) and 4 trunk muscles (i.e. flexors, extensors, lateral flexors and rotators) strength were bilaterally assessed (except trunk flexors/extensors) with portable dynamometry by two independent examiners over two sessions (1-2 weeks apart). One-way ANOVAs and intraclass correlation coefficients (ICC2,k) were used for analysis (α=0.05). SEM and MDD95% were also calculated. Results For all muscular groups and sources of outcome values, including one trial, after familiarization, similar results were found (0.01≤F≤0.08; 0.92≤p≤0.99) with significant and adequate values of intra-rater (0.64≤ICC≤0.99; 0.23≤95%CI≤0.99) and inter-rater (0.66≤ICC≤0.99; 0.25≤95%CI≤0.99) reliability. SEM and MDD95% were considered low (0.39≤EPM≤2.21 Kg; 0.96≤MMD95%≤6.12 Kg) for all outcome scores. Conclusion Only one trial, following familiarization, demonstrated adequate intra-rater and inter-rater reliability of the portable dynamometers for the measurement of hand grip, pinch grip and trunk strength in subjects with subacute stroke. PMID:27410161

  8. Reliability of the Matson Evaluation of Social Skills with Youngsters (MESSY) for Children with Autism Spectrum Disorders

    ERIC Educational Resources Information Center

    Matson, Johnny L.; Horovitz, Max; Mahan, Sara; Fodstad, Jill

    2013-01-01

    The purpose of this paper was to update the psychometrics of the "Matson Evaluation of Social Skills for Youngsters" ("MESSY") with children with Autism Spectrum Disorders (ASD), specifically with respect to internal consistency, split-half reliability, and inter-rater reliability. In Study 1, 114 children with ASD (Autistic Disorder, Asperger's…

  9. Reliability of physical examination tests for the diagnosis of knee disorders: Evidence from a systematic review.

    PubMed

    Décary, Simon; Ouellet, Philippe; Vendittoli, Pascal-André; Desmeules, François

    2016-12-01

    Clinicians often rely on physical examination tests to guide them in the diagnostic process of knee disorders. However, reliability of these tests is often overlooked and may influence the consistency of results and overall diagnostic validity. Therefore, the objective of this study was to systematically review evidence on the reliability of physical examination tests for the diagnosis of knee disorders. A structured literature search was conducted in databases up to January 2016. Included studies needed to report reliability measures of at least one physical test for any knee disorder. Methodological quality was evaluated using the QAREL checklist. A qualitative synthesis of the evidence was performed. Thirty-three studies were included with a mean QAREL score of 5.5 ± 0.5. Based on low to moderate quality evidence, the Thessaly test for meniscal injuries reached moderate inter-rater reliability (k = 0.54). Based on moderate to excellent quality evidence, the Lachman for anterior cruciate ligament injuries reached moderate to excellent inter-rater reliability (k = 0.42 to 0.81). Based on low to moderate quality evidence, the Tibiofemoral Crepitus, Joint Line and Patellofemoral Pain/Tenderness, Bony Enlargement and Joint Pain on Movement tests for knee osteoarthritis reached fair to excellent inter-rater reliability (k = 0.29 to 0.93). Based on low to moderate quality evidence, the Lateral Glide, Lateral Tilt, Lateral Pull and Quality of Movement tests for patellofemoral pain reached moderate to good inter-rater reliability (k = 0.49 to 0.73). Many physical tests appear to reach good inter-rater reliability, but this is based on low-quality and conflicting evidence. High-quality research is required to evaluate the reliability of knee physical examination tests.

  10. North Carolina Assessment of Risk (NCAR): Reliability and Predictive Validity with Juvenile Offenders

    ERIC Educational Resources Information Center

    Schwalbe, Craig S.; Fraser, Mark W.; Day, Steven H.; Arnold, Elizabeth Mayfield

    2004-01-01

    Actuarial risk assessment instruments are used increasingly in juvenile justice to classify youths according to their risk of recidivism. The purpose of this article is to describe the results of two studies of one instrument: the North Carolina Assessment of Risk (NCAR). In the first study, the inter-rater reliability of the risk assessment…

  11. Reliability of a Measure of Muscle Extensibility in Fullterm and Preterm Newborns

    ERIC Educational Resources Information Center

    Beuttler, Marybeth Grant; Leininger, Peter M.; Palisano, Robert J.

    2004-01-01

    Purpose: The purpose of this study was to examine the test-retest and inter-rater reliability of a measure of muscle extensibility developed by Tardieu, de la Tour, Bret, and Tardieu (1982) in fullterm and preterm newborns. Method: Twenty-one fullterm infants and twenty preterm infants were examined by two physical therapists. Each physical…

  12. Reliability and Validity of Autism Diagnostic Interview-Revised, Japanese Version

    ERIC Educational Resources Information Center

    Tsuchiya, Kenji J.; Matsumoto, Kaori; Yagi, Atsuko; Inada, Naoko; Kuroda, Miho; Inokuchi, Eiko; Koyama, Tomonori; Kamio, Yoko; Tsujii, Masatsugu; Sakai, Saeko; Mohri, Ikuko; Taniike, Masako; Iwanaga, Ryoichiro; Ogasahara, Kei; Miyachi, Taishi; Nakajima, Shunji; Tani, Iori; Ohnishi, Masafumi; Inoue, Masahiko; Nomura, Kazuyo; Hagiwara, Taku; Uchiyama, Tokio; Ichikawa, Hironobu; Kobayashi, Shuji; Miyamoto, Ken; Nakamura, Kazuhiko; Suzuki, Katsuaki; Mori, Norio; Takei, Nori

    2013-01-01

    To examine the inter-rater reliability of Autism Diagnostic Interview-Revised, Japanese Version (ADI-R-JV), the authors recruited 51 individuals aged 3-19 years, interviewed by two independent raters. Subsequently, to assess the discriminant and diagnostic validity of ADI-R-JV, the authors investigated 317 individuals aged 2-19 years, who were…

  13. Reliability of the Functional Mobility Scale for Children with Cerebral Palsy

    ERIC Educational Resources Information Center

    Harvey, Adrienne R.; Morris, Meg E.; Graham, H. Kerr; Wolfe, Rory; Baker, Richard

    2010-01-01

    This study examined inter-rater reliability of the Functional Mobility Scale (FMS) for children with cerebral palsy (CP) and the presence of rater bias. A consecutive sample of 118 children with CP, 2-18 years old (mean 10.3 years, SD 3.6), was recruited from a hospital setting. Children were classified using the gross motor function…

  14. Improving the reliability of clinical practice guideline appraisals: effects of the Korean AGREE II scoring guide.

    PubMed

    Oh, Moo-Kyung; Jo, Heuisug; Lee, You Kyoung

    2014-06-01

    The Korean translated Appraisal of Guidelines for Research and Evaluation II (Korean AGREE II) instrument was distributed into Korean medical societies in 2011. However, inter-rater disagreement issues still exist. The Korean AGREE II scoring guide was therefore developed to reduce inter-rater differences. This study examines the effects of the Korean AGREE II scoring guide to reduce inter-rater differences. Appraisers were randomly assigned to two groups (Scoring Guide group and Non-Scoring Guide group). The Korean AGREE II instrument was provided to both groups. However, the scoring guide was offered to Scoring Guide group only. Total 14 appraisers were participated and each guideline was assessed by 8 appraisers. To evaluate the reliability of the Korean AGREE II scoring guide, correlation of scores among appraisers and domain-specific intra-class correlation (ICC) were compared. Most scores of two groups were comparable. Scoring Guide group showed higher reliability at all guidelines. They showed higher correlation among appraisers and higher ICC values at almost all domains. The scoring guide reduces the inter-rater disagreement and improves the overall reliability of the Korean-AGREE II instrument.

  15. Reliability and Validity of Web-Based Portfolio Peer Assessment: A Case Study for a Senior High School's Students Taking Computer Course

    ERIC Educational Resources Information Center

    Chang, Chi-Cheng; Tseng, Kuo-Hung; Chou, Pao-Nan; Chen, Yi-Hui

    2011-01-01

    This study examined the reliability and validity of Web-based portfolio peer assessment. Participants were 72 second-grade students from a senior high school taking a computer course. The results indicated that: 1) there was a lack of consistency across various student raters on a portfolio, or inter-rater reliability; 2) two-thirds of the raters…

  16. Brief Report: Interrater Reliability of Clinical Diagnosis and DSM-IV Criteria for Autistic Disorder: Results of the DSM-IV Autism Field Trial.

    ERIC Educational Resources Information Center

    Klin, Ami; Lang, Jason; Cicchetti, Domenic V.; Volkmar, Fred R.

    2000-01-01

    This study examined the inter-rater reliability of clinician-assigned diagnosis of autism using or not using the criteria specified in the Diagnostic and Statistical Manual IV (DSM-IV). For experienced raters there was little difference in reliability in the two conditions. However, a clinically significant improvement in diagnostic reliability…

  17. Evaluating Rural Progress in Mathematics Achievement: Is "Adequate Yearly Progress" (AYP) Feasible, Valid, Reliable, and Fair? Working Paper.

    ERIC Educational Resources Information Center

    Lee, Jaekyung

    The No Child Left Behind Act requires standards-based accountability for school districts and schools receiving Title I funds. A major component of this policy is to report whether districts and schools are making "adequate yearly progress" (AYP) based on their performance goals. This paper raises questions for rural schools using the…

  18. Utility and Reliability of an App for the System for Observing Play and Recreation in Communities (iSOPARC®)

    ERIC Educational Resources Information Center

    Santos, Maria P. M.; Rech, Cassiano R.; Alberico, Claudia O.; Fermino, Rogério C.; Rios, Ana P.; David, João; Reis, Rodrigo S.; Sarmiento, Olga L.; McKenzie, Thomas L.; Mota, Jorge

    2016-01-01

    The app for the System for Observing Play and Recreation in Communities (iSOPARC®) was developed to enhance System for Observing Play and Recreation in Communities data collection and management. The study aim was to examine the usability and inter-rater reliability of iSOPARC®. Trained observers collected data in 16 park areas in two Latin…

  19. Reliability of a Retail Food Store Survey and Development of an Accompanying Retail Scoring System to Communicate Survey Findings and Identify Vendors for Healthful Food and Marketing Initiatives

    ERIC Educational Resources Information Center

    Ghirardelli, Alyssa; Quinn, Valerie; Sugerman, Sharon

    2011-01-01

    Objective: To develop a retail grocery instrument with weighted scoring to be used as an indicator of the food environment. Participants/Setting: Twenty six retail food stores in low-income areas in California. Intervention: Observational. Main Outcome Measure(s): Inter-rater reliability for grocery store survey instrument. Description of store…

  20. Brief Report: "Quick and (Not So) Dirty" Assessment of Change in Autism--Cross-Cultural Reliability of the Developmental Disabilities CGAS and the OSU Autism CGI

    ERIC Educational Resources Information Center

    Choque Olsson, Nora; Bölte, Sven

    2014-01-01

    There are few evaluated economic tools to assess change in autism. This study examined the inter-rater reliability of the Developmental Disabilities Children's Global Assessment Scale (DD-CGAS), and the OSU Autism Clinical Global Impression (OSU Autism CGI) in a European setting. Using these scales, 16 clinicians with multidisciplinary…

  1. Additional Evidence for the Reliability and Validity of the Student Risk Screening Scale at the High School Level: A Replication and Extension

    ERIC Educational Resources Information Center

    Lane, Kathleen Lynne; Oakes, Wendy P.; Ennis, Robin Parks; Cox, Meredith Lucille; Schatschneider, Christopher; Lambert, Warren

    2013-01-01

    This study reports findings from a validation study of the Student Risk Screening Scale for use with 9th- through 12th-grade students (N = 1854) attending a rural fringe school. Results indicated high internal consistency, test-retest stability, and inter-rater reliability. Predictive validity was established across two academic years, with Spring…

  2. The effect of physician experience on the measurement reliability of the Reimers’ hip migration percentage in children with cerebral palsy

    PubMed Central

    Analan, Pınar Doruk; Yilmaz, Emine Ece; Adam, Mehmet; Leblebici, Berrin

    2015-01-01

    [Purpose] Reimers’ hip migration percentage (MP) is commonly used to document the extent of hip displacement in children with cerebral palsy (CP). However, factors such as poor administration of pelvic radiographs, a lack of concentration, inexperience, or a busy clinical environment may result in variations in the MP measurements. The aim of this study was to compare the differences in the MP results of two physiatrists with varying levels of experience to determine the role of experience in the measurement’s accuracy. [Subjects and Methods] This retrospective study included 62 hip radiographs of 31 children with spastic CP. Two physiatrists with different experience levels calculated the baseline MP on two occasions six weeks apart. Correlations, intra- and inter-rater reliabilities, and differences in the MPs were compared. [Results] Correlations and inter- and intra-rater reliabilities of the measurements were excellent. There were no statistically significant intra- or inter-rater differences for either of the two measurement points. Inter-rater correlations for each session were 0.94. [Conclusion] Experience does not appear to be a factor in the evaluation of MP, and inter-rater differences do not cause problems regarding patient follow-up. Therefore, repeated pelvic radiographs are not necessary in the evaluation of MP in children with CP unless indicated. PMID:26644686

  3. An Inter-Rater Comparison of DoD Human Factors Analysis and Classification System (HFACS) and Human Factors Analysis and Classification System-Maritime (HFACS-M)

    DTIC Science & Technology

    2013-09-01

    105  ix LIST OF FIGURES Figure 1.  Reason’s original “Swiss Cheese ” model (From Reason...1997) ......... 1  Figure 2.  The “Swiss Cheese ” model—HFACS version (After Reason, 1990; DoD, 2005...rater reliability for SWOs and non-SWOs were calculated. This process was repeated at the sub-code and category level. Analysis showed that, of the

  4. An investigation of the reliability of Rapid Upper Limb Assessment (RULA) as a method of assessment of children's computing posture.

    PubMed

    Dockrell, Sara; O'Grady, Eleanor; Bennett, Kathleen; Mullarkey, Clare; Mc Connell, Rachel; Ruddy, Rachel; Twomey, Seamus; Flannery, Colleen

    2012-05-01

    Rapid Upper Limb Assessment (RULA) is a quick observation method of posture analysis. RULA has been used to assess children's computer-related posture, but the reliability of RULA on a paediatric population has not been established. The purpose of this study was to investigate the inter-rater and intra-rater reliability of the use of RULA with children. Video recordings of 24 school children were independently viewed by six trained raters who assessed their postures using RULA, on two separate occasions. RULA demonstrated higher intra-rater reliability than inter-rater reliability although both were moderate to good. RULA was more reliable when used for assessing the older children (8-12 years) than with the younger children (4-7 years). RULA may prove useful as part of an ergonomic assessment, but its level of reliability warrants caution for its sole use when assessing children, and in particular, younger children.

  5. Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy-based brain imaging

    NASA Astrophysics Data System (ADS)

    Li, Lin; Zeng, Li; Lin, Zi-Jing; Cazzell, Mary; Liu, Hanli

    2015-05-01

    Test-retest reliability of neuroimaging measurements is an important concern in the investigation of cognitive functions in the human brain. To date, intraclass correlation coefficients (ICCs), originally used in inter-rater reliability studies in behavioral sciences, have become commonly used metrics in reliability studies on neuroimaging and functional near-infrared spectroscopy (fNIRS). However, as there are six popular forms of ICC, the adequateness of the comprehensive understanding of ICCs will affect how one may appropriately select, use, and interpret ICCs toward a reliability study. We first offer a brief review and tutorial on the statistical rationale of ICCs, including their underlying analysis of variance models and technical definitions, in the context of assessment on intertest reliability. Second, we provide general guidelines on the selection and interpretation of ICCs. Third, we illustrate the proposed approach by using an actual research study to assess intertest reliability of fNIRS-based, volumetric diffuse optical tomography of brain activities stimulated by a risk decision-making protocol. Last, special issues that may arise in reliability assessment using ICCs are discussed and solutions are suggested.

  6. Reliability of lower extremity muscle strength measurements with handheld dynamometry in stroke patients during the acute phase: a pilot reliability study

    PubMed Central

    Yen, Hsiao-Ching; Luh, Jer-Junn; Teng, Ting; Pan, Guan-Shuo; Chen, Wen-Shiang; Hsun, Chiang-Chang; Jeng, Jiann-Shing

    2017-01-01

    [Purpose] No literature has described a suitable method for measuring muscle strength in a supine position during acute phase after stroke. This study investigated the feasibility and reliability of using a commercial handheld dynamometer to measure the muscle strengths of the hip flexor, knee extensor, and dorsiflexor in the supine position with a modified method for patients at a stroke intensive care center within 7 days of stroke onset. [Subjects and Methods] Fifteen persons with acute stroke participated in this cross-sectional study. For each patient, the muscle strengths of the hip flexors, knee extensors, and dorsiflexors were measured twice by two testers on the same day. Each patient was re-tested at the same time of day one day later. Inter-rater and test-retest reliability were then determined by the intraclass correlation coefficients (ICCs). [Results] For the three muscle groups, the inter-rater reliability ICCs were all 0.99 and the test-retest reliability ICCs were greater than 0.85. The investigated method thus has good inter-rater reliability and high agreement between the test-retest measurements, with acceptable measurement errors. [Conclusion] The modified method using a handheld dynamometer to test the muscle strength of acute stroke patients is a feasible and reliable method for clinical use. PMID:28265165

  7. Rater reliability and concurrent validity of the Keyboard Personal Computer Style instrument (K-PeCS).

    PubMed

    Baker, Nancy A; Cook, James R; Redfern, Mark S

    2009-01-01

    This paper describes the inter-rater and intra-rater reliability, and the concurrent validity of an observational instrument, the Keyboard Personal Computer Style instrument (K-PeCS), which assesses stereotypical postures and movements associated with computer keyboard use. Three trained raters independently rated the video clips of 45 computer keyboard users to ascertain inter-rater reliability, and then re-rated a sub-sample of 15 video clips to ascertain intra-rater reliability. Concurrent validity was assessed by comparing the ratings obtained using the K-PeCS to scores developed from a 3D motion analysis system. The overall K-PeCS had excellent reliability [inter-rater: intra-class correlation coefficients (ICC)=.90; intra-rater: ICC=.92]. Most individual items on the K-PeCS had from good to excellent reliability, although six items fell below ICC=.75. Those K-PeCS items that were assessed for concurrent validity compared favorably to the motion analysis data for all but two items. These results suggest that most items on the K-PeCS can be used to reliably document computer keyboarding style.

  8. Test-retest, inter- and intra-rater reliability of the flexicurve for evaluation of the spine in children

    PubMed Central

    Sedrez, Juliana A.; Candotti, Cláudia T.; Rosa, Maria I. Z.; Medeiros, Fernanda S.; Marques, Mariana T.; Loss, Jefferson F.

    2016-01-01

    Introduction: The early evaluation of the spine in children is desirable because it is at this stage of development that the greatest changes in the body structures occur. Objective: To determine the test-retest, intra- and inter-rater reliability of the Flexicurve instrument for the evaluation of spinal curvatures in children. Method: Forty children ranging from 5 to 15 years of age were evaluated by two independent evaluators using the Flexicurve to model the spine. The agreement was evaluated using Intraclass Correlation Coefficients (ICC), Standard Error of the Measurement (SEM), and Minimal Detectable Change (MDC). Results: In relation to thoracic kyphosis, the Flexicurve was shown to have excellent correlation in terms of test-retest reliability (ICC2,2=0.87) and moderate correlation in terms of intra-(ICC2,2=0.68) and inter-rater reliability (ICC2,2=0.72). In relation to lumbar lordosis, it was shown to have moderate correlation in terms of test-retest reliability (ICC2,2=0.66) and intra- (ICC2,2=0.50) and inter-rater reliability (ICC=0.56). Conclusion: This evaluation of the reliability of the Flexicurve allows its use in school screening. However, to monitor spinal curvatures in the sagittal plane in children, complementary clinical measures are necessary. Further studies are required to investigate the concurrent validity of the instrument in order to identify its diagnostic capacity. PMID:26786078

  9. The assessment of vibration sense in the musculoskeletal examination: Moving towards a valid and reliable quantitative approach to vibration testing in clinical practice.

    PubMed

    O' Conaire, Eoin; Rushton, Alison; Wright, Chris

    2011-06-01

    Impairment of vibration sense is an early sign of nerve pathology. A range of devices can evaluate vibration sense, with moderate to excellent reliability demonstrated for the Somedic Vibrameter. However, devices are expensive and time-consuming for use in practice, and tuning forks are used but not supported by rigorous research. The aims of this study were to evaluate the inter-rater reliability and precision of a novel device to improve use of a tuning fork, and to evaluate its concurrent validity with the Vibrameter. Following a power calculation, a double-blinded, prospective, reliability and validity study recruited 19 healthy subjects who were tested by two physiotherapists using both instruments testing over the median nerve distribution. Inter-rater reliability was determined using Intraclass Correlation Coefficients, 2.1 (0.798 for the Vibrameter and 0.520 for the tuning fork), and precision using Bland Altman plots and Standard Error of Measurement (Vibrameter 0.289 μm, tuning fork 2.55 s). Concurrent validity using Pearson's Product Moment Correlation was 0.515-0.634. The Vibrameter results support previous reliability studies. The tuning fork and novel device demonstrated a strong correlation with the Vibrameter supporting concurrent validity; although it possesses moderate inter-rater reliability. Further research exploring reliability in pathological populations is now indicated.

  10. Reliability of novice raters in using the movement system impairment approach to classify people with low back pain

    PubMed Central

    Henry, Sharon M.; Van Dillen, Linda R.; Trombley, Andrea R.; Dee, Justine M.; Bunn, Janice Y.

    2013-01-01

    Observational cross sectional study. To examine the inter-rater reliability of novice raters in using the Movement System Impairment (MSI) approach system and to explore the patterns of disagreement in classification errors. The inter-rater reliability of individual tests items used in the MSI approach is moderate to good; however, the reliability of the classification algorithm has been tested only preliminarily. Using previously recorded patient data (n = 21), 13 novice raters classified patients according to the MSI schema. The overall percent agreement using the kappa statistic as well as the agreement/disagreement among pair-wise comparisons in classification assignments were examined. There was an overall 87.4% agreement in the pairs of classification judgments with a kappa coefficient of 0.81 (95% CI: 0.79, 0.83). Raters were most likely to agree on the classification of Flexion (100%) and least likely to agree on the classification of Rotation (84%). The MSI classification algorithm can be learned by novice users and with training, their inter-rater reliability in applying the algorithm for classification judgments is good and similar to that reported in other studies. However, some degree of error persists in the classification decision-making associated with the MSI system, in particular for the Rotation category. PMID:22796388

  11. Food and beverage environment analysis and monitoring system: a reliability study in the school food and beverage environment.

    PubMed

    Bullock, Sally Lawrence; Craypo, Lisa; Clark, Sarah E; Barry, Jason; Samuels, Sarah E

    2010-07-01

    States and school districts around the country are developing policies that set nutrition standards for competitive foods and beverages sold outside of the US Department of Agriculture's reimbursable school lunch program. However, few tools exist for monitoring the implementation of these new policies. The objective of this research was to develop a computerized assessment tool, the Food and Beverage Environment Analysis and Monitoring System (FoodBEAMS), to collect data on the competitive school food environment and to test the inter-rater reliability of the tool among research and nonresearch professionals. FoodBEAMS was used to collect data in spring 2007 on the competitive foods and beverages sold in 21 California high schools. Adherence of the foods and beverages to California's competitive food and beverage nutrition policies for schools (Senate Bills 12 and 965) was determined using the data collected by both research and nonresearch professionals. The inter-rater reliability between the data collectors was assessed using the intraclass correlation coefficient. Researcher vs researcher and researcher vs nonresearcher inter-rater reliability was high for both foods and beverages, with intraclass correlation coefficients ranging from .972 to .987. Results of this study provide evidence that FoodBEAMS is a promising tool for assessing and monitoring adherence to nutrition standards for competitive foods sold on school campuses and can be used reliably by both research and nonresearch professionals.

  12. Inter and Intra Rater Reliability of the 10 Meter Walk Test in the Community Dweller Adults with Spastic Cerebral Palsy

    PubMed Central

    BAHRAMI, Fariba; NOORIZADEH DEHKORDI, Shohreh; DADGOO, Mehdi

    2017-01-01

    Objective We aimed to investigation the intra-rater and inter-raters reliability of the 10 meter walk test (10 MWT) in adults with spastic cerebral palsy (CP). Materials & Methods Thirty ambulatory adults with spastic CP in the summer of 2014 participated (19 men, 11 women; mean age 28 ± 7 yr, range 18- 46 yr). Individuals were non-randomly selected by convenient sampling from the Ra’ad Rehabilitation Goodwill Complex in Tehran, Iran. They had GMFCS levels below IV (I, II, and III). Retest interval for inter-raters study lasted a week. During the tests, participants walked with their maximum speed. Intraclass correlation coefficients (ICC) estimated reliability. Results The 10 MWT ICC for intra-rater was 0.98 (95% confidence interval (CI) 0.96-0.99) for participants, and >0.89 in GMFCS subgroups (95% confidence interval (CI) lower bound>0.67). The 10 MWT inter-raters’ ICC was 0.998 (95% confidence interval (CI) 0/996-0/999), and >0.993 in GMFCS subgroups (95% confidence interval (CI) lower bound>0.977). Standard error of the measurement (SEM) values for both studies was small (0.02< SEM< 0.07). Conclusion Excellent intra-rater and inter-raters reliability of the 10 MWT in adults with CP, especially in the moderate motor impairments (GMFCS level III), indicates that this tool can be used in clinics to assess the results of interventions. PMID:28277557

  13. Reliability of measuring the passive range of shoulder horizontal adduction using a smartphone in the supine versus the side-lying position.

    PubMed

    Lim, Jin-Yong; Kim, Tae-Ho; Lee, Jung-Seok

    2015-10-01

    [Purpose] The purpose of this study was to compare the reliability of the measurement of the passive range of motion (PROM) of shoulder horizontal adduction (SHA) measurements using a smartphone for the assessment posterior shoulder tightness (PST) between the side-lying and supine test positions. [Subjects and Methods] Forty-seven subjects (mean ± age, 24.9 ± 3.5 years) without shoulder pathology were included in this study. Intra-rater and inter-rater reliabilities were determined using intraclass correlation coefficients. The SHA PROM of each subject's dominant shoulder was measured using a smartphone by two investigators in two positions: the standard supine position, and a side-lying position on the tested side. [Results] The intra-rater reliability of the supine measurements was fair to good (ICC3,1 = 0.72-0.89), and for the side-lying measurements was excellent (ICC3,1 = 0.95-0.97). The inter-rater reliability of the supine measurements was fair (ICC2,2 = 0.79) and for the side-lying measurements was excellent (ICC2,2 = 0.94). [Conclusion] These results suggest that for healthy subjects, measurements of SHA using smartphones in the side-lying position has superior intra-rater and inter-rater reliabilities compared to the standard supine position.

  14. Reliability of measuring the passive range of shoulder horizontal adduction using a smartphone in the supine versus the side-lying position

    PubMed Central

    Lim, Jin-Yong; Kim, Tae-Ho; Lee, Jung-Seok

    2015-01-01

    [Purpose] The purpose of this study was to compare the reliability of the measurement of the passive range of motion (PROM) of shoulder horizontal adduction (SHA) measurements using a smartphone for the assessment posterior shoulder tightness (PST) between the side-lying and supine test positions. [Subjects and Methods] Forty-seven subjects (mean ± age, 24.9 ± 3.5 years) without shoulder pathology were included in this study. Intra-rater and inter-rater reliabilities were determined using intraclass correlation coefficients. The SHA PROM of each subject’s dominant shoulder was measured using a smartphone by two investigators in two positions: the standard supine position, and a side-lying position on the tested side. [Results] The intra-rater reliability of the supine measurements was fair to good (ICC3,1 = 0.72–0.89), and for the side-lying measurements was excellent (ICC3,1 = 0.95–0.97). The inter-rater reliability of the supine measurements was fair (ICC2,2 = 0.79) and for the side-lying measurements was excellent (ICC2,2 = 0.94). [Conclusion] These results suggest that for healthy subjects, measurements of SHA using smartphones in the side-lying position has superior intra-rater and inter-rater reliabilities compared to the standard supine position. PMID:26644657

  15. The importance of establishing reliability and validity of assessment instruments for mental health problems: An example from Somali children and adolescents living in three refugee camps in Ethiopia

    PubMed Central

    Hall, Brian J.; Puffer, Eve; Murray, Laura K.; Ismael, Abdulkadir; Bass, Judith K.; Sim, Amanda; Bolton, Paul A.

    2014-01-01

    Assessing mental health problems cross-culturally for children exposed to war and violence presents a number of unique challenges. One of the most important issues is the lack of validated symptom measures to assess these problems. The present study sought to evaluate the psychometric properties of two measures to assess mental health problems: the Achenbach Youth Self-Report and the Child Posttraumatic Stress Disorder Symptom Scale. We conducted a validity study in three refugee camps in Eastern Ethiopia in the outskirts of Jijiga, the capital of the Somali region. A total of 147 child and caregiver pairs were assessed, and scores obtained were submitted to rigorous psychometric evaluation. Excellent internal consistency reliability was obtained for symptom measures for children and their caregivers. Validation of study instruments based on local case definitions was obtained for the caregivers but not consistently for the children. Sensitivity and specificity of study measures were generally low, indicating that these scales would not perform adequately as screening instruments. Combined test-retest and inter-rater reliability was low for all scales. This study illustrates the need for validation and testing of existing measures cross-culturally. Methodological implications for future cross-cultural research studies in low- and middle-income countries are discussed. PMID:24955147

  16. Food and Beverage Environment Analysis and Monitoring System (FoodBEAMS™): A Reliability Study in the School Food and Beverage Environment

    PubMed Central

    Bullock, Sally Lawrence; Craypo, Lisa; Clark, Sarah E.; Barry, Jason; Samuels, Sarah E.

    2010-01-01

    States and school districts around the country are developing policies that set nutrition standards for competitive foods and beverages sold outside of the United States Department of Agriculture reimbursable school lunch program. However, few tools exist for monitoring the implementation of these new policies. The objective of this research was to develop a computerized assessment tool, the Food and Beverage Environment Analysis and Monitoring System (FoodBEAMS™), to collect data on the competitive school food environment and to test the inter-rater reliability of the tool among research and non-research professionals. FoodBEAMS was used to collect data in spring 2007, on the competitive foods and beverages sold in 21 California high schools. Adherence of the foods and beverages to California's competitive food and beverage nutrition policies for schools (Senate Bills 12 and 965) was determined using the data collected by both research and non-research professionals. The inter-rater reliability between the data collectors was assessed using the intraclass correlation coefficient (ICC). Researcher versus researcher and researcher versus non-researcher inter-rater reliability was high for both foods and beverages, with ICCs ranging from .972 to .987. The results of this study provide evidence that FoodBEAMS is a promising tool for assessing and monitoring adherence to nutrition standards for competitive foods sold on school campuses and can be used reliably by both research and non-research professionals. PMID:20630167

  17. Reliability of Fiber Tracking Measurements in Diffusion Tensor Imaging for Longitudinal Study

    PubMed Central

    Danielian, Laura E.; Iwata, Nobue K.; Thomasson, David M.; Floeter, Mary Kay

    2009-01-01

    The statistical reliability of diffusion property measurements was evaluated in ten healthy subjects using deterministic fiber tracking to localize tracts affected in motor neuron disease: corticospinal tract (CST), uncinate fasciculus (UNC), and the corpus callosum in its entirety (CC), and its genu (GE), motor (CCM), and splenium (SP) fibers separately. Measurements of fractional anisotropy (FA), mean diffusivity (MD), axial diffusivity (λ1), transverse diffusivity (λ⊥), and volume of voxels containing fibers (VV) were obtained within each tract. To assess intra-rater and inter-rater reliability, two raters carried out fiber tracking five times on each scan. Scan-rescan and longitudinal reliability were assessed in a subset of four subjects who had six scans, with two sets of three scans separated by one year. The statistical reliability of repeated measurements was evaluated using intra-class correlation coefficients (ICC) and coefficients of variation (CV). Spatial agreement of tract shape was assessed using the kappa (κ) statistic. Results Repeated same-scan fiber tracking evaluations showed good geometric alignment (intra-rater κ > 0.90, inter-rater κ > 0.76) and reliable diffusion property measurements (intra-rater ICC > 0.92, inter-rater ICC > 0.77). FA, MD, and λ⊥ were highly reliable with repeated scans on different days, up to a year apart (ICC > 0.8). VV also exhibited good reliability, but with higher CVs. We were unable to demonstrate reproducibility of λ1. Longitudinal reliability after one year was improved by averaging measurements from multiple scans at each timepoint. Fiber tracking provides a reliable tool for the longitudinal evaluation of white matter diffusion properties. PMID:19744567

  18. Reliability of the inter-rectus distance measured by palpation. Comparison of palpation and ultrasound measurements.

    PubMed

    Mota, Patrícia; Pascoal, Augusto Gil; Sancho, Fátima; Carita, Ana Isabel; Bø, Kari

    2013-08-01

    An increased inter-rectus distance (IRD) is a common condition in late pregnancy and in the postnatal period. The condition is difficult to assess. Palpation is the most commonly used method to assess IRD. To date there is scant knowledge of intra and inter-tester reliability of palpation to measure IRD and how palpation compares with ultrasound measurements. The aims of this study were: 1) evaluate intra and inter-rater reliability of abdominal palpation; 2) validate abdominal palpation of IRD measurements using ultrasound imaging as a reference. Two physiotherapists (PTs) conducted the palpation study in random order, blinded to each other's assessments. IRD was measured as finger widths between the two rectus abdominis (RA) muscles. Ultrasound images were recorded at the same locations as the palpation test. A blinded investigator measured the IRD offline. Palpation showed good intra-rater reliability between days expressed by a weighted Kappa (wK) higher than 0.7 for both physiotherapists, and moderate inter-rater reliability (wK = 0.534). Ultrasound was found to be more responsive for differences in IRD compared with values obtained by palpation. The intra-rater reliability was higher than the inter-rater reliability. Besides the difference in experience with palpation testing between the PTs, this result may be due to differences in finger width and/or the subjective interpretation of abdominal soft-tissues pressure. Ultrasound measures are highly sensitive to changes of IRD, which is not possible to replicate by palpation assessment using a finger width scale. Palpation has sufficient reliability to be used in clinical practice. However, ultrasound is a more accurate and valid method and is recommended in future research of IRD.

  19. The Structured Clinical Interview for Complicated Grief: Reliability, Validity, and Exploratory Factor Analysis

    PubMed Central

    Bui, Eric; Mauro, Christine; Robinaugh, Donald J.; Skritskaya, Natalia A.; Wang, Yuanjia; Gribbin, Colleen; Ghesquiere, Angela; Horenstein, Arielle; Duan, Naihua; Reynolds, Charles; Zisook, Sidney; Simon, Naomi M.; Shear, M. Katherine

    2015-01-01

    Background Complicated grief (CG) has been recently included in the DSM-5, under the term “Persistent Complex Bereavement Disorder”, as a condition requiring further study. To our knowledge, no psychometric data on any structured clinical interview of CG is available to date. In this manuscript, we introduce the Structured Clinical Interview for CG (SCI-CG) a 31-item “SCID-like” clinician-administered instrument to assess the presence of CG symptoms. Methods Participants were 281 treatment-seeking adults with CG (77.9% (n=219) women, mean age = 52.4, SD = 17.8) who were assessed with the SCI-CG and measures of depression, posttraumatic stress, anxiety, functional impairment. Results The SCI-CG exhibited satisfactory internal consistency (α = .78), good test-retest reliability (Inter-class correlation [ICC] 0.68, 95% CI [0.60, 0.75]), and excellent inter-rater reliability (ICC=0.95, 95% CI [0.89, 0.98]). Exploratory factor analyses revealed that a five-factor structure, explaining 50.3% of the total variance, was the best fit for the data. Conclusions The clinician-rated SCI-CG demonstrates good internal consistency, reliability, and convergent validity in treatment-seeking individuals with CG and therefore can be a useful tool to assess CG. Although diagnostic criteria for CG have yet to be adequately validated, the SCI-CG may facilitate this process. The SCI-CG can now be used as a validated instrument in research and clinical practice. PMID:26061724

  20. Inter- and intra-rater reliability of the GAITRite system among individuals with sub-acute stroke.

    PubMed

    Wong, Jennifer S; Jasani, Hardika; Poon, Vivien; Inness, Elizabeth L; McIlroy, William E; Mansfield, Avril

    2014-01-01

    Technology-based assessment tools with semi-automated processing, such as pressure-sensitive mats used for gait assessment, may be considered to be objective; therefore it may be assumed that rater reliability is not a concern. However, user input is often required and rater reliability must be determined. The purpose of this study was to assess the inter- and intra-rater reliability of spatial and temporal characteristics of gait in stroke patients using the GAITRite system. Forty-six individuals with stroke attending in-patient rehabilitation walked across the pressure-sensitive mat 2-4 times at preferred walking speeds, with or without a gait aid. Five raters independently processed gait data. Three raters re-processed the data after a delay of at least one month. The intraclass correlation coefficients (ICC) and 95% confidence intervals of the ICC were determined for velocity, step time, step length, and step width. Inter-rater reliability for velocity, step time, and step length were high (ICC>0.90). Intra-rater reliability was generally greater than inter-rater reliability (from 0.81 to >0.99 for inter-rater versus 0.77 to >0.99 for intra-rater reliability). Overall, this study suggests that GAITRite is a reliable assessment tool; however, there still remains subjectivity in processing the data, resulting in no patients with perfect agreement between raters. Additional logic checking within the processing software or standardization of training could help to reduce potential errors in processing.

  1. Reliability and criterion-related validity of the 20-yard shuttle test in competitive junior tennis players

    PubMed Central

    Eriksson, Anna; Johansson, Fredrik R; Bäck, Maria

    2015-01-01

    Purpose This study adds to the previous work in the field of sport-specific fitness testing by evaluating a tennis-specific agility test called “the 20-yard shuttle test”. The aim of the study was to evaluate the test–retest reliability, the inter-rater reliability, and the criterion-related validity of the 20-yard shuttle test on competitive junior tennis players. Participants and methods Totally, 34 Swedish tennis players (13 girls), mean age 14±1.6 years, participated in the study. To examine test–retest reliability, the subjects performed the 20-yard shuttle test three times on the same day and then the same procedure was repeated after 3 days. To test the inter-rater reliability, the time was measured with a stopwatch simultaneously by two different raters. The time recorded manually was compared to the gold standard of digital timing to evaluate the criterion-related validity. Results Excellent test–retest reliability was found both within the same day (intraclass correlation coefficient [ICC] 0.95) and between days (ICC 0.91). Furthermore, the results showed excellent inter-rater reliability (ICC 0.99) and criterion-related validity on both test occasions (ICC 0.99). Conclusion We have provided introductory support for the 20-yard shuttle test as a reliable and valid test for use in competitive junior tennis players. The ease of administration makes this test a practical alternative to evaluate physical fitness in order to optimally train the athletes. PMID:26316829

  2. Reliability of 3D laser-based anthropometry and comparison with classical anthropometry

    PubMed Central

    Kuehnapfel, Andreas; Ahnert, Peter; Loeffler, Markus; Broda, Anja; Scholz, Markus

    2016-01-01

    Anthropometric quantities are widely used in epidemiologic research as possible confounders, risk factors, or outcomes. 3D laser-based body scans (BS) allow evaluation of dozens of quantities in short time with minimal physical contact between observers and probands. The aim of this study was to compare BS with classical manual anthropometric (CA) assessments with respect to feasibility, reliability, and validity. We performed a study on 108 individuals with multiple measurements of BS and CA to estimate intra- and inter-rater reliabilities for both. We suggested BS equivalents of CA measurements and determined validity of BS considering CA the gold standard. Throughout the study, the overall concordance correlation coefficient (OCCC) was chosen as indicator of agreement. BS was slightly more time consuming but better accepted than CA. For CA, OCCCs for intra- and inter-rater reliability were greater than 0.8 for all nine quantities studied. For BS, 9 of 154 quantities showed reliabilities below 0.7. BS proxies for CA measurements showed good agreement (minimum OCCC > 0.77) after offset correction. Thigh length showed higher reliability in BS while upper arm length showed higher reliability in CA. Except for these issues, reliabilities of CA measurements and their BS equivalents were comparable. PMID:27225483

  3. Assessing local instrument reliability and validity: a field-based example from northern Uganda.

    PubMed

    Betancourt, Theresa S; Bass, Judith; Borisova, Ivelina; Neugebauer, Richard; Speelman, Liesbeth; Onyango, Grace; Bolton, Paul

    2009-08-01

    This paper presents an approach for evaluating the reliability and validity of mental health measures in non-Western field settings. We describe this approach using the example of our development of the Acholi psychosocial assessment instrument (APAI), which is designed to assess depression-like (two tam, par and kumu), anxiety-like (ma lwor) and conduct problems (kwo maraco) among war-affected adolescents in northern Uganda. To examine the criterion validity of this measure in the absence of a traditional gold standard, we derived local syndrome terms from qualitative data and used self reports of these syndromes by indigenous people as a reference point for determining caseness. Reliability was examined using standard test-retest and inter-rater methods. Each of the subscale scores for the depression-like syndromes exhibited strong internal reliability ranging from alpha = 0.84-0.87. Internal reliability was good for anxiety (0.70), conduct problems (0.83), and the pro-social attitudes and behaviors (0.70) subscales. Combined inter-rater reliability and test-retest reliability were good for most subscales except for the conduct problem scale and prosocial scales. The pattern of significant mean differences in the corresponding APAI problem scale score between self-reported cases vs. noncases on local syndrome terms was confirmed in the data for all of the three depression-like syndromes, but not for the anxiety-like syndrome ma lwor or the conduct problem kwo maraco.

  4. Reliability of different methodologies of infrared image analysis of myofascial trigger points in the upper trapezius muscle

    PubMed Central

    Dibai-Filho, Almir V.; Guirro, Elaine C. O.; Ferreira, Vânia T. K.; Brandino, Hugo E.; Vaz, Maíta M. O. L. L.; Guirro, Rinaldo R. J.

    2015-01-01

    BACKGROUND: Infrared thermography is recognized as a viable method for evaluation of subjects with myofascial pain. OBJECTIVE: The aim of the present study was to assess the intra- and inter-rater reliability of infrared image analysis of myofascial trigger points in the upper trapezius muscle. METHOD: A reliability study was conducted with 24 volunteers of both genders (23 females) between 18 and 30 years of age (22.12±2.54), all having cervical pain and presence of active myofascial trigger point in the upper trapezius muscle. Two trained examiners performed analysis of point, line, and area of the infrared images at two different periods with a 1-week interval. The intra-class correlation coefficient (ICC2,1) was used to assess the intra- and inter-rater reliability. RESULTS: With regard to the intra-rater reliability, ICC values were between 0.591 and 0.993, with temperatures between 0.13 and 1.57 °C for values of standard error of measurement (SEM) and between 0.36 and 4.35 °C for the minimal detectable change (MDC). For the inter-rater reliability, ICC ranged from 0.615 to 0.918, with temperatures between 0.43 and 1.22 °C for the SEM and between 1.19 and 3.38 °C for the MDC. CONCLUSION: The methods of infrared image analyses of myofascial trigger points in the upper trapezius muscle employed in the present study are suitable for clinical and research practices. PMID:25993626

  5. Building a reliable measure for unobtrusive observations of street-connecting pedestrian walkways.

    PubMed

    Wilson, Nick; Brander, Bill; Mansoor, Osman D; Pearson, Amber L

    2014-12-01

    There is evidence that good urban design, including street connectivity, facilitates walking for transport. We, therefore, piloted a short survey on 118 such walkways in nine suburbs in Wellington, New Zealand's capital. The instrument appeared feasible to use and performed well in terms of inter-rater reliability (median Kappa score for 15 items: 0.88). The study identified both favorable features (e.g., railings by steps), but also problematic ones (e.g., concerning graffiti, litter, and insufficient lighting and signage). There is scope for routinising the monitoring of walkway quality so that citizens and government agencies can work together to enhance urban walkability.

  6. Clinical measurement of craniovertebral angle by electronic head posture instrument: a test of reliability and validity.

    PubMed

    Cheung Lau, Herman Mun; Wing Chiu, Thomas Tai; Lam, Tai-Hing

    2009-08-01

    The study was a cross-sectional reliability study with the objective of assessing the reliability and validity of the Electronic Head Posture Instrument (EHPI) in measuring the craniovertebral (CV) angle for subjects with or without neck pain. Twenty-six subjects (mean age=36.88, SD+/-9.95) with chronic neck pain and 27 subjects (mean age=31.85, SD+/-7.63) without neck pain were recruited. The CV angle was measured by the EHPI which consists of an electronic angle finder, a transparent plastic base and a camera stand. Two therapists were recruited to assess the intra- and inter-rater reliability of the EHPI in two separate sessions of measurement. The difference in CV angle between the two groups was determined. The CV angle of the patient group (mean 43.94, SD+/-3.61) was significantly smaller (p<0.001) than that of the normal group (mean 50.58, SD+/-2.09). Intra-rater (intra-class correlation coefficient (ICC) ranged from 0.86 to 0.94) and inter-rater (ICC ranged from 0.85 to 0.91) reliability of the EHPI in measuring CV angle for both groups of subjects were high. In conclusion the EHPI was found to be reliable and valid in measuring the CV angle for subjects with or without neck pain.

  7. Entorhinal cortex volume in older adults: reliability and validity considerations for three published measurement protocols.

    PubMed

    Price, C C; Wood, M F; Leonard, C M; Towler, S; Ward, J; Montijo, H; Kellison, I; Bowers, D; Monk, T; Newcomer, J C; Schmalfuss, I

    2010-09-01

    Measuring the entorhinal cortex (ERC) is challenging due to lateral border discrimination from the perirhinal cortex. From a sample of 39 nondemented older adults who completed volumetric image scans and verbal memory indices, we examined reliability and validity concerns for three ERC protocols with different lateral boundary guidelines (i.e., Goncharova, Dickerson, Stoub, & deToledo-Morrell, 2001; Honeycutt et al., 1998; Insausti et al., 1998). We used three novice raters to assess inter-rater reliability on a subset of scans (216 total ERCs), with the entire dataset measured by one rater with strong intra-rater reliability on each technique (234 total ERCs). We found moderate to strong inter-rater reliability for two techniques with consistent ERC lateral boundary endpoints (Goncharova, Honeycutt), with negligible to moderate reliability for the technique requiring consideration of collateral sulcal depth (Insausti). Left ERC and story memory associations were moderate and positive for two techniques designed to exclude the perirhinal cortex (Insausti, Goncharova), with the Insausti technique continuing to explain 10% of memory score variance after additionally controlling for depression symptom severity. Right ERC-story memory associations were nonexistent after excluding an outlier. Researchers are encouraged to consider challenges of rater training for ERC techniques and how lateral boundary endpoints may impact structure-function associations.

  8. Video training and certification program improves reliability of postischemic neurologic deficit measurement in the rat.

    PubMed

    Taninishi, Hideki; Pearlstein, Molly; Sheng, Huaxin; Izutsu, Miwa; Chaparro, Rafael E; Goldstein, Larry B; Warner, David S

    2016-12-01

    Scoring systems are used to measure behavioral deficits in stroke research. Video-assisted training is used to standardize stroke-related neurologic deficit scoring in humans. We hypothesized that a video-assisted training and certification program can improve inter-rater reliability in assessing neurologic function after middle cerebral artery occlusion in rats. Three expert raters scored neurologic deficits in post-middle cerebral artery occlusion rats using three published systems having different complexity levels (3, 18, or 48 points). The system having the highest point estimate for the correlation between neurologic score and infarct size was selected to create a video-assisted training and certification program. Eight trainee raters completed the video-assisted training and certification program. Inter-rater agreement ( Κ: score) and agreement with expert consensus scores were measured before and after video-assisted training and certification program completion. The 48-point system correlated best with infarct size. Video-assisted training and certification improved agreement with expert consensus scores (pretraining = 65 ± 10, posttraining = 87 ± 14, 112 possible scores, P < 0.0001), median number of trainee raters with scores within ±2 points of the expert consensus score (pretraining = 4, posttraining = 6.5, P < 0.01), categories with Κ:  > 0.4 (pretraining = 4, posttraining = 9), and number of categories with an improvement in the Κ: score from pretraining to posttraining (n = 6). Video-assisted training and certification improved trainee inter-rater reliability and agreement with expert consensus behavioral scores in rats after middle cerebral artery occlusion. Video-assisted training and certification may be useful in multilaboratory preclinical studies.

  9. The Brazilian version of the Neuropsychiatric Inventory-Clinician rating (NPI-C): Reliability and validity in dementia

    PubMed Central

    Stella, Florindo; Forlenza, Orestes Vicente; Laks, Jerson; de Andrade, Larissa Pires; Ljubetic Avendaño, Michelle A.; Gasparetto Sé, Elisandra Villela; de Castilho Cação, João; Lyketsos, Constantine G.; de Medeiros, Kate

    2014-01-01

    Background Patients with dementia may be unable to describe their symptoms, and caregivers frequently suffer emotional burden that can interfere with judgment of the patient's behavior. The Neuropsychiatric Inventory-Clinician Rating Scale (NPI-C) is a comprehensive and versatile instrument to assess neuropsychiatric symptoms (NPS) in dementia. In the NPI-C, the clinician incorporates information from caregiver and patient interviews, and any other relevant available data to accurately measure NPS. The present study is a followup to the original, cross-national NPI-C validation evaluating the reliability and concurrent validity of NPI-C in quantifying psychopathological symptoms in dementia in a large Brazilian cohort. Methods Two blind raters evaluated 312 participants (156 patient-knowledgeable informant dyads) with the NPI-C totaling 624 observations in 5 Brazilian centers. Inter-rater reliability was determined through calculation of intraclass correlation coefficients for the NPI-C domains and traditional NPI. Convergent validity included correlations of specific domains of the NPI-C with the Brief Psychiatric Rating Scale (BPRS); the Cohen Mansfield Agitation Index (CMAI); the Cornell Scale for Depression in Dementia (CSDD); and the Apathy Inventory (AI). Results Inter-rater reliability was strong for all NPI-C domains. There were high correlations between NPI-C/Delusions and BPRS; NPI-C/Apathy-Indifference with the AI; NPI-C/Depression-Dysphoria with the CSDD; NPI-C/Agitation with the CMAI; and NPI-C/Aggression with the CMAI. There was moderate correlation between the NPI-C/Aberrant Vocalizations and CMAI and the NPI-C/Hallucinations with the BPRS. Conclusion The NPI-C is a comprehensive tool which provides accurate measurement of NPS in dementia with high concurrent validity and inter-rater reliability in the Brazilian setting. In addition to universal assessment, the NPI-C can be completed by individual domains. PMID:23763895

  10. Reliability of Health-Related Physical Fitness Tests among Colombian Children and Adolescents: The FUPRECOL Study.

    PubMed

    Ramírez-Vélez, Robinson; Rodrigues-Bezerra, Diogo; Correa-Bautista, Jorge Enrique; Izquierdo, Mikel; Lobelo, Felipe

    2015-01-01

    Substantial evidence indicates that youth physical fitness levels are an important marker of lifestyle and cardio-metabolic health profiles and predict future risk of chronic diseases. The reliability physical fitness tests have not been explored in Latino-American youth population. This study's aim was to examine the reliability of health-related physical fitness tests that were used in the Colombian health promotion "Fuprecol study". Participants were 229 Colombian youth (boys n = 124 and girls n = 105) aged 9 to 17.9 years old. Five components of health-related physical fitness were measured: 1) morphological component: height, weight, body mass index (BMI), waist circumference, triceps skinfold, subscapular skinfold, and body fat (%) via impedance; 2) musculoskeletal component: handgrip and standing long jump test; 3) motor component: speed/agility test (4x10 m shuttle run); 4) flexibility component (hamstring and lumbar extensibility, sit-and-reach test); 5) cardiorespiratory component: 20-meter shuttle-run test (SRT) to estimate maximal oxygen consumption. The tests were performed two times, 1 week apart on the same day of the week, except for the SRT which was performed only once. Intra-observer technical errors of measurement (TEMs) and inter-rater (reliability) were assessed in the morphological component. Reliability for the Musculoskeletal, motor and cardiorespiratory fitness components was examined using Bland-Altman tests. For the morphological component, TEMs were small and reliability was greater than 95% of all cases. For the musculoskeletal, motor, flexibility and cardiorespiratory components, we found adequate reliability patterns in terms of systematic errors (bias) and random error (95% limits of agreement). When the fitness assessments were performed twice, the systematic error was nearly 0 for all tests, except for the sit and reach (mean difference: -1.03% [95% CI = -4.35% to -2.28%]. The results from this study indicate that the "Fuprecol

  11. Reliability of Health-Related Physical Fitness Tests among Colombian Children and Adolescents: The FUPRECOL Study

    PubMed Central

    Ramírez-Vélez, Robinson; Rodrigues-Bezerra, Diogo; Correa-Bautista, Jorge Enrique; Izquierdo, Mikel; Lobelo, Felipe

    2015-01-01

    Substantial evidence indicates that youth physical fitness levels are an important marker of lifestyle and cardio-metabolic health profiles and predict future risk of chronic diseases. The reliability physical fitness tests have not been explored in Latino-American youth population. This study’s aim was to examine the reliability of health-related physical fitness tests that were used in the Colombian health promotion “Fuprecol study”. Participants were 229 Colombian youth (boys n = 124 and girls n = 105) aged 9 to 17.9 years old. Five components of health-related physical fitness were measured: 1) morphological component: height, weight, body mass index (BMI), waist circumference, triceps skinfold, subscapular skinfold, and body fat (%) via impedance; 2) musculoskeletal component: handgrip and standing long jump test; 3) motor component: speed/agility test (4x10 m shuttle run); 4) flexibility component (hamstring and lumbar extensibility, sit-and-reach test); 5) cardiorespiratory component: 20-meter shuttle-run test (SRT) to estimate maximal oxygen consumption. The tests were performed two times, 1 week apart on the same day of the week, except for the SRT which was performed only once. Intra-observer technical errors of measurement (TEMs) and inter-rater (reliability) were assessed in the morphological component. Reliability for the Musculoskeletal, motor and cardiorespiratory fitness components was examined using Bland–Altman tests. For the morphological component, TEMs were small and reliability was greater than 95% of all cases. For the musculoskeletal, motor, flexibility and cardiorespiratory components, we found adequate reliability patterns in terms of systematic errors (bias) and random error (95% limits of agreement). When the fitness assessments were performed twice, the systematic error was nearly 0 for all tests, except for the sit and reach (mean difference: -1.03% [95% CI = -4.35% to -2.28%]. The results from this study indicate that the

  12. Reliability and Validity of a Chinese version of the Diagnostic Interview for Borderlines-Revised (DIB-R)

    PubMed Central

    Wang, Lanlan; Yuan, Chenmei; Qiu, Jianying; Gunderson, John; Zhang, Min; Jiang, Kaida; Leung, Freedom; Zhong, Jie; Xiao, Zeping

    2014-01-01

    Background Borderline personality disorder (BPD) is the most studied of the Axis II disorders. One of the most widely used diagnostic instruments is the Diagnostic Interview for Borderline Patients - Revised (DIB-R). The aim of this study was to test the reliability and validity of DIB-R for use in the Chinese culture. Methods The reliability and validity of the DIB-R Chinese version were assessed in a sample of 236 outpatients with a probable BPD diagnosis. The Structured Clinical Interview for DSM-IV Personality Disorders (SCID-II) was used as a standard. Test/re-test reliability was tested at 6 months later with 20 patients and inter-rater reliability was tested on 32 patients. Results The Chinese version of the DIB-R showed good internal global consistency (Cronbach’s alpha of 0.916), good test-retest reliability (Pearson correlation of 0.704), good inter-raters reliability (ICC of 0.892 and Kappa of 0.861). When compared to the DSM-IV diagnosis as measured by the SCID-II, the DIB-R showed relatively good sensitivity (0.768) and specificity (0.891) at the cutoff of 7; moderate diagnostic convergence (Kappa of 0.631), as well as good discriminating validity. Conclusion The Chinese version of the DIB-R has good psychometric properties, which renders it a valuable method for examining the presence, the severity and component phenotypes of BPD in Chinese samples. PMID:24302703

  13. Development of a peer review system using patient records for outcome evaluation of medical education: reliability analysis.

    PubMed

    Kameoka, Junichi; Okubo, Tomoya; Koguma, Emi; Takahashi, Fumie; Ishii, Seiichi; Kanatsuka, Hiroshi

    2014-01-01

    In addition to input evaluation (education delivered at school) and output evaluation (students' capability at graduation), the methods for outcome evaluation (performance after graduation) of medical education need to be established. One approach is a review of medical records, which, however, has been met with difficulties because of poor inter-rater reliability. Here, we attempted to develop a peer review system of medical records with high inter-rater reliability. We randomly selected 112 patients (and finally selected 110 after removing two ineligible patients) who visited (and were hospitalized in) one of the four general hospitals in the Tohoku region of Japan between 2008 and 2012. Four reviewers, who were well-trained general internists from outside the Tohoku region, visited the hospitals independently and evaluated outpatient medical records based on an evaluation sheet that consisted of 14 items (3-point scale) for record keeping and 15 items (5-point scale) for quality of care. The mean total score was 84.1 ± 7.7. Cronbach's alpha for these items was 0.798. Single measure and average measure intraclass correlations for the reviewers were 0.733 (95% confidence interval: 0.720-0.745) and 0.917 (95% confidence interval: 0.912-0.921), respectively. An exploratory factor analysis revealed six factors: history taking, physical examination, clinical reasoning, management and outcome, rhetoric, and patient relationship. In conclusion, we have developed a peer review system of medical records with high inter-rater reliability, which may enable us, with further validity analysis, to measure quality of patient care as an outcome evaluation of medical education in the future.

  14. Reliability of ultrasound in combination with surface electromyogram for evaluating the activity of abdominal muscles in individuals with and without low back pain.

    PubMed

    Yang, Kyung-Hye; Park, Du-Jin

    2014-08-01

    This study investigated the reliability of ultrasound in combination with surface electromyogram (EMG) for evaluating the activity of the abdominal muscles in individuals with and without low back pain during the abdominal drawing-in maneuver (ADIM). The study recruited ten individuals with or without low back pain, respectively. While the participants were performing the ADIM, the activities of the transversus abdominis (TrA) and the internal oblique (IO) were measured using ultra-sound, while the activities of the external oblique (EO) and the rectus abdominis (RA) were measured using surface EMG. Intra-class correlation coefficients (ICC) were used to verify the inter-rater reliability of ultrasound in combination with surface EMG at rest and during the ADIM, and Bland-Altman plots were used to verify intra-rater reliability. The inter-rater reliability for the two groups at rest and during the ADIM was excellent (ICC2,1 = 0.77-0.95). In the Bland-Altman plots, the mean differences and 95% limits of agreement in the abdominal muscles of the two groups at rest were -0.03∼0.03 mm (-0.66 to 0.60 mm) and -0.12∼ -0.05 (-0.58 to 0.48% MVIC), respectively. The mean differences and 95% limits of agreement in the abdominal muscles of the two groups during the ADIM were -0.04∼0.02 mm (-0.73 to 0.65 mm) and -0.19∼0.05% MVIC (-1.24 to 1.34% MVIC), respectively. The ultrasound in combination with surface EMG showed excellent inter-rater and intra-rater reliability at rest and during the ADIM.

  15. Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review

    PubMed Central

    Hanskamp-Sebregts, Mirelle; Zegers, Marieke; Vincent, Charles; van Gurp, Petra J; de Vet, Henrica C W; Wollersheim, Hub

    2016-01-01

    Objectives Record review is the most used method to quantify patient safety. We systematically reviewed the reliability and validity of adverse event detection with record review. Design A systematic review of the literature. Methods We searched PubMed, EMBASE, CINAHL, PsycINFO and the Cochrane Library and from their inception through February 2015. We included all studies that aimed to describe the reliability and/or validity of record review. Two reviewers conducted data extraction. We pooled κ values (κ) and analysed the differences in subgroups according to number of reviewers, reviewer experience and training level, adjusted for the prevalence of adverse events. Results In 25 studies, the psychometric data of the Global Trigger Tool (GTT) and the Harvard Medical Practice Study (HMPS) were reported and 24 studies were included for statistical pooling. The inter-rater reliability of the GTT and HMPS showed a pooled κ of 0.65 and 0.55, respectively. The inter-rater agreement was statistically significantly higher when the group of reviewers within a study consisted of a maximum five reviewers. We found no studies reporting on the validity of the GTT and HMPS. Conclusions The reliability of record review is moderate to substantial and improved when a small group of reviewers carried out record review. The validity of the record review method has never been evaluated, while clinical data registries, autopsy or direct observations of patient care are potential reference methods that can be used to test concurrent validity. PMID:27550650

  16. The Reliability and Validity of the Complex Task Performance Assessment: A Performance-Based Assessment of Executive Function

    PubMed Central

    Wolf, Timothy J.; Dahl, Abigail; Auen, Colleen; Doherty, Meghan

    2015-01-01

    The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): An ecologically-valid performance-based assessment of executive function. Community control participants (n = 20) and individuals with mild stroke (n = 14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was 0.991. The ICCs for all of the sub scores of the CTPA were also high (0.889-0.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (ρ = −0.425), and the Wechsler Test of Adult Reading (ρ = −0.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p = 0.007) and all sub scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function. PMID:25939359

  17. The reliability and validity of the Complex Task Performance Assessment: A performance-based assessment of executive function.

    PubMed

    Wolf, Timothy J; Dahl, Abigail; Auen, Colleen; Doherty, Meghan

    2015-05-05

    The objective of this study was to evaluate the inter-rater reliability, test-retest reliability, concurrent validity, and discriminant validity of the Complex Task Performance Assessment (CTPA): an ecologically valid performance-based assessment of executive function. Community control participants (n = 20) and individuals with mild stroke (n = 14) participated in this study. All participants completed the CTPA and a battery of cognitive assessments at initial testing. The control participants completed the CTPA at two different times one week apart. The intra-class correlation coefficient (ICC) for inter-rater reliability for the total score on the CTPA was .991. The ICCs for all of the sub-scores of the CTPA were also high (.889-.977). The CTPA total score was significantly correlated to Condition 4 of the DKEFS Color-Word Interference Test (p = -.425), and the Wechsler Test of Adult Reading (p  = -.493). Finally, there were significant differences between control subjects and individuals with mild stroke on the total score of the CTPA (p = .007) and all sub-scores except interpretation failures and total items incorrect. These results are also consistent with other current executive function performance-based assessments and indicate that the CTPA is a reliable and valid performance-based measure of executive function.

  18. Teaching Chinese psychiatrists to make reliable dissociative disorder diagnoses.

    PubMed

    Fan, Qing; Yu, Junhan; Ross, Colin A; Keyes, Benjamin B; Dai, Yunfei; Zhang, Tianhong; Wang, Lanlan; Xiao, Zeping

    2011-09-01

    The aim of the study was to assess the outcome of an educational effort by two North American experts in dissociative disorders to teach Chinese psychiatrists to make reliable dissociative disorder diagnoses. In the final phase of the educational effort, 569 patients at Shanghai Mental Health Center completed the Chinese version of the Dissociative Experiences Scale (DES). Patients were then randomly selected in different proportions according to their DES scores: 96 selected patients were then assessed with the Dissociative Disorders Interview Schedule (DDIS) and clinical diagnostic interviews based on DSM-IV criteria. According to the clinical diagnostic interviews, 28 (4.9%) patients were diagnosed as having dissociative disorders. Agreement between the American experts and Chinese psychiatrists for presence or absence of a dissociative disorder was 0.75 using Cohen's kappa. Dissociative disorders can be diagnosed in China with good inter-rater reliability. The authors describe the steps taken to achieve this outcome.

  19. Reliability of Autism-Tics, AD/HD, and other Comorbidities (A-TAC) inventory in a test-retest design.

    PubMed

    Larson, Tomas; Kerekes, Nóra; Selinus, Eva Norén; Lichtenstein, Paul; Gumpert, Clara Hellner; Anckarsäter, Henrik; Nilsson, Thomas; Lundström, Sebastian

    2014-02-01

    The Autism-Tics, AD/HD, and other Comorbidities (A-TAC) inventory is used in epidemiological research to assess neurodevelopmental problems and coexisting conditions. Although the A-TAC has been applied in various populations, data on retest reliability are limited. The objective of the present study was to present additional reliability data. The A-TAC was administered by lay assessors and was completed on two occasions by parents of 400 individual twins, with an average interval of 70 days between test sessions. Intra- and inter-rater reliability were analysed with intraclass correlations and Cohen's kappa. A-TAC showed excellent test-retest intraclass correlations for both autism spectrum disorder and attention deficit hyperactivity disorder (each at .84). Most modules in the A-TAC had intra- and inter-rater reliability intraclass correlation coefficients of > or = .60. Cohen's kappa indi- cated acceptable reliability. The current study provides statistical evidence that the A-TAC yields good test-retest reliability in a population-based cohort of children.

  20. Reliability and validity of the Japanese version of the selective control assessment of the lower extremity tool among patients with spastic cerebral palsy

    PubMed Central

    Kusumoto, Yasuaki; Hanao, Mami; Takaki, Kenji; Matsuda, Tadamitsu; Nitta, Osamu

    2016-01-01

    [Purpose] The aim of this study was to translate the Selective Control Assessment of the Lower Extremity (SCALE) tool from English to Japanese and to assess the reliability and validity of the Japanese version of the SCALE (SCALE-J) tool in Japanese patients with spastic cerebral palsy. [Subjects and Methods] The SCALE tool was translated into Japanese in accordance with the published guidelines. In total, 55 patients with spastic cerebral palsy were enrolled in the present study. Reliability by internal consistency (Cronbach’s α), intrarater reliability, inter-rater reliability, and convergent validity by comparing Gross Motor Function Classification System (GMFCS) scores were examined. [Results] The Cronbach’s α value of the SCALE-J tool was 0.97–0.98, whereas that of the intrarater and inter-rater reliability ranged from 0.93 to 0.96. The Spearman correlation coefficient revealed a good relationship between the SCALE tool and the GMFCS. [Conclusion] The SCALE-J tool was found to be reliable and valid; therefore, the SCALE tool may be useful for evaluation in clinical practice. PMID:28174443

  1. The Autism Observation Scale for Infants: scale development and reliability data.

    PubMed

    Bryson, Susan E; Zwaigenbaum, Lonnie; McDermott, Catherine; Rombough, Vicki; Brian, Jessica

    2008-04-01

    The Autism Observation Scale for Infants (AOSI) was developed to detect and monitor early signs of autism as they emerge in high-risk infants (all with an older sibling with an autistic spectrum disorder). Here we describe the scale and its development, and provide preliminary data on its reliability. Inter-rater reliability both for total scores and total number of endorsed items is good to excellent at 6, 12 and 18 months; reliability is more modest for individual items, particularly in 6-month-olds. Test-retest reliability of the AOSI at 12 months of age is within acceptable limits. Evidence that the AOSI provides reliable data is the first critical step towards evaluating its efficacy in distinguishing high-risk infants who develop ASD.

  2. The Effects of Rater Training on Inter-Rater Agreement

    ERIC Educational Resources Information Center

    Pufpaff, Lisa A.; Clarke, Laura; Jones, Ruth E.

    2015-01-01

    This paper addresses the effects of rater training on the rubric-based scoring of three preservice teacher candidate performance assessments. This project sought to evaluate the consistency of ratings assigned to student learning outcome measures being used for program accreditation and to explore the need for rater training in order to increase…

  3. Measurement Issues in Anthropometric Measures of Limb Volume Change in Persons at Risk for and Living with Lymphedema: A Reliability Study.

    PubMed

    Tidhar, Dorit; Armer, Jane M; Deutscher, Daniel; Shyu, Chi-Ren; Azuri, Josef; Madsen, Richard

    2015-09-30

    Understanding whether a true change has occurred during the process of care is of utmost importance in lymphedema management secondary to cancer treatments. Decisions about when to order a garment, start an exercise program, and begin or end therapy are based primarily on measurements of limb volume, based on circumferences taken by physiotherapists using a flexible tape. This study aimed to assess intra-rater and inter-rater reliability of measurements taken by physiotherapists of legs and arms with and without lymphedema and to evaluate whether there is a difference in reliability when measuring a healthy versus a lymphedematous limb. The intra-rater reliability of arm and leg measurements by trained physiotherapist is very high (scaled standard error of measurements (SEMs) for an arm and a leg volume were 0.82% and 0.64%, respectively) and a cut-point of 1% scaled SEM may be recommended as a threshold for acceptable reliability. Physiotherapists can rely on the same error when assessing lymphedematous or healthy limbs. For those who work in teams and share patients, practice is needed in synchronizing the measurements and regularly monitoring their inter-rater reliability.

  4. Penetration-Aspiration: Is Their Detection in FEES ® Reliable Without Video Recording?

    PubMed

    Hey, Christiane; Pluschinski, Petra; Pajunk, Raissa; Almahameed, Anas; Girth, Lara; Sader, Robert; Stöver, Timo; Zaretsky, Yevgen

    2015-08-01

    Penetration-aspiration is known as the main finding in deglutition-disordered patients with implications for diagnostics and therapeutic management. Reliable detection of penetration-aspiration is given with fiberoptic endoscopic evaluation of swallowing (FEES(®)) as one of the gold standards in instrumental swallowing evaluation. The advice to implement video recording in FEES(®) to assure quality in identifying penetration-aspiration is often ignored, especially in bed-side settings. Thus, the aim of this study was to compare reliability and validity in detecting penetration-aspiration events with and without video recording. Eighty FEES(®) sequences, ten per severity grade of the Penetration-Aspiration Scale by Rosenbek et al., were rated by four blinded ENTs with two different methods. The first method simulated the evaluation without video recording (Method A), and the second one with video recording (Method B). Rating was performed twice per setting with 2 weeks in between and every time newly randomized. Intra- and inter-rater reliability as well as validity were analyzed for both evaluation methods. R-to-Z transformation was used to reveal the more reliable method and ordinal regression to determine potential rating influences. Method B demonstrated higher intra- and inter-rater reliability values than Method A and was revealed as more reliable in identifying penetration-aspiration according to r-to-Z transformation (Z = -2.92, p = .004). Ordinal regression detected a significant influence of the evaluation method choice on the rating results (p = .016). As Method B turned out to be more reliable than Method A in detecting penetration-aspiration, the presented study recommends the implementation of video recording in swallowing diagnostics.

  5. Reliability of the Italian INFVo scale and correlations with objective measures and VHI scores.

    PubMed

    Schindler, A; Ginocchio, D; Atac, M; Maruzzi, P; Madaschi, S; Ottaviani, F; Mozzanica, F

    2013-04-01

    The objective of this study was to evaluate the reliability of the INFVo scale and its relationship with objective measures and VHI scores in 40 native Italian-speaking patients with substitution voice. The maximum phonation time (MPT), diadochokinesis (DDK) of the three syllabic sequence [pa/ta/ka], reading of a passage and a single word repetition test were recorded. Each patient completed the Italian version of the VHI. Three speech-language pathologists blindly rated the recordings using the auditory perceptual INFVo scale; one listened and assessed the voice recording twice. The INFVo intra- and inter-rater reliability reached good values. Strong to moderate correlations between the INFVo scale scores and MPT, DDK, distortions in the repetition test, speech rate during reading and the functional subscale of the VHI were found. In conclusion, the INFVo scale is a reliable tool and can be recommended for the perceptual assessment of substitution voices in Italian speaking patients.

  6. Development, test reliability and validation of a classification for revision hip arthroplasty.

    PubMed

    Saleh, K J; Holtzman, J; Gafni ASaleh, L; Jaroszynski, G; Wong, P; Woodgate, I; Davis, A; Gross, A E

    2001-01-01

    The objective of the study was to develop a valid and reliable classification system for failed hip arthroplasties. The study uses research principals derived from multi-attribute utility theory and consensus group techniques. The development of the severity measure was done in two phases. Phase I of the study included: (a) questionnaire development, (b) submission of the questionnaire to the respondents, (c) data synthesis of the responses and item reduction, and (d) classification development and inter-observer reliability testing. Phase II included: (a) resubmission of the instrument to the respondents for suggestions/feedback, (b) instrument revision by the co-investigators based on the respondents' second feedback, and (c) inter-observer reliability testing and intraoperative validity testing of the instrument. The questionnaires sought to capture expert opinion as to what clinical determinants obtained preoperatively (during patient interview, physical exam and review of plain radiographs - AP pelvis and hip lateral) that would in their clinical experience reveal intraoperative severity. There was an 80% (16/20) response rate from the outside experts invited to participate in the study. Based on item reduction and test retest analysis, a five-grade radiographic classification for the acetabulum as well as the femur was developed. This system was then reviewed by 13 of the initial outside experts (16, 80%) who participated in the first round. Inter-rater reliability testing of the final format of the classification revealed a weighted kappa statistic value of 0.88 between the two-blinded raters (inter-rater reliability) and 0.87 between the blinded raters and the reference standard (intraoperative validity). We conclude that the study developed a reliable and valid radiographic classification system for failed hip arthroplasty.

  7. THE RELIABILITY OF FABER TEST HIP RANGE OF MOTION MEASUREMENTS

    PubMed Central

    Bauer, Lauren; Gradoz, Marissa; Grindstaff, Terry L

    2016-01-01

    Background The Flexion ABduction External Rotation (FABER) test is typically used as a provocation special test, but has also been used as a measurement of combined hip range of motion (ROM). It is thought that limited ROM with this measurement may be indicative of hip pathology. To date, normative data, reliability, and minimal detectable change (MDC) of such measurements have not been established. Purpose To determine normative FABER height, assess inter- and intra-rater reliability and MDC for FABER, and compare traditional FABER measurements to methods which account for differences in thigh length. Study Design Descriptive laboratory reliability study Methods Nineteen healthy participants without low back, hip, or knee pain in the preceding three months were recruited. Measurements were performed during two sessions (three to seven days between sessions) by three clinicians. FABER height and thigh length measurements were performed. Thigh length normalized FABER range of motion (ROM) and side-to-side FABER ROM symmetry were calculated. One tester also measured FABER with a digital inclinometer. Inter- and intra-rater reliability were calculated using interclass correlation coefficients (ICC) and mean MDC values were calculated. Results Mean values for FABER height and normalized FABER ROM were 12.4 ± 2.8 cm and 0.30 ± 0.07, respectively. Inter-rater reliability for FABER and normalized FABER were good (ICC 0.67-0.68) and between session intra-rater reliability were good to excellent (ICC 0.76-0.86). Mean FABER and normalized FABER ROM MDC were 3.7 cm and 0.04, respectively. Mean FABER ROM symmetry was 2.0 ± 0.9 cm with poor inter-rater reliability (ICC 0.20), poor to good intra-rater reliability (ICC 0.38-0.66), and mean MDC of 4.0 cm. FABER measured with a ruler, normalized FABER ROM, and inclinometry all resulted in excellent intra-rater reliability, with the highest ICC being demonstrated for inclinometry (ICC 0.86, 0.86, and 0

  8. Reliability of clinician judgements of bruxism.

    PubMed

    Marbach, J J; Raphael, K G; Janal, M N; Hirschkorn-Roth, R

    2003-02-01

    Bruxism is considered to be a parafunctional disorder requiring treatment and is viewed as a risk factor for the development of temporomandibular disorders (TMDs). The purpose of this investigation is to examine the reliability of clinician judgements of bruxism severity. Twenty dentists who are faculty members in a dental school examined 29 stone casts and gold-plated models of individual teeth for evidence of bruxism. Ordinal ratings of bruxism severity for the 29 augmented models were made on two occasions, approximately 3 months apart. Inter-rater reliability among all clinicians, evaluated using intraclass correlation coefficients (ICCs), was poor at both time one and time two (i.e. ICC = 0.33 and 0.32, respectively), with somewhat better reliability found among those clinicians with above-average time elapsed since completion of dental training (i.e. ICC = 0.48 and 0.50 for time 1 and time 2, respectively). Three-month test-retest reliabilities were fair (ICC = 0.46) for the full group of raters and were unrelated to clinicians' degree of confidence in their ratings. These results indicate a need to standardize methods for clinical assessment of bruxism. Additionally, they have implications for studies using clinical assessments of bruxism to test the association between bruxism and other conditions such as TMDs.

  9. Feasibility and reliability of classifying gross motor function among children with cerebral palsy using population-based record surveillance.

    PubMed

    Benedict, Ruth E; Patz, Jean; Maenner, Matthew J; Arneson, Carrie L; Yeargin-Allsopp, Marshalyn; Doernberg, Nancy S; Van Naarden Braun, Kim; Kirby, Russell S; Durkin, Maureen S

    2011-01-01

    For conditions with wide-ranging consequences, such as cerebral palsy (CP), population-based surveillance provides an estimate of the prevalence of case status but only the broadest understanding of the impact of the condition on children, families or society. Beyond case status, information regarding health, functional skills and participation is necessary to fully appreciate the consequences of the condition. The purpose of this study was to assess the feasibility and reliability of enhancing population-based surveillance by classifying gross motor function (GMF) from information available in medical records of children with CP. We assessed inter-rater reliability of two GMF classification methods, one the Gross Motor Function Classification System (GMFCS) and the other a 3-category classification of walking ability: (1) independently, (2) with handheld mobility device, or (3) limited or none. Two qualified clinicians independently reviewed abstracted evaluations from medical records of 8-year-old children residing in southeast Wisconsin, USA who were identified as having CP (n = 154) through the Centers for Disease Control and Prevention's Autism and Developmental Disabilities Monitoring Network. Ninety per cent (n = 138) of the children with CP had information in the record after age 4 years and 108 (70%) had adequate descriptions of gross motor skills to classify using the GMFCS. Agreement was achieved on 75.0% of the GMFCS ratings (simple kappa = 0.67, 95% confidence interval [95% CI 0.57, 0.78], weighted kappa = 0.83, [95% CI 0.77, 0.89]). Among case children for whom walking ability could be classified (n = 117), approximately half walked independently without devices and one-third had limited or no walking ability. Across walking ability categories, agreement was reached for 94% (simple kappa = 0.90, [95% CI 0.82, 0.96], weighted kappa = 0.94, [95% CI 0.89, 0.98]). Classifying GMF in the context of active records-based surveillance is feasible and reliable

  10. Comparison of Assertive Community Treatment Fidelity Assessment Methods: Reliability and Validity.

    PubMed

    Rollins, Angela L; McGrew, John H; Kukla, Marina; McGuire, Alan B; Flanagan, Mindy E; Hunt, Marcia G; Leslie, Doug L; Collins, Linda A; Wright-Berryman, Jennifer L; Hicks, Lia J; Salyers, Michelle P

    2016-03-01

    Assertive community treatment is known for improving consumer outcomes, but is difficult to implement. On-site fidelity measurement can help ensure model adherence, but is costly in large systems. This study compared reliability and validity of three methods of fidelity assessment (on-site, phone-administered, and expert-scored self-report) using a stratified random sample of 32 mental health intensive case management teams from the Department of Veterans Affairs. Overall, phone, and to a lesser extent, expert-scored self-report fidelity assessments compared favorably to on-site methods in inter-rater reliability and concurrent validity. If used appropriately, these alternative protocols hold promise in monitoring large-scale program fidelity with limited resources.

  11. Reliability and validity of parent- and child-rated anxiety measures in autism spectrum disorder.

    PubMed

    Kaat, Aaron J; Lecavalier, Luc

    2015-10-01

    Autism spectrum disorder (ASD) and anxiety frequently co-occur. Research on the phenomenology and treatment of anxiety in ASD is expanding, but is hampered by the lack of instruments validated for this population. This study evaluated the self- and parent-reported Revised Child Anxiety and Depression Scale and the Multidimensional Anxiety Scale in Children-2 among 46 youth with ASD. Internal consistency and test-retest reliability were acceptable, but inter-rater reliability was poor. Parent-child agreement was better for youth with higher IQs, less severe ASD symptoms, or more social cognitive skills. Convergent and divergent validity were acceptable. Demographic characteristics were considered as predictors of anxiety: they were unrelated to parent-report, but younger age and more severe ASD were related to increased self-reported anxiety.

  12. Reliability of ankle dorsiflexion passive range of motion measurements obtained using a hand-held goniometer and Biodex dynamometer in stroke patients.

    PubMed

    Jung, In-Gui; Yu, Il-Young; Kim, Soo-Yong; Lee, Dong-Kyu; Oh, Jae-Seop

    2015-06-01

    [Purpose] This study investigated the reliability of ankle dorsiflexion passive range of motion (DF-PROM) measurements obtained using a goniometer and Biodex dynamometer in stroke patients. [Subjects] Fifteen stroke patients participated in this study. [Methods] Ankle DF-PROM was assessed using a goniometer and Biodex dynamometer. Ankle DF-PROM was measured during two sessions with 7 days between tests. Intraclass correlation coefficient, standard error of measurement, and minimal detectable change values were used to assess the reliability of measurements obtained using both instruments. [Results] The intra-rater reliability for ankle DF-PROM using the goniometer was moderate and good for the two raters, while using the Biodex dynamometer, it was good for both raters. Inter-rater reliability using the goniometer was moderate; using the Biodex, it was good. [Conclusion] Both intra- and inter-reliability measurements of ankle DF-PROM were higher using a Biodex dynamometer than with a goniometer.

  13. Is the Bayley Scales of Infant and Toddler Developmental Screening Test, Valid and Reliable for Persian Speaking Children?

    PubMed Central

    Soleimani, Farin; Azari, Nadia; Vameghi, Roshanak; Sajedi, Firoozeh; Shahshahani, Soheila; Karimi, Hossein; Kraskian, Adis; Shahrokhi, Amin; Teymouri, Robab; Gharib, Masoud

    2016-01-01

    Background Advances in perinatal and neonatal care have substantially improved the survival of at-risk infants over the past two decades. Objectives The purpose of this study was to assess the reliability and validity of the Bayley Scales of infant and toddler developmental Screening test in Persian-speaking children. Methods This was a cross-sectional prospective study of 403 children aged 1 - 42-months. The Bayley scales screening instrument, which consists of five domains (cognitive, receptive, and expressive communication and fine and gross motor items), was used to measure infants’ and toddlers’ development. The psychometric properties examined included the face and content validity of the scale, in addition to cultural and linguistic modifications to the scale and its test-retest and inter-rater reliability. Results An expert team changed some of the test items relating to cultural and linguistic issues. In almost all the age groups, cultural or linguistic changes were made to items in the communication domains. According to Cronbach’s alpha for internal consistency, the reliability of the cognitive scale was r = 0.79, and the reliability of the receptive scale was r = 0.76. The reliability for expressive communication, fine motor, and gross motor scales was r = 0.81, r = 0.80, and r = 0.81, respectively. The construct validity of the tests was confirmed using a factor analysis and comparison of the mean scores of the age groups. The intra- and inter-rater reliabilities of the Bayley Scales were good-to-excellent. Conclusions The results indicated that the Bayley Scales had a high level of reliability in the present study. Thus, the scale can be used in a Persian population. PMID:28203335

  14. Ultrasonographic measurement of the acromiohumeral distance in spinal cord injury: Reliability and effects of shoulder positioning

    PubMed Central

    Lin, Yen-Sheng; Boninger, Michael L.; Day, Kevin A.

    2015-01-01

    Objective To investigate the reliability of ultrasonographic measurement of acromiohumeral distance (AHD) and the effects of shoulder positioning on AHD among manual wheelchair users (MWUs) with spinal cord injury (SCI) and an able-bodied control group. Methods Ten MWUs with SCI and 10 able-bodied subjects participated in this study. The ultrasonographic measurements of AHD from each subject were obtained by two raters during passive and active scapular plane arm elevation in neutral, 45°, 90° with and without resistance and in a weight relief raise position. The measurements were recorded again by each rater using the same procedures after a 30-minute time interval. All raters were blinded to each other's measurements. Setting University Laboratories and Veteran Affairs Healthcare System. Results Intra-rater (intraclass correlation coefficient, ICC > 0.83) and inter-rater (ICC > 0.78) reliability was excellent for both the MWUs with SCI and able-bodied groups across all arm positions except for the 45° position in the control group for one of the raters (intra-rater: ICC < 0.40 and inter-rater: ICC < 0.60). AHD significantly reduced when the shoulder was in the 90° arm elevated positions with or without resistance. Conclusion Findings from our study demonstrated that ultrasonography is a reliable means to evaluate AHD in both able bodied and individuals with SCI, who are known to have significant shoulder pathology. This technique could be used to develop reference measures and to identify changes in AHD caused by interventions. PMID:24968117

  15. Reliability and intermethod agreement for body fat assessment among two field and two laboratory methods in adolescents.

    PubMed

    Vicente-Rodríguez, Germán; Rey-López, Juan P; Mesana, Maria I; Poortvliet, Eric; Ortega, Francisco B; Polito, Angela; Nagy, Eniko; Widhalm, Kurt; Sjöström, Michael; Moreno, Luis A

    2012-01-01

    To increase knowledge about reliability and intermethods agreement for body fat (BF) is of interest for assessment, interpretation, and comparison purposes. It was aimed to examine intra- and inter-rater reliability, interday variability, and degree of agreement for BF using air-displacement plethysmography (Bod-Pod), dual-energy X-ray absorptiometry (DXA), bioelectrical impedance analysis (BIA), and skinfold measurements in European adolescents. Fifty-four adolescents (25 females) from Zaragoza and 30 (14 females) from Stockholm, aged 13-17 years participated in this study. Two trained raters in each center assessed BF with Bod-Pod, DXA, BIA, and anthropometry (DXA only in Zaragoza). Intermethod agreement and reliability were studied using a 4-way ANOVA for the same rater on the first day and two additional measurements on a second day, one each rater. Technical error of measurement (TEM) and percentage coefficient of reliability (%R) were also reported. No significant intrarater, inter-rater, or interday effect was observed for %BF for any method in either of the cities. In Zaragoza, %BF was significantly different when measured by Bod-Pod and BIA in comparison with anthropometry and DXA (all P < 0.001). The same result was observed in Stockholm (P < 0.001), except that DXA was not measured. Bod-Pod, DXA, BIA, and anthropometry are reliable for %BF repeated assessment within the same day by the same or different raters or in consecutive days by the same rater. Bod-Pod showed close agreement with BIA as did DXA with anthropometry; however, Bod-Pod and BIA presented higher values of %BF than anthropometry and DXA.

  16. Reliability of sagittal plane hip, knee, and ankle joint angles from a single frame of video data using the GAITRite camera system.

    PubMed

    Ross, Sandy A; Rice, Clinton; Von Behren, Kristyn; Meyer, April; Alexander, Rachel; Murfin, Scott

    2015-01-01

    The purpose of this study was to establish intra-rater, intra-session, and inter-rater, reliability of sagittal plane hip, knee, and ankle angles with and without reflective markers using the GAITRite walkway and single video camera between student physical therapists and an experienced physical therapist. This study included thirty-two healthy participants age 20-59, stratified by age and gender. Participants performed three successful walks with and without markers applied to anatomical landmarks. GAITRite software was used to digitize sagittal hip, knee, and ankle angles at two phases of gait: (1) initial contact; and (2) mid-stance. Intra-rater reliability was more consistent for the experienced physical therapist, regardless of joint or phase of gait. Intra-session reliability was variable, the experienced physical therapist showed moderate to high reliability (intra-class correlation coefficient (ICC) = 0.50-0.89) and the student physical therapist showed very poor to high reliability (ICC = 0.07-0.85). Inter-rater reliability was highest during mid-stance at the knee with markers (ICC = 0.86) and lowest during mid-stance at the hip without markers (ICC = 0.25). Reliability of a single camera system, especially at the knee joint shows promise. Depending on the specific type of reliability, error can be attributed to the testers (e.g. lack of digitization practice and marker placement), participants (e.g. loose fitting clothing) and camera systems (e.g. frame rate and resolution). However, until the camera technology can be upgraded to a higher frame rate and resolution, and the software can be linked to the GAITRite walkway, the clinical utility for pre/post measures is limited.

  17. Enhancing reliability in portfolio assessment: 'shaping' the portfolio.

    PubMed

    Pitts, John; Coles, Colin; Thomas, Peter

    2001-07-01

    This paper reports a follow-on project that assessed a series of portfolios assembled by a cohort of participants attending a course for prospective general practice trainers. In an attempt to enhance reliability, a framework for defining and addressing problems using a reflective practice model was offered to participants. The reliability of the judgements made by a panel of assessors about individual 'components', together with an overall global judgement about performance were studied. The reliability of individual assessors' judgements (i.e. their consistency) was moderate, but inter-rater reliability did not reach a level that could support making a safe summative judgement. Despite offering a possible structure for demonstrating reflective processes, the levels of reliability reached were similar to the earlier work and other subjective assessments generally, and perhaps reflected individuality of personal agendas of both the assessed and the assessors, and variations in portfolio structure and content; even agreement among the assessors about evidence of the framework being used was poor. Suggestions for approaches in the future are made. The conclusion remains that while portfolios might be valuable as resources for learning, as assessment tools they should be treated as problematic.

  18. A structured interview guide for global impressions: increasing reliability and scoring accuracy for CNS trials

    PubMed Central

    2013-01-01

    Background The clinical global impression of severity (CGI-S) scale is a frequently used rating instrument for the assessment of global severity of illness in Central Nervous System (CNS) trials. Although scoring guidelines have been proposed to anchor these scores, the collection of sufficient documentation to support the derived score is not part of any standardized interview procedure. It is self evident that the absence of a standardized, documentary format can affect inter-rater reliability and may adversely affect the accuracy of the resulting data. Method We developed a structured interview guide for global impressions (SIGGI) and evaluated the instrument in a 2-visit study of ambulatory patients with Major Depressive Disorder (MDD) or schizophrenia. Blinded, site-independent raters listened to audio recorded SIGGI interviews administered by site-based CGI raters. We compared SIGGI-derived CGI-S scores between the two separate site-based raters and the site-independent raters. Results We found significant intraclass correlations (p = 0.001) on all SIGGI-derived CGI-S scores between two separate site-based CGI raters with each other (r = 0.768) and with a blinded, site-independent rater (r = 0.748 and r = 0.706 respectively) and significant Pearson’s correlations between CGI-S scores with all MADRS validity comparisons for MDD and PANSS comparisons for schizophrenia (p- 0.001 in all cases). Compared to site-based raters, the site-independent raters gave identical “dual” CGI-S scores to 67.6% and 68.2% of subjects at visit 1 and 77.1% at visit 2. Conclusion We suggest that the SIGGI may improve the inter-rater reliability and scoring precision of the CGI-S and have broad applicability in CNS clinical trials. PMID:23369692

  19. Reliability and validity of the March of dimes preconception/prenatal family health history questionnaire: The Persian version.

    PubMed

    Mashhadi Abdolahi, Hossein; Kargar Maher, Mohammad Hassan; Karamouz, Majid; Khosroshahi, Hossein; Dastgiri, Saeed

    2016-05-01

    In recent years, there has been a remarkable gap between rapid advancements in genetic technology and public health practice. Looking at the familial health history may bridge this gap for easier and cheaper diagnosis and prevention of congenital anomalies. The aim of this study was to validate and culturally adapt the March of Dimes Preconception/Prenatal Family Health History Questionnaire for the Iranian population. After obtaining written permission from March of Dimes, the translation-back translation of the original questionnaire was performed. The content validity was assessed by a team of 12 experts. Based on a sample of 50 general practitioners and 100 subjects referred to health centers from September to November 2014 in Tabriz, Iran, test-retest reliability and inter-rater reliability were evaluated by Kappa and Intra-class Correlation Coefficient (ICC). Content validity of the Persian version of the questionnaire was confirmed according to the modified kappa value above 0.76 for all the items included in this tool. Inter-rater reliability assessment yielded a kappa value between 0.62 and 0.92 for variables with dichotomous measurement scales and ICC ranged from 0.6 to 0.9 for variables with numeric scales. Test-retest re-administration produced kappa ranging from 0.62 to 0.92 for variables with dichotomous measurement scales and ICC from 0.6 to 0.9 for variables with numeric scales. The Persian version of the March of Dimes preconception/prenatal family health history questionnaire showed acceptable reliability and validity and may be used as a simple tool for the detection of risk factors of birth defects in Iranian population.

  20. Validity and reliability of chronic tic disorder and obsessive-compulsive disorder diagnoses in the Swedish National Patient Register

    PubMed Central

    Rück, Christian; Larsson, K Johan; Lind, Kristina; Perez-Vigil, Ana; Isomura, Kayoko; Sariaslan, Amir; Lichtenstein, Paul; Mataix-Cols, David

    2015-01-01

    Objectives The usefulness of cases diagnosed in administrative registers for research purposes is dependent on diagnostic validity. This study aimed to investigate the validity and inter-rater reliability of recorded diagnoses of tic disorders and obsessive-compulsive disorder (OCD) in the Swedish National Patient Register (NPR). Design Chart review of randomly selected register cases and controls. Method 100 tic disorder cases and 100 OCD cases were randomly selected from the NPR based on codes from the International Classification of Diseases (ICD) 8th, 9th and 10th editions, together with 50 epilepsy and 50 depression control cases. The obtained psychiatric records were blindly assessed by 2 senior psychiatrists according to the criteria of the fourth edition of the Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR) and ICD-10. Primary outcome measurement Positive predictive value (PPV; cases diagnosed correctly divided by the sum of true positives and false positives). Results Between 1969 and 2009, the NPR included 7286 tic disorder and 24 757 OCD cases. The vast majority (91.3% of tic cases and 80.1% of OCD cases) are coded with the most recent ICD version (ICD-10). For tic disorders, the PPV was high across all ICD versions (PPV=89% in ICD-8, 86% in ICD-9 and 97% in ICD-10). For OCD, only ICD-10 codes had high validity (PPV=91–96%). None of the epilepsy or depression control cases were wrongly diagnosed as having tic disorders or OCD, respectively. Inter-rater reliability was outstanding for both tic disorders (κ=1) and OCD (κ=0.98). Conclusions The validity and reliability of ICD codes for tic disorders and OCD in the Swedish NPR is generally high. We propose simple algorithms to further increase the confidence in the validity of these codes for epidemiological research. PMID:26100027

  1. Parasellar Extension Grades and Surgical Extent in Endoscopic Endonasal Transsphenoidal Surgery for Pituitary Adenomas : A Single Surgeon's Consecutive Series with the Aspects of Reliability and Clinical Validity

    PubMed Central

    Lee, Sang-Hyo; Park, Jae-Sung; Lee, Song; Kim, Sung-Won

    2016-01-01

    Objective The inter-rater reliability of the modified Knosp's classification was measured before the analysis. The clinical validity of the parasellar extension grading system was evaluated by investigating the extents of resection and complication rates among the grades in the endoscopic endonasal transsphenoidal surgery (EETS) for pituitary adenomas. Methods From November 2008 to August 2015, of the 286 patients who underwent EETS by the senior author, 208 were pituitary adenoma cases (146 non-functioning pituitary adenomas, 10 adrenocorticotropic hormone-secreting adenomas, 31 growth hormone-secreting adenomas, 17 prolactin-secreting adenomas, and 4 thyroid-stimulating hormone-secreting adenomas; 23 microadenomas, 174 macroadenomas, and 11 giant adenomas). Two neurosurgeons and a neuroradiologist independently measured the degree of parasellar extension on the preoperative sellar MRI according to the modified Knosp's classification. Inter-rater reliability was statistically assessed by measuring the intraclass correlation coefficient. The extents of resection were evaluated by comparison of the pre- and post-operative MR images; the neurovascular complications were assessed by reviewing the patients' medical records. The extent of resection was measured in each parasellar extension grade; thereafter, their statistical differences were calculated. Results The intraclass correlation coefficient value of reliability across the three raters amounted to 0.862. The gross total removal (GTR) rates achieved in each grade were 70.0, 69.8, 62.9, 21.4, 37.5, and 4.3% in Grades 0, 1, 2, 3A, 3B, and 4, respectively. A significant difference in the extent of resection was observed only between Grades 2 and 3A. In addition, significantly higher complication rates were observed in the groups above Grade 3A. Conclusion Although the modified Knosp's classification system appears to be complex, its inter-rater reliability proves to be excellent. Regarding the clinical validity of

  2. Identification of Reliable Sulcal Patterns of the Human Rolandic Region

    PubMed Central

    Mellerio, Charles; Lapointe, Marie-Noël; Roca, Pauline; Charron, Sylvain; Legrand, Laurence; Meder, Jean-François; Oppenheim, Catherine; Cachia, Arnaud

    2016-01-01

    A major feature of the human cortex is its huge morphological variability. Although a comprehensive literature about the sulco-gyral pattern of the central region is available from post-mortem data, a reliable and reproducible characterization from in vivo data is still lacking. The aim of this study is to test the reliability of morphological criteria of the central region sulci used in post-mortem data, when applied to in vivo magnetic resonance imaging (MRI) data. Thirty right-handed healthy individuals were included in the study. Automated segmentation and three dimensional (3D) surface-based rendering were obtained from clinical 3D T1-weighted MRI. Two senior radiologists labeled the three sulci composing the central region (precentral [PreCS], central [CS] and postcentral [PostCS]) and analyzed their morphological variations using 47 standard criteria derived from Ono’s atlas based on post-mortem data. For each criterion, inter-rater concordance and comparison with the occurrence frequency provided in Ono’s atlas were estimated. Overall, the sulcal pattern criteria derived from MRI data were highly reproducible between the raters with a high mean inter-rater concordance in the three sulci (CS: κ = 0.92 in left hemisphere/κ = 0.91 in right hemisphere; PreCS: κ = 0.91/κ = 0.93; PostCS: κ = 0.84/0.79). Only a very limited number of sulcal criteria significantly differed between the in vivo and the post-mortem data (CS: 2 criteria in the left hemisphere/3 criteria in the right hemisphere; PreCS: 3 in the left and right hemispheres; PostCS: 3 in the left hemisphere and 5 in the right hemisphere). Our study provides a comprehensive description of qualitative sulcal patterns in the central region from in vivo clinical MRI with high agreement with previous post-mortem data. Such identification of reliable sulcal patterns of the central region visible with standard clinical MRI data paves the way for the detection of subtle variations of the central sulcation

  3. Brief report: "Quick and (not so) dirty" assessment of change in autism: cross-cultural reliability of the Developmental Disabilities CGAS and the OSU autism CGI.

    PubMed

    Choque Olsson, Nora; Bölte, Sven

    2014-07-01

    There are few evaluated economic tools to assess change in autism. This study examined the inter-rater reliability of the Developmental Disabilities Children's Global Assessment Scale (DD-CGAS), and the OSU Autism Clinical Global Impression (OSU Autism CGI) in a European setting. Using these scales, 16 clinicians with multidisciplinary background and varying experience independently rated eight vignettes of autism spectrum disorder for severity and general psychosocial functioning at referral and discharge. Intraclass correlation coefficient (ICCs) for experienced clinicians were .75 for the DD-CGAS and .72 for the OSU Autism CGI. In inexperienced clinicians these ICCs were .58 and .59. Results confirm previous North American studies, and further extents the reliability of the instruments to untrained, less experienced clinicians with different professions.

  4. Determinants of the reliability of ultrasound tomography sound speed estimates as a surrogate for volumetric breast density

    SciTech Connect

    Khodr, Zeina G.; Pfeiffer, Ruth M.; Gierach, Gretchen L.; Sak, Mark A.; Bey-Knight, Lisa; Duric, Nebojsa; Littrup, Peter; Ali, Haythem; Vallieres, Patricia; Sherman, Mark E.

    2015-10-15

    Purpose: High breast density, as measured by mammography, is associated with increased breast cancer risk, but standard methods of assessment have limitations including 2D representation of breast tissue, distortion due to breast compression, and use of ionizing radiation. Ultrasound tomography (UST) is a novel imaging method that averts these limitations and uses sound speed measures rather than x-ray imaging to estimate breast density. The authors evaluated the reproducibility of measures of speed of sound and changes in this parameter using UST. Methods: One experienced and five newly trained raters measured sound speed in serial UST scans for 22 women (two scans per person) to assess inter-rater reliability. Intrarater reliability was assessed for four raters. A random effects model was used to calculate the percent variation in sound speed and change in sound speed attributable to subject, scan, rater, and repeat reads. The authors estimated the intraclass correlation coefficients (ICCs) for these measures based on data from the authors’ experienced rater. Results: Median (range) time between baseline and follow-up UST scans was five (1–13) months. Contributions of factors to sound speed variance were differences between subjects (86.0%), baseline versus follow-up scans (7.5%), inter-rater evaluations (1.1%), and intrarater reproducibility (∼0%). When evaluating change in sound speed between scans, 2.7% and ∼0% of variation were attributed to inter- and intrarater variation, respectively. For the experienced rater’s repeat reads, agreement for sound speed was excellent (ICC = 93.4%) and for change in sound speed substantial (ICC = 70.4%), indicating very good reproducibility of these measures. Conclusions: UST provided highly reproducible sound speed measurements, which reflect breast density, suggesting that UST has utility in sensitively assessing change in density.

  5. Determinants of the reliability of ultrasound tomography sound speed estimates as a surrogate for volumetric breast density

    PubMed Central

    Khodr, Zeina G.; Sak, Mark A.; Pfeiffer, Ruth M.; Duric, Nebojsa; Littrup, Peter; Bey-Knight, Lisa; Ali, Haythem; Vallieres, Patricia; Sherman, Mark E.; Gierach, Gretchen L.

    2015-01-01

    Purpose: High breast density, as measured by mammography, is associated with increased breast cancer risk, but standard methods of assessment have limitations including 2D representation of breast tissue, distortion due to breast compression, and use of ionizing radiation. Ultrasound tomography (UST) is a novel imaging method that averts these limitations and uses sound speed measures rather than x-ray imaging to estimate breast density. The authors evaluated the reproducibility of measures of speed of sound and changes in this parameter using UST. Methods: One experienced and five newly trained raters measured sound speed in serial UST scans for 22 women (two scans per person) to assess inter-rater reliability. Intrarater reliability was assessed for four raters. A random effects model was used to calculate the percent variation in sound speed and change in sound speed attributable to subject, scan, rater, and repeat reads. The authors estimated the intraclass correlation coefficients (ICCs) for these measures based on data from the authors’ experienced rater. Results: Median (range) time between baseline and follow-up UST scans was five (1–13) months. Contributions of factors to sound speed variance were differences between subjects (86.0%), baseline versus follow-up scans (7.5%), inter-rater evaluations (1.1%), and intrarater reproducibility (∼0%). When evaluating change in sound speed between scans, 2.7% and ∼0% of variation were attributed to inter- and intrarater variation, respectively. For the experienced rater’s repeat reads, agreement for sound speed was excellent (ICC = 93.4%) and for change in sound speed substantial (ICC = 70.4%), indicating very good reproducibility of these measures. Conclusions: UST provided highly reproducible sound speed measurements, which reflect breast density, suggesting that UST has utility in sensitively assessing change in density. PMID:26429241

  6. Absolute and relative reliability of lumbar interspinous process ultrasound imaging measurements

    PubMed Central

    Tozawa, Ryosuke; Katoh, Munenori; Aramaki, Hidefumi; Kawasaki, Tsubasa; Nishikawa, Yuichi; Kumamoto, Tsuneo; Fujinawa, Osamu

    2016-01-01

    [Purpose] The intra- and inter-examiner reliabilities of lumbar interspinous process distances measured by ultrasound imaging were examined. [Subjects and Methods] The subjects were 10 males who had no history of orthopedic diseases or dysfunctions. Ten lumbar interspinous images from 360 images captured from 10 subjects were selected. The 10 images were measured by nine examiners. The lumbar interspinous process distance measurements were performed five times by each examiner. In addition, four of the nine examiners measured the distances again after 4 days for test-retest analysis. In statistical analysis, the intraclass correlation coefficient was used to investigate relative reliability, and Bland-Altman analysis was used to investigate absolute reliability. [Results] The intraclass correlation coefficients (1, 1) for intra-examiner reliability ranged from 0.985 to 0.998. For inter-rater reliability, the intraclass correlation coefficient (2, 1) was 0.969. The intraclass correlation coefficients (1, 2) for test-retest reliability ranged from 0.991 to 0.999. The Bland-Altman analysis results indicated no systematic error. [Conclusion] The results indicate that ultrasound measurements of interspinous process distance are highly reliable even when measured only once by a single person. PMID:27630399

  7. Reliability of superficial male pelvic floor structural measurements using linear-array transperineal sonography.

    PubMed

    Roll, Shawn C; Rana, Manku; Sigward, Susan M; Yani, Moheb S; Kirages, Daniel J; Kutch, Jason J

    2015-02-01

    This study evaluated reliability of measures for superficial structures of the male pelvic floor (PF) obtained via transperineal sonography. Two embalmed cadavers were dissected to identify positioning of muscles on and around the bulb of the penis and to confirm the PF protocol. Cross-sectional area (CSA) and linear thickness of the bulb of the penis, urethra, bulbospongiosus (BS) muscles, and ischiocavernosus (IC) muscles were measured on 38 transverse images from 20 male patients by three raters with varied study knowledge and sonographic experience. Intra- and inter-rater reliability were calculated with two-way, mixed effects intra-class correlation coefficients. Measures of the bulb of the penis had the best reliability. CSA of all muscles and sagittal thickness of the BS near the central tendon had good reliability. Reliability varied for rater-identified thickest muscle region and measures of the urethra. Our study suggests that structures of the male PF can be reliably evaluated using a transperineal sonographic approach.

  8. Validity and reliability of the Spanish version of the DN4 (Douleur Neuropathique 4 questions) questionnaire for differential diagnosis of pain syndromes associated to a neuropathic or somatic component

    PubMed Central

    Perez, Concepcion; Galvez, Rafael; Huelbes, Silvia; Insausti, Joaquin; Bouhassira, Didier; Diaz, Silvia; Rejas, Javier

    2007-01-01

    Background This study assesses the validity and reliability of the Spanish version of DN4 questionnaire as a tool for differential diagnosis of pain syndromes associated to a neuropathic (NP) or somatic component (non-neuropathic pain, NNP). Methods A study was conducted consisting of two phases: cultural adaptation into the Spanish language by means of conceptual equivalence, including forward and backward translations in duplicate and cognitive debriefing, and testing of psychometric properties in patients with NP (peripheral, central and mixed) and NNP. The analysis of psychometric properties included reliability (internal consistency, inter-rater agreement and test-retest reliability) and validity (ROC curve analysis, agreement with the reference diagnosis and determination of sensitivity, specificity, and positive and negative predictive values in different subsamples according to type of NP). Results A sample of 164 subjects (99 women, 60.4%; age: 60.4 ± 16.0 years), 94 (57.3%) with NP (36 with peripheral, 32 with central, and 26 with mixed pain) and 70 with NNP was enrolled. The questionnaire was reliable [Cronbach's alpha coefficient: 0.71, inter-rater agreement coefficient: 0.80 (0.71–0.89), and test-retest intra-class correlation coefficient: 0.95 (0.92–0.97)] and valid for a cut-off value ≥ 4 points, which was the best value to discriminate between NP and NNP subjects. Discussion This study, representing the first validation of the DN4 questionnaire into another language different than the original, not only supported its high discriminatory value for identification of neuropathic pain, but also provided supplemental psychometric validation (i.e. test-retest reliability, influence of educational level and pain intensity) and showed its validity in mixed pain syndromes. PMID:18053212

  9. Reliability and validity of mobile teledermatology in HIV positive patients in Botswana: a pilot study

    PubMed Central

    Azfar, Rahat S; Lee, Robert A.; Castelo-Soccio, Leslie; Greenberg, Martin S.; Bilker, Warren B; Gelfand, Joel M; Kovarik, Carrie L

    2014-01-01

    Importance Mobile teledermatology may increase access to care. Objective To determine if mobile teledermatology in HIV positive patients in Gaborone, Botswana was reliable and produced valid consultations in comparison to face-to-face dermatology consultations. Design Cross-sectional study Setting Outpatient clinics and public inpatient settings in Botswana. Participants 76 HIV positive patients aged 18 years and up with a skin or mucosal complaint that had not been previously evaluated by a dermatologist. Main Outcome(s) and Measure(s) We calculated Cohen's kappa coefficient for diagnosis, diagnostic category and management for test-retest reliability and for inter-rater reliability. We also calculated sensitivity and specificity for each diagnosis. Results Cohen's kappa for test-retest reliability ranged from 0.47 (95% CI 0.35-0.59) to 0.78 (95% CI 0.67-0.88) for the primary diagnosis, 0.29 (95% CI 0.18-0.42) to 0.73 (95% CI 0.61-0.84) for diagnostic category, and 0.17 (95% CI -0.01-0.36) to 0.54 (95% CI 0.38-0.70) for management. Cohen's kappa for inter-rater reliability ranged from 0.41 (95% CI 0.31-0.52) to 0.51 (95% CI 0.41-0.61) for the primary diagnosis, from 0.22 (95% CI 0.14-0.31) to 0.43 (95% CI 0.34-0.53) for the diagnostic category for the primary diagnosis and from 0.08 (95% CI 0.02-0.15) to 0.12 (95% CI 0.01-0.23) for management. Sensitivity and specificity for the top ten diagnoses ranged from 0 to 0.88 and from 0.84 to 1 respectively. Conclusions and Relevance Our results suggest that while the use of mobile teledermatology technology in HIV-positive patients in Botswana has significant potential for improving access to care, additional work is needed to improve reliability and validity of this technology on a larger scale in this population. PMID:24622778

  10. Reliability and validity of an iPhone® application for the measurement of lumbar spine flexion and extension range of motion

    PubMed Central

    Pourahmadi, Mohammad Reza; Jannati, Elham; Mohseni-Bandpei, Mohammad Ali; Ebrahimi Takamjani, Ismail; Rajabzadeh, Fatemeh

    2016-01-01

    Background Measurement of lumbar spine range of motion (ROM) is often considered to be an essential component of lumbar spine physiotherapy and orthopedic assessment. The measurement can be carried out through various instruments such as inclinometers, goniometers, and etc. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for inclinometric functions. Purpose The main purpose was to investigate the reliability and validity of an iPhone® app (TiltMeter© -advanced level and inclinometer) for measuring standing lumbar spine flexion–extension ROM in asymptomatic subjects. Design A cross-sectional study was carried out. Setting This study was conducted in a physiotherapy clinic located at School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. Subjects A convenience sample of 30 asymptomatic adults (15 males; 15 females; age range = 18–55 years) was recruited between August 2015 and December 2015. Methods Following a 2–minute warm-up, the subjects were asked to stand in a relaxed position and their skin was marked at the T12–L1 and S1–S2 spinal levels. From this position, they were asked to perform maximum lumbar flexion followed by maximum lumbar extension with their knees straight. Two blinded raters each used an inclinometer and the iPhone ® app to measure lumbar spine flexion–extension ROM. A third rater read the measured angles. To calculate total lumbar spine flexion–extension ROM, the measurement from S1–S2 was subtracted from T12–L1. The second (2 hours later) and third (48 hours later) sessions were carried out in the same manner as the first session. All of the measurements were conducted 3 times and the mean value of 3 repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater

  11. Reliability and concurrent validity of a new iPhone(®) goniometric application for measuring active wrist range of motion: a cross-sectional study in asymptomatic subjects.

    PubMed

    Pourahmadi, Mohammad Reza; Ebrahimi Takamjani, Ismail; Sarrafzadeh, Javad; Bahramian, Mehrdad; Mohseni-Bandpei, Mohammad Ali; Rajabzadeh, Fatemeh; Taghipour, Morteza

    2017-03-01

    Measurement of wrist range of motion (ROM) is often considered to be an essential component of wrist physical examination. The measurement can be carried out through various instruments such as goniometers and inclinometers. Recent smartphones have been equipped with accelerometers and magnetometers, which, through specific software applications (apps) can be used for goniometric functions. This study, for the first time, aimed to evaluate the reliability and concurrent validity of a new smartphone goniometric app (Goniometer Pro©) for measuring active wrist ROM. In all, 120 wrists of 70 asymptomatic adults (38 men and 32 women; aged 18-40 years) were assessed in a physiotherapy clinic located at the School of Rehabilitation Sciences, Iran University of Medical Science and Health Services, Tehran, Iran. Following the recruitment process, active wrist ROM was measured using a universal goniometer and iPhone(®) 5 app. Two blinded examiners each utilized the universal goniometer and iPhone(®) to measure active wrist ROM using a volar/dorsal alignment technique in the following sequences: flexion, extension, radial deviation, and ulnar deviation. The second (2 h later) and third (48 h later) sessions were carried out in the same manner as the first session. All the measurements were conducted three times and the mean value of three repetitions for each measurement was used for analysis. Intraclass correlation coefficient (ICC) models (3, k) and (2, k) were used to determine the intra-rater and inter-rater reliability, respectively. The Pearson correlation coefficients were used to establish concurrent validity of the iPhone(®) app. Good to excellent intra-rater and inter-rater reliability was demonstrated for the goniometer with ICC values of ≥ 0.82 and ≥ 0.73 and the iPhone(®) app with ICC values of ≥ 0.83 and ≥ 0.79, respectively. Minimum detectable change at the 95% confidence level (MDC95 ) was computed as 1.96 × standard error of measurement

  12. Reliability and validity of the modified functional ambulation category scale in patients with hemiparalysis

    PubMed Central

    Park, Chang Sik; An, Seung Heon

    2016-01-01

    [Purpose] This study aimed to examine the inter- and intra-rater reliability and validity of the modified functional ambulation category (mFAC) scale. [Subjects and Methods] The participants were 66 stroke patients with hemiparalysis. The inter- and intra-rater validity of the mFAC was calculated using the Spearman correlation coefficient. A score comparison of the stable or maximum gait speed with regard to mFAC and modified Rivermead Mobility Index (mRMI) performances was performed as a univariate linear regression analysis to determine how the Kruskal-Wallis test affects the mRMI and stable/maximum gait speed with regard to mFAC. [Results] The inter-rater reliability of the mFAC (intraclass coefficient [ICC]) was 0.982 (0.971–0.989), with a kappa coefficient of 0.923 and a consistency ratio of 94%. In contrast, the intra-rater reliability of the mFAC (ICC) was 0.991 (0.986–0.995), with a kappa coefficient of 0.961 and a consistency ratio of 96%, showing higher reliability. Moreover, there was a significant difference in stable/maximum gait speed between the mFAC and the mRMI. [Conclusion] Since the mFAC has sufficient inter- and intra-reliability and high validity, it can be used as an assessment tool that reflects the gait performance and mobility of stroke patients. PMID:27630410

  13. Reliability of home-based, motor function measure in hereditary neuromuscular diseases.

    PubMed

    Ruiz-Cortes, Xiomara; Ortiz-Corredor, Fernando; Mendoza-Pulido, Camilo

    2017-02-01

    Objective To evaluate the reliability of the motor function measure (MFM) scale in the assessment of disease severity and progression when administered at home and clinic and assess its correlation with the Paediatric Outcomes Data Collection Instrument (PODCI). Methods In this prospective study, two assessors rated children with hereditary neuromuscular diseases (HNMDs) using the MFM at the clinic and then 2 weeks later at the patients' home. Intraclass correlation coefficient (ICC) was calculated for the reliability of the MFM and its domains. The reliability of each item was assessed and the correlation between MFM and three domains of PODCI was evaluated. Results A total of 48 children (5-17 years of age) were assessed in both locations and the MFM scale demonstrated excellent inter-rater reliability (ICC, 0.98). Weighted kappa ranged from excellent to poor. Correlation of the home-based MFM with the PODCI domain 'basic mobility and transfers' was excellent, with the 'upper extremity' domain was moderate, but there was no correlation with the 'happiness' domain. Conclusion The MFM is a reliable tool for assessing patients with HNMD when used in a home-based setting.

  14. Content validity and reliability of test of gross motor development in Chilean children

    PubMed Central

    Cano-Cappellacci, Marcelo; Leyton, Fernanda Aleitte; Carreño, Joshua Durán

    2016-01-01

    ABSTRACT OBJECTIVE To validate a Spanish version of the Test of Gross Motor Development (TGMD-2) for the Chilean population. METHODS Descriptive, transversal, non-experimental validity and reliability study. Four translators, three experts and 92 Chilean children, from five to 10 years, students from a primary school in Santiago, Chile, have participated. The Committee of Experts has carried out translation, back-translation and revision processes to determine the translinguistic equivalence and content validity of the test, using the content validity index in 2013. In addition, a pilot implementation was achieved to determine test reliability in Spanish, by using the intraclass correlation coefficient and Bland-Altman method. We evaluated whether the results presented significant differences by replacing the bat with a racket, using T-test. RESULTS We obtained a content validity index higher than 0.80 for language clarity and relevance of the TGMD-2 for children. There were significant differences in the object control subtest when comparing the results with bat and racket. The intraclass correlation coefficient for reliability inter-rater, intra-rater and test-retest reliability was greater than 0.80 in all cases. CONCLUSIONS The TGMD-2 has appropriate content validity to be applied in the Chilean population. The reliability of this test is within the appropriate parameters and its use could be recommended in this population after the establishment of normative data, setting a further precedent for the validation in other Latin American countries. PMID:26815160

  15. Development and reliability of an audit tool to assess the school physical activity environment across 12 countries

    PubMed Central

    Broyles, S T; Drazba, K T; Church, T S; Chaput, J-P; Fogelholm, M; Hu, G; Kuriyan, R; Kurpad, A; Lambert, E V; Maher, C; Maia, J; Matsudo, V; Olds, T; Onywera, V; Sarmiento, O L; Standage, M; Tremblay, M S; Tudor-Locke, C; Zhao, P; Katzmarzyk, P T

    2015-01-01

    Objectives: Schools are an important setting to enable and promote physical activity. Researchers have created a variety of tools to perform objective environmental assessments (or ‘audits') of other settings, such as neighborhoods and parks; yet, methods to assess the school physical activity environment are less common. The purpose of this study is to describe the approach used to objectively measure the school physical activity environment across 12 countries representing all inhabited continents, and to report on the reliability and feasibility of this methodology across these diverse settings. Methods: The International Study of Childhood Obesity, Lifestyle and the Environment (ISCOLE) school audit tool (ISAT) data collection required an in-depth training (including field practice and certification) and was facilitated by various supporting materials. Certified data collectors used the ISAT to assess the environment of all schools enrolled in ISCOLE. Sites completed a reliability audit (simultaneous audits by two independent, certified data collectors) for a minimum of two schools or at least 5% of their school sample. Item-level agreement between data collectors was assessed with both the kappa statistic and percent agreement. Inter-rater reliability of school summary scores was measured using the intraclass correlation coefficient. Results: Across the 12 sites, 256 schools participated in ISCOLE. Reliability audits were conducted at 53 schools (20.7% of the sample). For the assessed environmental features, inter-rater reliability (kappa) ranged from 0.37 to 0.96; 18 items (42%) were assessed with almost perfect reliability (κ=0.80–0.96), and a further 24 items (56%) were assessed with substantial reliability (κ=0.61–0.79). Likewise, scores that summarized a school's support for physical activity were highly reliable, with the exception of scores assessing aesthetics and perceived suitability of the school grounds for sport, informal games and general

  16. Reliability of MR-Based Volumetric 3-D Analysis of Pelvic Muscles among Subjects with Low Back with Leg Pain and Healthy Volunteers

    PubMed Central

    Skorupska, Elżbieta; Keczmer, Przemysław; Łochowski, Rafał M.; Tomal, Paulina; Rychlik, Michał; Samborski, Włodzimierz

    2016-01-01

    Aim Lately, the diagnostic value of magnetic resonance imaging, Lasègue sign and classic neurological signs have been considered not accurate enough to distinguish the radicular from non-radicular low back with leg pain (LBLP) and a calculation of the symptomatic side muscle volume has been indicated as a probable valuable marker. However, only the multifidus muscle volume has been calculated so far. The main objective of the study was to verify whether LBLP subjects presented symptomatic side pelvic muscle atrophy compared to healthy volunteers. The second aim was to assess the inter-rater reliability of 3-D manual method for segmenting and measuring the volume of the gluteus maximus, gluteus medius, gluteus minimus and piriformis muscles in both LBLP patients and healthy subjects. Method Two independent raters analyzed MR images of LBLP and healthy subjects towards muscle volume of four pelvic muscles, i.e. the piriformis, gluteus minimus, gluteus medius and gluteus maximus. For both sides, the MR images of the muscles without adipose tissue infiltration were manually segmented in 3-D medical images. Results Symptomatic muscle atrophy was confirmed in only over 50% of LBLP subjects (gluteus maximus (p<0.001), gluteus minimus (p<0.01) and piriformis (p<0.05)). The ICC values indicated that the inter-rater reproducibility was greater than 0.90 for all measurements (LBLP and healthy subjects), except for the measurement of the right gluteus medius muscle in LBLP patients, which was equal to 0.848. Conclusion More than 50% of LBLP subjects presented symptomatic gluteus maximus, gluteus minimus and piriformis muscle atrophy. 3-D manual segmentation reliably measured muscle volume in all the measured pelvic muscles in both healthy and LBLP subjects. To answer the question of what kind of muscle atrophy is indicative of radicular or non-radicular pain further studies are required. PMID:27459688

  17. Reliability and Validity Study of Clinical Ultrasound Imaging on Lateral Curvature of Adolescent Idiopathic Scoliosis

    PubMed Central

    Wang, Q.; Li, M.; Lou, Edmond H. M.; Wong, M. S.

    2015-01-01

    Background Non-ionizing radiation imaging assessment has been advocated for the patients with adolescent idiopathic scoliosis (AIS). As one of the radiation-free methods, ultrasound imaging has gained growing attention in scoliosis assessment over the past decade. The center of laminae (COL) method has been proposed to measure the spinal curvature in the coronal plane of ultrasound image. However, the reliability and validity of this ultrasound method have not been validated in the clinical setting. Objectives To evaluate the reliability and validity of clinical ultrasound imaging on lateral curvature measurements of AIS with their corresponding magnetic resonance imaging (MRI) measurements. Methods Thirty curves (ranged 10.2°–68.2°) from sixteen patients with AIS were eligible for this study. The ultrasound scan was performed using a 3-D ultrasound unit within the same morning of MRI examination. Two researchers were involved in data collection of these two examinations. The COL method was used to measure the coronal curvature in ultrasound image, compared with the Cobb method in MRI. The intra- and inter-rater reliability of the COL method was evaluated by intra-class correlation coefficient (ICC). The validity of this method was analyzed by paired Student’s t-test, Bland–Altman statistics and Pearson correlation coefficient. The level of significance was set as 0.05. Results The COL method showed high intra- and inter-rater reliabilities (both with ICC (2, K) >0.9, p<0.05) to measure the coronal curvature. Compared with Cobb method, COL method showed no significant difference (p<0.05) when measuring coronal curvature. Furthermore, Bland-Altman method demonstrated an agreement between these two methods, and Pearson’s correlation coefficient (r) was high (r>0.9, p<0.05). Conclusion The ultrasound imaging could provide a reliable and valid measurement of spinal curvature in the coronal plane using the COL method. Further research is needed to validate the

  18. A sensitive and reliable test instrument to assess swimming in rats with spinal cord injury.

    PubMed

    Xu, Ning; Åkesson, Elisabet; Holmberg, Lena; Sundström, Erik

    2015-09-15

    For clinical translation of experimental spinal cord injury (SCI) research, evaluation of animal SCI models should include several sensorimotor functions. Validated and reliable assessment tools should be applicable to a wide range of injury severity. The BBB scale is the most widely used test instrument, but similar to most others it is used to assess open field ambulation. We have developed an assessment tool for swimming in rats with SCI, with high discriminative power and sensitivity to functional recovery after mild and severe injuries, without need for advanced test equipment. We studied various parameters of swimming in four groups of rats with thoracic SCI of different severity and a control group, for 8 weeks after surgery. Six parameters were combined in a multiple item scale, the Karolinska Institutet Swim Assessment Tool (KSAT). KSAT scores for all SCI groups showed consistent functional improvement after injury, and significant differences between the five experimental groups. The internal consistency, the inter-rater and the test-retest reliability were very high. The KSAT score was highly correlated to the cross-section area of white matter spared at the injury epicenter. Importantly, even after 8 weeks of recovery the KSAT score reliably discriminated normal animals from those inflicted by the mildest injury, and also displayed the recovery of the most severely injured rats. We conclude that this swim scale is an efficient and reliable tool to assess motor activity during swimming, and an important addition to the methods available for evaluating rat models of SCI.

  19. Reliability of the CMT neuropathy score (second version) in Charcot-Marie-Tooth disease.

    PubMed

    Murphy, Sinéad M; Herrmann, David N; McDermott, Michael P; Scherer, Steven S; Shy, Michael E; Reilly, Mary M; Pareyson, Davide

    2011-09-01

    The Charcot-Marie-Tooth neuropathy score (CMTNS) is a reliable and valid composite score comprising symptoms, signs, and neurophysiological tests, which has been used in natural history studies of CMT1A and CMT1X and as an outcome measure in treatment trials of CMT1A. Following an international workshop on outcome measures in Charcot-Marie-Tooth disease (CMT), the CMTNS was modified to attempt to reduce floor and ceiling effects and to standardize patient assessment, aiming to improve its sensitivity for detecting change over time and the effect of an intervention. After agreeing on the modifications made to the CMTNS (CMTNS2), three examiners evaluated 16 patients to determine inter-rater reliability; one examiner evaluated 18 patients twice within 8 weeks to determine intra-rater reliability. Three examiners evaluated 63 patients using the CMTNS and the CMTNS2 to determine how the modifications altered scoring. For inter- and intra-rater reliability, intra-class correlation coefficients (ICCs) were ≥0.96 for the CMT symptom score and the CMT examination score. There were small but significant differences in some of the individual components of the CMTNS compared with the CMTNS2, mainly in the components that had been modified the most. A longitudinal study is in progress to determine whether the CMTNS2 is more sensitive than the CMTNS for detecting change over time.

  20. Validity and reliability of the assessment and diagnosis of musculoskeletal elbow disorders using telerehabilitation.

    PubMed

    Lade, Hannah; McKenzie, Stephanie; Steele, Leah; Russell, Trevor G

    2012-10-01

    We examined the validity and reliability of a physiotherapy examination of the elbow, using telerehabilitation. The patho-anatomical diagnoses, systems diagnosis and physical examination findings of face-to-face physiotherapy examinations were compared with telerehabilitation examinations. Ten participants attended a single session, during which they were interviewed, a face-to-face physical examination was performed and a remote physical examination was conducted, guided by an examiner at a different location via a telerehabilitation system. Conventional face-to-face physiotherapy physical examination test results, diagnoses and systems diagnoses were compared to those produced by an examiner using the telerehabiliation system. There was substantial agreement for systems diagnosis (73%; P = 0.013) for validity and almost perfect agreement for intra-rater reliability (90%; P = 0.001). The inter-rater reliability had a weaker and non-significant agreement (64%; P = 0.11). Physical examination data demonstrated >68% agreement across all three datasets, between the examination methods. Performing a telerehabilitation physical examination to determine a musculoskeletal diagnosis of the elbow joint complex is both valid and reliable.

  1. Reliability and smallest real difference of the ankle lunge test post ankle fracture.

    PubMed

    Simondson, David; Brock, Kim; Cotton, Susan

    2012-02-01

    This study aimed to determine the reliability and the smallest real difference of the Ankle Lunge test in an ankle fracture patient population. In the post immobilisation stage of ankle fracture, ankle dorsiflexion is an important measure of progress and outcome. The Ankle Lunge test measures weight bearing dorsiflexion, resulting in negative scores (knee to wall distance) and positive scores (toe to wall distance), for which the latter has proven reliability in normal subjects only. A consecutive sample of ankle fracture patients with permission to commence weight bearing, were recruited to the study. Three measurements of the Ankle Lunge Test were performed each by two raters, one senior and one junior physiotherapist. These occurred prior to therapy sessions in the second week after plaster removal. A standardised testing station was utilised and allowed for both knee to wall distance and toe to wall distance measurement. Data was collected from 10 individuals with ankle fracture, with an average age of 36 years (SD 14.8). Seventy seven percent of observations were negative. Intra and inter-rater reliability yielded intra class correlations at or above 0.97, p < .001. There was a significant systematic bias towards improved scores during repeated measurement for one rater (p = .01). The smallest real difference was calculated as 13.8mm. The Ankle Lunge test is a practical and reliable tool for measuring weightbearing dorsiflexion post ankle fracture.

  2. THE RELIABILITY OF MAGNETIC RESONANCE ELASTOGRAPHY USING MULTISLICE 2D SPIN-ECHO ECHO-PLANAR IMAGING (SE-EPI) AND 3D INVERSION RECONSTRUCTION FOR ASSESSING RENAL STIFFNESS

    PubMed Central

    Low, Gavin; Owen, Nicola E.; Joubert, Ilse; Patterson, Andrew J.; Graves, Martin J.; Glaser, Kevin J.; Alexander, Graeme J.M.; Lomas, David J.

    2015-01-01

    PURPOSE To evaluate the reliability of MRE using a spin-echo echo-planar imaging (SE-EPI) renal MRE technique in healthy volunteers MATERIALS AND METHODS Institutional review board approved prospective study in which all participants provided written informed consent. Sixteen healthy volunteers comprising seven males and nine females with a median age of 35 years (age range: 23 to 59 years) were included. Coronal 90-Hz and 60-Hz MRE acquisitions were performed twice within a 30-minute interval between examinations. Renal MRE reliability was assessed by i) test-retest repeatability, and ii) inter-rater agreement between two independent readers. The MRE-measured averaged renal stiffness values were evaluated using: intraclass correlation coefficient (ICC), Bland-Altman and the within-subject coefficient of variation (COV). RESULTS For test-retest repeatability, Bland-Altman showed a mean stiffness difference between examinations of 0.07 kPa (95% limits of agreement: −1.41, 1.54) at 90-Hz and 0.01 kPa (95% limits of agreement: −0.51, 0.53) at 60-Hz. Coefficient of repeatability was 1.47 kPa and 0.52 kPa at 90-Hz and 60-Hz, respectively. The within-subject COV was 13.6% and 7.7% at 90-Hz and 60-Hz, respectively. ICC values were 0.922 and 0.907 for test-retest repeatability and 0.998 and 0.989 for inter-rater agreement, respectively (p < 0.001). CONCLUSION SE-EPI renal MRE is a reliable technique PMID:25537823

  3. Practices in Adequate Structural Design

    NASA Technical Reports Server (NTRS)

    Ryan, Robert S.

    1989-01-01

    Structural design and verification of space vehicles and space systems is a very tricky and awe inspiring business, particularly for manned missions. Failures in the missions with loss of life is devastating personally and nationally. The scope of the problem is driven by high performance requirements which push state-of-the-art technologies, creating high sensitivites to small variations and uncertainties. Insurance of safe, reliable flight dictates the use of sound principles, procedures, analysis, and testing. Many of those principles which were refocused by the Space Shuttle Challenger (51-L) accident on January 26, 1986, and the activities conducted to insure safe shuttle reflights are discussed. The emphasis will be focused on engineering, while recognizing that project and project management are also key to success.

  4. Reliability of a New Radiographic Classification for Developmental Dysplasia of the Hip

    PubMed Central

    Narayanan, Unni; Mulpuri, Kishore; Sankar, Wudbhav N.; Clarke, Nicholas M.P.; Hosalkar, Harish

    2015-01-01

    Background: Existing radiographic classification schemes (eg, Tönnis criteria) for DDH quantify the severity of disease based on the position of the ossific nucleus relative to Hilgenreiner’s and Perkin’s lines. By definition, this method requires the presence of an ossification centre, which can be delayed in appearance and eccentric in location within the femoral head. A new radiographic classification system has been developed by the International Hip Dysplasia Institute (IHDI), which uses the mid-point of the proximal femoral metaphysis as a reference landmark, and can therefore be applied to children of all ages. The purpose of this study was to compare the reliability of this new method with that of Tönnis, as the first step in establishing its validity and clinical utility. Methods: Twenty standardized anteroposterior pelvic radiographs of children with untreated DDH were selected purposefully to capture the spectrum of age (range, 3 to 32 mo) at presentation and disease severity. Each of the hips was classified separately by the IHDI and Tönnis methods by 6 experienced pediatric orthopaedists from the United States, Canada, Mexico, United Kingdom, and by 2 orthopaedic senior residents. The inter-rater reliability was tested using the Intra Class Correlation coefficient (ICC) to measure concordance between raters. Results: All 40 hips were classifiable by the IHDI method by all raters. Ten of the 40 hips could not be classified by the Tönnis method because of the absence of the ossific nucleus on one or both sides. The ICC (95% confidence interval) for the IHDI method for all raters was 0.90 (0.83-0.95) and 0.95 (0.91-0.98) for the right and left hips, respectively. The corresponding ICCs for the Tönnis method were 0.63 (0.46-0.80) and 0.60 (0.43-0.78), respectively. There was no significant difference between the ICCs of the 6 experts and 2 trainees. Conclusions: The IHDI method of classification has excellent inter-rater reliability, both among

  5. Reliability and concurrent validity of a novel method allowing for in-shoe measurement of navicular drop

    PubMed Central

    2014-01-01

    Background Increased navicular drop is associated with increased risk of lower extremity overuse injuries and foot orthoses are often prescribed to reduce navicular drop. For laboratory studies, transparent shoes may be used to monitor the effect of orthoses but no clinically feasible methods exist. We have developed a stretch-sensor that allows for in-shoe measurement of navicular drop but the reliability and validity is unknown. The purpose of this study was to investigate: 1) the reliability of the stretch-sensor for measuring navicular drop, and 2) the concurrent validity of the stretch-sensor compared to the static navicular drop test. Methods Intra- and inter-rater reliability was tested on 27 participants walking on a treadmill on two separate days. The stretch-sensor was positioned 20 mm posterior to the tip of the medial malleolus and 20 mm posterior to the navicular tuberosity. The participants walked six minutes on the treadmill before navicular drop was measured. Reliability was quantified by the Intraclass Correlation Coefficient (ICC 2.1) and agreement was quantified by Limits of Agreement (LOA). To assess concurrent validity, static navicular drop was measured with the stretch-sensor and compared with static navicular drop measured with a ruler on 27 new participants. Linear regression was used to measure concurrent validity. Results The reliability of the stretch-sensor was acceptable for barefoot measurement (intra- and inter-rater ICC: 0.76-0.84) but lower for in-shoe measurement (ICC: 0.65). There was a significant association between static navicular drop measured with the stretch-sensor compared with a ruler (r = 0.745, p < 0.001). Conclusion This study suggests that the stretch-sensor has acceptable reliability for dynamic barefoot measurement of navicular drop. Furthermore, the stretch-sensor shows concurrent validity compared with the static navicular drop test as performed by Brody. This new simple method may hold promise for both

  6. Reliability and validity of DSM-IV generalized anxiety disorder features.

    PubMed

    Gordon, Dina; Heimberg, Richard G

    2011-08-01

    The reliability of generalized anxiety disorder (GAD) features has been shown to be moderate, based on research utilizing the Anxiety Disorders Interview Schedule for DSM-IV (ADIS-IV), a semi-structured diagnostic interview. This may be a function of the criteria for the diagnosis of GAD, which have undergone much revision since its first inclusion in the Diagnostic and Statistical Manual of Mental Disorders. The reliability and validity of disorder feature ratings were examined in a diverse sample of patients who presented for assessment and treatment of excessive worry, generalized anxiety, or tension at an anxiety specialty clinic and who met criteria for a principal diagnosis of GAD (N=129). Internal consistency of the ratings of excessiveness of worry, uncontrollability of worry, and the associated symptom cluster was moderate to low and varied by disorder feature. Inter-rater reliability for all features of GAD and severity of the disorder varied between good and poor. Additional findings showed that the GAD features, as measured using the ADIS-IV module, have modest to strong convergent validity, varying by feature, and poor discriminant validity when tested against measures of social anxiety. Potential reasons for rater disagreement are discussed. Results are also considered in terms of how they may inform the evolving criteria for GAD in DSM-V.

  7. The Irvine, Beatties, and Bresnahan (IBB) Forelimb Recovery Scale: An Assessment of Reliability and Validity

    PubMed Central

    Irvine, Karen-Amanda; Ferguson, Adam R.; Mitchell, Kathleen D.; Beattie, Stephanie B.; Lin, Amity; Stuck, Ellen D.; Huie, J. Russell; Nielson, Jessica L.; Talbott, Jason F.; Inoue, Tomoo; Beattie, Michael S.; Bresnahan, Jacqueline C.

    2014-01-01

    The IBB scale is a recently developed forelimb scale for the assessment of fine control of the forelimb and digits after cervical spinal cord injury [SCI; (1)]. The present paper describes the assessment of inter-rater reliability and face, concurrent and construct validity of this scale following SCI. It demonstrates that the IBB is a reliable and valid scale that is sensitive to severity of SCI and to recovery over time. In addition, the IBB correlates with other outcome measures and is highly predictive of biological measures of tissue pathology. Multivariate analysis using principal component analysis (PCA) demonstrates that the IBB is highly predictive of the syndromic outcome after SCI (2), and is among the best predictors of bio-behavioral function, based on strong construct validity. Altogether, the data suggest that the IBB, especially in concert with other measures, is a reliable and valid tool for assessing neurological deficits in fine motor control of the distal forelimb, and represents a powerful addition to multivariate outcome batteries aimed at documenting recovery of function after cervical SCI in rats. PMID:25071704

  8. A nine-test screening battery for athletes: a reliability study.

    PubMed

    Frohm, A; Heijne, A; Kowalski, J; Svensson, P; Myklebust, G

    2012-06-01

    Studies have shown that reduced neuromuscular control or strength increases the risk of acute injuries. It is hypothesized that a non-functional movement pattern can predispose for injuries. In the present paper a detailed description of a test battery consisting of nine different tests to screen athletic movement pattern is provided. The aim was to evaluate the inter- and intra-rater reliability of the test battery on a group of male elite soccer players. Twenty-six healthy elite soccer players (17-28 years) were screened. Eighteen participated at a second occasion 7 days later. No significant difference (P=0.31) was found between test occasion 1 (LS means 18.3, 95% confidence interval 14.9-21.7) and test occasion 2 (18.0, 14.4-21.7) in the mean total score of the test battery. No significant difference in the inter-rater reliability was found between the eight physiotherapists at the two test occasions. The intra-class correlation coefficient was 0.80 and 0.81, respectively. The test battery showed good inter- and intra-rater reliability. The screening battery is easy to use for familiarized professionals and requires minimal equipment. However, further studies are needed to confirm the validity of the test battery in injury prevention, rehabilitation and performance enhancement.

  9. Diffusion tensor imaging tractography and reliability analysis for limbic and paralimbic white matter tracts.

    PubMed

    Malykhin, Nikolai; Concha, Luis; Seres, Peter; Beaulieu, Christian; Coupland, Nicholas J

    2008-11-30

    Diffusion tensor imaging (DTI) provides the opportunity to study white matter tracts in vivo. The goal was to estimate the reliability of DTI tractography for the analysis of limbic and paralimbic white matter. Normative data from 24 healthy subjects and reliability data from four healthy and four depressed subjects were acquired at 1.5 Tesla, using twice-refocused spin-echo, echoplanar DTI and Fluid-Attenuated Inversion Recovery (FLAIR) DTI sequences. Fiber tracking was performed using the Fiber Assignment by Continuous Tracking algorithm. Fractional Anisotropy (FA), trace Apparent Diffusion Coefficient and tract volumes were calculated. The inter-rater (and intra-rater) intraclass correlation coefficients for FA values were as follows: rostral cingulum 0.89 (0.87), dorsal cingulum 0.85 (0.90), parahippocampal cingulum 0.85 (0.95), uncinate fasciculus 0.85 (0.87), medial prefrontal white matter 0.97 (0.99), ventromedial prefrontal white matter 0.92 (0.93), crus of fornix 0.80 (0.81). The reported DTI protocol provides a reliable method to analyze limbic and paralimbic white matter tracts relevant to psychiatric disorders.

  10. The Chinese version of the Personal and Social Performance Scale (PSP): validity and reliability.

    PubMed

    Tianmei, Si; Liang, Shu; Yun'ai, Su; Chenghua, Tian; Jun, Yan; Jia, Cheng; Xueni, Li; Qi, Liu; Yantao, Ma; Weihua, Zhang; Hongyan, Zhang

    2011-01-30

    The Personal and Social Performance Scale (PSP) is a 100-point single-item rating scale that assesses four important domains of patients with mental disorders. This study was designed to examine the validity and reliability of a Chinese version of the PSP. The study was conducted in a sample of 157 patients with schizophrenia (confirmed by DSM-IV-TR criteria, SCID-P interview). The internal consistency (Cronbach's alpha=0.84) and the inter-rater reliability (kappa value=0.82, ICC=0.94 for PSP total score) was good. The test-retest reliability was high (intraclass correlation coefficient (ICC) of 0.95). The scale showed good construct validity with statistically significant correlations with the Global Assessment of Functioning Scale (GAF) (ICC of 0.95). The PSP score had a good negative correlation with the Positive and Negative Syndrome Scale (PANSS) total score. The improvement in PSP after 8 weeks of treatment was significantly correlated with the reduction in PANSS: after 8 weeks of treatment, the responders (defined as those with a reduction in PANSS total score ≥50%) experienced a greater improvement in PSP than the non-responders. The Chinese version of the PSP is a convenient and valid instrument to assess the personal and social functions of stabilized and acute patients with schizophrenia.

  11. Reliability and confidence in using a paired comparison paradigm in perceptual voice quality evaluation.

    PubMed

    Yiu, Edwin M-L; Chan, Karen M K; Mok, Rosa S-M

    2007-02-01

    One of the ways to improve the reliability in perceptual voice quality rating is to provide listeners with external anchors. A paired comparison matching paradigm using synthesized Cantonese voice stimuli that covered a range of rough and breathy qualities were used to investigate the rating reliability. Twenty-five speech pathology students rated the severity of roughness and breathiness of natural pathological voice samples using two paradigms: an eight-point anchored matching (paired comparison) paradigm and an eight-point non-anchored equal-appearing-interval (EAI) scale paradigm. The listeners also rated their confidence in judging each testing stimulus on a seven-point EAI scale. The results showed that the paired comparison method specifically improved the inter-rater reliability in rating male rough stimuli and mildly dysphonic female stimuli. The intra-rater agreement and confidence ratings remained similar across the two rating paradigms. These results suggest that the paired comparison paradigm may be used as an alternative perceptual voice quality evaluation tool.

  12. Reliability and validity of the Korean version of the community balance and mobility scale in patients with hemiplegia after stroke

    PubMed Central

    Lee, Kyoung-bo; Lee, Paul; Yoo, Sang-won; Kim, Young-dong

    2016-01-01

    [Purpose] The aim of this study was to translate and adapt the Community Balance and Mobility Scale (CB&M) into Korean (K-CB&M) and to verify the reliability and validity of scores obtained with Korean patients. [Subjects and Methods] A total of 16 subjects were recruited from St. Vincent’s Hospital in South Korea. At each testing session, subjects completed the K-CB&M, Berg balance scale (BBS), timed up and go test (TUG), and functional reaching test. All tests were administered by a physical therapist, and subjects completed the tests in an identical standardized order during all testing sessions. [Results] The inter- and intra-rater reliability coefficients were high for most subscores, while moderate inter-rater reliability was observed for the items “walking and looking” and “walk, look, and carry”, and moderate intra-rater reliability was observed for “forward to backward walking”. There was a positive correlation between the K-CB&M and BBS and a negative correlation between the K-CB&M and TUG in the convergent validity assessments. [Conclusion] The reliability and validity of the K-CB&M was high, suggesting that clinical practitioners treating Korean patients with hemiplegia can use this material for assessing static and dynamic balance. PMID:27630420

  13. Reliability and validity of the Korean version of the community balance and mobility scale in patients with hemiplegia after stroke.

    PubMed

    Lee, Kyoung-Bo; Lee, Paul; Yoo, Sang-Won; Kim, Young-Dong

    2016-08-01

    [Purpose] The aim of this study was to translate and adapt the Community Balance and Mobility Scale (CB&M) into Korean (K-CB&M) and to verify the reliability and validity of scores obtained with Korean patients. [Subjects and Methods] A total of 16 subjects were recruited from St. Vincent's Hospital in South Korea. At each testing session, subjects completed the K-CB&M, Berg balance scale (BBS), timed up and go test (TUG), and functional reaching test. All tests were administered by a physical therapist, and subjects completed the tests in an identical standardized order during all testing sessions. [Results] The inter- and intra-rater reliability coefficients were high for most subscores, while moderate inter-rater reliability was observed for the items "walking and looking" and "walk, look, and carry", and moderate intra-rater reliability was observed for "forward to backward walking". There was a positive correlation between the K-CB&M and BBS and a negative correlation between the K-CB&M and TUG in the convergent validity assessments. [Conclusion] The reliability and validity of the K-CB&M was high, suggesting that clinical practitioners treating Korean patients with hemiplegia can use this material for assessing static and dynamic balance.

  14. Validity and reliability of a low-cost digital dynamometer for measuring isometric strength of lower limb.

    PubMed

    Romero-Franco, Natalia; Jiménez-Reyes, Pedro; Montaño-Munuera, Juan A

    2016-11-24

    Lower limb isometric strength is a key parameter to monitor the training process or recognise muscle weakness and injury risk. However, valid and reliable methods to evaluate it often require high-cost tools. The aim of this study was to analyse the concurrent validity and reliability of a low-cost digital dynamometer for measuring isometric strength in lower limb. Eleven physically active and healthy participants performed maximal isometric strength for: flexion and extension of ankle, flexion and extension of knee, flexion, extension, adduction, abduction, internal and external rotation of hip. Data obtained by the digital dynamometer were compared with the isokinetic dynamometer to examine its concurrent validity. Data obtained by the digital dynamometer from 2 different evaluators and 2 different sessions were compared to examine its inter-rater and intra-rater reliability. Intra-class correlation (ICC) for validity was excellent in every movement (ICC > 0.9). Intra and inter-tester reliability was excellent for all the movements assessed (ICC > 0.75). The low-cost digital dynamometer demonstrated strong concurrent validity and excellent intra and inter-tester reliability for assessing isometric strength in the main lower limb movements.

  15. The Reliability of Naturalistic Observations of Social, Physical and Economic Environments of Bars.

    PubMed

    Morrison, Christopher; Lee, Juliet P; Gruenewald, Paul J; Mair, Christina

    2016-01-01

    Drinking in bars contributes to numerous public health problems, including violence and motor vehicle crashes. In order to formulate effective preventive interventions it is essential to identify which specific features of bar environments are related to increased risks. Unobtrusive ethnographic observations are one approach that has been used to characterize these features; however no studies have assessed reliability in a representative sample of bars. We performed brief scouting assessments in all 165 bars in six purposively selected California cities, followed by unobtrusive observations from a subsequent representative sample of 97 bars which were located in low and high bar density areas of the cities. Inter-rater reliability between two independent observers assessed individual item reliability, and principal components analyses assessed the reliability of a series of scales describing the physical, social, and economic characteristics of the bars. For the scouting assessment, items exhibited at least moderate reliability (κ or r ≥ 0.40). For the unobtrusive observations, items assessing physical and economic environments (e.g., pool table present, κ = 0.90; index beer cost, r = 0.82) had moderate to outstanding reliability (κ or r > 0.80). Items describing the social environment generally had poorer reliability, though group aspects (e.g., patron count, r = 0.78; patron circulation, r = 0.64) had better reliability than individual behaviors (e.g., derogatory speech, κ = 0.12). Scales constructed from specific sets of items exhibited modest reliability. The individual metrics and principal components we present will enable future studies seeking to disaggregate relationships between bar characteristics and public health problems.

  16. The Reliability of Naturalistic Observations of Social, Physical and Economic Environments of Bars

    PubMed Central

    Morrison, Christopher; Lee, Juliet P.; Gruenewald, Paul J.; Mair, Christina

    2016-01-01

    Drinking in bars contributes to numerous public health problems, including violence and motor vehicle crashes. In order to formulate effective preventive interventions it is essential to identify which specific features of bar environments are related to increased risks. Unobtrusive ethnographic observations are one approach that has been used to characterize these features; however no studies have assessed reliability in a representative sample of bars. We performed brief scouting assessments in all 165 bars in six purposively selected California cities, followed by unobtrusive observations from a subsequent representative sample of 97 bars which were located in low and high bar density areas of the cities. Inter-rater reliability between two independent observers assessed individual item reliability, and principal components analyses assessed the reliability of a series of scales describing the physical, social, and economic characteristics of the bars. For the scouting assessment, items exhibited at least moderate reliability (κ or r ≥ 0.40). For the unobtrusive observations, items assessing physical and economic environments (e.g., pool table present, κ = 0.90; index beer cost, r = 0.82) had moderate to outstanding reliability (κ or r > 0.80). Items describing the social environment generally had poorer reliability, though group aspects (e.g., patron count, r = 0.78; patron circulation, r = 0.64) had better reliability than individual behaviors (e.g., derogatory speech, κ = 0.12). Scales constructed from specific sets of items exhibited modest reliability. The individual metrics and principal components we present will enable future studies seeking to disaggregate relationships between bar characteristics and public health problems. PMID:27695393

  17. 21 CFR 1404.900 - Adequate evidence.

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... 21 Food and Drugs 9 2012-04-01 2012-04-01 false Adequate evidence. 1404.900 Section 1404.900 Food and Drugs OFFICE OF NATIONAL DRUG CONTROL POLICY GOVERNMENTWIDE DEBARMENT AND SUSPENSION (NONPROCUREMENT) Definitions § 1404.900 Adequate evidence. Adequate evidence means information sufficient...

  18. 21 CFR 1404.900 - Adequate evidence.

    Code of Federal Regulations, 2010 CFR

    2010-04-01

    ... 21 Food and Drugs 9 2010-04-01 2010-04-01 false Adequate evidence. 1404.900 Section 1404.900 Food and Drugs OFFICE OF NATIONAL DRUG CONTROL POLICY GOVERNMENTWIDE DEBARMENT AND SUSPENSION (NONPROCUREMENT) Definitions § 1404.900 Adequate evidence. Adequate evidence means information sufficient...

  19. Evaluation of Reliability and Validity of the Hendrich II Fall Risk Model in a Chinese Hospital Population

    PubMed Central

    Zhang, Congcong; Wu, Xinjuan; Lin, Songbai; Jia, Zhaoxia; Cao, Jing

    2015-01-01

    To translate, validate and examine the reliability and validity of a Chinese version of the Hendrich II Fall risk Model (HFRM) in predicting falls in elderly inpatient. A sample of 989 Chinese elderly inpatients was recruited upon admission at the Peking Union Medical College Hospital. The inpatients were assessed for fall risk using the Chinese version of the HFRM at admission. The reliability of the Chinese version of the HFRM was determined using the internal consistency and test-rested methods. Validity was determined using construct validity and convergent validity. Receiver operating characteristic (ROC) curves were created to determine the sensitivity and specificity. The Chinese version of the HFRM showed excellent repeatability with an intra-class correlation coefficient (ICC) of 0.9950 (95% confidence interval (CI): 0.9923–0.9984). The inter-rater reliability was high with an ICC of 0.9950 (95%CI: 0.9923–0.9984). Cronbach’s alpha coefficient was 0.366. Content validity was excellent, with a content validity ratio of 0.9333. The Chinese version of the HFRM had a sensitivity of 72% and a specificity of 69% when using a cut-off of 5 points on the scale. The area under the curve (AUC) was 0.815 (P<0.001). The Chinese version of the HFRM showed good reliability and validity in assessing the risk of fall in Chinese elderly inpatients. PMID:26544961

  20. The activities-specific balance confidence scale and berg balance scale: Reliability and validity in Arabic-speaking vestibular patients.

    PubMed

    Alghwiri, Alia A; Alghadir, Ahmad H; Al-Momani, Murad O; Whitney, Susan L

    2016-01-01

    Persons with vestibular disorders are susceptible to imbalance. The Activities-specific Balance Confidence (ABC) scale and Berg Balance Scale (BBS) have been validated in persons with vestibular disorders. The purpose of this study was to examine the reliability and validity of the Arabic versions of ABC and BBS among Arabic-speaking persons with vestibular disorders in Jordan and Saudi Arabia. Therefore, the A-ABC and A-BBS were administered to a convenience sample of 82 persons with vestibular disorders (age = 43 ± 14), (56% female). The test-retest reliability of the A-ABC item and total score as well as the inter-rater and intra-rater reliability of the A-BBS total score reflected high agreement. Significant and large correlations were found between the A-ABC and the A-BBS (r= 0.54, P< 0.05), the A-ABC and the Arabic Dizziness Handicap Inventory (A-DHI) (r= -0.76, P< 0.05), and the A-BBS and the A-DHI (r= -0.56, P< 0.05). The A-ABC and the A-BBS demonstrated good reliability and validity and can be utilized with Arabic-speaking persons with vestibular disorders.

  1. Interictal attenuation in pediatric electrocorticography can be reliably detected by EEG readers.

    PubMed

    Kim, Andrew J; Nangia, Srishti; Berg, Anne T; Nordli, Douglas R

    2014-10-01

    Intraoperative electrocorticography (ECoG) helps to demarcate epileptogenic cortex, but a commonly observed feature, interictal attenuation, has received little attention. This may limit its use in the determination of the resection margin. In order to test how reliably EEGers can discern attenuation, we assessed how well EEGers agree with each other and with an objective, quantified measure of attenuation. ECoG segments (n=34) were evaluated for attenuation by two EEGers independently and in consensus, and by an amplitude spectral analysis-based quantitative method. A third EEGer divided the 34 ECoG segments into 3 subgroups-physiologic field present, physiologic field uncertain, and physiologic field absent-based on the clustering patterns of the attenuated electrodes. Inter-rater agreement between two independent EEGers (kappa=0.56) was moderate, and between consensus EEGers and the quantitative method (kappa=0.71) was substantial. These agreements were especially good among the physiologic field present subgroup where the attenuation clearly involved contiguous electrodes, and thus, more likely pathologic (kappa=0.64 for two independent EEGers and kappa=0.78 for consensus EEGers and quantitative method). Our results suggest that interictal attenuation, especially when involving contiguous electrodes, is an ECoG marker that can be consistently and reliably discerned by trained EEGers.

  2. Reliability of the hospital nutrition environment scan for cafeterias, vending machines, and gift shops.

    PubMed

    Winston, Courtney P; Sallis, James F; Swartz, Michael D; Hoelscher, Deanna M; Peskin, Melissa F

    2013-08-01

    According to ecological models, the physical environment plays a major role in determining individual health behaviors. As such, researchers have started targeting the consumer nutrition environment of large-scale foodservice operations when implementing obesity-prevention programs. In 2010, the American Hospital Association released a call-to-action encouraging health care facilities to join in this movement and improve their facilities' consumer nutrition environments. The Hospital Nutrition Environment Scan (HNES) for Cafeterias, Vending Machines, and Gift Shops was developed in 2011, and the present study evaluated the inter-rater reliability of this instrument. Two trained raters visited 39 hospitals in southern California and completed the HNES. Percent agreement, kappa statistics, and intraclass correlation coefficients were calculated. Percent agreement between raters ranged from 74.4% to 100% and kappa statistics ranged from 0.458 to 1.0. The intraclass correlation coefficient for the overall nutrition composite scores was 0.961. Given these results, the HNES demonstrated acceptable reliability metrics and can now be disseminated to assess the current state of hospital consumer nutrition environments.

  3. Inter-Rater Agreement Measures and the Refinement of Metrics in the PLATO MT Evaluation Paradigm

    DTIC Science & Technology

    2005-07-01

    automated downstream processes are able to perform on MT output. 7 Acknowledgements We acknowledge and thank Lacey Sculley , who spent many long hours...Validation of MT Evaluation Metrics Across Languages. Proceedings of Language Resources and Evaluation Conference, Spain. White, John S. and K...Taylor. (1998). Task- Oriented Metric for MT Evaluation Proceedings of AMTA 1998, Langhorne, PA. White, John S., Jennifer B. Doyon, and Susan W. Talbott

  4. Reliability and Criterion Validity of a Novel Clinical Test of Simple and Complex Reaction Time in Athletes1

    PubMed Central

    Eckner, James T.; Richardson, James K.; Kim, Hogene; Joshi, Monica S.; Oh, Youkeun K.; Ashton-Miller, James A.

    2015-01-01

    Summary Slowed reaction time (RT) represents both a risk factor for and a consequence of sport concussion. The purpose of this study was to determine the reliability and criterion validity of a novel clinical test of simple and complex RT, called RTclin, in contact sport athletes. Both tasks were adapted from the well-known ruler drop test of RT and involve manually grasping a falling vertical shaft upon its release, with the complex task employing a go/no-go paradigm based on a slight cue. In 46 healthy contact sport athletes (24 males; M = 16.3 yr., SD = 5.0; 22 women: M age= 15.0 yr., SD = 4.0) whose sports included soccer, ice hockey, American football, martial arts, wrestling, and lacrosse, the latency and accuracy of simple and complex RTclin had acceptable test-retest and inter-rater reliabilities and correlated with a computerized criterion standard, the Axon Computerized Cognitive Assessment Tool. Medium to large effect sizes were found. The novel RTclin tests have acceptable reliability and criterion validity for clinical use and hold promise as concussion assessment tools. PMID:26106803

  5. Development of a New Valid, Reliable, and Internationally Applicable Assessment Tool of Residents’ Competence in Ophthalmic Surgery (An American Ophthalmological Society Thesis)

    PubMed Central

    Golnik, C.; Beaver, Hilary; Gauba, Vinod; Lee, Andrew G.; Mayorga, Eduardo; Palis, Gabriela; Saleh, George M.

    2013-01-01

    Purpose: To test the validity and reliability of a new tool for assessing residents’ competence in ophthalmic surgery. Changing paradigms of ophthalmic education in the United States have influenced worldwide ophthalmic education and necessitated new methods of assessing resident competence. Accordingly, a new tool for assessing residents’ competence in ophthalmic surgery (phacoemulsification) that could be applicable internationally was developed. We hypothesize that this instrument is valid and reliable. Methods: A panel of six international content experts adapted a previously published tool for assessing phacoemulsification. The tool (called the International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric, or ICO-OSCAR:phaco) was reviewed by 12 international content experts for their constructive comments, which were incorporated to ensure content validity. Ten expert cataract surgery teachers then graded six recorded phacoemulsification surgeries with the ICO-OSCAR:phaco to investigate inter-rater reliability. Results: The coefficient alpha statistic (a measure of reliability/internal consistency) for the ICO-OSCAR:phaco as a whole was 0.92, and 17 of its 20 dimensions had alpha coefficients greater than 0.70. Conclusions: The ICO-OSCAR:phaco is a valid and reliable assessment tool that could be applied internationally to satisfy the global need of new instruments to comply with emerging trends in ophthalmic education. A toolbox of similar surgical competency assessment tools is being developed. PMID:24072944

  6. Reliability and repeatability of quantitative tractography methods for mapping structural white matter connectivity in preterm and term infants at term-equivalent age.

    PubMed

    Kaur, Supreet; Powell, Samuel; He, Lili; Pierson, Christopher R; Parikh, Nehal A

    2014-01-01

    Premature infants exhibit widespread insults and delays in white matter maturation that can be sensitively detected early using diffusion tensor imaging. Diffusion tensor tractography facilitates in vivo visualization of white matter tracts and has the potential to be more sensitive than simpler two-dimensional DTI-based measures. However, the reliability and reproducibility of performing tractography for major white matter tracts in preterm infants is not known. The main objective of our study was to develop highly reliable and repeatable methods for ten white matter tracts in extremely low birth weight infants (birth weight ≤ 1000 g) at term-equivalent age. To demonstrate clinical utility, we also compared fiber microstructural and macrostructural parameters between preterm and healthy term controls. Twenty-nine ELBW infants and a control group of 15 healthy term newborns were studied. A team of researchers experienced in neuroanatomy/neuroimaging established the manual segmentation protocol based on a priori anatomical knowledge and an extensive training period to identify sources of variability. Intra- and inter-rater reliability and repeatability was tested using intra-class correlation coefficient, within-subject standard deviation (SD), repeatability, and Dice similarity index. Our results support our primary goal of developing highly reliable and reproducible comprehensive methods for manual segmentation of 10 white matter tracts in ELBW infants. The within-subject SD was within 1-2% and repeatability within 3-7% of the mean values for all 10 tracts. The intra-rater Dice index was excellent with a range of 0.97 to 0.99, and as expected, the inter-rater Dice index was lower (range: 0.80 to 0.91), but still within a very good reliability range. ELBW infants exhibited fewer fiber numbers and/or abnormal microstructure in a majority of the ten quantified tracts, consistent with injury/delayed development. This protocol could serve as a valuable tool for

  7. The validity, reliability and normative scores of the parent, teacher and self report versions of the Strengths and Difficulties Questionnaire in China

    PubMed Central

    Du, Yasong; Kou, Jianhua; Coghill, David

    2008-01-01

    Background The Strengths and Difficulties Questionnaire (SDQ) has become one of the most widely used measurement tools in child and adolescent mental health work across the globe. The SDQ was originally developed and validated within the UK and whilst its reliability and validity have been replicated in several countries important cross cultural issues have been raised. We describe normative data, reliability and validity of the Chinese translation of the SDQ (parent, teacher and self report versions) in a large group of children from Shanghai. Methods The SDQ was administered to the parents and teachers of students from 12 of Shanghai's 19 districts, aged between 3 and 17 years old, and to those young people aged between 11 and 17 years. Retest data was collected from parents and teachers for 45 students six weeks later. Data was analysed to describe normative scores, bandings and cut-offs for normal, borderline and abnormal scores. Reliability was assessed from analyses of internal consistency, inter-rater agreement, and temporal stability. Structural validity, convergent and discriminant validity were assessed. Results Full parent and teacher data was available for 1965 subjects and self report data for 690 subjects. Normative data for this Chinese urban population with bandings and cut-offs for borderline and abnormal scores are described. Principle components analysis indicates partial agreement with the original five factored subscale structure however this appears to hold more strongly for the Prosocial Behaviour, Hyperactivity – Inattention and Emotional Symptoms subscales than for Conduct Problems and Peer Problems. Internal consistency as measured by Cronbach's α coefficient were generally low ranging between 0.30 and 0.83 with only parent and teacher Hyperactivity – Inattention and teacher Prosocial Behaviour subscales having α > 0.7. Inter-rater correlations were similar to those reported previously (range 0.23 – 0.49) whilst test retest

  8. 5 CFR 919.900 - Adequate evidence.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... 5 Administrative Personnel 2 2010-01-01 2010-01-01 false Adequate evidence. 919.900 Section 919.900 Administrative Personnel OFFICE OF PERSONNEL MANAGEMENT (CONTINUED) CIVIL SERVICE REGULATIONS (CONTINUED) GOVERNMENTWIDE DEBARMENT AND SUSPENSION (NONPROCUREMENT) Definitions § 919.900 Adequate...

  9. Movement assessment battery for children-2: translation, reliability, and validity for Brazilian children.

    PubMed

    Valentini, N C; Ramalho, M H; Oliveira, M A

    2014-03-01

    The Movement Assessment Battery for Children 2nd edition (MABC-2) is a well-recognized assessment used to identify children with Developmental Coordination Disorder (DCD). Although researchers and practitioners across Brazil have used the MABC-2 to identify children with motor deficits, its validation for this particular population has yet to be investigated. In this study, we translated all MABC-2 items and validated them with respect to content, construct and criteria validity. The validation process involved 13 experts in Motor Development and a total of 844 children (3-13 years old) from two different states in Brazil. A cross-cultural translation method yielded a Brazilian-Portuguese version of the battery. The expert panel confirmed language clarity and pertinence of the items. High intra- and inter-rater reliability and internal consistency for the MABC-2 was established for Brazilian children. A discriminant analysis confirmed the MABC-2 power (.80) to differentiate children with DCD and those at risk for DCD from typically developing children. Predictive validity was observed for the impairment scores and a percentile main effect was found in the repeated measures ANOVA (ICC: .93 and .73, respectively). Although our data are not representative of the entire country, this study is the first to confirm that the original standardized scores established for the MABC-2 are valid in Brazilian children.

  10. Reliability and diagnostic validity for schizophrenia of the Japanese version of the Bonn Scale for Assessment of Basic Symptoms (BSABS).

    PubMed

    Oshima, Kazunari; Okimura, Tsukasa; Yukizane, Tomoaki; Yasumi, Katsuhiro; Iwawaki, Astushi; Nishikawa, Toru; Hanamura, Seiichi

    2010-03-01

    Schizophrenia is defined by operative diagnostic criteria in DSM-IV with some typical symptoms as hallucinations and duration of the disease. Huber focused on the subjective experience of patients and coined the term "basic symptoms" and created BSABS. Our study investigated the reliability and the diagnostic validity of the 5 clusters of BSABS for DSM-IV-based diagnosis of schizophrenia with a cohort of 105 patients. Good inter-rater reliability was obtained except for one item D.10. As evaluated by Spearman's rank correlation coefficients, among the 5 clusters excluding Cluster 2, internal consistency was good. This suggests that, although each cluster is heterogeneous, cluster symptoms are the expression of physiological and biological disturbances of schizophrenia. Receiver Operating Characteristic Curve analysis was also used to show the ability of each cluster to discriminate schizophrenia. Results showed that the area representing the powers in discriminate schizophrenia of Cluster 4 "Adynamia", which is considered related to the dynamic aspect of thinking, was highest, at 0.739. Cluster 1 "Information processing disturbances" which has a predictive ability for schizophrenia showed 0.714 and Cluster 3 "Impaired tolerance to normal stress" showed 0.711. Our findings suggest that, although these clusters symptoms differ from DSM-IV criteria, they are related to fundamental process of schizophrenia. Use of some of these three clusters with other neurophysiological markers could allow clinical evaluation of schizophrenia from a new perspective.

  11. A Systematic Review on methods of evaluate sentence production deficits in agrammatic aphasia patients: Validity and Reliability issues

    PubMed Central

    Mehri, Azar; Jalaie, Shohreh

    2014-01-01

    Background: The grammar assessment in aphasia has been done by few standard tests, but today these tests cannot precise evaluate the sentence production in agrammatic patients. In this study, we review structures and contents of tests or tasks designed to find more frequent methods for sentence production ability in aphasia patients. Materials and Methods: We searched the Cochrane library, Medline by PubMed, Science Direct, Scopus, and Google Scholar from 1980 to October 1, 2013 and evaluated all of exist tests or tasks included in the articles and systematic reviews. The sentence production has been studied in three methods. It contains the use of sentence production in spontaneous speech, tasks designed and both methods. The quality of studies was assessed using Critical Appraisal Skills Program. Results: The 160 articles were reviewed and 38 articles were studied according to inclusion and exclusion criteria. They were classified into three categories based on assessment methods of sentence production. In 39.5% studies, researchers have used tasks designed, 7.9% articles have applied spontaneous speech and 52.6% articles have used both methods for evaluation production. Inter-rater reliability was between 90% and 100% and intra-rater reliability was between 96% and 98% in studied. Conclusion: Agrammatic aphasia has syntax disorders, especially in sentence production. Most researchers and clinicians used both methods for evaluation production. PMID:25535505

  12. Assessing the reliability and validity of direct observation and traffic camera streams to measure helmet and motorcycle use.

    PubMed

    Zaccaro, Heather N; Carbone, Emily C; Dsouza, Nishita; Xu, Michelle R; Byrne, Mary C; Kraemer, John D

    2015-12-01

    There is a need to develop motorcycle helmet surveillance approaches that are less labour intensive than direct observation (DO), which is the commonly recommended but never formally validated approach, particularly in developing settings. This study sought to assess public traffic camera feeds as an alternative to DO, in addition to the reliability of DO under field conditions. DO had high inter-rater reliability, κ=0.88 and 0.84, respectively, for cycle type and helmet type, which reinforces its use as a gold standard. However, traffic camera-based data collection was found to be unreliable, with κ=0.46 and 0.53 for cycle type and helmet type. When bicycles, motorcycles and scooters were classified based on traffic camera streams, only 68.4% of classifications concurred with those made via DO. Given the current technology, helmet surveillance via traffic camera streams is infeasible, and there remains a need for innovative traffic safety surveillance approaches in low-income urban settings.

  13. Are inspectors’ assessments reliable? Ratings of NHS acute hospital trust services in England

    PubMed Central

    Addicott, Rachael; Robertson, Ruth; Ross, Shilpa; Walshe, Kieran

    2016-01-01

    The credibility of a regulator could be threatened if stakeholders perceive that assessments of performance made by its inspectors are unreliable. Yet there is little published research on the reliability of inspectors’ assessments of health care organizations’ services. Objectives We investigated the inter-rater reliability of assessments made by inspectors inspecting acute hospitals in England during the piloting of a new regulatory model implemented by the Care Quality Commission (CQC) during 2013 and 2014. Multi-professional teams of inspectors rated service provision on a four-point scale for each of five domains: safety; effectiveness; caring; responsiveness; and leadership. Methods In an online survey, we asked individual inspectors to assign a domain and a rating to each of 10 vignettes of service information extracted from CQC inspection reports. We used these data to simulate the ratings that might be produced by teams of inspectors. We also observed inspection teams in action, and interviewed inspectors and staff from hospitals that had been inspected. Results Levels of agreement varied substantially from vignette to vignette. Characteristics such as professional background explained only a very small part of the variation. Overall, agreement was higher on ratings than on domains, and for groups of inspectors compared with individual inspectors. A number of potential causes of disagreement were identified, such as differences regarding the weight that should be given to contextual factors and general uncertainty about interpreting the rating and domain categories. Conclusion Groups of inspectors produced more reliable assessments than individual inspectors, and there is evidence to support the utility of appropriate discussions between inspectors in improving reliability. The reliability of domain allocations was lower than for ratings. It is important to define categories and rating levels clearly, and to train inspectors in their use. Further

  14. Validity and reliability of a pressure ulcer monitoring tool for persons with spinal cord impairment

    PubMed Central

    Thomason, Susan S.; Luther, Stephen L.; Powell-Cope, Gail M.; Harrow, Jeffrey J.; Palacios, Polly

    2014-01-01

    Objective The purpose was to provide support for validity and reliability of the spinal cord impairment pressure ulcer monitoring tool (SCI-PUMT) to assess pressure ulcer (PrU) healing. Design Expert panels developed a 30-item pool, including new items and items from two established PrU healing tools, to represent potential variables for monitoring PrU healing. Subjects were prospectively assessed weekly for each variable over a 12-week period. Setting Data collection was conducted on a cohort of inpatients and outpatients in one Spinal Cord Injury/Disorders Center in the Veterans’ Health Administration. Subjects A convenience sample of Veterans (n = 66) with spinal cord impairment (SCI) was recruited. Eligible subjects had at least one PrU (n = 167) and a history of SCI for longer than 1 year. Interventions Not applicable. Outcome Measure A change in PrU volume was calculated using VeV Measurement Documentation software and a digital imaging camera. Results Content validity was established for a pool of items designed to gauge PrU healing. Exploratory factor analysis (construct validity) identified a parsimonious set of seven items for inclusion in the SCI-PUMT to assess PrU healing. The SCI-PUMT was found to explain 59% of the variance of the volume across the study. Inter-rater reliability was 0.79 and intra-rater reliability ranged from 0.81 to 0.99 among research assistants. Similar levels of reliability were subsequently established among registered nurses, who used the SCI-PUMT in the clinical setting. Conclusions The final version of the SCI-PUMT was determined to be valid, reliable, and sensitive in detecting PrU healing over time in Veterans with SCI. PMID:24621044

  15. The Turkish version of the pregnancy physical activity questionnaire: cross-cultural adaptation, reliability, and validity

    PubMed Central

    Tosun, Ozge Celiker; Solmaz, Ulas; Ekin, Atalay; Tosun, Gokhan; Mutlu, Ebru Kaya; Okyay, Emre; Adiyeke, Mehmet; Gezer, Cenk; Mat, Emre; Malkoc, Mehtap

    2015-01-01

    [Purpose] The aim of this study was to translate the Pregnancy Physical Activity Questionnaire, adapt it for use with Turkish subjects and determine its reliability and validity. [Subjects and Methods] The Pregnancy Physical Activity Questionnaire was translated into Turkish and administered twice at 7–14-day intervals to pregnant women to assess the test-retest reliability. Cronbach’s α was used for internal consistency, and the inter-rater correlation coefficient was used to calculate the test-retest reliability. The Turkish Short Form 36 Health Survey (SF-36) and the International Physical Activity Questionnaire were used to estimate validity. [Results] The internal consistency during the first and third trimesters of pregnancy was excellent, with Cronbach’s α values of 0.93 and 0.95, respectively. The mean interval between the two assessments was 11.1 ± 2.1 days. The correlation coefficient between the total activity measured by the Turkish version of the Pregnancy Physical Activity Questionnaire and the International Physical Activity Questionnaire estimates of the total metabolic equivalent were fair to poor during the first, second, and third trimesters of pregnancy (r = 0.17, r = 0.17, r = 0.21, respectively). The Turkish version of the Pregnancy Physical Activity Questionnaire showed fair correlations with the Short Form 36 Health Survey physical component score (r = −0.30) and mental component score (r = −0.37) for the first trimester of pregnancy. [Conclusion] The Turkish version of the Pregnancy Physical Activity Questionnaire was found to be reliable and valid for assessing a pregnant woman’s physical activity. PMID:26644678

  16. Manual Ability Classification System (MACS): reliability between therapists and parents in Brazil

    PubMed Central

    Silva, Daniela B. R.; Funayama, Carolina A. R.; Pfeifer, Luzia I.

    2015-01-01

    BACKGROUND: The Manual Ability Classification System (MACS) has been widely used to describe the manual ability of children with cerebral palsy (CP); however its reliability has not been verified in Brazil. OBJECTIVE: To establish the inter- and intra-rater reliability of the Portuguese-Brazil version of the MACS by comparing the classifications given by therapists and parents of children with CP. METHOD: Data were obtained from 90 children with CP between the ages of 4 and 18 years, who were treated at the neurology and rehabilitation clinics of a Brazilian hospital. Therapists (an occupational therapist and a student) classified manual ability (MACS) through direct observation and information provided by parents. Therapists and parents used the Portuguese-Brazil version of the MACS. Intra- and inter-rater reliability was obtained using unweighted Kappa coefficient (k) and intra-class correlation coefficient (ICC). The Chi-square test was used to identify the predominance of disagreements in the classification of parents and therapists. RESULTS: An almost perfect agreement resulted among therapists [K=0.90 (95% CI 0.83-0.97); ICC=0.97 (95%CI 0.96-0.98)], as well as with intra-rater (therapists), with Kappa ranging between 0.83 and 0.95 and ICC between 0.96 and 0.99 for the evaluator with more and less experience in rehabilitation, respectively. The agreement between therapists and parents was fair [K=0.36 (95% CI 0.22-0.50); ICC=0.79 (95% CI 0.70-0.86)]. CONCLUSIONS: The Portuguese version of the MACS is a reliable instrument to be used jointly by parents and therapists. PMID:25651133

  17. Validity and reliability of “Persian Weaning Tool” in mechanically ventilated patients

    PubMed Central

    Bazrafshan, Fatemeh; Irajpour, Alireza; Abbasi, Saeed; Mahaki, Behzad

    2016-01-01

    Background: “Persian Weaning Tool” (PWT) is the only specific, national protocol designed to assess patients’ readiness for weaning from mechanical ventilation in Iran. This study was developed to determine the validity and reliability of this protocol. Materials and Methods: This is a psychometric study conducted on 31 patients connected to mechanical ventilation were ready from weaning according to anesthesiologist's diagnosis and was selected through convenient sampling. The patients selected from Intensive Care Units (ICUs) of Al-Zahra Hospital in Isfahan. The sheet data collection includes demographic data, PWT; Burn's Wean Assessment Program (BWAP), and Morganroth's scale. To determine the inter-rater reliability between researcher and his partner, Pearson correlation and paired t-test were used. To assess the criterion validity of the PWT in relation to Burn's and Morganroth's weaning scales (as criteria), Pearson correlation and McNemar tests were used. To specify a minimum acceptable score of the PWT for weaning from mechanical ventilation, receiver operating characteristic curve was used. Results: The results showed that there was statistically significant correlation between score of PWT and BWAP (r = 0.370 with P < 0.05) and there were no statistically significant differences between these tools in terms of identification of patients’ readiness for weaning (P = 0.453). There was statistically significant correlation between PWT score obtained by researcher and his colleague (r = 0.928), and the reliability of this tool was approved. The PWTs cut of point was calculated as 57 (sensitivity = 0.679, specificity = 1). Conclusions: The reliability and validity of the PWT were confirmed for this study's sample size. Consequently, the findings of this study can be used to measure the PWTs effectiveness and applicability in ICUs. PMID:27761432

  18. Examining the quality of the 'Healthy Eating and Physical Activity in Schools' (HEPS) quality checklist: German results on usability and reliability.

    PubMed

    Dadaczynski, Kevin; Boye, Jutta

    2015-12-01

    The aim of the present study was to examine the usability and reliability of the HEPS quality checklist (Healthy Eating and Physical Activity in Schools), an instrument developed to assess the quality of school-based programmes on healthy eating and physical activity. With regard to usability, health promotion experts (n = 15) were asked to apply the HEPS quality checklist and to fill out a questionnaire about its comprehensibility and usability. To examine inter-rater reliability (IRR) a criteria-based selection of German school programmes on healthy eating and physical activity (n = 14) was randomly allocated to two programme pools and assessed independently by the authors. Results of the pilot testing revealed a high overall satisfaction with the HEPS quality checklist and a high willingness to use it or to recommend it to others. Furthermore, the checklist was perceived to be comprehensive and clearly structured. The assessment results of programme pool 1 revealed unsatisfactory Cohen's Kappa coefficients (IRR) and moderate intra-class correlations (ICC). After the HEPS manual guide had been amended with regard to its anchoring, the results of programme pool 2 showed substantial improvements with regard to IRR and ICC. In summary, the adapted HEPS quality checklist is a usable and reliable instrument for the quality assessment of school-based programmes on healthy eating and physical activity. The findings suggest that the HEPS checklist should be applied by two sufficiently trained raters.

  19. Development and testing of mobile technology for community park improvements: validity and reliability of the eCPAT application with youth.

    PubMed

    Besenyi, Gina M; Diehl, Paul; Schooley, Benjamin; Turner-McGrievy, Brie M; Wilcox, Sara; Stanis, Sonja A Wilhelm; Kaczynski, Andrew T

    2016-12-01

    Creation of mobile technology environmental audit tools can provide a more interactive way for youth to engage with communities and facilitate participation in health promotion efforts. This study describes the development and validity and reliability testing of an electronic version of the Community Park Audit Tool (eCPAT). eCPAT consists of 149 items and incorporates a variety of technology benefits. Criterion-related validity and inter-rater reliability were evaluated using data from 52 youth across 47 parks in Greenville County, SC. A large portion of items (>70 %) demonstrated either fair or moderate to perfect validity and reliability. All but six items demonstrated excellent percent agreement. The eCPAT app is a user-friendly tool that provides a comprehensive assessment of park environments. Given the proliferation of smartphones, tablets, and other electronic devices among both adolescents and adults, the eCPAT app has potential to be distributed and used widely for a variety of health promotion purposes.

  20. Asbestos/NESHAP adequately wet guidance

    SciTech Connect

    Shafer, R.; Throwe, S.; Salgado, O.; Garlow, C.; Hoerath, E.

    1990-12-01

    The Asbestos NESHAP requires facility owners and/or operators involved in demolition and renovation activities to control emissions of particulate asbestos to the outside air because no safe concentration of airborne asbestos has ever been established. The primary method used to control asbestos emissions is to adequately wet the Asbestos Containing Material (ACM) with a wetting agent prior to, during and after demolition/renovation activities. The purpose of the document is to provide guidance to asbestos inspectors and the regulated community on how to determine if friable ACM is adequately wet as required by the Asbestos NESHAP.

  1. Funding the Formula Adequately in Oklahoma

    ERIC Educational Resources Information Center

    Hancock, Kenneth

    2015-01-01

    This report is a longevity, simulational study that looks at how the ratio of state support to local support effects the number of school districts that breaks the common school's funding formula which in turns effects the equity of distribution to the common schools. After nearly two decades of adequately supporting the funding formula, Oklahoma…

  2. The 6-min mastication test: a unique test to assess endurance of continuous chewing, normal values, reliability, reproducibility and usability in patients with mitochondrial disease.

    PubMed

    van den Engel-Hoek, L; Knuijt, S; van Gerven, M H J C; Lagarde, M L J; Groothuis, J T; de Groot, I J M; Janssen, M C H

    2017-03-01

    In patients with mitochondrial disease, fatigue and muscle problems are the most common complaints. They also experience these complaints during mastication. To measure endurance of continuous mastication in patients with mitochondrial diseases, the 6-min mastication test (6MMT) was developed. This study included the collection of normal data for the 6MMT in a healthy population (children and adults). During 6 min of continuous mastication on a chew tube chewing cycles per minute, total amount of chewing cycles and the difference between minute 1 (M1 ) and minute 6 (M2 ) were collected in 271 healthy participants (5-80 years old). These results were compared with those of nine paediatric and 25 adult patients with a mitochondrial disease. Visual analogue scale (VAS) scores were collected directly after the test and after 5 min. A qualitative rating was made on masticatory movements. The reproducibility of the 6MMT in the healthy population with an interval of approximately 2 weeks was good. The inter-rater reliability for the observations was excellent. The patient group demonstrated lower total amount of chewing cycles or had greater differences between M1 and M6 . The 6MMT is a reliable and objective test to assess endurance of continuous chewing. It demonstrates the ability of healthy children and adults to chew during 6 min with a highly stable frequency of mastication movements. The test may give an explanation for the masticatory problems in patient groups, who are complaining of pain and fatigue during mastication.

  3. Reliability and Validity of the Clinical Dementia Rating for Community-Living Elderly Subjects without an Informant

    PubMed Central

    Nyunt, Ma Shwe Zin; Chong, Mei Sian; Lim, Wee Shiong; Lee, Tih Shih; Yap, Philip; Ng, Tze Pin

    2013-01-01

    Background The Clinical Dementia Rating (CDR) scale is widely used to assess cognitive impairment in Alzheimer's disease. It requires collateral information from a reliable informant who is not available in many instances. We adapted the original CDR scale for use with elderly subjects without an informant (CDR-NI) and evaluated its reliability and validity for assessing mild cognitive impairment (MCI) and dementia among community-dwelling elderly subjects. Method At two consecutive visits 1 week apart, nurses trained in CDR assessment interviewed, observed and rated cognitive and functional performance according to a protocol in 90 elderly subjects with suboptimal cognitive performance [Mini-Mental State Examination (MMSE) <26 and/or Montreal Cognitive Assessment (MOCA) <26] and without informants according to a protocol. CDR domains and global scores were assigned after the second visit based upon corroborative information from the subjects' responses to questions, role-play, and observed performance in specifically assigned tasks at home and within the community. Results The CDR-NI scores (0, 0.5, 1) showed good internal consistency (Crohnbach's α 0.83-0.84), inter-rater reliability (κ 0.77-1.00 for six domains and 0.95 for global rating) and test-retest reliability (κ 0.75-1.00 for six domains and 0.80 for global rating), good agreement (κ 0.79) with the clinical assessment status of MCI (n = 37) and dementia (n = 4) and significant differences in the mean scores for MMSE, MOCA and Instrumental Activities of Daily Living (ANOVA global p < 0.001). Conclusion Owing to the protocol of the interviews, assessments and structured observations gathered during the two visits, CDR-NI provides valid and reliable assessment of MCI and dementia in community-living elderly subjects without an informant. PMID:24348502

  4. Psychometric evaluation of a short observational tool for small-scale research projects in dementia.

    PubMed

    Smallwood, J; Irvine, E; Coulter, F; Connery, H

    2001-03-01

    Dementia is a degenerating illness and the lack of a reliable measure of self-report in particular presents particular difficulties for research. Often in the later stages of dementia behavioural measurement is the only tool available for the evaluation of treatment techniques. This paper describes and evaluates a short observational tool suitable for clinical assessment purposes. The scale has been shown to have the potential for adequate inter-rater reliability, test retest reliability, and convergent and divergent validity, if the study limitations reflecting statistical rather than ecological validity, and limitations of sample size are borne in mind.

  5. Measurement of craniovertebral angle by the Modified Head Posture Spinal Curvature Instrument: A reliability and validity study.

    PubMed

    Subbarayalu, Arun Vijay

    2016-01-01

    The Modified Head Posture Spinal Curvature Instrument (MHPSCI) is an extension of the Head Posture Spinal Curvature Instrument. Two specific modifications were made in the original design by adding a third arm projecting horizontally from the protractor to objectively fix the pivot exactly over the C7 vertebra and the addition of a spirit-level to properly align the instrument. In order to demonstrate reliability and validity, this study was conducted using patients with postural neck pain (N = 65) and healthy subjects (N = 20). All the subjects were working at a selected Information Technology Industry in India and had been recruited using a criterion-based sampling approach. The craniovertebral (CV) angle of each subject was evaluated by two raters consecutively. The measurements were taken by using both MHPSCI and the standard photographic method in a standardized sitting posture for the purpose of establishing criterion-validity of the instrument. The results of this study indicate a good inter-rater reliability (ICC = 0.76; CI = 0.65-0.84) as well as intra-rater reliability (ICC = 0.87; CI = 0.82-0.91) between three successive CV angle measurements (with 2 minutes interval between each measurement) through MHPSCI. While keeping the digital photographic measurement as a standard, this study established that the MHPSCI is a valid tool for measuring the CV angle as shown by non-significant difference (p > 0.01) and high correlation between the two methods (r = 0.79-0.84). This study demonstrates that the MHPSCI is a reliable and valid instrument for measuring CV angle in subjects with or without postural neck pain.

  6. Using Multitheory Model of Health Behavior Change to Predict Adequate Sleep Behavior.

    PubMed

    Knowlden, Adam P; Sharma, Manoj; Nahar, Vinayak K

    The purpose of this article was to use the multitheory model of health behavior change in predicting adequate sleep behavior in college students. A valid and reliable survey was administered in a cross-sectional design (n = 151). For initiation of adequate sleep behavior, the construct of behavioral confidence (P < .001) was found to be significant and accounted for 24.4% of the variance. For sustenance of adequate sleep behavior, changes in social environment (P < .02), emotional transformation (P < .001), and practice for change (P < .001) were significant and accounted for 34.2% of the variance.

  7. Serum thyroglobulin reference intervals in regions with adequate and more than adequate iodine intake.

    PubMed

    Wang, Zhaojun; Zhang, Hanyi; Zhang, Xiaowen; Sun, Jie; Han, Cheng; Li, Chenyan; Li, Yongze; Teng, Xiaochun; Fan, Chenling; Liu, Aihua; Shan, Zhongyan; Liu, Chao; Weng, Jianping; Teng, Weiping

    2016-11-01

    The purpose of this study was to establish normal thyroglobulin (Tg) reference intervals (RIs) in regions with adequate and more than adequate iodine intake according to the National Academy of Clinical Biochemistry (NACB) guidelines and to investigate the relationships between Tg and other factors.A total of 1317 thyroid disease-free adult subjects (578 men, 739 nonpregnant women) from 2 cities (Guangzhou and Nanjing) were enrolled in this retrospective, observational study. Each subject completed a questionnaire and underwent physical and ultrasonic examination. Serum Tg, thyroid-stimulating hormone (TSH), thyroid peroxidase antibody (TPOAb), Tg antibody (TgAb), and urinary iodine concentration (UIC) were measured. Reference groups were established on the basis of TSH levels: 0.5 to 2.0 and 0.27 to 4.2 mIU/L.The Tg RIs for Guangzhou and Nanjing were 1.6 to 30.0 and 1.9 to 25.8 ng/mL, respectively. No significant differences in Tg were found between genders or among different reference groups. Stepwise linear regression analyses showed that TgAb, thyroid volume, goiter, gender, age, and TSH levels were correlated with Tg.In adults from regions with adequate and more than adequate iodine intake, we found that Tg may be a suitable marker of iodine status; gender-specific Tg RI was unnecessary; there was no difference between Tg RIs in regions with adequate and more than adequate iodine intake; and the TSH criterion for selecting the Tg reference population could follow the local TSH reference rather than 0.5 to 2.0 mIU/L.

  8. Serum thyroglobulin reference intervals in regions with adequate and more than adequate iodine intake

    PubMed Central

    Wang, Zhaojun; Zhang, Hanyi; Zhang, Xiaowen; Sun, Jie; Han, Cheng; Li, Chenyan; Li, Yongze; Teng, Xiaochun; Fan, Chenling; Liu, Aihua; Shan, Zhongyan; Liu, Chao; Weng, Jianping; Teng, Weiping

    2016-01-01

    Abstract The purpose of this study was to establish normal thyroglobulin (Tg) reference intervals (RIs) in regions with adequate and more than adequate iodine intake according to the National Academy of Clinical Biochemistry (NACB) guidelines and to investigate the relationships between Tg and other factors. A total of 1317 thyroid disease-free adult subjects (578 men, 739 nonpregnant women) from 2 cities (Guangzhou and Nanjing) were enrolled in this retrospective, observational study. Each subject completed a questionnaire and underwent physical and ultrasonic examination. Serum Tg, thyroid-stimulating hormone (TSH), thyroid peroxidase antibody (TPOAb), Tg antibody (TgAb), and urinary iodine concentration (UIC) were measured. Reference groups were established on the basis of TSH levels: 0.5 to 2.0 and 0.27 to 4.2 mIU/L. The Tg RIs for Guangzhou and Nanjing were 1.6 to 30.0 and 1.9 to 25.8 ng/mL, respectively. No significant differences in Tg were found between genders or among different reference groups. Stepwise linear regression analyses showed that TgAb, thyroid volume, goiter, gender, age, and TSH levels were correlated with Tg. In adults from regions with adequate and more than adequate iodine intake, we found that Tg may be a suitable marker of iodine status; gender-specific Tg RI was unnecessary; there was no difference between Tg RIs in regions with adequate and more than adequate iodine intake; and the TSH criterion for selecting the Tg reference population could follow the local TSH reference rather than 0.5 to 2.0 mIU/L. PMID:27902589

  9. Site-specific landslide assessment in Alpine area using a reliable integrated monitoring system

    NASA Astrophysics Data System (ADS)

    Romeo, Saverio; Di Matteo, Lucio; Kieffer, Daniel Scott

    2016-04-01

    temperature values recorded in the valley and on the slope show a good relationship indicating that the climatic monitoring is reliable. In addition, the landslide displacement monitoring is reliable as well: the comparison between displacements in depth by extensometers and in surface by GBInSAR - referred to March-December 2013 - shows ad high reliability as confirmed by the inter-rater reliability analysis (Pearson correlation coefficient higher than 0.9). In conclusion, the reliability of the monitoring system confirms that data can be useful to improve the knowledge on rockfall kinematic and to develop an accurate early warning system useful for civil protection issues.

  10. Adequate mathematical modelling of environmental processes

    NASA Astrophysics Data System (ADS)

    Chashechkin, Yu. D.

    2012-04-01

    In environmental observations and laboratory visualization both large scale flow components like currents, jets, vortices, waves and a fine structure are registered (different examples are given). The conventional mathematical modeling both analytical and numerical is directed mostly on description of energetically important flow components. The role of a fine structures is still remains obscured. A variety of existing models makes it difficult to choose the most adequate and to estimate mutual assessment of their degree of correspondence. The goal of the talk is to give scrutiny analysis of kinematics and dynamics of flows. A difference between the concept of "motion" as transformation of vector space into itself with a distance conservation and the concept of "flow" as displacement and rotation of deformable "fluid particles" is underlined. Basic physical quantities of the flow that are density, momentum, energy (entropy) and admixture concentration are selected as physical parameters defined by the fundamental set which includes differential D'Alembert, Navier-Stokes, Fourier's and/or Fick's equations and closing equation of state. All of them are observable and independent. Calculations of continuous Lie groups shown that only the fundamental set is characterized by the ten-parametric Galilelian groups reflecting based principles of mechanics. Presented analysis demonstrates that conventionally used approximations dramatically change the symmetries of the governing equations sets which leads to their incompatibility or even degeneration. The fundamental set is analyzed taking into account condition of compatibility. A high order of the set indicated on complex structure of complete solutions corresponding to physical structure of real flows. Analytical solutions of a number problems including flows induced by diffusion on topography, generation of the periodic internal waves a compact sources in week-dissipative media as well as numerical solutions of the same

  11. Validity and reliability of a simple, low cost measure to quantify children’s dietary intake in afterschool settings

    PubMed Central

    Davison, Kirsten K.; Austin, S. Bryn; Giles, Catherine; Cradock, Angie L.; Lee, Rebekka M.; Gortmaker, Steven L.

    2017-01-01

    Interest in evaluating and improving children’s diets in afterschool settings has grown, necessitating the development of feasible yet valid measures for capturing children’s intake in such settings. This study’s purpose was to test the criterion validity and cost of three unobtrusive visual estimation methods compared to a plate-weighing method: direct on-site observation using a 4-category rating scale and off-site rating of digital photographs taken on-site using 4- and 10-category scales. Participants were 111 children in grades 1–6 attending four afterschool programs in Boston, MA in December 2011. Researchers observed and photographed 174 total snack meals consumed across two days at each program. Visual estimates of consumption were compared to weighed estimates (the criterion measure) using intra-class correlations. All three methods were highly correlated with the criterion measure, ranging from 0.92–0.94 for total calories consumed, 0.86–0.94 for consumption of pre-packaged beverages, 0.90–0.93 for consumption of fruits/vegetables, and 0.92–0.96 for consumption of grains. For water, which was not pre-portioned, coefficients ranged from 0.47–0.52. The photographic methods also demonstrated excellent inter-rater reliability: 0.84–0.92 for the 4-point and 0.92–0.95 for the 10-point scale. The costs of the methods for estimating intake ranged from $0.62 per observation for the on-site direct visual method to $0.95 per observation for the criterion measure. This study demonstrates that feasible, inexpensive methods can validly and reliably measure children’s dietary intake in afterschool settings. Improving precision in measures of children’s dietary intake can reduce the likelihood of spurious or null findings in future studies. PMID:25596895

  12. Reliability and validity of the delta finger-to-palm (FTP), a new measure of finger range of motion in systemic sclerosis

    PubMed Central

    Torok, Kathryn S.; Baker, Nancy A.; Lucas, Mary; Domsic, Robyn T.; Boudreau, Robert; Medsger, Thomas A.

    2010-01-01

    Objectives To determine the reliability and validity of a new measure of finger motion in patients with systemic sclerosis (SSc), the ‘delta finger-to-palm’ (delta FTP) and compare its psychometric properties to the traditional measure of finger motion, the finger-to-palm (FTP). Methods Phase 1: The reliability of the delta FTP and FTP were examined in 39 patients with SSc. Phase 2: Criterion and convergent construct validity of both measures were examined in 17 patients with SSc by comparing them to other clinical measures: Total Active Range of Motion (TAROM), Hand Mobility in Scleroderma (HAMIS), the Duruoz Hand Index (DHI), Health Assessment Questionnaire (HAQ), and modified Rodnan skin score (mRSS). Phase 3: Sensitivity to change of the delta FTP was investigated in 24 patients with early diffuse cutaneous SSc. Results Both measures had excellent intra-rater and inter-rater reliability (ICC 0.92 to 0.99). Fair to strong correlations (rs=0.49–0.94) were observed between the delta FTP and TAROM, HAMIS, and DHI. Fair to moderate correlations were observed between delta FTP and HAQ components related to hand function and upper extremity mRSS. Correlations of the traditional FTP with these measures were fair to strong, but most often the delta FTP outperformed the FTP. The effect size and standardised response mean for the mean delta FTP were 0.50 and 1.10 respectively, over a 2–8 month period. Conclusion The delta FTP is a valid and reliable measure of finger motion in patients with SSc which outperforms the FTP. PMID:20576211

  13. Reliable Detection of Respiratory Syncytial Virus Infection in Children for Adequate Hospital Infection Control Management

    PubMed Central

    Abels, Susanne; Nadal, David; Stroehle, Angelika; Bossart, Walter

    2001-01-01

    By using a rapid test for respiratory syncytial virus (RSV) detection (Abbott TestPack RSV), a number of patients were observed, showing repeatedly positive results over a period of up to 10 weeks. A prospective study was initiated to compare the rapid test with an antigen capture enzyme immunoassay (EIA) and a nested reverse transcriptase PCR (RT-PCR) protocol for detection of RSV serotypes A and B. Only respiratory samples from children exhibiting the prolonged presence of RSV (≥5 days) as determined by the rapid test were considered. A total of 134 specimens from 24 children was investigated by antigen capture EIA and nested RT-PCR. Using RT-PCR as the reference method, we determined the RSV rapid test to have a specificity of 63% and a sensitivity of 66% and the antigen capture EIA to have a specificity of 96% and a sensitivity of 69% for acute-phase samples and the homologous virus serotype A. In 7 (29%) of 24 patients, the positive results of the RSV rapid test could not be confirmed by either nested RT-PCR or antigen capture EIA. In these seven patients a variety of other respiratory viruses were detected. For general screening the RSV rapid test was found to be a reasonable tool to get quick results. However, its lack of specificity in some patients requires confirmation by additional tests to rule out false-positive results and/or detection of other respiratory viruses. PMID:11526141

  14. Reliability of the Brazilian Portuguese version of the fatigue severity scale and its correlation with pulmonary function, dyspnea, and functional capacity in patients with COPD*

    PubMed Central

    Valderramas, Silvia; Camelier, Aquiles Assunção; da Silva, Sinara Alves; Mallmann, Renata; de Paulo, Hanna Karine; Rosa, Fernanda Warken

    2013-01-01

    OBJECTIVE: To describe the intra-rater and inter-rater reliability of the Brazilian Portuguese version of the fatigue severity scale (FSS) in patients with COPD and to identify the presence of its association with parameters of pulmonary function, dyspnea, and functional capacity. METHODS: This was an observational cross-sectional study involving 50 patients with COPD, who completed the FSS in interviews with two researchers in two visits. The FSS scores were correlated with those of the Medical Research Council (MRC) scale, as well as with FEV1, FVC, and six-minute walk distance (6MWD). RESULTS: The mean age of the patients was 69.4 ± 8.23 years, whereas the mean FEV1 was 46.5 ± 20.4% of the predicted value. The scale was reliable, with an intraclass correlation coefficient of 0.90 (95% CI, 0.81-0.94; p < 0.01). The FSS scores showed significant correlations with those of MRC scale (r = 0.70; p < 0.01), as well as with 6MWD (r = –0.77; p < 0.01), FEV1 (r = –0.38; p < 0.01), FVC (r = –0.35; p < 0.01), and stage of the disease in accordance with the Global Initiative for Chronic Obstructive Lung Disease criteria (r = 0.37; p < 0.01). CONCLUSIONS: The Brazilian Portuguese version of the FSS proved reliable for use in COPD patients in Brazil and showed significant correlations with sensation of dyspnea, functional capacity, pulmonary function, and stage of the disease. PMID:24068263

  15. Global and regional kinematics of the cervical spine during upper cervical spine manipulation: a reliability analysis of 3D motion data.

    PubMed

    Dugailly, Pierre-Michel; Beyer, Benoît; Sobczak, Stéphane; Salvia, Patrick; Feipel, Véronique

    2014-10-01

    Studies reporting spine kinematics during cervical manipulation are usually related to continuous global head-trunk motion or discrete angular displacements for pre-positioning. To date, segmental data analyzing continuous kinematics of cervical manipulation is lacking. The objective of this study was to investigate upper cervical spine (UCS) manipulation in vitro. This paper reports an inter- and intra-rater reliability analysis of kinematics during high velocity low amplitude manipulation of the UCS. Integration of kinematics into specific-subject 3D models has been processed as well for providing anatomical motion representation during thrust manipulation. Three unembalmed specimens were included in the study. Restricted dissection was realized to attach technical clusters to each bone of interest (skull, C1-C4 and sternum). During manipulation, bone motion data was computed using an optoelectronic system. The reliability of manipulation kinematics was assessed for three experimented practitioners performing two trials of 3 repetitions on two separate days. During UCS manipulation, average global head-trunk motion ROM (±SD) were 14 ± 5°, 35 ± 7° and 14 ± 8° for lateral bending, axial rotation and flexion-extension, respectively. For regional ROM (C0-C2), amplitudes were 10 ± 5°, 30 ± 5° and 16 ± 4° for the same respective motions. Concerning the reliability, mean RMS ranged from 1° to 4° and from 3° to 6° for intra- and inter-rater comparisons, respectively. The present results confirm the limited angular displacement during manipulation either for global head-trunk or for UCS motion components, especially for axial rotation. Additionally, kinematics variability was low confirming intra- and inter-practitioners consistency of UCS manipulation achievement.

  16. Workplace-based assessment of communication skills: A pilot project addressing feasibility, acceptance and reliability.

    PubMed

    Weyers, Simone; Jemi, Iman; Karger, André; Raski, Bianca; Rotthoff, Thomas; Pentzek, Michael; Mortsiefer, Achim

    2016-01-01

    Background: Imparting communication skills has been given great importance in medical curricula. In addition to standardized assessments, students should communicate with real patients in actual clinical situations during workplace-based assessments and receive structured feedback on their performance. The aim of this project was to pilot a formative testing method for workplace-based assessment. Our investigation centered in particular on whether or not physicians view the method as feasible and how high acceptance is among students. In addition, we assessed the reliability of the method. Method: As part of the project, 16 students held two consultations each with chronically ill patients at the medical practice where they were completing GP training. These consultations were video-recorded. The trained mentoring physician rated the student's performance and provided feedback immediately following the consultations using the Berlin Global Rating scale (BGR). Two impartial, trained raters also evaluated the videos using BGR. For qualitative and quantitative analysis, information on how physicians and students viewed feasibility and their levels of acceptance was collected in written form in a partially standardized manner. To test for reliability, the test-retest reliability was calculated for both of the overall evaluations given by each rater. The inter-rater reliability was determined for the three evaluations of each individual consultation. Results: The formative assessment method was rated positively by both physicians and students. It is relatively easy to integrate into daily routines. Its significant value lies in the personal, structured and recurring feedback. The two overall scores for each patient consultation given by the two impartial raters correlate moderately. The degree of uniformity among the three raters in respect to the individual consultations is low. Discussion: Within the scope of this pilot project, only a small sample of physicians and

  17. Workplace-based assessment of communication skills: A pilot project addressing feasibility, acceptance and reliability

    PubMed Central

    Weyers, Simone; Jemi, Iman; Karger, André; Raski, Bianca; Rotthoff, Thomas; Pentzek, Michael; Mortsiefer, Achim

    2016-01-01

    Background: Imparting communication skills has been given great importance in medical curricula. In addition to standardized assessments, students should communicate with real patients in actual clinical situations during workplace-based assessments and receive structured feedback on their performance. The aim of this project was to pilot a formative testing method for workplace-based assessment. Our investigation centered in particular on whether or not physicians view the method as feasible and how high acceptance is among students. In addition, we assessed the reliability of the method. Method: As part of the project, 16 students held two consultations each with chronically ill patients at the medical practice where they were completing GP training. These consultations were video-recorded. The trained mentoring physician rated the student’s performance and provided feedback immediately following the consultations using the Berlin Global Rating scale (BGR). Two impartial, trained raters also evaluated the videos using BGR. For qualitative and quantitative analysis, information on how physicians and students viewed feasibility and their levels of acceptance was collected in written form in a partially standardized manner. To test for reliability, the test-retest reliability was calculated for both of the overall evaluations given by each rater. The inter-rater reliability was determined for the three evaluations of each individual consultation. Results: The formative assessment method was rated positively by both physicians and students. It is relatively easy to integrate into daily routines. Its significant value lies in the personal, structured and recurring feedback. The two overall scores for each patient consultation given by the two impartial raters correlate moderately. The degree of uniformity among the three raters in respect to the individual consultations is low. Discussion: Within the scope of this pilot project, only a small sample of physicians and

  18. Reliability training

    NASA Technical Reports Server (NTRS)

    Lalli, Vincent R. (Editor); Malec, Henry A. (Editor); Dillard, Richard B.; Wong, Kam L.; Barber, Frank J.; Barina, Frank J.

    1992-01-01

    Discussed here is failure physics, the study of how products, hardware, software, and systems fail and what can be done about it. The intent is to impart useful information, to extend the limits of production capability, and to assist in achieving low cost reliable products. A review of reliability for the years 1940 to 2000 is given. Next, a review of mathematics is given as well as a description of what elements contribute to product failures. Basic reliability theory and the disciplines that allow us to control and eliminate failures are elucidated.

  19. Trials and tribulations of conducting medication trials: pediatric bipolar disorder as prototype

    PubMed Central

    Pavuluri, Mani

    2015-01-01

    “In reality, it is the interpretation of symptomatology that leads to accurate diagnosis, rather than the short-term training and inter-rater reliability attained by conducting semi-structured research diagnostic interviews.” PMID:25642317

  20. Reliability and validity of the DSM-IV-TR and proposed DSM-5 criteria for pedophilia: Implications for the ICD-11 and the next DSM.

    PubMed

    Seto, Michael C; Fedoroff, J Paul; Bradford, John M; Knack, Natasha; Rodrigues, Nicole C; Curry, Susan; Booth, Brad; Gray, Jonathan; Cameron, Colin; Bourget, Dominique; Messina, Sarina; James, Elizabeth; Watson, Diane; Gulati, Sanjiv; Balmaceda, Rufino; Ahmed, Adekunle G

    We tested the inter-rater reliability and criterion-related validity of the DSM-IV-TR pedophilia diagnosis and proposed DSM-5 pedohebephilia diagnosis in a sample of 79 men who had committed child pornography offenses, contact sexual offenses against children, or who were referred because of concerns about whether they had a sexual interest in children. Participants were evaluated by two independent psychiatrists with an interview and questionnaire regarding demographic characteristics, sexual history, and self-reported sexual interests; they also completed phallometric and visual reaction time testing. Kappa was .59 for ever meeting DSM-IV-TR criteria for pedophilia and .52 for ever meeting the proposed DSM-5 criteria for pedohebephilia. Ever meeting DSM-IV-TR diagnosis was significantly related to self-reported index of sexual interest in children (highest AUC=.81, 95% CI=.70-.91, p<.001) and to indices of sexual interest in children from phallometric testing (AUC=.70; 95% CI=.52-.89; p<.05) or a computerized assessment based on visual reaction time and self-report (AUC=.75; 95% CI=.62-.88; p<.005). Ever meeting the proposed DSM-5 "diagnosis" was similarly related to self-report (AUC=.84, 95% CI=.74-.94, p<.001) and to the two objective indices, with AUCs of .69 (95% CI=.53-.85; p<.05) and .77 (95% CI=.64-.89; p<.001), respectively. Because the pDSM-5 criteria did not produce significantly better reliability or validity results and users are more familiar with the current DSM-5 criteria, we believe these results suggest the revision of DSM-5 and development of ICD-11 could benefit from drawing on the current DSM-5 criteria, which are essentially the same as DSM-IV-TR except for a distinction between having a paraphilia (the interest) and a paraphilic disorder (the paraphilia plus clinically significant distress or impairment).

  1. Person Reliability

    ERIC Educational Resources Information Center

    Lumsden, James

    1977-01-01

    Person changes can be of three kinds: developmental trends, swells, and tremors. Person unreliability in the tremor sense (momentary fluctuations) can be estimated from person characteristic curves. Average person reliability for groups can be compared from item characteristic curves. (Author)

  2. 40 CFR 716.25 - Adequate file search.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 40 Protection of Environment 31 2011-07-01 2011-07-01 false Adequate file search. 716.25 Section 716.25 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) TOXIC SUBSTANCES CONTROL ACT HEALTH AND SAFETY DATA REPORTING General Provisions § 716.25 Adequate file search. The scope of...

  3. 40 CFR 716.25 - Adequate file search.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 40 Protection of Environment 31 2014-07-01 2014-07-01 false Adequate file search. 716.25 Section 716.25 Protection of Environment ENVIRONMENTAL PROTECTION AGENCY (CONTINUED) TOXIC SUBSTANCES CONTROL ACT HEALTH AND SAFETY DATA REPORTING General Provisions § 716.25 Adequate file search. The scope of...

  4. "Something Adequate"? In Memoriam Seamus Heaney, Sister Quinlan, Nirbhaya

    ERIC Educational Resources Information Center

    Parker, Jan

    2014-01-01

    Seamus Heaney talked of poetry's responsibility to represent the "bloody miracle", the "terrible beauty" of atrocity; to create "something adequate". This article asks, what is adequate to the burning and eating of a nun and the murderous gang rape and evisceration of a medical student? It considers Njabulo Ndebele's…

  5. 40 CFR 716.25 - Adequate file search.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 40 Protection of Environment 30 2010-07-01 2010-07-01 false Adequate file search. 716.25 Section... ACT HEALTH AND SAFETY DATA REPORTING General Provisions § 716.25 Adequate file search. The scope of a person's responsibility to search records is limited to records in the location(s) where the...

  6. 40 CFR 51.354 - Adequate tools and resources.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 40 Protection of Environment 2 2013-07-01 2013-07-01 false Adequate tools and resources. 51.354... Requirements § 51.354 Adequate tools and resources. (a) Administrative resources. The program shall maintain the administrative resources necessary to perform all of the program functions including...

  7. 40 CFR 51.354 - Adequate tools and resources.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 40 Protection of Environment 2 2014-07-01 2014-07-01 false Adequate tools and resources. 51.354... Requirements § 51.354 Adequate tools and resources. (a) Administrative resources. The program shall maintain the administrative resources necessary to perform all of the program functions including...

  8. 40 CFR 51.354 - Adequate tools and resources.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 40 Protection of Environment 2 2010-07-01 2010-07-01 false Adequate tools and resources. 51.354... Requirements § 51.354 Adequate tools and resources. (a) Administrative resources. The program shall maintain the administrative resources necessary to perform all of the program functions including...

  9. 40 CFR 51.354 - Adequate tools and resources.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 40 Protection of Environment 2 2011-07-01 2011-07-01 false Adequate tools and resources. 51.354... Requirements § 51.354 Adequate tools and resources. (a) Administrative resources. The program shall maintain the administrative resources necessary to perform all of the program functions including...

  10. 40 CFR 51.354 - Adequate tools and resources.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 40 Protection of Environment 2 2012-07-01 2012-07-01 false Adequate tools and resources. 51.354... Requirements § 51.354 Adequate tools and resources. (a) Administrative resources. The program shall maintain the administrative resources necessary to perform all of the program functions including...

  11. 9 CFR 305.3 - Sanitation and adequate facilities.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... 9 Animals and Animal Products 2 2012-01-01 2012-01-01 false Sanitation and adequate facilities. 305.3 Section 305.3 Animals and Animal Products FOOD SAFETY AND INSPECTION SERVICE, DEPARTMENT OF... OF VIOLATION § 305.3 Sanitation and adequate facilities. Inspection shall not be inaugurated if...

  12. 9 CFR 305.3 - Sanitation and adequate facilities.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... 9 Animals and Animal Products 2 2011-01-01 2011-01-01 false Sanitation and adequate facilities. 305.3 Section 305.3 Animals and Animal Products FOOD SAFETY AND INSPECTION SERVICE, DEPARTMENT OF... OF VIOLATION § 305.3 Sanitation and adequate facilities. Inspection shall not be inaugurated if...

  13. 9 CFR 305.3 - Sanitation and adequate facilities.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... 9 Animals and Animal Products 2 2014-01-01 2014-01-01 false Sanitation and adequate facilities. 305.3 Section 305.3 Animals and Animal Products FOOD SAFETY AND INSPECTION SERVICE, DEPARTMENT OF... OF VIOLATION § 305.3 Sanitation and adequate facilities. Inspection shall not be inaugurated if...

  14. 9 CFR 305.3 - Sanitation and adequate facilities.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... 9 Animals and Animal Products 2 2010-01-01 2010-01-01 false Sanitation and adequate facilities. 305.3 Section 305.3 Animals and Animal Products FOOD SAFETY AND INSPECTION SERVICE, DEPARTMENT OF... OF VIOLATION § 305.3 Sanitation and adequate facilities. Inspection shall not be inaugurated if...

  15. 9 CFR 305.3 - Sanitation and adequate facilities.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... 9 Animals and Animal Products 2 2013-01-01 2013-01-01 false Sanitation and adequate facilities. 305.3 Section 305.3 Animals and Animal Products FOOD SAFETY AND INSPECTION SERVICE, DEPARTMENT OF... OF VIOLATION § 305.3 Sanitation and adequate facilities. Inspection shall not be inaugurated if...

  16. 21 CFR 201.5 - Drugs; adequate directions for use.

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... 21 Food and Drugs 4 2011-04-01 2011-04-01 false Drugs; adequate directions for use. 201.5 Section 201.5 Food and Drugs FOOD AND DRUG ADMINISTRATION, DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) DRUGS: GENERAL LABELING General Labeling Provisions § 201.5 Drugs; adequate directions for use....

  17. Region 9: Arizona Adequate Letter (10/14/2003)

    EPA Pesticide Factsheets

    This is a letter from Jack P. Broadben,. Director, to Nancy Wrona and Dennis Smith informing them that Maricopa County's motor vehicle emissions budgets in the 2003 MAGCO Maintenance Plan are adequate for transportation conformity purposes.

  18. Region 6: Texas Adequate Letter (4/16/2010)

    EPA Pesticide Factsheets

    This letter from EPA to Texas Commission on Environmental Quality determined 2021 motor vehicle emission budgets for nitrogen oxides (NOx) and volatile organic compounds (VOCs) for Beaumont/Port Arthur area adequate for transportation conformity purposes

  19. Region 2: New Jersey Adequate Letter (5/23/2002)

    EPA Pesticide Factsheets

    This April 22, 2002 letter from EPA to the New Jersey Department of Environmental Protection determined 2007 and 2014 Carbon Monoxide (CO) Mobile Source Emissions Budgets adequate for transportation conformity purposes and will be announced in the Federal

  20. Region 8: Colorado Adequate Letter (10/29/2001)

    EPA Pesticide Factsheets

    This letter from EPA to Colorado Department of Public Health and Environment determined Denvers' particulate matter (PM10) maintenance plan for Motor Vehicle Emissions Budgets adequate for transportation conformity purposes.

  1. Region 1: New Hampshire Adequate Letter (8/12/2008)

    EPA Pesticide Factsheets

    This July 9, 2008 letter from EPA to the New Hampshire Department of Environmental Services, determined the 2009 Motor Vehicle Emissions Budgets (MVEBs) are adequate for transportation conformity purposes and will be announced in the Federal Register (FR).

  2. Region 8: Colorado Adequate Letter (1/20/2004)

    EPA Pesticide Factsheets

    This letter from EPA to Colorado Department of Public Health and Environment determined Greeleys' Carbon Monoxide (CO) maintenance plan for Motor Vehicle Emissions Budgets adequate for transportation conformity purposes and will be announced in the FR.

  3. Region 8: Utah Adequate Letter (6/10/2005)

    EPA Pesticide Factsheets

    This letter from EPA to Utah Department of Environmental Quality determined Salt Lake Citys' and Ogdens' Carbon Monoxide (CO) maintenance plan for Motor Vehicle Emissions Budgets adequate for transportation conformity purposes.

  4. 15 CFR 970.404 - Adequate exploration plan.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... ENVIRONMENTAL DATA SERVICE DEEP SEABED MINING REGULATIONS FOR EXPLORATION LICENSES Certification of Applications § 970.404 Adequate exploration plan. Before he may certify an application, the Administrator must...

  5. 15 CFR 970.404 - Adequate exploration plan.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... ENVIRONMENTAL DATA SERVICE DEEP SEABED MINING REGULATIONS FOR EXPLORATION LICENSES Certification of Applications § 970.404 Adequate exploration plan. Before he may certify an application, the Administrator must...

  6. 15 CFR 970.404 - Adequate exploration plan.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... ENVIRONMENTAL DATA SERVICE DEEP SEABED MINING REGULATIONS FOR EXPLORATION LICENSES Certification of Applications § 970.404 Adequate exploration plan. Before he may certify an application, the Administrator must...

  7. 15 CFR 970.404 - Adequate exploration plan.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... ENVIRONMENTAL DATA SERVICE DEEP SEABED MINING REGULATIONS FOR EXPLORATION LICENSES Certification of Applications § 970.404 Adequate exploration plan. Before he may certify an application, the Administrator must...

  8. 15 CFR 970.404 - Adequate exploration plan.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... ENVIRONMENTAL DATA SERVICE DEEP SEABED MINING REGULATIONS FOR EXPLORATION LICENSES Certification of Applications § 970.404 Adequate exploration plan. Before he may certify an application, the Administrator must...

  9. Region 6: New Mexico Adequate Letter (8/21/2003)

    EPA Pesticide Factsheets

    This is a letter from Carl Edlund, Director, to Alfredo Santistevan regarding MVEB's contained in the latest revision to the Albuquerque Carbon Monoxide State Implementation Plan (SIP) are adequate for transportation conformity purposes.

  10. 10 CFR 1304.114 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... contained in a system of records are adequately trained to protect the security and privacy of such records..., by degaussing or by overwriting with the appropriate security software, in accordance...

  11. 4 CFR 200.14 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... require access to and use of records contained in a system of records are adequately trained to protect... with the appropriate security software, in accordance with regulations of the Archivist of the...

  12. 10 CFR 1304.114 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... contained in a system of records are adequately trained to protect the security and privacy of such records..., by degaussing or by overwriting with the appropriate security software, in accordance...

  13. 4 CFR 200.14 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... require access to and use of records contained in a system of records are adequately trained to protect... with the appropriate security software, in accordance with regulations of the Archivist of the...

  14. 10 CFR 1304.114 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... contained in a system of records are adequately trained to protect the security and privacy of such records..., by degaussing or by overwriting with the appropriate security software, in accordance...

  15. 10 CFR 1304.114 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... contained in a system of records are adequately trained to protect the security and privacy of such records..., by degaussing or by overwriting with the appropriate security software, in accordance...

  16. 4 CFR 200.14 - Responsibility for maintaining adequate safeguards.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... require access to and use of records contained in a system of records are adequately trained to protect... with the appropriate security software, in accordance with regulations of the Archivist of the...

  17. Region 9: Nevada Adequate Letter (3/30/2006)

    EPA Pesticide Factsheets

    This is a letter from Deborah Jordan, Director, to Leo M. Drozdoff regarding Nevada's motor vehicle emissions budgets in the 2005 Truckee Meadows CO Redesignation Request and Maintenance Plan are adequate for transportation conformity decisions.

  18. Reliability physics

    NASA Technical Reports Server (NTRS)

    Cuddihy, E. F.; Ross, R. G., Jr.

    1984-01-01

    Speakers whose topics relate to the reliability physics of solar arrays are listed and their topics briefly reviewed. Nine reports are reviewed ranging in subjects from studies of photothermal degradation in encapsulants and polymerizable ultraviolet stabilizers to interface bonding stability to electrochemical degradation of photovoltaic modules.

  19. One-two-triage: validation and reliability of a novel triage system for low-resource settings

    PubMed Central

    Khan, Ayesha; Mahadevan, S V; Dreyfuss, Andrea; Quinn, James; Woods, Joan; Somontha, Koy; Strehlow, Matthew

    2016-01-01

    Objectives To validate and assess reliability of a novel triage system, one-two-triage (OTT), that can be applied by inexperienced providers in low-resource settings. Methods This study was a two-phase prospective, comparative study conducted at three hospitals. Phase I assessed criterion validity of OTT on all patients arriving at an American university hospital by comparing agreement among three methods of triage: OTT, Emergency Severity Index (ESI) and physician-defined acuity (the gold standard). Agreement was reported in normalised and raw-weighted Cohen κ using two different scales for weighting, Expert-weighted and triage-weighted κ. Phase II tested reliability, reported in Fleiss κ, of OTT using standardised cases among three groups of providers at an urban and rural Cambodian hospital and the American university hospital. Results Normalised for prevalence of patients in each category, OTT and ESI performed similarly well for expert-weighted κ (OTT κ=0.58, 95% CI 0.52 to 0.65; ESI κ=0.47, 95% CI 0.40 to 0.53) and triage-weighted κ (κ=0.54, 95% CI 0.48 to 0.61; ESI κ=0.57, 95% CI 0.51 to 0.64). Without normalising, agreement with gold standard was less for both systems but performance of OTT and ESI remained similar, expert-weighted (OTT κ=0.57, 95% CI 0.52 to 0.62; ESI κ=0.6, 95% CI 0.58 to 0.66) and triage-weighted (OTT κ=0.31, 95% CI 0.25 to 0.38; ESI κ=0.41, 95% CI 0.35 to 0.4). In the reliability phase, all triagers showed fair inter-rater agreement, Fleiss κ (κ=0.308). Conclusions OTT can be reliably applied and performs as well as ESI compared with gold standard, but requires fewer resources and less experience. PMID:27466347

  20. Telehealth language assessments using consumer grade equipment in rural and urban settings: Feasible, reliable and well tolerated.

    PubMed

    Sutherland, Rebecca; Trembath, David; Hodge, Antoinette; Drevensek, Suzi; Lee, Sabrena; Silove, Natalie; Roberts, Jacqueline

    2017-01-01

    Introduction Telehealth can be an effective way to provide speech pathology intervention to children with speech and language impairments. However, the provision of reliable and feasible standardised language assessments via telehealth to establish children's needs for intervention and to monitor progress has not yet been well established. Further, there is limited information about children's reactions to telehealth. This study aimed to examine the reliability and feasibility of conducting standardised language assessment with school-aged children with known or suspected language impairment via a telehealth application using consumer grade computer equipment within a public school setting. Method Twenty-three children (aged 8-12 years) participated. Each child was assessed using a standardised language assessment comprising six subtests. Two subtests were administered by a speech pathologist face-to-face (local clinician) and four subtests were administered via telehealth. All subtests were completed within a single visit to the clinic service, with a break between the face to face and telehealth sessions. The face-to-face clinician completed behaviour observation checklists in the telehealth and face to face conditions and provided feedback on the audio and video quality of the application from the child's point of view. Parent feedback about their child's experience was elicited via survey. Results There was strong inter-rater reliability in the telehealth and face-to-face conditions (correlation coefficients ranged from r = 0.96-1.0 across the subtests) and good agreement on all measures. Similar levels of attention, distractibility and anxiety were observed in the two conditions. Clinicians rated only one session of 23 as having poor audio quality and no sessions were rated as having poor visual quality. Parent and child reactions to the use of telehealth were largely positive and supportive of using telehealth to assess rural children. Discussion The

  1. Measurement of health-related quality of life in survivors of cancer in childhood in Central America: feasibility, reliability, and validity.

    PubMed

    Fu, Ligia; Talsma, Danielle; Baez, Fulgencio; Bonilla, Miguel; Moreno, Belgica; Ah-Chu, Maria; Pena, Armando; Furlong, William; Barr, Ronald D

    2006-06-01

    Cancer is the commonest cause of disease-related death in children over 5 years of age in various parts of Latin America, but the survival rates are improving. This study assessed the health status and health-related quality of life (HRQL) of more than 200 survivors of cancer in childhood in the countries of a Central American consortium devoted to pediatric hematology-oncology. Patients' self-reports and parental proxy assessments were collected using interviewer-administered Spanish-language questionnaires, and physicians provided assessments using self-complete questionnaires, based on the complementary Health Utilities Index (HUI) Mark 2 (HUI2) and Mark 3 (HUI3) health status classification systems. Inter-rater agreement, measured by intra-class correlation (ICC), was fair to moderate (0.340.60) for all 3 pairs of assessors for readily assessable attributes: HUI2 sensation, HUI3 vision, HUI3 hearing, and HUI3 ambulation. Less than 40% of the patients reported being in perfect health. More than 20% reported being in health states with HRQL scores corresponding to moderate or severe disability, notably in the attributes of emotion and cognition. The results reflect a common profile in survivors of cancer in childhood, including those from industrialized societies. This study illustrates the feasibility of collecting reliable and valid information on HRQL in the developing country context, raising the prospect that such information could be used to influence clinical practice.

  2. Regulatory requirements for providing adequate veterinary care to research animals.

    PubMed

    Pinson, David M

    2013-09-01

    Provision of adequate veterinary care is a required component of animal care and use programs in the United States. Program participants other than veterinarians, including non-medically trained research personnel and technicians, also provide veterinary care to animals, and administrators are responsible for assuring compliance with federal mandates regarding adequate veterinary care. All program participants therefore should understand the regulatory requirements for providing such care. The author provides a training primer on the US regulatory requirements for the provision of veterinary care to research animals. Understanding the legal basis and conditions of a program of veterinary care will help program participants to meet the requirements advanced in the laws and policies.

  3. Assessing the Quality of Mobile Exercise Apps Based on the American College of Sports Medicine Guidelines: A Reliable and Valid Scoring Instrument

    PubMed Central

    Bian, Jiang; Leavitt, Trevor; Vincent, Heather K; Vander Zalm, Lindsey; Teurlings, Tyler L; Smith, Megan D

    2017-01-01

    Background Regular physical activity can not only help with weight management, but also lower cardiovascular risks, cancer rates, and chronic disease burden. Yet, only approximately 20% of Americans currently meet the physical activity guidelines recommended by the US Department of Health and Human Services. With the rapid development of mobile technologies, mobile apps have the potential to improve participation rates in exercise programs, particularly if they are evidence-based and are of sufficient content quality. Objective The goal of this study was to develop and test an instrument, which was designed to score the content quality of exercise program apps with respect to the exercise guidelines set forth by the American College of Sports Medicine (ACSM). Methods We conducted two focus groups (N=14) to elicit input for developing a preliminary 27-item scoring instruments based on the ACSM exercise prescription guidelines. Three reviewers who were no sports medicine experts independently scored 28 exercise program apps using the instrument. Inter- and intra-rater reliability was assessed among the 3 reviewers. An expert reviewer, a Fellow of the ACSM, also scored the 28 apps to create criterion scores. Criterion validity was assessed by comparing nonexpert reviewers’ scores to the criterion scores. Results Overall, inter- and intra-rater reliability was high with most coefficients being greater than .7. Inter-rater reliability coefficients ranged from .59 to .99, and intra-rater reliability coefficients ranged from .47 to 1.00. All reliability coefficients were statistically significant. Criterion validity was found to be excellent, with the weighted kappa statistics ranging from .67 to .99, indicating a substantial agreement between the scores of expert and nonexpert reviewers. Finally, all apps scored poorly against the ACSM exercise prescription guidelines. None of the apps received a score greater than 35, out of a possible maximal score of 70. Conclusions

  4. Network reliability

    NASA Technical Reports Server (NTRS)

    Johnson, Marjory J.

    1985-01-01

    Network control (or network management) functions are essential for efficient and reliable operation of a network. Some control functions are currently included as part of the Open System Interconnection model. For local area networks, it is widely recognized that there is a need for additional control functions, including fault isolation functions, monitoring functions, and configuration functions. These functions can be implemented in either a central or distributed manner. The Fiber Distributed Data Interface Medium Access Control and Station Management protocols provide an example of distributed implementation. Relative information is presented here in outline form.

  5. Design and reliability of a specific instrument to evaluate patient safety for patients with acute myocardial infarction treated in a predefined care track: a retrospective patient record review study in a single tertiary hospital in the Netherlands

    PubMed Central

    Eindhoven, Daniëlle C; Borleffs, C Jan Willem; Dietz, Marlieke F; Schalij, Martin J; Brouwers, Corline; de Bruijne, Martine C

    2017-01-01

    Objective Numerous studies have shown that a substantial number of patients suffer from adverse events (AEs) as a result of hospital care. However, specific data on AEs in acute cardiac care are scarce. The current manuscript describes the development and validation of a specific instrument to evaluate patient safety of a predefined care track for patients with acute myocardial infarction (AMI). Design Retrospective patient record review study. Setting and participants A total of 879 hospital admissions treated in a tertiary care centre for an AMI (age 64±12 years, 71% male). Main outcome measure In the first phase, the medical records of patients with AMI warranting coronary angiography or coronary intervention were analysed for process deviations. In the second phase, the medical records of these patients were checked for any harm that had occurred which was caused by the healthcare provider or the healthcare organisation (AE) and whether the harm that occurred was preventable. Results Of all 879 patients included in the analysis, 40% (n=354) had 1 or more process deviation. Of these 354 patients, 116 (33%) had an AE. Patients with AE experienced more process deviations compared with patients without AE (2±1.7 vs 1.5±0.9 process deviations per patient, p=0.005). Inter-rater reliability in assessing a causal relation of healthcare with the origin of an AE showed a κ of 0.67 (95% CI 0.51 to 0.83). Conclusions This study shows that it is possible to develop a reliable method, which can objectively assess process deviations and the occurrence of AEs in a specified population. This method could be a starting point for developing an electronic tracking system for continuous monitoring in strictly predefined care tracks. PMID:28320797

  6. 13 CFR 107.200 - Adequate capital for Licensees.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... operate actively in accordance with your Articles and within the context of your business plan, as... 13 Business Credit and Assistance 1 2010-01-01 2010-01-01 false Adequate capital for Licensees. 107.200 Section 107.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION SMALL...

  7. 13 CFR 107.200 - Adequate capital for Licensees.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... operate actively in accordance with your Articles and within the context of your business plan, as... 13 Business Credit and Assistance 1 2011-01-01 2011-01-01 false Adequate capital for Licensees. 107.200 Section 107.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION SMALL...

  8. Is the Stock of VET Skills Adequate? Assessment Methodologies.

    ERIC Educational Resources Information Center

    Blandy, Richard; Freeland, Brett

    In Australia and elsewhere, four approaches have been used to determine whether stocks of vocational education and training (VET) skills are adequate to meet industry needs. The four methods are as follows: (1) the manpower requirements approach; (2) the international, national, and industry comparisons approach; (3) the labor market analysis…

  9. Do Beginning Teachers Receive Adequate Support from Their Headteachers?

    ERIC Educational Resources Information Center

    Menon, Maria Eliophotou

    2012-01-01

    The article examines the problems faced by beginning teachers in Cyprus and the extent to which headteachers are considered to provide adequate guidance and support to them. Data were collected through interviews with 25 school teachers in Cyprus, who had recently entered teaching (within 1-5 years) in public primary schools. According to the…

  10. 13 CFR 108.200 - Adequate capital for NMVC Companies.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... Companies. 108.200 Section 108.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION NEW MARKETS VENTURE CAPITAL (âNMVCâ) PROGRAM Qualifications for the NMVC Program Capitalizing A Nmvc Company § 108.200 Adequate capital for NMVC Companies. You must meet the requirements of §§ 108.200-108.230 in order...

  11. 13 CFR 108.200 - Adequate capital for NMVC Companies.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... Companies. 108.200 Section 108.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION NEW MARKETS VENTURE CAPITAL (âNMVCâ) PROGRAM Qualifications for the NMVC Program Capitalizing A Nmvc Company § 108.200 Adequate capital for NMVC Companies. You must meet the requirements of §§ 108.200-108.230 in order...

  12. 13 CFR 108.200 - Adequate capital for NMVC Companies.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... Companies. 108.200 Section 108.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION NEW MARKETS VENTURE CAPITAL (âNMVCâ) PROGRAM Qualifications for the NMVC Program Capitalizing A Nmvc Company § 108.200 Adequate capital for NMVC Companies. You must meet the requirements of §§ 108.200-108.230 in order...

  13. 13 CFR 108.200 - Adequate capital for NMVC Companies.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... Companies. 108.200 Section 108.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION NEW MARKETS VENTURE CAPITAL (âNMVCâ) PROGRAM Qualifications for the NMVC Program Capitalizing A Nmvc Company § 108.200 Adequate capital for NMVC Companies. You must meet the requirements of §§ 108.200-108.230 in order...

  14. 13 CFR 108.200 - Adequate capital for NMVC Companies.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... Companies. 108.200 Section 108.200 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION NEW MARKETS VENTURE CAPITAL (âNMVCâ) PROGRAM Qualifications for the NMVC Program Capitalizing A Nmvc Company § 108.200 Adequate capital for NMVC Companies. You must meet the requirements of §§ 108.200-108.230 in order...

  15. Understanding Your Adequate Yearly Progress (AYP), 2011-2012

    ERIC Educational Resources Information Center

    Missouri Department of Elementary and Secondary Education, 2011

    2011-01-01

    The "No Child Left Behind Act (NCLB) of 2001" requires all schools, districts/local education agencies (LEAs) and states to show that students are making Adequate Yearly Progress (AYP). NCLB requires states to establish targets in the following ways: (1) Annual Proficiency Target; (2) Attendance/Graduation Rates; and (3) Participation…

  16. 34 CFR 200.13 - Adequate yearly progress in general.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 34 Education 1 2011-07-01 2011-07-01 false Adequate yearly progress in general. 200.13 Section 200.13 Education Regulations of the Offices of the Department of Education OFFICE OF ELEMENTARY AND SECONDARY EDUCATION, DEPARTMENT OF EDUCATION TITLE I-IMPROVING THE ACADEMIC ACHIEVEMENT OF THE...

  17. 34 CFR 200.13 - Adequate yearly progress in general.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 34 Education 1 2013-07-01 2013-07-01 false Adequate yearly progress in general. 200.13 Section 200.13 Education Regulations of the Offices of the Department of Education OFFICE OF ELEMENTARY AND SECONDARY EDUCATION, DEPARTMENT OF EDUCATION TITLE I-IMPROVING THE ACADEMIC ACHIEVEMENT OF THE...

  18. Region 9: Arizona Adequate Letter (11/1/2001)

    EPA Pesticide Factsheets

    This is a letter from Jack P. Broadbent, Director, Air Division to Nancy Wrona and James Bourney informing them of the adequacy of Revised MAG 1999 Serious Area Carbon Monoxide Plan and that the MAG CO Plan is adequate for Maricopa County.

  19. Assessment of Interpersonal Motivation in Transcripts (AIMIT): an inter- and intra-rater reliability study of a new method of detection of interpersonal motivational systems in psychotherapy.

    PubMed

    Fassone, G; Valcella, F; Pallini, S; Scarcella, F; Tombolini, L; Ivaldi, A; Prunetti, E; Manaresi, F; Liotti, G

    2012-01-01

    Assessing Interpersonal Motivations in Transcripts (AIMIT) is a coding system aiming to systematically detect the activity of interpersonal motivational systems (IMS) in the therapeutic dialogue. An inter- and intra-rater reliability study has been conducted. Sixteen video-recorded psychotherapy sessions were selected and transcribed according to the AIMIT criteria. Sessions relate to 16 patients with an Axis II diagnosis, with a mean Global Assessment of Functioning of 51. For the intra-rater reliability evaluation, five sessions have been selected and assigned to five independent coders who where asked to make a first evaluation, and then a second independent one 14 days later. For the inter-rater reliability study, the sessions coded by the therapist-coder were jointly revised with another coder and finally classified as gold standard. The 16 standard sessions were sent to other evaluators for the independent coding. The agreement (κ) was estimated according to the following parameters for each coding unit: evaluation units supported by the 'codable' activation of one or more IMS; motivational interaction with reference to the ongoing relation between patient and therapist; an interaction between the patient and another person reported/narrated by the patient; detection of specific IMS: attachment (At), caregiving (CG), rank (Ra), sexuality (Se), peer cooperation (PC); and transitions from one IMS to another were also scored. The intra-rater agreement was evaluated through the parameters 'cod', 'At', 'CG', 'Ra', 'Se' and 'PC' described above. A total of 2443 coding units were analysed. For the nine parameters on which the agreement was calculated, eight ['coded (Cod)', 'ongoing relation (Rel)', 'narrated relation (Nar)', 'At', 'CG', 'Ra', 'Se' and 'PC'] have κ values comprised between 0.62 (CG) and 0.81 (Cod) and were therefore satisfactory. The scoring of 'transitions' showed agreement values slightly below desired cut-off (0.56). Intra-rater reliability was

  20. Army General Fund Adjustments Not Adequately Documented or Supported

    DTIC Science & Technology

    2016-07-26

    statements were unreliable and lacked an adequate audit trail. Furthermore, DoD and Army managers could not rely on the data in their accounting...risk that AGF financial statements will be materially misstated and the Army will not achieve audit readiness by the congressionally mandated...and $6.5 trillion in yearend adjustments made to Army General Fund data during FY 2015 financial statement compilation. We conducted this audit in

  1. Affect Consciousness in children with internalizing problems: Assessment of affect integration.

    PubMed

    Taarvig, Eva; Solbakken, Ole André; Grova, Bjørg; Monsen, Jon T

    2015-10-01

    Affect integration was operationalized through the Affect Consciousness (AC) construct as degrees of awareness, tolerance, nonverbal expression and conceptual expression of 11 affects. These aspects are assessed through a semi-structured Affect Consciousness Interview (ACI) and separate rating scales (Affect Consciousness Scales (ACSs)) developed for use in research and clinical work with adults with psychopathological disorders. Age-adjusted changes were made in the interview and rating system. This study explored the applicability of the adjusted ACI to a sample of 11-year-old children with internalizing problems through examining inter-rater reliability of the adjusted ACI, along with relationships between the AC aspects and aspects of mental health as symptoms of depression, symptoms of anxiety, social competence, besides general intelligence. Satisfactory inter-rater reliability was found, as well as consistent relationships between the AC aspects and the various aspects of mental health, a finding which coincides with previous research. The finding indicates that the attainment of the capacity to deal adaptively with affect is probably an important contributor to the development of adequate social competence and maybe in the prevention of psychopathology in children. The results indicate that the adjusted ACI and rating scales are useful tools in treatment planning with children at least from the age of 11 years.

  2. Assessing health-related resources in senior living residences

    PubMed Central

    Kerr, Jacqueline; Carlson, Jordan A.; Sallis, James F.; Rosenberg, Dori; Leak, Chikarlo R.; Saelens, Brian E.; Chapman, James E.; Frank, Lawrence D.; Cain, Kelli L.; Conway, Terry L.; King, Abby C.

    2015-01-01

    This study evaluated a new tool, “The Audit of Physical Activity Resources for Seniors” (APARS), which assesses the physical activity environment in Senior Living Residences (SLRs). Audits were conducted in 29 SLRs and inter-rater reliability was assessed. Pearson correlations were examined between APARS items and objectively measured physical activity and sedentary time, and self-rated health, collected from residents at a subset of 12 SLRs (N=147). Eighty-nine of the 90 items (98.9%) demonstrated Kappa or ICC values above .70 and/or percent agreement above 80%. The 90 items were summarized into nine scales. Two scales (outside supportive physical activity features/functionality and outside exercise facilities) were related to greater physical activity and less sedentary time. Four scales (inside social facilities, onsite services, exercise programs, and social activities) were related to greater sedentary time and better self-rated health. APARS items demonstrated adequate inter-rater reliability and some evidence for construct validity to assess health-related environments in retirement facilities. Social activities in SLRs could benefit residents by incorporating more physical activity. Use of APARS could inform more health-promoting designs of senior living facilities. PMID:27168700

  3. Development of the Children's Communication Checklist (CCC): a method for assessing qualitative aspects of communicative impairment in children.

    PubMed

    Bishop, D V

    1998-09-01

    The Children's Communication Checklist (CCC) was developed to assess aspects of communicative impairment that are not adequately evaluated by contemporary standardised language tests. These are predominantly pragmatic abnormalities seen in social communication, although other qualitative aspects of speech and language were also included. Some items covering social relationships and restricted interests were incorporated, so that the relationship between pragmatic difficulties and other characteristics of pervasive developmental disorders could be explored. Checklist ratings were obtained for 76 children aged 7 to 9 years, all of whom had received special education for language impairment. In 71 cases, 2 raters (usually a teacher and speech-language therapist) independently completed the checklist, making it possible to establish inter-rater reliability. From an initial pool of 93 items, 70 items, grouped into 9 scales, were retained. Five of the subscales were concerned with pragmatic aspects of communication. A composite pragmatic impairment scale formed from these subscales had inter-rater reliability and internal consistency of around .80. This composite discriminated between children with a school diagnosis of semantic-pragmatic disorder and those with other types of specific language impairment (SLI). The majority of children with pragmatic language impairments did not have any evidence of restricted interests or significant difficulties in the domains of social relationships.

  4. A qualitative study of parental modeling and social support for physical activity in underserved adolescents.

    PubMed

    Wright, Marcie S; Wilson, Dawn K; Griffin, Sarah; Evans, Alexandra

    2010-04-01

    This study obtained qualitative data to assess how parental role modeling and parental social support influence physical activity in underserved (minority, low-income) adolescents. Fifty-two adolescents (22 males, 30 females; ages 10-14 years, 85% African-American) participated in a focus group (6-10 per group, same gender). Focus groups were audiotaped, transcribed and coded by independent raters. Inter-rater reliabilities indicated adequate agreement [inter-rater reliability (r) = 0.84]. Themes were identified for parental role modeling and parental social support. Regarding parental role modeling, adolescents reported that parents engaged in a variety of different types of physical activities with their children such as walking, cycling and playing basketball; however, activity was infrequent. Sex differences were noted in parental social support indicating that female adolescents reported receiving more emotional and negative support for physical activity (being required to play outside with a sibling), while boys reported receiving more tangible types of support for physical activity. Adolescents also generated ideas on how to increase parental social support and in particular tangible support was highlighted as important by both males and females. This study suggests that future interventions should focus on improving parental engagement and tangible support that involve direct participation from parents in physical activities with their adolescents.

  5. Genetic modification of preimplantation embryos: toward adequate human research policies.

    PubMed

    Dresser, Rebecca

    2004-01-01

    Citing advances in transgenic animal research and setbacks in human trials of somatic cell genetic interventions, some scientists and others want to begin planning for research involving the genetic modification of human embryos. Because this form of genetic modification could affect later-born children and their offspring, the protection of human subjects should be a priority in decisions about whether to proceed with such research. Yet because of gaps in existing federal policies, embryo modification proposals might not receive adequate scientific and ethical scrutiny. This article describes current policy shortcomings and recommends policy actions designed to ensure that the investigational genetic modification of embryos meets accepted standards for research on human subjects.

  6. Elements for adequate informed consent in the surgical context.

    PubMed

    Abaunza, Hernando; Romero, Klaus

    2014-07-01

    Given a history of atrocities and violations of ethical principles, several documents and regulations have been issued by a wide variety of organizations. They aim at ensuring that health care and clinical research adhere to defined ethical principles. A fundamental component was devised to ensure that the individual has been provided the necessary information to make an informed decision regarding health care or participation in clinical research. This article summarizes the history and regulations for informed consent and discusses suggested components for adequate consent forms for daily clinical practice in surgery as well as clinical research.

  7. Quantifying dose to the reconstructed breast: Can we adequately treat?

    SciTech Connect

    Chung, Eugene; Marsh, Robin B.; Griffith, Kent A.; Moran, Jean M.; Pierce, Lori J.

    2013-04-01

    To evaluate how immediate reconstruction (IR) impacts postmastectomy radiotherapy (PMRT) dose distributions to the reconstructed breast (RB), internal mammary nodes (IMN), heart, and lungs using quantifiable dosimetric end points. 3D conformal plans were developed for 20 IR patients, 10 autologous reconstruction (AR), and 10 expander-implant (EI) reconstruction. For each reconstruction type, 5 right- and 5 left-sided reconstructions were selected. Two plans were created for each patient, 1 with RB coverage alone and 1 with RB + IMN coverage. Left-sided EI plans without IMN coverage had higher heart Dmean than left-sided AR plans (2.97 and 0.84 Gy, p = 0.03). Otherwise, results did not vary by reconstruction type and all remaining metrics were evaluated using a combined AR and EI dataset. RB coverage was adequate regardless of laterality or IMN coverage (Dmean 50.61 Gy, D95 45.76 Gy). When included, IMN Dmean and D95 were 49.57 and 40.96 Gy, respectively. Mean heart doses increased with left-sided treatment plans and IMN inclusion. Right-sided treatment plans and IMN inclusion increased mean lung V{sub 20}. Using standard field arrangements and 3D planning, we observed excellent coverage of the RB and IMN, regardless of laterality or reconstruction type. Our results demonstrate that adequate doses can be delivered to the RB with or without IMN coverage.

  8. Smoking Cessation/Prevention in the Air Force: How Adequate

    DTIC Science & Technology

    2007-11-02

    FNP , Com. Member Approval DaW APPROVED: F.G. Abdellah, EdD, ScD, RN, FAAN Date Dean CURRICULUM VITAE Name: Cheryl Anita Udensi Permanent Address...sample of charts and client interview was employed to compare providers’ documented practice protocols with established guidelines set by the Department of...validity in smoking cessation practices was utilized. A pilot study was done to determine intercoder reliability. Descriptive statistics were utilized to

  9. Preliminary Validation and Reliability Testing of the Montreal Instrument for Cat Arthritis Testing, for Use by Veterinarians, in a Colony of Laboratory Cats

    PubMed Central

    Klinck, Mary P.; Rialland, Pascale; Guillot, Martin; Moreau, Maxim; Frank, Diane; Troncy, Eric

    2015-01-01

    Simple Summary Feline osteoarthritis (OA) is challenging to diagnose. A pain scale was developed for use by veterinarians, in association with their physical examination, and tested for reliability and validity. The scale items were: Interaction with the examiner, Exploration of the room, Body Posture, Gait, Body Condition, condition of Coat and Claws, and abnormal Findings or Cat Reaction upon joint Palpation. Expert review supported the scale content. Two studies using laboratory-housed cats found the most promising results for Gait and Body Posture, in terms of distinguishing between OA and non-OA cats, repeatability of results, and correlations with objectively measured kinetics (weight-bearing). Abstract Subtle signs and conflicting physical and radiographic findings make feline osteoarthritis (OA) challenging to diagnose. A physical examination-based assessment was developed, consisting of eight items: Interaction, Exploration, Posture, Gait, Body Condition, Coat and Claws, (joint) Palpation–Findings, and Palpation–Cat Reaction. Content (experts) and face (veterinary students) validity were excellent. Construct validity, internal consistency, and intra- and inter-rater reliability were assessed via a pilot and main study, using laboratory-housed cats with and without OA. Gait distinguished OA status in the pilot (p = 0.05) study. In the main study, no scale item achieved statistically significant OA detection. Forelimb peak vertical ground reaction force (PVF) correlated inversely with Gait (Rhos = −0.38 (p = 0.03) to −0.41 (p = 0.02)). Body Posture correlated with Gait, and inversely with forelimb PVF at two of three time points (Rhos = −0.38 (p = 0.03) to −0.43 (p = 0.01)). Palpation (Findings, Cat Reaction) did not distinguish OA from non-OA cats. Palpation—Cat Reaction (Forelimbs) correlated inversely with forelimb PVF at two time points (Rhos = −0.41 (p = 0.02) to −0.41 (p = 0.01)), but scores were highly variable, and poorly reliable

  10. Prostate cancer between prognosis and adequate/proper therapy

    PubMed Central

    Grozescu, T; Popa, F

    2017-01-01

    Knowing the indolent, non-invasive nature of most types of prostate cancer, as well as the simple fact that the disease seems more likely to be associated with age rather than with other factors (50% of men at the age of 50 and 80% at the age of 80 have it [1], with or without presenting any symptom), the big challenge of this clinical entity was to determine severity indicators (so far insufficient) to guide the physician towards an adequate attitude in the clinical setting. The risk of over-diagnosing and over-treating many prostate cancer cases (indicated by all the major European and American studies) is real and poses many question marks. The present paper was meant to deliver new research data and to reset the clinical approach in prostate cancer cases. PMID:28255369

  11. The cerebellopontine angle: does the translabyrinthine approach give adequate access?

    PubMed

    Fagan, P A; Sheehy, J P; Chang, P; Doust, B D; Coakley, D; Atlas, M D

    1998-05-01

    A long-standing but unfounded criticism of the translabyrinthine approach is the misperception that this approach does not give adequate access to the cerebellopontine angle. Because of what is perceived as limited visualization and operating space within the cerebellopontine angle, some surgeons still believe that the translabyrinthine approach is inappropriate for large acoustic tumors. In this study, the surgical access to the cerebellopontine angle by virtue of the translabyrinthine approach is measured and analyzed. The parameters are compared with those measured for the retrosigmoid approach. This series objectively confirms that the translabyrinthine approach offers the neurotologic surgeon a shorter operative depth to the tumor, via a similar-sized craniotomy. This permits superior visualization by virtue of a wider angle of surgical access. Such access is achieved with the merit of minimal cerebellar retraction.

  12. Barriers to adequate prenatal care utilization in American Samoa

    PubMed Central

    Hawley, Nicola L; Brown, Carolyn; Nu’usolia, Ofeira; Ah-Ching, John; Muasau-Howard, Bethel; McGarvey, Stephen T

    2013-01-01

    Objective To describe the utilization of prenatal care in American Samoan women and to identify socio-demographic predictors of inadequate prenatal care utilization. Methods Using data from prenatal clinic records, women (n=692) were categorized according to the Adequacy of Prenatal Care Utilization Index as having received adequate plus, adequate, intermediate or inadequate prenatal care during their pregnancy. Categorical socio-demographic predictors of the timing of initiation of prenatal care (week of gestation) and the adequacy of received services were identified using one way Analysis of Variance (ANOVA) and independent samples t-tests. Results Between 2001 and 2008 85.4% of women received inadequate prenatal care. Parity (P=0.02), maternal unemployment (P=0.03), and both parents being unemployed (P=0.03) were negatively associated with the timing of prenatal care initation. Giving birth in 2007–2008, after a prenatal care incentive scheme had been introduced in the major hospital, was associated with earlier initiation of prenatal care (20.75 versus 25.12 weeks; P<0.01) and improved adequacy of received services (95.04% versus 83.8%; P=0.02). Conclusion The poor prenatal care utilization in American Samoa is a major concern. Improving healthcare accessibility will be key in encouraging women to attend prenatal care. The significant improvements in the adequacy of prenatal care seen in 2007–2008 suggest that the prenatal care incentive program implemented in 2006 may be a very positive step toward addressing issues of prenatal care utilization in this population. PMID:24045912

  13. Duration of Pulmonary Tuberculosis Infectiousness under Adequate Therapy, as Assessed Using Induced Sputum Samples

    PubMed Central

    Ko, Yousang; Shin, Jeong Hwan; Lee, Hyun-Kyung; Lee, Young Seok; Lee, Suh-Young; Park, So Young; Mo, Eun-Kyung; Kim, Changhwan

    2017-01-01

    Background A sputum culture is the most reliable indicator of the infectiousness of pulmonary tuberculosis (PTB); however, a spontaneous sputum specimen may not be suitable. The aim of this study was to evaluate the infectious period in patients with non–drug-resistant (DR) PTB receiving adequate standard chemotherapy, using induced sputum (IS) specimens. Methods We evaluated the duration of infectiousness of PTB using a retrospective cohort design. Results Among the 35 patients with PTB, 22 were smear-positive. The rates of IS culture positivity from baseline to the sixth week of anti-tuberculosis medication in the smear-positive PTB group were 100%, 100%, 91%, 73%, 36%, and 18%, respectively. For smear-positive PTB cases, the median time of conversion to culture negativity was 35.0 days (range, 28.0–42.0 days). In the smear-negative PTB group (n=13), the weekly rates of positive IS culture were 100%, 77%, 39%, 8%, 0%, and 0%, respectively, and the median time to conversion to culture-negative was 21.0 days (range, 17.5–28.0 days). Conclusion The infectiousness of PTB, under adequate therapy, may persist longer than previously reported, even in patients with non-DR PTB. PMID:28119744

  14. Maintaining Adequate CO2 Washout for an Advanced EMU via a New Rapid Cycle Amine Technology

    NASA Technical Reports Server (NTRS)

    Chullen, Cinda; Conger, Bruce

    2012-01-01

    Over the past several years, NASA has realized tremendous progress in Extravehicular Activity (EVA) technology development. This has been evidenced by the progressive development of a new Rapid Cycle Amine (RCA) system for the Advanced Extravehicular Mobility Unit (AEMU) Portable Life Support Subsystem (PLSS). The PLSS is responsible for the life support of the crew member in the spacesuit. The RCA technology is responsible for carbon dioxide (CO2) and humidity control. Another aspect of the RCA is that it is on-back vacuum-regenerable, efficient, and reliable. The RCA also simplifies the PLSS schematic by eliminating the need for a condensing heat exchanger for humidity control in the current EMU. As development progresses on the RCA, it is important that the sizing be optimized so that the demand on the PLSS battery is minimized. As well, maintaining the CO2 washout at adequate levels during an EVA is an absolute requirement of the RCA and associated ventilation system. Testing has been underway in-house at NASA Johnson Space Center and analysis has been initiated to evaluate whether the technology provides exemplary performance in ensuring that the CO2 is removed sufficiently and the ventilation flow is adequate for maintaining CO2 washout in the AEMU spacesuit helmet of the crew member during an EVA. This paper will review the recent developments of the RCA unit, testing planned in-house with a spacesuit simulator, and the associated analytical work along with insights from the medical aspect on the testing. 1

  15. Ensuring reliability in expansion schemes.

    PubMed

    Kamal-Uddin, Abu Sayed; Williams, Donald Leigh

    2005-01-01

    Existing electricity power supplies must serve, or be adapted to serve, the expansion of hospital buildings. With the existing power supply assets of many hospitals being up to 20 years old, assessing the security and reliability of the power system must be given appropriate priority to avoid unplanned outages due to overloads and equipment failures. It is imperative that adequate contingency is planned for essential and non-essential electricity circuits. This article describes the methodology undertaken, and the subsequent recommendations that were made, when evaluating the security and reliability of electricity power supplies to a number of major London hospitals. The methodology described aligns with the latest issue of NHS Estates HTM 2011 'Primary Electrical Infrastructure Emergency Electrical Services Design Guidance' (to which ERA Technology has contributed).

  16. Systemic Crisis of Civilization: In Search for Adequate Solution

    NASA Astrophysics Data System (ADS)

    Khozin, Grigori

    In December 1972 a jumbo jet crashed in the Florida Everglades with the loss of 101 lives. The pilot, distracted by a minor malfunction, failed to note until too late the warning signal that - correctly - indicated an impending disaster. His sudden, astonished cry of Hey, what happening here? were his last words 1. Three decades after this tragic episode, as the Humankind approaches the threshold of the third Millennium, the problem of adequate reaction to warning signals of different nature and of distinguishing minor malfunctions in everyday life of society, in economy and technology as well as in evolution of biosphere from grave threats to the world community and the phenomenon of life on our planet remains crucial to human survival and the future of Civilization. Rational use of knowledge and technology available to the world community remains in this context the corner stone of discussions on the destiny of the intelligent life both on the planet Earth and in the Universe (the fact of intelligent life in the Universe is to be detected by the Humankind)…

  17. ENSURING ADEQUATE SAFETY WHEN USING HYDROGEN AS A FUEL

    SciTech Connect

    Coutts, D

    2007-01-22

    Demonstration projects using hydrogen as a fuel are becoming very common. Often these projects rely on project-specific risk evaluations to support project safety decisions. This is necessary because regulations, codes, and standards (hereafter referred to as standards) are just being developed. This paper will review some of the approaches being used in these evolving standards, and techniques which demonstration projects can implement to bridge the gap between current requirements and stakeholder desires. Many of the evolving standards for hydrogen-fuel use performance-based language, which establishes minimum performance and safety objectives, as compared with prescriptive-based language that prescribes specific design solutions. This is being done for several reasons including: (1) concern that establishing specific design solutions too early will stifle invention, (2) sparse performance data necessary to support selection of design approaches, and (3) a risk-adverse public which is unwilling to accept losses that were incurred in developing previous prescriptive design standards. The evolving standards often contain words such as: ''The manufacturer shall implement the measures and provide the information necessary to minimize the risk of endangering a person's safety or health''. This typically implies that the manufacturer or project manager must produce and document an acceptable level of risk. If accomplished using comprehensive and systematic process the demonstration project risk assessment can ease the transition to widespread commercialization. An approach to adequately evaluate and document the safety risk will be presented.

  18. DARHT -- an adequate EIS: A NEPA case study

    SciTech Connect

    Webb, M.D.

    1997-08-01

    In April 1996 the US District Court in Albuquerque ruled that the Dual Axis Radiographic Hydrodynamic Test (DARHT) Facility Environmental Impact Statement (EIS), prepared by the Los Alamos Area Office, US Department of Energy (DOE), was adequate. The DARHT EIS had been prepared in the face of a lawsuit in only 10 months, a third of the time usually allotted for a DOE EIS, and for only a small fraction of the cost of a typical DOE EIS, and for only a small fraction of the cost of a typical DOE EIS. It subject was the first major facility to be built in decades for the DOE nuclear weapons stockpile stewardship program. It was the first EIS to be prepared for a proposal at DOE`s Los Alamos National Laboratory since 1979, and the first ever prepared by the Los Alamos Area Office. Much of the subject matter was classified. The facility had been specially designed to minimize impacts to a nearby prehistoric Native American ruin, and extensive consultation with American Indian Pueblos was required. The week that the draft EIS was published Laboratory biologists identified a previously unknown pair of Mexican spotted owls in the immediate vicinity of the project, bringing into play the consultation requirements of the Endangered Species Act. In spite of these obstacles, the resultant DARHT EIS was reviewed by the court and found to meet all statutory and regulatory requirements; the court praised the treatment of the classified material which served as a basis for the environmental analysis.

  19. Dose Limits for Man do not Adequately Protect the Ecosystem

    SciTech Connect

    Higley, Kathryn A.; Alexakhin, Rudolf M.; McDonald, Joseph C.

    2004-08-01

    It has been known for quite some time that different organisms display differing degrees of sensitivity to the effects of ionizing radiations. Some microorganisms such as the bacterium Micrococcus radiodurans, along with many species of invertebrates, are extremely radio-resistant. Humans might be categorized as being relatively sensitive to radiation, and are a bit more resistant than some pine trees. Therefore, it could be argued that maintaining the dose limits necessary to protect humans will also result in the protection of most other species of flora and fauna. This concept is usually referred to as the anthropocentric approach. In other words, if man is protected then the environment is also adequately protected. The ecocentric approach might be stated as; the health of humans is effectively protected only when the environment is not unduly exposed to radiation. The ICRP is working on new recommendations dealing with the protection of the environment, and this debate should help to highlight a number of relevant issues concerning that topic.

  20. Reliability and validity of the Thai version of the Yale–Brown Obsessive Compulsive Scale – Second Edition in clinical samples

    PubMed Central

    Hiranyatheb, Thanita; Saipanish, Ratana; Lotrakul, Manote

    2014-01-01

    Purpose The Yale–Brown Obsessive Compulsive Scale (Y-BOCS) is regarded as the most acceptable tool for measuring obsessive–compulsive disorder symptom severity. Recently, the Yale–Brown Obsessive Compulsive Scale – Second Edition (Y-BOCS-II) was developed for better measurement. The study reported here aimed to evaluate the psychometric properties of the Thai version of the Yale–Brown Obsessive Compulsive Scale – Second Edition (Y-BOCS-II-T). Patients and methods The original version of the Y-BOCS-II was translated into Thai, which involved forward translation, synthesis of the translation, and back translation. Modification and cross-cultural adaptation were completed accordingly. The developed Y-BOCS-II-T, together with the Hamilton Rating Scale for Depression, was administered to 41 patients who had a primary diagnosis of obsessive–compulsive disorder. The patients then completed the Pictorial Thai Quality of Life instrument and Patient Health Questionnaire. Lastly, the Global Assessment of Functioning (GAF) and the Clinical Global Impression – Severity Scale (CGI-S) of all patients were blindly rated by another experienced psychiatrist who was not the interviewer. Results The mean total score of the Yale–Brown Obsessive Compulsive Scale – Second Edition – Severity Scale (Y-BOCS-II-SS) and the Yale–Brown Obsessive Compulsive Scale – Second Edition – Symptom Checklist (Y-BOCS-II-SC) were 18.44 (standard deviation =10.51) and 15.85 (standard deviation =9.58), respectively. The Y-BOCS-II-T had satisfactory internal consistency (Cronbach’s alpha =0.94 for the Severity Scale, and Kuder–Richardson Formula 20 =0.90 for the Symptom Checklist). Inter-rater reliability was excellent for both the Y-BOCS-II-SS and Y-BOCS-II-SC. Factor analysis of Y-BOCS-II-SS items revealed a two-factor component associated with obsession and compulsion. The Y-BOCS-II-SS correlated highly with the CGI-S and GAF (r =0.75 and −0.76, respectively), but the Y

  1. On Adequate Comparisons of Antenna Phase Center Variations

    NASA Astrophysics Data System (ADS)

    Schoen, S.; Kersten, T.

    2013-12-01

    One important part for ensuring the high quality of the International GNSS Service's (IGS) products is the collection and publication of receiver - and satellite antenna phase center variations (PCV). The PCV are crucial for global and regional networks, since they introduce a global scale factor of up to 16ppb or changes in the height component with an amount of up to 10cm, respectively. Furthermore, antenna phase center variations are also important for precise orbit determination, navigation and positioning of mobile platforms, like e.g. the GOCE and GRACE gravity missions, or for the accurate Precise Point Positioning (PPP) processing. Using the EUREF Permanent Network (EPN), Baire et al. (2012) showed that individual PCV values have a significant impact on the geodetic positioning. The statements are further supported by studies of Steigenberger et al. (2013) where the impact of PCV for local-ties are analysed. Currently, there are five calibration institutions including the Institut für Erdmessung (IfE) contributing to the IGS PCV file. Different approaches like field calibrations and anechoic chamber measurements are in use. Additionally, the computation and parameterization of the PCV are completely different within the methods. Therefore, every new approach has to pass a benchmark test in order to ensure that variations of PCV values of an identical antenna obtained from different methods are as consistent as possible. Since the number of approaches to obtain these PCV values rises with the number of calibration institutions, there is the necessity for an adequate comparison concept, taking into account not only the numerical values but also stochastic information and computational issues of the determined PCVs. This is of special importance, since the majority of calibrated receiver antennas published by the IGS origin from absolute field calibrations based on the Hannover Concept, Wübbena et al. (2000). In this contribution, a concept for the adequate

  2. Are Vancomycin Trough Concentrations Adequate for Optimal Dosing?

    PubMed Central

    Youn, Gilmer; Jones, Brenda; Jelliffe, Roger W.; Drusano, George L.; Rodvold, Keith A.; Lodise, Thomas P.

    2014-01-01

    The current vancomycin therapeutic guidelines recommend the use of only trough concentrations to manage the dosing of adults with Staphylococcus aureus infections. Both vancomycin efficacy and toxicity are likely to be related to the area under the plasma concentration-time curve (AUC). We assembled richly sampled vancomycin pharmacokinetic data from three studies comprising 47 adults with various levels of renal function. With Pmetrics, the nonparametric population modeling package for R, we compared AUCs estimated from models derived from trough-only and peak-trough depleted versions of the full data set and characterized the relationship between the vancomycin trough concentration and AUC. The trough-only and peak-trough depleted data sets underestimated the true AUCs compared to the full model by a mean (95% confidence interval) of 23% (11 to 33%; P = 0.0001) and 14% (7 to 19%; P < 0.0001), respectively. In contrast, using the full model as a Bayesian prior with trough-only data allowed 97% (93 to 102%; P = 0.23) accurate AUC estimation. On the basis of 5,000 profiles simulated from the full model, among adults with normal renal function and a therapeutic AUC of ≥400 mg · h/liter for an organism for which the vancomycin MIC is 1 mg/liter, approximately 60% are expected to have a trough concentration below the suggested minimum target of 15 mg/liter for serious infections, which could result in needlessly increased doses and a risk of toxicity. Our data indicate that adjustment of vancomycin doses on the basis of trough concentrations without a Bayesian tool results in poor achievement of maximally safe and effective drug exposures in plasma and that many adults can have an adequate vancomycin AUC with a trough concentration of <15 mg/liter. PMID:24165176

  3. Is clinical measurement of anatomic axis of the femur adequate?

    PubMed

    Wu, Chi-Chuan

    2017-03-23

    Background and purpose - The accuracy of using clinical measurement from the anterior superior iliac spine (ASIS) to the center of the knee to determine an anatomic axis of the femur has rarely been studied. A radiographic technique with a full-length standing scanogram (FLSS) was used to assess the adequacy of the clinical measurement. Patients and methods - 100 consecutive young adult patients (mean age 34 (20-40) years) with chronic unilateral lower extremity injuries were studied. The pelvis and intact contralateral lower extremity images in the FLSS were selected for study. The angles between the tibial axis and the femoral shaft anatomic axis (S-AA), the piriformis anatomic axis (P-AA), the clinical anatomic axis (C-AA), and the mechanical axis (MA) were compared between sexes. Results - Only the S-AA and C-AA angles were statistically significantly different in the 100 patients (3.6° vs. 2.8°; p = 0.03). There was a strong correlation between S-AA, P-AA, and C-AA angles (r > 0.9). The average intersecting angle between MA and S-AA in the femur in the 100 patients was 5.5°, and it was 4.8° between MA and C-AA. Interpretation - Clinical measurement of an anatomic axis from the ASIS to the center of the knee may be an adequate and acceptable method to determine lower extremity alignment. The optimal inlet for antegrade femoral intramedullary nailing may be the lateral edge of the piriformis fossa.

  4. Reliability model generator

    NASA Technical Reports Server (NTRS)

    McMann, Catherine M. (Inventor); Cohen, Gerald C. (Inventor)

    1991-01-01

    An improved method and system for automatically generating reliability models for use with a reliability evaluation tool is described. The reliability model generator of the present invention includes means for storing a plurality of low level reliability models which represent the reliability characteristics for low level system components. In addition, the present invention includes means for defining the interconnection of the low level reliability models via a system architecture description. In accordance with the principles of the present invention, a reliability model for the entire system is automatically generated by aggregating the low level reliability models based on the system architecture description.

  5. Ecological validity of the Multiple Errands Test using predictive models of dysexecutive problems in everyday life.

    PubMed

    Cuberos-Urbano, Gustavo; Caracuel, Alfonso; Vilar-López, Raquel; Valls-Serrano, Carlos; Bateman, Andrew; Verdejo-García, Antonio

    2013-01-01

    The"dysexecutive syndrome" is composed of a range of cognitive, emotional, and behavioral deficits that are difficult to evaluate using traditional neuropsychological tests. The Multiple Errands Test (MET) was originally developed to systematize the assessment of the more elusive manifestations of the dysexecutive syndrome. The aims of this study were to examining the reliability of the MET and to investigate the predictive ability of its indices to explain a range of "dysexecutive"-related symptoms in everyday life. Thirty patients with acquired brain injury participated in this study. The MET showed an adequate inter-rater reliability and ecological validity. The main performance indices from the MET were able to significantly predict severity of everyday life executive problems, with different indices predicting particular manifestations of different components of executive functions.

  6. Maintaining Adequate CO2 Washout for an Advanced EMU via a New Rapid Cycle Amine Technology

    NASA Technical Reports Server (NTRS)

    Chullen, Cinda

    2011-01-01

    Over the past several years, NASA has realized tremendous progress in Extravehicular Activity (EVA) technology development. This has been evidenced by the progressive development of a new Rapic Cycle Amine (RCA) system for the Advanced Extravehicular Mobility Unit (AEMU) Portable Life Support Subsystem (PLSS). The PLSS is responsible for the life support of the crew member in the spacesuit. The RCA technology is responsible for carbon dioxide (CO2) and humidity control. Another aspect of the RCA is that it is on-back vacuum-regenerable, efficient, and reliable. The RCA also simplifies the PLSS schematic by eliminating the need for a condensing heat exchanger for humidity control in the current EMU. As development progresses on the RCA, it is important that the sizing be optimized so that the demand on the PLSS battery is minimized. As well, maintaining the CO2 washout at adequate levels during an EVA is an absolute requirement of the RCA and associated ventilation system. Testing has been underway in-house at NASA Johnson Space Center and analysis has been initiated to evaluate whether the technology provides exemplary performance in ensuring that the CO2 is removed sufficiently enough and the ventilation flow is adequate enough to maintain CO2 1 Project Engineer, Space Suit and Crew Survival Systems Branch, Crew and Thermal Systems Division, 2101 NASA Parkway, Houston, TX 77058/EC5. washout in the AEMU spacesuit helmet of the crew member during an EVA. This paper will review the recent developments of the RCA unit, the testing results performed in-house with a spacesuit simulator, and the associated analytical work along with insights from the medical aspect on the testing.

  7. Reliability Generalization: "Lapsus Linguae"

    ERIC Educational Resources Information Center

    Smith, Julie M.

    2011-01-01

    This study examines the proposed Reliability Generalization (RG) method for studying reliability. RG employs the application of meta-analytic techniques similar to those used in validity generalization studies to examine reliability coefficients. This study explains why RG does not provide a proper research method for the study of reliability,…

  8. Can There Be Reliability without "Reliability?"

    ERIC Educational Resources Information Center

    Mislevy, Robert J.

    2004-01-01

    An "Educational Researcher" article by Pamela Moss (1994) asks the title question, "Can there be validity without reliability?" Yes, she answers, if by reliability one means "consistency among independent observations intended as interchangeable" (Moss, 1994, p. 7), quantified by internal consistency indices such as…

  9. Reliability Modeling of Critical Electronic Devices.

    DTIC Science & Technology

    1983-05-01

    Functional Degradation Failure ........ 84 Mechanisms 7.1.3 Semiconductor Laser Reliability Prediction 87.*>* Procedures 7.1.4 Model Limitations...vidicons, helium-cadmium lasers, semiconductor laser,,, circuit breakers, * I.G. sockets and surface acoustic wave devices. - 22 40 *oŔ Several of the...failure mechanism . To insure . adequate discharge of the photoconductive surface in a single scan, the total *capacitance of the target should be

  10. Assuring reliability program effectiveness.

    NASA Technical Reports Server (NTRS)

    Ball, L. W.

    1973-01-01

    An attempt is made to provide simple identification and description of techniques that have proved to be most useful either in developing a new product or in improving reliability of an established product. The first reliability task is obtaining and organizing parts failure rate data. Other tasks are parts screening, tabulation of general failure rates, preventive maintenance, prediction of new product reliability, and statistical demonstration of achieved reliability. Five principal tasks for improving reliability involve the physics of failure research, derating of internal stresses, control of external stresses, functional redundancy, and failure effects control. A final task is the training and motivation of reliability specialist engineers.

  11. 21 CFR 801.5 - Medical devices; adequate directions for use.

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... 21 Food and Drugs 8 2012-04-01 2012-04-01 false Medical devices; adequate directions for use. 801... (CONTINUED) MEDICAL DEVICES LABELING General Labeling Provisions § 801.5 Medical devices; adequate directions for use. Adequate directions for use means directions under which the layman can use a device...

  12. 21 CFR 801.5 - Medical devices; adequate directions for use.

    Code of Federal Regulations, 2010 CFR

    2010-04-01

    ... 21 Food and Drugs 8 2010-04-01 2010-04-01 false Medical devices; adequate directions for use. 801... (CONTINUED) MEDICAL DEVICES LABELING General Labeling Provisions § 801.5 Medical devices; adequate directions for use. Adequate directions for use means directions under which the layman can use a device...

  13. 21 CFR 801.5 - Medical devices; adequate directions for use.

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... 21 Food and Drugs 8 2011-04-01 2011-04-01 false Medical devices; adequate directions for use. 801... (CONTINUED) MEDICAL DEVICES LABELING General Labeling Provisions § 801.5 Medical devices; adequate directions for use. Adequate directions for use means directions under which the layman can use a device...

  14. 21 CFR 801.5 - Medical devices; adequate directions for use.

    Code of Federal Regulations, 2014 CFR

    2014-04-01

    ... 21 Food and Drugs 8 2014-04-01 2014-04-01 false Medical devices; adequate directions for use. 801... (CONTINUED) MEDICAL DEVICES LABELING General Labeling Provisions § 801.5 Medical devices; adequate directions for use. Adequate directions for use means directions under which the layman can use a device...

  15. 21 CFR 801.5 - Medical devices; adequate directions for use.

    Code of Federal Regulations, 2013 CFR

    2013-04-01

    ... 21 Food and Drugs 8 2013-04-01 2013-04-01 false Medical devices; adequate directions for use. 801... (CONTINUED) MEDICAL DEVICES LABELING General Labeling Provisions § 801.5 Medical devices; adequate directions for use. Adequate directions for use means directions under which the layman can use a device...

  16. Power electronics reliability analysis.

    SciTech Connect

    Smith, Mark A.; Atcitty, Stanley

    2009-12-01

    This report provides the DOE and industry with a general process for analyzing power electronics reliability. The analysis can help with understanding the main causes of failures, downtime, and cost and how to reduce them. One approach is to collect field maintenance data and use it directly to calculate reliability metrics related to each cause. Another approach is to model the functional structure of the equipment using a fault tree to derive system reliability from component reliability. Analysis of a fictitious device demonstrates the latter process. Optimization can use the resulting baseline model to decide how to improve reliability and/or lower costs. It is recommended that both electric utilities and equipment manufacturers make provisions to collect and share data in order to lay the groundwork for improving reliability into the future. Reliability analysis helps guide reliability improvements in hardware and software technology including condition monitoring and prognostics and health management.

  17. Human Reliability Program Overview

    SciTech Connect

    Bodin, Michael

    2012-09-25

    This presentation covers the high points of the Human Reliability Program, including certification/decertification, critical positions, due process, organizational structure, program components, personnel security, an overview of the US DOE reliability program, retirees and academia, and security program integration.

  18. Integrated avionics reliability

    NASA Technical Reports Server (NTRS)

    Alikiotis, Dimitri

    1988-01-01

    The integrated avionics reliability task is an effort to build credible reliability and/or performability models for multisensor integrated navigation and flight control. The research was initiated by the reliability analysis of a multisensor navigation system consisting of the Global Positioning System (GPS), the Long Range Navigation system (Loran C), and an inertial measurement unit (IMU). Markov reliability models were developed based on system failure rates and mission time.

  19. Reliable Design Versus Trust

    NASA Technical Reports Server (NTRS)

    Berg, Melanie; LaBel, Kenneth A.

    2016-01-01

    This presentation focuses on reliability and trust for the users portion of the FPGA design flow. It is assumed that the manufacturer prior to hand-off to the user tests FPGA internal components. The objective is to present the challenges of creating reliable and trusted designs. The following will be addressed: What makes a design vulnerable to functional flaws (reliability) or attackers (trust)? What are the challenges for verifying a reliable design versus a trusted design?

  20. Barriers to help-seeking, detection, and adequate treatment for anxiety and mood disorders: implications for health care policy.

    PubMed

    Mechanic, David

    2007-01-01

    Recently, the focus of health policies and initiatives has been directed toward mental health. More precisely, depressive and anxiety disorders have received particular attention because of their disabling outcomes and prevalence among most populations. Despite this increased interest, numerous issues regarding patients' willingness to seek treatment and the adequate recognition and treatment of these disorders by clinicians remain to be addressed. This article considers the factors that influence patients and physicians in their reticence to acknowledge and adequately treat depression and anxiety disorders. It also reviews the impact of society and the media, together with other factors relating to health care organization and administration that affect the treatment of depression and anxiety. In view of the multifaceted challenge involved, efforts to achieve a consensus in determining treatment for those with depressive and anxiety disorders are essential. A consensus will require easy, measurable, and reliable disability indicators; evidence that treatment of patients with varying levels of need is cost effective; and that persons who most need and would benefit from care can be reliably identified among the highly prevalent population of persons with more transient symptoms. Governments and other policymakers should be encouraged to provide appropriate coverage for access to primary and secondary care, the treatments required, and sufficient resources so that care is available when necessary. An important aspect of the challenge is to incorporate these efforts within the realistic constraints of primary care.

  1. Reliability and structural integrity

    NASA Technical Reports Server (NTRS)

    Davidson, J. R.

    1976-01-01

    An analytic model is developed to calculate the reliability of a structure after it is inspected for cracks. The model accounts for the growth of undiscovered cracks between inspections and their effect upon the reliability after subsequent inspections. The model is based upon a differential form of Bayes' Theorem for reliability, and upon fracture mechanics for crack growth.

  2. Reliability model generator specification

    NASA Technical Reports Server (NTRS)

    Cohen, Gerald C.; Mccann, Catherine

    1990-01-01

    The Reliability Model Generator (RMG), a program which produces reliability models from block diagrams for ASSIST, the interface for the reliability evaluation tool SURE is described. An account is given of motivation for RMG and the implemented algorithms are discussed. The appendices contain the algorithms and two detailed traces of examples.

  3. Viking Lander reliability program

    NASA Technical Reports Server (NTRS)

    Pilny, M. J.

    1978-01-01

    The Viking Lander reliability program is reviewed with attention given to the development of the reliability program requirements, reliability program management, documents evaluation, failure modes evaluation, production variation control, failure reporting and correction, and the parts program. Lander hardware failures which have occurred during the mission are listed.

  4. Theory of reliable systems

    NASA Technical Reports Server (NTRS)

    Meyer, J. F.

    1975-01-01

    An attempt was made to refine the current notion of system reliability by identifying and investigating attributes of a system which are important to reliability considerations. Techniques which facilitate analysis of system reliability are included. Special attention was given to fault tolerance, diagnosability, and reconfigurability characteristics of systems.

  5. Predicting software reliability

    NASA Technical Reports Server (NTRS)

    Littlewood, B.

    1989-01-01

    A detailed look is given to software reliability techniques. A conceptual model of the failure process is examined, and some software reliability growth models are discussed. Problems for which no current solutions exist are addressed, emphasizing the very difficult problem of safety-critical systems for which the reliability requirements can be enormously demanding.

  6. A majority rule approach for region-of-interest-guided streamline fiber tractography.

    PubMed

    Colon-Perez, L M; Triplett, W; Bohsali, A; Corti, M; Nguyen, P T; Patten, C; Mareci, T H; Price, C C

    2016-12-01

    Hand-drawn gray matter regions of interest (ROI) are often used to guide the estimation of white matter tractography, obtained from diffusion-weighted magnetic resonance imaging (DWI), in healthy and in patient populations. However, such ROIs are vulnerable to rater bias of the individual segmenting the ROIs, scan variability, and individual differences in neuroanatomy. In this report, a "majority rule" approach is introduced for ROI segmentation used to guide streamline tractography in white matter structures. DWI of one healthy participant was acquired in ten separate sessions using a 3 T scanner over the course of a month. Four raters identified ROIs within the left hemisphere [Cerebral Peduncle (CPED); Internal Capsule (IC); Hand Portion of the Motor Cortex, or Hand Bump, (HB)] using a group-established standard operating procedure for ROI definition to guide the estimation of streamline tracts within the corticospinal tract (CST). Each rater traced the ROIs twice for each scan session. The overlap of each rater's two ROIs was used to define a representative ROI for each rater. These ROIs were combined to create a "majority rules" ROI, in which the rule requires that each voxel is selected by at least three of four raters. Reproducibility for ROIs and CST segmentations were analyzed with the Dice Similarity Coefficient (DSC). Intra-rater reliability for each ROI was high (DSCs ≥ 0.83). Inter-rater reliability was moderate to adequate (DSC range 0.54-0.75; lowest for IC). Using intersected majority rules ROIs, the resulting CST showed improved overlap (DSC = 0.82) in the estimated streamline tracks for the ten sessions. Despite high intra-rater reliability, there was lower inter-rater reliability consistent with the expectation of rater bias. Employing the majority rules method improved reliability in the overlap of the CST.

  7. Situation awareness acquired from monitoring process plants - the Process Overview concept and measure.

    PubMed

    Lau, Nathan; Jamieson, Greg A; Skraaning, Gyrd

    2016-07-01

    We introduce Process Overview, a situation awareness characterisation of the knowledge derived from monitoring process plants. Process Overview is based on observational studies of process control work in the literature. The characterisation is applied to develop a query-based measure called the Process Overview Measure. The goal of the measure is to improve coupling between situation and awareness according to process plant properties and operator cognitive work. A companion article presents the empirical evaluation of the Process Overview Measure in a realistic process control setting. The Process Overview Measure demonstrated sensitivity and validity by revealing significant effects of experimental manipulations that corroborated with other empirical results. The measure also demonstrated adequate inter-rater reliability and practicality for measuring SA based on data collected by process experts. Practitioner Summary: The Process Overview Measure is a query-based measure for assessing operator situation awareness from monitoring process plants in representative settings.

  8. Educational Testing and Validity of Conclusions in the Scholarship of Teaching and Learning

    PubMed Central

    Beltyukova, Svetlana A.; Martin, Beth A.

    2013-01-01

    Validity and its integral evidence of reliability are fundamentals for educational and psychological measurement, and standards of educational testing. Herein, we describe these standards of educational testing, along with their subtypes including internal consistency, inter-rater reliability, and inter-rater agreement. Next, related issues of measurement error and effect size are discussed. This article concludes with a call for future authors to improve reporting of psychometrics and practical significance with educational testing in the pharmacy education literature. By increasing the scientific rigor of educational research and reporting, the overall quality and meaningfulness of SoTL will be improved. PMID:24249848

  9. Software Reliability 2002

    NASA Technical Reports Server (NTRS)

    Wallace, Dolores R.

    2003-01-01

    In FY01 we learned that hardware reliability models need substantial changes to account for differences in software, thus making software reliability measurements more effective, accurate, and easier to apply. These reliability models are generally based on familiar distributions or parametric methods. An obvious question is 'What new statistical and probability models can be developed using non-parametric and distribution-free methods instead of the traditional parametric method?" Two approaches to software reliability engineering appear somewhat promising. The first study, begin in FY01, is based in hardware reliability, a very well established science that has many aspects that can be applied to software. This research effort has investigated mathematical aspects of hardware reliability and has identified those applicable to software. Currently the research effort is applying and testing these approaches to software reliability measurement, These parametric models require much project data that may be difficult to apply and interpret. Projects at GSFC are often complex in both technology and schedules. Assessing and estimating reliability of the final system is extremely difficult when various subsystems are tested and completed long before others. Parametric and distribution free techniques may offer a new and accurate way of modeling failure time and other project data to provide earlier and more accurate estimates of system reliability.

  10. Recalibrating software reliability models

    NASA Technical Reports Server (NTRS)

    Brocklehurst, Sarah; Chan, P. Y.; Littlewood, Bev; Snell, John

    1990-01-01

    In spite of much research effort, there is no universally applicable software reliability growth model which can be trusted to give accurate predictions of reliability in all circumstances. Further, it is not even possible to decide a priori which of the many models is most suitable in a particular context. In an attempt to resolve this problem, techniques were developed whereby, for each program, the accuracy of various models can be analyzed. A user is thus enabled to select that model which is giving the most accurate reliability predicitons for the particular program under examination. One of these ways of analyzing predictive accuracy, called the u-plot, in fact allows a user to estimate the relationship between the predicted reliability and the true reliability. It is shown how this can be used to improve reliability predictions in a completely general way by a process of recalibration. Simulation results show that the technique gives improved reliability predictions in a large proportion of cases. However, a user does not need to trust the efficacy of recalibration, since the new reliability estimates prodcued by the technique are truly predictive and so their accuracy in a particular application can be judged using the earlier methods. The generality of this approach would therefore suggest that it be applied as a matter of course whenever a software reliability model is used.

  11. Recalibrating software reliability models

    NASA Technical Reports Server (NTRS)

    Brocklehurst, Sarah; Chan, P. Y.; Littlewood, Bev; Snell, John

    1989-01-01

    In spite of much research effort, there is no universally applicable software reliability growth model which can be trusted to give accurate predictions of reliability in all circumstances. Further, it is not even possible to decide a priori which of the many models is most suitable in a particular context. In an attempt to resolve this problem, techniques were developed whereby, for each program, the accuracy of various models can be analyzed. A user is thus enabled to select that model which is giving the most accurate reliability predictions for the particular program under examination. One of these ways of analyzing predictive accuracy, called the u-plot, in fact allows a user to estimate the relationship between the predicted reliability and the true reliability. It is shown how this can be used to improve reliability predictions in a completely general way by a process of recalibration. Simulation results show that the technique gives improved reliability predictions in a large proportion of cases. However, a user does not need to trust the efficacy of recalibration, since the new reliability estimates produced by the technique are truly predictive and so their accuracy in a particular application can be judged using the earlier methods. The generality of this approach would therefore suggest that it be applied as a matter of course whenever a software reliability model is used.

  12. Extension of a noninteractive reliability model for ceramic matrix composites

    NASA Technical Reports Server (NTRS)

    Duffy, Stephen F.; Wetherhold, Robert C.; Jain, Lalit K.

    1990-01-01

    Developments in the processing of high temperature ceramic composites demand innovative and progressive design protocols that adequately predict the thermal and mechanical behavior of these materials. The focus here is the extension of a reliability model for orthotropic ceramic composites. The approach chosen to describe failures leads to a noninteractive formulation of reliability that is phenomenological. This particular criterion, which was constructed using tensorial invariant theory, allows six potential failure modes to emerge.

  13. The Human Right to Adequate Housing: A Tool for Promoting and Protecting Individual and Community Health

    PubMed Central

    Thiele, Bret

    2002-01-01

    The human right to adequate housing is enshrined in international law. The right to adequate housing can be traced to the Universal Declaration of Human Rights, which was unanimously adopted by the world community in 1948. Since that time, the right to adequate housing has been reaffirmed on numerous occasions and further defined and elaborated. A key component of this right is habitability of housing, which should comply with health and safety standards. Therefore, the right to adequate housing provides an additional tool for advocates and others interested in promoting healthful housing and living conditions and thereby protecting individual and community health. PMID:11988432

  14. A Study to Identify and Analyze the Effects of Category and Frequency Sampling on the Reporting of Total Nursing Care Hour Requirements

    DTIC Science & Technology

    1989-06-26

    quarterly basis as a means to validate inter-rater reliability. Reliability testing will be conducted by an Independent, expert patient classifier...appointed by nursing administrat’on (Vail, Norton, & Rimm, 1984). An independent, expert patient classifier is defined as an RN not assigned to the unit

  15. Reliability, Recursion, and Risk.

    ERIC Educational Resources Information Center

    Henriksen, Melvin, Ed.; Wagon, Stan, Ed.

    1991-01-01

    The discrete mathematics topics of trees and computational complexity are implemented in a simple reliability program which illustrates the process advantages of the PASCAL programing language. The discussion focuses on the impact that reliability research can provide in assessment of the risks found in complex technological ventures. (Author/JJK)

  16. Monte Carlo Reliability Analysis.

    DTIC Science & Technology

    1987-10-01

    to Stochastic Processes , Prentice-Hall, Englewood Cliffs, NJ, 1975. (5) R. E. Barlow and F. Proscham, Statistical TheorX of Reliability and Life...Lewis and Z. Tu, "Monte Carlo Reliability Modeling by Inhomogeneous ,Markov Processes, Reliab. Engr. 16, 277-296 (1986). (4) E. Cinlar, Introduction

  17. Hawaii electric system reliability.

    SciTech Connect

    Silva Monroy, Cesar Augusto; Loose, Verne William

    2012-09-01

    This report addresses Hawaii electric system reliability issues; greater emphasis is placed on short-term reliability but resource adequacy is reviewed in reference to electric consumers' views of reliability %E2%80%9Cworth%E2%80%9D and the reserve capacity required to deliver that value. The report begins with a description of the Hawaii electric system to the extent permitted by publicly available data. Electrical engineering literature in the area of electric reliability is researched and briefly reviewed. North American Electric Reliability Corporation standards and measures for generation and transmission are reviewed and identified as to their appropriateness for various portions of the electric grid and for application in Hawaii. Analysis of frequency data supplied by the State of Hawaii Public Utilities Commission is presented together with comparison and contrast of performance of each of the systems for two years, 2010 and 2011. Literature tracing the development of reliability economics is reviewed and referenced. A method is explained for integrating system cost with outage cost to determine the optimal resource adequacy given customers' views of the value contributed by reliable electric supply. The report concludes with findings and recommendations for reliability in the State of Hawaii.

  18. Hawaii Electric System Reliability

    SciTech Connect

    Loose, Verne William; Silva Monroy, Cesar Augusto

    2012-08-01

    This report addresses Hawaii electric system reliability issues; greater emphasis is placed on short-term reliability but resource adequacy is reviewed in reference to electric consumers’ views of reliability “worth” and the reserve capacity required to deliver that value. The report begins with a description of the Hawaii electric system to the extent permitted by publicly available data. Electrical engineering literature in the area of electric reliability is researched and briefly reviewed. North American Electric Reliability Corporation standards and measures for generation and transmission are reviewed and identified as to their appropriateness for various portions of the electric grid and for application in Hawaii. Analysis of frequency data supplied by the State of Hawaii Public Utilities Commission is presented together with comparison and contrast of performance of each of the systems for two years, 2010 and 2011. Literature tracing the development of reliability economics is reviewed and referenced. A method is explained for integrating system cost with outage cost to determine the optimal resource adequacy given customers’ views of the value contributed by reliable electric supply. The report concludes with findings and recommendations for reliability in the State of Hawaii.

  19. The Japanese version of the revised Life Orientation Test: reliability and construct validity.

    PubMed

    Sumi, Katsunori

    2004-08-01

    The Japanese translation of the revised Life Orientation Test was completed by 223 Japanese college students. Factor analysis yielded two factors, namely, Optimism and Pessimism. These factor scales showed adequate reliability and construct validity.

  20. Chapter 9: Reliability

    SciTech Connect

    Algora, Carlos; Espinet-Gonzalez, Pilar; Vazquez, Manuel; Bosco, Nick; Miller, David; Kurtz, Sarah; Rubio, Francisca; McConnell,Robert

    2016-04-15

    This chapter describes the accumulated knowledge on CPV reliability with its fundamentals and qualification. It explains the reliability of solar cells, modules (including optics) and plants. The chapter discusses the statistical distributions, namely exponential, normal and Weibull. The reliability of solar cells includes: namely the issues in accelerated aging tests in CPV solar cells, types of failure and failures in real time operation. The chapter explores the accelerated life tests, namely qualitative life tests (mainly HALT) and quantitative accelerated life tests (QALT). It examines other well proven and experienced PV cells and/or semiconductor devices, which share similar semiconductor materials, manufacturing techniques or operating conditions, namely, III-V space solar cells and light emitting diodes (LEDs). It addresses each of the identified reliability issues and presents the current state of the art knowledge for their testing and evaluation. Finally, the chapter summarizes the CPV qualification and reliability standards.

  1. 9 CFR 2.40 - Attending veterinarian and adequate veterinary care (dealers and exhibitors).

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... veterinary care (dealers and exhibitors). 2.40 Section 2.40 Animals and Animal Products ANIMAL AND PLANT... and Adequate Veterinary Care § 2.40 Attending veterinarian and adequate veterinary care (dealers and... veterinary care to its animals in compliance with this section. (1) Each dealer and exhibitor shall employ...

  2. 9 CFR 2.33 - Attending veterinarian and adequate veterinary care.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... veterinary care. 2.33 Section 2.33 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE... adequate veterinary care. (a) Each research facility shall have an attending veterinarian who shall provide adequate veterinary care to its animals in compliance with this section: (1) Each research facility...

  3. 40 CFR 152.20 - Exemptions for pesticides adequately regulated by another Federal agency.

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 40 Protection of Environment 24 2014-07-01 2014-07-01 false Exemptions for pesticides adequately... PROTECTION AGENCY (CONTINUED) PESTICIDE PROGRAMS PESTICIDE REGISTRATION AND CLASSIFICATION PROCEDURES Exemptions § 152.20 Exemptions for pesticides adequately regulated by another Federal agency. The...

  4. 40 CFR 152.20 - Exemptions for pesticides adequately regulated by another Federal agency.

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 40 Protection of Environment 25 2013-07-01 2013-07-01 false Exemptions for pesticides adequately... PROTECTION AGENCY (CONTINUED) PESTICIDE PROGRAMS PESTICIDE REGISTRATION AND CLASSIFICATION PROCEDURES Exemptions § 152.20 Exemptions for pesticides adequately regulated by another Federal agency. The...

  5. 40 CFR 152.20 - Exemptions for pesticides adequately regulated by another Federal agency.

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 40 Protection of Environment 24 2011-07-01 2011-07-01 false Exemptions for pesticides adequately... PROTECTION AGENCY (CONTINUED) PESTICIDE PROGRAMS PESTICIDE REGISTRATION AND CLASSIFICATION PROCEDURES Exemptions § 152.20 Exemptions for pesticides adequately regulated by another Federal agency. The...

  6. 40 CFR 152.20 - Exemptions for pesticides adequately regulated by another Federal agency.

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 40 Protection of Environment 25 2012-07-01 2012-07-01 false Exemptions for pesticides adequately... PROTECTION AGENCY (CONTINUED) PESTICIDE PROGRAMS PESTICIDE REGISTRATION AND CLASSIFICATION PROCEDURES Exemptions § 152.20 Exemptions for pesticides adequately regulated by another Federal agency. The...

  7. 40 CFR 152.20 - Exemptions for pesticides adequately regulated by another Federal agency.

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 40 Protection of Environment 23 2010-07-01 2010-07-01 false Exemptions for pesticides adequately... PROTECTION AGENCY (CONTINUED) PESTICIDE PROGRAMS PESTICIDE REGISTRATION AND CLASSIFICATION PROCEDURES Exemptions § 152.20 Exemptions for pesticides adequately regulated by another Federal agency. The...

  8. 42 CFR 417.568 - Adequate financial records, statistical data, and cost finding.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 42 Public Health 3 2013-10-01 2013-10-01 false Adequate financial records, statistical data, and....568 Adequate financial records, statistical data, and cost finding. (a) Maintenance of records. (1) An HMO or CMP must maintain sufficient financial records and statistical data for proper determination...

  9. 42 CFR 417.568 - Adequate financial records, statistical data, and cost finding.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 42 Public Health 3 2014-10-01 2014-10-01 false Adequate financial records, statistical data, and....568 Adequate financial records, statistical data, and cost finding. (a) Maintenance of records. (1) An HMO or CMP must maintain sufficient financial records and statistical data for proper determination...

  10. 42 CFR 417.568 - Adequate financial records, statistical data, and cost finding.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 42 Public Health 3 2012-10-01 2012-10-01 false Adequate financial records, statistical data, and....568 Adequate financial records, statistical data, and cost finding. (a) Maintenance of records. (1) An HMO or CMP must maintain sufficient financial records and statistical data for proper determination...

  11. 42 CFR 438.207 - Assurances of adequate capacity and services.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 42 Public Health 4 2012-10-01 2012-10-01 false Assurances of adequate capacity and services. 438... Improvement Access Standards § 438.207 Assurances of adequate capacity and services. (a) Basic rule. The State... provides supporting documentation that demonstrates that it has the capacity to serve the...

  12. 42 CFR 438.207 - Assurances of adequate capacity and services.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 42 Public Health 4 2014-10-01 2014-10-01 false Assurances of adequate capacity and services. 438... Improvement Access Standards § 438.207 Assurances of adequate capacity and services. (a) Basic rule. The State... provides supporting documentation that demonstrates that it has the capacity to serve the...

  13. 42 CFR 438.207 - Assurances of adequate capacity and services.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 42 Public Health 4 2011-10-01 2011-10-01 false Assurances of adequate capacity and services. 438... Improvement Access Standards § 438.207 Assurances of adequate capacity and services. (a) Basic rule. The State... provides supporting documentation that demonstrates that it has the capacity to serve the...

  14. 42 CFR 438.207 - Assurances of adequate capacity and services.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 42 Public Health 4 2013-10-01 2013-10-01 false Assurances of adequate capacity and services. 438... Improvement Access Standards § 438.207 Assurances of adequate capacity and services. (a) Basic rule. The State... provides supporting documentation that demonstrates that it has the capacity to serve the...

  15. 9 CFR 2.33 - Attending veterinarian and adequate veterinary care.

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ..., DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Research Facilities § 2.33 Attending veterinarian and adequate veterinary care. (a) Each research facility shall have an attending veterinarian who shall provide adequate veterinary care to its animals in compliance with this section: (1) Each research facility...

  16. 9 CFR 2.33 - Attending veterinarian and adequate veterinary care.

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ..., DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Research Facilities § 2.33 Attending veterinarian and adequate veterinary care. (a) Each research facility shall have an attending veterinarian who shall provide adequate veterinary care to its animals in compliance with this section: (1) Each research facility...

  17. Validity and Reliability of a Scale Assessing Attitudes toward Mainstreaming.

    ERIC Educational Resources Information Center

    Green, Kathy; And Others

    1983-01-01

    In a study involving 50 undergraduate and graduate education students the Attitudes Toward Mainstreaming Scale was found to have a large first factor with adequate reliability. There was a low correlation between knowledge and ATMS scores, although knowledge was more strongly related to classroom acceptance of exceptional students. (CL)

  18. Norming a VALUE rubric to assess graduate information literacy skills

    PubMed Central

    Turbow, David J.; Evener, Julie

    2016-01-01

    Objective The study evaluated whether a modified version of the information literacy Valid Assessment of Learning in Undergraduate Education (VALUE) rubric would be useful for assessing the information literacy skills of graduate health sciences students. Methods Through facilitated calibration workshops, an interdepartmental six-person team of librarians and faculty engaged in guided discussion about the meaning of the rubric criteria. They applied the rubric to score student work for a peer-review essay assignment in the “Information Literacy for Evidence-Based Practice” course. To determine inter-rater reliability, the raters participated in a follow-up exercise in which they independently applied the rubric to ten samples of work from a research project in the doctor of physical therapy program: the patient case report assignment. Results For the peer-review essay, a high level of consistency in scoring was achieved for the second workshop, with statistically significant intra-class correlation coefficients above 0.8 for 3 criteria: “Determine the extent of evidence needed,” “Use evidence effectively to accomplish a specific purpose,” and “Access the needed evidence.” Participants concurred that the essay prompt and rubric criteria adequately discriminated the quality of student work for the peer-review essay assignment. When raters independently scored the patient case report assignment, inter-rater agreement was low and statistically insignificant for all rubric criteria (kappa=−0.16, p>0.05–kappa=0.12, p>0.05). Conclusions While the peer-review essay assignment lent itself well to rubric calibration, scorers had a difficult time with the patient case report. Lack of familiarity among some raters with the specifics of the patient case report assignment and subject matter might have accounted for low inter-rater reliability. When norming, it is important to hold conversations about search strategies and expectations of performance. Overall

  19. Adequate health literacy is associated with higher heart failure knowledge and self-care confidence in hospitalized patients.

    PubMed

    Dennison, Cheryl R; McEntee, Mindy L; Samuel, Laura; Johnson, Brandon J; Rotman, Stacey; Kielty, Alexandra; Russell, Stuart D

    2011-01-01

    Heart failure (HF) patients with inadequate health literacy are at increased risk for poor self-care and negative health outcomes such as hospital readmission. The purpose of the present study was to examine the prevalence of inadequate health literacy, the reliability of the Dutch HF Knowledge Scale (DHFKS) and the Self-care of Heart Failure Index (SCHFI), and the differences in HF knowledge, HF self-care, and 30-day readmission rate by health literacy level among patients hospitalized with HF. The convenience sample included adults (n = 95) admitted to a large, urban, teaching hospital whose primary diagnosis was HF. Measures included the Short Test of Functional Health Literacy in Adults, the DHFKS, the SCHFI, and readmission at 30 days after discharge. The sample was 59 ± 14 years in age, 51% male, and 67% African American; 35% had less than a high school education, 35% were employed, 73% lived with someone who helps with their HF care, and 16% were readmitted within 30 days of index admission. Health literacy was inadequate for 42%, marginal for 19%, and adequate for 39%. Reliability of the DHFKS and SCHFI scales was comparable to prior reports. Mean knowledge score was 11.43 ± 2.26; SCHFI subscale scores were 56.82 ± 17.12 for maintenance, 63.64 ± 18.29 for management, and 65.02 ± 16.34 for confidence. Those with adequate health literacy were younger and had higher education level, HF knowledge scores, and HF self-care confidence compared with those with marginal or inadequate health literacy. Self-care maintenance and management scores and 30-day readmission rate did not differ by health literacy level. These findings demonstrate the high prevalence of inadequate and marginal health literacy and that health literacy is an important consideration in promoting HF knowledge and confidence in self-care behaviors, particularly among older adults and those with less than a high school education.

  20. 45 CFR 1159.15 - Who has the responsibility for maintaining adequate technical, physical, and security safeguards...

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... adequate technical, physical, and security safeguards to prevent unauthorized disclosure or destruction of... adequate technical, physical, and security safeguards to prevent unauthorized disclosure or destruction of... of maintaining adequate technical, physical, and security safeguards to prevent...

  1. 45 CFR 1159.15 - Who has the responsibility for maintaining adequate technical, physical, and security safeguards...

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... adequate technical, physical, and security safeguards to prevent unauthorized disclosure or destruction of... adequate technical, physical, and security safeguards to prevent unauthorized disclosure or destruction of... of maintaining adequate technical, physical, and security safeguards to prevent...

  2. Reliability Analysis Model

    NASA Technical Reports Server (NTRS)

    1970-01-01

    RAM program determines probability of success for one or more given objectives in any complex system. Program includes failure mode and effects, criticality and reliability analyses, and some aspects of operations, safety, flight technology, systems design engineering, and configuration analyses.

  3. The rating reliability calculator

    PubMed Central

    Solomon, David J

    2004-01-01

    Background Rating scales form an important means of gathering evaluation data. Since important decisions are often based on these evaluations, determining the reliability of rating data can be critical. Most commonly used methods of estimating reliability require a complete set of ratings i.e. every subject being rated must be rated by each judge. Over fifty years ago Ebel described an algorithm for estimating the reliability of ratings based on incomplete data. While his article has been widely cited over the years, software based on the algorithm is not readily available. This paper describes an easy-to-use Web-based utility for estimating the reliability of ratings based on incomplete data using Ebel's algorithm. Methods The program is available public use on our server and the source code is freely available under GNU General Public License. The utility is written in PHP, a common open source imbedded scripting language. The rating data can be entered in a convenient format on the user's personal computer that the program will upload to the server for calculating the reliability and other statistics describing the ratings. Results When the program is run it displays the reliability, number of subject rated, harmonic mean number of judges rating each subject, the mean and standard deviation of the averaged ratings per subject. The program also displays the mean, standard deviation and number of ratings for each subject rated. Additionally the program will estimate the reliability of an average of a number of ratings for each subject via the Spearman-Brown prophecy formula. Conclusion This simple web-based program provides a convenient means of estimating the reliability of rating data without the need to conduct special studies in order to provide complete rating data. I would welcome other researchers revising and enhancing the program. PMID:15117416

  4. Multidisciplinary System Reliability Analysis

    NASA Technical Reports Server (NTRS)

    Mahadevan, Sankaran; Han, Song; Chamis, Christos C. (Technical Monitor)

    2001-01-01

    The objective of this study is to develop a new methodology for estimating the reliability of engineering systems that encompass multiple disciplines. The methodology is formulated in the context of the NESSUS probabilistic structural analysis code, developed under the leadership of NASA Glenn Research Center. The NESSUS code has been successfully applied to the reliability estimation of a variety of structural engineering systems. This study examines whether the features of NESSUS could be used to investigate the reliability of systems in other disciplines such as heat transfer, fluid mechanics, electrical circuits etc., without considerable programming effort specific to each discipline. In this study, the mechanical equivalence between system behavior models in different disciplines are investigated to achieve this objective. A new methodology is presented for the analysis of heat transfer, fluid flow, and electrical circuit problems using the structural analysis routines within NESSUS, by utilizing the equivalence between the computational quantities in different disciplines. This technique is integrated with the fast probability integration and system reliability techniques within the NESSUS code, to successfully compute the system reliability of multidisciplinary systems. Traditional as well as progressive failure analysis methods for system reliability estimation are demonstrated, through a numerical example of a heat exchanger system involving failure modes in structural, heat transfer and fluid flow disciplines.

  5. Metrology automation reliability

    NASA Astrophysics Data System (ADS)

    Chain, Elizabeth E.

    1996-09-01

    At Motorola's MOS-12 facility automated measurements on 200- mm diameter wafers proceed in a hands-off 'load-and-go' mode requiring only wafer loading, measurement recipe loading, and a 'run' command for processing. Upon completion of all sample measurements, the data is uploaded to the factory's data collection software system via a SECS II interface, eliminating the requirement of manual data entry. The scope of in-line measurement automation has been extended to the entire metrology scheme from job file generation to measurement and data collection. Data analysis and comparison to part specification limits is also carried out automatically. Successful integration of automated metrology into the factory measurement system requires that automated functions, such as autofocus and pattern recognition algorithms, display a high degree of reliability. In the 24- hour factory reliability data can be collected automatically on every part measured. This reliability data is then uploaded to the factory data collection software system at the same time as the measurement data. Analysis of the metrology reliability data permits improvements to be made as needed, and provides an accurate accounting of automation reliability. This reliability data has so far been collected for the CD-SEM (critical dimension scanning electron microscope) metrology tool, and examples are presented. This analysis method can be applied to such automated in-line measurements as CD, overlay, particle and film thickness measurements.

  6. Inferential Processing among Adequate and Struggling Adolescent Comprehenders and Relations to Reading Comprehension

    PubMed Central

    Barth, Amy E.; Barnes, Marcia; Francis, David J.; Vaughn, Sharon; York, Mary

    2015-01-01

    Separate mixed model analyses of variance (ANOVA) were conducted to examine the effect of textual distance on the accuracy and speed of text consistency judgments among adequate and struggling comprehenders across grades 6–12 (n = 1203). Multiple regressions examined whether accuracy in text consistency judgments uniquely accounted for variance in comprehension. Results suggest that there is considerable growth across the middle and high school years, particularly for adequate comprehenders in those text integration processes that maintain local coherence. Accuracy in text consistency judgments accounted for significant unique variance for passage-level, but not sentence-level comprehension, particularly for adequate comprehenders. PMID:26166946

  7. Evaluation of arthroscopy and macroscopic scoring

    PubMed Central

    af Klint, Erik; Catrina, Anca I; Matt, Peter; Neregråd, Petra; Lampa, Jon; Ulfgren, Ann-Kristin; Klareskog, Lars; Lindblad, Staffan

    2009-01-01

    Introduction Arthroscopy is a minimally invasive technique for retrieving synovial biopsies in rheumatology during the past 20 years. Vital for its use is continual evaluation of its safety and efficacy. Important for sampling is the fact of intraarticular variation for synovial markers. For microscopic measurements scoring systems have been developed and validated, but for macroscopic evaluations there is a need for further comprehensive description and validation of equivalent scoring systems. Methods We studied the complication rate and yield of arthroscopies performed at our clinic between 1998 and 2005. We also created and evaluated a macroscopic score set of instructions for synovitis. Results Of 408 procedures, we had two major and one minor complication; two haemarthrosis and one wound infection, respectively. Pain was most often not a problem, but 12 procedures had to be prematurely ended due to pain. Yield of biopsies adequate for histology were 83% over all, 94% for knee joints and 34% for smaller joints. Video printer photographs of synovium taken during arthroscopy were jointly and individually reviewed by seven raters in several settings, and intra and inter rater variation was calculated. A macroscopic synovial scoring system for arthroscopy was created (Macro-score), based upon hypertrophy, vascularity and global synovitis. These written instructions were evaluated by five control-raters, and when evaluated individual parameters were without greater intra or inter rater variability, indicating that the score is reliable and easy to use. Conclusions In our hands rheumatologic arthroscopy is a safe method with very few complications. For knee joints it is a reliable method to retrieve representative tissue in clinical longitudinal studies. We also created an easy to use macroscopic score, that needs to be validated against other methodologies. We hope it will be of value in further developing international standards in this area. PMID:19490631

  8. Target Window Reliability

    SciTech Connect

    Woloshun, Keith Albert

    2016-02-11

    The target window design implemented and tested in experiments at ANL have performed without failure for the available beam of 6 mm FWHM on a 12 mm diameter target. However, scaling that design to a 25 mm diameter target size for a 12 mm FWHM beam has proven problematic. Combined thermal and mechanical (pressure induced) stresses and strains are too high to maintain the small coolant gaps and provide adequate fatigue lifetime.

  9. Region 8: Colorado Lamar and Steamboat Springs Adequate Letter (11/12/2002)

    EPA Pesticide Factsheets

    This letter from EPA to Colorado Department of Public Health and Environment determined Lamar and Steamboat Springs particulate matter (PM10) maintenance plan for Motor Vehicle Emissions Budgets adequate for transportation conformity purposes

  10. 75 FR 5893 - Suspension of Community Eligibility for Failure To Maintain Adequate Floodplain Management...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-02-05

    ... To Maintain Adequate Floodplain Management Regulations AGENCY: Federal Emergency Management Agency... floodplain management regulations meeting minimum requirements under the National Flood Insurance Program... they have brought their floodplain management regulations into compliance with the NFIP...

  11. Region 9: California Adequate / Inadequate Letter Attachment (5/30/2008)

    EPA Pesticide Factsheets

    This is a document that states that it has been found adequate for transportation conformitypurposes certain 8-hour ozone and PM2.5 motor vehicleemissions budgets in the 2007 South Coast StateImplementation Plan.

  12. Statistical modelling of software reliability

    NASA Technical Reports Server (NTRS)

    Miller, Douglas R.

    1991-01-01

    During the six-month period from 1 April 1991 to 30 September 1991 the following research papers in statistical modeling of software reliability appeared: (1) A Nonparametric Software Reliability Growth Model; (2) On the Use and the Performance of Software Reliability Growth Models; (3) Research and Development Issues in Software Reliability Engineering; (4) Special Issues on Software; and (5) Software Reliability and Safety.

  13. Photovoltaic module reliability workshop

    SciTech Connect

    Mrig, L.

    1990-01-01

    The paper and presentations compiled in this volume form the Proceedings of the fourth in a series of Workshops sponsored by Solar Energy Research Institute (SERI/DOE) under the general theme of photovoltaic module reliability during the period 1986--1990. The reliability Photo Voltaic (PV) modules/systems is exceedingly important along with the initial cost and efficiency of modules if the PV technology has to make a major impact in the power generation market, and for it to compete with the conventional electricity producing technologies. The reliability of photovoltaic modules has progressed significantly in the last few years as evidenced by warranties available on commercial modules of as long as 12 years. However, there is still need for substantial research and testing required to improve module field reliability to levels of 30 years or more. Several small groups of researchers are involved in this research, development, and monitoring activity around the world. In the US, PV manufacturers, DOE laboratories, electric utilities and others are engaged in the photovoltaic reliability research and testing. This group of researchers and others interested in this field were brought together under SERI/DOE sponsorship to exchange the technical knowledge and field experience as related to current information in this important field. The papers presented here reflect this effort.

  14. Photovoltaic module reliability workshop

    NASA Astrophysics Data System (ADS)

    Mrig, L.

    The paper and presentations compiled in this volume form the Proceedings of the fourth in a series of Workshops sponsored by Solar Energy Research Institute (SERI/DOE) under the general theme of photovoltaic module reliability during the period 1986 to 1990. The reliability photovoltaic (PV) modules/systems is exceedingly important along with the initial cost and efficiency of modules if the PV technology has to make a major impact in the power generation market, and for it to compete with the conventional electricity producing technologies. The reliability of photovoltaic modules has progressed significantly in the last few years as evidenced by warrantees available on commercial modules of as long as 12 years. However, there is still need for substantial research and testing required to improve module field reliability to levels of 30 years or more. Several small groups of researchers are involved in this research, development, and monitoring activity around the world. In the U.S., PV manufacturers, DOE laboratories, electric utilities and others are engaged in the photovoltaic reliability research and testing. This group of researchers and others interested in this field were brought together under SERI/DOE sponsorship to exchange the technical knowledge and field experience as related to current information in this important field. The papers presented here reflect this effort.

  15. Orbiter Autoland reliability analysis

    NASA Technical Reports Server (NTRS)

    Welch, D. Phillip

    1993-01-01

    The Space Shuttle Orbiter is the only space reentry vehicle in which the crew is seated upright. This position presents some physiological effects requiring countermeasures to prevent a crewmember from becoming incapacitated. This also introduces a potential need for automated vehicle landing capability. Autoland is a primary procedure that was identified as a requirement for landing following and extended duration orbiter mission. This report documents the results of the reliability analysis performed on the hardware required for an automated landing. A reliability block diagram was used to evaluate system reliability. The analysis considers the manual and automated landing modes currently available on the Orbiter. (Autoland is presently a backup system only.) Results of this study indicate a +/- 36 percent probability of successfully extending a nominal mission to 30 days. Enough variations were evaluated to verify that the reliability could be altered with missions planning and procedures. If the crew is modeled as being fully capable after 30 days, the probability of a successful manual landing is comparable to that of Autoland because much of the hardware is used for both manual and automated landing modes. The analysis indicates that the reliability for the manual mode is limited by the hardware and depends greatly on crew capability. Crew capability for a successful landing after 30 days has not been determined yet.

  16. Proposed reliability cost model

    NASA Technical Reports Server (NTRS)

    Delionback, L. M.

    1973-01-01

    The research investigations which were involved in the study include: cost analysis/allocation, reliability and product assurance, forecasting methodology, systems analysis, and model-building. This is a classic example of an interdisciplinary problem, since the model-building requirements include the need for understanding and communication between technical disciplines on one hand, and the financial/accounting skill categories on the other. The systems approach is utilized within this context to establish a clearer and more objective relationship between reliability assurance and the subcategories (or subelements) that provide, or reenforce, the reliability assurance for a system. Subcategories are further subdivided as illustrated by a tree diagram. The reliability assurance elements can be seen to be potential alternative strategies, or approaches, depending on the specific goals/objectives of the trade studies. The scope was limited to the establishment of a proposed reliability cost-model format. The model format/approach is dependent upon the use of a series of subsystem-oriented CER's and sometimes possible CTR's, in devising a suitable cost-effective policy.

  17. Individual and contextual determinants of adequate maternal health care services in Kenya.

    PubMed

    Achia, Thomas N O; Mageto, Lillian E

    2015-01-01

    This study aimed to examine individual and community level factors associated with adequate use of maternal antenatal health services in Kenya. Individual and community level factors associated with adequate use of maternal health care (MHC) services were obtained from the 2008-09 Kenya Demographic and Health Survey data set. Multilevel partial-proportional odds logit models were fitted using STATA 13.0 to quantify the relations of the selected covariates to adequate MHC use, defined as a three-category ordinal variable. The sample consisted of 3,621 women who had at least one live birth in the five-year period preceding this survey. Only 18 percent of the women had adequate use of MHC services. Greater educational attainment by the woman or her partner, higher socioeconomic status, access to medical insurance coverage, and greater media exposure were the individual-level factors associated with adequate use of MHC services. Greater community ethnic diversity, higher community-level socioeconomic status, and greater community-level health facility deliveries were the contextual-level factors associated with adequate use of MHC. To improve the use of MHC services in Kenya, the government needs to design and implement programs that target underlying individual and community level factors, providing focused and sustained health education to promote the use of antenatal, delivery, and postnatal care.

  18. Reliability Centered Maintenance - Methodologies

    NASA Technical Reports Server (NTRS)

    Kammerer, Catherine C.

    2009-01-01

    Journal article about Reliability Centered Maintenance (RCM) methodologies used by United Space Alliance, LLC (USA) in support of the Space Shuttle Program at Kennedy Space Center. The USA Reliability Centered Maintenance program differs from traditional RCM programs because various methodologies are utilized to take advantage of their respective strengths for each application. Based on operational experience, USA has customized the traditional RCM methodology into a streamlined lean logic path and has implemented the use of statistical tools to drive the process. USA RCM has integrated many of the L6S tools into both RCM methodologies. The tools utilized in the Measure, Analyze, and Improve phases of a Lean Six Sigma project lend themselves to application in the RCM process. All USA RCM methodologies meet the requirements defined in SAE JA 1011, Evaluation Criteria for Reliability-Centered Maintenance (RCM) Processes. The proposed article explores these methodologies.

  19. Reliability and Validity of a Self-Concept Scale for Researchers in Family Relationships

    ERIC Educational Resources Information Center

    Rathus, Spencer A.; Siegel, Larry J.

    1976-01-01

    Self-concept questionnaire was shown to have high test-retest reliability, but only fair to moderate split-half (odd-even) reliability. Validity was adequate. The scale will serve as a heuristic device for family counselors who require a rapid assessment of a child's self-esteem. (Author)

  20. Reliability Analyses for the ADSI: Test-Retest and Internal Consistency

    ERIC Educational Resources Information Center

    Corrigan, M. J.; Gurdineer, E. E.

    2012-01-01

    Objective: This article reports on two separate studies of reliability of the Adolescent Domain Screening Inventory (ADSI), test-retest and internal consistency analyses. The ADSI has shown adequate validity, although reliability has not been established. Methods: Study 1: Students were recruited from two undergraduate courses (N = 29).…

  1. Gearbox Reliability Collaborative Update (Presentation)

    SciTech Connect

    Sheng, S.; Keller, J.; Glinsky, C.

    2013-10-01

    This presentation was given at the Sandia Reliability Workshop in August 2013 and provides information on current statistics, a status update, next steps, and other reliability research and development activities related to the Gearbox Reliability Collaborative.

  2. Reliability Engineering Handbook

    DTIC Science & Technology

    1964-06-01

    INTEVAL 00 0 542 917 1953 OPERATING TIME IN HOURS Figure 6-4. TWT Reliability Function, Showing the 90% Confidence Interval 6-7 6-2-4 to 6-2-5 NAVWEPS...the lower one-sided 90% greater than 977 hours, or 90% confidence confidence limit on 0 is (.704)(530) = 373 that 0 lies between these two bounds . R...6-4 6-2-2 Measurement of Reliability (Application of Confidence Limits).. 6-4 6-2-3 Procedural Steps

  3. How Effective Are Self- and Peer Assessment of Oral Presentation Skills Compared with Teachers' Assessments?

    ERIC Educational Resources Information Center

    De Grez, Luc; Valcke, Martin; Roozen, Irene

    2012-01-01

    Assessment of oral presentation skills is an underexplored area. The study described here focuses on the agreement between professional assessment and self- and peer assessment of oral presentation skills and explores student perceptions about peer assessment. The study has the merit of paying attention to the inter-rater reliability of the…

  4. A Comparative Study of ESL Writers' Performance in a Paper-Based and a Computer-Delivered Writing Test

    ERIC Educational Resources Information Center

    Lee, H. K.

    2004-01-01

    This study aimed to comprehensively investigate the impact of a word-processor on an ESL writing assessment, covering comparison of inter-rater reliability, the quality of written products, the writing process across different testing occasions using different writing media, and students' perception of a computer-delivered test. Writing samples of…

  5. Development of a Chinese Version of the Suicide Intent Scale

    ERIC Educational Resources Information Center

    Gau, Susan S. F.; Chen, Chin-Hung; Lee, Charles T. C.; Chang, Jung-Chen; Cheng, Andrew T. A.

    2009-01-01

    This study established the psychometric properties of the Chinese version of the Suicide Intent Scale (SIS) in a clinic- and community-based sample of 36 patients and 592 respondents, respectively. Results showed that the Chinese SIS demonstrated good inter-rater and test-retest reliability. Factor analysis generated three factors (Precautions,…

  6. Development and validation of standard area diagrams to aide assessment of pecan scab symptoms on pecan fruit

    Technology Transfer Automated Retrieval System (TEKTRAN)

    Pecan scab (Fusicladium effusum) causes losses of pecan nutmeat yield and quality in the southeastern U.S. Disease assessment relies on visual rating, which can be inaccurate, imprecise with poor inter-rater reliability. A standard area diagram (SAD) set for pecan scab on fruit valves was develope...

  7. Does a Rater's Familiarity with a Candidate's Pronunciation Affect the Rating in Oral Proficiency Interviews?

    ERIC Educational Resources Information Center

    Carey, Michael D.; Mannell, Robert H.; Dunn, Peter K.

    2011-01-01

    This study investigated factors that could affect inter-examiner reliability in the pronunciation assessment component of speaking tests. We hypothesized that the rating of pronunciation is susceptible to variation in assessment due to the amount of exposure examiners have to nonnative English accents. An inter-rater variability analysis was…

  8. The Development and Initial Testing of the AIM2 Framework to Assess Risk and Strengths in Young People Who Sexually Offend

    ERIC Educational Resources Information Center

    Griffin, Helen Louise; Beech, Anthony; Print, Bobbie; Bradshaw, Helen; Quayle, Jeremy

    2008-01-01

    This paper describes the AIM2 assessment framework and the process of its development and initial testing. AIM2 is used to assess areas of concerns and strengths of young people. Some preliminary analysis is described, including the correlation of assessment items, their ability to discriminate between cases, their inter-rater reliability and a…

  9. Preliminary Findings on the Health of the Nation Outcome Scales for Children and Adolescents in an Inpatient Secure Adolescent Unit

    ERIC Educational Resources Information Center

    Hunt, Jenny; Wheatley, Malcolm

    2009-01-01

    To date there is limited research examining the use of the Health of the Nation Outcome Scales for Children and Adolescents (HoNOSCA) with adolescents in secure care. The aim of this article is to examine the inter-rater reliability, concurrent validity and clinical utility of HoNOSCA in an adolescent secure psychiatric unit. Twenty-four…

  10. Validity of the Consensual Assessment Technique--Evidence with Three Groups of Judges and an Elementary School Student Sample

    ERIC Educational Resources Information Center

    Long, Haiying

    2012-01-01

    As one of the most widely used creativity assessment tools, the Consensual Assessment Technique (CAT) has been praised as a valid tool to assess creativity. In Amabile's (1982) seminal work, the inter-rater reliability was defined as construct validity of the CAT. During the past three decades, researchers followed this definition and…

  11. Assuring Software Reliability

    DTIC Science & Technology

    2014-08-01

    resources.sei.cmu.edu/asset_files/WhitePaper/2009_019_001_29066.pdf [Boydston 2009] Boydston, A. & Lewis , W. Qualification and Reliability of...Woody, Carol . Survivability Analysis Framework (CMU/SEI-2010-TN-013). Software Engineering Institute, Carnegie Mellon University, 2010. http

  12. Parametric Mass Reliability Study

    NASA Technical Reports Server (NTRS)

    Holt, James P.

    2014-01-01

    The International Space Station (ISS) systems are designed based upon having redundant systems with replaceable orbital replacement units (ORUs). These ORUs are designed to be swapped out fairly quickly, but some are very large, and some are made up of many components. When an ORU fails, it is replaced on orbit with a spare; the failed unit is sometimes returned to Earth to be serviced and re-launched. Such a system is not feasible for a 500+ day long-duration mission beyond low Earth orbit. The components that make up these ORUs have mixed reliabilities. Components that make up the most mass-such as computer housings, pump casings, and the silicon board of PCBs-typically are the most reliable. Meanwhile components that tend to fail the earliest-such as seals or gaskets-typically have a small mass. To better understand the problem, my project is to create a parametric model that relates both the mass of ORUs to reliability, as well as the mass of ORU subcomponents to reliability.

  13. Sequential Reliability Tests.

    ERIC Educational Resources Information Center

    Eiting, Mindert H.

    1991-01-01

    A method is proposed for sequential evaluation of reliability of psychometric instruments. Sample size is unfixed; a test statistic is computed after each person is sampled and a decision is made in each stage of the sampling process. Results from a series of Monte-Carlo experiments establish the method's efficiency. (SLD)

  14. Designing reliability into accelerators

    SciTech Connect

    Hutton, A.

    1992-08-01

    For the next generation of high performance, high average luminosity colliders, the ``factories,`` reliability engineering must be introduced right at the inception of the project and maintained as a central theme throughout the project. There are several aspects which will be addressed separately: Concept; design; motivation; management techniques; and fault diagnosis.

  15. Designing reliability into accelerators

    SciTech Connect

    Hutton, A.

    1992-08-01

    For the next generation of high performance, high average luminosity colliders, the factories,'' reliability engineering must be introduced right at the inception of the project and maintained as a central theme throughout the project. There are several aspects which will be addressed separately: Concept; design; motivation; management techniques; and fault diagnosis.

  16. Reliable solar cookers

    SciTech Connect

    Magney, G.K.

    1992-12-31

    The author describes the activities of SERVE, a Christian relief and development agency, to introduce solar ovens to the Afghan refugees in Pakistan. It has provided 5,000 solar cookers since 1984. The experience has demonstrated the potential of the technology and the need for a durable and reliable product. Common complaints about the cookers are discussed and the ideal cooker is described.

  17. Software reliability report

    NASA Technical Reports Server (NTRS)

    Wilson, Larry

    1991-01-01

    There are many software reliability models which try to predict future performance of software based on data generated by the debugging process. Unfortunately, the models appear to be unable to account for the random nature of the data. If the same code is debugged multiple times and one of the models is used to make predictions, intolerable variance is observed in the resulting reliability predictions. It is believed that data replication can remove this variance in lab type situations and that it is less than scientific to talk about validating a software reliability model without considering replication. It is also believed that data replication may prove to be cost effective in the real world, thus the research centered on verification of the need for replication and on methodologies for generating replicated data in a cost effective manner. The context of the debugging graph was pursued by simulation and experimentation. Simulation was done for the Basic model and the Log-Poisson model. Reasonable values of the parameters were assigned and used to generate simulated data which is then processed by the models in order to determine limitations on their accuracy. These experiments exploit the existing software and program specimens which are in AIR-LAB to measure the performance of reliability models.

  18. Reliability Design Handbook

    DTIC Science & Technology

    1976-03-01

    prediction, failure modes and effects analysis ( FMEA ) and reliability growth techniques represent those prediction and design evaluation methods that...Assessment Production Operation Ö Maintenance MIL-HDBK- 217 Bayesian Techniques Probabilistic Design FMEA I R Growth " I...devices suffer thermal aging; oxidation and other chemical reactions are enhanced; viscosity reduction and evaporation of lubricants are problems

  19. Reliability Generalization (RG) Analysis: The Test Is Not Reliable

    ERIC Educational Resources Information Center

    Warne, Russell

    2008-01-01

    Literature shows that most researchers are unaware of some of the characteristics of reliability. This paper clarifies some misconceptions by describing the procedures, benefits, and limitations of reliability generalization while using it to illustrate the nature of score reliability. Reliability generalization (RG) is a meta-analytic method…

  20. Importance of adequate exercise in the detection of coronary heart disease by radionuclide ventriculography

    SciTech Connect

    Brady, T.J.; Thrall, J.H.; Lo, K.; Pitt, B.

    1980-12-01

    Rest and exercise radionuclide ventriculograms were obtained on 77 symptomatic patients without prior documented coronary artery disease (CAD). Coronary artery disease was present by angiograms in 48. Radionuclide ventriculography (RNV) was abnormal in 41 patients (overall sensitivity 85%). In 29 patients with normal coronary arteries, RNV was normal in 24 (specificity 83%). To determine if the exercise level affects sensitivity, the studies were graded for adequacy of exercise. It was considered adequate if patients developed (a) chest pain, or (b) ST segment depression of at least 1 mm, or (c) if they achieved a pressure rate product greater than 250. Among the 48 patients with coronary artery disease, 35 achieved adequate exercise. Thirty-three had an abnormal RNV (sensitivity 94%). In 13 patients who failed to achieve adequate exercise, RNV was abnormal in eight (sensitivity of only 62%). Some patients with coronary artery disease may have a normal ventricular response at inadequate levels of stress.

  1. [Prevention of ocular complications of herpes zoster ophthalmicus by adequate treatment with acyclovir].

    PubMed

    Borruat, F X; Buechi, E R; Piguet, B; Fitting, P; Zografos, L; Herbort, C P

    1991-05-01

    We compared the frequency of severe ocular complications secondary to Herpes Zoster Ophthalmicus (HZO) in 232 patients. They were divided into three groups: 1) patients without treatment (n = 164); 2) patients treated adequately (n = 48) with acyclovir (ACV; 5 x 800 mg/d orally and ophthalmic ointment 5 x /d for a minimum of 7 days, given within three days after skin eruption); and, 3) patients treated inadequately (n = 20) with ACV (only topical treatment, insufficient doses, interrupted treatment, delayed treatment). Patients with no treatment or with inadequate treatments showed the same frequency of severe ocular complications (21% (34/164) and 25% (5/20), respectively). In contrast, when adequate treatment of ACV was given complications occurred in only 4% (2/48) of cases. This study emphasizes the need for prompt (within three days after skin eruption) and adequate (5 x 800 mg/d for at least 7 days) treatment of ACV to prevent the severe complications of HZO.

  2. In vitro validation of a hand-held optical reflectometer to measure clinically observed erosive tooth wear.

    PubMed

    Carvalho, Thiago Saads; Assunção, Cristiane Meira; Jost, Fabian; Bürgin, Walter Bruno; Rodrigues, Jonas Almeida; Lussi, Adrian

    2016-08-01

    In this study, we analyzed a newly developed optical reflectometer for measuring erosive tooth wear (ETW) in vitro. Three examiners independently assessed the labial surface of 80 deciduous canines and 75 permanent incisors. One examiner performed visual examinations (BEWE), and the other two used the optical pen-size reflectometer to measure surface reflection intensity (SRI) on the same labial surfaces. The examinations were made in duplicate with at least 1 week interval. Intra- and inter-rater agreements were calculated using weighted kappa analysis for BEWE, and intra-class correlation coefficients (ICC) as well as Bland-Altman plots for SRI. The teeth were separated into without (BEWE 0) or with (BEWE 1-3) ETW, and SRI cut-off points were calculated. Intra-rater agreement for the visual examination was 0.46 and 0.82 for deciduous and permanent teeth, respectively. Inter-rater and intra-rater agreement for SRI were good (ICC > 0.7; p < 0.001). SRI measurements produced high specificity values for deciduous and permanent teeth (≥0.74 and ≥ 0.84, respectively), and lower sensitivity values (≥0.37 and ≥ 0.64, respectively), but permanent teeth had generally higher SRI values (p < 0.05). We observed a significant association between BEWE and SRI (p < 0.05). The optical pen-size reflectometer was able to adequately differentiate ETW on permanent teeth, with highly reliable and reproducible measurements, but ETW on deciduous teeth was less accurately differentiated. The reflectometer is a good candidate for clinical research.

  3. Broadband inversion of 1J(CC) responses in 1,n-ADEQUATE spectra.

    PubMed

    Reibarkh, Mikhail; Williamson, R Thomas; Martin, Gary E; Bermel, Wolfgang

    2013-11-01

    Establishing the carbon skeleton of a molecule greatly facilitates the process of structure elucidation, both manual and computer-assisted. Recent advances in the family of ADEQUATE experiments demonstrated their potential in this regard. 1,1-ADEQUATE, which provides direct (13)C-(13)C correlation via (1)J(CC), and 1,n-ADEQUATE, which typically yields (3)J(CC) and (1)J(CC) correlations, are more sensitive and more widely applicable experiments than INADEQUATE and PANACEA. A recently reported modified pulse sequence that semi-selectively inverts (1)J(CC) correlations in 1,n-ADEQUATE spectra provided a significant improvement, allowing (1)J(CC) and (n)J(CC) correlations to be discerned in the same spectrum. However, the reported experiment requires a careful matching of the amplitude transfer function with (1)J(CC) coupling constants in order to achieve the inversion, and even then some (1)J(CC) correlations could still have positive intensity due to the oscillatory nature of the transfer function. Both shortcomings limit the practicality of the method. We now report a new, dual-optimized inverted (1)J(CC) 1,n-ADEQUATE experiment, which provides more uniform inversion of (1)J(CC) correlations across the range of 29-82 Hz. Unlike the original method, the dual optimization experiment does not require fine-tuning for the molecule's (1)J(CC) coupling constant values. Even more usefully, the dual-optimized version provides up to two-fold improvement in signal-to-noise for some long-range correlations. Using modern, cryogenically-cooled probes, the experiment can be successfully applied to samples of ~1 mg under favorable circumstances. The improvements afforded by dual optimization inverted (1)J(CC) 1,n-ADEQUATE experiment make it a useful and practical tool for NMR structure elucidation and should facilitate the implementation and utilization of the experiment.

  4. Space Shuttle Propulsion System Reliability

    NASA Technical Reports Server (NTRS)

    Welzyn, Ken; VanHooser, Katherine; Moore, Dennis; Wood, David

    2011-01-01

    This session includes the following sessions: (1) External Tank (ET) System Reliability and Lessons, (2) Space Shuttle Main Engine (SSME), Reliability Validated by a Million Seconds of Testing, (3) Reusable Solid Rocket Motor (RSRM) Reliability via Process Control, and (4) Solid Rocket Booster (SRB) Reliability via Acceptance and Testing.

  5. Self-reported segregation experience throughout the life course and its association with adequate health literacy.

    PubMed

    Goodman, Melody S; Gaskin, Darrell J; Si, Xuemei; Stafford, Jewel D; Lachance, Christina; Kaphingst, Kimberly A

    2012-09-01

    Residential segregation has been shown to be associated with health outcomes and health care utilization. We examined the association between racial composition of five physical environments throughout the life course and adequate health literacy among 836 community health center patients in Suffolk County, NY. Respondents who attended a mostly White junior high school or currently lived in a mostly White neighborhood were more likely to have adequate health literacy compared to those educated or living in predominantly minority or diverse environments. This association was independent of the respondent's race, ethnicity, age, education, and country of birth.

  6. Self-reported segregation experience throughout the life course and its association with adequate health literacy

    PubMed Central

    Gaskin, Darrell J.; Si, Xuemei; Stafford, Jewel D.; Lachance, Christina; Kaphingst, Kimberly A.

    2012-01-01

    Residential segregation has been shown to be associated with health outcomes and health care utilization. We examined the association between racial composition of five physical environments throughout the life course and adequate health literacy among 836 community health center patients in Suffolk County, NY. Respondents who attended a mostly White junior high school or currently lived in a mostly White neighborhood were more likely to have adequate health literacy compared to those educated or living in predominantly minority or diverse environments. This association was independent of the respondent’s race, ethnicity, age, education, and country of birth. PMID:22658579

  7. Development of workplace-based assessments of non-technical skills in anaesthesia.

    PubMed

    Crossingham, G V; Sice, P J A; Roberts, M J; Lam, W H; Gale, T C E

    2012-02-01

    Non-technical skills are recognised as crucial to good anaesthetic practice. We designed and evaluated a specialty-specific tool to assess non-technical aspects of trainee performance in theatre, based on a system previously found reliable in a recruitment setting. We compared inter-rater agreement (multir-ater kappa) for live assessments in theatre with that in a selection centre and a video-based rater training exercise. Twenty-seven trainees participated in the first in-theatre assessment round and 40 in the second. Round- 1 scores had poor inter-rater agreement (mean kappa = 0.20) and low reliability (generalisability coefficient G = 0.50). A subsequent assessor training exercise showed good inter-rater agreement, (mean kappa = 0.79) but did not improve performance of the assessment tool when used in round 2 (mean kappa = 0.14, G = 0.42). Inter-rater agreement in two selection centres (mean kappa = 0.61 and 0.69) exceeded that found in theatre. Assessment tools that perform reliably in controlled settings may not do so in the workplace.

  8. Human Reliability Program Workshop

    SciTech Connect

    Landers, John; Rogers, Erin; Gerke, Gretchen

    2014-05-18

    A Human Reliability Program (HRP) is designed to protect national security as well as worker and public safety by continuously evaluating the reliability of those who have access to sensitive materials, facilities, and programs. Some elements of a site HRP include systematic (1) supervisory reviews, (2) medical and psychological assessments, (3) management evaluations, (4) personnel security reviews, and (4) training of HRP staff and critical positions. Over the years of implementing an HRP, the Department of Energy (DOE) has faced various challenges and overcome obstacles. During this 4-day activity, participants will examine programs that mitigate threats to nuclear security and the insider threat to include HRP, Nuclear Security Culture (NSC) Enhancement, and Employee Assistance Programs. The focus will be to develop an understanding of the need for a systematic HRP and to discuss challenges and best practices associated with mitigating the insider threat.

  9. Reliable broadcast protocols

    NASA Technical Reports Server (NTRS)

    Joseph, T. A.; Birman, Kenneth P.

    1989-01-01

    A number of broadcast protocols that are reliable subject to a variety of ordering and delivery guarantees are considered. Developing applications that are distributed over a number of sites and/or must tolerate the failures of some of them becomes a considerably simpler task when such protocols are available for communication. Without such protocols the kinds of distributed applications that can reasonably be built will have a very limited scope. As the trend towards distribution and decentralization continues, it will not be surprising if reliable broadcast protocols have the same role in distributed operating systems of the future that message passing mechanisms have in the operating systems of today. On the other hand, the problems of engineering such a system remain large. For example, deciding which protocol is the most appropriate to use in a certain situation or how to balance the latency-communication-storage costs is not an easy question.

  10. Compact, Reliable EEPROM Controller

    NASA Technical Reports Server (NTRS)

    Katz, Richard; Kleyner, Igor

    2010-01-01

    A compact, reliable controller for an electrically erasable, programmable read-only memory (EEPROM) has been developed specifically for a space-flight application. The design may be adaptable to other applications in which there are requirements for reliability in general and, in particular, for prevention of inadvertent writing of data in EEPROM cells. Inadvertent writes pose risks of loss of reliability in the original space-flight application and could pose such risks in other applications. Prior EEPROM controllers are large and complex and do not provide all reasonable protections (in many cases, few or no protections) against inadvertent writes. In contrast, the present controller provides several layers of protection against inadvertent writes. The controller also incorporates a write-time monitor, enabling determination of trends in the performance of an EEPROM through all phases of testing. The controller has been designed as an integral subsystem of a system that includes not only the controller and the controlled EEPROM aboard a spacecraft but also computers in a ground control station, relatively simple onboard support circuitry, and an onboard communication subsystem that utilizes the MIL-STD-1553B protocol. (MIL-STD-1553B is a military standard that encompasses a method of communication and electrical-interface requirements for digital electronic subsystems connected to a data bus. MIL-STD- 1553B is commonly used in defense and space applications.) The intent was to both maximize reliability while minimizing the size and complexity of onboard circuitry. In operation, control of the EEPROM is effected via the ground computers, the MIL-STD-1553B communication subsystem, and the onboard support circuitry, all of which, in combination, provide the multiple layers of protection against inadvertent writes. There is no controller software, unlike in many prior EEPROM controllers; software can be a major contributor to unreliability, particularly in fault

  11. Designing reliability into accelerators

    NASA Astrophysics Data System (ADS)

    Hutton, A.

    1992-07-01

    Future accelerators will have to provide a high degree of reliability. Quality must be designed in right from the beginning and must remain a central theme throughout the project. The problem is similar to the problems facing US industry today, and examples of the successful application of quality engineering will be given. Different aspects of an accelerator project will be addressed: Concept, Design, Motivation, Management Techniques, and Fault Diagnosis. The importance of creating and maintaining a coherent team will be stressed.

  12. Reliability and testing

    NASA Technical Reports Server (NTRS)

    Auer, Werner

    1996-01-01

    Reliability and its interdependence with testing are important topics for development and manufacturing of successful products. This generally accepted fact is not only a technical statement, but must be also seen in the light of 'Human Factors.' While the background for this paper is the experience gained with electromechanical/electronic space products, including control and system considerations, it is believed that the content could be also of interest for other fields.

  13. Laser System Reliability

    DTIC Science & Technology

    1977-03-01

    NEALE CAPT. RANDALL D. GODFREY CAPT. JOHN E. ACTON HR. DAVE B. LEMMING (ASD) :,^ 19 . ••^w**** SECTION III RELIABILITY PREDICTION...Dete Exchange Program) failure rate date bank. In addition, some data have been obtained from Hughes. Rocketdyne , Garrett, and the AFWL’s APT Failure...Central Ave, Suite 306, Albuq, NM 87108 R/M Systems, Inc (Dr. K. Blemel), 10801 Lomas 81vd NE, Albuquerque, NM 87112 Rocketdyne 01 v, Rockwell

  14. Spacecraft transmitter reliability

    NASA Technical Reports Server (NTRS)

    1980-01-01

    A workshop on spacecraft transmitter reliability was held at the NASA Lewis Research Center on September 25 and 26, 1979, to discuss present knowledge and to plan future research areas. Since formal papers were not submitted, this synopsis was derived from audio tapes of the workshop. The following subjects were covered: users' experience with space transmitters; cathodes; power supplies and interfaces; and specifications and quality assurance. A panel discussion ended the workshop.

  15. Software reliability studies

    NASA Technical Reports Server (NTRS)

    Hoppa, Mary Ann; Wilson, Larry W.

    1994-01-01

    There are many software reliability models which try to predict future performance of software based on data generated by the debugging process. Our research has shown that by improving the quality of the data one can greatly improve the predictions. We are working on methodologies which control some of the randomness inherent in the standard data generation processes in order to improve the accuracy of predictions. Our contribution is twofold in that we describe an experimental methodology using a data structure called the debugging graph and apply this methodology to assess the robustness of existing models. The debugging graph is used to analyze the effects of various fault recovery orders on the predictive accuracy of several well-known software reliability algorithms. We found that, along a particular debugging path in the graph, the predictive performance of different models can vary greatly. Similarly, just because a model 'fits' a given path's data well does not guarantee that the model would perform well on a different path. Further we observed bug interactions and noted their potential effects on the predictive process. We saw that not only do different faults fail at different rates, but that those rates can be affected by the particular debugging stage at which the rates are evaluated. Based on our experiment, we conjecture that the accuracy of a reliability prediction is affected by the fault recovery order as well as by fault interaction.

  16. General Aviation Aircraft Reliability Study

    NASA Technical Reports Server (NTRS)

    Pettit, Duane; Turnbull, Andrew; Roelant, Henk A. (Technical Monitor)

    2001-01-01

    This reliability study was performed in order to provide the aviation community with an estimate of Complex General Aviation (GA) Aircraft System reliability. To successfully improve the safety and reliability for the next generation of GA aircraft, a study of current GA aircraft attributes was prudent. This was accomplished by benchmarking the reliability of operational Complex GA Aircraft Systems. Specifically, Complex GA Aircraft System reliability was estimated using data obtained from the logbooks of a random sample of the Complex GA Aircraft population.

  17. Highly reliable PLC systems

    SciTech Connect

    Beckman, L.V.

    1995-03-01

    Today`s control engineers are afforded many options when designing microprocessor based systems for safety applications. The use of some form of redundancy is typical, but the final selection must match the requirements of the application. Should the system be fail safe or fault tolerant? Is safety the overriding consideration, or is production a concern as well? Are redundant PLC`s (Programmable Logic Controllers) adequate, or should a system specifically designed for safety applications be utilized? There is a considerable effort in progress, both in the USA and in Europe, to establish guidelines and standards which match the safety integrity of the system with the degree of risk inherent in the application. This paper is intended to provide an introduction to the subject, and explore some of the microprocessor based alternatives available to the control or safety engineer.

  18. 75 FR 69648 - Safety Analysis Requirements for Defining Adequate Protection for the Public and the Workers

    Federal Register 2010, 2011, 2012, 2013, 2014

    2010-11-15

    ... ENERGY Safety Analysis Requirements for Defining Adequate Protection for the Public and the Workers... designed to hold firmly in place. 10 CFR Part 830 imposes a requirement that a documented safety analysis... provide guidance on meeting the requirements imposed by DOE Order 5480.23, Nuclear Safety Analysis...

  19. 42 CFR 413.24 - Adequate cost data and cost finding.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    .... Adequate data capable of being audited is consistent with good business concepts and effective and efficient management of any organization, whether it is operated for profit or on a nonprofit basis. It is a... contract for services (for example, a management contract), directly assigning the costs to the...

  20. Prenatal zinc supplementation of zinc-adequate rats adversely affects immunity in offspring

    Technology Transfer Automated Retrieval System (TEKTRAN)

    We previously showed that zinc (Zn) supplementation of Zn-adequate dams induced immunosuppressive effects that persist in the offspring after weaning. We investigated whether the immunosuppressive effects were due to in utero exposure and/or mediated via milk using a cross-fostering design. Pregnant...

  1. Towards Defining Adequate Lithium Trials for Individuals with Mental Retardation and Mental Illness.

    ERIC Educational Resources Information Center

    Pary, Robert J.

    1991-01-01

    Use of lithium with mentally retarded individuals with psychiatric conditions and/or behavior disturbances is discussed. The paper describes components of an adequate clinical trial and reviews case studies and double-blind cases. The paper concludes that aggression is the best indicator for lithium use, and reviews treatment parameters and…

  2. ADEQUATE SHELTERS AND QUICK REACTIONS TO WARNING: A KEY TO CIVIL DEFENSE.

    PubMed

    LYNCH, F X

    1963-11-08

    Case histories collected by investigators in Japan during 1945 illustrate both the effectiveness of shelters and the dangers inherent in apathy of the population, which suffered needless casualties by ignoring air raid warnintgs. Adequate shelters and immediate response to warnings are essential to survival in nuclear attack.

  3. Perceptions of Teachers in Their First Year of School Restructuring: Failure to Make Adequate Yearly Progress

    ERIC Educational Resources Information Center

    Moser, Sharon

    2010-01-01

    The 2007-2008 school year marked the first year Florida's Title I schools that did not made Adequate Yearly Progress (AYP) for five consecutive years entered into restructuring as mandated by the "No Child Left Behind Act" of 2001. My study examines the perceptions of teacher entering into their first year of school restructuring due to…

  4. 45 CFR 1182.15 - Institute responsibility for maintaining adequate technical, physical, and security safeguards to...

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... record systems. These security safeguards shall apply to all systems in which identifiable personal data... data and automated systems shall be adequately trained in the security and privacy of personal data. (4... technical, physical, and security safeguards to prevent unauthorized disclosure or destruction of manual...

  5. 42 CFR 417.568 - Adequate financial records, statistical data, and cost finding.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 42 Public Health 3 2011-10-01 2011-10-01 false Adequate financial records, statistical data, and... financial records, statistical data, and cost finding. (a) Maintenance of records. (1) An HMO or CMP must maintain sufficient financial records and statistical data for proper determination of costs payable by...

  6. Effect of tranquilizers on animal resistance to the adequate stimuli of the vestibular apparatus

    NASA Technical Reports Server (NTRS)

    Maksimovich, Y. B.; Khinchikashvili, N. V.

    1980-01-01

    The effect of tranquilizers on vestibulospinal reflexes and motor activity was studied in 900 centrifuged albino mice. Actometric studies have shown that the tranquilizers have a group capacity for increasing animal resistance to the action of adequate stimuli to the vestibular apparatus.

  7. 9 CFR 2.40 - Attending veterinarian and adequate veterinary care (dealers and exhibitors).

    Code of Federal Regulations, 2012 CFR

    2012-01-01

    ... 9 Animals and Animal Products 1 2012-01-01 2012-01-01 false Attending veterinarian and adequate veterinary care (dealers and exhibitors). 2.40 Section 2.40 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Attending...

  8. 9 CFR 2.40 - Attending veterinarian and adequate veterinary care (dealers and exhibitors).

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... 9 Animals and Animal Products 1 2014-01-01 2014-01-01 false Attending veterinarian and adequate veterinary care (dealers and exhibitors). 2.40 Section 2.40 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Attending...

  9. 9 CFR 2.40 - Attending veterinarian and adequate veterinary care (dealers and exhibitors).

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... 9 Animals and Animal Products 1 2011-01-01 2011-01-01 false Attending veterinarian and adequate veterinary care (dealers and exhibitors). 2.40 Section 2.40 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Attending...

  10. 9 CFR 2.40 - Attending veterinarian and adequate veterinary care (dealers and exhibitors).

    Code of Federal Regulations, 2013 CFR

    2013-01-01

    ... 9 Animals and Animal Products 1 2013-01-01 2013-01-01 false Attending veterinarian and adequate veterinary care (dealers and exhibitors). 2.40 Section 2.40 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Attending...

  11. The Relationship between Parental Involvement and Adequate Yearly Progress among Urban, Suburban, and Rural Schools

    ERIC Educational Resources Information Center

    Ma, Xin; Shen, Jianping; Krenn, Huilan Y.

    2014-01-01

    Using national data from the 2007-08 School and Staffing Survey, we compared the relationships between parental involvement and school outcomes related to adequate yearly progress (AYP) in urban, suburban, and rural schools. Parent-initiated parental involvement demonstrated significantly positive relationships with both making AYP and staying off…

  12. Which Food Security Determinants Predict Adequate Vegetable Consumption among Rural Western Australian Children?

    PubMed

    Godrich, Stephanie L; Lo, Johnny; Davies, Christina R; Darby, Jill; Devine, Amanda

    2017-01-03

    Improving the suboptimal vegetable consumption among the majority of Australian children is imperative in reducing chronic disease risk. The objective of this research was to determine whether there was a relationship between food security determinants (FSD) (i.e., food availability, access, and utilisation dimensions) and adequate vegetable consumption among children living in regional and remote Western Australia (WA). Caregiver-child dyads (n = 256) living in non-metropolitan/rural WA completed cross-sectional surveys that included questions on FSD, demographics and usual vegetable intake. A total of 187 dyads were included in analyses, which included descriptive and logistic regression analyses via IBM SPSS (version 23). A total of 13.4% of children in this sample had adequate vegetable intake. FSD that met inclusion criteria (p ≤ 0.20) for multivariable regression analyses included price; promotion; quality; location of food outlets; variety of vegetable types; financial resources; and transport to outlets. After adjustment for potential demographic confounders, the FSD that predicted adequate vegetable consumption were, variety of vegetable types consumed (p = 0.007), promotion (p = 0.017), location of food outlets (p = 0.027), and price (p = 0.043). Food retail outlets should ensure that adequate varieties of vegetable types (i.e., fresh, frozen, tinned) are available, vegetable messages should be promoted through food retail outlets and in community settings, towns should include a range of vegetable purchasing options, increase their reliance on a local food supply and increase transport options to enable affordable vegetable purchasing.

  13. 9 CFR 2.33 - Attending veterinarian and adequate veterinary care.

    Code of Federal Regulations, 2011 CFR

    2011-01-01

    ... veterinary care. 2.33 Section 2.33 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Research Facilities § 2.33 Attending veterinarian and adequate veterinary care. (a) Each research facility shall have an attending veterinarian who shall...

  14. 9 CFR 2.33 - Attending veterinarian and adequate veterinary care.

    Code of Federal Regulations, 2014 CFR

    2014-01-01

    ... veterinary care. 2.33 Section 2.33 Animals and Animal Products ANIMAL AND PLANT HEALTH INSPECTION SERVICE, DEPARTMENT OF AGRICULTURE ANIMAL WELFARE REGULATIONS Research Facilities § 2.33 Attending veterinarian and adequate veterinary care. (a) Each research facility shall have an attending veterinarian who shall...

  15. Identifying the Factors Impacting the Adequately Yearly Progress Performance in the United States

    ERIC Educational Resources Information Center

    Hsieh, Ju-Shan

    2013-01-01

    The NCLB (No Child Left Behind Act) specifies that states must develop AYP (adequate yearly progress) statewide measurable objectives for improved achievement by all students, including economically disadvantaged students, students from minority races, students with disabilities, and students with limited English proficiency. By the 2013-2014…

  16. 42 CFR 438.207 - Assurances of adequate capacity and services.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 42 Public Health 4 2010-10-01 2010-10-01 false Assurances of adequate capacity and services. 438.207 Section 438.207 Public Health CENTERS FOR MEDICARE & MEDICAID SERVICES, DEPARTMENT OF HEALTH AND HUMAN SERVICES (CONTINUED) MEDICAL ASSISTANCE PROGRAMS MANAGED CARE Quality Assessment and...

  17. 36 CFR 13.960 - Who determines when there is adequate snow cover?

    Code of Federal Regulations, 2011 CFR

    2011-07-01

    ... 36 Parks, Forests, and Public Property 1 2011-07-01 2011-07-01 false Who determines when there is adequate snow cover? 13.960 Section 13.960 Parks, Forests, and Public Property NATIONAL PARK SERVICE, DEPARTMENT OF THE INTERIOR NATIONAL PARK SYSTEM UNITS IN ALASKA Special Regulations-Denali National Park...

  18. 36 CFR 13.960 - Who determines when there is adequate snow cover?

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... 36 Parks, Forests, and Public Property 1 2010-07-01 2010-07-01 false Who determines when there is adequate snow cover? 13.960 Section 13.960 Parks, Forests, and Public Property NATIONAL PARK SERVICE, DEPARTMENT OF THE INTERIOR NATIONAL PARK SYSTEM UNITS IN ALASKA Special Regulations-Denali National Park...

  19. 76 FR 51041 - Hemoglobin Standards and Maintaining Adequate Iron Stores in Blood Donors; Public Workshop

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-08-17

    ... HUMAN SERVICES Food and Drug Administration Hemoglobin Standards and Maintaining Adequate Iron Stores in... workshop. The Food and Drug Administration (FDA) is announcing a public workshop entitled: ``Hemoglobin... discuss blood donor hemoglobin and hematocrit qualification standards in the United States, its impact...

  20. 21 CFR 514.117 - Adequate and well-controlled studies.

    Code of Federal Regulations, 2010 CFR

    2010-04-01

    ... adequate and well-controlled studies of a new animal drug is to distinguish the effect of the new animal... with one or more controls to provide a quantitative evaluation of drug effects. The protocol and the... for special circumstances. Examples include studies in which the effect of the new animal drug is...

  1. 21 CFR 514.117 - Adequate and well-controlled studies.

    Code of Federal Regulations, 2011 CFR

    2011-04-01

    ... adequate and well-controlled studies of a new animal drug is to distinguish the effect of the new animal... with one or more controls to provide a quantitative evaluation of drug effects. The protocol and the... for special circumstances. Examples include studies in which the effect of the new animal drug is...

  2. 21 CFR 514.117 - Adequate and well-controlled studies.

    Code of Federal Regulations, 2014 CFR

    2014-04-01

    ... adequate and well-controlled studies of a new animal drug is to distinguish the effect of the new animal... with one or more controls to provide a quantitative evaluation of drug effects. The protocol and the... for special circumstances. Examples include studies in which the effect of the new animal drug is...

  3. 21 CFR 514.117 - Adequate and well-controlled studies.

    Code of Federal Regulations, 2012 CFR

    2012-04-01

    ... adequate and well-controlled studies of a new animal drug is to distinguish the effect of the new animal... with one or more controls to provide a quantitative evaluation of drug effects. The protocol and the... for special circumstances. Examples include studies in which the effect of the new animal drug is...

  4. 21 CFR 514.117 - Adequate and well-controlled studies.

    Code of Federal Regulations, 2013 CFR

    2013-04-01

    ... adequate and well-controlled studies of a new animal drug is to distinguish the effect of the new animal... with one or more controls to provide a quantitative evaluation of drug effects. The protocol and the... for special circumstances. Examples include studies in which the effect of the new animal drug is...

  5. 30 CFR 227.801 - What if a State does not adequately perform a delegated function?

    Code of Federal Regulations, 2010 CFR

    2010-07-01

    ... delegated function? 227.801 Section 227.801 Mineral Resources MINERALS MANAGEMENT SERVICE, DEPARTMENT OF THE INTERIOR MINERALS REVENUE MANAGEMENT DELEGATION TO STATES Performance Review § 227.801 What if a State does not adequately perform a delegated function? If your performance of the delegated function does...

  6. Science Education as a Contributor to Adequate Yearly Progress and Accountability Programs

    ERIC Educational Resources Information Center

    Judson, Eugene

    2010-01-01

    The No Child Left Behind (NCLB) Act requires states to measure the adequate yearly progress (AYP) of each public school and local educational agency (LEA) and to hold schools and LEAs accountable for failing to make AYP. Although it is required that science be assessed in at least three grades, the achievement results from science examinations are…

  7. 42 CFR 417.568 - Adequate financial records, statistical data, and cost finding.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 42 Public Health 3 2010-10-01 2010-10-01 false Adequate financial records, statistical data, and... financial records, statistical data, and cost finding. (a) Maintenance of records. (1) An HMO or CMP must maintain sufficient financial records and statistical data for proper determination of costs payable by...

  8. Understanding the pelvic pain mechanism is key to find an adequate therapeutic approach.

    PubMed

    Van Kerrebroeck, Philip

    2016-06-25

    Pain is a natural mechanism to actual or potential tissue damage and involves both a sensory and an emotional experience. In chronic pelvic pain, localisation of pain can be widespread and can cause considerable distress. A multidisciplinary approach is needed in order to fully understand the pelvic pain mechanism and to identify an adequate therapeutic approach.

  9. 36 CFR 13.960 - Who determines when there is adequate snow cover?

    Code of Federal Regulations, 2012 CFR

    2012-07-01

    ... 36 Parks, Forests, and Public Property 1 2012-07-01 2012-07-01 false Who determines when there is adequate snow cover? 13.960 Section 13.960 Parks, Forests, and Public Property NATIONAL PARK SERVICE, DEPARTMENT OF THE INTERIOR NATIONAL PARK SYSTEM UNITS IN ALASKA Special Regulations-Denali National Park...

  10. 36 CFR 13.960 - Who determines when there is adequate snow cover?

    Code of Federal Regulations, 2014 CFR

    2014-07-01

    ... 36 Parks, Forests, and Public Property 1 2014-07-01 2014-07-01 false Who determines when there is adequate snow cover? 13.960 Section 13.960 Parks, Forests, and Public Property NATIONAL PARK SERVICE, DEPARTMENT OF THE INTERIOR NATIONAL PARK SYSTEM UNITS IN ALASKA Special Regulations-Denali National Park...

  11. 36 CFR 13.960 - Who determines when there is adequate snow cover?

    Code of Federal Regulations, 2013 CFR

    2013-07-01

    ... 36 Parks, Forests, and Public Property 1 2013-07-01 2013-07-01 false Who determines when there is adequate snow cover? 13.960 Section 13.960 Parks, Forests, and Public Property NATIONAL PARK SERVICE, DEPARTMENT OF THE INTERIOR NATIONAL PARK SYSTEM UNITS IN ALASKA Special Regulations-Denali National Park...

  12. Human milk feeding supports adequate growth in infants

    Technology Transfer Automated Retrieval System (TEKTRAN)

    Despite current nutritional strategies, premature infants remain at high risk for extrauterine growth restriction. The use of an exclusive human milk-based diet is associated with decreased incidence of necrotizing enterocolitis (NEC), but concerns exist about infants achieving adequate growth. The ...

  13. Adequate Yearly Progress for Students with Emotional and Behavioral Disorders through Research-Based Practices

    ERIC Educational Resources Information Center

    Vannest, Kimberly J.; Temple-Harvey, Kimberly K.; Mason, Benjamin A.

    2009-01-01

    Because schools are held accountable for the academic performance of all students, it is important to focus on academics and the need for effective teaching practices. Adequate yearly progress, a method of accountability that is part of the No Child Left Behind Act (2001), profoundly affects the education of students who have emotional and…

  14. Influenza 2005-2006: vaccine supplies adequate, but bird flu looms.

    PubMed

    Mossad, Sherif B

    2005-11-01

    Influenza vaccine supplies appear to be adequate for the 2005-2006 season, though delivery has been somewhat delayed. However, in the event of a pandemic of avian flu-considered inevitable by most experts, although no one knows when it will happen-the United States would be woefully unprepared.

  15. How Much and What Kind? Identifying an Adequate Technology Infrastructure for Early Childhood Education. Policy Brief

    ERIC Educational Resources Information Center

    Daugherty, Lindsay; Dossani, Rafiq; Johnson, Erin-Elizabeth; Wright, Cameron

    2014-01-01

    To realize the potential benefits of technology use in early childhood education (ECE), and to ensure that technology can help to address the digital divide, providers, families of young children, and young children themselves must have access to an adequate technology infrastructure. The goals for technology use in ECE that a technology…

  16. CR reliability testing

    NASA Astrophysics Data System (ADS)

    Honeyman-Buck, Janice C.; Rill, Lynn; Frost, Meryll M.; Staab, Edward V.

    1998-07-01

    The purpose of this work was to develop a method for systematically testing the reliability of a CR system under realistic daily loads in a non-clinical environment prior to its clinical adoption. Once digital imaging replaces film, it will be very difficult to revert back should the digital system become unreliable. Prior to the beginning of the test, a formal evaluation was performed to set the benchmarks for performance and functionality. A formal protocol was established that included all the 62 imaging plates in the inventory for each 24-hour period in the study. Imaging plates were exposed using different combinations of collimation, orientation, and SID. Anthropomorphic phantoms were used to acquire images of different sizes. Each combination was chosen randomly to simulate the differences that could occur in clinical practice. The tests were performed over a wide range of times with batches of plates processed to simulate the temporal constraints required by the nature of portable radiographs taken in the Intensive Care Unit (ICU). Current patient demographics were used for the test studies so automatic routing algorithms could be tested. During the test, only three minor reliability problems occurred, two of which were not directly related to the CR unit. One plate was discovered to cause a segmentation error that essentially reduced the image to only black and white with no gray levels. This plate was removed from the inventory to be replaced. Another problem was a PACS routing problem that occurred when the DICOM server with which the CR was communicating had a problem with disk space. The final problem was a network printing failure to the laser cameras. Although the units passed the reliability test, problems with interfacing to workstations were discovered. The two issues that were identified were the interpretation of what constitutes a study for CR and the construction of the look-up table for a proper gray scale display.

  17. Ultimately Reliable Pyrotechnic Systems

    NASA Technical Reports Server (NTRS)

    Scott, John H.; Hinkel, Todd

    2015-01-01

    This paper presents the methods by which NASA has designed, built, tested, and certified pyrotechnic devices for high reliability operation in extreme environments and illustrates the potential applications in the oil and gas industry. NASA's extremely successful application of pyrotechnics is built upon documented procedures and test methods that have been maintained and developed since the Apollo Program. Standards are managed and rigorously enforced for performance margins, redundancy, lot sampling, and personnel safety. The pyrotechnics utilized in spacecraft include such devices as small initiators and detonators with the power of a shotgun shell, detonating cord systems for explosive energy transfer across many feet, precision linear shaped charges for breaking structural membranes, and booster charges to actuate valves and pistons. NASA's pyrotechnics program is one of the more successful in the history of Human Spaceflight. No pyrotechnic device developed in accordance with NASA's Human Spaceflight standards has ever failed in flight use. NASA's pyrotechnic initiators work reliably in temperatures as low as -420 F. Each of the 135 Space Shuttle flights fired 102 of these initiators, some setting off multiple pyrotechnic devices, with never a failure. The recent landing on Mars of the Opportunity rover fired 174 of NASA's pyrotechnic initiators to complete the famous '7 minutes of terror.' Even after traveling through extreme radiation and thermal environments on the way to Mars, every one of them worked. These initiators have fired on the surface of Titan. NASA's design controls, procedures, and processes produce the most reliable pyrotechnics in the world. Application of pyrotechnics designed and procured in this manner could enable the energy industry's emergency equipment, such as shutoff valves and deep-sea blowout preventers, to be left in place for years in extreme environments and still be relied upon to function when needed, thus greatly enhancing

  18. Reliability Growth Prediction

    DTIC Science & Technology

    1986-09-01

    the Duane model because: *e ’he reliability gSod’ data analyzed were reflective of a single Lesr- for • each equipment as opposed to a series of zest ...fabrication) and costs wbich are a function of test length (e.g., chamber operations). A life -cycle cost model, Ref. 14 for example, can be exercised tc...J. Gibson and K. K. Mcain APPROVED FOR FUBLIC RE1EAS NI ODSrRUTIG1,N UY-LUlHfF :-:-4 ROME AIR DEVELOPMENT CENTER Air Force Systems Command Griffiss

  19. Blade reliability collaborative :

    SciTech Connect

    Ashwill, Thomas D.; Ogilvie, Alistair B.; Paquette, Joshua A.

    2013-04-01

    The Blade Reliability Collaborative (BRC) was started by the Wind Energy Technologies Department of Sandia National Laboratories and DOE in 2010 with the goal of gaining insight into planned and unplanned O&M issues associated with wind turbine blades. A significant part of BRC is the Blade Defect, Damage and Repair Survey task, which will gather data from blade manufacturers, service companies, operators and prior studies to determine details about the largest sources of blade unreliability. This report summarizes the initial findings from this work.

  20. Reliable VLSI sequential controllers

    NASA Technical Reports Server (NTRS)

    Whitaker, S.; Maki, G.; Shamanna, M.

    1990-01-01

    A VLSI architecture for synchronous sequential controllers is presented that has attractive qualities for producing reliable circuits. In these circuits, one hardware implementation can realize any flow table with a maximum of 2(exp n) internal states and m inputs. Also all design equations are identical. A real time fault detection means is presented along with a strategy for verifying the correctness of the checking hardware. This self check feature can be employed with no increase in hardware. The architecture can be modified to achieve fail safe designs. With no increase in hardware, an adaptable circuit can be realized that allows replacement of faulty transitions with fault free transitions.