Estimates of Intraclass Correlation for Variables Related to Behavioral HIV/STD Prevention in a Predominantly African American and Hispanic Sample of Young Women

ERIC Educational Resources Information Center

Pals, Sherri L.; Beaty, Brenda L.; Posner, Samuel F.; Bull, Sheana S.

2009-01-01

Studies designed to evaluate HIV and STD prevention interventions often involve random assignment of groups such as neighborhoods or communities to study conditions (e.g., to intervention or control). Investigators who design group-randomized trials (GRTs) must take the expected intraclass correlation coefficient (ICC) into account in sample size…

Agreement in functional assessment: graphic approaches to displaying respondent effects.

PubMed

Haley, Stephen M; Ni, Pengsheng; Coster, Wendy J; Black-Schaffer, Randie; Siebens, Hilary; Tao, Wei

2006-09-01

The objective of this study was to examine the agreement between respondents of summary scores from items representing three functional content areas (physical and mobility, personal care and instrumental, applied cognition) within the Activity Measure for Postacute Care (AM-PAC). We compare proxy vs. patient report in both hospital and community settings as represented by intraclass correlation coefficients and two graphic approaches. The authors conducted a prospective, cohort study of a convenience sample of adults (n = 47) receiving rehabilitation services either in hospital (n = 31) or community (n = 16) settings. In addition to using intraclass correlation coefficients (ICC) as indices of agreement, we applied two graphic approaches to serve as complements to help interpret the direction and magnitude of respondent disagreements. We created a "mountain plot" based on a cumulative distribution curve and a "survival-agreement plot" with step functions used in the analysis of survival data. ICCs on summary scores between patient and proxy report were physical and mobility ICC = 0.92, personal care and instrumental ICC = 0.93, and applied cognition ICC = 0.77. Although combined respondent agreement was acceptable, graphic approaches helped interpret differences in separate analyses of clinician and family agreement. Graphic analyses allow for a simple interpretation of agreement data and may be useful in determining the meaningfulness of the amount and direction of interrespondent variation.

Correlation and agreement of a digital and conventional method to measure arch parameters.

PubMed

Nawi, Nes; Mohamed, Alizae Marny; Marizan Nor, Murshida; Ashar, Nor Atika

2018-01-01

The aim of the present study was to determine the overall reliability and validity of arch parameters measured digitally compared to conventional measurement. A sample of 111 plaster study models of Down syndrome (DS) patients were digitized using a blue light three-dimensional (3D) scanner. Digital and manual measurements of defined parameters were performed using Geomagic analysis software (Geomagic Studio 2014 software, 3D Systems, Rock Hill, SC, USA) on digital models and with a digital calliper (Tuten, Germany) on plaster study models. Both measurements were repeated twice to validate the intraexaminer reliability based on intraclass correlation coefficients (ICCs) using the independent t test and Pearson's correlation, respectively. The Bland-Altman method of analysis was used to evaluate the agreement of the measurement between the digital and plaster models. No statistically significant differences (p > 0.05) were found between the manual and digital methods when measuring the arch width, arch length, and space analysis. In addition, all parameters showed a significant correlation coefficient (r ≥ 0.972; p < 0.01) between all digital and manual measurements. Furthermore, a positive agreement between digital and manual measurements of the arch width (90-96%), arch length and space analysis (95-99%) were also distinguished using the Bland-Altman method. These results demonstrate that 3D blue light scanning and measurement software are able to precisely produce 3D digital model and measure arch width, arch length, and space analysis. The 3D digital model is valid to be used in various clinical applications.

Correlation and agreement between eplet mismatches calculated using serological, low-intermediate and high resolution molecular human leukocyte antigen typing methods.

PubMed

Fidler, Samantha; D'Orsogna, Lloyd; Irish, Ashley B; Lewis, Joshua R; Wong, Germaine; Lim, Wai H

2018-03-02

Structural human leukocyte antigen (HLA) matching at the eplet level can be identified by HLAMatchmaker, which requires the entry of four-digit alleles. The aim of this study was to evaluate the agreement between eplet mismatches calculated by serological and two-digit typing methods compared to high-resolution four-digit typing. In a cohort of 264 donor/recipient pairs, the evaluation of measurement error was assessed using intra-class correlation to confirm the absolute agreement between the number of eplet mismatches at class I (HLA-A, -B, C) and II loci (HLA-DQ and -DR) calculated using serological or two-digit molecular typing compared to four-digit molecular typing methods. The proportion of donor/recipient pairs with a difference of >5 eplet mismatches between the HLA typing methods was also determined. Intra-class correlation coefficients between serological and four-digit molecular typing methods were 0.969 (95% confidence intervals [95% CI] 0.960-0.975) and 0.926 (95% CI 0.899-0.944), respectively; and 0.995 (95% CI 0.994-0.996) and 0.993 (95% CI 0.991-0.995), respectively between two-digit and four-digit molecular typing methods. The proportion of donor/recipient pairs with a difference of >5 eplet mismatches at class I and II loci was 4% and 16% for serological versus four-digit molecular typing methods, and 0% and 2% for two-digit versus four-digit molecular typing methods, respectively. In this small predominantly Caucasian population, compared with serology, there is a high level of agreement in the number of eplet mismatches calculated using two-compared to four-digit molecular HLA-typing methods, suggesting that two-digit typing may be sufficient in determining eplet mismatch load in kidney transplantation.

Correlation and agreement between eplet mismatches calculated using serological, low-intermediate and high resolution molecular human leukocyte antigen typing methods

PubMed Central

Fidler, Samantha; D’Orsogna, Lloyd; Irish, Ashley B.; Lewis, Joshua R.; Wong, Germaine; Lim, Wai H.

2018-01-01

Structural human leukocyte antigen (HLA) matching at the eplet level can be identified by HLAMatchmaker, which requires the entry of four-digit alleles. The aim of this study was to evaluate the agreement between eplet mismatches calculated by serological and two-digit typing methods compared to high-resolution four-digit typing. In a cohort of 264 donor/recipient pairs, the evaluation of measurement error was assessed using intra-class correlation to confirm the absolute agreement between the number of eplet mismatches at class I (HLA-A, -B, C) and II loci (HLA-DQ and -DR) calculated using serological or two-digit molecular typing compared to four-digit molecular typing methods. The proportion of donor/recipient pairs with a difference of >5 eplet mismatches between the HLA typing methods was also determined. Intra-class correlation coefficients between serological and four-digit molecular typing methods were 0.969 (95% confidence intervals [95% CI] 0.960–0.975) and 0.926 (95% CI 0.899–0.944), respectively; and 0.995 (95% CI 0.994–0.996) and 0.993 (95% CI 0.991–0.995), respectively between two-digit and four-digit molecular typing methods. The proportion of donor/recipient pairs with a difference of >5 eplet mismatches at class I and II loci was 4% and 16% for serological versus four-digit molecular typing methods, and 0% and 2% for two-digit versus four-digit molecular typing methods, respectively. In this small predominantly Caucasian population, compared with serology, there is a high level of agreement in the number of eplet mismatches calculated using two-compared to four-digit molecular HLA-typing methods, suggesting that two-digit typing may be sufficient in determining eplet mismatch load in kidney transplantation. PMID:29568344

Intra-class correlation estimates for assessment of vitamin A intake in children.

PubMed

Agarwal, Girdhar G; Awasthi, Shally; Walter, Stephen D

2005-03-01

In many community-based surveys, multi-level sampling is inherent in the design. In the design of these studies, especially to calculate the appropriate sample size, investigators need good estimates of intra-class correlation coefficient (ICC), along with the cluster size, to adjust for variation inflation due to clustering at each level. The present study used data on the assessment of clinical vitamin A deficiency and intake of vitamin A-rich food in children in a district in India. For the survey, 16 households were sampled from 200 villages nested within eight randomly-selected blocks of the district. ICCs and components of variances were estimated from a three-level hierarchical random effects analysis of variance model. Estimates of ICCs and variance components were obtained at village and block levels. Between-cluster variation was evident at each level of clustering. In these estimates, ICCs were inversely related to cluster size, but the design effect could be substantial for large clusters. At the block level, most ICC estimates were below 0.07. At the village level, many ICC estimates ranged from 0.014 to 0.45. These estimates may provide useful information for the design of epidemiological studies in which the sampled (or allocated) units range in size from households to large administrative zones.

The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling

PubMed Central

Hsu, Hsien-Yuan; Lin, Jr-Hung; Kwok, Oi-Man; Acosta, Sandra; Willson, Victor

2016-01-01

Several researchers have recommended that level-specific fit indices should be applied to detect the lack of model fit at any level in multilevel structural equation models. Although we concur with their view, we note that these studies did not sufficiently consider the impact of intraclass correlation (ICC) on the performance of level-specific fit indices. Our study proposed to fill this gap in the methodological literature. A Monte Carlo study was conducted to investigate the performance of (a) level-specific fit indices derived by a partially saturated model method (e.g., CFIPS_B and CFIPS_W) and (b) SRMRW and SRMRB in terms of their performance in multilevel structural equation models across varying ICCs. The design factors included intraclass correlation (ICC: ICC1 = 0.091 to ICC6 = 0.500), numbers of groups in between-level models (NG: 50, 100, 200, and 1,000), group size (GS: 30, 50, and 100), and type of misspecification (no misspecification, between-level misspecification, and within-level misspecification). Our simulation findings raise a concern regarding the performance of between-level-specific partial saturated fit indices in low ICC conditions: the performances of both TLIPS_B and RMSEAPS_B were more influenced by ICC compared with CFIPS_B and SRMRB. However, when traditional cutoff values (RMSEA≤ 0.06; CFI, TLI≥ 0.95; SRMR≤ 0.08) were applied, CFIPS_B and TLIPS_B were still able to detect misspecified between-level models even when ICC was as low as 0.091 (ICC1). On the other hand, both RMSEAPS_B and SRMRB were not recommended under low ICC conditions. PMID:29795901

A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research.

PubMed

Koo, Terry K; Li, Mae Y

2016-06-01

Intraclass correlation coefficient (ICC) is a widely used reliability index in test-retest, intrarater, and interrater reliability analyses. This article introduces the basic concept of ICC in the content of reliability analysis. There are 10 forms of ICCs. Because each form involves distinct assumptions in their calculation and will lead to different interpretations, researchers should explicitly specify the ICC form they used in their calculation. A thorough review of the research design is needed in selecting the appropriate form of ICC to evaluate reliability. The best practice of reporting ICC should include software information, "model," "type," and "definition" selections. When coming across an article that includes ICC, readers should first check whether information about the ICC form has been reported and if an appropriate ICC form was used. Based on the 95% confident interval of the ICC estimate, values less than 0.5, between 0.5 and 0.75, between 0.75 and 0.9, and greater than 0.90 are indicative of poor, moderate, good, and excellent reliability, respectively. This article provides a practical guideline for clinical researchers to choose the correct form of ICC and suggests the best practice of reporting ICC parameters in scientific publications. This article also gives readers an appreciation for what to look for when coming across ICC while reading an article.

Agreement Analysis: What He Said, She Said Versus You Said.

PubMed

Vetter, Thomas R; Schober, Patrick

2018-06-01

Correlation and agreement are 2 concepts that are widely applied in the medical literature and clinical practice to assess for the presence and strength of an association. However, because correlation and agreement are conceptually distinct, they require the use of different statistics. Agreement is a concept that is closely related to but fundamentally different from and often confused with correlation. The idea of agreement refers to the notion of reproducibility of clinical evaluations or biomedical measurements. The intraclass correlation coefficient is a commonly applied measure of agreement for continuous data. The intraclass correlation coefficient can be validly applied specifically to assess intrarater reliability and interrater reliability. As its name implies, the Lin concordance correlation coefficient is another measure of agreement or concordance. In undertaking a comparison of a new measurement technique with an established one, it is necessary to determine whether they agree sufficiently for the new to replace the old. Bland and Altman demonstrated that using a correlation coefficient is not appropriate for assessing the interchangeability of 2 such measurement methods. They in turn described an alternative approach, the since widely applied graphical Bland-Altman Plot, which is based on a simple estimation of the mean and standard deviation of differences between measurements by the 2 methods. In reading a medical journal article that includes the interpretation of diagnostic tests and application of diagnostic criteria, attention is conventionally focused on aspects like sensitivity, specificity, predictive values, and likelihood ratios. However, if the clinicians who interpret the test cannot agree on its interpretation and resulting typically dichotomous or binary diagnosis, the test results will be of little practical use. Such agreement between observers (interobserver agreement) about a dichotomous or binary variable is often reported as the

Complex versus Simple Modeling for DIF Detection: When the Intraclass Correlation Coefficient (?) of the Studied Item Is Less Than the ? of the Total Score

ERIC Educational Resources Information Center

Jin, Ying; Myers, Nicholas D.; Ahn, Soyeon

2014-01-01

Previous research has demonstrated that differential item functioning (DIF) methods that do not account for multilevel data structure could result in too frequent rejection of the null hypothesis (i.e., no DIF) when the intraclass correlation coefficient (?) of the studied item was the same as the ? of the total score. The current study extended…

Repeatability, interocular correlation and agreement of quantitative swept-source optical coherence tomography angiography macular metrics in healthy subjects.

PubMed

Fang, Danqi; Tang, Fang Yao; Huang, Haifan; Cheung, Carol Y; Chen, Haoyu

2018-05-29

To investigate the repeatability, interocular correlation and agreement of quantitative swept-source optical coherence tomography angiography (SS-OCTA) metrics in healthy subjects. Thirty-three healthy normal subjects were enrolled. The macula was scanned four times by an SS-OCTA system using the 3 mm×3 mm mode. The superficial capillary map images were analysed using a MATLAB program. A series of parameters were measured: foveal avascular zone (FAZ) area, FAZ perimeter, FAZ circularity, parafoveal vessel density, fractal dimension and vessel diameter index (VDI). The repeatability of four scans was determined by intraclass correlation coefficient (ICC). Then the averaged results were analysed for intereye difference, correlation and agreement using paired t-test, Pearson's correlation coefficient (r), ICC and Bland-Altman plot. The repeatability assessment of the macular metrics exported high ICC values (ranged from 0.853 to 0.996). There is no statistically significant difference in the OCTA metrics between the two eyes. FAZ area (ICC=0.961, r=0.929) and FAZ perimeter (ICC=0.884, r=0.802) showed excellent binocular correlation. Fractal dimension (ICC=0.732, r=0.578) and VDI (ICC=0.707, r=0.547) showed moderate binocular correlation, while parafoveal vessel density had poor binocular correlation. Bland-Altman plots showed the range of agreement was from -0.0763 to 0.0954 mm 2 for FAZ area and from -0.0491 to 0.1136 for parafoveal vessel density. The macular metrics obtained using SS-OCTA showed excellent repeatability in healthy subjects. We showed high intereye correlation in FAZ area and perimeter, moderate correlation in fractal dimension and VDI, while vessel density had poor correlation in normal healthy subjects. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

How to assess and compare inter-rater reliability, agreement and correlation of ratings: an exemplary analysis of mother-father and parent-teacher expressive vocabulary rating pairs

PubMed Central

Stolarova, Margarita; Wolf, Corinna; Rinker, Tanja; Brielmann, Aenne

2014-01-01

This report has two main purposes. First, we combine well-known analytical approaches to conduct a comprehensive assessment of agreement and correlation of rating-pairs and to dis-entangle these often confused concepts, providing a best-practice example on concrete data and a tutorial for future reference. Second, we explore whether a screening questionnaire developed for use with parents can be reliably employed with daycare teachers when assessing early expressive vocabulary. A total of 53 vocabulary rating pairs (34 parent–teacher and 19 mother–father pairs) collected for two-year-old children (12 bilingual) are evaluated. First, inter-rater reliability both within and across subgroups is assessed using the intra-class correlation coefficient (ICC). Next, based on this analysis of reliability and on the test-retest reliability of the employed tool, inter-rater agreement is analyzed, magnitude and direction of rating differences are considered. Finally, Pearson correlation coefficients of standardized vocabulary scores are calculated and compared across subgroups. The results underline the necessity to distinguish between reliability measures, agreement and correlation. They also demonstrate the impact of the employed reliability on agreement evaluations. This study provides evidence that parent–teacher ratings of children's early vocabulary can achieve agreement and correlation comparable to those of mother–father ratings on the assessed vocabulary scale. Bilingualism of the evaluated child decreased the likelihood of raters' agreement. We conclude that future reports of agreement, correlation and reliability of ratings will benefit from better definition of terms and stricter methodological approaches. The methodological tutorial provided here holds the potential to increase comparability across empirical reports and can help improve research practices and knowledge transfer to educational and therapeutic settings. PMID:24994985

Probability interpretations of intraclass reliabilities.

PubMed

Ellis, Jules L

2013-11-20

Research where many organizations are rated by different samples of individuals such as clients, patients, or employees frequently uses reliabilities computed from intraclass correlations. Consumers of statistical information, such as patients and policy makers, may not have sufficient background for deciding which levels of reliability are acceptable. It is shown that the reliability is related to various probabilities that may be easier to understand, for example, the proportion of organizations that will be classed significantly above (or below) the mean and the probability that an organization is classed correctly given that it is classed significantly above (or below) the mean. One can view these probabilities as the amount of information of the classification and the correctness of the classification. These probabilities have an inverse relationship: given a reliability, one can 'buy' correctness at the cost of informativeness and conversely. This article discusses how this can be used to make judgments about the required level of reliabilities. Copyright © 2013 John Wiley & Sons, Ltd.

Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

PubMed

Díaz-Vilela, Luis F; Delgado Rodríguez, Naira; Isla-Díaz, Rosa; Díaz-Cabrera, Dolores; Hernández-Fernaud, Estefanía; Rosales-Sánchez, Christian

2015-01-01

Work performance is one of the most important dependent variables in Work and Organizational Psychology. The main objective of this paper was to explore the relationships between citizenship performance and task performance measures obtained from different appraisers and their consistency through a seldom-used methodology, intraclass correlation coefficients. Participants were 135 public employees, the total staff in a local government department. Jobs were clustered into job families through a work analysis based on standard questionnaires. A task description technique was used to develop a performance appraisal questionnaire for each job family, with three versions: self-, supervisor-, and peer-evaluation, in addition to a measure of citizenship performance. Only when the self-appraisal bias is controlled, significant correlations appeared between task performance rates. However, intraclass correlations analyses show that only self- (contextual and task) performance measures are consistent, while interrater agreement disappears. These results provide some interesting clues about the procedure of appraisal instrument development, the role of appraisers, and the importance of choosing adequate consistency analysis methods.

Pre-operative Duplex Ultrasonography in Arteriovenous Fistula Creation: Intra- and Inter-observer Agreement.

PubMed

Zonnebeld, Niek; Maas, Tommy M G; Huberts, Wouter; van Loon, Magda M; Delhaas, Tammo; Tordoir, Jan H M

2017-11-01

Although clinical guidelines on arteriovenous fistula (AVF) creation advocate minimum luminal arterial and venous diameters, assessed by duplex ultrasonography (DUS), the clinical value of routine DUS examination is under debate. DUS might be an insufficiently repeatable and/or reproducible imaging modality because of its operator dependency. The present study aimed to assess intra- and inter-observer agreement of DUS examination in support of AVF surgery planning. Ten end stage renal disease patients were included, to assess intra- and inter-observer agreement of pre-operative DUS measurements. All measurements were performed by two trained and experienced vascular technicians, blinded to measurement readings. From the routine DUS protocol, representative measurements (venous diameters, and arterial diameters and volume flow in the upper arm and forearm) were selected. For intra-observer agreement the measurements were performed in triplicate, with the probe released from the skin between each. Intraclass correlation coefficients were calculated for intra- and inter-observer agreement, and Bland-Altman plots used to graphically display mean measurement differences and limits of agreement. Ten patients (6 male, 59.4±19.7 years) consented to participate, and all predefined measurements were obtained. Intraclass correlation coefficients for intra-observer agreement of diameter measurements were at least 0.90 (95% CI 0.74-0.97; radial artery). Inter-observer agreement was at least 0.83 (0.46-0.96; lateral diameter upper arm cephalic vein). The Bland-Altman plots showed acceptable mean measurement differences and limits of agreement. In experienced hands, excellent intra- and inter-observer agreement can be reached for the discrete pre-operative DUS measurements advocated in clinical guidelines. DUS is therefore a reliable imaging modality to support AVF surgery planning. The content of DUS protocols, however, needs further standardisation. Copyright © 2017 European

Relationships between Contextual and Task Performance and Interrater Agreement: Are There Any?

PubMed Central

Díaz-Cabrera, Dolores; Hernández-Fernaud, Estefanía; Rosales-Sánchez, Christian

2015-01-01

Work performance is one of the most important dependent variables in Work and Organizational Psychology. The main objective of this paper was to explore the relationships between citizenship performance and task performance measures obtained from different appraisers and their consistency through a seldom-used methodology, intraclass correlation coefficients. Participants were 135 public employees, the total staff in a local government department. Jobs were clustered into job families through a work analysis based on standard questionnaires. A task description technique was used to develop a performance appraisal questionnaire for each job family, with three versions: self-, supervisor-, and peer-evaluation, in addition to a measure of citizenship performance. Only when the self-appraisal bias is controlled, significant correlations appeared between task performance rates. However, intraclass correlations analyses show that only self- (contextual and task) performance measures are consistent, while interrater agreement disappears. These results provide some interesting clues about the procedure of appraisal instrument development, the role of appraisers, and the importance of choosing adequate consistency analysis methods. PMID:26473956

[Intraclass reliability of the Alberta Infant Motor Scale in the Brazilian version].

PubMed

Silva, Larissa Paiva; Maia, Polyana Candeia; Lopes, Márcia Maria Coelho Oliveira; Cardoso, Maria Vera Lúcia Moreira Leitão

2013-10-01

This study had as its objective to analyze the intraclass reliability of the Alberta Infant Motor Scale (AIMS), in the Brazilian version, in preterm and term infants. It was a methodological study, conducted from November 2009 to April 2010, with 50 children receiving care in two public institutions in Fortaleza, Ceará, Brazil. Children were grouped according to gestational age as preterm and term, and evaluated by three evaluators in the communication laboratory of a public institution or at home. The intraclass correlation indices for the categories prone, supine, sitting and standing ranged from 0.553 to 0.952; most remained above 0.800, except for the standing category of the third evaluator, in which the index was 0.553. As for the total score and percentile, rates ranged from 0.843 to 0.954. The scale proved to be a reliable instrument for assessing gross motor performance of Brazilian children, particularly in Ceará, regardless of gestational age at birth.

Interrater Agreement in the Radiologic Characterization of Ruptured Intracranial Aneurysms Based on Computed Tomography Angiography.

PubMed

Maldaner, Nicolai; Stienen, Martin N; Bijlenga, Philippe; Croci, Davide; Zumofen, Daniel W; Dalonzo, Donato; Marbacher, Serge; Maduri, Rodolfo; Daniel, Roy Thomas; Serra, Carlo; Esposito, Giuseppe; Neidert, Marian Christoph; Bozinov, Oliver; Regli, Luca; Burkhardt, Jan-Karl

2017-07-01

To determine interrater agreement in the initial radiologic characterization of ruptured intracranial aneurysms based on computed tomography angiography (CTA) with special emphasis on the rater's level of experience. One junior and one senior rater of 5 high-volume neurovascular tertiary centers evaluated anonymized CTA images of 30 consecutive patients with aneurysmal subarachnoid hemorrhage. Each rater described location, side, size, and morphology in a standardized manner. Interrater variability was analyzed using intraclass correlation and Fleiss' kappa analysis. There was a high level of agreement for location (κ = 0.76, 95% confidence interval [CI] 0.74-0.79), side (κ = 0.95, CI 0.91-0.99), maximum diameter (intraclass correlation coefficient [ICC] 0.81, CI 0.70-0.90), and dome (ICC 0.78, CI 0.66-0.88) of intracranial aneurysms. In contrast, a lower level of agreement was observed for aneurysms' neck diameter (ICC 0.39, CI 0.28-0.58), the presence of multiple aneurysms (κ = 0.35, CI 0.30-0.40), and aneurysm morphology (blister κ = 0.11, CI -0.05 to 0.07; fusiform κ = 0.54, CI 0.48-0.60; multilobular, κ = 0.39 CI 0.33-0.45). The interrater agreement in the senior rater group was greater than in the junior rater group. Interrater agreement confirms the benefit of CTA as initial diagnostic imaging in ruptured intracranial aneurysms but not for aneurysm morphology and presence of multiple aneurysms. A trend towards greater interrater agreement between more experienced raters was noticed. Copyright © 2017 Elsevier Inc. All rights reserved.

Pitfalls and important issues in testing reliability using intraclass correlation coefficients in orthopaedic research.

PubMed

Lee, Kyoung Min; Lee, Jaebong; Chung, Chin Youb; Ahn, Soyeon; Sung, Ki Hyuk; Kim, Tae Won; Lee, Hui Jong; Park, Moon Seok

2012-06-01

Intra-class correlation coefficients (ICCs) provide a statistical means of testing the reliability. However, their interpretation is not well documented in the orthopedic field. The purpose of this study was to investigate the use of ICCs in the orthopedic literature and to demonstrate pitfalls regarding their use. First, orthopedic articles that used ICCs were retrieved from the Pubmed database, and journal demography, ICC models and concurrent statistics used were evaluated. Second, reliability test was performed on three common physical examinations in cerebral palsy, namely, the Thomas test, the Staheli test, and popliteal angle measurement. Thirty patients were assessed by three orthopedic surgeons to explore the statistical methods testing reliability. Third, the factors affecting the ICC values were examined by simulating the data sets based on the physical examination data where the ranges, slopes, and interobserver variability were modified. Of the 92 orthopedic articles identified, 58 articles (63%) did not clarify the ICC model used, and only 5 articles (5%) described all models, types, and measures. In reliability testing, although the popliteal angle showed a larger mean absolute difference than the Thomas test and the Staheli test, the ICC of popliteal angle was higher, which was believed to be contrary to the context of measurement. In addition, the ICC values were affected by the model, type, and measures used. In simulated data sets, the ICC showed higher values when the range of data sets were larger, the slopes of the data sets were parallel, and the interobserver variability was smaller. Care should be taken when interpreting the absolute ICC values, i.e., a higher ICC does not necessarily mean less variability because the ICC values can also be affected by various factors. The authors recommend that researchers clarify ICC models used and ICC values are interpreted in the context of measurement.

Test-Retest Reliability of Rating of Perceived Exertion and Agreement With 1-Repetition Maximum in Adults.

PubMed

Bove, Allyn M; Lynch, Andrew D; DePaul, Samantha M; Terhorst, Lauren; Irrgang, James J; Fitzgerald, G Kelley

2016-09-01

Study Design Clinical measurement. Background It has been suggested that rating of perceived exertion (RPE) may be a useful alternative to 1-repetition maximum (1RM) to determine proper resistance exercise dosage. However, the test-retest reliability of RPE for resistance exercise has not been determined. Additionally, prior research regarding the relationship between 1RM and RPE is conflicting. Objectives The purpose of this study was to (1) determine test-retest reliability of RPE related to resistance exercise and (2) assess agreement between percentages of 1RM and RPE during quadriceps resistance exercise. Methods A sample of participants with and without knee pathology completed a series of knee extension exercises and rated the perceived difficulty of each exercise on a 0-to-10 RPE scale, then repeated the procedure 1 to 2 weeks later for test-retest reliability. To determine agreement between RPE and 1RM, participants completed knee extension exercises at various percentages of their 1RM (10% to 130% of predicted 1RM) and rated the perceived difficulty of each exercise on a 0-to-10 RPE scale. Percent agreement was calculated between the 1RM and RPE at each resistance interval. Results The intraclass correlation coefficient indicated excellent test-retest reliability of RPE for quadriceps resistance exercises (intraclass correlation coefficient = 0.895; 95% confidence interval: 0.866, 0.918). Overall percent agreement between RPE and 1RM was 60%, but agreement was poor within the ranges that would typically be used for training (50% 1RM for muscle endurance, 70% 1RM and greater for strength). Conclusion Test-retest reliability of perceived exertion during quadriceps resistance exercise was excellent. However, agreement between the RPE and 1RM was poor, especially in common training zones for knee extensor strengthening. J Orthop Sports Phys Ther 2016;46(9):768-774. Epub 5 Aug 2016. doi:10.2519/jospt.2016.6498.

Agreement between Internet-based self- and proxy-reported health care resource utilization and administrative health care claims.

PubMed

Palmer, Liisa; Johnston, Stephen S; Rousculp, Matthew D; Chu, Bong-Chul; Nichol, Kristin L; Mahadevia, Parthiv J

2012-05-01

Although Internet-based surveys are becoming more common, little is known about agreement between administrative claims data and Internet-based survey self- and proxy-reported health care resource utilization (HCRU) data. This analysis evaluated the level of agreement between self- and proxy-reported HCRU data, as recorded through an Internet-based survey, and administrative claims-based HCRU data. The Child and Household Influenza-Illness and Employee Function study collected self- and proxy-reported HCRU data monthly between November 2007 and May 2008. Data included the occurrence and number of visits to hospitals, emergency departments, urgent care centers, and outpatient offices for a respondent's and his or her household members' care. Administrative claims data from the MarketScan® Databases were assessed during the same time and evaluated relative to survey-based metrics. Only data for individuals with employer-sponsored health care coverage linkable to claims were included. The Kappa (κ) statistic was used to evaluate visit concordance, and the intraclass correlation coefficient was used to describe frequency consistency. Agreement for presence of a health care visit and the number of visits were similar for self- and proxy-reported HCRU data. There was moderate to substantial agreement related to health care visit occurrence between survey-based and claims-based HCRU data for inpatient, emergency department, and office visits (κ: 0.47-0.77). There was less agreement on health care visit frequencies, with intraclass correlation coefficient values ranging from 0.14 to 0.71. This study's agreement values suggest that Internet-based surveys are an effective method to collect self- and proxy-reported HCRU data. These results should increase confidence in the use of the Internet for evaluating disease burden. Copyright © 2012 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Performance of intraclass correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies.

PubMed

Mehta, Shraddha; Bastero-Caballero, Rowena F; Sun, Yijun; Zhu, Ray; Murphy, Diane K; Hardas, Bhushan; Koch, Gary

2018-04-29

Many published scale validation studies determine inter-rater reliability using the intra-class correlation coefficient (ICC). However, the use of this statistic must consider its advantages, limitations, and applicability. This paper evaluates how interaction of subject distribution, sample size, and levels of rater disagreement affects ICC and provides an approach for obtaining relevant ICC estimates under suboptimal conditions. Simulation results suggest that for a fixed number of subjects, ICC from the convex distribution is smaller than ICC for the uniform distribution, which in turn is smaller than ICC for the concave distribution. The variance component estimates also show that the dissimilarity of ICC among distributions is attributed to the study design (ie, distribution of subjects) component of subject variability and not the scale quality component of rater error variability. The dependency of ICC on the distribution of subjects makes it difficult to compare results across reliability studies. Hence, it is proposed that reliability studies should be designed using a uniform distribution of subjects because of the standardization it provides for representing objective disagreement. In the absence of uniform distribution, a sampling method is proposed to reduce the non-uniformity. In addition, as expected, high levels of disagreement result in low ICC, and when the type of distribution is fixed, any increase in the number of subjects beyond a moderately large specification such as n = 80 does not have a major impact on ICC. Copyright © 2018 John Wiley & Sons, Ltd.

Testing the Difference of Correlated Agreement Coefficients for Statistical Significance

ERIC Educational Resources Information Center

Gwet, Kilem L.

2016-01-01

This article addresses the problem of testing the difference between two correlated agreement coefficients for statistical significance. A number of authors have proposed methods for testing the difference between two correlated kappa coefficients, which require either the use of resampling methods or the use of advanced statistical modeling…

Parent–Youth Agreement on Self-Reported Competencies of Youth With Depressive and Suicidal Symptoms

PubMed Central

Mbekou, Valentin; MacNeil, Sasha; Gignac, Martin; Renaud, Johanne

2015-01-01

Objective: A multi-informant approach is often used in child psychiatry. The Achenbach System of Empirically Based Assessment uses this approach, gathering parent reports on the Child Behaviour Checklist (CBCL) and youth reports on the Youth Self-Report (YSR), which contain scales assessing both the child’s problems and competencies. Agreement between parent and youth perceptions of their competencies on these forms has not been studied to date. Method: Our study examined the parent–youth agreement of competencies on the CBCL and YSR from a sample of 258 parent–youth dyads referred to a specialized outpatient clinic for depressive and suicidal disorders. Intraclass correlation coefficients were calculated for all competency scales (activity, social, and academic), with further examinations based on youth’s sex, age, and type of problem. Results: Weak-to-moderate parent–youth agreements were reported on the activities and social subscales. For the activities subscale, boys’ ratings had a strong correlation with parents’ ratings, while it was weak for girls. Also, agreement on activities and social subscales was stronger for dyads with the youth presenting externalizing instead of internalizing problems. Conclusion: Agreement on competencies between parents and adolescents varied based on competency and adolescent sex, age, and type of problem. PMID:25886673

Agreement of repeated motor and sensory scores at individual myotomes and dermatomes in young persons with spinal cord injury.

PubMed

Krisa, L; Gaughan, J; Vogel, L; Betz, R R; Mulcahey, M J

2013-01-01

A prospective repeated measures multicenter study to determine reliability at individual spinal levels when applied to young persons with spinal cord injury (SCI). To evaluate intra- and inter-rater agreement of repeated motor and sensory scores at individual spinal levels. Shriners Hospitals for Children--Philadelphia and Chicago, USA. A total 189 youth with complete and incomplete SCI underwent four neurological exams by two different raters. Agreement between and within raters for each myotome and dermatome was evaluated for complete and incomplete SCI separately. Intraclass correlation coefficients and 95% confidence intervals were calculated. Overall, both intra- and inter-rater agreement resulted in moderate-to-high agreement among myotomes. Subjects with complete SCI had moderate agreement for light touch (LT) and pin prick (PP) testing, whereas subjects with incomplete SCI had >60.0% of dermatomes resulting in poor agreement for PP testing. Overall, moderate-to-high agreement was found for muscle strength comparisons and moderate-to-poor agreement was found for PP and LT.

Agreement between FRAX scores calculated with and without bone mineral density in women with osteopenia in Turkey.

PubMed

Olmez Sarikaya, Nese; Kapar Yavasi, Secil; Tan, Gulten; Satiroglu, Servet; Yildiz, Arife Hilal; Oz, Bengi; Yoleri, Ozlem; Memis, Asuman

2014-12-01

This study aimed to analyze the agreement between FRAX scores calculated with and without femoral neck (FN) bone mineral density (BMD) and to investigate the resultant treatment recommendations in women with osteopenia. A cross-sectional review of postmenopausal women who were referred for DXA evaluation was conducted. One hundred twenty-nine postmenopausal women aged 40 years and older with osteopenia [FN T-score between -1 and (-2.5)] were recruited for the study. Absolute agreement between FRAX scores calculated with and without BMD was analyzed by intraclass correlation analysis (ICC). Thresholds recommended by National Osteoporosis Foundation were used for treatment recommendations. Correlation between demographic factors and the difference in BMD+ and BMD- FRAX scores was analyzed by Spearman correlation test. Agreement levels and treatment recommendations were also analyzed in 112/129 patients without previous fracture. Agreement between BMD+ and BMD- MO and hip FRAX scores was good (ICC 0.867) and fair to good (ICC 0.641), respectively. In patients without previous fracture, agreement between MO and hip fracture probabilities was good (ICC = 0.838 and ICC = 0.778, respectively). Treatment recommendations with respect to treatment threshold of ≥3 for hip fracture probabilities were identical in 120/129 (93 %) cases. Difference between BMD+ and BMD- fracture probabilities was correlated with age and FN BMD. In most cases, FRAX without BMD provided the same treatment recommendations as FRAX with BMD in postmenopausal women with osteopenia. Exclusion of patients with previous fracture yielded better agreement levels.

Effect of ergonomics training on agreement between expert and nonexpert ratings of the potential for musculoskeletal harm in manufacturing tasks.

PubMed

Fethke, Nathan B; Merlino, Linda; Gerr, Fred

2013-12-01

To evaluate the effect of ergonomics training on non-ergonomists' ability to recognize and characterize the potential for musculoskeletal harm in manufacturing tasks. Ergonomics training was delivered to members of a participatory ergonomics team in a manufacturing facility. Before and after training, participatory ergonomics team members and the research team rated the potential for musculoskeletal harm for each of 30 tasks. Measures of agreement included Pearson, concordance, and intraclass correlation coefficients. Measures of agreement generally improved after training. The greatest agreement was observed for ratings of the potential for musculoskeletal harm to the low back. The greatest improvement in agreement was observed for ratings of the potential for musculoskeletal harm to the neck/shoulder. The training seemed to improve non-experts' ability to identify the potential for musculoskeletal harm.

Gas exchange and lactate anaerobic thresholds: inter- and intraevaluator agreement.

PubMed

Gladden, L B; Yates, J W; Stremel, R W; Stamford, B A

1985-06-01

Twenty-four coded graph sets of gas exchange variables and blood lactate concentration (LA) plotted against time at 15-s intervals were analyzed by nine evaluators who determined the gas exchange (ATGE) and LA (ATLA) anaerobic thresholds. In addition, ATGE and ATLA were determined by a linear regression computer program. Agreement between ATGE and ATLA was poor; the median intraclass correlation coefficient (ri) was 0.53. Among evaluators, ATLA agreement (median ri = 0.81) was better than ATGE agreement (median ri = 0.70). In general, the ability of any evaluator to choose similar values from duplicate plots for either ATGE (median ri = 0.97) or ATLA (median ri = 0.995) was good. There was better agreement between the mean ATLA of the evaluators and the computer ATLA (ComLA) (ri = 0.88) than between the mean ATGE of the evaluators and the computer ATGE (ComVE), (ri = 0.58). Agreement between ComVE and ComLA was poor (ri = 0.29). These results suggest that ATGE does not accurately predict ATLA and that different evaluators choose different thresholds from the same data. Further assessment of the validity and precision of ATGE based on breath-by-breath and minute-by-minute data is needed.

Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy-based brain imaging

NASA Astrophysics Data System (ADS)

Li, Lin; Zeng, Li; Lin, Zi-Jing; Cazzell, Mary; Liu, Hanli

2015-05-01

Test-retest reliability of neuroimaging measurements is an important concern in the investigation of cognitive functions in the human brain. To date, intraclass correlation coefficients (ICCs), originally used in inter-rater reliability studies in behavioral sciences, have become commonly used metrics in reliability studies on neuroimaging and functional near-infrared spectroscopy (fNIRS). However, as there are six popular forms of ICC, the adequateness of the comprehensive understanding of ICCs will affect how one may appropriately select, use, and interpret ICCs toward a reliability study. We first offer a brief review and tutorial on the statistical rationale of ICCs, including their underlying analysis of variance models and technical definitions, in the context of assessment on intertest reliability. Second, we provide general guidelines on the selection and interpretation of ICCs. Third, we illustrate the proposed approach by using an actual research study to assess intertest reliability of fNIRS-based, volumetric diffuse optical tomography of brain activities stimulated by a risk decision-making protocol. Last, special issues that may arise in reliability assessment using ICCs are discussed and solutions are suggested.

Correlation or Limits of Agreement? Applying the Bland-Altman Approach to the Comparison of Cognitive Screening Instruments.

PubMed

Larner, A J

2016-01-01

Calculation of correlation coefficients is often undertaken as a way of comparing different cognitive screening instruments (CSIs). However, test scores may correlate but not agree, and high correlation may mask lack of agreement between scores. The aim of this study was to use the methodology of Bland and Altman to calculate limits of agreement between the scores of selected CSIs and contrast the findings with Pearson's product moment correlation coefficients between the test scores of the same instruments. Datasets from three pragmatic diagnostic accuracy studies which examined the Mini-Mental State Examination (MMSE) vs. the Montreal Cognitive Assessment (MoCA), the MMSE vs. the Mini-Addenbrooke's Cognitive Examination (M-ACE), and the M-ACE vs. the MoCA were analysed to calculate correlation coefficients and limits of agreement between test scores. Although test scores were highly correlated (all >0.8), calculated limits of agreement were broad (all >10 points), and in one case, MMSE vs. M-ACE, was >15 points. Correlation is not agreement. Highly correlated test scores may conceal broad limits of agreement, consistent with the different emphases of different tests with respect to the cognitive domains examined. Routine incorporation of limits of agreement into diagnostic accuracy studies which compare different tests merits consideration, to enable clinicians to judge whether or not their agreement is close. © 2016 S. Karger AG, Basel.

Reliability and agreement in the use of four- and six-point ordinal scales for the assessment of erythema in digital images of canine skin.

PubMed

Hill, Peter B

2015-06-01

Grading of erythema in clinical practice is a subjective assessment that cannot be confirmed using a definitive test; nevertheless, erythema scores are typically measured in clinical trials assessing the response to treatment interventions. Most commonly, ordinal scales are used for this purpose, but the optimal number of categories in such scales has not been determined. This study aimed to compare the reliability and agreement of a four-point and a six-point ordinal scale for the assessment of erythema in digital images of canine skin. Fifteen digital images showing varying degrees of erythema were assessed by specialist dermatologists and laypeople, using either the four-point or the six-point scale. Reliability between the raters was assessed using intraclass correlation coefficients and Cronbach's α. Agreement was assessed using the variation ratio (the percentage of respondents who chose the mode, the most common answer). Intraobserver variability was assessed by comparing the results of two grading sessions, at least 6 weeks apart. Both scales demonstrated high reliability, with intraclass correlation coefficient values and Cronbach's α above 0.99. However, the four-point scale demonstrated significantly superior agreement, with variation ratios for the four-point scale averaging 74.8%, compared with 56.2% for the six-point scale. Intraobserver consistency for the four-point scale was very high. Although both scales demonstrated high reliability, the four-point scale was superior in terms of agreement. For the assessment of erythema in clinical trials, a four-point ordinal scale is recommended. © 2014 ESVD and ACVD.

Inter- and intra-rater reliability and agreement in determining subcutaneous tumour margins in dogs.

PubMed

Ranganathan, B; Milovancev, M; Leeper, H; Townsend, K L; Bracha, S; Curran, K

2018-03-01

The objective of this prospective study was to evaluate agreement and reliability of calliper-based measurements of locally invasive subcutaneous malignant tumours in dogs. Four raters measured the longest diameter of 12 subcutaneous tumours (7 soft tissue sarcomas and 5 mast cell tumours) from 11 client-owned dogs during 3 randomized, blinded measurement trials, both pre- and post-sedation. Inter- and intra-rater reliability was evaluated using intra-class correlation coefficient (ICC) and agreement was evaluated using Bland-Altman plots. Inter- and intra-rater reliability was good (ICC range of 0.8694-0.89520) and excellent (ICC range of 0.9720-0.9966), respectively. For agreement calculations, an a priori clinically relevant limit of agreement of 10 mm was set. Inter- and intra-rater agreement was unacceptable with inter-rater limits of agreement ranging from 15.9 to 55.6 mm and intra-rater limit of agreement ranging from 11.9 to 28.1 mm. Review of the measurement trial photographs revealed that calliper orientation changes were frequent, occurring in 9/12 (75%) and 8/12 (67%) pre- and post-sedation cases. No significant correlation was found between inter-rater measurement standard deviations and calliper orientation changes or dog body condition score. These findings suggest veterinarians may have poor agreement in determining the gross edge of tumours, which is expected to introduce bias and inconsistency in tumour staging, assessing response to therapy, and surgical margin planning. Due to the potential consequences for veterinary cancer patients, future studies are needed to validate the present findings. © 2018 John Wiley & Sons Ltd.

Agreement of Tracing and Direct Viewing Techniques for Cervical Vertebral Maturation Assessment.

PubMed

Wiwatworakul, Opas; Manosudprasit, Montian; Pisek, Poonsak; Chatrchaiwiwatana, Supaporn; Wangsrimongkol, Tasanee

2015-08-01

This study aimed to evaluate agreement among three methods for cervical vertebral maturation (CVM) assessment, comprising direct viewing, tracing only, and tracing with digitized points. Two examiners received training and tests of reliability with each CVM method before evaluation of agreement among methods. The subjects were 96 female-cleft lateral cephalometric radiographs (films of eight subjects for each age ranged from seven to 18 years). The examiners interpreted CVM stages of the subjects with four-week interval between uses of each method. The range of weighted kappa values for paired comparisons among the three methods were: 0.96-0.98 for direct viewing and tracing only comparison; 0.93-0.94 for direct viewing and tracing with digitized points comparison; and 0.96-0.97 for tracing only and tracing with digitized points comparison. The intraclass correlation coefficient (ICC) value among the three methods was 0.95. These results indicated very good agreement among methods. Use of direct viewing is suitable for CVM assessment without spending more time for tracing. However, the three methods might be used interchangeably.

Semi-quantitative methods yield greater inter- and intraobserver agreement than subjective methods for interpreting 99m technetium-hydroxymethylene-diphosphonate uptake in equine thoracic processi spinosi.

PubMed

van Zadelhoff, Claudia; Ehrle, Anna; Merle, Roswitha; Jahn, Werner; Lischer, Christoph

2018-05-09

Scintigraphy is a standard diagnostic method for evaluating horses with back pain due to suspected thoracic processus spinosus pathology. Lesion detection is based on subjective or semi-quantitative assessments of increased uptake. This retrospective, analytical study is aimed to compare semi-quantitative and subjective methods in the evaluation of scintigraphic images of the processi spinosi in the equine thoracic spine. Scintigraphic images of 20 Warmblood horses, presented for assessment of orthopedic conditions between 2014 and 2016, were included in the study. Randomized, blinded image evaluation was performed by 11 veterinarians using subjective and semi-quantitative methods. Subjective grading was performed for the analysis of red-green-blue and grayscale scintigraphic images, which were presented in full-size or as masked images. For the semi-quantitative assessment, observers placed regions of interest over each processus spinosus. The uptake ratio of each processus spinosus in comparison to a reference region of interest was determined. Subsequently, a modified semi-quantitative calculation was developed whereby only the highest counts-per-pixel for a specified number of pixels was processed. Inter- and intraobserver agreement was calculated using intraclass correlation coefficients. Inter- and intraobserver intraclass correlation coefficients were 41.65% and 71.39%, respectively, for the subjective image assessment. Additionally, a correlation between intraobserver agreement, experience, and grayscale images was identified. The inter- and intraobserver agreement was significantly increased when using semi-quantitative analysis (97.35% and 98.36%, respectively) or the modified semi-quantitative calculation (98.61% and 98.82%, respectively). The proposed modified semi-quantitative technique showed a higher inter- and intraobserver agreement when compared to other methods, which makes it a useful tool for the analysis of scintigraphic images. The

The coefficient of determination R2 and intra-class correlation coefficient from generalized linear mixed-effects models revisited and expanded.

PubMed

Nakagawa, Shinichi; Johnson, Paul C D; Schielzeth, Holger

2017-09-01

The coefficient of determination R 2 quantifies the proportion of variance explained by a statistical model and is an important summary statistic of biological interest. However, estimating R 2 for generalized linear mixed models (GLMMs) remains challenging. We have previously introduced a version of R 2 that we called [Formula: see text] for Poisson and binomial GLMMs, but not for other distributional families. Similarly, we earlier discussed how to estimate intra-class correlation coefficients (ICCs) using Poisson and binomial GLMMs. In this paper, we generalize our methods to all other non-Gaussian distributions, in particular to negative binomial and gamma distributions that are commonly used for modelling biological data. While expanding our approach, we highlight two useful concepts for biologists, Jensen's inequality and the delta method, both of which help us in understanding the properties of GLMMs. Jensen's inequality has important implications for biologically meaningful interpretation of GLMMs, whereas the delta method allows a general derivation of variance associated with non-Gaussian distributions. We also discuss some special considerations for binomial GLMMs with binary or proportion data. We illustrate the implementation of our extension by worked examples from the field of ecology and evolution in the R environment. However, our method can be used across disciplines and regardless of statistical environments. © 2017 The Author(s).

Agreement among readers on what is relevant in self-help psychology books.

PubMed

Forest, James J; Del Ben, Kevin; Toews, Stuart B

2003-12-01

It was hypothesized that text marking in self-help psychology books would indicate that readers agree on which pages and lines contain relevant information. Previously owned copies of two self-help book titles (n=48, n=38), all with marked text, were collected from second-hand book stores and scored for line and page marking. Chi-squares for goodness-of-fit yielded significant differences between observed and chance agreement in marking behavior. Intraclass and KR-20 correlations were significantly different from zero, suggesting that readers agreed on what information was relevant and irrelevant. Actual users of self-help books may have similar standards because of cultural values, social group relations, or common problem experiences.

Echocardiographic agreement in the diagnostic evaluation for infective endocarditis.

PubMed

Lauridsen, Trine Kiilerich; Selton-Suty, Christine; Tong, Steven; Afonso, Luis; Cecchi, Enrico; Park, Lawrence; Yow, Eric; Barnhart, Huiman X; Paré, Carlos; Samad, Zainab; Levine, Donald; Peterson, Gail; Stancoven, Amy Butler; Johansson, Magnus Carl; Dickerman, Stuart; Tamin, Syahidah; Habib, Gilbert; Douglas, Pamela S; Bruun, Niels Eske; Crowley, Anna Lisa

2016-07-01

Echocardiography is essential for the diagnosis and management of infective endocarditis (IE). However, the reproducibility for the echocardiographic assessment of variables relevant to IE is unknown. Objectives of this study were: (1) To define the reproducibility for IE echocardiographic variables and (2) to describe a methodology for assessing quality in an observational cohort containing site-interpreted data. IE reproducibility was assessed on a subset of echocardiograms from subjects enrolled in the International Collaboration on Endocarditis registry. Specific echocardiographic case report forms were used. Intra-observer agreement was assessed from six site readers on ten randomly selected echocardiograms. Inter-observer agreement between sites and an echocardiography core laboratory was assessed on a separate random sample of 110 echocardiograms. Agreement was determined using intraclass correlation (ICC), coverage probability (CP), and limits of agreement for continuous variables and kappa statistics (κweighted) and CP for categorical variables. Intra-observer agreement for LVEF was excellent [ICC = 0.93 ± 0.1 and all pairwise differences for LVEF (CP) were within 10 %]. For IE categorical echocardiographic variables, intra-observer agreement was best for aortic abscess (κweighted = 1.0, CP = 1.0 for all readers). Highest inter-observer agreement for IE categorical echocardiographic variables was obtained for vegetation location (κweighted = 0.95; 95 % CI 0.92-0.99) and lowest agreement was found for vegetation mobility (κweighted = 0.69; 95 % CI 0.62-0.86). Moderate to excellent intra- and inter-observer agreement is observed for echocardiographic variables in the diagnostic assessment of IE. A pragmatic approach for determining echocardiographic data reproducibility in a large, multicentre, site interpreted observational cohort is feasible.

The relationship between multilevel models and non-parametric multilevel mixture models: Discrete approximation of intraclass correlation, random coefficient distributions, and residual heteroscedasticity.

PubMed

Rights, Jason D; Sterba, Sonya K

2016-11-01

Multilevel data structures are common in the social sciences. Often, such nested data are analysed with multilevel models (MLMs) in which heterogeneity between clusters is modelled by continuously distributed random intercepts and/or slopes. Alternatively, the non-parametric multilevel regression mixture model (NPMM) can accommodate the same nested data structures through discrete latent class variation. The purpose of this article is to delineate analytic relationships between NPMM and MLM parameters that are useful for understanding the indirect interpretation of the NPMM as a non-parametric approximation of the MLM, with relaxed distributional assumptions. We define how seven standard and non-standard MLM specifications can be indirectly approximated by particular NPMM specifications. We provide formulas showing how the NPMM can serve as an approximation of the MLM in terms of intraclass correlation, random coefficient means and (co)variances, heteroscedasticity of residuals at level 1, and heteroscedasticity of residuals at level 2. Further, we discuss how these relationships can be useful in practice. The specific relationships are illustrated with simulated graphical demonstrations, and direct and indirect interpretations of NPMM classes are contrasted. We provide an R function to aid in implementing and visualizing an indirect interpretation of NPMM classes. An empirical example is presented and future directions are discussed. © 2016 The British Psychological Society.

A Statistical Analysis of Reviewer Agreement and Bias in Evaluating Medical Abstracts 1

PubMed Central

Cicchetti, Domenic V.; Conn, Harold O.

1976-01-01

Observer variability affects virtually all aspects of clinical medicine and investigation. One important aspect, not previously examined, is the selection of abstracts for presentation at national medical meetings. In the present study, 109 abstracts, submitted to the American Association for the Study of Liver Disease, were evaluated by three “blind” reviewers for originality, design-execution, importance, and overall scientific merit. Of the 77 abstracts rated for all parameters by all observers, interobserver agreement ranged between 81 and 88%. However, corresponding intraclass correlations varied between 0.16 (approaching statistical significance) and 0.37 (p < 0.01). Specific tests of systematic differences in scoring revealed statistically significant levels of observer bias on most of the abstract components. Moreover, the mean differences in interobserver ratings were quite small compared to the standard deviations of these differences. These results emphasize the importance of evaluating the simple percentage of rater agreement within the broader context of observer variability and systematic bias. PMID:997596

Factors influencing agreement between child self-report and parent proxy-reports on the Pediatric Quality of Life Inventory 4.0 (PedsQL) generic core scales.

PubMed

Cremeens, Joanne; Eiser, Christine; Blades, Mark

2006-08-30

In situations where children are unable or unwilling to respond for themselves, measurement of quality of life (QOL) is often obtained by parent proxy-report. However the relationship between child self and parent proxy-reports has been shown to be poor in some circumstances. Additionally the most appropriate statistical method for comparing ratings between child and parent proxy-reports has not been clearly established. The objectives of this study were to assess the: 1) agreement between child and parent proxy-reports on an established child QOL measure (the PedsQL) using two different statistical methods; 2) effect of chronological age and domain type on agreement between children's and parents' reports on the PedsQL; 3) relationship between parents' own well-being and their ratings of their child's QOL. One hundred and forty-nine healthy children (5.5 - 6.5, 6.5 - 7.5, and 7.5 - 8.5 years) completed the PedsQL. One hundred and three of their parents completed these measures in relation to their child, and a measure of their own QOL (SF-36). Consistency between child and parent proxy-reports on the PedsQL was low, with Intra-Class correlation coefficients ranging from 0.02 to 0.23. Correlations were higher for the oldest age group for Total Score and Psychosocial Health domains, and for the Physical Health domain in the youngest age group. Statistically significant median differences were found between child and parent-reports on all subscales of the PedsQL. The largest median differences were found for the two older age groups. Statistically significant correlations were found between parents' own QOL and their proxy-reports of child QOL across the total sample and within the middle age group. Intra-Class correlation coefficients and median difference testing can provide different information on the relationship between parent proxy-reports and child self-reports. Our findings suggest that differences in the levels of parent-child agreement previously reported

Intraclass correlation estimates for cancer screening outcomes: estimates and applications in the design of group-randomized cancer screening studies.

PubMed

Hade, Erinn M; Murray, David M; Pennell, Michael L; Rhoda, Dale; Paskett, Electra D; Champion, Victoria L; Crabtree, Benjamin F; Dietrich, Allen; Dignan, Mark B; Farmer, Melissa; Fenton, Joshua J; Flocke, Susan; Hiatt, Robert A; Hudson, Shawna V; Mitchell, Michael; Monahan, Patrick; Shariff-Marco, Salma; Slone, Stacey L; Stange, Kurt; Stewart, Susan L; Strickland, Pamela A Ohman

2010-01-01

Screening has become one of our best tools for early detection and prevention of cancer. The group-randomized trial is the most rigorous experimental design for evaluating multilevel interventions. However, identifying the proper sample size for a group-randomized trial requires reliable estimates of intraclass correlation (ICC) for screening outcomes, which are not available to researchers. We present crude and adjusted ICC estimates for cancer screening outcomes for various levels of aggregation (physician, clinic, and county) and provide an example of how these ICC estimates may be used in the design of a future trial. Investigators working in the area of cancer screening were contacted and asked to provide crude and adjusted ICC estimates using the analysis of variance method estimator. Of the 29 investigators identified, estimates were obtained from 10 investigators who had relevant data. ICC estimates were calculated from 13 different studies, with more than half of the studies collecting information on colorectal screening. In the majority of cases, ICC estimates could be adjusted for age, education, and other demographic characteristics, leading to a reduction in the ICC. ICC estimates varied considerably by cancer site and level of aggregation of the groups. Previously, only two articles had published ICCs for cancer screening outcomes. We have complied more than 130 crude and adjusted ICC estimates covering breast, cervical, colon, and prostate screening and have detailed them by level of aggregation, screening measure, and study characteristics. We have also demonstrated their use in planning a future trial and the need for the evaluation of the proposed interval estimator for binary outcomes under conditions typically seen in GRTs.

Agreement between sleep diary and actigraphy in a highly educated Brazilian population.

PubMed

Campanini, Marcela Zambrim; Lopez-Garcia, Esther; Rodríguez-Artalejo, Fernando; González, Alberto Durán; Andrade, Selma Maffei; Mesas, Arthur Eumann

2017-07-01

This study evaluated the agreement between a sleep diary and actigraphy on the assessment of sleep parameters among school teachers from Brazil. A total of 163 teachers (66.3% women; aged 45 ± 9 years) filled out a sleep diary and wore a wrist actigraph device for seven consecutive days. Data were collected from August 2014 to March 2015 in Londrina, a large city in southern Brazil. Intraclass correlation coefficients (ICC) and Pearson correlation coefficients (r) were used to compare self-reported and actigraphic data. Self-reported total sleep time (TST), sleep onset latency (SOL), and sleep efficiency were higher than measured by actigraphy (mean difference: 22.6 ± 46.9 min, 2.6 ± 13.3 min, and 7.3± 5.7%, respectively). Subjective total time in bed (TIB) and wake-up time were lower than measured by actigraphy (mean difference: -10.7 ± 37.6 and -19.7 ± 29.6, respectively). Moderate or good agreement and correlation were found between the sleep diary and the actigraphic data for TST (ICC = 0.70; r = 0.60), TIB (ICC = 0.83; r = 0.73), bedtime (ICC = 0.95; r = 0.91), sleep start time (ICC = 0.94; r = 0.88), and wake-up time (ICC = 0.87; r = 0.78). However, SOL (ICC = 0.49; r = 0.38) and sleep efficiency (ICC = 0.16; r = 0.22) showed only fair or poor agreement and correlation. In this highly educated population, the sleep diary and the actigraphy showed moderate or good agreement to assess several sleep parameters. However, these methods seemed to measure different dimensions of sleep regarding sleep onset latency and efficiency. These findings moderately varied according to the individual's subjective sleep quality. Copyright © 2017 Elsevier B.V. All rights reserved.

Intraclass correlation and design effect in BMI, physical activity and diet: a cross-sectional study of 56 countries.

PubMed

Masood, Mohd; Reidpath, Daniel D

2016-01-07

Measuring the intraclass correlation coefficient (ICC) and design effect (DE) may help to modify the public health interventions for body mass index (BMI), physical activity and diet according to geographic targeting of interventions in different countries. The purpose of this study was to quantify the level of clustering and DE in BMI, physical activity and diet in 56 low-income, middle-income and high-income countries. Cross-sectional study design. Multicountry national survey data. The World Health Survey (WHS), 2003, data were used to examine clustering in BMI, physical activity in metabolic equivalent of task (MET) and diet in fruits and vegetables intake (FVI) from low-income, middle-income and high-income countries. Multistage sampling in the WHS used geographical clusters as primary sampling units (PSU). These PSUs were used as a clustering or grouping variable in this analysis. Multilevel intercept only regression models were used to calculate the ICC and DE for each country. The median ICC (0.039) and median DE (1.82) for BMI were low; however, FVI had a higher median ICC (0.189) and median DE (4.16). For MET, the median ICC was 0.141 and median DE was 4.59. In some countries, however, the ICC and DE for BMI were large. For instance, South Africa had the highest ICC (0.39) and DE (11.9) for BMI, whereas Uruguay had the highest ICC (0.434) for MET and Ethiopia had the highest ICC (0.471) for FVI. This study shows that across a wide range of countries, there was low area level clustering for BMI, whereas MET and FVI showed high area level clustering. These results suggested that the country level clustering effect should be considered in developing preventive approaches for BMI, as well as improving physical activity and healthy diets for each country. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Intraclass Correlation Coefficients for Obesity Indicators and Energy Balance-Related Behaviors Among New York City Public Elementary Schools.

PubMed

Gray, Heewon Lee; Burgermaster, Marissa; Tipton, Elizabeth; Contento, Isobel R; Koch, Pamela A; Di Noia, Jennifer

2016-04-01

Sample size and statistical power calculation should consider clustering effects when schools are the unit of randomization in intervention studies. The objective of the current study was to investigate how student outcomes are clustered within schools in an obesity prevention trial. Baseline data from the Food, Health & Choices project were used. Participants were 9- to 13-year-old students enrolled in 20 New York City public schools (n= 1,387). Body mass index (BMI) was calculated based on measures of height and weight, and body fat percentage was measured with a Tanita® body composition analyzer (Model SC-331s). Energy balance-related behaviors were self-reported with a frequency questionnaire. To examine the cluster effects, intraclass correlation coefficients (ICCs) were calculated as school variance over total variance for outcome variables. School-level covariates, percentage students eligible for free and reduced-price lunch, percentage Black or Hispanic, and English language learners were added in the model to examine ICC changes. The ICCs for obesity indicators are: .026 for BMI-percentile, .031 for BMIz-score, .035 for percentage of overweight students, .037 for body fat percentage, and .041 for absolute BMI. The ICC range for the six energy balance-related behaviors are .008 to .044 for fruit and vegetables, .013 to .055 for physical activity, .031 to .052 for recreational screen time, .013 to .091 for sweetened beverages, .033 to .121 for processed packaged snacks, and .020 to .083 for fast food. When school-level covariates were included in the model, ICC changes varied from -95% to 85%. This is the first study reporting ICCs for obesity-related anthropometric and behavioral outcomes among New York City public schools. The results of the study may aid sample size estimation for future school-based cluster randomized controlled trials in similar urban setting and population. Additionally, identifying school-level covariates that can reduce cluster

Estimation of occupational cosmic radiation exposure among airline personnel: Agreement between a job-exposure matrix, aggregate, and individual dose estimates.

PubMed

Talibov, Madar; Salmelin, Raili; Lehtinen-Jacks, Susanna; Auvinen, Anssi

2017-04-01

Job-exposure matrices (JEM) are used for exposure assessment in occupational studies, but they can involve errors. We assessed agreement between the Nordic Occupational Cancer Studies JEM (NOCCA-JEM) and aggregate and individual dose estimates for cosmic radiation exposure among Finnish airline personnel. Cumulative cosmic radiation exposure for 5,022 airline crew members was compared between a JEM and aggregate and individual dose estimates. The NOCCA-JEM underestimated individual doses. Intraclass correlation coefficient was 0.37, proportion of agreement 64%, kappa 0.46 compared with individual doses. Higher agreement was achieved with aggregate dose estimates, that is annual medians of individual doses and estimates adjusted for heliocentric potentials. The substantial disagreement between NOCCA-JEM and individual dose estimates of cosmic radiation may lead to exposure misclassification and biased risk estimates in epidemiological studies. Using aggregate data may provide improved estimates. Am. J. Ind. Med. 60:386-393, 2017. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

SPSS Macros for Assessing the Reliability and Agreement of Student Evaluations of Teaching

ERIC Educational Resources Information Center

Morley, Donald D.

2009-01-01

This article reports and demonstrates two SPSS macros for calculating Krippendorff's alpha and intraclass reliability coefficients in repetitive situations where numerous coefficients are needed. Specifically, the reported SPSS macros were used to evaluate the interrater agreement and reliability of student evaluations of teaching in thousands of…

[Evaluation of agreement and correlation of three occlusal indices in an assessment of orthodontic treatment need].

PubMed

Djordjević, Jelena; Sćepan, Ivana; Glisić, Branislav

2011-02-01

Occlusal indices are quantitative diagnostic indicators of malocclusion severity, orthodontic treatment need, complexity and outcome. The aim of this study was to determine correlations and agreement among three occlusal indices: the Index of Orthodontic Treatment Need (IOTN), the Peer Assessment Rating Index (PAR) and the Index of Complexity, Outcome and Need (ICON) in evaluating orthodontic treatment need. A total eighty study models of patients referred to the Department of Orthodontics, School of Dentistry, Belgrade, were assessed in this retrospective study. Malocclusions of various types and severity in the permanent dentition were included. The Aesthetic and the Dental Health Component of IOTN determined orthodontic treatment need in 25% and 51% of the patients, respectively. PAR determined orthodontic treatment need in 59% and ICON in 53% of patients. The Aesthetic Component of IOTN and ICON had the highest correlation (Spearman's correlation coefficient 0.95, p < 0.01). Correlations between indices were 0.44 to 0.61 with statistical significance (p < 0.01). The agreement between indices, calculated using Kappa statistics, was 0.22 to 0.63. The most critical in malocclusion assessment was PAR. The Aesthetic Component of IOTN and ICON correlated highly (p < 0.01). Correlations between other pairs of indices were moderate (p < 0.01). The Aesthetic Component of IOTN and ICON had substantial agreement, whereas agreement between other indices was fair or moderate. ICON could replace PAR and IOTN. Application of occlusal indices enables objective evaluation of orthodontic treatment need and easier determination of the treatment priorities.

Validation of the Parental-Caregiver Perceptions Questionnaire: agreement between parental and child reports.

PubMed

Barbosa, Taís de Souza; Gavião, Maria Beatriz Duarte

2015-01-01

To test the validity and reliability of Brazilian Portuguese version of the Parental-Caregiver Perceptions Questionnaire (P-CPQ) (Aim 1) and to assess the agreement between parents and children concerning the child's oral health-related quality of life (OHRQoL) (Aim 2). The P-CPQ and the Brazilian Portuguese versions of the Child Perceptions Questionnaires (CPQ8-10 and CPQ11-14 ) were used. Objective 1 addressed in the study that involved 210 (validity and internal reliability) and 20 (test-retest reliability) parents and Objective 2 in the study that involved 210 pairs of parents and children. Construct validity was calculated using the Spearman's correlation and the Mann-Whitney/Kruskal-Wallis tests. Reliability was determined using Cronbach's alpha and intraclass correlation coefficient (ICC). Agreement between overall and subscale scores derived from the P-CPQ and CPQ was assessed in comparison and correlation analyses. The P-CPQ discriminated among the categories of malocclusion and dmft. The P-CPQ showed good construct validity, good internal consistency reliability, and excellent test-retest reliability. There was systematic under- and overreporting in parents' assessments for younger and older children, respectively. However, the magnitude of the directional differences was just small. At individual level, agreement between parents and children was excellent. However, it ranged from excellent to moderate or substantial in subscales for CPQ8-10 and CPQ11-14 groups, respectively. The Portuguese version of P-CPQ is valid and reliable. Some parents have limited knowledge about child OHRQoL. Given that parental and child reports measure different realities concerning the child's OHRQoL, information provided by parents can complement the child's evaluation. © 2015 American Association of Public Health Dentistry.

Intra- and inter-observer agreement in histological assessment of canine soft tissue sarcoma.

PubMed

Yap, F W; Rasotto, R; Priestnall, S L; Parsons, K J; Stewart, J

2017-12-01

The diagnosis of canine soft tissue sarcoma (STS) is based on histological assessment. Assessment of criteria such as, degree of differentiation, necrosis score and mitotic score, gives rise to a final tumour grade, which is important in the recommendation of treatment and prognosis of patients. Previously diagnosed cases of STS were independently assessed by three board-certified veterinary pathologists. Participating pathologists were blinded to the original results. For the intra-observer study, the cases were assessed by a single pathologist six months apart and slides were randomized between readings. For the inter-observer study, the whole case series was assessed by a single pathologist before being passed onto the next pathologist. Intraclass correlation coefficient (ICC) and Fleiss's Kappa (ƙ) for the intra- (single observer) and inter-observer agreement. Strong agreement was observed for the intra-observer assessment in necrosis score, mitotic score, total score and tumour grading (ICC between 0.78 to 0.91). The intra-observer agreement for differentiation score was rated perfect (ICC 1.00). The agreement between pathologists for the diagnosis and grading of canine STS was moderate (ƙ = 0.60 and 0.43 respectively). Histological assessment of canine STS had high reproducibility by an individual pathologist. The agreement of diagnosis and grading of canine STS was moderate between pathologists. Future studies are required to investigate further assessment criteria to improve the specificity of STS diagnosis and the accuracy of the STS grading in dogs. © 2017 John Wiley & Sons Ltd.

Spine Instability Neoplastic Score: agreement across different medical and surgical specialties.

PubMed

Arana, Estanislao; Kovacs, Francisco M; Royuela, Ana; Asenjo, Beatriz; Pérez-Ramírez, Úrsula; Zamora, Javier

2016-05-01

Spinal instability is an acknowledged complication of spinal metastases; in spite of recent suggested criteria, it is not clearly defined in the literature. This study aimed to assess intra and interobserver agreement when using the Spine Instability Neoplastic Score (SINS) by all physicians involved in its management. Independent multicenter reliability study for the recently created SINS, undertaken with a panel of medical oncologists, neurosurgeons, radiologists, orthopedic surgeons, and radiation oncologists, was carried out. Ninety patients with biopsy-proven spinal metastases and magnetic resonance imaging, reviewed at the multidisciplinary tumor board of our institution, were included. Intraclass correlation coefficient (ICC) was used for SINS score agreement. Fleiss kappa statistic was used to assess agreement on the location of the most affected vertebral level; agreement on the SINS category ("stable," "potentially stable," or "unstable"); and overall agreement with the classification established by tumor board. Clinical data and imaging were provided to 83 specialists in 44 hospitals across 14 Spanish regions. No assessment criteria were pre-established. Each clinician assessed the SINS score twice, with a minimum 6-week interval. Clinicians were blinded to assessments made by other specialists and to their own previous assessment. Subgroup analyses were performed by clinicians' specialty, experience (≤7, 8-13, ≥14 years), and hospital category (four levels according to size and complexity). This study was supported by Kovacs Foundation. Intra and interobserver agreement on the location of the most affected levels was "almost perfect" (κ>0.94). Intra-observer agreement on the SINS score was "excellent" (ICC=0.77), whereas interobserver agreement was "moderate" (ICC=0.55). Intra-observer agreement in SINS category was "substantial" (k=0.61), whereas interobserver agreement was "moderate" (k=0.42). Overall agreement with the tumor board classification

Efficiency and measurements agreement between swept-source OCT and low-coherence interferometry biometry systems.

PubMed

Calvo-Sanz, Jorge A; Portero-Benito, Alejandro; Arias-Puente, Alfonso

2018-03-01

To compare and evaluate the agreement between the measurements obtained with a swept-source optical coherence tomography (OCT)-based biometer, the IOLMaster® 700 (IOLM), and those obtained by an optical biometer based on optical low-coherence interferometry (OLCI), the Aladdin (ALD); To evaluate the ability to perform biometric measurements in those eyes with transparency alterations. Fifty-five eyes of 55 subjects were included in this study. Axial length (AL), corneal power (K, in diopters) and its astigmatism, anterior chamber depth (ACD), central corneal thickness (CCT), and lens thickness (LT) measures were obtained within both biometers, Zeiss IOLMaster 700 and Topcon Aladdin. Results were analyzed and compared using the Student's paired samples t-test, Bland-Altman analysis and intraclass correlation coefficient (ICC). Mean age was 73.12 ± 2.63 (62-89 years). The IOLM mean AL, K, and LT values did not show a statistically significant difference from ALD values and showed excellent agreement and correlation (ICC = 1.000, 0.970, 0.952). IOLM measured a lower mean ACD (-0.036 mm) and higher CCT measurements (9.296 μm). Those results were statistically different (p < 0.001 in both cases) but showed an excellent correlation coefficients (ICC = 0.994, 0.938). IOLM was able to obtain measures from all the eyes examined, while ALD did not measure in two cases with dense nuclear cataract. ALD showed spherical K measures in 7.27% of cases. Overall a quite good agreement between IOLM and ALD was found. ALD showed spherical keratometry measures in 7.27% of cases. IOLMaster 700 was more effective in obtaining AL measurements in eyes with dense cataracts.

Intra- and interobserver agreement for fetal cerebral measurements in 3D-ultrasonography.

PubMed

Albers, Maria E W A; Buisman, Erato T I A; Kahn, René S; Franx, Arie; Onland-Moret, N Charlotte; de Heus, Roel

2018-04-10

The aim of this study is to evaluate intra- and interobserver agreement for measurement of intracranial, cerebellar, and thalamic volume with the Virtual Organ Computer-aided AnaLysis (VOCAL) technique in three-dimensional ultrasound images, in comparison to two-dimensional measurements of these brain structures. Three-dimensional ultrasound images of the brains of 80 fetuses at 20-24 weeks' gestational age were obtained from YOUth, a Dutch prospective cohort study. Two observers performed offline measurement of the occipitofrontal diameter, intracranial volume, transcerebellar diameter, cerebellar volume, and thalamic width, area, and volume, independently. VOCAL was used for calculation of the volumes. The two-way random, single measures intraclass correlation coefficient (ICC) was used for analysis of agreement and Bland-Altman plots were configured. Intra- and interobserver agreement was almost perfect for occipitofrontal diameter (intra ICC 0.88, 95% CI 0.82-0.92; inter ICC 0.91, 95% CI 0.85-0.94), intracranial volume (intra ICC 0.96, 95% CI 0.91-0.98; inter ICC 0.97, 95% CI 0.96-0.98) and transcerebellar diameter (intra ICC 0.91, 95% CI 0.86-0.94; inter ICC 0.86, 95% CI 0.78-0.910). For cerebellar volume, the intraobserver agreement was almost perfect (0.85, 95% CI 0.76-0.90), whereas the interobserver agreement was substantial (0.75, 95% CI 0.44-0.88). Agreement was only moderate for thalamic measurements. Bland-Altman plots for the volume measurements are normally distributed with acceptable mean differences and 95% limits of agreement. The intra- and interobserver agreement of the measurement of intracranial and cerebellar volume with VOCAL was almost perfect. These measurements are therefore reliable, and can be used to investigate fetal brain development. Thalamic measurements are not reliable enough. © 2018 Wiley Periodicals, Inc.

Agreement among healthcare professionals in ten European countries in diagnosing case-vignettes of surgical-site infections.

PubMed

Birgand, Gabriel; Lepelletier, Didier; Baron, Gabriel; Barrett, Steve; Breier, Ann-Christin; Buke, Cagri; Markovic-Denic, Ljiljana; Gastmeier, Petra; Kluytmans, Jan; Lyytikainen, Outi; Sheridan, Elizabeth; Szilagyi, Emese; Tacconelli, Evelina; Troillet, Nicolas; Ravaud, Philippe; Lucet, Jean-Christophe

2013-01-01

Although surgical-site infection (SSI) rates are advocated as a major evaluation criterion, the reproducibility of SSI diagnosis is unknown. We assessed agreement in diagnosing SSI among specialists involved in SSI surveillance in Europe. Twelve case-vignettes based on suspected SSI were submitted to 100 infection-control physicians (ICPs) and 86 surgeons in 10 European countries. Each participant scored eight randomly-assigned case-vignettes on a secure online relational database. The intra-class correlation coefficient (ICC) was used to assess agreement for SSI diagnosis on a 7-point Likert scale and the kappa coefficient to assess agreement for SSI depth on a three-point scale. Intra-specialty agreement for SSI diagnosis ranged across countries and specialties from 0.00 (95%CI, 0.00-0.35) to 0.65 (0.45-0.82). Inter-specialty agreement varied from 0.04 (0.00-0.62) in to 0.55 (0.37-0.74) in Germany. For all countries pooled, intra-specialty agreement was poor for surgeons (0.24, 0.14-0.42) and good for ICPs (0.41, 0.28-0.61). Reading SSI definitions improved agreement among ICPs (0.57) but not surgeons (0.09). Intra-specialty agreement for SSI depth ranged across countries and specialties from 0.05 (0.00-0.10) to 0.50 (0.45-0.55) and was not improved by reading SSI definition. Among ICPs and surgeons evaluating case-vignettes of suspected SSI, considerable disagreement occurred regarding the diagnosis, with variations across specialties and countries.

Agreement among Healthcare Professionals in Ten European Countries in Diagnosing Case-Vignettes of Surgical-Site Infections

PubMed Central

Birgand, Gabriel; Lepelletier, Didier; Baron, Gabriel; Barrett, Steve; Breier, Ann-Christin; Buke, Cagri; Markovic-Denic, Ljiljana; Gastmeier, Petra; Kluytmans, Jan; Lyytikainen, Outi; Sheridan, Elizabeth; Szilagyi, Emese; Tacconelli, Evelina; Troillet, Nicolas; Ravaud, Philippe; Lucet, Jean-Christophe

2013-01-01

Objective Although surgical-site infection (SSI) rates are advocated as a major evaluation criterion, the reproducibility of SSI diagnosis is unknown. We assessed agreement in diagnosing SSI among specialists involved in SSI surveillance in Europe. Methods Twelve case-vignettes based on suspected SSI were submitted to 100 infection-control physicians (ICPs) and 86 surgeons in 10 European countries. Each participant scored eight randomly-assigned case-vignettes on a secure online relational database. The intra-class correlation coefficient (ICC) was used to assess agreement for SSI diagnosis on a 7-point Likert scale and the kappa coefficient to assess agreement for SSI depth on a three-point scale. Results Intra-specialty agreement for SSI diagnosis ranged across countries and specialties from 0.00 (95%CI, 0.00–0.35) to 0.65 (0.45–0.82). Inter-specialty agreement varied from 0.04 (0.00–0.62) in to 0.55 (0.37–0.74) in Germany. For all countries pooled, intra-specialty agreement was poor for surgeons (0.24, 0.14–0.42) and good for ICPs (0.41, 0.28–0.61). Reading SSI definitions improved agreement among ICPs (0.57) but not surgeons (0.09). Intra-specialty agreement for SSI depth ranged across countries and specialties from 0.05 (0.00–0.10) to 0.50 (0.45–0.55) and was not improved by reading SSI definition. Conclusion Among ICPs and surgeons evaluating case-vignettes of suspected SSI, considerable disagreement occurred regarding the diagnosis, with variations across specialties and countries. PMID:23874690

Agreement among health care professionals in diagnosing case Vignette-based surgical site infections.

PubMed

Lepelletier, Didier; Ravaud, Philippe; Baron, Gabriel; Lucet, Jean-Christophe

2012-01-01

To assess agreement in diagnosing surgical site infection (SSI) among healthcare professionals involved in SSI surveillance. Case-vignette study done in 2009 in 140 healthcare professionals from seven specialties (20 in each specialty, Anesthesiologists, Surgeons, Public health specialists, Infection control physicians, Infection control nurses, Infectious diseases specialists, Microbiologists) in 29 University and 36 non-University hospitals in France. We developed 40 case-vignettes based on cardiac and gastrointestinal surgery patients with suspected SSI. Each participant scored six randomly assigned case-vignettes before and after reading the SSI definition on an online secure relational database. The intraclass correlation coefficient (ICC) was used to assess agreement regarding SSI diagnosis on a seven-point Likert scale and the kappa coefficient to assess agreement for superficial or deep SSI on a three-point scale. Based on a consensus, SSI was present in 21 of 40 vignettes (52.5%). Intraspecialty agreement for SSI diagnosis ranged across specialties from 0.15 (95% confidence interval, 0.00-0.59) (anesthesiologists and infection control nurses) to 0.73 (0.32-0.90) (infectious diseases specialists). Reading the SSI definition improved agreement in the specialties with poor initial agreement. Intraspecialty agreement for superficial or deep SSI ranged from 0.10 (-0.19-0.38) to 0.54 (0.25-0.83) (surgeons) and increased after reading the SSI definition only among the infection control nurses from 0.10 (-0.19-0.38) to 0.41 (-0.09-0.72). Interspecialty agreement for SSI diagnosis was 0.36 (0.22-0.54) and increased to 0.47 (0.31-0.64) after reading the SSI definition. Among healthcare professionals evaluating case-vignettes for possible surgical site infection, there was large disagreement in diagnosis that varied both between and within specialties.

Agreement between the Facial Nerve Grading System 2.0 and the House-Brackmann Grading System in Patients with Bell Palsy.

PubMed

Lee, Ho Yun; Park, Moon Suh; Byun, Jae Yong; Chung, Ji Hyun; Na, Se Young; Yeo, Seung Geun

2013-09-01

We have analyzed the correlation between the House-Brackmann (HB) scale and Facial Nerve Grading System 2.0 (FNGS 2.0) in patients with Bell palsy, and evaluated the usefulness of the new grading system. Sixty patients diagnosed with Bell palsy from May 2009 to December 2010 were evaluated using the HB scale and FNGS 2.0 scale during their initial visit, and after 3 and 6 weeks and 3 months. The overall intraclass correlation coefficient (ICC) was 0.908 (P=0.000) and the Spearman correlation coefficient (SCC) was 0.912 (P<0.05). ICC and SCC displayed differences over time, being 0.604 and 0.626, respectively, at first visit; 0.834 and 0.843, respectively, after 3 weeks; 0.844 and 0.848, respectively, after 6 weeks; and 0.808 and 0.793, respectively, after 3 months. There was a significant difference in full recovery, depending on the scale used (HB, P=0.000; FNGS 2.0, P<0.05). The exact agreements between regional assessment and FNGS 2.0 for the mouth, eyes, and brow were 72%, 63%, and 52%, respectively. FNGS 2.0 shows moderate agreement with HB grading. Regional assessment, rather than HB grading, yields stricter evaluation, resulting in better prognosis and determination of grade.

The Smile Esthetic Index (SEI): A method to measure the esthetics of the smile. An intra-rater and inter-rater agreement study.

PubMed

Rotundo, Roberto; Nieri, Michele; Bonaccini, Daniele; Mori, Massimiliano; Lamberti, Elena; Massironi, Domenico; Giachetti, Luca; Franchi, Lorenzo; Venezia, Piero; Cavalcanti, Raffaele; Bondi, Elena; Farneti, Mauro; Pinchi, Vilma; Buti, Jacopo

2015-01-01

To propose a method to measure the esthetics of the smile and to report its validation by means of an intra-rater and inter-rater agreement analysis. Ten variables were chosen as determinants for the esthetics of a smile: smile line and facial midline, tooth alignment, tooth deformity, tooth dischromy, gingival dischromy, gingival recession, gingival excess, gingival scars and diastema/missing papillae. One examiner consecutively selected seventy smile pictures, which were in the frontal view. Ten examiners, with different levels of clinical experience and specialties, applied the proposed assessment method twice on the selected pictures, independently and blindly. Intraclass correlation coefficient (ICC) and Fleiss' kappa) statistics were performed to analyse the intra-rater and inter-rater agreement. Considering the cumulative assessment of the Smile Esthetic Index (SEI), the ICC value for the inter-rater agreement of the 10 examiners was 0.62 (95% CI: 0.51 to 0.72), representing a substantial agreement. Intra-rater agreement ranged from 0.86 to 0.99. Inter-rater agreement (Fleiss' kappa statistics) calculated for each variable ranged from 0.17 to 0.75. The SEI was a reproducible method, to assess the esthetic component of the smile, useful for the diagnostic phase and for setting appropriate treatment plans.

Repeatability and reproducibility of corneal thickness using SOCT Copernicus HR.

PubMed

Vidal, Silvia; Viqueira, Valentín; Mas, David; Domenech, Begoña

2013-05-01

The aim of this study is to determine the reliability of corneal thickness measurements derived from SOCT Copernicus HR (Fourier domain OCT). Thirty healthy eyes of 30 subjects were evaluated. One eye of each patient was chosen randomly. Images were obtained of the central (up to 2.0 mm from the corneal apex) and paracentral (2.0 to 4.0 mm) cornea. We assessed corneal thickness (central and paracentral) and epithelium thickness. The intra-observer repeatability data were analysed using the intra-class correlation coefficient (ICC) for a range of 95 per cent within-subject standard deviation (S(W)) and the within-subject coefficient of variation (C(W)). The level of agreement by Bland-Altman analysis was also represented for the study of the reproducibility between observers and agreement between methods of measurement (automatic versus manual). The mean value of the central corneal thickness (CCT) was 542.4 ± 30.1 μm (SD). There was a high intra-observer agreement, finding the best result in the central sector with an intra-class correlation coefficient of 0.99, 95 per cent CI (0.989 to 0.997) and the worst, in the minimum corneal thickness, with an intra-class correlation coefficient of 0.672, 95 per cent CI (0.417 to 0.829). Reproducibility between observers was very high. The best result was found in the central sector thickness obtained both manually and automatically with an intra-class correlation coefficient of 0.990 in both cases and the worst result in the maximum corneal thickness with an intra-class correlation coefficient of 0.827. The agreement between measurement methods was also very high with intra-class correlation coefficient greater than 0.91. On the other hand the repeatability and reproducibility for epithelial measurements was poor. Pachymetric mapping with SOCT Copernicus HR was found to be highly repeatable and reproducible. We found that the device lacks an appropriate ergonomic design as proper focusing of the laser beam onto the

The META score for differentiating metastatic from osteoporotic vertebral fractures: an independent agreement assessment.

PubMed

Besa, Pablo; Urrutia, Julio; Campos, Mauricio; Mobarec, Sebastián; Cruz, Juan Pablo; Cikutovic, Pablo; Diaz, Gonzalo

2018-04-27

Differentiating osteoporotic vertebral fractures (OVFs) from metastatic vertebral fractures (MVFs) is an important clinical challenge. A novel magnetic resonance imaging (MRI)-based score (the META score) was described, aiming to differentiate OVF from MVF. This score showed an almost perfect agreement by the group developing it, but an independent agreement evaluation is pending. We aimed to perform an independent inter- and intraobserver agreement evaluation of the META score and to test the score's capability of differentiating OVF from MVF. This is an agreement study of the META score. Sixty-four patients with confirmed OVF or MVF were assessed by six independent evaluators (three spine surgeons and three fellowship-trained radiologists) using the META score. We used the intraclass correlation coefficient (ICC) to determine the overall inter-and intraobserver agreement, and the kappa statistic (κ) to express the agreement for each individual score criterion. The score accuracy was determined by calculating the area under the receiver operating characteristic curve. Finally, we used κ to evaluate the agreement among raters to determine whether the fracture was OVF or MVF. The overall interobserver agreement was poor [ICC=0.10 (0.02-0.20)]; spine surgeons [ICC=0.75 (0.66-0.83)] had better agreement than radiologists did [ICC=0.05 (-0.08 to 0.21)]. The intraobserver agreement was poor [ICC=0.17 (0.01-0.32)]; both spine surgeons [ICC=0.21 (0.05-0.41)] and radiologists had a poor agreement [ICC=0.03 (-0.29 to 0.27)]. The agreement for each specific criterion varied from κ=0.24 to κ=0.60. The area under the receiver operating characteristic curve was 0.58 (0.64 for spine surgeons and 0.52 for radiologists, p<.01). The interobserver agreement using the META score was adequate for spine surgeons but not for other potential users (radiologists); the intraobserver agreement was poor. Further studies are thus necessary before the use of this score is recommended

Parent-child agreement on the Behavior Rating Inventory of Executive Functioning (BRIEF) in a community sample of adolescents.

PubMed

Egan, Kaitlyn N; Cohen, L Adelyn; Limbers, Christine

2018-03-06

Despite its widespread use, a minimal amount is known regarding the agreement between parent and youth ratings of youth's executive functioning on the Behavior Rating Inventory of Executive Functioning (BRIEF) in typically developing youth. The present study examined parent-child agreement on the BRIEF with a community sample of adolescents and their parents. Ninety-seven parent-child dyads (M age  = 13.91 years; SD = .52) completed the BRIEF self- and parent-report forms and a demographic questionnaire. Intraclass Correlation Coefficients (ICCs) and paired sample t-tests were used to evaluate agreement between self- and parent-reports on the BRIEF. Total sample ICCs indicated moderate to good parent-child agreement (0.46-0.68). Parents from the total sample reported significantly higher mean T-scores for their adolescents on Inhibit, Working Memory, Planning/Organization, Behavioral Regulation Index (BRI), Metacognition Index, and Global Executive Composite. Differences were found in regard to gender and race/ethnicity: ICCs were higher between parent-girl dyads on the scales that comprise the BRI than between parent-boy dyads. Parent-adolescent ICCs were also higher for adolescents who self-identified as White in comparison to those who identified as Non-White/Mixed Race on Emotional Control. These findings suggest gender and racial/ethnic differences should be considered when examining parent-child agreement on the BRIEF in typically developing adolescents.

Test-retest agreement and reliability of quantitative sensory testing 1 year after breast cancer surgery.

PubMed

Andersen, Kenneth Geving; Kehlet, Henrik; Aasvang, Eske Kvanner

2015-05-01

Quantitative sensory testing (QST) is used to assess sensory dysfunction and nerve damage by examining psychophysical responses to controlled, graded stimuli such as mechanical and thermal detection and pain thresholds. In the breast cancer population, 4 studies have used QST to examine persistent pain after breast cancer treatment, suggesting neuropathic pain being a prominent pain mechanism. However, the agreement and reliability of QST has not been described in the postsurgical breast cancer population, hindering exact interpretation of QST studies in this population. The aim of the present study was to assess test-retest properties of QST after breast cancer surgery. A total of 32 patients recruited from a larger ongoing prospective trial were examined with QST 12 months after breast cancer surgery and reexamined a week later. A standardized QST protocol was used, including sensory mapping for mechanical, warmth and cold areas of sensory dysfunction, mechanical thresholds using monofilaments and pin-prick, thermal thresholds including warmth and cold detection thresholds and heat pain threshold, with bilateral examination. Agreement and reliability were assessed by Bland-Altman plots, descriptive statistics, coefficients of variance, and intraclass correlation. Bland-Altman plots showed high variation on the surgical side. Intraclass coefficients ranged from 0.356 to 0.847 (moderate to substantial reliability). Between-patient variation was generally higher (0.9 to 14.5 SD) than within-patient variation (0.23 to 3.55 SD). There were no significant differences between pain and pain-free patients. The individual test-retest variability was higher on the operated side compared with the nonoperated side. The QST protocol reliability allows for group-to-group comparison of sensory function, but less so for individual follow-up after breast cancer surgery.

Agreement between prospective diary data and retrospective questionnaire report of abdominal pain and stooling symptoms in children with irritable bowel syndrome.

PubMed

Self, M M; Williams, A E; Czyzewski, D I; Weidler, E M; Shulman, R J

2015-08-01

In functional gastrointestinal disorders, patient recall of symptoms drives diagnostic decisions and evaluation of treatment response, and research conclusions about potential treatments. In pediatrics, parent report also impacts assessment and care. Hence, identifying methods for accurately capturing patient and parent report of irritable bowel syndrome (IBS) symptoms is important. This study evaluated correspondence between retrospective questionnaire (parent and child report) and prospective diary data for children and adolescents with IBS. Participants included 50 children/adolescents with IBS per Rome III criteria. Children completed a 2-week pain and stool diary. Children and parents subsequently completed a 2-week recall questionnaire, reporting number of pain days, maximum pain, days without bowel movement, and days with diarrhea during the diary interval. Intraclass correlation coefficients and Bland-Altman plots assessed agreement. For pain and days without bowel movement, overall agreement between child recall questionnaire and child diary was strong, although under conditions likely to facilitate agreement and with individual variation observed. Parent recall and child diary were less concordant, and agreement about diarrhea was poor for parent and child. Age did not significantly correlate with agreement. Child questionnaire with short recall interval may be a reasonable approximation for diary data, although this varies by individual and replication/investigation of lengthier recall are needed. Relying on parent questionnaire does not appear a suitable proxy, and recall of stool form by both parent and child appears more problematic. These results combined with existing literature support use of diary data whenever possible. © 2015 John Wiley & Sons Ltd.

Breast lesion shape and margin evaluation: BI-RADS based metrics understate radiologists' actual levels of agreement.

PubMed

Rawashdeh, Mohammad; Lewis, Sarah; Zaitoun, Maha; Brennan, Patrick

2018-05-01

While there is much literature describing the radiologic detection of breast cancer, there are limited data available on the agreement between experts when delineating and classifying breast lesions. The aim of this work is to measure the level of agreement between expert radiologists when delineating and classifying breast lesions as demonstrated through Breast Imaging Reporting and Data System (BI-RADS) and quantitative shape metrics. Forty mammographic images, each containing a single lesion, were presented to nine expert breast radiologists using a high specification interactive digital drawing tablet with stylus. Each reader was asked to manually delineate the breast masses using the tablet and stylus and then visually classify the lesion according to the American College of Radiology (ACR) BI-RADS lexicon. The delineated lesion compactness and elongation were computed using Matlab software. Intraclass Correlation Coefficient (ICC) and Cohen's kappa were used to assess inter-observer agreement for delineation and classification outcomes, respectively. Inter-observer agreement was fair for BI-RADS shape (kappa = 0.37) and moderate for margin (kappa = 0.58) assessments. Agreement for quantitative shape metrics was good for lesion elongation (ICC = 0.82) and excellent for compactness (ICC = 0.93). Fair to moderate levels of agreement was shown by radiologists for shape and margin classifications of cancers using the BI-RADS lexicon. When quantitative shape metrics were used to evaluate radiologists' delineation of lesions, good to excellent inter-observer agreement was found. The results suggest that qualitative descriptors such as BI-RADS lesion shape and margin understate the actual level of expert radiologist agreement. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Pfirrmann classification of lumbar intervertebral disc degeneration: an independent inter- and intra-observer agreement assessment.

PubMed

Urrutia, Julio; Besa, Pablo; Campos, Mauricio; Cikutovic, Pablo; Cabezon, Mario; Molina, Marcelo; Cruz, Juan Pablo

2016-09-01

Grading inter-vertebral disc degeneration (IDD) is important in the evaluation of many degenerative conditions, including patients with low back pain. Magnetic resonance imaging (MRI) is considered the best imaging instrument to evaluate IDD. The Pfirrmann classification is commonly used to grade IDD; the authors describing this classification showed an adequate agreement using it; however, there has been a paucity of independent agreement studies using this grading system. The aim of this study was to perform an independent inter- and intra-observer agreement study using the Pfirrmann classification. T2-weighted sagittal images of 79 patients consecutively studied with lumbar spine MRI were classified using the Pfirrmann grading system by six evaluators (three spine surgeons and three radiologists). After a 6-week interval, the 79 cases were presented to the same evaluators in a random sequence for repeat evaluation. The intra-class correlation coefficient (ICC) and the weighted kappa (wκ) were used to determine the inter- and intra-observer agreement. The inter-observer agreement was excellent, with an ICC = 0.94 (0.93-0.95) and wκ = 0.83 (0.74-0.91). There were no differences between spine surgeons and radiologists. Likewise, there were no differences in agreement evaluating the different lumbar discs. Most differences among observers were only of one grade. Intra-observer agreement was also excellent with ICC = 0.86 (0.83-0.89) and wκ = 0.89 (0.85-0.93). In this independent study, the Pfirrmann classification demonstrated an adequate agreement among different observers and by the same observer on separate occasions. Furthermore, it allows communication between radiologists and spine surgeons.

Correlation of hepatic fractional extracellular space using gadolinium enhanced MRI with liver stiffness using magnetic resonance elastography.

PubMed

Wells, Michael L; Moynagh, Michael R; Carter, Rickey E; Childs, Robert A; Leitch, Cameron E; Fletcher, Joel G; Yeh, Benjamin M; Venkatesh, Sudhakar K

2017-01-01

To compare MR hepatic fractional extracellular space (fECS) to liver stiffness (LS) with magnetic resonance elastography (MRE) for evaluation of liver fibrosis. 71 consecutive patients with suspected chronic liver disease underwent standard liver MRI with MR elastography and additional delayed Gd-DTPA-enhanced sequences at 5 and 10 min in order to calculate hepatic fECS (%) and LS (kilopascals, kPa). Two radiologists blinded to clinical history examined MR images and calculated fECS and LS in identical locations for every patient. Interobserver agreement was calculated using the intraclass correlation coefficient. Pearson's correlation was calculated for LS and fECS measures, as was the area under the receiver operatic curve (AUROC), sensitivity and specificity of fECS to predict liver stiffness ≥2.93 and ≥5 kPa. The sensitivity of fECS for detecting fibrosis was separately analyzed in the subgroup of patients without anatomic findings of cirrhosis. Substantial to excellent interobserver agreement for both LS and fECS measurements was seen with intraclass correlation of 0.88 (95% CI 0.81-0.92) for LS, 0.77 (95% CI 0.66-0.85) for fECS 5 and 0.76 (95% CI 0.64-0.84) for fECS 10 . A significant correlation was found between MRE and fECS 5 (r = 0.47, p < 0.0001) and fECS 10 (r = 0.44, p < 0.0001). The performance of fECS improved for detection of advanced fibrosis (≥5 kPa) with AUROC, sensitivity and specificity of 0.72, 38%, and 94% for fECS 5 and 0.72, 67%, and 66% for fECS 10 . fECS correlates modestly with MRE-determined LS. fECS at MRI is a simple calculation to perform and may represent a practical way to suggest the presence of fibrosis during routine liver evaluation.

Agreement Mechanisms in Native and Nonnative Language Processing: Electrophysiological Correlates of Complexity and Interference

ERIC Educational Resources Information Center

Tanner, Darren

2011-01-01

This dissertation investigates the neural and behavioral correlates of grammatical agreement computation during language comprehension in native English speakers and highly advanced L1 Spanish-L2 English bilinguals. In a series of electrophysiological (event-related brain potential (ERP)) and behavioral (acceptability judgment and self-paced…

Intra- and inter-observer agreement on diagnosis of Dupuytren disease, measurements of severity of contracture, and disease extent.

PubMed

Broekstra, Dieuwke C; Lanting, Rosanne; Werker, Paul M N; van den Heuvel, Edwin R

2015-08-01

Dupuytren disease (DD) is a fibrosing disease affecting the palmar aponeurosis, and is mostly treated by surgery based on measurement of severity of flexion contracture of the fingers. Literature concerning the measurement reliability is scarce. This study aimed to determine the intra- and inter-observer agreement of four variables for diagnosing DD, determining severity of contracture, and disease extent. One of them is a new measurement on the area of nodules and cords for measuring the disease extent in early disease stages. An agreement study (n = 54) was performed by two trained investigators. Agreement was calculated per finger, based on an intraclass correlation coefficient (ICC) using a latent variable model on subjects for diagnosis and Tubiana stage. For total passive extension deficit (TPED) and the area of nodules and cords, agreement was calculated with an ICC using a one-way random effects model with subject as random effect. Inter-observer agreement was very good for diagnosing DD (ICC: 95.5%-99.9%) and good to very good for classifying Tubiana stage (ICC: 73.5%-94.9%). Agreements for area and TPED were moderate (middle finger) to very good (ICC: 48.4%-98.6% and 45.0%-99.5%, respectively). Intra-observer agreement was slightly higher on average than inter-observer agreement. Overall, the intra- and inter-observer agreement in diagnosing DD, and determining the severity of flexion contracture is high. Also, the newly introduced variable area of nodules and cords has high intra- and inter-observer agreement, indicating that it is suitable to measure disease extent. Copyright © 2015 Elsevier Ltd. All rights reserved.

Instrument validation process: a case study using the Paediatric Pain Knowledge and Attitudes Questionnaire.

PubMed

Peirce, Deborah; Brown, Janie; Corkish, Victoria; Lane, Marguerite; Wilson, Sally

2016-06-01

To compare two methods of calculating interrater agreement while determining content validity of the Paediatric Pain Knowledge and Attitudes Questionnaire for use with Australian nurses. Paediatric pain assessment and management documentation was found to be suboptimal revealing a need to assess paediatric nurses' knowledge and attitude to pain. The Paediatric Pain Knowledge and Attitudes Questionnaire was selected as it had been reported as valid and reliable in the United Kingdom with student nurses. The questionnaire required content validity determination prior to use in the Australian context. A two phase process of expert review. Ten paediatric nurses completed a relevancy rating of all 68 questionnaire items. In phase two, five pain experts reviewed the items of the questionnaire that scored an unacceptable item level content validity. Item and scale level content validity indices and intraclass correlation coefficients were calculated. In phase one, 31 items received an item level content validity index <0·78 and the scale level content validity index average was 0·80 which were below levels required for acceptable validity. The intraclass correlation coefficient was 0·47. In phase two, 10 items were amended and four items deleted. The revised questionnaire provided a scale level content validity index average >0·90 and an intraclass correlation coefficient of 0·94 demonstrating excellent agreement between raters therefore acceptable content validity. Equivalent outcomes were achieved using the content validity index and the intraclass correlation coefficient. To assess content validity the content validity index has the advantage of providing an item level score and is a simple calculation. The intraclass correlation coefficient requires statistical knowledge, or support, and has the advantage of accounting for the possibility of chance agreement. © 2016 John Wiley & Sons Ltd.

Image quality guided approach for adaptive modelling of biometric intra-class variations

NASA Astrophysics Data System (ADS)

Abboud, Ali J.; Jassim, Sabah A.

2010-04-01

The high intra-class variability of acquired biometric data can be attributed to several factors such as quality of acquisition sensor (e.g. thermal), environmental (e.g. lighting), behavioural (e.g. change face pose). Such large fuzziness of biometric data can cause a big difference between an acquired and stored biometric data that will eventually lead to reduced performance. Many systems store multiple templates in order to account for such variations in the biometric data during enrolment stage. The number and typicality of these templates are the most important factors that affect system performance than other factors. In this paper, a novel offline approach is proposed for systematic modelling of intra-class variability and typicality in biometric data by regularly selecting new templates from a set of available biometric images. Our proposed technique is a two stage algorithm whereby in the first stage image samples are clustered in terms of their image quality profile vectors, rather than their biometric feature vectors, and in the second stage a per cluster template is selected from a small number of samples in each clusters to create an ultimate template sets. These experiments have been conducted on five face image databases and their results will demonstrate the effectiveness of proposed quality guided approach.

PROSPECTIVE EVALUATION OF VISUAL ACUITY AGREEMENT BETWEEN STANDARD EARLY TREATMENT DIABETIC RETINOPATHY STUDY CHART AND A HANDHELD EQUIVALENT IN EYES WITH RETINAL PATHOLOGY.

PubMed

Rahimy, Ehsan; Reddy, Sahitya; DeCroos, Francis Char; Khan, M Ali; Boyer, David S; Gupta, Omesh P; Regillo, Carl D; Haller, Julia A

2015-08-01

To evaluate the visual acuity agreement between a standard back-illuminated Early Treatment Diabetic Retinopathy Study (ETDRS) chart and a handheld internally illuminated ETDRS chart. Two-center prospective study. Seventy patients (134 eyes) with retinal pathology were enrolled between October 2012 and August 2013. Visual acuity was measured using both the ETDRS chart and the handheld device by masked independent examiners after best protocol refraction. Examination was performed in the same room under identical illumination and testing conditions. The mean number of letters seen was 63.0 (standard deviation: 19.8 letters) and 61.2 letters (standard deviation: 19.1 letters) for the ETDRS chart and handheld device, respectively. Mean difference per eye between the ETDRS and handheld device was 1.8 letters. A correlation coefficient (r) of 0.95 demonstrated a positive linear correlation between ETDRS chart and handheld device measured acuities. Intraclass correlation coefficient was performed to assess the reproducibility of the measurements made by different observers measuring the same quantity and was calculated to be 0.95 (95% confidence interval: 0.93-0.96). Agreement was independent of retinal disease. The strong correlation between measured visual acuity using the ETDRS and handheld equivalent suggests that they may be used interchangeably, with accurate measurements. Potential benefits of this device include convenience and portability, as well as the ability to assess ETDRS visual acuity without a dedicated testing lane.

Reliability and Agreement Between Metrics of Cone Spacing in Adaptive Optics Images of the Human Retinal Photoreceptor Mosaic.

PubMed

Giannini, Daniela; Lombardo, Giuseppe; Mariotti, Letizia; Devaney, Nicholas; Serrao, Sebastiano; Lombardo, Marco

2017-06-01

To assess reliability and agreement among three metrics used to evaluate the distribution of cell distances in adaptive optics (AO) images of the cone mosaic. Using an AO flood illumination retinal camera, we acquired images of the cone mosaic in 20 healthy subjects and 12 patients with retinal diseases. The three spacing metrics studied were the center-to-center spacing (Scc), the local cone spacing (LCS), and the density recovery profile distance (DRPD). Each metric was calculated in sampling areas of different sizes (64 × 64 μm and 204 × 204 μm) across the parafovea. Both Scc and LCS were able to discriminate between healthy subjects and patients with retinal diseases; DRPD did not reliably detect any abnormality in the distribution of cell distances in patients with retinal diseases. The agreement between Scc and LCS was high in healthy subjects (intraclass correlation coefficient [ICC] ≥ 0.79) and moderate in patients with retinal diseases (ICC ≤ 0.51). The DRPD had poor agreement with Scc (ICC ≤ 0.47) and LCS (ICC ≤ 0.37). The correlation between the spacing metrics of the two sampling areas was greater in healthy subjects than in patients with retinal diseases. The Scc and LCS provided interchangeable estimates of cone distance in AO retinal images of healthy subjects but could not be used interchangeably when investigating retinal diseases with significant cell reflectivity loss (≥30%). The DRPD was unreliable for describing cell distance in a human retinal cone mosaic and did not correlate with Scc and LCS. Caution is needed when comparing spacing metrics evaluated in sampling areas of different sizes.

Correlation and agreement between the bispectral index vs. state entropy during hypothermic cardio-pulmonary bypass.

PubMed

Meybohm, P; Gruenewald, M; Höcker, J; Renner, J; Graesner, J-T; Ilies, C; Scholz, J; Bein, B

2010-02-01

The bispectral index (BIS) and spectral entropy enable monitoring the depth of anaesthesia. Mild hypothermia has been shown to affect the ability of electroencephalography monitors to reflect the anaesthetic drug effect. The purpose of this study was to investigate the effect of hypothermia during a cardio-pulmonary bypass on the correlation and agreement between the BIS and entropy variables compared with normothermic conditions. This prospective clinical study included coronary artery bypass grafting patients (n=25) evaluating correlation and agreement (Bland-Altman analysis) between the BIS and both spectral and response entropy during a hypothermic cardio-pulmonary bypass (31-34 degrees C) compared with nomothermic conditions (34-37.5 degrees C). Anaesthesia was maintained with propofol and sufentanil and adjusted clinically, while the anaesthetist was blinded to the monitors. The BIS and entropy values decreased during cooling (P<0.05), but the decrease was more pronounced for entropy variables compared with BIS (P<0.05). The correlation coefficients (bias+/-SD; percentage error) between the BIS vs. spectral state entropy and response entropy were r(2)=0.56 (1+/-11; 42%) and r(2)=0.58 (-2+/-11; 43%) under normothermic conditions, and r(2)=0.17 (10+/-12; 77%) and r(2)=0.18 (9+/-11; 68%) under hypothermic conditions, respectively. Bias was significantly increased under hypothermic conditions (P<0.001 vs. normothermia). Acceptable agreement was observed between the BIS and entropy variables under normothermic but not under hypothermic conditions. The BIS and entropy variables may therefore not be interchangeable during a hypothermic cardio-pulmonary bypass.

Agreement in DNA methylation levels from the Illumina 450K array across batches, tissues, and time

PubMed Central

Forest, Marie; O'Donnell, Kieran J.; Voisin, Greg; Gaudreau, Helene; MacIsaac, Julia L.; McEwen, Lisa M.; Silveira, Patricia P.; Steiner, Meir; Kobor, Michael S.; Meaney, Michael J.; Greenwood, Celia M.T.

2018-01-01

ABSTRACT Epigenome-wide association studies (EWAS) have focused primarily on DNA methylation as a chemically stable and functional epigenetic modification. However, the stability and accuracy of the measurement of methylation in different tissues and extraction types is still being actively studied, and the longitudinal stability of DNA methylation in commonly studied peripheral tissues is of great interest. Here, we used data from two studies, three tissue types, and multiple time points to assess the stability of DNA methylation measured with the Illumina Infinium HumanMethylation450 BeadChip array. Redundancy analysis enabled visual assessment of agreement of replicate samples overall and showed good agreement after removing effects of tissue type, age, and sex. At the probe level, analysis of variance contrasts separating technical and biological replicates clearly showed better agreement between technical replicates versus longitudinal samples, and suggested increased stability for buccal cells versus blood or blood spots. Intraclass correlations (ICCs) demonstrated that inter-individual variability is of similar magnitude to within-sample variability at many probes; however, as inter-individual variability increased, so did ICC. Furthermore, we were able to demonstrate decreasing agreement in methylation levels with time, despite a maximal sampling interval of only 576 days. Finally, at 6 popular candidate genes, there was a large range of stability across probes. Our findings highlight important sources of technical and biological variation in DNA methylation across different tissues over time. These data will help to inform longitudinal sampling strategies of future EWAS. PMID:29381404

Subsolid Lung Nodule Classification: A CT Criterion for Improving Interobserver Agreement.

PubMed

Revel, Marie-Pierre; Mannes, Inès; Benzakoun, Joseph; Guinet, Claude; Léger, Thomas; Grenier, Philippe; Lupo, Audrey; Fournel, Ludovic; Chassagnon, Guillaume; Bommart, Sébastien

2018-01-01

Purpose To evaluate an objective computed tomographic (CT) criterion for distinguishing between part-solid (PS) and nonsolid (NS) lung nodules. Materials and Methods This study received institutional review board approval, and patients gave informed consent. Preoperative CT studies in all patients who underwent surgery for subsolid nodules between 2008 and 2015 were first reviewed by two senior radiologists, who subjectively classified the nodules as PS or NS. A second reading performed 1 month later used predefined classification criteria and involved a third senior radiologist as well as three junior radiologists. Subsolid nodules were classified as PS if a solid portion was detectable in the mediastinal window setting (nonmeasurable, < 50%, or > 50% of the entire nodule) and were otherwise classified as NS (subclassified as pure or heterogeneous). Interreader agreement was assessed with κ statistics and the intraclass correlation coefficient (ICC). Results A total of 99 nodules measuring a median of 20 mm (range, 5-47 mm) in lung window CT images were analyzed. Senior radiologist agreement on the PS/NS distinction increased from moderate (κ = 0.54; 95% confidence interval [CI]: 0.37, 0.71) to excellent (κ = 0.89; 95% CI: 0.80, 0.98) between the first and second readings. At the second readings, agreement among senior and junior radiologists was excellent for PS/NS distinction (ICC = 0.87; 95% CI: 0.83, 0.90) and for subcategorization (ICC = 0.82; 95% CI: 0.77, 0.87). When a solid portion was measurable in the mediastinal window, the specificity for adenocarcinoma invasiveness ranged from 86% to 96%. Conclusion Detection of a solid portion in the mediastinal window setting allows subsolid nodules to be classified as PS with excellent interreader agreement. If the solid portion is measurable, the specificity for adenocarcinoma invasiveness is high. © RSNA, 2017 Online supplemental material is available for this article.

Agreement between children aged 5-6 years and their mothers in rating child oral health-related quality of life.

PubMed

Abanto, Jenny; Tsakos, Georgios; Paiva, Saul Martins; Raggio, Daniela Prócida; Celiberti, Paula; Bönecker, Marcelo

2014-09-01

Studies have assessed parent-child agreement on ratings of school-aged children's OHRQoL. There are, however, no studies on children younger than 7 years of age. The aim was to assess the agreement between children aged 5-6 years and their mothers regarding child's oral health-related quality of life (OHRQoL). In this cross-sectional study, a total of 298 mother-child pairs (MCP), seeking the pediatric dental screening at the Dental School, University of São Paulo, completed the Brazilian version of the Scale of Oral Health Outcomes for 5-year-old children (SOHO-5), validated for children aged 5-6 years in Brazil. Agreement between total and items' scores was assessed using comparison and correlation analyses, by comparing the mean directional differences and by computing the intraclass correlation coefficient (ICC) values, respectively. The mean directional difference in the total scores was 0.13 (CI 95% -0.076; 0.338) and therefore not significant for MCP. The mean absolute difference for MCP was 1.26, representing 11% of the maximum possible score. The ICC for total score was 0.84 (CI 95% 0.798; 0.867) for MCP. Mothers do rate their young children's OHRQoL similarly to children's self-reports. When assessing OHRQoL of children aged 5-6 years, mothers may be reliable proxies for their young children. © 2013 BSPD, IAPD and John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Profiles and Correlates of Parent-Child Agreement on Social Anxiety Symptoms in Youth with Autism Spectrum Disorder.

PubMed

Burrows, Catherine A; Usher, Lauren V; Becker-Haimes, Emily M; McMahon, Camilla M; Mundy, Peter C; Jensen-Doss, Amanda; Henderson, Heather A

2018-06-01

This study characterized patterns and correlates of parent-youth agreement on social anxiety in youth with and without autism spectrum disorder (ASD). Participants (279 verbally-fluent youth aged 8-16 years, N ASD  = 144, N TD  = 135) completed the SASC-R. Youth with ASD exhibited higher social anxiety across informants. While TD youth endorsed higher anxiety than did parents, self- and parent-reports did not differ in youth with ASD. For children with ASD, higher parent-youth agreement was associated with lower lifetime ASD symptoms and higher adaptive skills. For TD youth, agreement on high anxiety was associated with lowest adaptive skills. Demographic factors (age, verbal IQ, gender) did not relate to agreement for either group. In ASD, parent-child agreement on youth anxiety, either high or low, was associated with better outcomes.

Scoring haemophilic arthropathy on X-rays: improving inter- and intra-observer reliability and agreement using a consensus atlas.

PubMed

Foppen, Wouter; van der Schaaf, Irene C; Beek, Frederik J A; Verkooijen, Helena M; Fischer, Kathelijn

2016-06-01

The radiological Pettersson score (PS) is widely applied for classification of arthropathy to evaluate costly haemophilia treatment. This study aims to assess and improve inter- and intra-observer reliability and agreement of the PS. Two series of X-rays (bilateral elbows, knees, and ankles) of 10 haemophilia patients (120 joints) with haemophilic arthropathy were scored by three observers according to the PS (maximum score 13/joint). Subsequently, (dis-)agreement in scoring was discussed until consensus. Example images were collected in an atlas. Thereafter, second series of 120 joints were scored using the atlas. One observer rescored the second series after three months. Reliability was assessed by intraclass correlation coefficients (ICC), agreement by limits of agreement (LoA). Median Pettersson score at joint level (PSjoint) of affected joints was 6 (interquartile range 3-9). Using the consensus atlas, inter-observer reliability of the PSjoint improved significantly from 0.94 (95 % confidence interval (CI) 0.91-0.96) to 0.97 (CI 0.96-0.98). LoA improved from ±1.7 to ±1.1 for the PSjoint. Therefore, true differences in arthropathy were differences in the PSjoint of >2 points. Intra-observer reliability of the PSjoint was 0.98 (CI 0.97-0.98), intra-observer LoA were ±0.9 points. Reliability and agreement of the PS improved by using a consensus atlas. • Reliability of the Pettersson score significantly improved using the consensus atlas. • The presented consensus atlas improved the agreement among observers. • The consensus atlas could be recommended to obtain a reproducible Pettersson score.

Agreement in assessment of infliximab and adalimumab levels in rheumatoid arthritis: interlaboratory and interassay comparison.

PubMed

Valor, Lara; Hernández-Flórez, Diana; de la Torre, Inmaculada; Llinares, Francisca; Rosas, José; Yagüe, Jordi; Garrido, Jesús; Naredo, Esperanza

2015-01-01

Infliximab (IFX) and adalimumab (ADL) drug levels and anti-drug antibodies (ADA) are assessed using a variety of techniques, therefore, results cannot accurately be compared for clinical purposes. The aim of this study was to test two infliximab (IFX) and adalimumab (ADL) ELISA versions, for drug levels and ADA, to see whether they yield similar results. ELISA versions [Promonitor® IFX R1 and R2 (V.1), Promonitor® IFX and Anti-IFX (V.2); Promonitor® ADL R1 and R2 (V.1), Promonitor® ADL and Anti-ADL (V.2) kits (Progenika Biopharma, Spain)] were used to measure drug levels and ADA in IFX (n=24) and ADL (n=24) rheumatoid arthritis-treated patients in three independent laboratories. Quantitative and qualitative agreements were evaluated using intraclass correlation coefficients (ICC), and Cohen's Kappa (κ) respectively. The Bland-Altman plots assessed differences between V.1 and V.2. Interlaboratory agreement (ICC/κ) with V.1 was poor for IFX (0.66/0.62) and ADL (0.69/0.52) drug levels; meanwhile, high agreement was found with V.2 for IFX (0.98/0.95) and ADL (0.094/1.00). Comparison between V.1 and V.2 in each laboratory resulted in systematically higher values in V.2 than in V.1 and poor agreement (ICC/κ ranges) for IFX (0.12-0.7/ 0.19-0.42) and ADL (0.69-0.89 /0.50-0.73). Qualitative measurements result in better agreement, as evidenced in our study. Greater agreement in V.2 compared with V.1 for IFX and ADL levels could be due to a better tune up. Further studies are required to standardise methods to establish therapeutic reference ranges.

Agreement between aggregate and individual-level measures of income and education: a comparison across three patient groups.

PubMed

Marra, Carlo A; Lynd, Larry D; Harvard, Stephanie S; Grubisic, Maja

2011-03-31

The association between lower socioeconomic status and poorer health outcomes has been observed using both individual-level and aggregate-level measures of income and education. While both are predictive of health outcomes, previous research indicates poor agreement between individual-level and aggregate-level measures. The purpose of this study was to determine the level of agreement between aggregate-level and individual-level measures of income and education among three distinct patient groups, specifically asthma, diabetes, and rheumatoid patients. Individual-level measures of annual household income and education were derived from three separate surveys conducted among patients with asthma (n = 359), diabetes (n = 281) and rheumatoid arthritis (n = 275). Aggregate-level measures of income and education were derived from the 2001 Canadian census, including both census tract-and dissemination area-level measures. Cross-tabulations of individual-level income by aggregate-level income were used to determine the percentage of income classifications in agreement. The kappa statistic (simple and weighted), Spearman's rank correlations, and intra-class correlation coefficient (ICC) were also calculated. Individual-level and aggregate-level education was compared using Chi-Square tests within patient groups. Point biserial correlation coefficients between individual-level and aggregate-level education were computed. Individual-level income was poorly correlated with aggregate-level measures, which provided the worst estimations of income among patients in the lowest income category at the individual-level. Both aggregate-level measures were best at approximating individual-level income in patients with diabetes, in whom aggregate-level estimates were only significantly different from individual-level measures for patients in the lowest income category. Among asthma patients, the proportion of patients classified by aggregate-level measures as having a university degree

Repeatability of shear wave elastography in liver fibrosis phantoms—Evaluation of five different systems

PubMed Central

2018-01-01

This study aimed to assess and validate the repeatability and agreement of quantitative elastography of novel shear wave methods on four individual tissue-mimicking liver fibrosis phantoms with different known Young’s modulus. We used GE Logiq E9 2D-SWE, Philips iU22 ARFI (pSWE), Samsung TS80A SWE (pSWE), Hitachi Ascendus (SWM) and Transient Elastography (TE). Two individual investigators performed all measurements non-continued and in parallel. The methods were evaluated for inter- and intraobserver variability by intraclass correlation, coefficient of variation and limits of agreement using the median elastography value. All systems used in this study provided high repeatability in quantitative measurements in a liver fibrosis phantom and excellent inter- and intraclass correlations. All four elastography platforms showed excellent intra-and interobserver agreement (interclass correlation 0.981–1.000 and intraclass correlation 0.987–1.000) and no significant difference in mean elasticity measurements for all systems, except for TE on phantom 4. All four liver fibrosis phantoms could be differentiated by quantitative elastography, by all platforms (p<0.001). In the Bland-Altman analysis the differences in measurements were larger for the phantoms with higher Young’s modulus. All platforms had a coefficient of variation in the range 0.00–0.21 for all four phantoms, equivalent to low variance and high repeatability. PMID:29293527

Accuracy of contrast-enhanced spectral mammography for estimating residual tumor size after neoadjuvant chemotherapy in patients with breast cancer: a feasibility study

PubMed Central

Barra, Filipe Ramos; de Souza, Fernanda Freire; Camelo, Rosimara Eva Ferreira Almeida; Ribeiro, Andrea Campos de Oliveira; Farage, Luciano

2017-01-01

Objective To assess the feasibility of contrast-enhanced spectral mammography (CESM) of the breast for assessing the size of residual tumors after neoadjuvant chemotherapy (NAC). Materials and methods In breast cancer patients who underwent NAC between 2011 and 2013, we evaluated residual tumor measurements obtained with CESM and full-field digital mammography (FFDM). We determined the concordance between the methods, as well as their level of agreement with the pathology. Three radiologists analyzed eight CESM and FFDM measurements separately, considering the size of the residual tumor at its largest diameter and correlating it with that determined in the pathological analysis. Interobserver agreement was also evaluated. Results The sensitivity, specificity, positive predictive value, and negative predictive value were higher for CESM than for FFDM (83.33%, 100%, 100%, and 66% vs. 50%, 50%, 50%, and 25%, respectively). The CESM measurements showed a strong, consistent correlation with the pathological findings (correlation coefficient = 0.76-0.92; intraclass correlation coefficient = 0.692-0.886). The correlation between the FFDM measurements and the pathological findings was not statistically significant, with questionable consistency (intraclass correlation coefficient = 0.488-0.598). Agreement with the pathological findings was narrower for CESM measurements than for FFDM measurements. Interobserver agreement was higher for CESM than for FFDM (0.94 vs. 0.88). Conclusion CESM is a feasible means of evaluating residual tumor size after NAC, showing a good correlation and good agreement with pathological findings. For CESM measurements, the interobserver agreement was excellent. PMID:28894329

Accuracy of contrast-enhanced spectral mammography for estimating residual tumor size after neoadjuvant chemotherapy in patients with breast cancer: a feasibility study.

PubMed

Barra, Filipe Ramos; de Souza, Fernanda Freire; Camelo, Rosimara Eva Ferreira Almeida; Ribeiro, Andrea Campos de Oliveira; Farage, Luciano

2017-01-01

To assess the feasibility of contrast-enhanced spectral mammography (CESM) of the breast for assessing the size of residual tumors after neoadjuvant chemotherapy (NAC). In breast cancer patients who underwent NAC between 2011 and 2013, we evaluated residual tumor measurements obtained with CESM and full-field digital mammography (FFDM). We determined the concordance between the methods, as well as their level of agreement with the pathology. Three radiologists analyzed eight CESM and FFDM measurements separately, considering the size of the residual tumor at its largest diameter and correlating it with that determined in the pathological analysis. Interobserver agreement was also evaluated. The sensitivity, specificity, positive predictive value, and negative predictive value were higher for CESM than for FFDM (83.33%, 100%, 100%, and 66% vs. 50%, 50%, 50%, and 25%, respectively). The CESM measurements showed a strong, consistent correlation with the pathological findings (correlation coefficient = 0.76-0.92; intraclass correlation coefficient = 0.692-0.886). The correlation between the FFDM measurements and the pathological findings was not statistically significant, with questionable consistency (intraclass correlation coefficient = 0.488-0.598). Agreement with the pathological findings was narrower for CESM measurements than for FFDM measurements. Interobserver agreement was higher for CESM than for FFDM (0.94 vs. 0.88). CESM is a feasible means of evaluating residual tumor size after NAC, showing a good correlation and good agreement with pathological findings. For CESM measurements, the interobserver agreement was excellent.

Agreement of Anterior Segment Parameters Obtained From Swept-Source Fourier-Domain and Time-Domain Anterior Segment Optical Coherence Tomography.

PubMed

Chansangpetch, Sunee; Nguyen, Anwell; Mora, Marta; Badr, Mai; He, Mingguang; Porco, Travis C; Lin, Shan C

2018-03-01

To assess the interdevice agreement between swept-source Fourier-domain and time-domain anterior segment optical coherence tomography (AS-OCT). Fifty-three eyes from 41 subjects underwent CASIA2 and Visante OCT imaging. One hundred eighty-degree axis images were measured with the built-in two-dimensional analysis software for the swept-source Fourier-domain AS-OCT (CASIA2) and a customized program for the time-domain AS-OCT (Visante OCT). In both devices, we examined the angle opening distance (AOD), trabecular iris space area (TISA), angle recess area (ARA), anterior chamber depth (ACD), anterior chamber width (ACW), and lens vault (LV). Bland-Altman plots and intraclass correlation (ICC) were performed. Orthogonal linear regression assessed any proportional bias. ICC showed strong correlation for LV (0.925) and ACD (0.992) and moderate agreement for ACW (0.801). ICC suggested good agreement for all angle parameters (0.771-0.878) except temporal AOD500 (0.743) and ARA750 (nasal 0.481; temporal 0.481). There was a proportional bias in nasal ARA750 (slope 2.44, 95% confidence interval [CI]: 1.95-3.18), temporal ARA750 (slope 2.57, 95% CI: 2.04-3.40), and nasal TISA500 (slope 1.30, 95% CI: 1.12-1.54). Bland-Altman plots demonstrated in all measured parameters a minimal mean difference between the two devices (-0.089 to 0.063); however, evidence of constant bias was found in nasal AOD250, nasal AOD500, nasal AOD750, nasal ARA750, temporal AOD500, temporal AOD750, temporal ARA750, and ACD. Among the parameters with constant biases, CASIA2 tends to give the larger numbers. Both devices had generally good agreement. However, there were proportional and constant biases in most angle parameters. Thus, it is not recommended that values be used interchangeably.

Agreement and correlation between the straight leg raise and slump tests in subjects with leg pain.

PubMed

Walsh, Jeremy; Hall, Toby

2009-01-01

The straight leg raise (SLR) and slump tests have traditionally been used to identify nerve root compression arising from disk herniation. However, they may be more appropriate as tests of lumbosacral neural tissue mechanosensitivity. The aim of this study was to determine agreement and correlation between the SLR and slump tests in a population presenting with back and leg pain. This was an observational, cross-sectional study design. Forty-five subjects with unilateral leg pain were recruited from an outpatient Back Pain Screening Clinic at a large teaching hospital in Ireland. The SLR and slump tests were performed on each side. In the event of symptom reproduction, the ankle was dorsiflexed. Reproduction of presenting symptoms, which were intensified by ankle dorsiflexion, was interpreted as a positive test. An inclinometer was used to measure range of motion (ROM). There was substantial agreement between SLR and slump test interpretation (kappa = 0.69) with good correlation in ROM between the 2 tests (r = 0.64) on the symptomatic side. In subjects who had positive results, ROM for both tests was significantly reduced compared to ROM on the contralateral side and ROM in subjects who had negative results. When the SLR and slump tests are interpreted as positive in the event of reproduction of presenting leg pain that are intensified by ankle dorsiflexion, these tests show substantial agreement and good correlation in the leg pain population. When interpreted in this way, these tests may be appropriate tests of neural tissue mechanosensitivity, but further criteria must be met before a definitive conclusion in relation to neural tissue mechanosensitivity may be drawn.

Intra-observer and inter-observer agreements for the measurement of dual-input whole tumor computed tomography perfusion in patients with lung cancer: Influences of the size and inner-air density of tumors.

PubMed

Wang, Qingle; Zhang, Zhiyong; Shan, Fei; Shi, Yuxin; Xing, Wei; Shi, Liangrong; Zhang, Xingwei

2017-09-01

This study was conducted to assess intra-observer and inter-observer agreements for the measurement of dual-input whole tumor computed tomography perfusion (DCTP) in patients with lung cancer. A total of 88 patients who had undergone DCTP, which had proved a diagnosis of primary lung cancer, were divided into two groups: (i) nodules (diameter ≤3 cm) and masses (diameter >3 cm) by size, and (ii) tumors with and without air density. Pulmonary flow, bronchial flow, and pulmonary index were measured in each group. Intra-observer and inter-observer agreements for measurement were assessed using intraclass correlation coefficient, within-subject coefficient of variation, and Bland-Altman analysis. In all lung cancers, the reproducibility coefficient for intra-observer agreement (range 26.1-38.3%) was superior to inter-observer agreement (range 38.1-81.2%). Further analysis revealed lower agreements for nodules compared to masses. Additionally, inner-air density reduced both agreements for lung cancer. The intra-observer agreement for measuring lung cancer DCTP was satisfied, while the inter-observer agreement was limited. The effects of tumoral size and inner-air density to agreements, especially between two observers, should be emphasized. In future, an automatic computer-aided segment of perfusion value of the tumor should be developed. © 2017 The Authors. Thoracic Cancer published by China Lung Oncology Group and John Wiley & Sons Australia, Ltd.

Quality Control of Epidemiological Lectures Online: Scientific Evaluation of Peer Review

PubMed Central

Linkov, Faina; Lovalekar, Mita; LaPorte, Ronald

2007-01-01

Aim To examine the feasibility of using peer review for the quality control of online materials. Methods We analyzed the inter-rater agreement on the quality of epidemiological lectures online, based on the Global Health Network Supercourse lecture library. We examined the agreement among reviewers by looking at κ statistics and intraclass correlations. Seven expert reviewers examined and rated a random sample of 100 Supercourse lectures. Their reviews were compared with the reviews of the lay Supercourse reviewers. Results Both expert and non-expert reviewers rated lectures very highly, with a mean overall score of 4 out of 5. Kappa (κ) statistic and intraclass correlations indicated that inter-rater agreement for experts and non-experts was surprisingly low (below 0.4). Conclusions To our knowledge, this was the first time that poor inter-rater agreement was demonstrated for the Internet lectures. Future research studies need to evaluate the alternatives to the peer review system, especially for online materials. PMID:17436390

Test-retest stability of the Task and Ego Orientation Questionnaire.

PubMed

Lane, Andrew M; Nevill, Alan M; Bowes, Neal; Fox, Kenneth R

2005-09-01

Establishing stability, defined as observing minimal measurement error in a test-retest assessment, is vital to validating psychometric tools. Correlational methods, such as Pearson product-moment, intraclass, and kappa are tests of association or consistency, whereas stability or reproducibility (regarded here as synonymous) assesses the agreement between test-retest scores. Indexes of reproducibility using the Task and Ego Orientation in Sport Questionnaire (TEOSQ; Duda & Nicholls, 1992) were investigated using correlational (Pearson product-moment, intraclass, and kappa) methods, repeated measures multivariate analysis of variance, and calculating the proportion of agreement within a referent value of +/-1 as suggested by Nevill, Lane, Kilgour, Bowes, and Whyte (2001). Two hundred thirteen soccer players completed the TEOSQ on two occasions, 1 week apart. Correlation analyses indicated a stronger test-retest correlation for the Ego subscale than the Task subscale. Multivariate analysis of variance indicated stability for ego items but with significant increases in four task items. The proportion of test-retest agreement scores indicated that all ego items reported relatively poor stability statistics with test-retest scores within a range of +/-1, ranging from 82.7-86.9%. By contrast, all task items showed test-retest difference scores ranging from 92.5-99%, although further analysis indicated that four task subscale items increased significantly. Findings illustrated that correlational methods (Pearson product-moment, intraclass, and kappa) are influenced by the range in scores, and calculating the proportion of agreement of test-retest differences with a referent value of +/-1 could provide additional insight into the stability of the questionnaire. It is suggested that the item-by-item proportion of agreement method proposed by Nevill et al. (2001) should be used to supplement existing methods and could be especially helpful in identifying rogue items in the

Patient-Proxy Agreement on the Health-Related Quality of Life One Year After Traumatic Brain Injury.

PubMed

Hwang, Hei-Fen; Chen, Chih-Yi; Lin, Mau-Roung

2017-12-01

To examine the level of agreement between patients and their proxies on a measure of health-related quality of life (HRQL) 1 year after traumatic brain injury (TBI). A cross-sectional study. Four hospitals in Taipei. Participants (N=176) were patients with TBI (n=88) identified from discharge records of 4 hospitals in Taiwan and family members or friends (n=88) who could answer questions regarding the patient's health and HRQL 1 year after the injury. Not applicable. A health profile of the brief Taiwanese version of the World Health Organization Quality of Life (WHOQOL-BREF) and 2 health utility measures of the time tradeoff (TTO) and standard gamble (SG). Compared with proxy responses, patients provided higher ratings on the domains of the WHOQOL-BREF and lower ratings on the TTO and SG. Intraclass correlation coefficients between patient and proxy ratings varied among the 4 domains of the WHOQOL-BREF, in which levels of agreement were moderate or good for physical capacity (.69) and low for psychological well-being (.45), social relationships (.24), and the environment (.32). Levels of agreement were extremely low for the TTO (0.0) and SG (.10). A profile analysis showed that patients' ratings on the WHOQOL-BREF, on average, were significantly greater than those of their proxies (mean difference, 3.07), with a similar distribution of scatter responses (mean difference, .002) and shape agreement (mean difference, .57). Greater variations in the patient-proxy level of agreement appeared in patients who were younger and had more severe injuries, and also with parent and child proxies. To assess the HRQL of patients with a TBI, the level of patient-proxy agreement was adequate for the physical domain but was lower for the social and environmental domains, and the agreement was very low for the TTO and SG. Furthermore, a patient's age and injury severity, and the patient-proxy' relationship may affect the agreement. Copyright © 2017 American Congress of

Coronary artery disease reporting and data system (CAD-RADSTM): Inter-observer agreement for assessment categories and modifiers.

PubMed

Maroules, Christopher D; Hamilton-Craig, Christian; Branch, Kelley; Lee, James; Cury, Roberto C; Maurovich-Horvat, Pál; Rubinshtein, Ronen; Thomas, Dustin; Williams, Michelle; Guo, Yanshu; Cury, Ricardo C

The Coronary Artery Disease Reporting and Data System (CAD-RADS) provides a lexicon and standardized reporting system for coronary CT angiography. To evaluate inter-observer agreement of the CAD-RADS among an panel of early career and expert readers. Four early career and four expert cardiac imaging readers prospectively and independently evaluated 50 coronary CT angiography cases using the CAD-RADS lexicon. All readers assessed image quality using a five-point Likert scale, with mean Likert score ≥4 designating high image quality, and <4 designating moderate/low image quality. All readers were blinded to medical history and invasive coronary angiography findings. Inter-observer agreement for CAD-RADS assessment categories and modifiers were assessed using intra-class correlation (ICC) and Fleiss' Kappa (κ).The impact of reader experience and image quality on inter-observer agreement was also examined. Inter-observer agreement for CAD-RADS assessment categories was excellent (ICC 0.958, 95% CI 0.938-0.974, p < 0.0001). Agreement among expert readers (ICC 0.925, 95% CI 0.884-0.954) was marginally stronger than for early career readers (ICC 0.904, 95% CI 0.852-0.941), both p < 0.0001. High image quality was associated with stronger agreement than moderate image quality (ICC 0.944, 95% CI 0.886-0.974 vs. ICC 0.887, 95% CI 0.775-0.95, both p < 0.0001). While excellent inter-observer agreement was observed for modifiers S (stent) and G (bypass graft) (both κ = 1.0), only fair agreement (κ = 0.40) was observed for modifier V (high risk plaque). Inter-observer reproducibility of CAD-RADS assessment categories and modifiers is excellent, except for high-risk plaque (modifier V) which demonstrates fair agreement. These results suggest CAD-RADS is feasible for clinical implementation. Copyright © 2017. Published by Elsevier Inc.

Agreement among Goldmann applanation tonometer, iCare, and Icare PRO rebound tonometers; non-contact tonometer; and Tonopen XL in healthy elderly subjects.

PubMed

Kato, Yoshitake; Nakakura, Shunsuke; Matsuo, Naoko; Yoshitomi, Kayo; Handa, Marina; Tabuchi, Hitoshi; Kiuchi, Yoshiaki

2018-04-01

To evaluate the inter-device agreement among the Goldmann applanation tonometer (GAT), iCare and Icare PRO rebound tonometers, non-contact tonometer (NCT), and Tonopen XL tonometer. Sixty healthy elderly subjects were enrolled. The intraocular pressure (IOP) in each subject's right eye was measured thrice using each of the five tonometers. Intra-device agreement was evaluated by calculating intraclass correlation coefficients (ICCs). Inter-device agreement was evaluated by ICC and Bland-Altman analyses. ICCs for intra-device agreement for each tonometer were >0.8. IOP as measured by iCare (mean ± SD, 11.6 ± 2.5 mmHg) was significantly lower (p < 0.05) than that measured by GAT (14.0 ± 2.8 mmHg), NCT (13.6 ± 2.5 mmHg), Tonopen XL (13.7 ± 4.1 mmHg), and Icare PRO (12.6 ± 2.2 mmHg; Bonferroni test). There was no significant difference in mean IOP among GAT, NCT, and Tonopen XL. Regarding inter-device agreement, ICC was lower between Tonopen XL and other tonometers (all ICCs < 0.4). However, ICCs of GAT, iCare, Icare PRO, and NCT showed good agreement (0.576-0.700). The Bland-Altman analysis revealed that the width of the 95% limits of agreement was larger between the Tonopen XL and the other tonometers ranged from 14.94 to 16.47 mmHg. Among the other tonometers, however, the widths of 95% limits of agreement ranged from 7.91 to 9.24 mmHg. There was good inter-device agreement among GAT, rebound tonometers, and NCT. Tonopen XL shows the worst agreement with the other tonometers; therefore, we should pay attention to its' respective IOP. Japan Clinical Trials Register; number: UMIN000011544.

Steps towards Smarter Solutions in Optometry and Ophthalmology-Inter-Device Agreement of Subjective Methods to Assess the Refractive Errors of the Eye.

PubMed

Ohlendorf, Arne; Leube, Alexander; Wahl, Siegfried

2016-07-13

To investigate the inter-device agreement and mean differences between a newly developed digital phoropter and the two standard methods (trial frame and manual phoropter). Refractive errors of two groups of participants were measured by two examiners (examiner 1 (E1): 36 subjects; examiner 2 (E2): 38 subjects). Refractive errors were assessed using a trial frame, a manual phoropter and a digital phoropter. Inter-device agreement regarding the measurement of refractive errors was analyzed for differences in terms of the power vector components (spherical equivalent (SE) and the cylindrical power vector components J0 and J45) between the used methods. Intraclass correlation coefficients (ICC's) were calculated to evaluate correlations between the used methods. Analyzing the variances between the three methods for SE, J0 and J45 using a two-way ANOVA showed no significant differences between the methods (SE: p = 0.13, J0: p = 0.58 and J45: p = 0.96) for examiner 1 and for examiner 2 (SE: p = 0.88, J0: p = 0.95 and J45: p = 1). Mean differences and ±95% Limits of Agreement for each pair of inter-device agreement regarding the SE for both examiners were as follows: Trial frame vs. digital phoropter: +0.10 D ± 0.56 D (E1) and +0.19 D ± 0.60 D (E2), manual phoropter vs. trial frame: -0.04 D ± 0.59 D (E1) and -0.12 D ± 0.49 D (E2) and for manual vs. digital phoropter: +0.06 D ± 0.65 D (E1) and +0.08 D ± 0.45 D (E2). ICCs revealed high correlations between all methods for both examiner (p < 0.001). The time to assess the subjective refraction was significantly smaller with the digital phoropter (examiner 1: p < 0.001; examiner 2: p < 0.001). "All used subjective methods show a good agreement between each other terms of ICC (>0.9). Assessing refractive errors using different subjective methods, results in similar mean differences and 95% limits of agreement, when compared to those reported in studies comparing subjective refraction non-cylcoplegic retinoscopy or

Steps towards Smarter Solutions in Optometry and Ophthalmology—Inter-Device Agreement of Subjective Methods to Assess the Refractive Errors of the Eye

PubMed Central

Ohlendorf, Arne; Leube, Alexander; Wahl, Siegfried

2016-01-01

Purpose: To investigate the inter-device agreement and mean differences between a newly developed digital phoropter and the two standard methods (trial frame and manual phoropter). Methods: Refractive errors of two groups of participants were measured by two examiners (examiner 1 (E1): 36 subjects; examiner 2 (E2): 38 subjects). Refractive errors were assessed using a trial frame, a manual phoropter and a digital phoropter. Inter-device agreement regarding the measurement of refractive errors was analyzed for differences in terms of the power vector components (spherical equivalent (SE) and the cylindrical power vector components J0 and J45) between the used methods. Intraclass correlation coefficients (ICC’s) were calculated to evaluate correlations between the used methods. Results: Analyzing the variances between the three methods for SE, J0 and J45 using a two-way ANOVA showed no significant differences between the methods (SE: p = 0.13, J0: p = 0.58 and J45: p = 0.96) for examiner 1 and for examiner 2 (SE: p = 0.88, J0: p = 0.95 and J45: p = 1). Mean differences and ±95% Limits of Agreement for each pair of inter-device agreement regarding the SE for both examiners were as follows: Trial frame vs. digital phoropter: +0.10 D ± 0.56 D (E1) and +0.19 D ± 0.60 D (E2), manual phoropter vs. trial frame: −0.04 D ± 0.59 D (E1) and −0.12 D ± 0.49 D (E2) and for manual vs. digital phoropter: +0.06 D ± 0.65 D (E1) and +0.08 D ± 0.45 D (E2). ICCs revealed high correlations between all methods for both examiner (p < 0.001). The time to assess the subjective refraction was significantly smaller with the digital phoropter (examiner 1: p < 0.001; examiner 2: p < 0.001). Conclusion: “All used subjective methods show a good agreement between each other terms of ICC (>0.9). Assessing refractive errors using different subjective methods, results in similar mean differences and 95% limits of agreement, when compared to those reported in studies comparing subjective

Validity and Reliability of the Golombok Rust Inventory of Sexual Satisfaction in Couples with Incontinent Partners.

PubMed

Lim, Renly; Liong, Men Long; Khan, Nurzalina Abdul Karim; Yuen, Kah Hay

2017-02-17

There is currently no published information on the validity and reliability of the Golombok Rust Inventory of Sexual Satisfaction in the Asian population, specifically in patients with stress urinary incontinence, which limits its use in this region. Our study aimed to evaluate the psychometric properties of this questionnaire in the Malaysian population. Ten couples were recruited for the pilot testing. The agreement between the English and Chinese or Malay versions were tested using the intraclass correlation coefficients, with results of more than 0.80 for all subscales and overall scores indicating good agreement. Sixty-six couples were included in the subsequent phase. The following data are presented in the order of English, Chinese, and Malay. Cronbach's alphas for the male total score were 0.82, 0.88, and 0.95. For the female total score, Cronbach's alphas were 0.76, 0.78, and 0.88. Intraclass correlation coefficients for the male total score were 0.93, 0.94, and 0.99, while intraclass correlation coefficients for the female total score were 0.89, 0.86, and 0.88. In conclusion, the English, Chinese, and Malay versions each proved to be valid and reliable in our Malaysian population.

Intra-rater reliability and agreement of various methods of measurement to assess dorsiflexion in the Weight Bearing Dorsiflexion Lunge Test (WBLT) among female athletes.

PubMed

Langarika-Rocafort, Argia; Emparanza, José Ignacio; Aramendi, José F; Castellano, Julen; Calleja-González, Julio

2017-01-01

To examine the intra-observer reliability and agreement between five methods of measurement for dorsiflexion during Weight Bearing Dorsiflexion Lunge Test and to assess the degree of agreement between three methods in female athletes. Repeated measurements study design. Volleyball club. Twenty-five volleyball players. Dorsiflexion was evaluated using five methods: heel-wall distance, first toe-wall distance, inclinometer at tibia, inclinometer at Achilles tendon and the dorsiflexion angle obtained by a simple trigonometric function. For the statistical analysis, agreement was studied using the Bland-Altman method, the Standard Error of Measurement and the Minimum Detectable Change. Reliability analysis was performed using the Intraclass Correlation Coefficient. Measurement methods using the inclinometer had more than 6° of measurement error. The angle calculated by trigonometric function had 3.28° error. The reliability of inclinometer based methods had ICC values < 0.90. Distance based methods and trigonometric angle measurement had an ICC values > 0.90. Concerning the agreement between methods, there was from 1.93° to 14.42° bias, and from 4.24° to 7.96° random error. To assess DF angle in WBLT, the angle calculated by a trigonometric function is the most repeatable method. The methods of measurement cannot be used interchangeably. Copyright © 2016 Elsevier Ltd. All rights reserved.

Is liver perfusion CT reproducible? A study on intra- and interobserver agreement of normal hepatic haemodynamic parameters obtained with two different software packages.

PubMed

Bretas, Elisa Almeida Sathler; Torres, Ulysses S; Torres, Lucas Rios; Bekhor, Daniel; Saito Filho, Celso Fernando; Racy, Douglas Jorge; Faggioni, Lorenzo; D'Ippolito, Giuseppe

2017-10-01

To evaluate the agreement between the measurements of perfusion CT parameters in normal livers by using two different software packages. This retrospective study was based on 78 liver perfusion CT examinations acquired for detecting suspected liver metastasis. Patients with any morphological or functional hepatic abnormalities were excluded. The final analysis included 37 patients (59.7 ± 14.9 y). Two readers (1 and 2) independently measured perfusion parameters using different software packages from two major manufacturers (A and B). Arterial perfusion (AP) and portal perfusion (PP) were determined using the dual-input vascular one-compartmental model. Inter-reader agreement for each package and intrareader agreement between both packages were assessed with intraclass correlation coefficients (ICC) and Bland-Altman statistics. Inter-reader agreement was substantial for AP using software A (ICC = 0.82) and B (ICC = 0.85-0.86), fair for PP using software A (ICC = 0.44) and fair to moderate for PP using software B (ICC = 0.56-0.77). Intrareader agreement between software A and B ranged from slight to moderate (ICC = 0.32-0.62) for readers 1 and 2 considering the AP parameters, and from fair to moderate (ICC = 0.40-0.69) for readers 1 and 2 considering the PP parameters. At best there was only moderate agreement between both software packages, resulting in some uncertainty and suboptimal reproducibility. Advances in knowledge: Software-dependent factors may contribute to variance in perfusion measurements, demanding further technical improvements. AP measurements seem to be the most reproducible parameter to be adopted when evaluating liver perfusion CT.

Analysis of Agreement of Retinal-Layer Thickness Measures Derived from the Segmentation of Horizontal and Vertical Spectralis OCT Macular Scans.

PubMed

Gonzalez Caldito, Natalia; Antony, Bhavna; He, Yufan; Lang, Andrew; Nguyen, James; Rothman, Alissa; Ogbuokiri, Esther; Avornu, Ama; Balcer, Laura; Frohman, Elliot; Frohman, Teresa C; Bhargava, Pavan; Prince, Jerry; Calabresi, Peter A; Saidha, Shiv

2018-03-01

Optical coherence tomography (OCT) is a reliable method used to quantify discrete layers of the retina. Spectralis OCT is a device used for this purpose. Spectralis OCT macular scan imaging acquisition can be obtained on either the horizontal or vertical plane. The vertical protocol has been proposed as favorable, due to postulated reduction in confound of Henle's fibers on segmentation-derived metrics. Yet, agreement of the segmentation measures of horizontal and vertical macular scans remains unexplored. Our aim was to determine this agreement. Horizontal and vertical macular scans on Spectralis OCT were acquired in 20 healthy controls (HCs) and 20 multiple sclerosis (MS) patients. All scans were segmented using Heidelberg software and a Johns Hopkins University (JHU)-developed method. Agreement was analyzed using Bland-Altman analyses and intra-class correlation coefficients (ICCs). Using both segmentation techniques, mean differences (agreement at the cohort level) in the thicknesses of all macular layers derived from both acquisition protocols in MS patients and HCs were narrow (<1 µm), while the limits of agreement (LOA) (agreement at the individual level) were wider. Using JHU segmentation mean differences (and LOA) for the macular retinal nerve fiber layer (RNFL) and ganglion cell layer + inner plexiform layer (GCIP) in MS were 0.21 µm (-1.57-1.99 µm) and -0.36 µm (-1.44-1.37 µm), respectively. OCT segmentation measures of discrete retinal-layer thicknesses derived from both vertical and horizontal protocols on Spectralis OCT agree excellently at the cohort level (narrow mean differences), but only moderately at the individual level (wide LOA). This suggests patients scanned using either protocol should continue to be scanned with the same protocol. However, due to excellent agreement at the cohort level, measures derived from both acquisitions can be pooled for outcome purposes in clinical trials.

Reliability and Agreement of Neck Functional Capacity Evaluation Tests in Patients With Chronic Multifactorial Neck Pain.

PubMed

Reneman, M F; Roelofs, M; Schiphorst Preuper, H R

2017-07-01

To analyze test-retest reliability and agreement, and to explore the safety of neck functional capacity evaluation (Neck-FCE) tests in patients with chronic multifactorial neck pain. Test-retest; 2 FCE sessions were held with a 2-week interval. University-based outpatient rehabilitation center. Individuals (N=18; 14 women) with a mean age of 34 years. Not applicable. The Neck-FCE protocol consists of 6 tests: lifting waist to overhead (kg), 2-handed carrying (kg), overhead working (s), bending and overhead reaching (s), and repetitive side reaching (left and right) (s). Intraclass correlation coefficients (ICCs) and limits of agreement (LoA) were calculated. ICC point estimates between .75 and .90 were considered as good, and >.90 were considered as excellent reliability. ICC point estimates ranged between .39 and .96. Ratios of the LoA ranged between 32.0% and 56.5%. Mean ± SD numeric rating scale pain scores in the neck and shoulder 24 hours after the test were 6.7±2.6 and 6.3±3.0, respectively. Based on ICC point estimates and 95% confidence intervals, 3 tests had excellent reliability and 3 had poor reliability. LoA were substantial in all 6 tests. Safety was confirmed. Copyright © 2016 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Agreement between children with cancer and their parents in reporting the child's health-related quality of life during a stay at the hospital and at home.

PubMed

Speyer, E; Herbinet, A; Vuillemin, A; Chastagner, P; Briançon, S

2009-07-01

Although parent-child agreement is widely studied in the paediatric clinical sample, no study has compared parent-child agreement during home and hospital stays. We aimed to determine the level of agreement in reports of health-related quality of life (HRQoL) between parents of children with cancer and the children themselves during a stay in the hospital and a stay at home. The sample consisted of 28 children, aged 9-18 years old, hospitalized and treated for cancer in a Children's University Hospital in France. The child's HRQoL was assessed by the parent and child versions of the Child Health Questionnaire. Parent-child agreement was estimated by the intraclass correlation coefficient. Potential predictors influencing the parent-child agreement were investigated. For both locations of stay, parent scores from the HRQoL survey were lower than those for their children for all domains, except for the general behaviour during the home stay. Scores for both parents and children, for all domains, were lower during the hospital than the home stay. The parent-child agreement was better for mental health, self-esteem, general health and family activities during the hospital stay (range 0.32-0.66), but was better for physical function, role/physical and general behaviour during the home stay (range 0.45-0.71). Few predictors of parent-child agreement were found. Agreement between parents and their children who have cancer in reporting the child's HRQoL differed by location of stay. For the home stay, the agreement was better for domains related to the child's physical life, but for the hospital stay, it was better for domains related to the child's behaviour/psychological life.

Profiles and Correlates of Parent-Child Agreement on Social Anxiety Symptoms in Youth with Autism Spectrum Disorder

ERIC Educational Resources Information Center

Burrows, Catherine A.; Usher, Lauren V.; Becker-Haimes, Emily M.; McMahon, Camilla M.; Mundy, Peter C.; Jensen-Doss, Amanda; Henderson, Heather A.

2018-01-01

This study characterized patterns and correlates of parent-youth agreement on social anxiety in youth with and without autism spectrum disorder (ASD). Participants (279 verbally-fluent youth aged 8-16 years, NASD = 144, NTD = 135) completed the SASC-R. Youth with ASD exhibited higher social anxiety across informants. While TD youth endorsed higher…

Test-retest reliability and agreement of the Satisfaction with the Assistive Technology Services (SATS) instrument in two Nordic countries.

PubMed

Sund, Terje; Iwarsson, Susanne; Anttila, Heidi; Helle, Tina; Brandt, Ase

2014-07-01

The purpose of this study was to investigate test-retest reliability, agreement, internal consistency, and floor- and ceiling effects of the Danish and Finnish versions of the Satisfaction with the Assistive Technology Services (SATS) instrument among adult users of powered wheelchairs (PWCs) or powered scooters (scooters). Test-retest design, two telephone interviews 7-18 days apart of 40 informants, with mean age of 67.5 (SD 13.09) years in the Danish; and 54 informants with mean age of 55.6 (SD 12.09) years in the Finnish sample. The intra-class correlation coefficient varied between 0.57 and 0.93 for items in the Danish and between 0.41 and 0.93 in the Finnish sample. The percentage agreement varied between 54.2 and 79.5 for items in the Danish and between 69.2 and 81.1 in the Finnish sample, while the Cronbach's alpha values varied between 0.87 and 0.96 in the two samples. A ceiling effect was found in all items of both samples. This study indicates that the SATS may be reliably administered for telephone interviews among adult PWC and scooter users, and give information about aspects of the service delivery process for quality development improvement purposes. Further psychometric testing of the SATS is required.

Repeatability data and agreement of keratometry with the VERION system compared to the IOLMaster.

PubMed

Nemeth, Gabor; Szalai, Eszter; Hassan, Ziad; Lipecz, Agnes; Berta, Andras; Modis, Laszlo

2015-05-01

To analyze the repeatability of keratometric and white-to-white (WTW) distance measurements with the VERION Measurement Module (Alcon Laboratories, Inc., Fort Worth, TX) and to compare the measured data to the results of the IOLMaster (Carl Zeiss Meditec, Jena, Germany). Three images were captured with the VERION and the flattest and steepest keratometric data, the astigmatism axis, and the WTW distance were recorded. Subsequently, the axial length, the keratometric data with axis, and the WTW distance were measured with an IOLMaster. The repeatability data of the keratometric value of the VERION System, converted to cross cylinder J0 and J45 vector components, were analyzed. The agreement data for keratometry obtained by the VERION System and the differences regarding keratometric data and WTW distance compared to IOLMaster were calculated. The measurements were conducted in 50 eyes of 50 healthy volunteers (median age: 50.32 years, range: 19.34 to 85.3 years). The flattest and the steepest keratometric data, the diopter of astigmatism, the J0 and J45 vector components, and WTW distance did not differ significantly between devices (P > .05). Intraclass correlation coefficients (range: 0.863 to 0.994) and Cronbach's alpha values (range: 0.950 to 0.998) were high for all parameters measured by the VERION System. The VERION System has high repeatability and agreement with the IOLMaster, making it suitable as an alternative tool in clinical practice. Copyright 2015, SLACK Incorporated.

Characterization of Severe Arterial Phase Respiratory Motion Artifact on Gadoxetate Disodium-Enhanced MRI - Assessment of Interrater Agreement and Reliability.

PubMed

Ringe, Kristina Imeen; Luetkens, Julian A; Fimmers, Rolf; Hammerstingl, Renate Maria; Layer, Günter; Maurer, Martin H; Nähle, Claas Philip; Michalik, Sabine; Reimer, Peter; Schraml, Christina; Schreyer, Andreas G; Stumpp, Patrick; Vogl, Thomas J; Wacker, Frank K; Willinek, Winfried; Kukuk, Guido Mattias

2018-04-01

 To assess the interrater agreement and reliability of experienced abdominal radiologists in the characterization and grading of arterial phase gadoxetate disodium-related respiratory motion artifact on liver MRI.  This prospective multicenter study was initiated by the working group for abdominal imaging within the German Roentgen Society (DRG), and approved by the local IRB of each participating center. 11 board-certified radiologists independently reviewed 40 gadoxetate disodium-enhanced liver MRI datasets. Motion artifacts in the arterial phase were assessed on a 5-point scale. Interrater agreement and reliability were calculated using the intraclass correlation coefficient (ICC) and Kendall coefficient of concordance (W), with p < 0.05 deemed significant.  The ICC for interrater agreement and reliability were 0.983 (CI 0.973 - 0.990) and 0.985 (CI 0.978 - 0.991), respectively (both p < 0.0001), indicating excellent agreement and reliability. Kendall's W for interrater agreement was 0.865. A severe motion artifact, defined as a mean motion score ≥ 4 in the arterial phase was observed in 12 patients. In these specific cases, a motion score ≥ 4 was assigned by all readers in 75 % (n = 9/12 cases).  Differentiation and grading of arterial phase respiratory motion artifact is possible with a high level of inter-/intrarater agreement and interrater reliability, which is crucial for assessing the incidence of this phenomenon in larger multicenter studies.   · Inter- and intrarater agreement for motion artifact scoring is excellent among experienced readers.. · Interrater reliability for motion artifact scoring is excellent among experienced readers.. · Characterization of severe motion artifacts proved feasible in this multicenter study.. · Ringe KI, Luetkens JA, Fimmers R et al. Characterization of Severe Arterial Phase Respiratory Motion Artifact on Gadoxetate Disodium-Enhanced MRI - Assessment of Interrater Agreement

Agreement between child self-reported and parent-reported scores for chronic pain secondary to specific pediatric diseases.

PubMed

Díez Rodriguez-Labajo, A; Castarlenas, E; Miró, J; Reinoso-Barbero, F

2017-03-01

Parental report on a child's secondary chronic pain is commonly requested by anesthesiologists when the child cannot directly provide information. Daily pain intensity is reported as highest, average and lowest. However, it is unclear whether the parents' score is a valid indicator of the child's pain experience. Nineteen children (aged 6-18years) with secondary chronic pain attending our anesthesiologist-run pediatric pain unit participated in this study. Identification of highest, average and lowest pain intensity levels were requested during initial screening interviews with the child and parents. Pain intensity was scored on a 0-10 numerical rating scale. Agreement was examined using: (i) intraclass correlation coefficient (ICC), and (ii) the Bland-Altman method. The ICC's between the children and the parents' pain intensity reports were: 0.92 for the highest, 0.68 for the average, and 0.50 for the lowest pain intensity domains. The limits of agreement set at 95% between child and parental reports were respectively +2.19 to -2.07, +3.17 to -3.88 and +5.15 to -5.50 for the highest, average and lowest pain domains. For the highest pain intensity domain, agreement between parents and children was excellent. If replicated this preliminary finding would suggest the highest pain intensity is the easiest domain for reporting pain intensity when a child cannot directly express him or herself. Copyright © 2016 Sociedad Española de Anestesiología, Reanimación y Terapéutica del Dolor. Publicado por Elsevier España, S.L.U. All rights reserved.

Reliability and limits of agreement of circumferential, water displacement, and optoelectronic volumetry in the measurement of upper limb lymphedema.

PubMed

Deltombe, T; Jamart, J; Recloux, S; Legrand, C; Vandenbroeck, N; Theys, S; Hanson, P

2007-03-01

We conducted a reliability comparison study to determine the intrarater and inter-rater reliability and the limits of agreement of the volume estimated by circumferential measurements using the frustum sign method and the disk model method, by water displacement volumetry, and by infrared optoelectronic volumetry in the assessment of upper limb lymphedema. Thirty women with lymphedema following axillary lymph node dissection surgery for breast cancer surgery were enrolled. In each patient, the volumes of the upper limbs were estimated by three physical therapists using circumference measurements, water displacement and optoelectronic volumetry. One of the physical therapists performed each measure twice. Intraclass correlation coefficients (ICCs), relative differences, and limits of agreement were determined. Intrarater and interrater reliability ICCs ranged from 0.94 to 1. Intrarater relative differences were 1.9% for the disk model method, 3.2% for the frustum sign model method, 2.9% for water displacement volumetry, and 1.5% for optoelectronic volumetry. Intrarater reliability was always better than interrater, except for the optoelectronic method. Intrarater and interrater limits of agreement were calculated for each technique. The disk model method and optoelectronic volumetry had better reliability than the frustum sign method and water displacement volumetry, which is usually considered to be the gold standard. In terms of low-cost, simplicity, and reliability, we recommend the disk model method as the method of choice in clinical practice. Since intrarater reliability was always better than interrater reliability (except for optoelectronic volumetry), patients should therefore, ideally, always be evaluated by the same therapist. Additionally, the limits of agreement must be taken into account when determining the response of a patient to treatment.

Correlation and agreement of self-assessed and objective skin disease severity in a cross-sectional study of patients with acne, psoriasis, and atopic eczema.

PubMed

Magin, Parker J; Pond, C Dimity; Smith, Wayne T; Watson, Alan B; Goode, Susan M

2011-12-01

Previous studies have shown variable correlation of patients' self-assessed skin severity measures and clinician-assessed objective measures of severity. But, generally, correlation has not been as good as might be expected for conditions in which the objective physical extent of skin disease is apparent to the sufferer to an extent that is not applicable in many other diseases. This paper reports agreement and correlation of self-assessed and objective severity measures in a study of 108 subjects with acne, psoriasis, or atopic eczema. The study was a cross-sectional study examining psychological associations of these skin diseases. Objective severity was assessed with the Leeds technique (acne), the Psoriasis Area and Severity Index, and Six Area Six Sign Atopic Dermatitis instruments. Agreement is a more appropriate measure than correlation in this situation and was measured with weighted kappa, while correlation was measured with Spearman's rank correlation. There was a modest correlation of ρ = 0.46 and similarly very modest agreement of 0.35 (weighted kappa) of self-assessed and clinician-assessed disease severity. Furthermore, self-assessed (but not clinician-assessed) severity was statistically associated with psychological morbidity in this study; i.e. - depression, anxiety, and overall psychological morbidity. Clinicians should consider psychological sequelae of skin disease, not only in those with objectively more severe disease but in patients across the severity spectrum. Both observational and interventional studies of skin disease should include both clinician-assessed and self-assessed measures of severity among assessed variables. © 2011 The International Society of Dermatology.

Hip range of motion and provocative physical examination tests reliability and agreement in asymptomatic volunteers

PubMed Central

Prather, H; Harris-Hayes, M; Hunt, D; Steger-May, K; Mathew, V; Clohisy, JC

2012-01-01

Objective The objectives of this study are the following: 1) report passive hip ROM in asymptomatic young adults, 2) report the intra-tester and inter-tester reliability of hip ROM measurements among testers of multiple disciplines, 3) report the results of provocative hip tests and tester agreement. Design descriptive epidemiology study Setting tertiary university Participants Twenty-eight young adult volunteers without musculoskeletal symptoms, history of disorder or surgery involving the lumbar spine or lower extremities were enrolled and completed the study. Methods Asymptomatic young adult volunteers completed questionnaires and were examined by two blinded examiners during a single session. The testers were physical therapists and physicians. Hip range of motion and provocative tests were completed by both examiners on each hip. Main Outcome Measurements Inter and intra-rater reliability for ROM and agreement for provocative tests was determined. Results Twenty-eight asymptomatic adults with mean age 31 years old (range 18–51 years) and mean modified Harris Hip Score of 99.5 ± 1.5 and UCLA Activity score of 8.8 ± 1.2 completed the study. Intra-rater agreement was excellent for all hip range of motion measurements, with intraclass correlation coefficients (ICCs) ranging from 0.76 to 0.97 with similar agreement if the examiner was a physical therapist or a physician. Excellent inter-rater reliability was found for hip flexion ICC 0.87 (95% CI 0.78 to 0.92), supine internal rotation ICC 0.75 (95% CI 0.60 to 0.84) and prone internal rotation ICC 0.79 (95% CI 0.66 to 0.87). The least reliable measurements were supine hip abduction (ICC 0.34) and supine external rotation (ICC 0.18). Agreement between examiners ranged from 96–100% for provocative hip tests which included the hip impingement, resisted straight leg raise, FABER/Patrick’s and log roll tests. Conclusions Specific hip ROM measures show excellent inter-rater reliability and provocative hip tests

Measurement agreement of the self-administered questionnaire of the Belgian Health Interview Survey: Paper-and-pencil versus web-based mode.

PubMed

Braekman, Elise; Berete, Finaba; Charafeddine, Rana; Demarest, Stefaan; Drieskens, Sabine; Gisle, Lydia; Molenberghs, Geert; Tafforeau, Jean; Van der Heyden, Johan; Van Hal, Guido

2018-01-01

Before organizing mixed-mode data collection for the self-administered questionnaire of the Belgian Health Interview Survey, measurement effects between the paper-and-pencil and the web-based questionnaire were evaluated. A two-period cross-over study was organized with a sample of 149 employees of two Belgian research institutes (age range 22-62 years, 72% female). Measurement agreement was assessed for a diverse range of health indicators related to general health, mental and psychosocial health, health behaviors and prevention with kappa coefficients and intraclass correlation (ICC). The quality of the data collected by both modes was evaluated by quantifying the missing, 'don't know' and inconsistent values and data entry mistakes. Good to very good agreement was found for all categorical indicators with kappa coefficients superior to 0.60, except for two mental and psychosocial health indicators namely the presence of a sleeping disorder and of a depressive disorder (kappa≥0.50). For the continuous indicators high to acceptable agreement was observed with ICC superior to 0.70. Inconsistent answers and data-entry mistakes were only occurring in the paper-and-pencil mode. There were no less missing values in the web-based mode compared to the paper-and-pencil mode. The study supports the idea that web-based modes provide, in general, equal responses to paper-and-pencil modes. However, health indicators based upon factual and objective items tend to have higher measurement agreement than indicators requiring an assessment of personal subjective feelings. A web-based mode greatly facilitates the data-entry process and guides the completing of a questionnaire. However, item non-response was not positively affected.

Evaluation of interobserver agreement for postoperative pain and sedation assessment in cats.

PubMed

Benito, Javier; Monteiro, Beatriz P; Beauchamp, Guy; Lascelles, B Duncan X; Steagall, Paulo V

2017-09-01

OBJECTIVE To evaluate agreement between observers with different training and experience for assessment of postoperative pain and sedation in cats by use of a dynamic and interactive visual analog scale (DIVAS) and for assessment of postoperative pain in the same cats with a multidimensional composite pain scale (MCPS). DESIGN Randomized, controlled, blinded study. ANIMALS 45 adult cats undergoing ovariohysterectomy. PROCEDURES Cats received 1 of 3 preoperative treatments: bupivacaine, IP; meloxicam, SC with saline (0.9% NaCl) solution, IP, (positive control); or saline solution only, IP (negative control). All cats received premedication with buprenorphine prior to general anesthesia. An experienced observer (observer 1; male; native language, Spanish) used scales in English, and an inexperienced observer (observer 2; female; native language, French) used scales in French to assess signs of sedation and pain. Rescue analgesia was administered according to MCPS scoring by observer 1. Mean pain and sedation scores per treatment and time point, proportions of cats in each group with MCPS scores necessitating rescue analgesia, and mean MCPS scores assigned at the time of rescue analgesia were compared between observers. Agreement was assessed by intraclass correlation coefficient determination. Percentage disagreement between observers on the need for rescue analgesia was calculated. RESULTS Interobserver agreements for pain scores were good, and that for sedation scores was fair. On the basis of observer 1's MCPS scores, a greater proportion of cats in the negative control group received rescue analgesia than in the bupivacaine or positive control groups. Scores from observer 2 indicated a greater proportion of cats in the negative control group than in the positive control group required rescue analgesia but identified no significant difference between the negative control and bupivacaine groups for this variable. Overall, disagreement regarding need for rescue

Reproducibility of dynamically represented acoustic lung images from healthy individuals

PubMed Central

Maher, T M; Gat, M; Allen, D; Devaraj, A; Wells, A U; Geddes, D M

2008-01-01

Background and aim: Acoustic lung imaging offers a unique method for visualising the lung. This study was designed to demonstrate reproducibility of acoustic lung images recorded from healthy individuals at different time points and to assess intra- and inter-rater agreement in the assessment of dynamically represented acoustic lung images. Methods: Recordings from 29 healthy volunteers were made on three separate occasions using vibration response imaging. Reproducibility was measured using quantitative, computerised assessment of vibration energy. Dynamically represented acoustic lung images were scored by six blinded raters. Results: Quantitative measurement of acoustic recordings was highly reproducible with an intraclass correlation score of 0.86 (very good agreement). Intraclass correlations for inter-rater agreement and reproducibility were 0.61 (good agreement) and 0.86 (very good agreement), respectively. There was no significant difference found between the six raters at any time point. Raters ranged from 88% to 95% in their ability to identically evaluate the different features of the same image presented to them blinded on two separate occasions. Conclusion: Acoustic lung imaging is reproducible in healthy individuals. Graphic representation of lung images can be interpreted with a high degree of accuracy by the same and by different reviewers. PMID:18024534

Direct comparison of PI-RADS version 2 and version 1 regarding interreader agreement and diagnostic accuracy for the detection of clinically significant prostate cancer.

PubMed

Becker, Anton S; Cornelius, Alexander; Reiner, Cäcilia S; Stocker, Daniel; Ulbrich, Erika J; Barth, Borna K; Mortezavi, Ashkan; Eberli, Daniel; Donati, Olivio F

2017-09-01

to simultaneously evaluate interreader agreement and diagnostic accuracy in the of PI-RADS v2 and compare it to v1. A total of 67 patients (median age 65.3 y, range 51.2-78.2 y; PSA 6.8μg/L, 0.2-33μg/L) undergoing MRI of the prostate and subsequent transperineal template biopsy within ≤6 months from MRI were included. Four readers from two institutions evaluated the likelihood of prostate cancer using PI-RADS v1 and v2 in two separate reading sessions ≥3 months apart. Interreader agreement was assessed for each pulse-sequence and for total PI-RADS scores using the intraclass correlation coefficient (ICC). Differences were considered significant for non-overlapping 95%-confidence intervals. Diagnostic accuracy was assessed with the area under the receiver operating characteristic curve (A Z ). A p-value <0.05 was considered statistically significant. Interreader agreement for DCE-scores was good in v2 (ICC 2 =0.70; 95% CI: 0.66-0.74) and slightly lower in v1 (ICC 1 =0.64, 0.59-0.69). Agreement for DWI scores (ICC 1 =0.77, ICC 2 =0.76) as well as final PI-RADS scores per quadrant were nearly identical (ICC 1 =ICC 2 =0.71). Diagnostic accuracy showed no significant differences (p=0.09-0.93) between v1 and v2 in any of the readers (range: A Z =0.78-0.88). PI-RADS scores show similar interreader agreement in v2 and v1 at comparable diagnostic performance. The simplification of the DCE interpretation in v2 might slightly improve agreement while not negatively affecting diagnostic performance. Copyright © 2017 Elsevier B.V. All rights reserved.

Is there a systematic bias of apparent diffusion coefficient (ADC) measurements of the breast if measured on different workstations? An inter- and intra-reader agreement study.

PubMed

Clauser, Paola; Marcon, Magda; Maieron, Marta; Zuiani, Chiara; Bazzocchi, Massimo; Baltzer, Pascal A T

2016-07-01

To evaluate the influence of post-processing systems, intra- and inter-reader agreement on the variability of apparent diffusion coefficient (ADC) measurements in breast lesions. Forty-one patients with 41 biopsy-proven breast lesions gave their informed consent and were included in this prospective IRB-approved study. Magnetic resonance imaging (MRI) examinations were performed at 1.5 T using an EPI-DWI sequence, with b-values of 0 and 1000 s/mm(2). Two radiologists (R1, R2) reviewed the images in separate sessions and measured the ADC for lesion, using MRI-workstation (S-WS), PACS-workstation (P-WS) and a commercial DICOM viewer (O-SW). Agreement was evaluated using the intraclass correlation coefficient (ICC), Bland-Altman plots and coefficient of variation (CV). Thirty-one malignant, two high-risk and eight benign mass-like lesions were analysed. Intra-reader agreement was almost perfect (ICC-R1 = 0.974; ICC-R2 = 0.990) while inter-reader agreement was substantial (ICC from 0.615 to 0.682). Bland-Altman plots revealed a significant bias in ADC values measured between O-SW and S-WS (P = 0.025), no further systematic differences were identified. CV varied from 6.8 % to 7.9 %. Post-processing systems may have a significant, although minor, impact on ADC measurements in breast lesions. While intra-reader agreement is high, the main source of ADC variability seems to be caused by inter-reader variation. • ADC provides quantitative information on breast lesions independent from the system used. • ADC measurement using different workstations and software systems is generally reliable. • Systematic, but minor, differences may occur between different post-processing systems. • Inter-reader agreement of ADC measurements exceeded intra-reader agreement.

Reproducibility and Agreement Between 2 Spectral Domain Optical Coherence Tomography Devices for Anterior Chamber Angle Measurements

PubMed Central

Marion, Kenneth M.; Maram, Jyotsna; Pan, Xiaojing; Dastiridou, Anna; Zhang, ZhouYuan; Ho, Alex; Francis, Brian A.; Sadda, Srinivas R.

2015-01-01

Purpose: To compare anterior chamber angle parameters based on the location of Schwalbe line (SL) from 2 spectral domain optical coherence tomography (SD-OCT) instruments and to measure their reproducibility. Methods: Forty-two eyes from 21 normal, healthy participants underwent imaging of the inferior irido-corneal angle with the Spectralis and Cirrus SD-OCT under tightly controlled low-light conditions. SL-angle opening distance (SL-AOD) and SL-trabecular iris space area (SL-TISA) were measured by masked, certified graders at the Doheny Imaging Reading Center using customized grading software. Interinstrument and intrainstrument, as well as interobserver and intraobserver reproducibility of SL-AOD and SL-TISA measurements were evaluated by intraclass correlation coefficients (ICCs) and Bland-Altman plots with limits of agreement (LoA). Results: The mean SL-AOD was 0.662±0.191 mm in Spectralis and 0.677±0.213 mm in Cirrus. The mean SL-TISA was 0.250±0.073 mm2 in Spectralis and 0.256±0.082 mm2 in Cirrus. The agreement for intrainstrument (ICCs>0.979), intragrader (ICCs>0.992), and intergrader (ICCs>0.929) was excellent. Excellent agreement between the 2 devices was also documented with a mean difference of −0.016 (LoA −0.125 to 0.092) mm for SL-AOD and −0.007 (LoA −0.056 to 0.043) mm2 in SL-TISA. Conclusions: Both SD-OCTs provided comparable measurements and permitted calculation of SL-based angle metrics. There was excellent interinstrument and intrainstrument and intraobserver and interobserver reproducibility for Spectralis and Cirrus SD-OCTs, suggesting true interchangeability between SD-OCT devices. This has the potential to lead to development of standardized grading assessments and quantification of angle parameters that would be valid across various SD-OCT devices. PMID:26200742

Gait Deviation Index, Gait Profile Score and Gait Variable Score in children with spastic cerebral palsy: Intra-rater reliability and agreement across two repeated sessions.

PubMed

Rasmussen, Helle Mätzke; Nielsen, Dennis Brandborg; Pedersen, Niels Wisbech; Overgaard, Søren; Holsgaard-Larsen, Anders

2015-07-01

The Gait Deviation Index (GDI) and Gait Profile Score (GPS) are the most used summary measures of gait in children with cerebral palsy (CP). However, the reliability and agreement of these indices have not been investigated, limiting their clinimetric quality for research and clinical practice. The aim of this study was to investigate the intra-rater reliability and agreement of summary measures of gait (GDI; GPS; and the Gait Variable Score (GVS) derived from the GPS). The intra-rater reliability and agreement were investigated across two repeated sessions in 18 children aged 5-12 years diagnosed with spastic CP. No systematic bias was observed between the sessions and no heteroscedasticity was observed in Bland-Altman plots. For the GDI and GPS, excellent reliability with intraclass correlation coefficient (ICC) values of 0.8-0.9 was found, while the GVS was found to have fair to good reliability with ICCs of 0.4-0.7. The agreement for the GDI and the logarithmically transformed GPS, in terms of the standard error of measurement as a percentage of the grand mean (SEM%) varied from 4.1 to 6.7%, whilst the smallest detectable change in percent (SDC%) ranged from 11.3 to 18.5%. For the logarithmically transformed GVS, we found a fair to large variation in SEM% from 7 to 29% and in SDC% from 18 to 81%. The GDI and GPS demonstrated excellent reliability and acceptable agreement proving that they can both be used in research and clinical practice. However, the observed large variability for some of the GVS requires cautious consideration when selecting outcome measures. Copyright © 2015 Elsevier B.V. All rights reserved.

Comparison of echocardiographic and cardiac magnetic resonance imaging measurements of functional single ventricular volumes, mass, and ejection fraction (from the Pediatric Heart Network Fontan Cross-Sectional Study).

PubMed

Margossian, Renee; Schwartz, Marcy L; Prakash, Ashwin; Wruck, Lisa; Colan, Steven D; Atz, Andrew M; Bradley, Timothy J; Fogel, Mark A; Hurwitz, Lynne M; Marcus, Edward; Powell, Andrew J; Printz, Beth F; Puchalski, Michael D; Rychik, Jack; Shirali, Girish; Williams, Richard; Yoo, Shi-Joon; Geva, Tal

2009-08-01

Assessment of the size and function of a functional single ventricle (FSV) is a key element in the management of patients after the Fontan procedure. Measurement variability of ventricular mass, volume, and ejection fraction (EF) among observers by echocardiography and cardiac magnetic resonance imaging (CMR) and their reproducibility among readers in these patients have not been described. From the 546 patients enrolled in the Pediatric Heart Network Fontan Cross-Sectional Study (mean age 11.9 +/- 3.4 years), 100 echocardiograms and 50 CMR studies were assessed for measurement reproducibility; 124 subjects with paired studies were selected for comparison between modalities. Interobserver agreement for qualitative grading of ventricular function by echocardiography was modest for left ventricular (LV) morphology (kappa = 0.42) and weak for right ventricular (RV) morphology (kappa = 0.12). For quantitative assessment, high intraclass correlation coefficients were found for echocardiographic interobserver agreement (LV 0.87 to 0.92, RV 0.82 to 0.85) of systolic and diastolic volumes, respectively. In contrast, intraclass correlation coefficients for LV and RV mass were moderate (LV 0.78, RV 0.72). The corresponding intraclass correlation coefficients by CMR were high (LV 0.96, RV 0.85). Volumes by echocardiography averaged 70% of CMR values. Interobserver reproducibility for the EF was similar for the 2 modalities. Although the absolute mean difference between modalities for the EF was small (<2%), 95% limits of agreement were wide. In conclusion, agreement between observers of qualitative FSV function by echocardiography is modest. Measurements of FSV volume by 2-dimensional echocardiography underestimate CMR measurements, but their reproducibility is high. Echocardiographic and CMR measurements of FSV EF demonstrate similar interobserver reproducibility, whereas measurements of FSV mass and LV diastolic volume are more reproducible by CMR.

Application of Prostate Imaging Reporting and Data System Version 2 (PI-RADS v2): Interobserver Agreement and Positive Predictive Value for Localization of Intermediate- and High-Grade Prostate Cancers on Multiparametric Magnetic Resonance Imaging.

PubMed

Chen, Frank; Cen, Steven; Palmer, Suzanne

2017-09-01

To evaluate interobserver agreement with the use of and the positive predictive value (PPV) of Prostate Imaging Reporting and Data System version 2 (PI-RADS v2) for the localization of intermediate- and high-grade prostate cancers on multiparametric magnetic resonance imaging (mpMRI). In this retrospective, institutional review board-approved study, 131 consecutive patients who had mpMRI followed by transrectal ultrasound-MR imaging fusion-guided biopsy of the prostate were included. Two readers who were blinded to initial mpMRI reports, clinical data, and pathologic outcomes reviewed the MR images, identified all prostate lesions, and scored each lesion based on the PI-RADS v2. Interobserver agreement was assessed by intraclass correlation coefficient (ICC), and PPV was calculated for each PI-RADS category. PI-RADS v2 was found to have a moderate level of interobserver agreement between two readers of varying experience, with ICC of 0.74, 0.72, and 0.67 for all lesions, peripheral zone lesions, and transitional zone lesions, respectively. Despite only moderate interobserver agreement, the calculated PPV in the detection of intermediate- and high-grade prostate cancers for each PI-RADS category was very similar between the two readers, with approximate PPV of 0%, 12%, 64%, and 87% for PI-RADS categories 2, 3, 4, and 5, respectively. In our study, PI-RADS v2 has only moderate interobserver agreement, a similar finding in studies of the original PI-RADS and in initial studies of PI-RADS v2. Despite this, PI-RADS v2 appears to be a useful system to predict significant prostate cancer, with PI-RADS scores correlating well with the likelihood of intermediate- and high-grade cancers. Copyright © 2017 The Association of University Radiologists. Published by Elsevier Inc. All rights reserved.

Test-Retest Reliability, Agreement and Responsiveness of Productivity Loss (iPCQ-VR) and Healthcare Utilization (TiCP-VR) Questionnaires for Sick Workers with Chronic Musculoskeletal Pain.

PubMed

Beemster, Timo T; van Velzen, Judith M; van Bennekom, Coen A M; Reneman, Michiel F; Frings-Dresen, Monique H W

2018-03-16

The purpose of this study was to assess test-retest reliability, agreement, and responsiveness of questionnaires on productivity loss (iPCQ-VR) and healthcare utilization (TiCP-VR) for sick-listed workers with chronic musculoskeletal pain who were referred to vocational rehabilitation. Methods Test-retest reliability and agreement was assessed with a 2-week interval. Responsiveness was assessed at discharge after a 15-week vocational rehabilitation (VR) program. Data was obtained from six Dutch VR centers. Test-retest reliability was determined with intraclass correlation coefficient (ICC) and Cohen's kappa. Agreement was determined by Standard Error of Measurement (SEM), smallest detectable changes (on group and individual level), and percentage observed, positive and negative agreement. Responsiveness was determined with area under the curve (AUC) obtained from receiver operation characteristic (ROC). Results A sample of 52 participants on test-retest reliability and agreement, and a sample of 223 on responsiveness were included in the analysis. Productivity loss (iPCQ-VR): ICCs ranged from 0.52 to 0.90, kappa ranged from 0.42 to 0.96, and AUC ranged from 0.55 to 0.86. Healthcare utilization (TiCP-VR): ICC was 0.81, and kappa values of the single healthcare utilization items ranged from 0.11 to 1.00. Conclusions The iPCQ-VR showed good measurement properties on working status, number of hours working per week and long-term sick leave, and low measurement properties on short-term sick leave and presenteeism. The TiCP-VR showed adequate reliability on all healthcare utilization items together and medication use, but showed low measurement properties on the single healthcare utilization items.

Validity and test–retest reliability of a novel simple back extensor muscle strength test

PubMed Central

Harding, Amy T; Weeks, Benjamin Kurt; Horan, Sean A; Little, Andrew; Watson, Steven L; Beck, Belinda Ruth

2017-01-01

Objectives: To develop and determine convergent validity and reliability of a simple and inexpensive clinical test to quantify back extensor muscle strength. Methods: Two testing sessions were conducted, 7 days apart. Each session involved three trials of standing maximal isometric back extensor muscle strength using both the novel test and isokinetic dynamometry. Lumbar spine bone mineral density was examined by dual-energy X-ray absorptiometry. Validation was examined with Pearson correlations (r). Test–retest reliability was examined with intraclass correlation coefficients and limits of agreement. Pearson correlations and intraclass correlation coefficients are presented with corresponding 95% confidence intervals. Linear regression was used to examine the ability of peak back extensor muscle strength to predict indices of lumbar spine bone mineral density and strength. Results: A total of 52 healthy adults (26 men, 26 women) aged 46.4 ± 20.4 years were recruited from the community. A strong positive relationship was observed between peak back extensor strength from hand-held and isokinetic dynamometry (r = 0.824, p < 0.001). For the novel back extensor strength test, short- and long-term reliability was excellent (intraclass correlation coefficient = 0.983 (95% confidence interval, 0.971–0.990), p < 0.001 and intraclass correlation coefficient = 0.901 (95% confidence interval, 0.833–0.943), p < 0.001, respectively). Limits of agreement for short-term repeated back extensor strength measures with the novel back extensor strength protocol were −6.63 to 7.70 kg, with a mean bias of +0.71 kg. Back extensor strength predicted 11% of variance in lumbar spine bone mineral density (p < 0.05) and 9% of lumbar spine index of bone structural strength (p < 0.05). Conclusion: Our novel hand-held dynamometer method to determine back extensor muscle strength is quick, relatively inexpensive, and reliable; demonstrates

Correlation and Agreement of Handheld Spirometry with Laboratory Spirometry in Allogeneic Hematopoietic Cell Transplant Recipients

PubMed Central

Cheng, Guang-Shing; Campbell, Angela P.; Xie, Hu; Stednick, Zach; Callais, Cheryl; Leisenring, Wendy M.; Englund, Janet A.; Chien, Jason W.; Boeckh, Michael

2016-01-01

BACKGROUND Early detection of subclinical lung function decline may help identify allogeneic hematopoietic cell transplantation (HCT) recipients who are at increased risk for late non-infectious pulmonary complications including bronchiolitis obliterans syndrome (BOS). We evaluated the use of handheld spirometry in this population. METHODS Allogeneic HCT recipients enrolled in a single center observational trial performed weekly spirometry with a handheld spirometer for one year after transplantation. Participants performed pulmonary function tests in an outpatient laboratory setting at 3 time points: pre-transplant, day 80 and 1 year post-transplant. Correlation between the two methods was assessed by Pearson and Spearman correlations; agreement was assessed using Bland-Altman plots. RESULTS A total of 437 subjects had evaluable pulmonary function tests. Correlation for FEV1 was r=0.954 (p<.0001) at day 80 and r=0.931 (p<.0001) at 1 year when the handheld and laboratory tests were performed within one day of each other. Correlation for handheld FEV6 with laboratory FVC was r=0.914 (p<.0001) at day 80 and r=0.826 (p<.0001) at 1 year. The bias, or the mean difference (handheld minus laboratory) for FEV1 at day 80 and 1 year was −0.13L (−0.63, 0.37) and −0.10L (−0.77, 0.56), respectively. FEV6 showed greater bias at day 80 [−0.51L (−1.44, 0.42)] and 1 year [−0.40L (−1.81, 1.01)]. CONCLUSIONS Handheld spirometry correlated well with laboratory spirometry after allogeneic HCT and may be useful for self-monitoring of patients for early identification of airflow obstruction. PMID:26748162

Walking-adaptability assessments with the Interactive Walkway: Between-systems agreement and sensitivity to task and subject variations.

PubMed

Geerse, Daphne J; Coolen, Bert H; Roerdink, Melvyn

2017-05-01

The ability to adapt walking to environmental circumstances is an important aspect of walking, yet difficult to assess. The Interactive Walkway was developed to assess walking adaptability by augmenting a multi-Kinect-v2 10-m walkway with gait-dependent visual context (stepping targets, obstacles) using real-time processed markerless full-body kinematics. In this study we determined Interactive Walkway's usability for walking-adaptability assessments in terms of between-systems agreement and sensitivity to task and subject variations. Under varying task constraints, 21 healthy subjects performed obstacle-avoidance, sudden-stops-and-starts and goal-directed-stepping tasks. Various continuous walking-adaptability outcome measures were concurrently determined with the Interactive Walkway and a gold-standard motion-registration system: available response time, obstacle-avoidance and sudden-stop margins, step length, stepping accuracy and walking speed. The same holds for dichotomous classifications of success and failure for obstacle-avoidance and sudden-stops tasks and performed short-stride versus long-stride obstacle-avoidance strategies. Continuous walking-adaptability outcome measures generally agreed well between systems (high intraclass correlation coefficients for absolute agreement, low biases and narrow limits of agreement) and were highly sensitive to task and subject variations. Success and failure ratings varied with available response times and obstacle types and agreed between systems for 85-96% of the trials while obstacle-avoidance strategies were always classified correctly. We conclude that Interactive Walkway walking-adaptability outcome measures are reliable and sensitive to task and subject variations, even in high-functioning subjects. We therefore deem Interactive Walkway walking-adaptability assessments usable for obtaining an objective and more task-specific examination of one's ability to walk, which may be feasible for both high

A prospective study assessing agreement and reliability of a geriatric evaluation.

PubMed

Locatelli, Isabella; Monod, Stéfanie; Cornuz, Jacques; Büla, Christophe J; Senn, Nicolas

2017-07-19

The present study takes place within a geriatric program, aiming at improving the diagnosis and management of geriatric syndromes in primary care. Within this program it was of prime importance to be able to rely on a robust and reproducible geriatric consultation to use as a gold standard for evaluating a primary care brief assessment tool. The specific objective of the present study was thus assessing the agreement and reliability of a comprehensive geriatric consultation. The study was conducted at the outpatient clinic of the Service of Geriatric Medicine, University of Lausanne, Switzerland. All community-dwelling older persons aged 70 years and above were eligible. Patients were excluded if they hadn't a primary care physician, they were unable to speak French, or they were already assessed by a geriatrician within the last 12 months. A set of 9 geriatricians evaluated 20 patients. Each patient was assessed twice within a 2-month delay. Geriatric consultations were based on a structured evaluation process, leading to rating the following geriatric conditions: functional, cognitive, visual, and hearing impairment, mood disorders, risk of fall, osteoporosis, malnutrition, and urinary incontinence. Reliability and agreement estimates on each of these items were obtained using a three-way Intraclass Correlation and a three-way Observed Disagreement index. The latter allowed a decomposition of overall disagreement into disagreements due to each source of error variability (visit, rater and random). Agreement ranged between 0.62 and 0.85. For most domains, geriatrician-related error variability explained an important proportion of disagreement. Reliability ranged between 0 and 0.8. It was poor/moderate for visual impairment, malnutrition and risk of fall, and good/excellent for functional/cognitive/hearing impairment, osteoporosis, incontinence and mood disorders. Six out of nine items of the geriatric consultation described in this study (functional

Agreement between an online dietary assessment tool (myfood24) and an interviewer-administered 24-h dietary recall in British adolescents aged 11-18 years.

PubMed

Albar, Salwa A; Alwan, Nisreen A; Evans, Charlotte E L; Greenwood, Darren C; Cade, Janet E

2016-05-01

myfood24 Is an online 24-h dietary assessment tool developed for use among British adolescents and adults. Limited information is available regarding the validity of using new technology in assessing nutritional intake among adolescents. Thus, a relative validation of myfood24 against a face-to-face interviewer-administered 24-h multiple-pass recall (MPR) was conducted among seventy-five British adolescents aged 11-18 years. Participants were asked to complete myfood24 and an interviewer-administered MPR on the same day for 2 non-consecutive days at school. Total energy intake (EI) and nutrients recorded by the two methods were compared using intraclass correlation coefficients (ICC), Bland-Altman plots (using between and within-individual information) and weighted κ to assess the agreement. Energy, macronutrients and other reported nutrients from myfood24 demonstrated strong agreement with the interview MPR data, and ICC ranged from 0·46 for Na to 0·88 for EI. There was no significant bias between the two methods for EI, macronutrients and most reported nutrients. The mean difference between myfood24 and the interviewer-administered MPR for EI was -230 kJ (-55 kcal) (95 % CI -490, 30 kJ (-117, 7 kcal); P=0·4) with limits of agreement ranging between 39 % (3336 kJ (-797 kcal)) lower and 34 % (2874 kJ (687 kcal)) higher than the interviewer-administered MPR. There was good agreement in terms of classifying adolescents into tertiles of EI (κ w =0·64). The agreement between day 1 and day 2 was as good for myfood24 as for the interviewer-administered MPR, reflecting the reliability of myfood24. myfood24 Has the potential to collect dietary data of comparable quality with that of an interviewer-administered MPR.

Proton Density Fat Fraction Measurements at 1.5- and 3-T Hepatic MR Imaging: Same-Day Agreement among Readers and across Two Imager Manufacturers.

PubMed

Serai, Suraj D; Dillman, Jonathan R; Trout, Andrew T

2017-07-01

Purpose To determine the agreement of proton density fat fraction (PDFF) measurements obtained with hepatic magnetic resonance (MR) imaging among readers, imager manufacturers, and field strengths. Materials and Methods This HIPAA-compliant study was approved by the institutional review board. After providing informed consent, 24 adult volunteers underwent imaging with one 1.5-T MR unit (Ingenia; Philips Healthcare, Best, the Netherlands) and two different 3.0-T units (750 W [GE Healthcare, Waukesha, Wis] and Ingenia) on the same day to estimate hepatic PDFF. A single-breath-hold multipoint Dixon-based acquisition was performed with commercially available pulse sequences provided by the MR imager manufacturers (mDIXON Quant [Philips Healthcare], IDEAL IQ [GE Healthcare]). Five readers placed one large region of interest, inclusive of as much liver parenchyma as possible in the right lobe while avoiding large vessels, on imager-generated parametric maps to measure hepatic PDFF. Two-way single-measure intraclass correlation coefficients (ICCs) were used to assess interreader agreement and agreement across the three imaging platforms. Results Excellent interreader agreement for hepatic PDFF measurements was obtained with mDIXON Quant and the Philips 1.5-T unit (ICC, 0.995; 95% confidence interval [CI]: 0.991, 0.998), mDIXON Quant and the Philips 3.0-T unit (ICC, 0.992; 95% CI: 0.986, 0.996), and IDEAL IQ and the GE 3.0-T unit (ICC, 0.966; 95% CI: 0.939, 0.984). Individual reader ICCs for hepatic PDFF measurements across all three imager manufacturer-field strength combinations also showed excellent interimager agreement, ranging from 0.914 to 0.954. Conclusion Estimation of PDFF with hepatic MR imaging by using multipoint Dixon techniques is highly reproducible across readers, field strengths, and imaging platforms. © RSNA, 2017.

[Parent-child agreement in the health related quality of life (HRQOL) of children with attention-deficit/hyperactivity disorder (ADHD): a longitudinal study].

PubMed

Rajmil, L; Estrada, M D; Herdman, M; Serra-Sutton, V; Tebé, C; Izaguirre, J; Alda, J A; Alonso, J; Riley, A W; Forrest, C B; Starfield, B

2009-06-01

To assess parent-child agreement on changes over a short-term period of time in the HRQOL of children treated for ADHD over a short period of time, and to compare child and parent ratings of children with ADHD with general population norms. Prospective study in children 6-12 years old with ADHD. Children and parents completed the Spanish versions of the Child Health and Illness Profile-Child Edition (CHIP-CE) before and after 8 weeks of treatment. CHIP-PE scores at both visits were compared using paired t tests and effect sizes (ES), intra-class correlation coefficients (ICC), and scatter plots. Child and parent ratings were compared with CHIP-CE scores for a general population sample. Thirty-one children and parents were included in the analysis. The highest change between the first and the follow-up visit was on the Risk Avoidance domain both children and parents (effect size [ES]=0.24 and 0.40, respectively). The ICC ranged from 0.44 (Satisfaction) to 0.01 (Risk avoidance). Child self-ratings were close to general population values. All domains of the parent version presented standardized means below the reference values at the baseline visit and closer to the general population norm after treatment. This study found poor parent-child agreement and suggests that both ratings should be collected in future studies on the impact of ADHD and treatment effectiveness.

Agreement between Computerized and Human Assessment of Performance on the Ruff Figural Fluency Test

PubMed Central

Elderson, Martin F.; Pham, Sander; van Eersel, Marlise E. A.; Wolffenbuttel, Bruce H. R.; Kok, Johan; Gansevoort, Ron T.; Tucha, Oliver; van der Klauw, Melanie M.; Slaets, Joris P. J.

2016-01-01

The Ruff Figural Fluency Test (RFFT) is a sensitive test for nonverbal fluency suitable for all age groups. However, assessment of performance on the RFFT is time-consuming and may be affected by interrater differences. Therefore, we developed computer software specifically designed to analyze performance on the RFFT by automated pattern recognition. The aim of this study was to compare assessment by the new software with conventional assessment by human raters. The software was developed using data from the Lifelines Cohort Study and validated in an independent cohort of the Prevention of Renal and Vascular End Stage Disease (PREVEND) study. The total study population included 1,761 persons: 54% men; mean age (SD), 58 (10) years. All RFFT protocols were assessed by the new software and two independent human raters (criterion standard). The mean number of unique designs (SD) was 81 (29) and the median number of perseverative errors (interquartile range) was 9 (4 to 16). The intraclass correlation coefficient (ICC) between the computerized and human assessment was 0.994 (95%CI, 0.988 to 0.996; p<0.001) and 0.991 (95%CI, 0.990 to 0.991; p<0.001) for the number of unique designs and perseverative errors, respectively. The mean difference (SD) between the computerized and human assessment was -1.42 (2.78) and +0.02 (1.94) points for the number of unique designs and perseverative errors, respectively. This was comparable to the agreement between two independent human assessments: ICC, 0.995 (0.994 to 0.995; p<0.001) and 0.985 (0.982 to 0.988; p<0.001), and mean difference (SD), -0.44 (2.98) and +0.56 (2.36) points for the number of unique designs and perseverative errors, respectively. We conclude that the agreement between the computerized and human assessment was very high and comparable to the agreement between two independent human assessments. Therefore, the software is an accurate tool for the assessment of performance on the RFFT. PMID:27661083

Prospective cohort study of ultrasound-ultrasound and ultrasound-MR enterography agreement in the evaluation of pediatric small bowel Crohn disease.

PubMed

Dillman, Jonathan R; Smith, Ethan A; Sanchez, Ramon; DiPietro, Michael A; Dehkordy, Soudabeh Fazeli; Adler, Jeremy; DeMatos-Maillard, Vera; Khalatbari, Shokoufeh; Davenport, Matthew S

2016-04-01

There is a paucity of published literature describing ultrasound (US)-US and US-MR enterography (MRE) inter-radiologist agreement in pediatric small bowel Crohn disease. To prospectively assess US-US and US-MRE inter-radiologist agreement in pediatric small bowel Crohn disease. Institutional Review Board approval and informed consent/assent were obtained for this HIPAA-compliant prospective cohort study of children with newly diagnosed distal small bowel Crohn disease (July 2012 to December 2014). Enrolled subjects (n = 29) underwent two small bowel US examinations performed by blinded independent radiologists both before and at multiple time points after initiation of medical therapy (231 unique US examinations, in total); 134 US examinations were associated with concurrent MRE. The MRE examination was interpreted by a third blinded radiologist. The following was documented on each examination: involved length of ileum (cm); maximum bowel wall thickness (mm); amount of bowel wall and mesenteric Doppler signal, and presence of stricture, penetrating disease and/or abscess. Inter-radiologist agreement was assessed with single-measure, three-way, mixed-model intra-class correlation coefficients (ICC) and prevalence-adjusted, bias-adjusted kappa statistics (κ). Numbers in brackets are 95% confidence intervals. Ultrasound-US agreement was moderate for involved length (ICC: 0.41 [0.35-0.49]); substantial for maximum bowel wall thickness (ICC: 0.67 [0.64-0.70]); moderate for bowel wall Doppler signal (ICC: 0.53 [0.48-0.59]); slight for mesenteric Doppler signal (ICC: 0.25 [0.18-0.42]), and moderate to almost perfect for stricture (κ: 0.54), penetrating disease (κ: 0.80), and abscess (κ: 0.96). US-MRE agreement was moderate for involved length (ICC: 0.42 [0.37-0.49]); substantial for maximum bowel wall thickness (ICC: 0.66 [0.65-0.69]), and substantial to almost perfect for stricture (κ: 0.61), penetrating disease (κ: 0.72) and abscess (κ: 0.88). Ultrasound

Pulmonary disease in cystic fibrosis: assessment with chest CT at chest radiography dose levels.

PubMed

Ernst, Caroline W; Basten, Ines A; Ilsen, Bart; Buls, Nico; Van Gompel, Gert; De Wachter, Elke; Nieboer, Koenraad H; Verhelle, Filip; Malfroot, Anne; Coomans, Danny; De Maeseneer, Michel; de Mey, Johan

2014-11-01

. Very good agreement was found in overall Bhalla score ( ICC intraclass correlation coefficient , 0.96) with regard to the severity of bronchiectasis ( ICC intraclass correlation coefficient , 0.87) and sacculations and abscesses ( ICC intraclass correlation coefficient , 0.84). Interobserver agreement was excellent ( ICC intraclass correlation coefficient , 0.86-1). For patients with CF cystic fibrosis , a dedicated chest CT protocol can replace the two yearly follow-up chest radiographic examinations without major dose penalty and with similar diagnostic quality compared with conventional CT.

Investigating the level of agreement of two positioning protocols when using dual energy X-ray absorptiometry in the assessment of body composition.

PubMed

Shiel, Flinn; Persson, Carl; Simas, Vini; Furness, James; Climstein, Mike; Schram, Ben

2017-01-01

Dual energy X-ray absorptiometry (DXA) is a commonly used instrument for analysing segmental body composition (BC). The information from the scan guides the clinician in the treatment of conditions such as obesity and can be used to monitor recovery of lean mass following injury. Two commonly used DXA positioning protocols have been identified-the Nana positioning protocol and the National Health and Nutrition Examination Survey (NHANES). Both protocols have been shown to be reliable. However, only one study has assessed the level of agreement between the protocols and ascertained the participants' preference of protocol based upon comfort. Given the paucity of research in the field and the growing use of DXA in both healthy and pathological populations further research determining the most appropriate positioning protocol is warranted. Therefore, the aims of this study were to assess the level of agreement between results from the NHANES protocol and Nana protocol, and the participants' preference of protocol based on comfort. Thirty healthy participants (15 males, 15 females, aged 23-59 years) volunteered to participate in this study. These participants underwent two whole body DXA scans in a single morning (Nana positioning protocol and NHANES positioning protocol), in a randomised order. Each participant attended for scanning wearing minimal clothing and having fasted overnight, refrained from exercise in the past 24 h and voided their bladders. Level of agreement, comparing NAHNES to Nana protocol was assessed using an intra-class correlation coefficient (ICC), concordance correlation coefficient (CCC) and percentage change in mean. Limit of agreement comparing the two protocols were assessed using plots, mean difference and confidence limits. Participants were asked to indicate the protocol they found most comfortable. When assessing level of agreement between protocols both the ICC and CCC scores were very high and ranged from 0.987 to 0.997 for whole body

[Validity of self-reported metabolic syndrome components in a cohort study].

PubMed

Fernández-Montero, Alejandro; Beunza, Juan J; Bes-Rastrollo, Maira; Barrio, María T; de la Fuente-Arrillaga, Carmen; Moreno-Galarraga, Laura; Martínez-González, Miguel A

2011-01-01

To assess the accuracy of self-reported data needed to constitute the metabolic syndrome in the University of Navarra Follow-Up [Seguimiento Universidad de Navarra (SUN)] cohort. The SUN project is a multi-purpose prospective cohort, formed by more than 20,000 university graduates, followed-up using surface mail questionnaires every 2 years. In a sample of 287 cohort participants, self-reported data on the criteria needed to define the metabolic syndrome (waist circumference, blood pressure, triglycerides, high-density lipoprotein-cholesterol and glucose) were compared with the same biometric data obtained by blood tests or measured by trained medical staff. Intra-class correlation coefficients with 95% confidence intervals (95% CI), relative mean error and agreement limits according to the method proposed by Bland and Altman were calculated for each variable studied. High intraclass correlations were found for the values of waist circumference (r=0.86, 95% CI: 0.80-0.90) and triglycerides (r=0.71, 95%CI: 0.61-0.79). Moderate intraclass correlations were found (between 0.46 and 0.63) for the other factors. Relative mean errors were always<2.5%, and >91% of values were within the limits of agreement for all variables. The results suggest that self-declared data on the criteria of metabolic syndrome obtained in the SUN cohort, though with some caution, are sufficiently accurate to be used in epidemiological studies. Copyright © 2010 SESPAS. Published by Elsevier Espana. All rights reserved.

A novel Hartman Shack-based topography system: repeatability and agreement for corneal power with Scheimpflug+Placido topographer and rotating prism auto-keratorefractor.

PubMed

Prakash, Gaurav; Srivastava, Dhruv; Choudhuri, Sounak

2015-12-01

The purpose of this study is to analyze the repeatability and agreement of corneal power using a new Hartman type topographer in comparison to Scheimpflug+Placido and autorefractor devices. In this cross sectional, observational study performed at the cornea services of a specialty hospital, 100 normal eyes (100 consecutive candidates) without any previous ocular surgery or morbidity except refractive error were evaluated. All candidates underwent three measurements each on a Full gradient, Hartman type topographer (FG) (iDesign, AMO), Scheimpflug+Placido topographer (SP) (Sirius, CSO) and rotating prism auto-keratorefractor (AR) (KR1, Nidek). The parameters assessed were flat keratometry (K1), steep keratometry (K2), steep axis (K2 axis), mean K, J 0 and J 45. Intra-device repeatability and inter-device agreement were evaluated. On repeatability analysis, the intra-device means were not significantly different (ANOVA, p > 0.05). Intraclass correlations (ICC) were >0.98 except for J 0 and J 45. In terms of intra-measurement standard deviation (Sw), the SP and FG groups fared better than AR group (p < 0.001, ANOVA). On Sw versus Average plots, no significantly predictive fit was seen (p > 0.05, R (2) < 0.1 for all the values). On inter-device agreement analysis, there was no difference in means (ANOVA, p > 0.05). ICC ranged from 0.92 to 0.99 (p < 0.001). Regression fits on Bland-Altman plots suggested no clinically significant effect of average values over difference in means. The repeatability of Hartman type topographer in normal eyes is comparable to SP combination device and better than AR. The agreement between the three devices is good. However, we recommend against interchanging these devices between follow-ups or pooling their data.

Repeatability of chemical-shift-encoded water-fat MRI and diffusion-tensor imaging in lower extremity muscles in children.

PubMed

Ponrartana, Skorn; Andrade, Kristine E; Wren, Tishya A L; Ramos-Platt, Leigh; Hu, Houchun H; Bluml, Stefan; Gilsanz, Vicente

2014-06-01

The purpose of this study was to assess the repeatability of water-fat MRI and diffusion-tensor imaging (DTI) as quantitative biomarkers of pediatric lower extremity skeletal muscle. MRI at 3 T of a randomly selected thigh and lower leg of seven healthy children was studied using water-fat separation and DTI techniques. Muscle-fat fraction, apparent diffusion coefficient (ADC), and fractional anisotropy (FA) values were calculated. Test-retest and interrater repeatability were assessed by calculating the Pearson correlation coefficient, intraclass correlation coefficient, and Bland-Altman analysis. Bland-Altman plots show that the mean difference between test-retest and interrater measurements of muscle-fat fraction, ADC, and FA was near 0. The correlation coefficients and intraclass correlation coefficients were all between 0.88 and 0.99 (p < 0.05), suggesting excellent reliability of the measurements. Muscle-fat fraction measurements from water-fat MRI exhibited the highest intraclass correlation coefficient. Interrater agreement was consistently better than test-retest comparisons. Water-fat MRI and DTI measurements in lower extremity skeletal muscles are objective repeatable biomarkers in children. This knowledge should aid in the understanding of the number of participants needed in clinical trials when using these determinations as an outcome measure to noninvasively monitor neuromuscular disease.

An agreement coefficient for image comparison

USGS Publications Warehouse

Ji, Lei; Gallo, Kevin

2006-01-01

Combination of datasets acquired from different sensor systems is necessary to construct a long time-series dataset for remotely sensed land-surface variables. Assessment of the agreement of the data derived from various sources is an important issue in understanding the data continuity through the time-series. Some traditional measures, including correlation coefficient, coefficient of determination, mean absolute error, and root mean square error, are not always optimal for evaluating the data agreement. For this reason, we developed a new agreement coefficient for comparing two different images. The agreement coefficient has the following properties: non-dimensional, bounded, symmetric, and distinguishable between systematic and unsystematic differences. The paper provides examples of agreement analyses for hypothetical data and actual remotely sensed data. The results demonstrate that the agreement coefficient does include the above properties, and therefore is a useful tool for image comparison.

Reliability, agreement, and responsiveness of a 6-minute walk/run test in patients with heart disease.

PubMed

Berghmans, Danielle D; Lenssen, Antoine F; Bastiaenen, Carolien H; Ilhan, Mustafa; Lencer, Nicole H; Roox, George M

2013-02-01

The 6-minute walk test (6 MWT) is widely used to assess exercise tolerance in cardiac rehabilitation (CR). However, previous research shows it to be insufficiently responsive, especially for patients with a relatively high maximal exercise tolerance at baseline. We therefore designed a 6-minute walk/run test (6 MWRT), which has the same duration as the 6 MWT but allows running. The objective of this study was to determine the test-retest reproducibility and responsiveness of this 6 MWRT. Responsiveness was investigated in a prospective cohort study among a group of patients entering CR at Maastricht University Medical Center, with a cross-sectional part to assess the test-retest reproducibility. Test-retest reproducibility (reliability and agreement) was investigated using the intraclass correlation (ICC) and a Bland-Altman plot of two measurements implemented in the first week of rehabilitation. Responsiveness of the 6 MWT and the 6 MWRT was calculated using the standard response mean (SRM) over a 6-week period. The first reproducibility analysis included 34 patients, the second 22 patients. The ICCs were 0.935 and 0.906, respectively, with limits of agreement of ± 79 and ± 61 m. The responsiveness analysis included 27 patients. The SRM values were 0.83 for the 6 MWT and 0.71 for the 6 MWRT. Although the 6 MWRT is a reproducible test in CR, its responsiveness is not superior to that of the 6 MWT. We therefore prefer the conventional 6 MWT as an evaluative measurement in CR and advise against using the 6 MWRT as (evaluative) measurement in CR for this purpose.

An interrater reliability study of the Braden scale in two nursing homes.

PubMed

Kottner, Jan; Dassen, Theo

2008-10-01

Adequate risk assessment is essential in pressure ulcer prevention. Assessment scales were designed to support practitioners in identifying persons at pressure ulcer risk. The Braden scale is one of the most extensively studied risk assessment instruments, although the majority of studies focused on validity rather than reliability. The first aim was to measure the interrater reliability of the Braden scale and its individual items. The second aim was to study different statistical approaches regarding interrater reliability estimation. An interrater reliability study was conducted in two German nursing homes. Residents (n = 152) from 8 units were assessed twice. The raters were trained nurses with a work experience ranging from 0.5 to 30 years. Data were analysed using an overall percentage of agreement, weighted and unweighted kappa and the intraclass correlation coefficient. Differences between nurses rating the overall Braden score ranged from 0 up to 9 points. Interrater reliability expressed by the intraclass correlation coefficient ranged from 0.73 (95% CI 0.26 - 0.91) to 0.95 (95% CI 0.87 - 0.98). Calculated intraclass correlation coefficients for individual items ranged from 0.06 (95% CI -0.31 to 0.48) to 0.97 (95% CI 0.93-0.99) with the lowest values being measured for the items "sensory perception" and "nutrition". There was no association between work experience and the level of interrater reliability. With two exceptions, simple kappa-values were always lower than weighted kappa-values and intraclass correlation coefficients. Although the calculated interrater reliability coefficients for the total Braden score were high in some cases, several clinically relevant differences occurred between the nurses. Due to interrater reliability being very low for the items "sensory perception" and "nutrition", it is doubtful if their assessment contributes to any valid results. The calculation of weighted kappa or intraclass correlation coefficients is the most

Agreement between digital image analysis and clinical spectrophotometer in CIEL*C*h° coordinate differences and total color difference (ΔE) measurements of dental ceramic shade tabs.

PubMed

Farah, Ra'fat I

2016-01-01

The objectives of this in vitro study were: 1) to test the agreement among color coordinate differences and total color difference (ΔL*, ΔC*, Δh°, and ΔE) measurements obtained by digital image analysis (DIA) and spectrophotometer, and 2) to test the reliability of each method for obtaining color differences. A digital camera was used to record standardized images of each of the 15 shade tabs from the IPS e.max shade guide placed edge-to-edge in a phantom head with a reference shade tab. The images were analyzed using image-editing software (Adobe Photoshop) to obtain the color differences between the middle area of each test shade tab and the corresponding area of the reference tab. The color differences for the same shade tab areas were also measured using a spectrophotometer. To assess the reliability, measurements for the 15 shade tabs were repeated twice using the two methods. The Intraclass Correlation Coefficient (ICC) and the Dahlberg index were used to calculate agreement and reliability. The total agreement of the two methods for measuring ΔL*, ΔC*, Δh°, and ΔE, according to the ICC, exceeded 0.82. The Dahlberg indices for ΔL* and ΔE were 2.18 and 2.98, respectively. For the reliability calculation, the ICCs for the DIA and the spectrophotometer ΔE were 0.91 and 0.94, respectively. High agreement was obtained between the DIA and spectrophotometer results for the ΔL*, ΔC*, Δh°, and ΔE measurements. Further, the reliability of the measurements for the spectrophotometer was slightly higher than the reliability of all measurements in the DIA.

Agreement Between Responses From Community-Dwelling Persons With Stroke and Their Proxies on the NIH Neurological Quality of Life (Neuro-QoL) Short Forms.

PubMed

Kozlowski, Allan J; Singh, Ritika; Victorson, David; Miskovic, Ana; Lai, Jin-Shei; Harvey, Richard L; Cella, David; Heinemann, Allen W

2015-11-01

To examine agreement between patient and proxy responses on the Quality of Life in Neurological Disorders (Neuro-QoL) instruments after stroke. Cross-sectional observational substudy of the longitudinal, multisite, multicondition Neuro-QoL validation study. In-person, interview-guided, patient-reported outcomes. Convenience sample of dyads (N=86) of community-dwelling persons with stroke and their proxy respondents. Not applicable. Dyads concurrently completed short forms of 8 or 9 items for the 13 Neuro-QoL adult domains using the patient-proxy perspective. Agreement was examined at the scale-level with difference scores, intraclass correlation coefficients (ICCs), effect size statistics, and Bland-Altman plots, and at the item-level with kappa coefficients. We found no mean differences between patients and proxies on the Applied Cognition-General Concerns, Depression, Satisfaction With Social Roles and Activities, Stigma, and Upper Extremity Function (Fine Motor, activities of daily living) short forms. Patients rated themselves more favorably on the Applied Cognition-Executive Function, Ability to Participate in Social Roles and Activities, Lower Extremity Function (Mobility), Positive Affect and Well-Being, Anxiety, Emotional and Behavioral Dyscontrol, and Fatigue short forms. The largest mean patient-proxy difference observed was 3 T-score points on the Lower Extremity Function (Mobility). ICCs ranged from .34 to .59. However, limits of agreement showed dyad differences exceeding ±20 T-score points, and item-level agreement ranged from not significant to weighted kappa=.34. Proxy responses on Neuro-QoL short forms can complement responses of moderate- to high-functioning community-dwelling persons with stroke and augment group-level analyses, but do not substitute for individual patient ratings. Validation is needed for other stroke populations. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Common pitfalls in statistical analysis: Measures of agreement.

PubMed

Ranganathan, Priya; Pramesh, C S; Aggarwal, Rakesh

2017-01-01

Agreement between measurements refers to the degree of concordance between two (or more) sets of measurements. Statistical methods to test agreement are used to assess inter-rater variability or to decide whether one technique for measuring a variable can substitute another. In this article, we look at statistical measures of agreement for different types of data and discuss the differences between these and those for assessing correlation.

Intraclass reliability for assessing how well Taiwan constrained hospital-provided medical services using statistical process control chart techniques.

PubMed

Chien, Tsair-Wei; Chou, Ming-Ting; Wang, Wen-Chung; Tsai, Li-Shu; Lin, Weir-Sen

2012-05-15

Few studies discuss the indicators used to assess the effect on cost containment in healthcare across hospitals in a single-payer national healthcare system with constrained medical resources. We present the intraclass correlation coefficient (ICC) to assess how well Taiwan constrained hospital-provided medical services in such a system. A custom Excel-VBA routine to record the distances of standard deviations (SDs) from the central line (the mean over the previous 12 months) of a control chart was used to construct and scale annual medical expenditures sequentially from 2000 to 2009 for 421 hospitals in Taiwan to generate the ICC. The ICC was then used to evaluate Taiwan's year-based convergent power to remain unchanged in hospital-provided constrained medical services. A bubble chart of SDs for a specific month was generated to present the effects of using control charts in a national healthcare system. ICCs were generated for Taiwan's year-based convergent power to constrain its medical services from 2000 to 2009. All hospital groups showed a gradually well-controlled supply of services that decreased from 0.772 to 0.415. The bubble chart identified outlier hospitals that required investigation of possible excessive reimbursements in a specific time period. We recommend using the ICC to annually assess a nation's year-based convergent power to constrain medical services across hospitals. Using sequential control charts to regularly monitor hospital reimbursements is required to achieve financial control in a single-payer nationwide healthcare system.

Psychosocial health and quality of life among children with cardiac diagnoses: agreement and discrepancies between parent and child reports.

PubMed

Patel, Bhavika J; Lai, Lillian; Goldfield, Gary; Sananes, Renee; Longmuir, Patricia E

2017-05-01

Psychosocial health issues are common among children with cardiac diagnoses. Understanding parent and child perceptions is important because parents are the primary health information source. Significant discrepancies have been documented between parent/child quality-of-life data but have not been examined among psychosocial diagnostic instruments. This study examined agreement and discrepancies between parent and child reports of psychosocial health and quality of life in the paediatric cardiology population. Children (n=50, 6-14 years) with diagnoses of CHDs (n=38), arrhythmia (n=5), cardiomyopathy (n=4), or infectious disease affecting the heart (n=3) were enrolled, completing one or more outcome measures. Children and their parents completed self-reports and parent proxy reports of quality of life - Pediatric Quality of Life Inventory - and psychosocial health - Behavioral Assessment Scale for Children (Version 2). Patients also completed the Multidimensional Anxiety Scale for Children. Associations (Pearson's correlations, Intraclass Correlation Coefficients) and differences (Student's t-tests) between parent proxy reports and child self-reports were evaluated. Moderate parent-child correlations were found for physical (R=0.33, p=0.03), school (R=0.43, p<0.01), social (R=0.36, p=0.02), and overall psychosocial (R=0.43, p<0.01) quality of life. Parent-child reports of externalising behaviour problems, for example aggression, were strongly correlated (R=0.70, p<0.01). No significant parent-child associations were found for emotional quality of life (R=0.25, p=0.10), internalising problems (R=0.17, p=0.56), personal adjustment/adaptation skills (R=0.23, p=0.42), or anxiety (R=0.07, p=0.72). Our data suggest that clinicians caring for paediatric cardiac patients should assess both parent and child perspectives, particularly in relation to domains such as anxiety and emotional quality of life, which are more difficult to observe.

Do physiotherapy staff record treatment time accurately? An observational study.

PubMed

Bagley, Pam; Hudson, Mary; Green, John; Forster, Anne; Young, John

2009-09-01

To assess the reliability of duration of treatment time measured by physiotherapy staff in early-stage stroke patients. Comparison of physiotherapy staff's recording of treatment sessions and video recording. Rehabilitation stroke unit in a general hospital. Thirty-nine stroke patients without trunk control or who were unable to stand with an erect trunk without the support of two therapists recruited to a randomized trial evaluating the Oswestry Standing Frame. Twenty-six physiotherapy staff who were involved in patient treatment. Contemporaneous recording by physiotherapy staff of treatment time (in minutes) compared with video recording. Intraclass correlation with 95% confidence interval and the Bland and Altman method for assessing agreement by calculating the mean difference (standard deviation; 95% confidence interval), reliability coefficient and 95% limits of agreement for the differences between the measurements. The mean duration (standard deviation, SD) of treatment time recorded by physiotherapy staff was 32 (11) minutes compared with 25 (9) minutes as evidenced in the video recording. The mean difference (SD) was -6 (9) minutes (95% confidence interval (CI) -9 to -3). The reliability coefficient was 18 minutes and the 95% limits of agreement were -24 to 12 minutes. Intraclass correlation coefficient for agreement between the two methods was 0.50 (95% CI 0.12 to 0.73). Physiotherapy staff's recording of duration of treatment time was not reliable and was systematically greater than the video recording.

Validity and interobserver agreement of lower extremity local tissue water measurements in healthy women using tissue dielectric constant.

PubMed

Jensen, Mads R; Birkballe, Susanne; Nørregaard, Susan; Karlsmark, Tonny

2012-07-01

Tissue dielectric constant (TDC) measurement may become an important tool in the clinical evaluation of chronic lower extremity swelling in women; however, several factors are known to influence TDC measurements, and comparative data on healthy lower extremities are few. Thirty-four healthy women volunteered. Age, BMI, moisturizer use and hair removal were registered. Three blinded investigators performed TDC measurements in a randomized sequence on clearly marked locations on the foot, the ankle and the lower leg. The effective measuring depth was 2.5 mm. The mean TDC was 37.8 ± 5.5 (mean ± SD) on the foot, 29.0 ± 3.1 on the ankle and 30.5 ± 3.9 on the lower leg. TDC was highly dependent on measuring site (P<0.001) but did not vary significantly between investigators (P=0.127). Neither age, BMI, hair removal nor moisturizer use had any significant effect on the lower leg TDC. Intraclass correlation coefficients were 0.77 for the foot, 0.94 for the ankle and 0.94 for the lower leg. The TDC on the foot was significantly higher compared with ankle and lower leg values. Foot measurements should be interpreted cautiously because of questionable interobserver agreement. The interobserver agreement was high on lower leg and ankle measurements. Neither age, BMI, hair removal nor moisturizer use had any significant on effect on the lower leg TDC. TDC values of 35.2 for the ankle and 38.3 for the lower leg are suggested as upper normal reference limits in women. © 2012 The Authors Clinical Physiology and Functional Imaging © 2012 Scandinavian Society of Clinical Physiology and Nuclear Medicine.

Correlation Between Intraocular Pressure and Central Corneal Thickness in Persian Children.

PubMed

Nejabat, Mahmood; Heidary, Fatemeh; Talebnejad, Mohammad Reza; Salouti, Ramin; Nowroozzadeh, Mohammad Hossein; Masoumpour, Masoumeh; Mahdaviazad, Hamideh; Tajbakhsh, Zahra; Keshtkar, Maryam; Jamali, Hossein; Khalili, Mohammad Reza; Movahedan, Hossein; Roustaei, Narges; Gharebaghi, Reza

2016-12-01

This study aimed to determine intraocular pressure (IOP) and central corneal thickness (CCT) measurements in healthy Persian children to find clinical reference values in this ethnicity. Additionally, we examined the possible relationship between these measurements. This cross-sectional study included 262 eyes of 131 Persian primary school children between 6 and 13 years of age. All eyes were healthy and had no anterior or posterior segment abnormalities, corneal disease, or evidence of glaucoma. Specular microscopy was used to measure CCT and both noncontact tonometry (NCT) and Goldmann applanation tonometer (GAT) were used to measure IOP. Correlations between IOP measurements were also examined. Mean CCT was 513.47 ± 34.51 μm in the right eye (OD) and 513.93 ± 33.88 μm in the left eye (OS). The CCT was not significantly different between older (10-13 years) and younger (6-9 years) patients. Mean IOP measured with GAT was 13.86 ± 2.13 mmHg OD and 13.72 ± 2.04 mmHg OS and mean IOP measured with NCT was 15.26 ± 2.38 mmHg OD and 15.11 ± 2.18 mmHg OS. The IOP and CCT measured with GAT were weakly correlated (OD: r = 0.141, P = 0.114; OS: r = 0.236, P = 0.007). However, IOP and CCT measured with NCT (OD: r = 0.487, P = 0.000; OS: r = 0.456, P = 0.000) were moderately correlated. Our outcomes demonstrated that for 100 μm increase in CCT, IOP measured with GAT and NCT increased by 0.8 and 3.3 mmHg, respectively, in OD and by 1.4 and 2.9 mmHg in OS. Based on intraclass correlation coefficients, IOP measurements made with GAT and NCT were in fair agreement in OD and in good agreement in OS. The IOP and CCT in healthy Persian school children (6-13 years old) were positively correlated. Our findings revealed that corneal thickness is thinner in Persian children than in most other racial groups. This study has been funded by deputy dean in research of School of Medicine and deputy vice chancellor of Shiraz University of

Predicting phonetic transcription agreement: Insights from research in infant vocalizations

PubMed Central

RAMSDELL, HEATHER L.; OLLER, D. KIMBROUGH; ETHINGTON, CORINNA A.

2010-01-01

The purpose of this study is to provide new perspectives on correlates of phonetic transcription agreement. Our research focuses on phonetic transcription and coding of infant vocalizations. The findings are presumed to be broadly applicable to other difficult cases of transcription, such as found in severe disorders of speech, which similarly result in low reliability for a variety of reasons. We evaluated the predictiveness of two factors not previously documented in the literature as influencing transcription agreement: canonicity and coder confidence. Transcribers coded samples of infant vocalizations, judging both canonicity and confidence. Correlation results showed that canonicity and confidence were strongly related to agreement levels, and regression results showed that canonicity and confidence both contributed significantly to explanation of variance. Specifically, the results suggest that canonicity plays a major role in transcription agreement when utterances involve supraglottal articulation, with coder confidence offering additional power in predicting transcription agreement. PMID:17882695

Intraclass reliability for assessing how well Taiwan constrained hospital-provided medical services using statistical process control chart techniques

PubMed Central

2012-01-01

Background Few studies discuss the indicators used to assess the effect on cost containment in healthcare across hospitals in a single-payer national healthcare system with constrained medical resources. We present the intraclass correlation coefficient (ICC) to assess how well Taiwan constrained hospital-provided medical services in such a system. Methods A custom Excel-VBA routine to record the distances of standard deviations (SDs) from the central line (the mean over the previous 12 months) of a control chart was used to construct and scale annual medical expenditures sequentially from 2000 to 2009 for 421 hospitals in Taiwan to generate the ICC. The ICC was then used to evaluate Taiwan’s year-based convergent power to remain unchanged in hospital-provided constrained medical services. A bubble chart of SDs for a specific month was generated to present the effects of using control charts in a national healthcare system. Results ICCs were generated for Taiwan’s year-based convergent power to constrain its medical services from 2000 to 2009. All hospital groups showed a gradually well-controlled supply of services that decreased from 0.772 to 0.415. The bubble chart identified outlier hospitals that required investigation of possible excessive reimbursements in a specific time period. Conclusion We recommend using the ICC to annually assess a nation’s year-based convergent power to constrain medical services across hospitals. Using sequential control charts to regularly monitor hospital reimbursements is required to achieve financial control in a single-payer nationwide healthcare system. PMID:22587736

Inter-laboratory agreement on embryo classification and clinical decision: Conventional morphological assessment vs. time lapse.

PubMed

Martínez-Granados, Luis; Serrano, María; González-Utor, Antonio; Ortíz, Nereyda; Badajoz, Vicente; Olaya, Enrique; Prados, Nicolás; Boada, Montse; Castilla, Jose A

2017-01-01

The aim of this study is to determine inter-laboratory variability on embryo assessment using time-lapse platform and conventional morphological assessment. This study compares the data obtained from a pilot study of external quality control (EQC) of time lapse, performed in 2014, with the classical EQC of the Spanish Society for the Study of Reproductive Biology (ASEBIR) performed in 2013 and 2014. In total, 24 laboratories (8 using EmbryoScope™, 15 using Primo Vision™ and one with both platforms) took part in the pilot study. The clinics that used EmbryoScope™ analysed 31 embryos and those using Primo Vision™ analysed 35. The classical EQC was implemented by 39 clinics, based on an analysis of 25 embryos per year. Both groups were required to evaluate various qualitative morphological variables (cell fragmentation, the presence of vacuoles, blastomere asymmetry and multinucleation), to classify the embryos in accordance with ASEBIR criteria and to stipulate the clinical decision taken. In the EQC time-lapse pilot study, the groups were asked to determine, as well as the above characteristics, the embryo development times, the number, opposition and size of pronuclei, the direct division of 1 into 3 cells and/or of 3 into 5 cells and false divisions. The degree of agreement was determined by calculating the intra-class correlation coefficients and the coefficient of variation for the quantitative variables and the Gwet index for the qualitative variables. For both EmbryoScope™ and Primo Vision™, two periods of greater inter-laboratory variability were observed in the times of embryo development events. One peak of variability was recorded among the laboratories addressing the first embryo events (extrusion of the second polar body and the appearance of pronuclei); the second peak took place between the times corresponding to the 8-cell and morula stages. In most of the qualitative variables analysed regarding embryo development, there was almost

Inter-laboratory agreement on embryo classification and clinical decision: Conventional morphological assessment vs. time lapse

PubMed Central

Serrano, María; González-Utor, Antonio; Ortíz, Nereyda; Badajoz, Vicente; Olaya, Enrique; Prados, Nicolás; Boada, Montse; Castilla, Jose A.

2017-01-01

The aim of this study is to determine inter-laboratory variability on embryo assessment using time-lapse platform and conventional morphological assessment. This study compares the data obtained from a pilot study of external quality control (EQC) of time lapse, performed in 2014, with the classical EQC of the Spanish Society for the Study of Reproductive Biology (ASEBIR) performed in 2013 and 2014. In total, 24 laboratories (8 using EmbryoScope™, 15 using Primo Vision™ and one with both platforms) took part in the pilot study. The clinics that used EmbryoScope™ analysed 31 embryos and those using Primo Vision™ analysed 35. The classical EQC was implemented by 39 clinics, based on an analysis of 25 embryos per year. Both groups were required to evaluate various qualitative morphological variables (cell fragmentation, the presence of vacuoles, blastomere asymmetry and multinucleation), to classify the embryos in accordance with ASEBIR criteria and to stipulate the clinical decision taken. In the EQC time-lapse pilot study, the groups were asked to determine, as well as the above characteristics, the embryo development times, the number, opposition and size of pronuclei, the direct division of 1 into 3 cells and/or of 3 into 5 cells and false divisions. The degree of agreement was determined by calculating the intra-class correlation coefficients and the coefficient of variation for the quantitative variables and the Gwet index for the qualitative variables. For both EmbryoScope™ and Primo Vision™, two periods of greater inter-laboratory variability were observed in the times of embryo development events. One peak of variability was recorded among the laboratories addressing the first embryo events (extrusion of the second polar body and the appearance of pronuclei); the second peak took place between the times corresponding to the 8-cell and morula stages. In most of the qualitative variables analysed regarding embryo development, there was almost

Dynamic contrast-enhanced MR imaging of the rectum: Correlations between single-section and whole-tumor histogram analyses.

PubMed

Choi, M H; Oh, S N; Park, G E; Yeo, D-M; Jung, S E

2018-05-10

To evaluate the interobserver and intermethod correlations of histogram metrics of dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) parameters acquired by multiple readers using the single-section and whole-tumor volume methods. Four DCE parameters (K trans , K ep , V e , V p ) were evaluated in 45 patients (31 men and 14 women; mean age, 61±11 years [range, 29-83 years]) with locally advanced rectal cancer using pre-chemoradiotherapy (CRT) MRI. Ten histogram metrics were extracted using two methods of lesion selection performed by three radiologists: the whole-tumor volume method for the whole tumor on axial section-by-section images and the single-section method for the entire area of the tumor on one axial image. The interobserver and intermethod correlations were evaluated using the intraclass correlation coefficients (ICCs). The ICCs showed excellent interobserver and intermethod correlations in most of histogram metrics of the DCE parameters. The ICCs among the three readers were > 0.7 (P<0.001) for all histogram metrics, except for the minimum and maximum. The intermethod correlations for most of the histogram metrics were excellent for each radiologist, regardless of the differences in the radiologists' experience. The interobserver and intermethod correlations for most of the histogram metrics of the DCE parameters are excellent in rectal cancer. Therefore, the single-section method may be a potential alternative to the whole-tumor volume method using pre-CRT MRI, despite the fact that the high agreement between the two methods cannot be extrapolated to post-CRT MRI. Copyright © 2018 Société française de radiologie. Published by Elsevier Masson SAS. All rights reserved.

Faculty and resident evaluations of medical students on a surgery clerkship correlate poorly with standardized exam scores.

PubMed

Goldstein, Seth D; Lindeman, Brenessa; Colbert-Getz, Jorie; Arbella, Trisha; Dudas, Robert; Lidor, Anne; Sacks, Bethany

2014-02-01

The clinical knowledge of medical students on a surgery clerkship is routinely assessed via subjective evaluations from faculty members and residents. Interpretation of these ratings should ideally be valid and reliable. However, prior literature has questioned the correlation between subjective and objective components when assessing students' clinical knowledge. Retrospective cross-sectional data were collected from medical student records at The Johns Hopkins University School of Medicine from July 2009 through June 2011. Surgical faculty members and residents rated students' clinical knowledge on a 5-point, Likert-type scale. Interrater reliability was assessed using intraclass correlation coefficients for students with ≥4 attending surgeon evaluations (n = 216) and ≥4 resident evaluations (n = 207). Convergent validity was assessed by correlating average evaluation ratings with scores on the National Board of Medical Examiners (NBME) clinical subject examination for surgery. Average resident and attending surgeon ratings were also compared by NBME quartile using analysis of variance. There were high degrees of reliability for resident ratings (intraclass correlation coefficient, .81) and attending surgeon ratings (intraclass correlation coefficient, .76). Resident and attending surgeon ratings shared a moderate degree of variance (19%). However, average resident ratings and average attending surgeon ratings shared a small degree of variance with NBME surgery examination scores (ρ(2) ≤ .09). When ratings were compared among NBME quartile groups, the only significant difference was for residents' ratings of students with the lower 25th percentile of scores compared with the top 25th percentile of scores (P = .007). Although high interrater reliability suggests that attending surgeons and residents rate students with consistency, the lack of convergent validity suggests that these ratings may not be reflective of actual clinical knowledge. Both faculty

Short version of the Depression Anxiety Stress Scale-21: is it valid for Brazilian adolescents?

PubMed Central

da Silva, Hítalo Andrade; dos Passos, Muana Hiandra Pereira; de Oliveira, Valéria Mayaly Alves; Palmeira, Aline Cabral; Pitangui, Ana Carolina Rodarti; de Araújo, Rodrigo Cappato

2016-01-01

ABSTRACT Objective To evaluate the interday reproducibility, agreement and validity of the construct of short version of the Depression Anxiety Stress Scale-21 applied to adolescents. Methods The sample consisted of adolescents of both sexes, aged between 10 and 19 years, who were recruited from schools and sports centers. The validity of the construct was performed by exploratory factor analysis, and reliability was calculated for each construct using the intraclass correlation coefficient, standard error of measurement and the minimum detectable change. Results The factor analysis combining the items corresponding to anxiety and stress in a single factor, and depression in a second factor, showed a better match of all 21 items, with higher factor loadings in their respective constructs. The reproducibility values for depression were intraclass correlation coefficient with 0.86, standard error of measurement with 0.80, and minimum detectable change with 2.22; and, for anxiety/stress: intraclass correlation coefficient with 0.82, standard error of measurement with 1.80, and minimum detectable change with 4.99. Conclusion The short version of the Depression Anxiety Stress Scale-21 showed excellent values of reliability, and strong internal consistency. The two-factor model with condensation of the constructs anxiety and stress in a single factor was the most acceptable for the adolescent population. PMID:28076595

Various methods for assessing static lower extremity alignment: implications for prospective risk-factor screenings.

PubMed

Nguyen, Anh-Dung; Boling, Michelle C; Slye, Carrie A; Hartley, Emily M; Parisi, Gina L

2013-01-01

Accurate, efficient, and reliable measurement methods are essential to prospectively identify risk factors for knee injuries in large cohorts. To determine tester reliability using digital photographs for the measurement of static lower extremity alignment (LEA) and whether values quantified with an electromagnetic motion-tracking system are in agreement with those quantified with clinical methods and digital photographs. Descriptive laboratory study. Laboratory. Thirty-three individuals participated and included 17 (10 women, 7 men; age = 21.7 ± 2.7 years, height = 163.4 ± 6.4 cm, mass = 59.7 ± 7.8 kg, body mass index = 23.7 ± 2.6 kg/m2) in study 1, in which we examined the reliability between clinical measures and digital photographs in 1 trained and 1 novice investigator, and 16 (11 women, 5 men; age = 22.3 ± 1.6 years, height = 170.3 ± 6.9 cm, mass = 72.9 ± 16.4 kg, body mass index = 25.2 ± 5.4 kg/m2) in study 2, in which we examined the agreement among clinical measures, digital photographs, and an electromagnetic tracking system. We evaluated measures of pelvic angle, quadriceps angle, tibiofemoral angle, genu recurvatum, femur length, and tibia length. Clinical measures were assessed using clinically accepted methods. Frontal- and sagittal-plane digital images were captured and imported into a computer software program. Anatomic landmarks were digitized using an electromagnetic tracking system to calculate static LEA. Intraclass correlation coefficients and standard errors of measurement were calculated to examine tester reliability. We calculated 95% limits of agreement and used Bland-Altman plots to examine agreement among clinical measures, digital photographs, and an electromagnetic tracking system. Using digital photographs, fair to excellent intratester (intraclass correlation coefficient range = 0.70-0.99) and intertester (intraclass correlation coefficient range = 0.75-0.97) reliability were observed for static knee alignment and limb

Predicted and measured retinal nerve fiber layer thickness from time-domain optical coherence tomography compared with spectral-domain optical coherence tomography.

PubMed

Schrems, Wolfgang A; Schrems-Hoesl, Laura M; Bendschneider, Delia; Mardin, Christian Y; Laemmer, Robert; Kruse, Friedrich E; Horn, Folkert K

2015-10-01

New methods are needed to compare peripapillary retinal nerve fiber layer thickness (pRNFLT) measurements taken from time-domain optical coherence tomography (TD-OCT) and spectral-domain OCT (SD-OCT). To compare the agreement of measured and predicted pRNFLT using different equations based on pRNFLT measurements obtained by TD-OCT and SD-OCT. Cross-sectional single-center study that took place at the Department of Ophthalmology, University of Erlangen-Nuremberg from November 16, 2005, to June 3, 2015, and included 138 eyes of control participants, 126 eyes of patients with ocular hypertension, 128 eyes of patients with preperimetric glaucoma, and 160 eyes of patients with perimetric glaucoma. All participants had standard clinical examinations to obtain TD-OCT (via Stratus OCT) and SD-OCT (via Spectralis OCT) measurements of pRNFLT. Two groups were matched for diagnostic subgroup, eye side, sex, and age. The TD-OCT measurements of the first group were used to predict the mean SD-OCT and 6-sector vertical-split pRNFLT measurements of the second group and vice versa. The agreement between the predicted pRNFLT calculations of conversion equations and measured pRNFLT of the second group was evaluated by intraclass correlation coefficients and Bland-Altman plots. Mean and sectoral pRNFLT measurements obtained by TD-OCT and SD-OCT as well as the agreement between measured and predicted pRNFLT. The agreement for all investigated equations to predict mean pRNFLT measurements with intraclass correlation coeffecients ranged from 0.937 to 0.939. Bland-Altman plots demonstrated systemic biases between -0.7 μm and +1.1 μm for measured and predicted mean pRNFLT measurements. The ratio method demonstrated an intraclass correlation coefficient of 0.969 for the temporal-inferior sector. The best color-code agreement between both OCT devices was achieved by the no conversion method, with κ = 0.731 (95% CI, 0.656-0.806) for the mean pRNFLT. These data suggest that the

New agreement measures based on survival processes

PubMed Central

Guo, Ying; Li, Ruosha; Peng, Limin; Manatunga, Amita K.

2013-01-01

Summary The need to assess agreement arises in many scenarios in biomedical sciences when measurements were taken by different methods on the same subjects. When the endpoints are survival outcomes, the study of agreement becomes more challenging given the special characteristics of time-to-event data. In this paper, we propose a new framework for assessing agreement based on survival processes that can be viewed as a natural representation of time-to-event outcomes. Our new agreement measure is formulated as the chance-corrected concordance between survival processes. It provides a new perspective for studying the relationship between correlated survival outcomes and offers an appealing interpretation as the agreement between survival times on the absolute distance scale. We provide a multivariate extension of the proposed agreement measure for multiple methods. Furthermore, the new framework enables a natural extension to evaluate time-dependent agreement structure. We develop nonparametric estimation of the proposed new agreement measures. Our estimators are shown to be strongly consistent and asymptotically normal. We evaluate the performance of the proposed estimators through simulation studies and then illustrate the methods using a prostate cancer data example. PMID:23844617

[Reliability of nursing outcomes classification label "Knowledge: cardiac disease management (1830)" in outpatients with heart failure].

PubMed

Cañón-Montañez, Wilson; Oróstegui-Arenas, Myriam

2015-01-01

To determine the reliability (internal consistency, inter-rater reproducibility and level of agreement) of nursing outcome: "Knowledge: cardiac disease management (1830)" of the version published in Spanish, in outpatients with heart failure. A reliability study was conducted on 116 outpatients with heart failure. Six indicators of nursing outcome were operationalized. All participants were assessed simultaneously by two evaluators. Three evaluation periods were defined: initial (at baseline), final (a month later), and follow-up (two months later). Internal consistency by Cronbach alpha coefficient, inter-rater reproducibility with intraclass correlation coefficient of reproducibility or agreement and level agreement using the 95% limits of Bland and Altman. Cronbach's alpha was 0.83 (95% CI: 0.77 - 0.89) in the final evaluation, and follow-up values of 0.85 (95% CI: 0.82-0.89) and 0.83 (95% CI: 0.78 - 0.88) were found for the first and second evaluator, respectively. The intraclass correlation coefficient showed values greater 0.9 in the three evaluation periods in both the random and mixed model. The Bland-Altman 95% limits of agreement were close to zero in the three evaluations performed. The questionnaire operationalized to assess the nursing outcome: "Knowledge: cardiac disease management (1830)" in its Spanish version, is a reliable method to measure skills and knowledge in outpatients with heart failure in the Colombian context. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Comparison of Two Devices for Intraoperative Portal Venous Flow Measurement in Living-Donor Liver Transplantation: Transit Time Ultrasound and Conventional Doppler Ultrasound.

PubMed

Wang, H-K; Chen, C-Y; Lin, N-C; Liu, C-S; Loong, C-C; Lin, Y-H; Lai, Y-C; Chiou, H-J

2018-05-01

Intraoperative portal venous flow measurement provides surgeons with instant guidance for portal flow modulation during living-donor liver transplantation (LDLT). In this study, we compared the agreement of portal flow measurement obtained by 2 devices: transit time ultrasound (TTU) and conventional Doppler ultrasound (CDU). Fifty-four recipients of LDLT underwent intraoperative measurement of portal flow after completion of vascular anastomosis of the implanted partial liver graft. Both TTU and CDU were used concurrently. Agreement of TTU and CDU was assessed by intraclass correlation coefficient using a model of 2-way random effects, absolute agreement, and single measurement. A Bland-Altman plot was applied to assess the variability between the 2 devices. The mean, median, and range of portal venous flow was 1456, 1418, and 117 to 2776 mL/min according to TTU; and 1564, 1566, and 119 to 3216 mL/min according to CDU. The intraclass correlation coefficient of portal venous flow between TTU and CDU was 0.68 (95% confidence interval, 0.51-0.80). The Bland-Altman plots revealed an average variation of 4.8% between TTU and CDU but with a rather wide 95% confidence interval of variation ranging from -57.7% to 67.4%. Intraoperative TTU and CDU showed moderate agreement in portal flow measurement. However, a relatively wide range of variation exists between TTU and CDU, indicating that data obtained from the 2 devices may not be interchangeable. Copyright © 2018 Elsevier Inc. All rights reserved.

Measurement of central corneal thickness with optical low-coherence reflectometry and ultrasound pachymetry in normal and post-femtosecond laser in situ keratomileusis eyes.

PubMed

Huang, Jinhai; Liao, Na; Savini, Giacomo; Li, Yuanguang; Bao, Fangjun; Yu, Ye; Yu, Ayong; Wang, Qinmei

2015-02-01

To determine the repeatability and reproducibility of measurements of central corneal thickness (CCT) using optical low-coherence reflectometry (Lenstar LS900; Haag Streit) in normal eyes and post-femtosecond laser in situ keratomileusis (post-FS-LASIK) eyes and evaluate their agreement with ultrasound (US) pachymetry. CCT was measured using Lenstar and US pachymetry sequentially in normal and post-FS-LASIK eyes by 2 experienced observers. Intraoperator repeatability and interoperator reproducibility were assessed by within-subject standard deviation, test-retest repeatability, coefficient of variation (CoV), and intraclass correlation coefficient. Paired t-tests and Bland-Altman plots were used for analyzing agreement between the 2 devices. In this study, 55 healthy subjects and 50 post-FS-LASIK patients were recruited. Test-retest repeatability of Lenstar was within 10 μm, CoV was less than 1.0%, and intraclass correlation coefficient was more than 0.9 in both normal and post-FS-LASIK groups. Mean difference between these methods was 1.4 ± 4.2 μm and -1.7 ± 5.4 μm, respectively. Moreover, measurements of CCT showed narrow 95% limits of agreement (range, normal group: -6.8 and 9.6 μm; post-FS-LASIK group: -12.4 and 8.9 μm), which implied good agreement. Measurements of CCT using Lenstar showed excellent intraoperator repeatability and interoperator reproducibility both in normal eyes and post-FS-LASIK eyes. Measurements of CCT using Lenstar and US pachymetry showed good agreement and both can be used interchangeably.

Unified Parkinson's Disease Rating Scale-Motor Exam: inter-rater reliability of advanced practice nurse and neurologist assessments.

PubMed

Palmer, Janice L; Coats, Mary A; Roe, Catherine M; Hanko, Shelly M; Xiong, Chengjie; Morris, John C

2010-06-01

This paper is a report of a study to establish the inter-rater reliability of advanced practice nurse and neurologist neurological assessments which included ratings with the Unified Parkinson's Disease Rating Scale-Motor Exam. Around the world, advanced practice nurses are performing tasks once completed only by physicians. To promote consumer and provider confidence, it is important to establish that nurse and physician ratings using assessment tools are similar. In addition in research settings, when different raters are used, establishment of inter-rater reliability for study assessments is needed. Advanced practice nurses and neurologists independently recorded findings on neurological examinations of 46 participants in a study conducted between August 2007 and January 2008. An intraclass correlation coefficient was calculated to estimate overall agreement between the nurse and neurologist ratings. Agreement for individual items measured on a dichotomous scale was assessed by calculating Cohen's kappa. There was substantial agreement between advanced practice nurses and neurologists on the mean Unified Parkinson's Disease Rating Scale-Motor Exam ratings (intraclass correlation coefficient = 0.65) and the U.S. National Alzheimer's Coordinating Center Uniform Data Set neurological examination ratings of unremarkable findings (kappa = 0.74) and of gait disorder (kappa = 0.73). Moderate agreement (kappa = 0.53) was reached for the rating of whether all Unified Parkinson's Disease Rating Scale-Motor Exam items were normal. These findings are consistent with studies of the inter-rater agreement of the Unified Parkinson's Disease Rating Scale-Motor Exam and support the conduct of neurological assessments by advanced practice nurses.

Reliability of the hospital nutrition environment scan for cafeterias, vending machines, and gift shops.

PubMed

Winston, Courtney P; Sallis, James F; Swartz, Michael D; Hoelscher, Deanna M; Peskin, Melissa F

2013-08-01

According to ecological models, the physical environment plays a major role in determining individual health behaviors. As such, researchers have started targeting the consumer nutrition environment of large-scale foodservice operations when implementing obesity-prevention programs. In 2010, the American Hospital Association released a call-to-action encouraging health care facilities to join in this movement and improve their facilities' consumer nutrition environments. The Hospital Nutrition Environment Scan (HNES) for Cafeterias, Vending Machines, and Gift Shops was developed in 2011, and the present study evaluated the inter-rater reliability of this instrument. Two trained raters visited 39 hospitals in southern California and completed the HNES. Percent agreement, kappa statistics, and intraclass correlation coefficients were calculated. Percent agreement between raters ranged from 74.4% to 100% and kappa statistics ranged from 0.458 to 1.0. The intraclass correlation coefficient for the overall nutrition composite scores was 0.961. Given these results, the HNES demonstrated acceptable reliability metrics and can now be disseminated to assess the current state of hospital consumer nutrition environments. Copyright © 2013 Academy of Nutrition and Dietetics. Published by Elsevier Inc. All rights reserved.

Standardized assessment of tumor-infiltrating lymphocytes in breast cancer: an evaluation of inter-observer agreement between pathologists.

PubMed

Tramm, Trine; Di Caterino, Tina; Jylling, Anne-Marie B; Lelkaitis, Giedrius; Lænkholm, Anne-Vibeke; Ragó, Péter; Tabor, Tomasz P; Talman, Maj-Lis M; Vouza, Emmanouela

2018-01-01

In breast cancer, there is a growing body of evidence that tumor-infiltrating lymphocytes (TILs) may have clinical utility and may be able to direct clinical decisions for subgroups of patients. Clinical utility is, however, not sufficient for warranting the implementation of a new biomarker in the routine practice, and evaluation of the analytical validity is needed, including testing the reproducibility of decentralized assessment of TILs. The aim of this study was to evaluate the inter-observer agreement of TILs assessment using a standardized method, as proposed by the International TILs Working Group 2014, applied to a cohort of breast cancers reflecting an average breast cancer population. Stromal TILs were assessed using full slide sections from 124 breast cancers with varying histology, malignancy grade and ER- and HER2 status. TILs were estimated by nine dedicated breast pathologists using scanned hematoxylin-eosin stainings. TILs results were categorized using various cutoffs, and the inter-observer agreement was evaluated using the intraclass coefficient (ICC), Kappa statistics as well as individual overall agreements with the median value of TILs. Evaluation of TILs led to an ICC of 0.71 (95% CI: 0.65-0.77) corresponding to an acceptable agreement. Kappa values were in the range of 0.38-0.46 corresponding to a fair to moderate agreement. The individual agreements increased, when using only two categories ('high' vs. 'low' TILs) and a cutoff of 50-60%. The results of the present study are in accordance with previous studies, and shows that the proposed methodology for standardized evaluation of TILs renders an acceptable inter-observer agreement. The findings, however, indicate that assessment of TILs needs further refinement, and is in support of the latest St. Gallen Consensus, that routine reporting of TILs for early breast cancer is not ready for implementation in a clinical setting.

Challenge of assessing symptoms in seriously ill intensive care unit patients: can proxy reporters help?

PubMed

Puntillo, Kathleen A; Neuhaus, John; Arai, Shoshana; Paul, Steven M; Gropper, Michael A; Cohen, Neal H; Miaskowski, Christine

2012-10-01

Determine levels of agreement among intensive care unit patients and their family members, nurses, and physicians (proxies) regarding patients' symptoms and compare levels of mean intensity (i.e., the magnitude of a symptom sensation) and distress (i.e., the degree of emotionality that a symptom engenders) of symptoms among patients and proxy reporters. Prospective study of proxy reporters of symptoms in seriously ill patients. Two intensive care units in a tertiary medical center in the Western United States. Two hundred and forty-five intensive care unit patients, 243 family members, 103 nurses, and 92 physicians. None. On the basis of the magnitude of intraclass correlation coefficients, where coefficients from .35 to .78 are considered to be appropriately robust, correlation coefficients between patients' and family members' ratings met this criterion (≥.35) for intensity in six of ten symptoms. No intensity ratings between patients and nurses had intraclass correlation coefficients >.32. Three symptoms had intensity correlation coefficients of ≥.36 between patients' and physicians' ratings. Correlation coefficients between patients and family members were >.40 for five symptom-distress ratings. No symptoms had distress correlation coefficients of ≥.28 between patients' and nurses' ratings. Two symptoms had symptom-distress correlation coefficients between patients' and physicians' ratings at >.39. Family members, nurses, and physicians reported higher symptom-intensity scores than patients did for 80%, 60%, and 60% of the symptoms, respectively. Family members, nurses, and physicians reported higher symptom-distress scores than patients did for 90%, 70%, and 80% of the symptoms, respectively. Patient-family intraclass correlation coefficients were sufficiently close for us to consider using family members to help assess intensive care unit patients' symptoms. Relatively low intraclass correlation coefficients between intensive care unit clinicians' and

Agreement and reliability of pelvic floor measurements during contraction using three-dimensional pelvic floor ultrasound and virtual reality.

PubMed

Speksnijder, L; Rousian, M; Steegers, E A P; Van Der Spek, P J; Koning, A H J; Steensma, A B

2012-07-01

Virtual reality is a novel method of visualizing ultrasound data with the perception of depth and offers possibilities for measuring non-planar structures. The levator ani hiatus has both convex and concave aspects. The aim of this study was to compare levator ani hiatus volume measurements obtained with conventional three-dimensional (3D) ultrasound and with a virtual reality measurement technique and to establish their reliability and agreement. 100 symptomatic patients visiting a tertiary pelvic floor clinic with a normal intact levator ani muscle diagnosed on translabial ultrasound were selected. Datasets were analyzed using a rendered volume with a slice thickness of 1.5 cm at the level of minimal hiatal dimensions during contraction. The levator area (in cm(2)) was measured and multiplied by 1.5 to get the levator ani hiatus volume in conventional 3D ultrasound (in cm(3)). Levator ani hiatus volume measurements were then measured semi-automatically in virtual reality (cm(3) ) using a segmentation algorithm. An intra- and interobserver analysis of reliability and agreement was performed in 20 randomly chosen patients. The mean difference between levator ani hiatus volume measurements performed using conventional 3D ultrasound and virtual reality was 0.10 (95% CI, - 0.15 to 0.35) cm(3). The intraclass correlation coefficient (ICC) comparing conventional 3D ultrasound with virtual reality measurements was > 0.96. Intra- and interobserver ICCs for conventional 3D ultrasound measurements were > 0.94 and for virtual reality measurements were > 0.97, indicating good reliability for both. Levator ani hiatus volume measurements performed using virtual reality were reliable and the results were similar to those obtained with conventional 3D ultrasonography. Copyright © 2012 ISUOG. Published by John Wiley & Sons, Ltd.

Correcting Four Similar Correlational Measures for Attenuation Due to Errors of Measurement in the Dependent Variable: Eta, Epsilon, Omega, and Intraclass r.

ERIC Educational Resources Information Center

Stanley, Julian C.; Livingston, Samuel A.

Besides the ubiquitous Pearson product-moment r, there are a number of other measures of relationship that are attenuated by errors of measurement and for which the relationship between true measures can be estimated. Among these are the correlation ratio (eta squared), Kelley's unbiased correlation ratio (epsilon squared), Hays' omega squared,…

[Inter-rater agreement on self-reported exposure to ergonomic risk factors for the upper extremities among mechanic assemblers in an automotive industry].

PubMed

d'Errico, Angelo; Fontana, Dario; Merogno, Angela

2016-01-01

to assess reproducibility of self-reported exposure to ergonomic hazards for the upper limbs, measured through a questionnaire based on a diffused checklist for the assessment of ergonomic risk (OCRA) in a sample of mechanical assemblers of an automotive industry. cross-sectional study; reproducibility was assessed as interrater agreement of a composite index of ergonomic risk, estimated through the intraclass correlation coefficient (ICC). 58 mechanical assemblers, working in 29 twin areas, characterised by same work stations and tasks. composite index of ergonomic risk for the upper limbs. reproducibility of the ergonomic index was high in the overall sample (ICC: 0.81) and it was higher for the twin areas employing same-gender workers (ICC: 0.96), compared to those with workers of the opposite gender (ICC: 0.66). these results indicate that a questionnaire measuring with a great detail the exposure to the main ergonomic risk factors for the upper limbs, as the one based on the OCRA checklist used for this study, would allow to obtain a highly reproducible ergonomic index. If its validity against the corresponding observational checklist will be found elevated by future studies, this questionnaire may represent a useful tool for a preliminary assessment of workers' exposure to ergonomic hazards for the upper limbs.

Three assessment tools for deliberate self-harm and suicide behavior: evaluation and psychopathological correlates.

PubMed

Fliege, Herbert; Kocalevent, Rueya-Daniela; Walter, Otto B; Beck, Stefanie; Gratz, Kim L; Gutierrez, Peter M; Klapp, Burghard F

2006-07-01

The aims of this study are to adapt two validated self-report questionnaires of deliberate self-harm and suicidal behavior to German, to investigate their psychometric properties and agreement with clinician-administered ratings, and to examine their psychopathological correlates. The Deliberate Self-Harm Inventory [Gratz KL. Measurement of deliberate self-harm: preliminary data on the deliberate self-harm inventory. J Psychopathol Behav 2001;23:253-263] and the Self-Harm Behavior Questionnaire [Guttierez PM, Osman A, Barrios FX, Kopper BA. Development and initial validation of the self-harm behavior questionnaire. J Pers Assess 2001;77:475-490] were completed by 361 patients hospitalized for depressive, anxiety, adjustment, somatoform, and/or eating disorders. A clinician-administered rating scale of self-destructive behavior was included. Psychopathological variables were assessed by standardized questionnaires. The self-report questionnaires demonstrated good reliability (alpha=.81-.96, split-half r=.78-.98, test-retest r=.65-.91). Reliability of the clinician-administered ratings was acceptable (interrater kappa=.46-.77, test-retest kappa=.35-.48). Intraclass correlations (ICC=.68) for all three instruments were satisfactory. Rates of self-harm and associations between self-harm and suicidal behaviors are reported. The findings support the hypotheses of a higher degree of psychiatric symptomatology in patients with self-harm behavior compared to those without. The two questionnaire adaptations are reliable and valid self-report scales for the assessment of self-harm and past suicidal behavior.

Estimation of Rank Correlation for Clustered Data

PubMed Central

Rosner, Bernard; Glynn, Robert

2017-01-01

It is well known that the sample correlation coefficient (Rxy) is the maximum likelihood estimator (MLE) of the Pearson correlation (ρxy) for i.i.d. bivariate normal data. However, this is not true for ophthalmologic data where X (e.g., visual acuity) and Y (e.g., visual field) are available for each eye and there is positive intraclass correlation for both X and Y in fellow eyes. In this paper, we provide a regression-based approach for obtaining the MLE of ρxy for clustered data, which can be implemented using standard mixed effects model software. This method is also extended to allow for estimation of partial correlation by controlling both X and Y for a vector U of other covariates. In addition, these methods can be extended to allow for estimation of rank correlation for clustered data by (a) converting ranks of both X and Y to the probit scale, (b) estimating the Pearson correlation between probit scores for X and Y, and (c) using the relationship between Pearson and rank correlation for bivariate normally distributed data. The validity of the methods in finite-sized samples is supported by simulation studies. Finally, two examples from ophthalmology and analgesic abuse are used to illustrate the methods. PMID:28399615

Networking and knowledge exchange to promote the formation of transdisciplinary coalitions and levels of agreement among transdisciplinary peer reviewers.

PubMed

Lobb, Rebecca; Petermann, Lisa; Manafo, Elizabeth; Keen, Deb; Kerner, Jon

2013-01-01

Funding for transdisciplinary chronic disease prevention research has increased over the past decade. However, few studies have evaluated whether networking and knowledge exchange activities promote the creation of transdisciplinary teams to successfully respond to requests for proposals (RFPs). Such evaluations are critical to understanding how to accelerate the integration of research with practice and policy to improve population health. To examine (1) the extent of participation in pre-RFP activities among funded and nonfunded transdisciplinary coalitions that responded to a RFP for cancer and chronic disease prevention initiatives and (2) levels of agreement in proposal ratings among research, practice, and policy peer reviewers. Descriptive report of a Canadian funding initiative to increase the integration of evidence with action. Four hundred forty-nine representatives in 41 research, practice, and policy coalitions who responded to a RFP and whose proposals were peer reviewed by a transdisciplinary adjudication panel. The funder hosted 6 national meetings and issued a letter of intent (LOI) to foster research, practice, and policy collaborations before issuing a RFP. All provinces and territories in Canada were represented by the coalitions. Funded coalitions were 2.5 times more likely than nonfunded coalitions to submit a LOI. A greater proportion of funded coalitions were exposed to the pre-RFP activities (100%) compared with coalitions that were not funded (68%). Overall research, practice, and policy peer reviewer agreement was low (intraclass correlation 0.12). There is widespread interest in transdisciplinary collaborations to improve cancer and chronic disease prevention. Engagement in networking and knowledge exchange activities, and feedback from LOIs prior to submission of a final application, may contribute to stronger proposals and subsequent funding success. Future evaluations should examine best practices for transdisciplinary peer review to

Measurement of the Inter-Rater Reliability Rate Is Mandatory for Improving the Quality of a Medical Database: Experience with the Paulista Lung Cancer Registry.

PubMed

Lauricella, Leticia L; Costa, Priscila B; Salati, Michele; Pego-Fernandes, Paulo M; Terra, Ricardo M

2018-06-01

Database quality measurement should be considered a mandatory step to ensure an adequate level of confidence in data used for research and quality improvement. Several metrics have been described in the literature, but no standardized approach has been established. We aimed to describe a methodological approach applied to measure the quality and inter-rater reliability of a regional multicentric thoracic surgical database (Paulista Lung Cancer Registry). Data from the first 3 years of the Paulista Lung Cancer Registry underwent an audit process with 3 metrics: completeness, consistency, and inter-rater reliability. The first 2 methods were applied to the whole data set, and the last method was calculated using 100 cases randomized for direct auditing. Inter-rater reliability was evaluated using percentage of agreement between the data collector and auditor and through calculation of Cohen's κ and intraclass correlation. The overall completeness per section ranged from 0.88 to 1.00, and the overall consistency was 0.96. Inter-rater reliability showed many variables with high disagreement (>10%). For numerical variables, intraclass correlation was a better metric than inter-rater reliability. Cohen's κ showed that most variables had moderate to substantial agreement. The methodological approach applied to the Paulista Lung Cancer Registry showed that completeness and consistency metrics did not sufficiently reflect the real quality status of a database. The inter-rater reliability associated with κ and intraclass correlation was a better quality metric than completeness and consistency metrics because it could determine the reliability of specific variables used in research or benchmark reports. This report can be a paradigm for future studies of data quality measurement. Copyright © 2018 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Using Network Oriented Research Assistant (NORA) Technology to Compare Digital Photographic With In-Person Assessment of Acne Vulgaris.

PubMed

Singer, Hannah M; Almazan, Timothy; Craft, Noah; David, Consuelo V; Eells, Samantha; Erfe, Crisel; Lazzaro, Cynthia; Nguyen, Kathy; Preciado, Katy; Tan, Belinda; Patel, Vishal A

2018-02-01

Teledermatology has undergone exponential growth in the past 2 decades. Many technological innovations are becoming available without necessarily undergoing validation studies for specific dermatologic applications. To determine whether patient-taken photographs of acne using Network Oriented Research Assistant (NORA) result in similar lesion counts and Investigator's Global Assessment (IGA) findings compared with in-person examination findings. This pilot reliability study enrolled consecutive patients with acne vulgaris from a single general dermatology practice in Los Angeles, California, who were able to use NORA on an iPhone 6 to take self-photographs. Patients were enrolled from January 1 through March 31, 2016. Each individual underwent in-person and digital evaluation of his or her acne by the same dermatologist. A period of at least 1 week separated the in-person and digital assessments of acne. All participants were trained on how to use NORA on the iPhone 6 and take photographs of their face with the rear-facing camera. Reliability of patient-taken photographs with NORA for acne evaluation compared with in-person examination findings. Acne assessment measures included lesion count (total, inflammatory, noninflammatory, and cystic) and IGA for acne severity. A total of 69 patients (37 male [54%] and 32 female [46%]; mean [SD] age, 22.7 [7.7] years) enrolled in the study. The intraclass correlation coefficients of in-person and photograph-based acne evaluations indicated strong agreement. The intraclass correlation coefficient for total lesion count was 0.81; for the IGA, 0.75. Inflammatory lesion count, noninflammatory lesion count, and cyst count had intraclass correlation coefficients of 0.72, 0.72, and 0.82, respectively. This study found agreement between acne evaluations performed in person and from self-photographs with NORA. As a reliable telehealth technology for acne, NORA can be used as a teledermatology platform for dermatology research and can

Corneal thickness and elevation measurements using swept-source optical coherence tomography and slit scanning topography in normal and keratoconic eyes.

PubMed

Jhanji, Vishal; Yang, Bingzhi; Yu, Marco; Ye, Cong; Leung, Christopher K S

2013-11-01

To compare corneal thickness and corneal elevation using swept source optical coherence tomography and slit scanning topography. Prospective study. 41 normal and 46 keratoconus subjects. All eyes were imaged using swept source optical coherence tomography and slit scanning tomography during the same visit. Mean corneal thickness and best-fit sphere measurements were compared between the instruments. Agreement of measurements between swept source optical coherence tomography and scanning slit topography was analyzed. Intra-rater reproducibility coefficient and intraclass correlation coefficient were evaluated. In normal eyes, central corneal thickness measured by swept source optical coherence tomography was thinner compared with slit scanning topography (p < 0.0001) and ultrasound pachymetry (p = < .0001). Ultrasound pachymetry readings had better 95% limits of agreement with swept source optical coherence tomography than slit scanning topography. In keratoconus eyes, central corneal thickness was thinner on swept source optical coherence tomography than slit scanning topography (p = 0.081) and ultrasound pachymetry (p = 0.001). There were significant differences between thinnest corneal thickness, and, anterior and posterior best-fit sphere measurements between both instruments (p < 0.05 for all). Overall, reproducibility coefficients and intraclass correlation coefficients were significantly better with swept source optical coherence tomography for measurement of central corneal thickness, anterior best-fit sphere and, posterior best-fit sphere (all p < 0.001). Corneal thickness and elevation measurements were significantly different between swept source optical coherence tomography and slit scanning topography. With better reproducibility coefficients and intraclass correlation coefficients, swept source optical coherence tomography may provide a reliable alternative for measurement of corneal parameters. © 2013 The Authors. Clinical

Measurement of acute nonspecific low back pain perception in primary care physical therapy: reliability and validity of the brief illness perception questionnaire.

PubMed

Hallegraeff, Joannes M; van der Schans, Cees P; Krijnen, Wim P; de Greef, Mathieu H G

2013-02-01

The eight-item Brief Illness Perception Questionnaire is used as a screening instrument in physical therapy to assess mental defeat in patients with acute low back pain, besides patient perception might determine the course and risk for chronic low back pain. However, the psychometric properties of the Brief Illness Perception Questionnaire in common musculoskeletal disorders like acute low back pain have not been adequately studied. Patients' perceptions vary across different populations and affect coping styles. Thus, our aim was to determine the internal consistency, test-retest reliability and validity of the Dutch language version of the Brief Illness Perception Questionnaire in acute non-specific low back pain patients in primary care physical therapy. A non-experimental cross-sectional study with two measurements was performed. Eighty-four acute low back pain patients, in multidisciplinary health care center in Dutch primary care with a sample mean (SD) age of 42 (12) years, participated in the study. Internal consistency (Cronbach's α) and test-retest procedures (Intraclass Correlation Coefficients and limits of agreement) were evaluated at a one-week interval. The concurrent validity of the Brief Illness Perception Questionnaire was examined by using the Mental Health Component of the Short Form 36 Health Survey. The Cronbach's α for internal consistency was 0.73 (95% CI, 0.67 - 0.83); and the Intraclass Correlation Coefficient test-retest reliability was acceptable: 0.72 (95% CI, 0.53 - 0.82), however, the limits of agreement were large. The Intraclass Correlation Coefficient measuring concurrent validity 0.65 (95% CI, 0.46 - 0.80). The Dutch version of the Brief Illness Perception Questionnaire is an appropriate instrument for measuring patients' perceptions in acute low back pain patients, showing acceptable internal consistency and reliability. Concurrent validity is adequate, however, the instrument may be unsuitable for detecting changes in low

The Dependency Axiom and the Relation between Agreement and Movement

ERIC Educational Resources Information Center

Linares Scarcerieau, Carlo Andrei

2012-01-01

Agreement and movement go hand in hand in a number of constructions across languages, and this correlation has played an important role in syntactic theory. The current standard approach to this "movement-agreement connection" is the Agree+EPP model, whose EPP component has often been questioned on conceptual grounds. The goal of this…

Unified Parkinson’s Disease Rating Scale-Motor Exam: Inter-rater reliability of advanced practice nurse and neurologist assessments

PubMed Central

Palmer, Janice L.; Coats, Mary A.; Roe, Catherine M.; Hanko, Shelly M.; Xiong, Chengjie; Morris, John C.

2010-01-01

Aim This paper is a report of a study to establish the inter-rater reliability of advanced practice nurse and neurologist neurological assessments which included ratings with the Unified Parkinson’s Disease Rating Scale-Motor Exam. Background Around the world, advanced practice nurses are performing tasks once completed by only physicians. To promote consumer and provider confidence, it is important to establish that nurse and physician ratings using assessment tools are similar. In addition in research settings, when different raters are used, establishment of inter-rater reliability for study assessments is needed. Method Advanced practice nurses and neurologists independently recorded findings on neurological examinations of 46 participants in a study conducted between August 2007 and January 2008. An intraclass correlation coefficient was calculated to estimate overall agreement between the nurse and neurologist ratings. Agreement for individual items measured on a dichotomous scale was assessed by calculating Cohen’s kappa. Results There was substantial agreement between advanced practice nurses and neurologists on the mean Unified Parkinson’s Disease Rating Scale-Motor Exam ratings (intraclass correlation coefficient = 0.65) and the U.S. National Alzheimer’s Coordinating Center Uniform Data Set neurological examination ratings of unremarkable findings (kappa = 0.74) and of gait disorder (kappa = 0.73). Moderate agreement (kappa = 0.53) was reached for the rating of whether all Unified Parkinson’s Disease Rating Scale-Motor Exam items were normal. Conclusion These findings are consistent with studies of the inter-rater agreement of the Unified Parkinson’s Disease Rating Scale-Motor Exam and support the conduct of neurological assessments by advanced practice nurses. PMID:20546368

Comparison of Sleep Latency and Number of SOREMPs in the Home and Hospital With a Modified Multiple Sleep Latency Test: A Randomized Crossover Study.

PubMed

Beiske, Kornelia K; Sand, Trond; Rugland, Eyvind; Stavem, Knut

2017-05-01

Comparison of mean sleep latencies and number of sleep-onset rapid eye movement periods (SOREMPs) between modified multiple sleep latency test (MSLT) performed in the unattended home and in-hospital laboratory setting. A randomized crossover single-blinded design. Thirty-four subjects referred to MSLT for suspected hypersomnia or narcolepsy were included. Participants were randomized to perform modified MSLT in the unattended home or in the hospital first. Scores in the two settings were compared using Wilcoxon signed-rank test or exact McNemar test. Agreement between home and hospital categorized mean sleep latency and number of SOREMPs was assessed using simple kappa (κ) and proportion agreement. Agreement between home and hospital mean sleep latency was assessed using a Bland-Altman plot and an intraclass correlation coefficient. There was no difference between home and hospital assessment of mean sleep latency (P = 0.86). Two or more SOREMPs were found more frequently on modified MSLTs performed at home compared with those at the hospital (7 and 2, respectively; P = 0.025). Agreement was moderate for categorized sleep latency (κ = 0.53) and fair for categorized SOREMPs (κ = 0.39) in the 2 settings. Analysis of mean sleep latency using intraclass correlation coefficient showed a very good agreement between the two settings. Group mean sleep latency for home modified MSLTs seems to be reliable compared with that for the attended sleep-laboratory setting. Higher rate of SOREMP in the unattended home suggests that napping in a familiar environment facilitates the transition into REM sleep. Further studies are needed to assess the normal limit, sensitivity, and specificity for SOREMP at home before the clinical utility of home-based napping can be determined.

Reliability of intensive care unit admitting and comorbid diagnoses, race, elements of Acute Physiology and Chronic Health Evaluation II score, and predicted probability of mortality in an electronic intensive care unit database.

PubMed

Wenner, Joshua B; Norena, Monica; Khan, Nadia; Palepu, Anita; Ayas, Najib T; Wong, Hubert; Dodek, Peter M

2009-09-01

Although reliability of severity of illness and predicted probability of hospital mortality have been assessed, interrater reliability of the abstraction of primary and other intensive care unit (ICU) admitting diagnoses and underlying comorbidities has not been studied. Patient data from one ICU were originally abstracted and entered into an electronic database by an ICU nurse. A research assistant reabstracted patient demographics, ICU admitting diagnoses and underlying comorbidities, and elements of Acute Physiology and Chronic Health Evaluation II (APACHE II) score from 100 random patients of 474 admitted during 2005 using an identical electronic database. Chamberlain's percent positive agreement was used to compare diagnoses and comorbidities between the 2 data abstractors. A kappa statistic was calculated for demographic variables, Glasgow Coma Score, APACHE II chronic health points, and HIV status. Intraclass correlation was calculated for acute physiology points and predicted probability of hospital mortality. Percent positive agreement for ICU primary and other admitting diagnoses ranged from 0% (primary brain injury) to 71% (sepsis), and for underlying comorbidities, from 40% (coronary artery bypass graft) to 100% (HIV). Agreement as measured by kappa statistic was strong for race (0.81) and age points (0.95), moderate for chronic health points (0.50) and HIV (0.66), and poor for Glasgow Coma Score (0.36). Intraclass correlation showed a moderate-high agreement for acute physiology points (0.88) and predicted probability of hospital mortality (0.71). Reliability for ICU diagnoses and elements of the APACHE II score is related to the objectivity of primary data in the medical charts.

Reliability of scoring arousals in normal children and children with obstructive sleep apnea syndrome.

PubMed

Wong, Tat Kong; Galster, Patricia; Lau, Tai Shing; Lutz, Janita M; Marcus, Carole L

2004-09-15

Scoring of arousals in children is based on an extension of adult criteria, as defined by the American Sleep Disorders Association (ASDA). By this, a minimum duration of 3 seconds is required. A few recent studies utilized modified criteria for the study of children, with durations as short as 1 second. However, the validity and reliability of scoring these shorter arousals have never been verified. Based on studies in adults, we hypothesized that interscorer agreement for scoring arousals shorter than 3 seconds was poor. Retrospective review of polysomnograms by 2 experienced sleep practitioners who independently scored arousals according to the ASDA 3-second criteria and modified duration criteria of 1 and 2 seconds. Academic hospital. 20 polysomnographic studies from children aged 3 to 8 years with mild to severe obstructive sleep apnea syndrome, and 16 polysomnographic studies from normal children. None. The intraclass correlation coefficient for scoring ASDA arousals was 0.90 (95% confidence interval: 0.81-0.95), indicating excellent interscorer agreement. The intraclass correlation coefficient for scoring modified 1-second and 2-second arousals were 0.35 (95% confidence interval: 0.02-0.61) and 0.42 (95% confidence interval: 0.12-0.65) respectively, indicating poor to fair interscorer agreement. Furthermore, modified 1-second and 2-second arousals accounted for less than 15% of all arousals scored. We conclude that there is much poorer interscorer agreement for scoring arousals shorter than 3 seconds, when compared to the standard ASDA criteria. We propose that scoring of arousals in children should follow the standard ASDA criteria.

Interobserver agreement on the echocardiographic parameters that estimate right ventricular systolic function in the early postoperative period of cardiac surgery.

PubMed

Olmos-Temois, S G; Santos-Martínez, L E; Álvarez-Álvarez, R; Gutiérrez-Delgado, L G; Baranda-Tovar, F M

2016-11-01

To know the variability of transthoracic echocardiographic parameters that assess right ventricular systolic function by analyzing interobserver agreement in the early postoperative period of cardiovascular surgery. To assess the feasibility of these echocardiographic measurements. A cross-sectional study, double-blind pilot study was carried out from May 2011 to February 2013. Cardiovascular postoperative critical care at the National Institute of Cardiology "Ignacio Chávez", Mexico City, Mexico. Consecutive, non-probabilistic sampling. Fifty-six patients were studied in the postoperative period of cardiac surgery. The first echocardiographic parameters were obtained between 6-8hours after cardiac surgery, followed by blinded second measurements. Tricuspid annular plane systolic excursion (TAPSE), tricuspid annular peak systolic velocity on tissue Doppler imaging (VSPAT), diameters and right ventricular outflow area, tract fractional shortening. The agreement was analyzed by the Bland-Altman method, and its magnitude was assessed by the intraclass correlation coefficient (95% confidence interval). Both observers evaluated TAPSE and VSPAT in 48 patients (92%). The average TAPSE was 11.68±4.53mm (range 4-27mm). Right ventricular systolic dysfunction was observed in 41 cases (85%) and normal TAPSE in 7 patients (15%). The average difference and its limits according to TAPSE were -0.917±2.95 (-6.821, 4.988), with a magnitude of 0.725 (0.552, 0.837); the tricuspid annular peak systolic velocity on tissue Doppler imaging was -0.001±0.015 (-0.031, 0.030), and its magnitude 0.825 (0.708, 0.898), respectively. VSPAT and TAPSE were estimated by both observers in 92% of the patients, these parameters exhibiting the lowest interobserver variability. Copyright © 2016 Elsevier España, S.L.U. y SEMICYUC. All rights reserved.

Transcultural adaptation and psychometric properties of Spanish version of Pregnancy Physical Activity Questionnaire: the PregnActive project.

PubMed

Oviedo-Caro, Miguel Ángel; Bueno-Antequera, Javier; Munguía-Izquierdo, Diego

2018-03-19

To transculturally adapt the Spanish version of Pregnancy Physical Activity Questionnaire (PPAQ) analyzing its psychometric properties. The PPAQ was transculturally adapted into Spanish. Test-retest reliability was evaluated in a subsample of 109 pregnant women. The validity was evaluated in a sample of 208 pregnant women who answered the questionnaire and wore the multi-sensor monitor for 7 valid days. The reliability (intraclass correlation coefficient), concordance (concordance correlation coefficient), correlation (Pearson correlation coefficient), agreement (Bland-Altman plots) and relative activity levels (Jonckheere-Terpstra test) between both administrations and methods were examined. Intraclass correlation coefficients between both administrations were good for all categories except transportation. A low but significant correlation was found for total activity (light and above) whereas no correlation was found for other intensities between both methods. Relative activity levels analysis showed a significant linear trend for increased total activity between both methods. Spanish version of PPAQ is a brief and easily interpretable questionnaire with good reliability and ability to rank individuals, and poor validity compared with multi-sensor monitor. The use of PPAQ provides information of pregnancy-specific activities in order to establish physical activity levels of pregnant women and adapt health promotion interventions. Copyright © 2018 SESPAS. Publicado por Elsevier España, S.L.U. All rights reserved.

Concurrent Validity Between Live and Home Video Observations Using the Alberta Infant Motor Scale.

PubMed

Boonzaaijer, Marike; van Dam, Ellen; van Haastert, Ingrid C; Nuysink, Jacqueline

2017-04-01

Serial assessment of gross motor development of infants at risk is an established procedure in neonatal follow-up clinics. Assessments based on home video recordings could be a relevant addition. In 48 infants (1.5-19 months), the concurrent validity of 2 applications was examined using the Alberta Infant Motor Scale: (1) a home video made by parents and (2) simultaneous observation on-site by a pediatric physical therapist. Parents' experiences were explored using a questionnaire. The intraclass correlation coefficient agreement between live and home video assessment was 0.99, with a standard error of measurement of 1.41 items. Intra- and interrater reliability: intraclass correlation coefficients were more than 0.99. According to 94% of the parents, recording their infant's movement repertoire was easy to perform. Assessing the Alberta Infant Motor Scale based on home video recordings is comparable to assessment by live observation. The video method is a promising application that can be used with low burden for parents and infants.

Influence of cone-beam computed tomography image artifacts on the determination of dental arch measurements.

PubMed

Gamba, Thiago O; Oliveira, Matheus L; Flores, Isadora L; Cruz, Adriana D; Almeida, Solange M; Haiter-Neto, Francisco; Lopes, Sérgio L P C

2014-03-01

To compare dental plaster model (DPM) and cone-beam computed tomography (CBCT) in the measurement of the dental arches, and investigate whether CBCT image artifacts compromise the reliability of such measurements. Twenty patients were divided into two groups based on the presence or absence of metallic restorations in the posterior teeth. Both dental arches of the patients were scanned with the CBCT unit i-CAT, and DPMs were obtained. Two examiners obtained eight arch measurements on the CBCT images and DPMs and repeated this procedure 15 days later. The arch measurements of each patient group were compared separately by the Wilcoxon rank sum (Mann-Whitney U) test, with a significance level of 5% (α  =  .05). Intraclass correlation measured the level of intraobserver agreement. Patients with healthy teeth showed no significant difference between all DPM and CBCT arch measurements (P > .05). Patients with metallic restoration showed significant difference between DPM and CBCT for the majority of the arch measurements (P > .05). The two examiners showed excellent intraobserver agreement for both measuring methods with intraclass correlation coefficient higher than 0.95. CBCT provided the same accuracy as DPM in the measurement of the dental arches, and was negatively influenced by the presence of image artifacts.

Development and reliability testing of a food store observation form.

PubMed

Rimkus, Leah; Powell, Lisa M; Zenk, Shannon N; Han, Euna; Ohri-Vachaspati, Punam; Pugach, Oksana; Barker, Dianne C; Resnick, Elissa A; Quinn, Christopher M; Myllyluoma, Jaana; Chaloupka, Frank J

2013-01-01

To develop a reliable food store observational data collection instrument to be used for measuring product availability, pricing, and promotion. Observational data collection. A total of 120 food stores (26 supermarkets, 34 grocery stores, 54 gas/convenience stores, and 6 mass merchandise stores) in the Chicago metropolitan statistical area. Inter-rater reliability for product availability, pricing, and promotion measures on a food store observational data collection instrument. Cohen's kappa coefficient and proportion of overall agreement for dichotomous variables and intra-class correlation coefficient for continuous variables. Inter-rater reliability, as measured by average kappa coefficient, was 0.84 for food and beverage product availability measures, 0.80 for interior store characteristics, and 0.70 for exterior store characteristics. For continuous measures, average intra-class correlation coefficient was 0.82 for product pricing measures; 0.90 for counts of fresh, frozen, and canned fruit and vegetable options; and 0.85 for counts of advertisements on the store exterior and property. The vast majority of measures demonstrated substantial or almost perfect agreement. Although some items may require revision, results suggest that the instrument may be used to reliably measure the food store environment. Copyright © 2013 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Improved estimation of subject-level functional connectivity using full and partial correlation with empirical Bayes shrinkage.

PubMed

Mejia, Amanda F; Nebel, Mary Beth; Barber, Anita D; Choe, Ann S; Pekar, James J; Caffo, Brian S; Lindquist, Martin A

2018-05-15

Reliability of subject-level resting-state functional connectivity (FC) is determined in part by the statistical techniques employed in its estimation. Methods that pool information across subjects to inform estimation of subject-level effects (e.g., Bayesian approaches) have been shown to enhance reliability of subject-level FC. However, fully Bayesian approaches are computationally demanding, while empirical Bayesian approaches typically rely on using repeated measures to estimate the variance components in the model. Here, we avoid the need for repeated measures by proposing a novel measurement error model for FC describing the different sources of variance and error, which we use to perform empirical Bayes shrinkage of subject-level FC towards the group average. In addition, since the traditional intra-class correlation coefficient (ICC) is inappropriate for biased estimates, we propose a new reliability measure denoted the mean squared error intra-class correlation coefficient (ICC MSE ) to properly assess the reliability of the resulting (biased) estimates. We apply the proposed techniques to test-retest resting-state fMRI data on 461 subjects from the Human Connectome Project to estimate connectivity between 100 regions identified through independent components analysis (ICA). We consider both correlation and partial correlation as the measure of FC and assess the benefit of shrinkage for each measure, as well as the effects of scan duration. We find that shrinkage estimates of subject-level FC exhibit substantially greater reliability than traditional estimates across various scan durations, even for the most reliable connections and regardless of connectivity measure. Additionally, we find partial correlation reliability to be highly sensitive to the choice of penalty term, and to be generally worse than that of full correlations except for certain connections and a narrow range of penalty values. This suggests that the penalty needs to be chosen carefully

Estimation of rank correlation for clustered data.

PubMed

Rosner, Bernard; Glynn, Robert J

2017-06-30

It is well known that the sample correlation coefficient (R xy ) is the maximum likelihood estimator of the Pearson correlation (ρ xy ) for independent and identically distributed (i.i.d.) bivariate normal data. However, this is not true for ophthalmologic data where X (e.g., visual acuity) and Y (e.g., visual field) are available for each eye and there is positive intraclass correlation for both X and Y in fellow eyes. In this paper, we provide a regression-based approach for obtaining the maximum likelihood estimator of ρ xy for clustered data, which can be implemented using standard mixed effects model software. This method is also extended to allow for estimation of partial correlation by controlling both X and Y for a vector U_ of other covariates. In addition, these methods can be extended to allow for estimation of rank correlation for clustered data by (i) converting ranks of both X and Y to the probit scale, (ii) estimating the Pearson correlation between probit scores for X and Y, and (iii) using the relationship between Pearson and rank correlation for bivariate normally distributed data. The validity of the methods in finite-sized samples is supported by simulation studies. Finally, two examples from ophthalmology and analgesic abuse are used to illustrate the methods. Copyright © 2017 John Wiley & Sons, Ltd. Copyright © 2017 John Wiley & Sons, Ltd.

Comparison of Central Corneal Thickness Measured by Standard Ultrasound Pachymetry, Corneal Topography, Tono-Pachymetry and Anterior Segment Optical Coherence Tomography.

PubMed

González-Pérez, Javier; Queiruga Piñeiro, Juan; Sánchez García, Ángelx; González Méijome, José Manuel

2018-04-10

To compare central corneal thickness (CCT) measured by standard ultrasound pachymetry (USP), and three non-contact devices in healthy eyes. A cross-sectional study of CCT measurement in 52 eyes of 52 healthy volunteers was done by a single examiner at Ocular Surface and Contact Lens Laboratory. Three consecutive measurements were done by standard USP, non-contact tono-pachymeter, Pentacam corneal topographer, and Anterior Segment Optical Coherence Tomography (AS-OCT). The mean values were used for assessment. The results were compared using multivariate ANOVA, linear regression, and Pearson correlation. Agreement among the devices was analyzed using mean differences and Bland-Altman analysis with 95% limits of agreement (LoA). Finally, reliability was analyzed using intraclass correlation coefficient (ICC). Mean CCT by ultrasound pachymeter, tono-pachymeter, corneal topographer and AS-OCT were 558.9 ± 31.2 µm, 525.8 ± 43.1 µm, 550.4 ± 30.5 µm, and 545.9 ± 30.5 µm respectively. There was a significant positive correlation between AS-OCT and USP (Pearson correlation = 0.957, p < 0.001), corneal topography and USP (Pearson correlation = 0.965, p < 0.001), and corneal topography and AS-OCT (Pearson correlation = 0.965, p < 0.001). There was a lower correlation between CT-1P tono-pachymeter and the other three modalities. Intraclass correlation coefficients show an excellent reliability between pairs except for CT-1P against the other three instruments that were found moderate. CT-1P tono-pachymeter underestimates CCT measurements compared to Scheimpflug system, AS-OCT device, and USP. Mean CCT among USP, Pentacam and AS-OCT were comparable and had significant linear correlations. In clinical practice, these three modalities could be interchangeable in healthy patients.

68Ga-DOTATATE PET/CT interobserver agreement for neuroendocrine tumor assessments: results from a prospective study on 50 patients

PubMed Central

Fendler, Wolfgang Peter; Barrio, Martin; Spick, Claudio; Allen-Auerbach, Martin; Ambrosini, Valentina; Benz, Matthias; Bluemel, Christina; Grewal, Ravinder Kaur; Lapa, Constantin; Miederer, Matthias; Nicolas, Guillaume; Schuster, Tibor; Czernin, Johannes; Herrmann, Ken

2016-01-01

We evaluated the observer agreement for 68Ga-DOTATATE PET/CT study interpretations in patients with neuroendocrine tumors (NET). Methods 68Ga-DOTATATE PET/CT was performed in 50 patients with known or suspected NET of the small bowel (n = 19), pancreas (n = 14), lung (n = 4) or other location (n = 13). Images were reviewed by seven observers who used a standardized approach for image interpretation. Observers were classified as having low (<500 scans or <5 years experience with 68Ga-DOTATATE PET/CT; n = 4) or high level of experience (≥500 scans and ≥5 years experience with 68Ga-DOTATATE PET/CT; n = 3). Interpretation by the primary nuclear medicine physician un-blinded to all clinical and imaging data served as reference standard. Interobserver agreement was determined by Cohen's κ and intraclass correlation coefficient (ICC) with corresponding 95% confidence interval (CI). Results Interobserver agreement was substantial and the median number of false findings (FF) was low for the overall scan result; i.e. positive versus negative study (κ = 0.80, 95%CI 0.74–0.86; FF = 3), organ involvement (κ = 0.70, 95%CI 0.64–0.76; FF = 5), and lymph node involvement (κ = 0.71, 95%CI 0.65–0.78; FF = 6). The interobserver agreement was substantial to almost-perfect and the average absolute difference (Δ) to the reference reader was low for number of organ and lymph node metastases (ICC = 0.84, 95%CI 0.77–0.89, Δ = 0.45 and ICC = 0.77, 95%CI 0.69–0.84, Δ = 0.45), tumor SUVmax (ICC = 0.99, 95%CI 0.97–0.99; Δ = 0.44) and reference SUV (SUVmean spleen: ICC = 0.81, Δ = 1.10; SUVmax liver ICC = 0.79, Δ = 0.62). Interpretations of the appropriateness for peptide-receptor radionuclide therapy (PRRT) varied more significantly among observers (κ = 0.64, 95%CI 0.57–0.70) and a higher frequency of false positive recommendations for PRRT occurred in observers with low versus high levels of experience (range, 7–12 versus 4–8). Conclusion The interpretation of

Intertester agreement in refractive error measurements.

PubMed

Huang, Jiayan; Maguire, Maureen G; Ciner, Elise; Kulp, Marjean T; Quinn, Graham E; Orel-Bixler, Deborah; Cyert, Lynn A; Moore, Bruce; Ying, Gui-Shuang

2013-10-01

To determine the intertester agreement of refractive error measurements between lay and nurse screeners using the Retinomax Autorefractor and the SureSight Vision Screener. Trained lay and nurse screeners measured refractive error in 1452 preschoolers (3 to 5 years old) using the Retinomax and the SureSight in a random order for screeners and instruments. Intertester agreement between lay and nurse screeners was assessed for sphere, cylinder, and spherical equivalent (SE) using the mean difference and the 95% limits of agreement. The mean intertester difference (lay minus nurse) was compared between groups defined based on the child's age, cycloplegic refractive error, and the reading's confidence number using analysis of variance. The limits of agreement were compared between groups using the Brown-Forsythe test. Intereye correlation was accounted for in all analyses. The mean intertester differences (95% limits of agreement) were -0.04 (-1.63, 1.54) diopter (D) sphere, 0.00 (-0.52, 0.51) D cylinder, and -0.04 (1.65, 1.56) D SE for the Retinomax and 0.05 (-1.48, 1.58) D sphere, 0.01 (-0.58, 0.60) D cylinder, and 0.06 (-1.45, 1.57) D SE for the SureSight. For either instrument, the mean intertester differences in sphere and SE did not differ by the child's age, cycloplegic refractive error, or the reading's confidence number. However, for both instruments, the limits of agreement were wider when eyes had significant refractive error or the reading's confidence number was below the manufacturer's recommended value. Among Head Start preschool children, trained lay and nurse screeners agree well in measuring refractive error using the Retinomax or the SureSight. Both instruments had similar intertester agreement in refractive error measurements independent of the child's age. Significant refractive error and a reading with low confidence number were associated with worse intertester agreement.

I did eat my vegetables. Agreement between parent and child food intake diaries.

PubMed

Rangelov, Natalie; Suggs, L Suzanne; Marques-Vidal, Pedro

2016-12-01

To assess the level of agreement between children and their parents when reporting a child's food consumption. Cross-sectional study in which children and parents independently completed 7 d food diaries describing the foods and drinks the child consumed at every meal and snack. The association between child and parent reporting was assessed for nineteen food groups using Kendall's tau-b non-parametric correlations, Spearman's rank correlations, kappa coefficients and Lin's concordance measure of agreement. Results were also stratified by gender of the child and his/her grade at school. Households in Ticino, Switzerland, April-June 2014. Two hundred and ninety-nine children aged 6-12 years and one of their parents participated, with 264 providing complete data (35 % completion rate). Results showed a high level of agreement between child and parent reporting. Spearman correlations ranged from 0·55 (sauces) and 0·57 (fatty meat) to 0·80 (fruit), 0·83 (starchy foods) and 0·84 (pastries). All nineteen Spearman correlations were significant at the 0·001 level. Kendall's tau-b correlations ranged from 0·44 (fat meat) to 0·81 (puff pastry). Kappa values showed low to high levels of agreement, ranging from 0·15 (sweets) to 0·77 (puff pastry). Lin's concordance correlation coefficients ranged from 0·39 (whole grains) to 0·86 (puff pastry). When assessing the eating behaviour of children using a 7 d food diary, children's reports might be as reliable as their parents'.

Clinical applications of correlational vestibular autorotation test.

PubMed

Hsieh, Li-Chun; Lin, Te-Ming; Chang, Yu-Min; Kuo, Terry B J; Lee, Gho-She

2015-06-01

The correlational vestibular autorotation test (VAT) system has the advantages of good test-retest reliability and calibrations of absolute degrees of eye movement are unnecessary when acquiring a cross correlation coefficient (CCC). The approach is able to efficiently detect peripheral vestibulopathies. A VAT has some drawbacks including poor test-retest reliability and slippage of sensor. This study aimed to develop a correlational VAT system and to evaluate the reliability and applicability of this system. Twenty healthy participants and 10 vertiginous patients were enrolled. Vertical and horizontal autorotations from 0 to 3 Hz with either closed or open eyes were performed. A small sensor and a wireless transmission technique were used to acquire the electro-ocular graph and head velocity signals. The two signals were analyzed using CCCs to assess the functioning of the vestibular ocular reflex (VOR). The results showed a significantly greater CCC for open-eye versus closed-eye of head autorotations. The CCCs also increased significantly with head rotational frequencies. Moreover, the CCCs significantly correlated with the VOR gains at autorotation frequencies ≥1.0 Hz. The test-retest reliability was good (intraclass correlation coefficients ≥0.85). The vertiginous participants had significantly lower individual CCCs and overall average CCC than age- and-gender matched controls.

Exploiting Attribute Correlations: A Novel Trace Lasso-Based Weakly Supervised Dictionary Learning Method.

PubMed

Wu, Lin; Wang, Yang; Pan, Shirui

2017-12-01

It is now well established that sparse representation models are working effectively for many visual recognition tasks, and have pushed forward the success of dictionary learning therein. Recent studies over dictionary learning focus on learning discriminative atoms instead of purely reconstructive ones. However, the existence of intraclass diversities (i.e., data objects within the same category but exhibit large visual dissimilarities), and interclass similarities (i.e., data objects from distinct classes but share much visual similarities), makes it challenging to learn effective recognition models. To this end, a large number of labeled data objects are required to learn models which can effectively characterize these subtle differences. However, labeled data objects are always limited to access, committing it difficult to learn a monolithic dictionary that can be discriminative enough. To address the above limitations, in this paper, we propose a weakly-supervised dictionary learning method to automatically learn a discriminative dictionary by fully exploiting visual attribute correlations rather than label priors. In particular, the intrinsic attribute correlations are deployed as a critical cue to guide the process of object categorization, and then a set of subdictionaries are jointly learned with respect to each category. The resulting dictionary is highly discriminative and leads to intraclass diversity aware sparse representations. Extensive experiments on image classification and object recognition are conducted to show the effectiveness of our approach.

Conformity of pre-gestational weight measurement and agreement of anthropometric data reported by pregnant women and those recorded in prenatal cards, City of Rio de Janeiro, 2007-2008.

PubMed

Niquini, Roberta Pereira; Bittencourt, Sonia Azevedo; Leal, Maria do Carmo

2013-09-01

To assess the conformity of the weight measurement process in the pre-gestational care offered in the city of Rio de Janeiro by primary units and hospitals of the National Health System, as well as to verify the agreement between the anthropometric data reported by pregnant women and those recorded in prenatal cards. A cross-sectional study was conducted in 2007 - 2008 with two cluster samples: one to obtain a sample of pregnant women to be interviewed and another one for the weight measurement procedures to be observed. The conformity of the weight measurement process was evaluated according to the Ministry of Health standards, and the agreement between the two sources of anthropometric data was evaluated using mean differences, Bland-Altman method, intraclass correlation coefficient (ICC) and weighted Kappa. Out of the twelve criteria for weight measurement evaluation (n = 159 observations), three weren't in conformity (< 50% of conformity), two of them only need to be assessed when the scale is mechanical. For the interviewed pregnant women (n = 2,148), who had the two sources of anthropometric data, there was a tendency of self-reported height overestimation and pre-gestational and current weight and Body Mass Index underestimation. Accordance between the two sources of anthropometric information, according to ICC and weighted Kappa, were high (> 0.80). Studies may use weight and height information reported by pregnant women, in the absence of prenatal cards records, when it is an important economy to their execution, although the improvement of these two sources of information by means of better anthropometric process is necessary.

The Stayhealthy bioelectrical impedance analyzer predicts body fat in children and adults.

PubMed

Erceg, David N; Dieli-Conwright, Christina M; Rossuello, Amerigo E; Jensky, Nicole E; Sun, Stephanie; Schroeder, E Todd

2010-05-01

Bioelectrical impedance analysis (BIA) is a time-efficient and cost-effective method for estimating body composition. We hypothesized that there would be no significant difference between the Stayhealthy BC1 BIA and the selected reference methods when determining body composition. Thus, the purpose of the present study was to determine the validity of estimating percent body fat (%BF) using the Stayhealthy BIA with its most recently updated algorithms compared to the reference methods of dual-energy x-ray absorptiometry for adults and hydrostatic weighing for children. We measured %BF in 245 adults aged 18 to 80 years and 115 children aged 10 to 17 years. Body fat by BIA was determined using a single 50 kHz frequency handheld impedance device and proprietary software. Agreement between BIA and reference methods was assessed by Bland and Altman plots. Bland and Altman analysis for men, women, and children revealed good agreement between the reference methods and BIA. There was no significant difference by t tests between mean %BF by BIA for men, women, or children when compared to the respective reference method. Significant correlation values between BIA, and reference methods for all men, women, and children were 0.85, 0.88, and 0.79, respectively. Reliability (test-retest) was assessed by intraclass correlation coefficient and coefficient of variation. Intraclass correlation coefficient values were greater than 0.99 (P < .001) for men, women, and children with coefficient of variation values 3.3%, 1.8%, and 1.7%, respectively. The Stayhealthy BIA device demonstrated good agreement between reference methods using Bland and Altman analyses. Copyright 2010 Elsevier Inc. All rights reserved.

Using alternative or direct anthropometric measurements to assess risk for malnutrition in nursing homes.

PubMed

Lorini, Chiara; Collini, Francesca; Castagnoli, Mariangela; Di Bari, Mauro; Cavallini, Maria Chiara; Zaffarana, Nicoletta; Pepe, Pasquale; Lucenteforte, Ersilia; Vannacci, Alfredo; Bonaccorsi, Guglielmo

2014-10-01

The aim of this study was to use the Malnutrition Universal Screening Tool (MUST) to assess the applicability of alternative versus direct anthropometric measurements for evaluating the risk for malnutrition in older individuals living in nursing homes (NHs). We conducted a cross-sectional survey in 67 NHs in Tuscany, Italy. We measured the weight, standing height (SH), knee height (KH), ulna length (UL), and middle-upper-arm circumference of 641 NH residents. Correlations between the different methods for calculating body mass index (BMI; using direct or alternative measurements) were evaluated by the intraclass correlation coefficient and the Bland-Altman method; agreement in the allocation of participants to the same risk category was assessed by squared weighted kappa statistic and indicators of internal relative validity. The intraclass correlation coefficient for BMI calculated using KH was 0.839 (0.815-0.861), whereas those calculated by UL were 0.890 (0.872-0.905). The limits of agreement were ±6.13 kg/m(2) using KH and ±4.66 kg/m(2) using UL. For BMI calculated using SH, 79.9% of the patients were at low risk, 8.1% at medium risk, and 12.2% at high risk for malnutrition. The agreement between this classification and that obtained using BMI calculated by alternative measurements was "fair-good." When it is not possible to determine risk category by using SH, we suggest using the alternative measurements (primarily UL, due to its highest sensitivity) to predict the height and to compare these evaluations with those obtained by using middle-upper-arm-circumference to predict the BMI. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

Intersibling agreement for Goldberg's big five adjective markers.

PubMed

Lanthier, R P

2000-04-01

In a sample of 240 college students intersibling agreement was examined for Goldberg's 100 unipolar Big Five adjective markers. Participants showed self-enhancement by rating themselves more favorably on three of the five traits (Agreeableness, Conscientiousness, and Culture/Intellect); however, self-ratings on Neuroticism were higher than siblings' ratings. Correlations among raters were moderate (mean r = .41) and comparable to values obtained in studies using peer ratings. The type of the sibling relationship, based on ratings of relationship quality, moderated the rank-order measures but not the mean agreement.

Agreement and clinical comparison between a new swept-source optical coherence tomography-based optical biometer and an optical low-coherence reflectometry biometer

PubMed Central

Arriola-Villalobos, P; Almendral-Gómez, J; Garzón, N; Ruiz-Medrano, J; Fernández-Pérez, C; Martínez-de-la-Casa, J M; Díaz-Valle, D

2017-01-01

Purpose To compare measurements taken using a swept-source optical coherence tomography-based optical biometer (IOLmaster 700) and an optical low-coherence reflectometry biometer (Lenstar 900), and to determine the clinical impacts of differences in their measurements on intraocular lens (IOL) power predictions. Methods Eighty eyes of 80 patients scheduled to undergo cataract surgery were examined with both biometers. The measurements made using each device were axial length (AL), central corneal thickness (CCT), aqueous depth (AQD), lens thickness (LT), mean keratometry (MK), white-to-white distance (WTW), and pupil diameter (PD). Holladay 2 and SRK/T formulas were used to calculate IOL power. Differences in measurement between the two biometers were determined using the paired t-test. Agreement was assessed through intraclass correlation coefficients (ICC) and Bland–Altman plots. Results Mean patient age was 76.3±6.8 years (range 59–89). Using the Lenstar, AL and PD could not be measured in 12.5 and 5.25% of eyes, respectively, while IOLMaster 700 took all measurements in all eyes. The variables CCT, AQD, LT, and MK varied significantly between the two biometers. According to ICCs, correlation between measurements made with both devices was excellent except for WTW and PD. Using the SRK/T formula, IOL power prediction based on the data from the two devices were statistically different, but differences were not clinically significant. Conclusions No clinically relevant differences were detected between the biometers in terms of their measurements and IOL power predictions. Using the IOLMaster 700, it was easier to obtain biometric measurements in eyes with less transparent ocular media or longer AL. PMID:27834962

Test-Retest Reliability of the Salutogenic Wellness Promotion Scale (SWPS)

ERIC Educational Resources Information Center

Anderson, L. M.; Moore, J. B.; Hayden, B. M.; Becker, C. M.

2014-01-01

Objective: This study examined the temporal stability (i.e. test-retest reliability) of the Salutogenic Wellness Promotion Scale (SWPS) using intraclass correlation coefficients (ICC). Current intraclass results were also compared to previously published interclass correlations to support the use of the intraclass method for test-retest…

Reliable scar scoring system to assess photographs of burn patients.

PubMed

Mecott, Gabriel A; Finnerty, Celeste C; Herndon, David N; Al-Mousawi, Ahmed M; Branski, Ludwik K; Hegde, Sachin; Kraft, Robert; Williams, Felicia N; Maldonado, Susana A; Rivero, Haidy G; Rodriguez-Escobar, Noe; Jeschke, Marc G

2015-12-01

Several scar-scoring scales exist to clinically monitor burn scar development and maturation. Although scoring scars through direct clinical examination is ideal, scars must sometimes be scored from photographs. No scar scale currently exists for the latter purpose. We modified a previously described scar scale (Yeong et al., J Burn Care Rehabil 1997) and tested the reliability of this new scale in assessing burn scars from photographs. The new scale consisted of three parameters as follows: scar height, surface appearance, and color mismatch. Each parameter was assigned a score of 1 (best) to 4 (worst), generating a total score of 3-12. Five physicians with burns training scored 120 representative photographs using the original and modified scales. Reliability was analyzed using coefficient of agreement, Cronbach alpha, intraclass correlation coefficient, variance, and coefficient of variance. Analysis of variance was performed using the Kruskal-Wallis test. Color mismatch and scar height scores were validated by analyzing actual height and color differences. The intraclass correlation coefficient, the coefficient of agreement, and Cronbach alpha were higher for the modified scale than those of the original scale. The original scale produced more variance than that in the modified scale. Subanalysis demonstrated that, for all categories, the modified scale had greater correlation and reliability than the original scale. The correlation between color mismatch scores and actual color differences was 0.84 and between scar height scores and actual height was 0.81. The modified scar scale is a simple, reliable, and useful scale for evaluating photographs of burn patients. Copyright © 2015 Elsevier Inc. All rights reserved.

Validity of wearable activity monitors for tracking steps and estimating energy expenditure during a graded maximal treadmill test.

PubMed

Kendall, Bradley; Bellovary, Bryanne; Gothe, Neha P

2018-06-04

The purpose of this study was to assess the accuracy of energy expenditure (EE) estimation and step tracking abilities of six activity monitors (AMs) in relation to indirect calorimetry and hand counted steps and assess the accuracy of the AMs between high and low fit individuals in order to assess the impact of exercise intensity. Fifty participants wore the Basis watch, Fitbit Flex, Polar FT7, Jawbone, Omron pedometer, and Actigraph during a maximal graded treadmill test. Correlations, intra-class correlations, and t-tests determined accuracy and agreement between AMs and criterions. The results indicate that the Omron, Fitbit, and Actigraph were accurate for measuring steps while the Basis and Jawbone significantly underestimated steps. All AMs were significantly correlated with indirect calorimetry, however, no devices showed agreement (p < .05). When comparing low and high fit groups, correlations between AMs and indirect calorimetry improved for the low fit group, suggesting AMs may be better at measuring EE at lower intensity exercise.

Blinded evaluation of interrater reliability of an operative competency assessment tool for direct laryngoscopy and rigid bronchoscopy.

PubMed

Ishman, Stacey L; Benke, James R; Johnson, Kaalan Erik; Zur, Karen B; Jacobs, Ian N; Thorne, Marc C; Brown, David J; Lin, Sandra Y; Bhatti, Nasir; Deutsch, Ellen S

2012-10-01

OBJECTIVES To confirm interrater reliability using blinded evaluation of a skills-assessment instrument to assess the surgical performance of resident and fellow trainees performing pediatric direct laryngoscopy and rigid bronchoscopy in simulated models. DESIGN Prospective, paired, blinded observational validation study. SUBJECTS Paired observers from multiple institutions simultaneously evaluated residents and fellows who were performing surgery in an animal laboratory or using high-fidelity manikins. The evaluators had no previous affiliation with the residents and fellows and did not know their year of training. INTERVENTIONS One- and 2-page versions of an objective structured assessment of technical skills (OSATS) assessment instrument composed of global and a task-specific surgical items were used to evaluate surgical performance. RESULTS Fifty-two evaluations were completed by 17 attending evaluators. The instrument agreement for the 2-page assessment was 71.4% when measured as a binary variable (ie, competent vs not competent) (κ = 0.38; P = .08). Evaluation as a continuous variable revealed a 42.9% percentage agreement (κ = 0.18; P = .14). The intraclass correlation was 0.53, considered substantial/good interrater reliability (69% reliable). For the 1-page instrument, agreement was 77.4% when measured as a binary variable (κ = 0.53, P = .0015). Agreement when evaluated as a continuous measure was 71.0% (κ = 0.54, P < .001). The intraclass correlation was 0.73, considered high interrater reliability (85% reliable). CONCLUSIONS The OSATS assessment instrument is an effective tool for evaluating surgical performance among trainees with acceptable interrater reliability in a simulator setting. Reliability was good for both the 1- and 2-page OSATS checklists, and both serve as excellent tools to provide immediate formative feedback on operational competency.

High Familial Correlation in Methylphenidate Response and Side Effect Profile.

PubMed

Gazer-Snitovsky, Michal; Brand-Gothelf, Ayelet; Dubnov-Raz, Gal; Weizman, Abraham; Gothelf, Doron

2015-04-21

To examine whether a familial tendency exists in clinical response to methylphenidate. Nineteen pairs of siblings or parent-child stimulant-naive individuals with ADHD were prescribed methylphenidate-immediate release, and were comprehensively evaluated at baseline, Week 2, and Week 4, using the ADHD Rating Scale IV, Clinical Global Impression Scale, and the Barkley Side Effects Rating Scale. We found significant intraclass correlations in family member response to methylphenidate-immediate release and side effect profile, including emotional symptoms and loss of appetite and weight. Family history of response to methylphenidate should be taken into account when treating ADHD. © 2015 SAGE Publications.

Regional oxygen saturation index (rSO2) in brachioradialis and deltoid muscle. Correlation and prognosis in patients with respiratory sepsis.

PubMed

Rodríguez, A; Claverias, L; Marín, J; Magret, M; Rosich, S; Bodí, M; Trefler, S; Pascual, S; Gea, J

2015-03-01

To compare oxygen saturation index (rSO2) obtained simultaneously in two different brachial muscles. Prospective and observational study. Intensive care unit. Critically ill patients with community-acquired pneumonia. Two probes of NIRS device (INVOS 5100) were simultaneously placed on the brachioradialis (BR) and deltoid (D) muscles. rSO2 measurements were recorded at baseline (ICU admission) and at 24h. Demographic and clinical variables were registered. Pearson's correlation coefficient was used to assess the association between continuous variables. The consistency of the correlation was assessed using the intraclass correlation coefficient (ICC) and Bland-Altman plot. The predictive value of the rSO2 for mortality was calculated by ROC curve. Nineteen patients were included with an ICU mortality of 21.1%. The rSO2 values at baseline and at 24h were significantly higher in D than in BR muscle. Values obtained simultaneously in both limbs showed a strong correlation and adequate consistency: BR (r=0.95; p<0.001; ICC=0.94; 95% CI: 0.90-0.96; p<0.001), D (r=0.88; p=0.01; ICC=0.88; 95% CI: 0.80-0.90; p>0.001) but a wide limit of agreement. Non-survivors had rSO2 values significantly lower than survivors at all times of the study. No patient with rSO2 >60% in BR died, and only 17.6% died with an rSO2 value >60% in D. Both muscles showed consistent discriminatory power for mortality. Both BR and D muscles were appropriate for measuring rSO2. Copyright © 2013 Elsevier España, S.L.U. and SEMICYUC. All rights reserved.

Translation, cross-cultural adaptation and validation of the Bulgarian version of the Dizziness Handicap Inventory.

PubMed

Georgieva-Zhostova, Spaska; Kolev, Ognyan I; Stambolieva, Katerina

2014-09-01

The aim of the present study was the translation, cross-cultural adaptation and validation of the Dizziness Handicap Inventory in Bulgarian language (DHI-BG). Ninety-seven vestibular patients (19 men and 78 women, mean age 45.08 ± 13.85 years) took part in the investigation. All participants were asked to fill in the DHI-BG. Internal consistency was estimated using Cronbach's alpha and item-total correlation, reproducibility by calculating Bland-Altman's limits of agreement and intraclass correlation coefficients (ICCs). Associations were estimated by Spearman's correlation coefficients. The Cronbach's alpha for the total score, functional, physical and emotional subscales of DHI-BG were 0.88, 0.75, 0.72 and 0.81. The floor and ceiling effects of the DHI-BG total scale were evaluated with respect to the limits of agreement which were ±9.4-14.53 points. Intraclass correlation coefficients (ICCs) for all scale and subscales were higher than the recommended value of 0.75 and determined good test-retest reliability. The range of items correlation for DHI-BG was from 0.27 (item 12) to 0.72 (item 3). No significant differences were observed in the Cronbach's alpha coefficients between the DHI-BG and the original version, the German and Italian versions of the questionnaire. The most significant difference was observed in comparison with the German version of DHI. Construct validity presented a moderate correlation between Romberg coefficients and DHI-BG scores and strong correlation between all scores of DHI and the self-perceived disability. The results suggest that DHI-BG scores show a good discriminative validity between groups with different levels of self-assessed disability. The Bulgarian version of the DHI is a reliable and valid tool in assessing the impact of dizziness on the quality of life in Bulgarian vestibular patients.

Comparative measurement of collagen bundle orientation by Fourier analysis and semiquantitative evaluation: reliability and agreement in Masson's trichrome, Picrosirius red and confocal microscopy techniques.

PubMed

Marcos-Garcés, V; Harvat, M; Molina Aguilar, P; Ferrández Izquierdo, A; Ruiz-Saurí, A

2017-08-01

Measurement of collagen bundle orientation in histopathological samples is a widely used and useful technique in many research and clinical scenarios. Fourier analysis is the preferred method for performing this measurement, but the most appropriate staining and microscopy technique remains unclear. Some authors advocate the use of Haematoxylin-Eosin (H&E) and confocal microscopy, but there are no studies comparing this technique with other classical collagen stainings. In our study, 46 human skin samples were collected, processed for histological analysis and stained with Masson's trichrome, Picrosirius red and H&E. Five microphotographs of the reticular dermis were taken with a 200× magnification with light microscopy, polarized microscopy and confocal microscopy, respectively. Two independent observers measured collagen bundle orientation with semiautomated Fourier analysis with the Image-Pro Plus 7.0 software and three independent observers performed a semiquantitative evaluation of the same parameter. The average orientation for each case was calculated with the values of the five pictures. We analyzed the interrater reliability, the consistency between Fourier analysis and average semiquantitative evaluation and the consistency between measurements in Masson's trichrome, Picrosirius red and H&E-confocal. Statistical analysis for reliability and agreement was performed with the SPSS 22.0 software and consisted of intraclass correlation coefficient (ICC), Bland-Altman plots and limits of agreement and coefficient of variation. Interrater reliability was almost perfect (ICC > 0.8) with all three histological and microscopy techniques and always superior in Fourier analysis than in average semiquantitative evaluation. Measurements were consistent between Fourier analysis by one observer and average semiquantitative evaluation by three observers, with an almost perfect agreement with Masson's trichrome and Picrosirius red techniques (ICC > 0.8) and a strong

Inter-observer agreement improves with PERCIST 1.0 as opposed to qualitative evaluation in non-small cell lung cancer patients evaluated with F-18-FDG PET/CT early in the course of chemo-radiotherapy.

PubMed

Fledelius, Joan; Khalil, Azza; Hjorthaug, Karin; Frøkiær, Jørgen

2016-12-01

The purpose of this study is to determine whether a qualitative approach or a semi-quantitative approach provides the most robust method for early response evaluation with 2'-deoxy-2'-[(18)F]fluoro-D-glucose (F-18-FDG) positron emission tomography combined with whole body computed tomography (PET/CT) in non-small cell lung cancer (NSCLC). In this study eight Nuclear Medicine consultants analyzed F-18-FDG PET/CT scans from 35 patients with locally advanced NSCLC. Scans were performed at baseline and after 2 cycles of chemotherapy. Each observer used two different methods for evaluation: (1) PET response criteria in solid tumors (PERCIST) 1.0 and (2) a qualitative approach. Both methods allocate patients into one of four response categories (complete and partial metabolic response (CMR and PMR) and stable and progressive metabolic disease (SMD and PMD)). The inter-observer agreement was evaluated using Fleiss' kappa for multiple raters, Cohens kappa for comparison of the two methods, and intraclass correlation coefficients (ICC) for comparison of lean body mass corrected standardized uptake value (SUL) peak measurements. The agreement between observers when determining the percentage change in SULpeak was "almost perfect", with ICC = 0.959. There was a strong agreement among observers allocating patients to the different response categories with a Fleiss kappa of 0.76 (0.71-0.81). In 22 of the 35 patients, complete agreement was observed with PERCIST 1.0. The agreement was lower when using the qualitative method, moderate, having a Fleiss kappa of 0.60 (0.55-0.64). Complete agreement was achieved in only 10 of the 35 patients. The difference between the two methods was statistically significant (p < 0.005) (chi-squared). Comparing the two methods for each individual observer showed Cohen's kappa values ranging from 0.64 to 0.79, translating into a strong agreement between the two methods. PERCIST 1.0 provides a higher overall agreement between observers

12 CFR 133.5 - Related agreements considered a single agreement.

Code of Federal Regulations, 2012 CFR

2012-01-01

... agreement. 133.5 Section 133.5 Banks and Banking COMPTROLLER OF THE CURRENCY, DEPARTMENT OF THE TREASURY DISCLOSURE AND REPORTING OF CRA-RELATED AGREEMENTS § 133.5 Related agreements considered a single agreement... § 133.2 of this part. (a) Agreements entered into by same parties. All written agreements to which an...

Medical Evidence Influence on Inpatients and Nurses Pain Ratings Agreement

PubMed Central

Samolsky Dekel, Boaz Gedaliahu; Gori, Alberto; Vasarri, Alessio; Sorella, Maria Cristina; Di Nino, Gianfranco; Melotti, Rita Maria

2016-01-01

Biased pain evaluation due to automated heuristics driven by symptom uncertainty may undermine pain treatment; medical evidence moderators are thought to play a role in such circumstances. We explored, in this cross-sectional survey, the effect of such moderators (e.g., nurse awareness of patients' pain experience and treatment) on the agreement between n = 862 inpatients' self-reported pain and n = 115 nurses' pain ratings using a numerical rating scale. We assessed the mean of absolute difference, agreement (κ-statistics), and correlation (Spearman rank) of inpatients and nurses' pain ratings and analyzed congruence categories' (CCs: underestimation, congruence, and overestimation) proportions and dependence upon pain categories for each medical evidence moderator (χ 2 analysis). Pain ratings agreement and correlation were limited; the CCs proportions were further modulated by the studied moderators. Medical evidence promoted in nurses overestimation of low and underestimation of high inpatients' self-reported pain. Knowledge of the negative influence of automated heuristics driven by symptoms uncertainty and medical-evidence moderators on pain evaluation may render pain assessment more accurate. PMID:27445633

Agreement between the spatio-temporal gait parameters from treadmill-based photoelectric cell and the instrumented treadmill system in healthy young adults and stroke patients.

PubMed

Lee, Myungmo; Song, Changho; Lee, Kyoungjin; Shin, Doochul; Shin, Seungho

2014-07-14

Treadmill gait analysis was more advantageous than over-ground walking because it allowed continuous measurements of the gait parameters. The purpose of this study was to investigate the concurrent validity and the test-retest reliability of the OPTOGait photoelectric cell system against the treadmill-based gait analysis system by assessing spatio-temporal gait parameters. Twenty-six stroke patients and 18 healthy adults were asked to walk on the treadmill at their preferred speed. The concurrent validity was assessed by comparing data obtained from the 2 systems, and the test-retest reliability was determined by comparing data obtained from the 1st and the 2nd session of the OPTOGait system. The concurrent validity, identified by the intra-class correlation coefficients (ICC [2, 1]), coefficients of variation (CVME), and 95% limits of agreement (LOA) for the spatial-temporal gait parameters, were excellent but the temporal parameters expressed as a percentage of the gait cycle were poor. The test-retest reliability of the OPTOGait System, identified by ICC (3, 1), CVME, 95% LOA, standard error of measurement (SEM), and minimum detectable change (MDC95%) for the spatio-temporal gait parameters, was high. These findings indicated that the treadmill-based OPTOGait System had strong concurrent validity and test-retest reliability. This portable system could be useful for clinical assessments.

Correlation of rheumatoid arthritis activity indexes (Disease Activity Score 28 measured with ESR and CRP, Simplified Disease Activity Index and Clinical Disease Activity Index) and agreement of disease activity states with various cut-off points in a Northeastern Brazilian population.

PubMed

Medeiros, Marta Maria das Chagas; de Oliveira, Brenda Maria Gurgel Barreto; de Cerqueira, João Victor Medeiros; Quixadá, Raquel Telles de Souza; de Oliveira, Ídila Mont'Alverne Xavier

2015-01-01

The Disease Activity Score 28 (DAS28) and its versions have been used to measure rheumatoid arthritis (RA) activity, but there is no consensus about which one is the best. Determine the correlation among indexes (DAS28 ESR, DAS28 CRP, SDAI and CDAI) and evaluate agreement of activity strata using different cutoff points. Rheumatoid arthritis patients were cross-sectionally evaluated with data collection to calculate the DAS28 (ESR and CRP), SDAI and CDAI, using different cut-offs for defining remission, mild, moderate and high activity. Pearson correlations were calculated for continuous measures and agreement (kappa test) for the strata (remission, mild, moderate and high activity). Of 111 patients included, 108 were women, age 55.6 years, 11-year disease duration. DAS28 (ESR) was significantly higher than DAS28 (CRP) (4.0 vs. 3.5; p<0.001) and the values remained higher after stratification by age, gender, disease duration, rheumatoid factor and HAQ. Correlations among indexes ranged from 0.84 to 0.99, with better correlation between SDAI and CDAI. Agreements among activity strata ranged from 46.8% to 95.8%. DAS28 (CRP) with cut-off point for the remission of 2.3 underestimated disease activity by 45.8% compared with DAS28 (ESR). SDAI and CDAI showed agreement of 95.8%. The four indexes were associated with disease duration and HAQ. Although the activity indexes show good correlation, they show discrepancies in activity strata, thus requiring more researches to define a better index and better cutoff points. Copyright © 2015 Elsevier Editora Ltda. All rights reserved.

Multimodal Assessment of Corneal Thinning Using Optical Coherence Tomography, Scheimpflug Imaging, Pachymetry, and Slit-Lamp Examination.

PubMed

Oatts, Julius T; Keenan, Jeremy D; Mannis, Tova; Lietman, Tom M; Rose-Nussbaumer, Jennifer

2017-04-01

To assess the relationship between corneal thinning measured by clinician-graded slit-lamp examination compared with ultrasound pachymetry (USP), anterior segment optical coherence tomography (AS-OCT), and the Pentacam. Patients with corneal thinning underwent USP, AS-OCT, Pentacam measurements and standardized clinical grading by 2 cornea specialists estimating thinning on slit-lamp examination. Reproducibility of each testing modality was assessed using the intraclass correlation coefficient. Bland-Altman plots were used to determine precision and limits of agreement (LOA) between imaging modalities and clinical grading. We included 22 patients with corneal thinning secondary to infectious or inflammatory keratitis. Mean percent stromal thinning estimated by grader 1 was 51% (SD 31) and grader 2 was 49% (SD 33). The intraclass correlation coefficient between the masked examiners was 0.95 (95% confidence interval, 0.88-0.98). Graders were more similar to each other than to any other modality with 2% difference and 4.6% of measurements outside the LOA. When measuring the area of maximum thinning, AS-OCT measured approximately 10% thicker than human graders while the Pentacam measured approximately 10% thinner than human graders with 16.7% outside the LOA. USP measured approximately 20% thinner than human graders with 5.6% outside the LOA. Trained corneal specialists have a high degree of agreement in location and degree of corneal thinning when measured in a standardized fashion on the same day. Other testing modalities had acceptable reproducibility and agreement with clinical examination and each other, although Scheimpflug imaging fared worse for corneal thinning, particularly in the periphery, than the other modalities.

Autorefraction, Retinoscopy, Javal's Rule, and Grosvenor's Modified Javal's Rule: The Best Predictor of Refractive Astigmatism

PubMed Central

Asiedu, Kofi; Ampiah, Emmanuel Ekow

2016-01-01

The aim of the study was to determine the level of agreement between Javal's rule, autorefraction, retinoscopy, and refractive astigmatism and to determine which technique is the most suitable substitute when subjective refraction is not applicable using a clinical sample. A total of 36 subjects, 14 males and 22 females, were involved in this study. The intraclass correlation coefficients between subjective refraction, autorefraction, and retinoscopy were 0.895 and 0.989, respectively, for the spherical equivalent. The Bland-Altman 95% limits of agreement between subjective refraction and autorefraction; subjective refraction and retinoscopy; and autorefraction and retinoscopy were −2.84 to 3.58, −0.88 to 1.12, and −3.01 to 3.53, respectively, for the spherical equivalent. The intraclass correlation coefficients between spectacle total astigmatism and the following techniques were as follows: retinoscopy (0.85); autorefraction (0.92); Javal's rule (0.82); and Grosvenor et al. version (0.85). The Bland-Altman 95% limits of agreement between subjective refraction and autorefraction; subjective refraction and retinoscopy; subjective refraction and Javal's rule; and subjective refraction and Grosvenor et al. version were −0.87 to 1.25, −1.49 to 1.99, −0.73 to 1.93, and −0.89 to 1.7, respectively, for the total astigmatism. The study showed that autorefraction and Javal's rule may provide a starting point for subjective refraction cylinder power determination but only retinoscopy may satisfactorily replace subjective refraction total astigmatism when subjective refraction is not applicable. PMID:27803811

Refinement of the Interprofessional Socialization and Valuing Scale (ISVS-21) and Development of 9-Item Equivalent Versions.

PubMed

King, Gillian; Orchard, Carole; Khalili, Hossein; Avery, Lisa

2016-01-01

Measures of interprofessional (IP) socialization are needed to capture the role of interprofessional education in preparing students and health practitioners to function as part of IP health care teams. The aims of this study were to refine a previously published version of the Interprofessional Socialization and Valuing Scale (the ISVS-24) and create two shorter equivalent forms to be used in pre-post studies. A graded response model was used to identify ISVS items in a practitioner data set (n = 345), with validation (measure invariance) conducted using a separate student sample (n = 341). Analyses indicated a unidimensional 21-item version with excellent measurement properties, Cronbach alpha of 0.988, 95% confidence interval (CI) 0.985-0.991. There was evidence of measure invariance, as there was excellent agreement of the factor scores for the practitioner and student data, intraclass correlation coefficient = 0.993, 95% CI 0.991-0.994. This indicates that the ISVS-21 measures IP socialization consistently across groups. Two 9-item equivalent versions for pre-post use were developed, with excellent agreement between the two forms. The student score agreement for the two item sets was excellent: intraclass correlation coefficient = 0.970, 95% CI 0.963-0.976. The ISVS-21 is a refined measure to assess existing levels of IP socialization in practitioners and students, and relate IP socialization to other important constructs such as IP collaboration and the development of an IP identity. The equivalent versions can be used to assess change in IP socialization as a result of interprofessional education.

Agreement in the determination of preformed wire shape templates on plaster models and customized digital arch form diagrams on digital models.

PubMed

Camardella, Leonardo Tavares; Sá, Maiara da Silva Bezerra; Guimarães, Luciana Campos; Vilella, Beatriz de Souza; Vilella, Oswaldo de Vasconcellos

2018-03-01

The aim of this study was to verify the accuracy of preformed wire shape templates on plaster models and those of customized digital arch form diagrams on digital models. Twenty pairs of dental plaster models were randomly selected from the archives of the Department of Orthodontics of Federal Fluminense University, Niterói, Rio de Janeiro, Brazil. All plaster model samples were scanned in a plaster model scanner to create the respective digital models. Three examiners defined the arch form on the mandibular arch of these models by selecting the ideal preformed wire shape template on each plaster model or by making a customized digital arch form on the digital models using a digital arch form customization tool. These 2 arch forms were superimposed by the best-fit method. The greatest differences in the 6 regions on the superimposed arches were evaluated. Each examiner presented a descriptive analysis with the means, standard deviation, and minimum and maximum intervals of the differences on the superimpositions. Intraclass correlation coefficient and paired t tests were used to evaluate the accuracy of the superimpositions. Among the 6 regions analyzed in the superimpositions, the largest differences in the anterior and premolar regions were considered clinically insignificant, whereas the largest differences in the right molar region, especially the second molar area, were considered clinically significant by all 3 examiners. The intraclass correlation coefficients showed a weak correlation in the premolar region and moderate correlations in the anterior and molar regions. The paired t test showed statistically significant differences in the left anterior and premolar regions. The superimpositions between the arch forms on plaster and digital models were considered accurate, and the differences were not clinically significant, with the exception of the second molar area. Despite the favorable results, the requirement of correcting some software problems may

Using Social Judgment Theory method to examine how experienced occupational therapy driver assessors use information to make fitness-to-drive recommendations

PubMed Central

Harries, Priscilla; Davies, Miranda

2015-01-01

Introduction As people with a range of disabilities strive to increase their community mobility, occupational therapy driver assessors are increasingly required to make complex recommendations regarding fitness-to-drive. However, very little is known about how therapists use information to make decisions. The aim of this study was to model how experienced occupational therapy driver assessors weight and combine information when making fitness-to-drive recommendations and establish their level of decision agreement. Method Using Social Judgment Theory method, this study examined how 45 experienced occupational therapy driver assessors from the UK, Australia and New Zealand made fitness-to-drive recommendations for a series of 64 case scenarios. Participants completed the task on a dedicated website, and data were analysed using discriminant function analysis and an intraclass correlation coefficient. Results Accounting for 87% of the variance, the cues central to the fitness-to-drive recommendations made by assessors are the client’s physical skills, cognitive and perceptual skills, road law craft skills, vehicle handling skills and the number of driving instructor interventions. Agreement (consensus) between fitness-to-drive recommendations was very high: intraclass correlation coefficient = .97, 95% confidence interval .96–.98). Conclusion Findings can be used by both experienced and novice driver assessors to reflect on and strengthen the fitness-to-drive recommendations made to clients. PMID:26435572

A Local Agreement Pattern Measure Based on Hazard Functions for Survival Outcomes

PubMed Central

Dai, Tian; Guo, Ying; Peng, Limin; Manatunga, Amita K.

2017-01-01

Summary Assessing agreement is often of interest in biomedical and clinical research when measurements are obtained on the same subjects by different raters or methods. Most classical agreement methods have been focused on global summary statistics, which cannot be used to describe various local agreement patterns. The objective of this work is to study the local agreement pattern between two continuous measurements subject to censoring. In this paper, we propose a new agreement measure based on bivariate hazard functions to characterize the local agreement pattern between two correlated survival outcomes. The proposed measure naturally accommodates censored observations, fully captures the dependence structure between bivariate survival times and provides detailed information on how the strength of agreement evolves over time. We develop a nonparametric estimation method for the proposed local agreement pattern measure and study theoretical properties including strong consistency and asymptotical normality. We then evaluate the performance of the estimator through simulation studies and illustrate the method using a prostate cancer data example. PMID:28724196

Improved assessment of multiple sclerosis lesion segmentation agreement via detection and outline error estimates

PubMed Central

2012-01-01

Background Presented is the method “Detection and Outline Error Estimates” (DOEE) for assessing rater agreement in the delineation of multiple sclerosis (MS) lesions. The DOEE method divides operator or rater assessment into two parts: 1) Detection Error (DE) -- rater agreement in detecting the same regions to mark, and 2) Outline Error (OE) -- agreement of the raters in outlining of the same lesion. Methods DE, OE and Similarity Index (SI) values were calculated for two raters tested on a set of 17 fluid-attenuated inversion-recovery (FLAIR) images of patients with MS. DE, OE, and SI values were tested for dependence with mean total area (MTA) of the raters' Region of Interests (ROIs). Results When correlated with MTA, neither DE (ρ = .056, p=.83) nor the ratio of OE to MTA (ρ = .23, p=.37), referred to as Outline Error Rate (OER), exhibited significant correlation. In contrast, SI is found to be strongly correlated with MTA (ρ = .75, p < .001). Furthermore, DE and OER values can be used to model the variation in SI with MTA. Conclusions The DE and OER indices are proposed as a better method than SI for comparing rater agreement of ROIs, which also provide specific information for raters to improve their agreement. PMID:22812697

Comparisons of Office and 24-Hour Ambulatory Blood Pressure Monitoring in Children with Obstructive Sleep Apnea.

PubMed

Kang, Kun-Tai; Chiu, Shuenn-Nan; Weng, Wen-Chin; Lee, Pei-Lin; Hsu, Wei-Chung

2017-03-01

To compare office blood pressure (BP) and 24-hour ambulatory BP (ABP) monitoring to facilitate the diagnosis and management of hypertension in children with obstructive sleep apnea (OSA). Children aged 4-16 years with OSA-related symptoms were recruited from a tertiary referral medical center. All children underwent overnight polysomnography, office BP, and 24-hour ABP studies. Multiple linear regression analyses were applied to elucidate the association between the apnea-hypopnea index and BP. Correlation and consistency between office BP and 24-hour ABP were measured by Pearson correlation, intraclass correlation, and Bland-Altman analyses. In the 163 children enrolled (mean age, 8.2 ± 3.3 years; 67% male). The prevalence of systolic hypertension at night was significantly higher in children with moderate-to-severe OSA than in those with primary snoring (44.9% vs 16.1%, P = .006). Pearson correlation and intraclass correlation analyses revealed associations between office BP and 24-hour BP, and Bland-Altman analysis indicated an agreement between office and 24-hour BP measurements. However, multiple linear regression analyses demonstrated that 24-hour BP (nighttime systolic BP and mean arterial pressure), unlike office BP, was independently associated with the apnea-hypopnea index, after adjustment for adiposity variables. Twenty-four-hour ABP is more strongly correlated with OSA in children, compared with office BP. Copyright © 2016 Elsevier Inc. All rights reserved.

Agreement between pedometer and accelerometer in measuring physical activity in overweight and obese pregnant women.

PubMed

Kinnunen, Tarja I; Tennant, Peter W G; McParlin, Catherine; Poston, Lucilla; Robson, Stephen C; Bell, Ruth

2011-06-27

Inexpensive, reliable objective methods are needed to measure physical activity (PA) in large scale trials. This study compared the number of pedometer step counts with accelerometer data in pregnant women in free-living conditions to assess agreement between these measures. Pregnant women (n = 58) with body mass index ≥25 kg/m(2) at median 13 weeks' gestation wore a GT1M Actigraph accelerometer and a Yamax Digi-Walker CW-701 pedometer for four consecutive days. The Spearman rank correlation coefficients were determined between pedometer step counts and various accelerometer measures of PA. Total agreement between accelerometer and pedometer step counts was evaluated by determining the 95% limits of agreement estimated using a regression-based method. Agreement between the monitors in categorising participants as active or inactive was assessed by determining Kappa. Pedometer step counts correlated moderately (r = 0.36 to 0.54) with most accelerometer measures of PA. Overall step counts recorded by the pedometer and the accelerometer were not significantly different (medians 5961 vs. 5687 steps/day, p = 0.37). However, the 95% limits of agreement ranged from -2690 to 2656 steps/day for the mean step count value (6026 steps/day) and changed substantially over the range of values. Agreement between the monitors in categorising participants to active and inactive varied from moderate to good depending on the criteria adopted. Despite statistically significant correlations and similar median step counts, the overall agreement between pedometer and accelerometer step counts was poor and varied with activity level. Pedometer and accelerometer steps cannot be used interchangeably in overweight and obese pregnant women.

Reliability of a questionnaire on substance use among adolescent students, Brazil.

PubMed

Machado Neto, Adelmo de Souza; Andrade, Tarcisio Matos; Fernandes, Gilênio Borges; Zacharias, Helder Paulo; Carvalho, Fernando Martins; Machado, Ana Paula Souza; Dias, Ana Carmen Costa; Garcia, Ana Carolina Rocha; Santana, Lauro Reis; Rolin, Carlos Eduardo; Sampaio, Cyntia; Ghiraldi, Gisele; Bastos, Francisco Inácio

2010-10-01

To analyze reliability of a self-applied questionnaire on substance use and misuse among adolescent students. Two cross-sectional studies were carried out for the instrument test-retest. The sample comprised male and female students aged 1119 years from public and private schools (elementary, middle, and high school students) in the city of Salvador, Northeastern Brazil, in 2006. A total of 591 questionnaires were applied in the test and 467 in the retest. Descriptive statistics, the Kappa index, Cronbach's alpha and intraclass correlation were estimated. The prevalence of substance use/misuse was similar in both test and retest. Sociodemographic variables showed a "moderate" to "almost perfect" agreement for the Kappa index, and a "satisfactory" (>0.75) consistency for Cronbach's alpha and intraclass correlation. The age which psychoactive substances (tobacco, alcohol, and cannabis) were first used and chronological age were similar in both studies. Test-retest reliability was found to be a good indicator of students' age of initiation and their patterns of substance use. The questionnaire reliability was found to be satisfactory in the population studied.

Concurrent Validity Between Live and Home Video Observations Using the Alberta Infant Motor Scale

PubMed Central

van Dam, Ellen; van Haastert, Ingrid C.; Nuysink, Jacqueline

2017-01-01

Purpose: Serial assessment of gross motor development of infants at risk is an established procedure in neonatal follow-up clinics. Assessments based on home video recordings could be a relevant addition. Methods: In 48 infants (1.5-19 months), the concurrent validity of 2 applications was examined using the Alberta Infant Motor Scale: (1) a home video made by parents and (2) simultaneous observation on-site by a pediatric physical therapist. Parents' experiences were explored using a questionnaire. Results: The intraclass correlation coefficient agreement between live and home video assessment was 0.99, with a standard error of measurement of 1.41 items. Intra- and interrater reliability: intraclass correlation coefficients were more than 0.99. According to 94% of the parents, recording their infant's movement repertoire was easy to perform. Conclusion: Assessing the Alberta Infant Motor Scale based on home video recordings is comparable to assessment by live observation. The video method is a promising application that can be used with low burden for parents and infants. PMID:28350771

Validation of Morphometric Analyses of Small-Intestinal Biopsy Readouts in Celiac Disease

PubMed Central

Taavela, Juha; Koskinen, Outi; Huhtala, Heini; Lähdeaho, Marja-Leena; Popp, Alina; Laurila, Kaija; Collin, Pekka; Kaukinen, Katri; Kurppa, Kalle; Mäki, Markku

2013-01-01

Background Assessment of the gluten-induced small-intestinal mucosal injury remains the cornerstone of celiac disease diagnosis. Usually the injury is evaluated using grouped classifications (e.g. Marsh groups), but this is often too imprecise and ignores minor but significant changes in the mucosa. Consequently, there is a need for validated continuous variables in everyday practice and in academic and pharmacological research. Methods We studied the performance of our standard operating procedure (SOP) on 93 selected biopsy specimens from adult celiac disease patients and non-celiac disease controls. The specimens, which comprised different grades of gluten-induced mucosal injury, were evaluated by morphometric measurements. Specimens with tangential cutting resulting from poorly oriented biopsies were included. Two accredited evaluators performed the measurements in blinded fashion. The intraobserver and interobserver variations for villus height and crypt depth ratio (VH:CrD) and densities of intraepithelial lymphocytes (IELs) were analyzed by the Bland-Altman method and intraclass correlation. Results Unevaluable biopsies according to our SOP were correctly identified. The intraobserver analysis of VH:CrD showed a mean difference of 0.087 with limits of agreement from −0.398 to 0.224; the standard deviation (SD) was 0.159. The mean difference in interobserver analysis was 0.070, limits of agreement −0.516 to 0.375, and SD 0.227. The intraclass correlation coefficient in intraobserver variation was 0.983 and that in interobserver variation 0.978. CD3+ IEL density countings in the paraffin-embedded and frozen biopsies showed SDs of 17.1% and 16.5%; the intraclass correlation coefficients were 0.961 and 0.956, respectively. Conclusions Using our SOP, quantitative, reliable and reproducible morphometric results can be obtained on duodenal biopsy specimens with different grades of gluten-induced injury. Clinically significant changes were defined according to

EXPLORATION OF SCORE AGREEMENT ON A MODIFIED UPPER QUARTER Y-BALANCE TEST KIT AS COMPARED TO THE UPPER QUARTER Y-BALANCE TEST.

PubMed

Cramer, Josh; Quintero, Miguel; Rhinehart, Alex; Rutherford, Caitlin; Nasypany, Alan; May, James; Baker, Russell T

2017-02-01

Physical performance measures (PPMs) such as The Star Excursion Balance Test (SEBT) and the Y-Balance Test (YBT) are functional movement tests used to assess participants' dynamic balance, which can be a vital component in physical exams to identify predisposing factors for risk of injury. The YBT is a functional assessment tool for the upper and lower body. It evolved from the SEBT, which has been previously used in research as a lower body functional assessment. It is comprised of fewer movement directions, which help limit fatigue. The YBT kit is a commercialized tool, which may pose barriers for clinicians with limited budgets and/or strict approval process for purchasing capital items in their clinics, especially healthcare providers in the secondary school setting. The cost may also pose a barrier for researchers with limited budgets. A less expensive, easy to make kit, may provide clinicians an opportunity to integrate functional testing into their evaluation or research. The purpose of this pilot study was to describe a cost efficient method to gather participant's upper quarter YBT (UQYBT) measurements and examine the inter- and intra-rater score agreement between this method and the commercial YBT measurements. A convenience sample of 20 physically active participants volunteered to participate in a comparison study of the of Upper Quarter Y-Balance Test (UQYBT) using the commercialized kit and the Modified Upper Quarter Y-Balance Test kit (mUQYBT) made with three cloth tape measures, athletic tape, a goniometer and three 2x4x8 wood blocks. A Pearson Product Moment correlation and Bland-Altman analyses were used to examine the relationship between intra-rater scores comparing the UQYBT and mUQYBT. Inter-rater scores were analyzed using intraclass correlation coefficients (ICC) (2,1) and Bland-Altman analyses. All Pearson Product Moment r-values for intra-rater scores were greater than .96 and statistically significant at p<0.05. Coefficients of

Student and Teacher Ratings of Academic Competence: An Examination of Cross-Informant Agreement

ERIC Educational Resources Information Center

Kettler, Ryan J.; Elliott, Stephen N.; DiPerna, James C.; Bolt, Daniel M.; Reiser, Deitra; Resurreccion, Leilani

2014-01-01

Two studies were conducted with samples of middle and high school teachers and students to examine cross-informant agreement on the Academic Competence Evaluation Scales. Cross-informant agreement was examined using Pearson correlations and conditional probability indices. Results of Study 1 (N = 65) and Study 2 (N = 66) indicated that teacher and…

Reliability of Pain Measurements Using Computerized Cuff Algometry: A DoloCuff Reliability and Agreement Study.

PubMed

Kvistgaard Olsen, Jack; Fener, Dilay Kesgin; Waehrens, Eva Elisabet; Wulf Christensen, Anton; Jespersen, Anders; Danneskiold-Samsøe, Bente; Bartels, Else Marie

2017-07-01

Computerized pneumatic cuff pressure algometry (CPA) using the DoloCuff is a new method for pain assessment. Intra- and inter-rater reliabilities have not yet been established. Our aim was to examine the inter- and intrarater reliabilities of DoloCuff measures in healthy subjects. Twenty healthy subjects (ages 20 to 29 years) were assessed three times at 24-hour intervals by two trained raters. Inter-rater reliability was established based on the first and second assessments, whereas intrarater reliability was based on the second and third assessments. Subjects were randomized 1:1 to first assessment at either rater 1 or rater 2. The variables of interest were pressure pain threshold (PT), pressure pain tolerance (PTol), and temporal summation index (TSI). Reliability was estimated by a two-way mixed intraclass correlation coefficient (ICC) absolute agreement analysis. Reliability was considered excellent if ICC > 0.75, fair to good if 0.4 < ICC < 0.75, and poor if ICC < 0.4. Bias and random errors between raters and assessments were evaluated using 95% confidence interval (CI) and Bland-Altman plots. Inter-rater reliability for PT, PTol, and TSI was 0.88 (95% CI: 0.69 to 0.95), 0.86 (95% CI: 0.65 to 0.95), and 0.81 (95% CI: 0.42 to 0.94), respectively. The intrarater reliability for PT, PTol, and TSI was 0.81 (95% CI: 0.53 to 0.92), 0.89 (95% CI: 0.74 to 0.96), and 0.75 (95% CI: 0.28 to 0.91), respectively. Inter-rater reliability was excellent for PT, PTol, and TSI. Similarly, the intrarater reliability for PT and PTol was excellent, while borderline excellent/good for TSI. Therefore, the DoloCuff can be used to obtain reliable measures of pressure pain parameters in healthy subjects. © 2016 World Institute of Pain.

Validity evidence of non-technical skills assessment instruments in simulated anaesthesia crisis management.

PubMed

Jirativanont, T; Raksamani, K; Aroonpruksakul, N; Apidechakul, P; Suraseranivongse, S

2017-07-01

We sought to evaluate the validity of two non-technical skills evaluation instruments, the Anaesthetists' Non-Technical Skills (ANTS) behavioural marker system and the Ottawa Global Rating Scale (GRS), to apply them to anaesthesia training. The content validity, response process, internal structure, relations with other variables and consequences were described for validity evidence. Simulated crisis management sessions were initiated during which two trained raters evaluated the performance of postgraduate first-, second- and third-year (PGY-1, PGY-2 and PGY-3) anaesthesia residents. The study included 70 participants, composed of 24 PGY-1, 24 PGY-2 and 22 PGY-3 residents. Both instruments differentiated the non-technical skills of PGY-1 from PGY-3 residents ( P <0.05). Inter-rater agreement was measured using the intraclass correlation coefficient (ICC). For the ANTS instrument, the intraclass correlation coefficients for task management, team-working, situation awareness and decision-making were 0.79, 0.34, 0.81 and 0.70, respectively. For the Ottawa GRS, the intraclass correlation coefficients for overall performance, leadership, problem-solving, situation awareness, resource utilisation and communication skills were 0.86, 0.83, 0.84, 0.87, 0.80 and 0.86, respectively. The Cronbach's alpha for internal consistency of the ANTS instrument was 0.93, and was 0.96 for the Ottawa GRS. There was a high correlation between the ANTS and Ottawa GRS. The raters reported the ease of use of the Ottawa GRS compared to the ANTS. We found sufficient evidence of validity in the ANTS instrument and the Ottawa GRS for the evaluation of non-technical skills in a simulated anaesthesia setting, but the Ottawa GRS was more practical and had higher reliability.

Does the choice of tariff matter?

PubMed Central

Zhao, Yue; Li, Shun-Ping; Liu, Liu; Zhang, Jiang-Lin; Chen, Gang

2017-01-01

Abstract There is an increasing trend globally to develop country-specific tariffs that can theoretically better reflect population's preferences on health states for preference-based health-related quality-of-life instruments, also known as multiattribute utility instruments. This study focused on the most recently developed 5-level version of EuroQol-5 Dimension (EQ-5D) questionnaire, 1 of the world's most well-known multiattribute utility instruments, and aimed to empirically explore the agreements and known-group validities of applying the country-specific tariff versus tariffs developed from other countries using a sample of psoriasis vulgaris patients in Mainland China. A convenience sampling framework was adopted to recruit patients diagnosed with psoriasis vulgaris from Xiangya Hospital, Central South University, China, between May 2014 and February 2015. The 5-level EuroQol-5 dimensions (EQ-5D-5L) utilities were scored by using the Chinese, Japanese, and UK tariffs. Health state utilities were compared using a range of nonparametric test. The intraclass correlation coefficients and Bland–Altman plots were used to examine the agreements among the 3 EQ-5D-5L scores. Health state utility decrements between known groups were investigated using both effect size and a regression analysis. In all, 350 patients (aged 16 years or older) were recruited. There were significant differences among the 3 national tariff sets. Overall, 3 tariffs showed excellent agreements (intraclass correlation coefficient >0.90); however, the wide limits of agreement from the Bland–Altman plots suggest that these tariffs cannot be used interchangeably. The EQ-5D-5L scores using the Chinese-specific tariff showed the best known-group validity than the other 2 tariffs in this Chinese patient sample. The evidence from this study supports the choice of the country-specific tariff to be used in Mainland China. PMID:28834893

Interobserver reliability of echocardiography for prognostication of normotensive patients with pulmonary embolism

PubMed Central

2014-01-01

Objectives To evaluate the interobserver reliability of echocardiographic findings of right ventricle (RV) dysfunction for prognosticating normotensive patients with pulmonary embolism (PE). Methods A central panel of cardiologists evaluated echocardiographic studies of 75 patients included in the PROTECT study for the following signs: RV diameter, RV/left ventricular (LV) diameter ratio, hypokinesis of the RV free wall, and tricuspid plane systolic excursion (TAPSE). Investigators used intraclass correlation to assess agreement between the measurements of the central panel and each of the local cardiologists. Investigators used the single weighted kappa statistic to test for agreement between readers of interpretation of RV enlargement and RV hypokinesis. Results The two observers had fair agreement (k = 0.45) for RV enlargement assessed by the RV diameter, and good agreement (k = 0.65) for RV enlargement assessed by the RV/LV diameter ratio. The interobserver reliability of the assessment whether hypokinesis of the RV free wall is present was good (к = 0.70), and whether RV dysfunction (assessed by TAPSE measurement) is present was very good (k = 0.86). The intraclass correlation for the RV/LV diameter ratio was fair (0.55; 95% confidence interval [CI], 0.37-0.69), for the RV diameter was good (0.70; 95% CI, 0.56-0.80), and for the TAPSE measurement was very good (0.85; 95% CI, 0.77-0.90). On Bland-Altman analysis, the mean differences for RV diameter, RV/LV diameter ratio and TAPSE measurement were 2.33 (±5.38), 0.06 (±0.23) and 0.08 (±2.20), respectively. Conclusion TAPSE measurement is the least user dependent and most reproducible echocardiographic finding of RV dysfunction in normotensive patients with PE. PMID:25092465

Does the choice of tariff matter?: A comparison of EQ-5D-5L utility scores using Chinese, UK, and Japanese tariffs on patients with psoriasis vulgaris in Central South China.

PubMed

Zhao, Yue; Li, Shun-Ping; Liu, Liu; Zhang, Jiang-Lin; Chen, Gang

2017-08-01

There is an increasing trend globally to develop country-specific tariffs that can theoretically better reflect population's preferences on health states for preference-based health-related quality-of-life instruments, also known as multiattribute utility instruments. This study focused on the most recently developed 5-level version of EuroQol-5 Dimension (EQ-5D) questionnaire, 1 of the world's most well-known multiattribute utility instruments, and aimed to empirically explore the agreements and known-group validities of applying the country-specific tariff versus tariffs developed from other countries using a sample of psoriasis vulgaris patients in Mainland China.A convenience sampling framework was adopted to recruit patients diagnosed with psoriasis vulgaris from Xiangya Hospital, Central South University, China, between May 2014 and February 2015. The 5-level EuroQol-5 dimensions (EQ-5D-5L) utilities were scored by using the Chinese, Japanese, and UK tariffs. Health state utilities were compared using a range of nonparametric test. The intraclass correlation coefficients and Bland-Altman plots were used to examine the agreements among the 3 EQ-5D-5L scores. Health state utility decrements between known groups were investigated using both effect size and a regression analysis.In all, 350 patients (aged 16 years or older) were recruited. There were significant differences among the 3 national tariff sets. Overall, 3 tariffs showed excellent agreements (intraclass correlation coefficient >0.90); however, the wide limits of agreement from the Bland-Altman plots suggest that these tariffs cannot be used interchangeably. The EQ-5D-5L scores using the Chinese-specific tariff showed the best known-group validity than the other 2 tariffs in this Chinese patient sample. The evidence from this study supports the choice of the country-specific tariff to be used in Mainland China.

Translation, cross-cultural adaptation and reliability of the german version of the dizziness handicap inventory.

PubMed

Kurre, Annette; van Gool, Christel J A W; Bastiaenen, Caroline H G; Gloor-Juzi, Thomas; Straumann, Dominik; de Bruin, Eling D

2009-04-01

To translate the Dizziness Handicap Inventory into German (DHI-G) and investigate reliability, assess the association between selected items of the University of California Los Angeles Dizziness Questionnaire and the DHI-G, and compare the scores of patients and healthy participants. Cross-sectional design. Tertiary center for vertigo, dizziness, or balance disorders. One hundred forty-one patients with vertigo, dizziness, and unsteadiness associated with a vestibular disorder, with a mean age (standard deviation) of 51.5 (13.2) years, and 52 healthy individuals participated. Fourteen patients participated in the cognitive debriefing; 127 patients completed the questionnaires once or twice within 1 week. The DHI-G assesses disability caused by dizziness and unsteadiness; the items of the University of California Los Angeles Dizziness Questionnaire assess dizziness and impact on everyday activities. Internal consistency was estimated using Cronbach alpha, reproducibility by calculating Bland-Altman limits of agreement and intraclass correlation coefficients. Associations were estimated by Spearman correlation coefficients. Patients filled out the DHI-G without problem and found that their self-perceived disabilities were mostly included. Cronbach alpha values for the DHI-G and the functional, physical, and emotional subscales were 0.90, 0.80, 0.71, and 0.82, respectively. The limits of agreement were +/-12.4 points for the total scale (maximum, 100 points). Intraclass correlation coefficients ranged from 0.90 to 0.95. The DHI-G correlated moderately with the question assessing functional disability (0.56) and fairly with the questions quantifying dizziness (0.43, 0.35). The DHI-G discriminated significantly between healthy participants and patients. The DHI-G demonstrated good reliability and is recommended as a measure of disability in patients with dizziness and unsteadiness.

Assessing the Agreement Between Radiologic and Clinical Measurements of Lumbar and Cervical Epidural Depths in Patients Undergoing Prone Interlaminar Epidural Steroid Injection.

PubMed

Jones, James Harvey; Singh, Naileshni; Nidecker, Anna; Li, Chin-Shang; Fishman, Scott

2017-05-01

Fluoroscopy-guided epidural steroid injection (ESI) commonly is performed to treat radicular pain yet can lead to adverse events if the needle is not advanced with precision. Accurate preoperative assessment of the distance from the skin to the epidural space holds the potential for reducing the risks of adverse effects from ESI. It was hypothesized that the distance from the skin to the epidural space as measured on preoperative magnetic resonance imaging (MRI) would agree with the distance traveled by a Tuohy needle to reach the epidural space during midline, interlaminar ESI. This study compared the final needle depth measurement at the point of loss of resistance (LOR) from cervical or lumbar ESI to the distance from the skin to the anterior and posterior borders of the epidural space on the associated cervical and lumbar preoperative MRI. This retrospective chart review analyzed the procedure notes, MRI, and demographic data of patients who received a prone, interlaminar ESI at an outpatient chronic pain clinic between June 1, 2013, and June 1, 2015. The following data were collected: body mass index (BMI), age, sex, intervertebral level of the ESI, and LOR depth. We then measured the distance from the skin surface to the anterior border of the ligamentum flavum (ligamentum flavum depth [LFD]) and dura (dura depth [DD]) on MRI. A total of 335 patients were categorized into the following patient subgroups: age ≥65 years, age <65 years, BMI ≥30 kg/m (obese), BMI <30 kg/m (nonobese), male, and female. Secondary analyses were then performed to compare the agreement between LOR depth and DD with that between LOR depth and LFD within each patient subgroup. Intraclass correlation coefficient (ICC) and Bland-Altman plot were used to assess the agreement between DD or LFD and LOR depth. Data from 335 ESIs were analyzed, including 147 cervical ESIs and 188 lumbar ESIs. Estimated ICC values for the agreement between LOR depth and LFD for all lumbar and cervical

Conventional vs. reduced field of view diffusion weighted imaging of the prostate: Comparison of image quality, correlation with histology, and inter-reader agreement.

PubMed

Warndahl, Brent A; Borisch, Eric A; Kawashima, Akira; Riederer, Stephen J; Froemming, Adam T

2018-04-01

To evaluate if Field of view Optimized and Constrained Undistorted Single shot (FOCUS) (GE Healthcare, Waukesha, WI) diffusion weighted images (DWI) provide more reliable imaging than conventional DWI, with non-inferior quantitative apparent diffusion coefficient (ADC) results. IRB approval was obtained for this study of 43 patients (44 exams, one patient with two visits) that underwent multiparametric prostate MRI with two DWI sequences and subsequent radical prostatectomy with histology as the gold standard. Randomized DWI sequence images were graded independently by two blinded experienced prostate MRI radiologists with a period of memory extinction between the two separate reading sessions. Blinded images were also reviewed head to head in a later session for direct comparison. Multiple parameters were measured from a region of interest in a dominant lesion as well as two control areas. Patient characteristics were collected by chart review. There was good correlation between the mean ADC value for lesions obtained by conventional and FOCUS DWI (ρ=0.85), with no trend toward any systematic difference, and equivalent correlation between ADC measurements and Gleason score. Agreement between the two readers was significantly higher for lesion ROI analysis with the FOCUS DWI derived ADC values (CCC 0.839) compared with the conventional ADC values (CCC 0.618; difference 0.221, 95% CI 0.01-0.46). FOCUS showed significantly better image quality scores (separate review: mean 2.17±0.6, p<0.001) compared to the conventional sequence (mean 2.65±0.6, p<0.001). In 13 cases the image quality was improved from grade of 3+ with conventional DWI to <3 with FOCUS DWI, a clinically meaningful improvement. Head-to-head blinded review found 61 ratings showed strong to slight preference for FOCUS, 13 no preference, and 14 slight preference for the conventional sequence. There was also a strong and equivalent correlation between both sequences and PIRADS version 2 grading (ρ=-0

Comparison of two dietary assessment methods by food consumption: results of the German National Nutrition Survey II.

PubMed

Eisinger-Watzl, Marianne; Straßburg, Andrea; Ramünke, Josa; Krems, Carolin; Heuer, Thorsten; Hoffmann, Ingrid

2015-04-01

To further characterise the performance of the diet history method and the 24-h recalls method, both in an updated version, a comparison was conducted. The National Nutrition Survey II, representative for Germany, assessed food consumption with both methods. The comparison was conducted in a sample of 9,968 participants aged 14-80. Besides calculating mean differences, statistical agreement measurements encompass Spearman and intraclass correlation coefficients, ranking participants in quartiles and the Bland-Altman method. Mean consumption of 12 out of 18 food groups was higher assessed with the diet history method. Three of these 12 food groups had a medium to large effect size (e.g., raw vegetables) and seven showed at least a small strength while there was basically no difference for coffee/tea or ice cream. Intraclass correlations were strong only for beverages (>0.50) and revealed the least correlation for vegetables (<0.20). Quartile classification of participants exhibited more than two-thirds being ranked in the same or adjacent quartile assessed by both methods. For every food group, Bland-Altman plots showed that the agreement of both methods weakened with increasing consumption. The cognitive effort essential for the diet history method to remember consumption of the past 4 weeks may be a source of inaccurateness, especially for inhomogeneous food groups. Additionally, social desirability gains significance. There is no assessment method without errors and attention to specific food groups is a critical issue with every method. Altogether, the 24-h recalls method applied in the presented study, offers advantages approximating food consumption as compared to the diet history method.

Agreement between pedometer and accelerometer in measuring physical activity in overweight and obese pregnant women

PubMed Central

2011-01-01

Background Inexpensive, reliable objective methods are needed to measure physical activity (PA) in large scale trials. This study compared the number of pedometer step counts with accelerometer data in pregnant women in free-living conditions to assess agreement between these measures. Methods Pregnant women (n = 58) with body mass index ≥25 kg/m2 at median 13 weeks' gestation wore a GT1M Actigraph accelerometer and a Yamax Digi-Walker CW-701 pedometer for four consecutive days. The Spearman rank correlation coefficients were determined between pedometer step counts and various accelerometer measures of PA. Total agreement between accelerometer and pedometer step counts was evaluated by determining the 95% limits of agreement estimated using a regression-based method. Agreement between the monitors in categorising participants as active or inactive was assessed by determining Kappa. Results Pedometer step counts correlated moderately (r = 0.36 to 0.54) with most accelerometer measures of PA. Overall step counts recorded by the pedometer and the accelerometer were not significantly different (medians 5961 vs. 5687 steps/day, p = 0.37). However, the 95% limits of agreement ranged from -2690 to 2656 steps/day for the mean step count value (6026 steps/day) and changed substantially over the range of values. Agreement between the monitors in categorising participants to active and inactive varied from moderate to good depending on the criteria adopted. Conclusions Despite statistically significant correlations and similar median step counts, the overall agreement between pedometer and accelerometer step counts was poor and varied with activity level. Pedometer and accelerometer steps cannot be used interchangeably in overweight and obese pregnant women. PMID:21703033

A local agreement pattern measure based on hazard functions for survival outcomes.

PubMed

Dai, Tian; Guo, Ying; Peng, Limin; Manatunga, Amita K

2018-03-01

Assessing agreement is often of interest in biomedical and clinical research when measurements are obtained on the same subjects by different raters or methods. Most classical agreement methods have been focused on global summary statistics, which cannot be used to describe various local agreement patterns. The objective of this work is to study the local agreement pattern between two continuous measurements subject to censoring. In this article, we propose a new agreement measure based on bivariate hazard functions to characterize the local agreement pattern between two correlated survival outcomes. The proposed measure naturally accommodates censored observations, fully captures the dependence structure between bivariate survival times and provides detailed information on how the strength of agreement evolves over time. We develop a nonparametric estimation method for the proposed local agreement pattern measure and study theoretical properties including strong consistency and asymptotical normality. We then evaluate the performance of the estimator through simulation studies and illustrate the method using a prostate cancer data example. © 2017, The International Biometric Society.

Self-Other Agreement in Multisource Feedback: The Influence of Doctor and Rater Group Characteristics

ERIC Educational Resources Information Center

Roberts, Martin J.; Campbell, John L.; Richards, Suzanne H.; Wright, Christine

2013-01-01

Introduction: Multisource feedback (MSF) ratings provided by patients and colleagues are often poorly correlated with doctors' self-assessments. Doctors' reactions to feedback depend on its agreement with their own perceptions, but factors influencing self-other agreement in doctors' MSF ratings have received little attention. We aimed to identify…

Investigating Various Thresholds as Immunohistochemistry Cutoffs for Observer Agreement.

PubMed

Ali, Asif; Bell, Sarah; Bilsland, Alan; Slavin, Jill; Lynch, Victoria; Elgoweini, Maha; Derakhshan, Mohammad H; Jamieson, Nigel B; Chang, David; Brown, Victoria; Denley, Simon; Orange, Clare; McKay, Colin; Carter, Ross; Oien, Karin A; Duthie, Fraser R

2017-10-01

Clinical translation of immunohistochemistry (IHC) biomarkers requires reliable and reproducible cutoffs or thresholds for interpretation of immunostaining. Most IHC biomarker research focuses on the clinical relevance (diagnostic, prognostic, or predictive utility) of cutoffs, with less emphasis on observer agreement using these cutoffs. From the literature, we identified 3 commonly used cutoffs of 10% positive epithelial cells, 20% positive epithelial cells, and moderate to strong staining intensity (+2/+3 hereafter) to use for investigating observer agreement. A series of 36 images of microarray cores stained for 4 different IHC biomarkers, with variable staining intensity and percentage of positive cells, was used for investigating interobserver and intraobserver agreement. Seven pathologists scored the immunostaining in each image using the 3 cutoffs for positive and negative staining. Kappa (κ) statistic was used to assess the strength of agreement for each cutoff. The interobserver agreement between all 7 pathologists using the 3 cutoffs was reasonably good, with mean κ scores of 0.64, 0.59, and 0.62, respectively, for 10%, 20%, and +2/+3 cutoffs. A good agreement was observed for experienced pathologists using the 10% cutoff, and their agreement was statistically higher than for junior pathologists (P=0.02). In addition, the mean intraobserver agreement for all 7 pathologists using the 3 cutoffs was reasonably good, with mean κ scores of 0.71, 0.60, and 0.73, respectively, for 10%, 20%, and +2/+3 cutoffs. For all 3 cutoffs, a positive correlation was observed with perceived ease of interpretation (P<0.003). Finally, cytoplasmic-only staining achieved higher agreement using all 3 cutoffs than mixed staining patterns. All 3 cutoffs investigated achieve reasonable strength of agreement, modestly decreasing interobserver and intraobserver variability in IHC interpretation. These cutoffs have previously been used in cancer pathology, and this study provides

Does training improve diagnostic accuracy and inter-rater agreement in applying the Berlin radiographic definition of acute respiratory distress syndrome? A multicenter prospective study.

PubMed

Peng, Jin-Min; Qian, Chuan-Yun; Yu, Xiang-You; Zhao, Ming-Yan; Li, Shu-Sheng; Ma, Xiao-Chun; Kang, Yan; Zhou, Fa-Chun; He, Zhen-Yang; Qin, Tie-He; Yin, Yong-Jie; Jiang, Li; Hu, Zhen-Jie; Sun, Ren-Hua; Lin, Jian-Dong; Li, Tong; Wu, Da-Wei; An, You-Zhong; Ai, Yu-Hang; Zhou, Li-Hua; Cao, Xiang-Yuan; Zhang, Xi-Jing; Sun, Rong-Qing; Chen, Er-Zhen; Du, Bin

2017-01-20

Poor inter-rater reliability in chest radiograph interpretation has been reported in the context of acute respiratory distress syndrome (ARDS), although not for the Berlin definition of ARDS. We sought to examine the effect of training material on the accuracy and consistency of intensivists' chest radiograph interpretations for ARDS diagnosis. We conducted a rater agreement study in which 286 intensivists (residents 41.3%, junior attending physicians 35.3%, and senior attending physician 23.4%) independently reviewed the same 12 chest radiographs developed by the ARDS Definition Task Force ("the panel") before and after training. Radiographic diagnoses by the panel were classified into the consistent (n = 4), equivocal (n = 4), and inconsistent (n = 4) categories and were used as a reference. The 1.5-hour training course attended by all 286 intensivists included introduction of the diagnostic rationale, and a subsequent in-depth discussion to reach consensus for all 12 radiographs. Overall diagnostic accuracy, which was defined as the percentage of chest radiographs that were interpreted correctly, improved but remained poor after training (42.0 ± 14.8% before training vs. 55.3 ± 23.4% after training, p < 0.001). Diagnostic sensitivity and specificity improved after training for all diagnostic categories (p < 0.001), with the exception of specificity for the equivocal category (p = 0.883). Diagnostic accuracy was higher for the consistent category than for the inconsistent and equivocal categories (p < 0.001). Comparisons of pre-training and post-training results revealed that inter-rater agreement was poor and did not improve after training, as assessed by overall agreement (0.450 ± 0.406 vs. 0.461 ± 0.575, p = 0.792), Fleiss's kappa (0.133 ± 0.575 vs. 0.178 ± 0.710, p = 0.405), and intraclass correlation coefficient (ICC; 0.219 vs. 0.276, p = 0.470). The radiographic diagnostic accuracy and

Delineation of vertebral area on the coronal plane using three-dimensional ultrasonography advanced volume contrast imaging (VCI) Omni view: intrarater reliability and agreement using standard mouse, high definition mouse, and pen-tablet.

PubMed

Araujo Júnior, Edward; Martinez, Luis Henrique; Simioni, Christiane; Martins, Wellington P; Nardozza, Luciano M; Moron, Antonio F

2012-09-01

To assess the fetal lumbosacral spine by three-dimensional (3D) ultrasonography using volume contrast imaging (VCI) omni view method and compare reproducibility and agreement between three different measurement techniques: standard mouse, high definition mouse and pen-tablet. A comparative and prospective study with 40 pregnant women between 20 and 34 + 6 weeks was realized. 3D volume datasets of the fetal spine were acquired using a convex transabdominal transducer. Starting scan plane was the coronal section of fetal lumbosacral spine by VCI-C function. Omni view manual trace was selected and a parallel plane of fetal spine was drawn including interest region. Intraclass correlation coefficient (ICC) was used for reproducibility analysis. The relative difference between three used techniques was compared by chi-square test and Fischer test. Pen-tablet showed better reliability (ICC=0.987). In the relative proportion of differences, this was significantly higher for the pen-tablet (82.14%; p<0.01). In paired comparison, the relative difference was significantly greater for the pen-tablet (p<0.01). The pen-tablet showed to be the most reproductive and concordant method in the measurement of body vertebral area of fetal lumbosacral spine by 3D ultrasonography using the VCI.

Reliability of Lactation Assessment Tools Applied to Overweight and Obese Women.

PubMed

Chapman, Donna J; Doughty, Katherine; Mullin, Elizabeth M; Pérez-Escamilla, Rafael

2016-05-01

The interrater reliability of lactation assessment tools has not been evaluated in overweight/obese women. This study aimed to compare the interrater reliability of 4 lactation assessment tools in this population. A convenience sample of 45 women (body mass index > 27.0) was videotaped while breastfeeding (twice daily on days 2, 4, and 7 postpartum). Three International Board Certified Lactation Consultants independently rated each videotaped session using 4 tools (Infant Breastfeeding Assessment Tool [IBFAT], modified LATCH [mLATCH], modified Via Christi [mVC], and Riordan's Tool [RT]). For each day and tool, we evaluated interrater reliability with 1-way repeated-measures analyses of variance, intraclass correlation coefficients (ICCs), and percentage absolute agreement between raters. Analyses of variance showed significant differences between raters' scores on day 2 (all scales) and day 7 (RT). Intraclass correlation coefficient values reflected good (mLATCH) to excellent reliability (IBFAT, mVC, and RT) on days 2 and 7. All day 4 ICCs reflected good reliability. The ICC for mLATCH was significantly lower than all others on day 2 and was significantly lower than IBFAT (day 7). Percentage absolute interrater agreement for scale components ranged from 31% (day 2: observable swallowing, RT) to 92% (day 7: IBFAT, fixing; and mVC, latch time). Swallowing scores on all scales had the lowest levels of interrater agreement (31%-64%). We demonstrated differences in the interrater reliability of 4 lactation assessment tools when applied to overweight/obese women, with the lowest values observed on day 4. Swallowing assessment was particularly unreliable. Researchers and clinicians using these scales should be aware of the differences in their psychometric behavior. © The Author(s) 2015.

Development and Validation of a Practical Instrument for Injury Prevention: The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT).

PubMed

Sun, Yi; Arning, Martin; Bochmann, Frank; Börger, Jutta; Heitmann, Thomas

2018-06-01

The Occupational Safety and Health Monitoring and Assessment Tool (OSH-MAT) is a practical instrument that is currently used in the German woodworking and metalworking industries to monitor safety conditions at workplaces. The 12-item scoring system has three subscales rating technical, organizational, and personnel-related conditions in a company. Each item has a rating value ranging from 1 to 9, with higher values indicating higher standard of safety conditions. The reliability of this instrument was evaluated in a cross-sectional survey among 128 companies and its validity among 30,514 companies. The inter-rater reliability of the instrument was examined independently and simultaneously by two well-trained safety engineers. Agreement between the double ratings was quantified by the intraclass correlation coefficient and absolute agreement of the rating values. The content validity of the OSH-MAT was evaluated by quantifying the association between OSH-MAT values and 5-year average injury rates by Poisson regression analysis adjusted for the size of the companies and industrial sectors. The construct validity of OSH-MAT was examined by principle component factor analysis. Our analysis indicated good to very good inter-rater reliability (intraclass correlation coefficient = 0.64-0.74) of OSH-MAT values with an absolute agreement of between 72% and 81%. Factor analysis identified three component subscales that met exactly the structure theory of this instrument. The Poisson regression analysis demonstrated a statistically significant exposure-response relationship between OSH-MAT values and the 5-year average injury rates. These analyses indicate that OSH-MAT is a valid and reliable instrument that can be used effectively to monitor safety conditions at workplaces.

Evaluation of agreement between temporal series obtained from electrocardiogram and pulse wave.

NASA Astrophysics Data System (ADS)

Leikan, GM; Rossi, E.; Sanz, MCuadra; Delisle Rodríguez, D.; Mántaras, MC; Nicolet, J.; Zapata, D.; Lapyckyj, I.; Siri, L. Nicola; Perrone, MS

2016-04-01

Heart rate variability allows to study the cardiovascular autonomic nervous system modulation. Usually, this signal is obtained from the electrocardiogram (ECG). A simpler method for recording the pulse wave (PW) is by means of finger photoplethysmography (PPG), which also provides information about the duration of the cardiac cycle. In this study, the correlation and agreement between the time series of the intervals between heartbeats obtained from the ECG with those obtained from the PPG, were studied. Signals analyzed were obtained from young, healthy and resting subjects. For statistical analysis, the Pearson correlation coefficient and the Bland and Altman limits of agreement were used. Results show that the time series constructed from the PW would not replace the ones obtained from ECG.

Successful associateship agreements.

PubMed

Crafton, B C

1997-08-01

When evaluating potential associateship agreements, dentists need to recognize and understand how status, noncompete clauses, scheduling and compensation affect the strength of an associateship agreement. Dentists should not enter an associateship agreement without fully understanding the agreement and its obligations or without the help of an accountant and an attorney.

Intraclass Correlations and Covariate Outcome Correlations for Planning Two-and Three-Level Cluster-Randomized Experiments in Education

ERIC Educational Resources Information Center

Hedges, Larry V.; Hedberg, E. C.

2013-01-01

Background: Cluster-randomized experiments that assign intact groups such as schools or school districts to treatment conditions are increasingly common in educational research. Such experiments are inherently multilevel designs whose sensitivity (statistical power and precision of estimates) depends on the variance decomposition across levels.…

Intraclass Correlations and Covariate Outcome Correlations for Planning 2 and 3 Level Cluster Randomized Experiments in Education

ERIC Educational Resources Information Center

Hedges, Larry V.; Hedberg, Eric C.

2013-01-01

Background: Cluster randomized experiments that assign intact groups such as schools or school districts to treatment conditions are increasingly common in educational research. Such experiments are inherently multilevel designs whose sensitivity (statistical power and precision of estimates) depends on the variance decomposition across levels.…

[Interobserver reliability of the Glasgow coma scale in critically ill patients with neurological and/or neurosurgical disease].

PubMed

Sánchez-Sánchez, M M; Sánchez-Izquierdo, R; Sánchez-Muñoz, E I; Martínez-Yegles, I; Fraile-Gamo, M P; Arias-Rivera, S

2014-01-01

The Glasgow coma scale (GCS) is a common tool used for neurological assessment of critically ill patients. Despite its widespread use, the GCS has some limitations, as sometimes different observers may value differently the same response. To evaluate the interobserver agreement, among intensive care nurses with a minimum of 3 years experience, both in the overall estimate of GCS and for each of its components. Prospective observational study including 110 neurological and/or neurosurgical patients conducted in a critical care unit of 18 beds, from October 2010 until December 2012. Registered variables: Demographic characteristics, reason for admission, overall GCS and its components. The neurological evaluation was conducted by a minimum of 3 nurses. One of them applied an algorithm and consensual assessment technique and all, independently, valued response to stimuli. Interobserver agreement was measured using the intraclass correlation coefficient (ICC) for a confidence interval (CI) of 95%. The study was approved by the Ethics Committee for Clinical Trails. The intraclass correlation coefficient (confident interval) for scale was: Overall GCS: 0.989 (0.985-0.992); ocular response: 0.981 (0.974-0.986); verbal response: 0.971 (0.960-0.979); motor response: 0.987 (0.982-0.991). In our cohort of patients we observed a high level of consistency in the application of both the GCS as in each of its components. Copyright © 2013 Elsevier España, S.L. y SEEIUC. All rights reserved.

Normal fetal posterior fossa in MR imaging: new biometric data and possible clinical significance.

PubMed

Ber, R; Bar-Yosef, O; Hoffmann, C; Shashar, D; Achiron, R; Katorza, E

2015-04-01

Posterior fossa malformations are a common finding in prenatal diagnosis. The objectives of this study are to re-evaluate existing normal MR imaging biometric data of the fetal posterior fossa, suggest and evaluate new parameters, and demonstrate the possible clinical applications of these data. This was a retrospective review of 215 fetal MR imaging examinations with normal findings and 5 examinations of fetuses with a suspected pathologic posterior fossa. Six previously reported parameters and 8 new parameters were measured. Three new parameter ratios were calculated. Interobserver agreement was calculated by using the intraclass correlation coefficient. For measuring each structure, 151-211 MR imaging examinations were selected, resulting in a normal biometry curve according to gestational age for each parameter. Analysis of the ratio parameters showed that vermian lobe ratio and cerebellar hemisphere ratio remain constant with gestational age and that the vermis-to-cisterna magna ratio varies with gestational age. Measurements of the 5 pathologic fetuses are presented on the normal curves. Interobserver agreement was excellent, with the intraclass correlation coefficients of most parameters above 0.9 and only 2 parameters below 0.8. The biometry curves derived from new and existing biometric data and presented in this study may expand and deepen the biometry we use today, while keeping it simple and repeatable. By applying these extensive biometric data on suspected abnormal cases, diagnoses may be confirmed, better classified, or completely altered. © 2015 by American Journal of Neuroradiology.

Measuring physical activity in young people with cerebral palsy: validity and reliability of the ActivPAL™ monitor.

PubMed

Bania, Theofani

2014-09-01

We determined the criterion validity and the retest reliability of the ΑctivPAL™ monitor in young people with diplegic cerebral palsy (CP). Activity monitor data were compared with the criterion of video recording for 10 participants. For the retest reliability, activity monitor data were collected from 24 participants on two occasions. Participants had to have diplegic CP and be between 14 and 22 years of age. They also had to be of Gross Motor Function Classification System level II or III. Outcomes were time spent in standing, number of steps (physical activity) and time spent in sitting (sedentary behaviour). For criterion validity, coefficients of determination were all high (r(2)  ≥ 0.96), and limits of group agreement were relatively narrow, but limits of agreement for individuals were narrow only for number of steps (≥5.5%). Relative reliability was high for number of steps (intraclass correlation coefficient = 0.87) and moderate for time spent in sitting and lying, and time spent in standing (intraclass correlation coefficients = 0.60-0.66). For groups, changes of up to 7% could be due to measurement error with 95% confidence, but for individuals, changes as high as 68% could be due to measurement error. The results support the criterion validity and the retest reliability of the ActivPAL™ to measure physical activity and sedentary behaviour in groups of young people with diplegic CP but not in individuals. Copyright © 2014 John Wiley & Sons, Ltd.

Parent-teacher agreement on children's problems in 21 societies.

PubMed

Rescorla, Leslie A; Bochicchio, Lauren; Achenbach, Thomas M; Ivanova, Masha Y; Almqvist, Fredrik; Begovac, Ivan; Bilenberg, Niels; Bird, Hector; Dobrean, Anca; Erol, Nese; Fombonne, Eric; Fonseca, Antonio; Frigerio, Alessandra; Fung, Daniel S S; Lambert, Michael C; Leung, Patrick W L; Liu, Xianchen; Marković, Ivica; Markovic, Jasminka; Minaei, Asghar; Ooi, Yoon Phaik; Roussos, Alexandra; Rudan, Vlasta; Simsek, Zeynep; van der Ende, Jan; Weintraub, Sheila; Wolanczyk, Tomasz; Woo, Bernardine; Weiss, Bahr; Weisz, John; Zukauskiene, Rita; Verhulst, Frank C

2014-01-01

Parent-teacher cross-informant agreement, although usually modest, may provide important clinical information. Using data for 27,962 children from 21 societies, we asked the following: (a) Do parents report more problems than teachers, and does this vary by society, age, gender, or type of problem? (b) Does parent-teacher agreement vary across different problem scales or across societies? (c) How well do parents and teachers in different societies agree on problem item ratings? (d) How much do parent-teacher dyads in different societies vary in within-dyad agreement on problem items? (e) How well do parents and teachers in 21 societies agree on whether the child's problem level exceeds a deviance threshold? We used five methods to test agreement for Child Behavior Checklist (CBCL) and Teacher's Report Form (TRF) ratings. CBCL scores were higher than TRF scores on most scales, but the informant differences varied in magnitude across the societies studied. Cross-informant correlations for problem scale scores varied moderately across societies studied and were significantly higher for Externalizing than Internalizing problems. Parents and teachers tended to rate the same items as low, medium, or high, but within-dyad item agreement varied widely in every society studied. In all societies studied, both parental noncorroboration of teacher-reported deviance and teacher noncorroboration of parent-reported deviance were common. Our findings underscore the importance of obtaining information from parents and teachers when evaluating and treating children, highlight the need to use multiple methods of quantifying cross-informant agreement, and provide comprehensive baselines for patterns of parent-teacher agreement across 21 societies.

Cross-cultural adaptation and validation of the Turkish version of the pain catastrophizing scale among patients with ankylosing spondylitis

PubMed Central

İlçin, Nursen; Gürpınar, Barış; Bayraktar, Deniz; Savcı, Sema; Çetin, Pınar; Sarı, İsmail; Akkoç, Nurullah

2016-01-01

[Purpose] This study describes the cultural adaptation, validation, and reliability of the Turkish version of the Pain Catastrophizing Scale in patients with ankylosing spondylitis. [Methods] The validity of the Turkish version of the Pain Catastrophizing Scale was assessed by evaluating data quality (missing data and floor and ceiling effects), principal components analysis, internal consistency (Cronbach’s alpha), and construct validity (Spearman’s rho). Reproducibility analyses included standard measurement error, minimum detectable change, limits of agreement, and intraclass correlation coefficients. [Results] Sixty-four adult patients with ankylosing spondylitis with a mean age of 42.2 years completed the study. Factor analysis revealed that all questionnaire items could be grouped into two factors. Excellent internal consistency was found, with a Chronbach’s alpha value of 0.95. Reliability analyses showed an intraclass correlation coefficient (95% confidence interval) of 0.96 for the total score. There was a low correlation coefficient between the Turkish version of the Pain Catastrophizing Scale and body mass index, pain levels at rest and during activity, health-related quality of life, and fear and avoidance behaviors. [Conclusion] The results of this study indicate that the Turkish version of the Pain Catastrophizing Scale is a valid and reliable clinical and research tool for patients with ankylosing spondylitis. PMID:26957778

The validity and reliability of an iPhone app for measuring vertical jump performance.

PubMed

Balsalobre-Fernández, Carlos; Glaister, Mark; Lockey, Richard Anthony

2015-01-01

The purpose of this investigation was to analyse the concurrent validity and reliability of an iPhone app (called: My Jump) for measuring vertical jump performance. Twenty recreationally active healthy men (age: 22.1 ± 3.6 years) completed five maximal countermovement jumps, which were evaluated using a force platform (time in the air method) and a specially designed iPhone app. My jump was developed to calculate the jump height from flight time using the high-speed video recording facility on the iPhone 5 s. Jump heights of the 100 jumps measured, for both devices, were compared using the intraclass correlation coefficient, Pearson product moment correlation coefficient (r), Cronbach's alpha (α), coefficient of variation and Bland-Altman plots. There was almost perfect agreement between the force platform and My Jump for the countermovement jump height (intraclass correlation coefficient = 0.997, P < 0.001; Bland-Altman bias = 1.1 ± 0.5 cm, P < 0.001). In comparison with the force platform, My Jump showed good validity for the CMJ height (r = 0.995, P < 0.001). The results of the present study showed that CMJ height can be easily, accurately and reliably evaluated using a specially developed iPhone 5 s app.

Agreement between ambulatory, home, and office blood pressure variability.

PubMed

Juhanoja, Eeva P; Niiranen, Teemu J; Johansson, Jouni K; Puukka, Pauli J; Jula, Antti M

2016-01-01

Ambulatory, home, and office blood pressure (BP) variability are often treated as a single entity. Our aim was to assess the agreement between these three methods for measuring BP variability. Twenty-four-hour ambulatory BP monitoring, 28 home BP measurements, and eight office BP measurements were performed on 461 population-based or hypertensive participants. Five variability indices were calculated for all measurement methods: SD, coefficient of variation, maximum-minimum difference, variability independent of the mean, and average real variability. Pearson's correlation coefficients were calculated for indices measured with different methods. The agreement between different measurement methods on the diagnoses of extreme BP variability (participants in the highest decile of variability) was assessed with kappa (κ) coefficients. SBP/DBP variability was greater in daytime (coefficient of variation: 9.8 ± 2.9/11.9 ± 3.6) and night-time ambulatory measurements (coefficient of variation: 8.6 ± 3.4/12.1 ± 4.5) than in home (coefficient of variation: 4.4 ± 1.8/4.7 ± 1.9) and office (coefficient of variation: 4.6 ± 2.4/5.2 ± 2.6) measurements (P < 0.001/0.001 for all). Pearson's correlation coefficients for systolic/diastolic daytime or night-time ambulatory-home, ambulatory-office, and home-office variability indices ranged between 0.07-0.25/0.12-0.23, 0.13-0.26/0.03-0.22 and 0.13-0.24/0.10-0.19, respectively, indicating, at most, a weak positive (r < 0.3) relationship. The agreement between measurement methods on diagnoses of extreme SBP/DBP variability was only slight (κ < 0.2), with the κ coefficients for daytime and night-time ambulatory-home, ambulatory-office, and home-office agreement varying between-0.014-0.20/0.061-0.15, 0.037-0.18/0.082-0.15, and 0.082-0.13/0.045-0.15, respectively. Shorter-term and longer-term BP variability assessed by different methods of BP measurement seem to correlate only weakly

Reliability of the Brazilian version of the Physical Activity Checklist Interview in children.

PubMed

Adami, Fernando; Cruciani, Fernanda; Douek, Michelle; Sewell, Carolina Dumit; Mariath, Aline Brandão; Hinnig, Patrícia de Fragas; Freaza, Silvia Rafaela Mascarenhas; Bergamaschi, Denise Pimentel

2011-04-01

To assess the reliability of the Lista de Atividades Físicas (Brazilian version of the Physical Activity Checklist Interview) in children. The study is part of a cross-cultural adaptation of the Physical Activity Checklist Interview, conducted with 83 school children aged between seven and ten years, enrolled between the 2nd and 5th grades of primary education in the city of São Paulo, Southeastern Brazil, in 2008. The questionnaire was responded by children through individual interviews. It is comprised of a list of 21 moderate to vigorous physical activities performed on the previous day, it is divided into periods (before, during and after school) and it has a section for interview assessment. This questionnaire enables the quantification of time spent in physical and sedentary activities and the total and weighed metabolic costs. Reliability was assessed by comparing two interviews conducted with a mean interval of three hours. For the interview assessment, data from the first interview and those from an external evaluator were compared. Bland-Altman's proposal, the intraclass correlation coefficient and Lin's concordance correlation coefficient were used to assess reliability. The intraclass correlation coefficient lower limits for the outcomes analyzed varied from 0.84 to 0.96. Precision and agreement varied between 0.83 and 0.97 and between 0.99 and 1, respectively. The line estimated from the pairs of values obtained in both interviews indicates high data precision. The interview item showing the poorest result was the ability to estimate time (fair in 27.7% of interviews). Interview assessment items showed intraclass correlation coefficients between 0.60 and 0.70, except for level of cooperation (0.46). The Brazilian version of the Physical Activity Checklist Interview shows high reliability to assess physical and sedentary activity on the previous day in children.

Inter-rater Agreement on Final Competency Testing Utilizing Standardized Patients.

PubMed

Bowman, Dixie H; Ferber, Kyle L; Sima, Adam P

2016-01-01

The purpose of this study was to determine whether licensed physical therapists (n=8) serving as standardized patients (SPs) for practical examinations evaluate physical therapy students (n=51) equivalently to the physical therapy course instructor (n=1). The SPs completed the same assessment based on the evaluation criteria as did the instructor. The scores for the practical examination, answers to three questions, and the documentation note were summarized separately for the SP and the instructor by means and standard deviations. A paired t-test and an intraclass correlation coefficient (ICC) for each aspect of the score were calculated. ICC(1,1) values were reported along with corresponding 95% confidence intervals. The instructor had significantly higher scores for the practical exam and the overall score compared to the ratings from the SPs. No differences were observed between the instructor and SP scores on the three answers to the questions and documentation note scores. Based on the ICC values identified in this study, a physical therapist serving as an SP may not be an adequate replacement for an instructor when it comes to grading physical therapy students on all aspects of their competency tests.

Intraclass Correlations for Three-Level Multi-Site Cluster-Randomized Trials of Science Achievement

ERIC Educational Resources Information Center

Westine, Carl D.

2015-01-01

A cluster-randomized trial (CRT) relies on random assignment of intact clusters to treatment conditions, such as classrooms or schools (Raudenbush & Bryk, 2002). One specific type of CRT, a multi-site CRT (MSCRT), is commonly employed in educational research and evaluation studies (Spybrook & Raudenbush, 2009; Spybrook, 2014; Bloom,…

Development and validation of two equations based on anthropometry, estimating body fat for the Greek adult population.

PubMed

Kanellakis, Spyridon; Skoufas, Efstathios; Khudokonenko, Vladlena; Apostolidou, Eftychia; Gerakiti, Loukia; Andrioti, Maria-Chrysi; Bountouvi, Evangelia; Manios, Yannis

2017-02-01

To validate anthropometric equations in the current literature predicting body fat percentage (%BF) in the Greek population, to develop and validate two anthropometric equations estimating %BF, and to compare them with the retrieved equations. Anthropometric data from 642 Greek adults were incorporated. Dual-energy X-ray absorptiometry was used as reference method. The comparison with other equations was made using Bland-Altman analysis, intraclass correlation coefficient, and Lin's concordance correlation coefficient. Nine of the thirty-one retrieved equations had no statistically significant bias. However, all of them had wide limits of agreement (±8.3 to ±16%BF). The equations accrued were: BF% = -0.615-10.948 × sex + 0.321 × waist circumference + 0.502 × hips circumference-0.39 × forearm circumference - 19.768 × height (m) and BF% = -27.787-5.515 × sex-8.419 × height + 0.145 × waist circumference + 0.270 × hips circumference + 7.509 × log of thigh skinfold + 20.090 × log of sum of skinfolds (bicep + tricep + suprailiac + subscapular)-0.445 × forearm circumference. Bland-Altman's reliability analysis showed no significant bias of -0.058 and -0.148%BF and limits of agreement ±8.100 and ±6.056%BF; the intraclass correlation coefficient was 0.955 and 0.976; and Lin's concordance correlation coefficient was 0.914 and 0.951, respectively. Literature equations performed moderately on this study's population. Therefore, two equations were designed and validated. The first one was simple and easily applicable, with measures obtained from a measuring tape, and the second one more complicated yet more accurate and reliable. Both were found to be reliable for the assessment of body composition in the Greek population. © 2017 The Obesity Society.

Agreement and reliability of pelvic floor measurements during rest and on maximum Valsalva maneuver using three-dimensional translabial ultrasound and virtual reality imaging.

PubMed

Speksnijder, L; Oom, D M J; Koning, A H J; Biesmeijer, C S; Steegers, E A P; Steensma, A B

2016-08-01

Imaging of the levator ani hiatus provides valuable information for the diagnosis and follow-up of patients with pelvic organ prolapse (POP). This study compared measurements of levator ani hiatal volume during rest and on maximum Valsalva, obtained using conventional three-dimensional (3D) translabial ultrasound and virtual reality imaging. Our objectives were to establish their agreement and reliability, and their relationship with prolapse symptoms and POP quantification (POP-Q) stage. One hundred women with an intact levator ani were selected from our tertiary clinic database. Information on clinical symptoms were obtained using standardized questionnaires. Ultrasound datasets were analyzed using a rendered volume with a slice thickness of 1.5 cm, at the level of minimal hiatal dimensions, during rest and on maximum Valsalva. The levator area (in cm(2) ) was measured and multiplied by 1.5 to obtain the levator ani hiatal volume (in cm(3) ) on conventional 3D ultrasound. Levator ani hiatal volume (in cm(3) ) was measured semi-automatically by virtual reality imaging using a segmentation algorithm. Twenty patients were chosen randomly to analyze intra- and interobserver agreement. The mean difference between levator hiatal volume measurements on 3D ultrasound and by virtual reality was 1.52 cm(3) (95% CI, 1.00-2.04 cm(3) ) at rest and 1.16 cm(3) (95% CI, 0.56-1.76 cm(3) ) during maximum Valsalva (P < 0.001). Both intra- and interobserver intraclass correlation coefficients were ≥ 0.96 for conventional 3D ultrasound and > 0.99 for virtual reality. Patients with prolapse symptoms or POP-Q Stage ≥ 2 had significantly larger hiatal measurements than those without symptoms or POP-Q Stage < 2. Levator ani hiatal volume at rest and on maximum Valsalva is significantly smaller when using virtual reality compared with conventional 3D ultrasound; however, this difference does not seem clinically important. Copyright © 2015 ISUOG. Published by

MIDAS and HIT-6 French translation: reliability and correlation between tests.

PubMed

Magnoux, E; Freeman, M A; Zlotnik, G

2008-01-01

, with a median of 19 days. The Shrout-Fleiss intraclass correlation coefficients for MIDAS and HIT-6 were, respectively, 0.76 and 0.77 for episodic headaches and 0.83 and 0.80 for chronic headaches. The Pearson correlation coefficient between the MIDAS and HIT-6 questionnaires was 0.48 for episodic headaches and 0.58 for chronic headaches at the first compilation and 0.42 and 0.59 at the second compilation. The test-retest intraclass correlation of the French versions for both MIDAS and HIT-6 questionnaires indicates moderate reliability for episodic headache and substantial reliability for chronic headache. The correlation between the MIDAS and HIT-6 questionnaires is weak for episodic headaches, but approaches a level of 'good' for chronic headaches.

Reliability of mercury-in-silastic strain gauge plethysmography curve reading: influence of clinical clues and observer variation.

PubMed

Høyer, Christian; Pavar, Susanne; Pedersen, Begitte H; Biurrun Manresa, José A; Petersen, Lars J

2013-08-01

Mercury-in-silastic strain gauge pletysmography (SGP) is a well-established technique for blood flow and blood pressure measurements. The aim of this study was to examine (i) the possible influence of clinical clues, e.g. the presence of wounds and color changes during blood pressure measurements, and (ii) intra- and inter-observer variation of curve interpretation for segmental blood pressure measurements. A total of 204 patients with known or suspected peripheral arterial disease (PAD) were included in a diagnostic accuracy trial. Toe and ankle pressures were measured in both limbs, and primary observers analyzed a total of 804 pressure curve sets. The SGP curves were later reanalyzed separately by two observers blinded to clinical clues. Intra- and inter-observer agreement was quantified using Cohen's kappa and reliability was quantified using intra-class correlation coefficients, coefficients of variance, and Bland-Altman analysis. There was an overall agreement regarding patient diagnostic classification (PAD/not PAD) in 202/204 (99.0%) for intra-observer (κ = 0.969, p < 0.001), and 201/204 (98.5%) for inter-observer readings (κ = 0.953, p < 0.001). Reliability analysis showed excellent correlation between blinded versus non-blinded and inter-observer readings for determination of absolute segmental pressures (all intraclass correlation coefficients ≥ 0.984). The coefficient of variance for determination of absolute segmental blood pressure ranged from 2.9-3.4% for blinded/non-blinded data and from 3.8-5.0% for inter-observer data. This study shows a low inter-observer variation among experienced laboratory technicians for reading strain gauge curves. The low variation between blinded/non-blinded readings indicates that SGP measurements are minimally biased by clinical clues.

Predicting Phonetic Transcription Agreement: Insights from Research in Infant Vocalizations

ERIC Educational Resources Information Center

Ramsdell, Heather L.; Oller, D. Kimbrough; Ethington, Corinna A.

2007-01-01

The purpose of this study is to provide new perspectives on correlates of phonetic transcription agreement. Our research focuses on phonetic transcription and coding of infant vocalizations. The findings are presumed to be broadly applicable to other difficult cases of transcription, such as found in severe disorders of speech, which similarly…

Arabic cross cultural adaptation and validation of the National Institutes of Health Stroke Scale.

PubMed

Hussein, Haitham M; Abdel Moneim, Amr; Emara, Tamer; Abd-Elhamid, Yousry A; Salem, Haitham H; Abd-Allah, Foad; Farrag, Mohammad A; Tork, M Amir; Shalash, Ali S; Ezz El Dein, Khaled H; Osman, Gamaleldin; Georgy, Shady S; Ghali, Peter G; Lyden, Patrick D; Moustafa, Ramez R

2015-10-15

The National Institutes of Health Stroke Scale (NIHSS), the most commonly used tool to quantify neurological deficit in acute stroke, was initially developed in English. We present our experience in developing and validating an Arabic version of the NIHSS (arNIHSS). In 6months, 137 patients were recruited (mean age±standard deviation 62±12years; 48 women). For interrater agreement, weighted kappa value ranged from 0.36 to 0.66 and intraclass correlation coefficient (ICC) for the whole scale was excellent at 0.95 (95% confidence interval [CI] 0.94-0.97). For intrarater agreement, weighted kappa ranged from 0.52 to 1.0 and the ICC was 0.94 (95% CI 0.87-0.98). The construct validity of the arNIHSS is demonstrated by its correlation with the DWI-ASPECT and the 3months mRS score (Spearman correlation -0.46 and 0.58 respectively; P<0.001 for both). We developed and validated a culturally adapted Arabic version of the NIHSS. Further validation in other Arab countries is recommended. Copyright © 2015 Elsevier B.V. All rights reserved.

46 CFR 298.38 - Partnership agreements and limited liability company agreements.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 46 Shipping 8 2010-10-01 2010-10-01 false Partnership agreements and limited liability company... liability company agreements. Partnership and limited liability company agreements must be in form and...) Duration of the entity; (b) Adequate partnership or limited liability company funding requirements and...

Reliability of the detailed assessment of speed of handwriting on Flemish children.

PubMed

Simons, Johan; Probst, Michel

2014-01-01

This study evaluates the reliability of the Detailed Assessment of Speed of Handwriting (DASH) in a Dutch-speaking sample of children. The sample included 650 boys and 513 girls (age range = 9-16 years). Handwriting speed measurements were obtained using the DASH. Interrater agreement, test-retest reliability, and internal consistency were calculated; gender and age effects were analyzed. Interrater agreement shows excellent reliability with intraclass correlation coefficients of at least 0.94. Test-retest correlations ranged from r = 0.65 to r = 0.81. The internal consistency measures, calculated with Cronbach's alpha, were between 0.88 and 0.94. Both gender and age have a significant effect on handwriting speed, with F (7.1144) = 17.43 (P < .001) for gender and F (7.1144) = 21.8 (P < .001) for age. The DASH is a reliable assessment tool to evaluate handwriting speed of Dutch-speaking children. There is a tendency of girls to write faster than boys.

Validation of mid-infrared spectroscopy for macronutrient analysis of human milk.

PubMed

Parat, S; Groh-Wargo, S; Merlino, S; Wijers, C; Super, D M

2017-07-01

Human milk has considerable variation in its composition. Hence, the nutrient profile is only an estimate and can result in under- or over-estimation of the intake of preterm infants. Mid-infrared (MIR) spectroscopy is an evolving technique for analyzing human milk but needs validation before use in clinical practice. Human milk samples from 35 mothers delivering at 35 weeks to term gestation were analyzed for macronutrients by MIR spectroscopy and by standard laboratory methods using Kjeldahl assay for protein, Mojonnier assay for fat and high-pressure liquid chromatography assay for lactose. MIR analysis of the macronutrients in human milk correlated well with standard laboratory tests with intraclass correlation coefficients of 0.997 for fat, 0.839 for protein and 0.776 for lactose. Agreement between the two methods was excellent for fat, and moderate for protein and lactose (P<0.001). This methodological paper provides evidence that MIR spectroscopy can be used to analyze macronutrient composition of human milk. Agreement between the methodologies varies by macronutrient.

Utility of Urinary Protein-Creatinine Ratio and Protein Content in a 24-Hour Urine Collection in Systemic Lupus Erythematosus: A Systematic Review and Meta-Analysis.

PubMed

Medina-Rosas, Jorge; Yap, Kristy S; Anderson, Melanie; Su, Jiandong; Touma, Zahi

2016-09-01

To systematically review literature on the utility of spot urinary protein-creatinine ratio (PCR) as a screening test for proteinuria and its ability to accurately measure proteinuria compared with 24-hour urine collection (24H-P) in patients with systemic lupus erythematosus (SLE). We conducted a literature search (1900-2015) for articles comparing PCR and 24H-P in SLE patients in the databases Medline, Web of Science, and Embase. Included studies and their results were critically appraised and analyzed. Thirteen studies (1,001 patients; 84.01% women) were included. Ten studies reported on Pearson's correlation (range 0.67-0.94), and 3 studies reported on Spearman's correlation (range 0.78-1.00). The meta-analysis of studies with Pearson's correlation showed a high overall correlation of 0.80 between 24H-P and PCR, yet with high heterogeneity (I(2)  = 97.2%). Correlation analysis is not sufficient to evaluate the utility of a new test against the gold standard test, and analysis on agreement is required. Seven studies reported on agreement: 3 studies analyzed concordance correlation coefficient (0.48-0.94), 3 analyzed intraclass correlation coefficient (0.66-0.95), and 1 analyzed kappa coefficient (0.58). These results confirmed that the agreement between 24H-P and PCR was inappropriate. Three studies included Bland-Altman plots, and the results also demonstrated poor agreement between both tests. The PCR has a utility as a screening test for proteinuria in SLE patients. The studies' results of 24H-P and PCR showed poor agreement between both tests, signifying that PCR should not be a substitute for the gold standard test (24H-P) to accurately measure proteinuria. © 2016, American College of Rheumatology.

Spanish translation and validation of four short pelvic floor disorders questionnaires.

PubMed

Treszezamsky, Alejandro D; Karp, Deborah; Dick-Biascoechea, Madeline; Ehsani, Nazanin; Dancz, Christina; Montoya, T Ignacio; Olivera, Cedric K; Smith, Aimee L; Cardenas, Rosa; Fashokun, Tola; Bradley, Catherine S

2013-04-01

Globally, Spanish is the primary language for 329 million people; however, most urogynecologic questionnaires are available in English. We set out to develop valid Spanish translations of the Questionnaire for Urinary Incontinence Diagnosis (QUID), the Three Incontinence Questions (3IQ), and the short Pelvic Floor Distress Inventory (PFDI-20) and Pelvic Floor Impact Questionnaire (PFIQ-7). The TRAPD method (translation, review, adjudication, pretesting, and documentation) was used for translation. Eight native Spanish-speaking translators developed Spanish versions collaboratively. These were pretested with cognitive interviews and revised until optimal. For validation, bilingual patients at seven clinics completed Spanish and English questionnaire versions in randomized order. Participants completed a second set of questionnaires later. The Spanish versions' internal consistency and reliability and Spanish-English agreement were measured using Cronbach's alpha, weighted kappa, and intraclass correlation coefficients. A total of 78 subjects were included; 94.9 % self-identified as Hispanic and 73.1 % spoke Spanish as their primary language. The proportion of per-item missing responses was similar in both languages (median 1.3 %). Internal consistency for Spanish PFDI-20 subscales was acceptable to good and for PFIQ-7 and QUID excellent. Test-retest reliability per item was moderate to near perfect for PFDI-20, substantial to near perfect for PFIQ-7 and 3IQ, and substantial for QUID. Spanish-English agreement for individual items was substantial to near perfect for all questionnaires (kappa range 0.64-0.95) and agreement for PFDI-20, PFIQ-7, and QUID subscales scores was high [intraclass correlation coefficient (ICC) range 0.92-0.99]. We obtained valid Spanish translations of the PFDI-20, PFIQ-7, QUID, and 3IQ. These results support their use as clinical and research assessment tools in Spanish-speaking populations.

Use of Chest Wall Electromyography to Detect Respiratory Effort during Polysomnography

PubMed Central

Berry, Richard B.; Ryals, Scott; Girdhar, Ankur; Wagner, Mary H.

2016-01-01

Study Objectives: To evaluate the ability of chest wall EMG (CW-EMG) using surface electrodes to classify apneas as obstructive, mixed, or central compared to classification using dual channel uncalibrated respiratory inductance plethysmography (RIP). Methods: CW-EMG was recorded from electrodes in the eighth intercostal space at the right mid-axillary line. Consecutive adult clinical sleep studies were retrospectively reviewed, and the first 60 studies with at least 10 obstructive and 10 mixed or central apneas and technically adequate tracings were selected. Four obstructive and six central or mixed apneas (as classified by previous clinical scoring) were randomly selected. A blinded experienced scorer classified the apneas on the basis of tracings showing either RIP channels or the CW-EMG channel. The agreement using the two classification methods was determined by kappa analysis and intraclass correlation. Results: The percentage agreement was 89.5%, the kappa statistic was 0.83 (95% confidence interval 0.79 to 0.87), and the intraclass correlation was 0.83, showing good agreement. Of the 249 apneas classified as central by RIP, 26 were classified as obstructive (10.4%) and 7 as mixed (2.8%) by CW-EMG. Of the 229 events classified as central by CW-EMG, 7 (3.1%) were classified as obstructive and 6 (2.6%) as mixed by RIP. Conclusions: Monitoring CW-EMG may provide a clinically useful method of detection of respiratory effort when used with RIP and can prevent false classification of apneas as central. RIP can rarely detect respiratory effort not easily discernible by CW-EMG and the combination of the two methods is more likely to avoid apnea misclassification. Citation: Berry RB, Ryals S, Girdhar A, Wagner MH. Use of chest wall electromyography to detect respiratory effort during polysomnography. J Clin Sleep Med 2016;12(9):1239–1244. PMID:27306391

Accuracy of CBCT for volumetric measurement of simulated periapical lesions.

PubMed

Ahlowalia, M S; Patel, S; Anwar, H M S; Cama, G; Austin, R S; Wilson, R; Mannocci, F

2013-06-01

To compare the accuracy of cone beam computed tomography (CBCT) and micro-computed tomography (μCT) when measuring the volume of bone cavities. Ten irregular-shaped cavities of varying dimensions were created in bovine bone specimens using a rotary diamond bur. The samples were then scanned using the Accuitomo 3D CBCT scanner. The scanned information was converted to the Digital Imaging and Communication in Medicine (DICOM) format ready for analysis. Once formatted, 10 trained and calibrated examiners segmented the scans and measured the volumes of the lesions. Intra/interexaminer agreement was assessed by each examiner re-segmenting each scan after a 2-week interval. Micro-CT scans were analysed by a single examiner. To achieve a physical reading of the artificially created cavities, replicas were created using dimensionally stable silicone impression material. After measuring the mass of each impression sample, the volume was calculated by dividing the mass of each sample by the density of the set impression material. Further corroboration of these measurements was obtained by employing Archimedes' principle to measure the volume of each impression sample. Intraclass correlation was used to assess agreement. Both CBCT (mean volume: 175.9 mm3) and μCT (mean volume: 163.1 mm3) showed a high degree of agreement (intraclass correlation coefficient >0.9) when compared to both weighed and 'Archimedes' principle' measurements (mean volume: 177.7 and 182.6 mm3, respectively). Cone beam computed tomography is an accurate means of measuring volume of artificially created bone cavities in an ex vivo model. This may provide a valuable tool for monitoring the healing rate of apical periodontitis; further investigations are warranted. © 2012 International Endodontic Journal. Published by Blackwell Publishing Ltd.

Shear wave elastography for breast masses is highly reproducible.

PubMed

Cosgrove, David O; Berg, Wendie A; Doré, Caroline J; Skyba, Danny M; Henry, Jean-Pierre; Gay, Joel; Cohen-Bacrie, Claude

2012-05-01

To evaluate intra- and interobserver reproducibility of shear wave elastography (SWE) for breast masses. For intraobserver reproducibility, each observer obtained three consecutive SWE images of 758 masses that were visible on ultrasound. 144 (19%) were malignant. Weighted kappa was used to assess the agreement of qualitative elastographic features; the reliability of quantitative measurements was assessed by intraclass correlation coefficients (ICC). For the interobserver reproducibility, a blinded observer reviewed images and agreement on features was determined. Mean age was 50 years; mean mass size was 13 mm. Qualitatively, SWE images were at least reasonably similar for 666/758 (87.9%). Intraclass correlation for SWE diameter, area and perimeter was almost perfect (ICC ≥ 0.94). Intraobserver reliability for maximum and mean elasticity was almost perfect (ICC = 0.84 and 0.87) and was substantial for the ratio of mass-to-fat elasticity (ICC = 0.77). Interobserver agreement was moderate for SWE homogeneity (κ = 0.57), substantial for qualitative colour assessment of maximum elasticity (κ = 0.66), fair for SWE shape (κ = 0.40), fair for B-mode mass margins (κ = 0.38), and moderate for B-mode mass shape (κ = 0.58), orientation (κ = 0.53) and BI-RADS assessment (κ = 0.59). SWE is highly reproducible for assessing elastographic features of breast masses within and across observers. SWE interpretation is at least as consistent as that of BI-RADS ultrasound B-mode features. • Shear wave ultrasound elastography can measure the stiffness of breast tissue • It provides a qualitatively and quantitatively interpretable colour-coded map of tissue stiffness • Intraobserver reproducibility of SWE is almost perfect while intraobserver reproducibility of SWE proved to be moderate to substantial • The most reproducible SWE features between observers were SWE image homogeneity and maximum elasticity.

Self-proxy agreement and correlates of health-related quality of life in young adults with epilepsy and mild intellectual disabilities.

PubMed

Zimmermann, Friederike; Endermann, Michael

2008-07-01

This study investigated health-related quality of life (HRQOL) in young adults with epilepsy and intellectual disabilities. First, agreement between self-reports and proxy reports of HRQOL was examined. Second, medical and psychological contributions to HRQOL were explored. Thirty-six patients were interviewed using the Quality of Life in Epilepsy inventory (QOLIE-31), the Hospital Anxiety and Depression Scale, and the Neuroticism and Extraversion scales of the NEO Five-Factor Inventory. Medical data were taken from files. Professional caregivers completed rephrased QOLIE-31-questionnaires. The perspectives on HRQOL differed systematically: Caregivers underrated their clients' HRQOL on average. Few correlations with medical characteristics emerged, whereas all psychological variables were strongly related to HRQOL. Neuroticism, Age at Disability Onset, and their interaction explained 71% of the HRQOL variance. Results indicate that proxy reports do not provide valid substitutes for most of the self-reported HRQOL subscales. Psychological treatment of negative affectivity and after critical life events in adolescence may improve HRQOL in young adults with epilepsy and mild intellectual disabilities.

Reliability of self-reported weight and height among state bank employees.

PubMed

Chor, D; Coutinho, E da S; Laurenti, R

1999-02-01

Self-reported weight and height were compared with direct measurements in order to evaluate the agreement between the two sources. Data were obtained from a cross-sectional study on health status from a probabilistic sample of 1,183 employees of a bank, in Rio de Janeiro State, Brazil. Direct measurements were made of 322 employees. Differences between the two sources were evaluated using mean differences, limits of agreement and intraclass correlation coefficient (ICC). Men and women tended to underestimate their weight while differences between self-reported and measured height were insignificant. Body mass index (BMI) mean differences were smaller than those observed for weight. ICC was over 0.98 for weight and 0.95 for BMI, expressing close agreement. Combining a graphical method with ICC may be useful in pilot studies to detect populational groups capable of providing reliable information on weight and height, thus minimizing resources needed for field work.

Telepsychiatry: assessment of televideo psychiatric interview reliability with present- and next-generation internet infrastructures.

PubMed

Yoshino, A; Shigemura, J; Kobayashi, Y; Nomura, S; Shishikura, K; Den, R; Wakisaka, H; Kamata, S; Ashida, H

2001-09-01

We assessed the reliability of remote video psychiatric interviews conducted via the internet using narrow and broad bandwidths. Televideo psychiatric interviews conducted with 42 in-patients with chronic schizophrenia using two bandwidths (narrow, 128 kilobits/s; broad, 2 megabits/s) were assessed in terms of agreement with face-to-face interviews in a test-retest fashion. As a control, agreement was assessed between face-to-face interviews. Psychiatric symptoms were rated using the Oxford version of the Brief Psychiatric Rating Scale (BPRS), and agreement between interviews was estimated as the intraclass correlation coefficient (ICC). The ICC was significantly lower in the narrow bandwidth than in the broad bandwidth and the control for both positive symptoms score and total score. While reliability of televideo psychiatric interviews is insufficient using the present narrow-band internet infrastructure, the next generation of infrastructure (broad-band) may permit reliable diagnostic interviews.

Technology Partnership Agreements | NREL

Science.gov Websites

Partnership Agreements Technology Partnership Agreements Looking for Funding? We do not fund any projects under a technology partnership agreement. The partner provides the necessary resources and, in using technology partnership agreements. See a summary of our Fiscal Year 2017 technology partnership

22 CFR 124.6 - Termination of manufacturing license agreements and technical assistance agreements.

Code of Federal Regulations, 2010 CFR

2010-04-01

... and technical assistance agreements. 124.6 Section 124.6 Foreign Relations DEPARTMENT OF STATE... Termination of manufacturing license agreements and technical assistance agreements. The U.S. party to a manufacturing license or a technical assistance agreement must inform the Directorate of Defense Trade Controls...

Intravoxel Incoherent Motion in Normal Pituitary Gland: Initial Study with Turbo Spin-Echo Diffusion-Weighted Imaging.

PubMed

Kamimura, K; Nakajo, M; Fukukura, Y; Iwanaga, T; Saito, T; Sasaki, M; Fujisaki, T; Takemura, A; Okuaki, T; Yoshiura, T

2016-12-01

DWI with conventional single-shot EPI of the pituitary gland is hampered by strong susceptibility artifacts. Our purpose was to evaluate the feasibility of intravoxel incoherent motion assessment by using DWI based on TSE of the normal anterior pituitary lobe. The intravoxel incoherent motion parameters, including the true diffusion coefficient (D), the perfusion fraction (f), and the pseudo-diffusion coefficient (D*), were obtained with TSE-DWI in 5 brain regions (the pons, the WM and GM of the vermis, and the genu and splenium of the corpus callosum) in 8 healthy volunteers, and their agreement with those obtained with EPI-DWI was evaluated by using the intraclass correlation coefficient. The 3 intravoxel incoherent motion parameters in the anterior pituitary lobe were compared with those in the brain regions by using the Dunnett test. The agreement between TSE-DWI and EPI-DWI was moderate (intraclass correlation coefficient = 0.571) for D, substantial (0.699) for f', but fair (0.405) for D*. D in the anterior pituitary lobe was significantly higher than in the 5 brain regions (P < .001). The f in the anterior pituitary lobe was significantly higher than in the 5 brain regions (P < .001), except for the vermian GM. The pituitary D* was not significantly different from that in the 5 brain regions. Our results demonstrated the feasibility of intravoxel incoherent motion assessment of the normal anterior pituitary lobe by using TSE-DWI. High D and f values in the anterior pituitary lobe were thought to reflect its microstructural and perfusion characteristics. © 2016 by American Journal of Neuroradiology.

Verification of a computer-aided replica technique for evaluating prosthesis adaptation using statistical agreement analysis.

PubMed

Mai, Hang-Nga; Lee, Kyeong Eun; Lee, Kyu-Bok; Jeong, Seung-Mi; Lee, Seok-Jae; Lee, Cheong-Hee; An, Seo-Young; Lee, Du-Hyeong

2017-10-01

The purpose of this study was to evaluate the reliability of computer-aided replica technique (CART) by calculating its agreement with the replica technique (RT), using statistical agreement analysis. A prepared metal die and a metal crown were fabricated. The gap between the restoration and abutment was replicated using silicone indicator paste (n = 25). Gap measurements differed in the control (RT) and experimental (CART) groups. In the RT group, the silicone replica was manually sectioned, and the marginal and occlusal gaps were measured using a microscope. In the CART group, the gap was digitized using optical scanning and image superimposition, and the gaps were measured using a software program. The agreement between the measurement techniques was evaluated by using the 95% Bland-Altman limits of agreement and concordance correlation coefficients (CCC). The least acceptable CCC was 0.90. The RT and CART groups showed linear association, with a strong positive correlation in gap measurements, but without significant differences. The 95% limits of agreement between the paired gap measurements were 3.84% and 7.08% of the mean. The lower 95% confidence limits of CCC were 0.9676 and 0.9188 for the marginal and occlusal gap measurements, respectively, and the values were greater than the allowed limit. The CART is a reliable digital approach for evaluating the fit accuracy of fixed dental prostheses.

Simple Method to Estimate Mean Heart Dose From Hodgkin Lymphoma Radiation Therapy According to Simulation X-Rays

DOE Office of Scientific and Technical Information (OSTI.GOV)

Nimwegen, Frederika A. van; Cutter, David J.; Oxford Cancer Centre, Oxford University Hospitals NHS Trust, Oxford

Purpose: To describe a new method to estimate the mean heart dose for Hodgkin lymphoma patients treated several decades ago, using delineation of the heart on radiation therapy simulation X-rays. Mean heart dose is an important predictor for late cardiovascular complications after Hodgkin lymphoma (HL) treatment. For patients treated before the era of computed tomography (CT)-based radiotherapy planning, retrospective estimation of radiation dose to the heart can be labor intensive. Methods and Materials: Patients for whom cardiac radiation doses had previously been estimated by reconstruction of individual treatments on representative CT data sets were selected at random from a case–controlmore » study of 5-year Hodgkin lymphoma survivors (n=289). For 42 patients, cardiac contours were outlined on each patient's simulation X-ray by 4 different raters, and the mean heart dose was estimated as the percentage of the cardiac contour within the radiation field multiplied by the prescribed mediastinal dose and divided by a correction factor obtained by comparison with individual CT-based dosimetry. Results: According to the simulation X-ray method, the medians of the mean heart doses obtained from the cardiac contours outlined by the 4 raters were 30 Gy, 30 Gy, 31 Gy, and 31 Gy, respectively, following prescribed mediastinal doses of 25-42 Gy. The absolute-agreement intraclass correlation coefficient was 0.93 (95% confidence interval 0.85-0.97), indicating excellent agreement. Mean heart dose was 30.4 Gy with the simulation X-ray method, versus 30.2 Gy with the representative CT-based dosimetry, and the between-method absolute-agreement intraclass correlation coefficient was 0.87 (95% confidence interval 0.80-0.95), indicating good agreement between the two methods. Conclusion: Estimating mean heart dose from radiation therapy simulation X-rays is reproducible and fast, takes individual anatomy into account, and yields results comparable to the labor

Simple method to estimate mean heart dose from Hodgkin lymphoma radiation therapy according to simulation X-rays.

PubMed

van Nimwegen, Frederika A; Cutter, David J; Schaapveld, Michael; Rutten, Annemarieke; Kooijman, Karen; Krol, Augustinus D G; Janus, Cécile P M; Darby, Sarah C; van Leeuwen, Flora E; Aleman, Berthe M P

2015-05-01

To describe a new method to estimate the mean heart dose for Hodgkin lymphoma patients treated several decades ago, using delineation of the heart on radiation therapy simulation X-rays. Mean heart dose is an important predictor for late cardiovascular complications after Hodgkin lymphoma (HL) treatment. For patients treated before the era of computed tomography (CT)-based radiotherapy planning, retrospective estimation of radiation dose to the heart can be labor intensive. Patients for whom cardiac radiation doses had previously been estimated by reconstruction of individual treatments on representative CT data sets were selected at random from a case-control study of 5-year Hodgkin lymphoma survivors (n=289). For 42 patients, cardiac contours were outlined on each patient's simulation X-ray by 4 different raters, and the mean heart dose was estimated as the percentage of the cardiac contour within the radiation field multiplied by the prescribed mediastinal dose and divided by a correction factor obtained by comparison with individual CT-based dosimetry. According to the simulation X-ray method, the medians of the mean heart doses obtained from the cardiac contours outlined by the 4 raters were 30 Gy, 30 Gy, 31 Gy, and 31 Gy, respectively, following prescribed mediastinal doses of 25-42 Gy. The absolute-agreement intraclass correlation coefficient was 0.93 (95% confidence interval 0.85-0.97), indicating excellent agreement. Mean heart dose was 30.4 Gy with the simulation X-ray method, versus 30.2 Gy with the representative CT-based dosimetry, and the between-method absolute-agreement intraclass correlation coefficient was 0.87 (95% confidence interval 0.80-0.95), indicating good agreement between the two methods. Estimating mean heart dose from radiation therapy simulation X-rays is reproducible and fast, takes individual anatomy into account, and yields results comparable to the labor-intensive representative CT-based method. This simpler method may produce a

Assessing distractors and teamwork during surgery: developing an event-based method for direct observation.

PubMed

Seelandt, Julia C; Tschan, Franziska; Keller, Sandra; Beldi, Guido; Jenni, Nadja; Kurmann, Anita; Candinas, Daniel; Semmer, Norbert K

2014-11-01

To develop a behavioural observation method to simultaneously assess distractors and communication/teamwork during surgical procedures through direct, on-site observations; to establish the reliability of the method for long (>3 h) procedures. Observational categories for an event-based coding system were developed based on expert interviews, observations and a literature review. Using Cohen's κ and the intraclass correlation coefficient, interobserver agreement was assessed for 29 procedures. Agreement was calculated for the entire surgery, and for the 1st hour. In addition, interobserver agreement was assessed between two tired observers and between a tired and a non-tired observer after 3 h of surgery. The observational system has five codes for distractors (door openings, noise distractors, technical distractors, side conversations and interruptions), eight codes for communication/teamwork (case-relevant communication, teaching, leadership, problem solving, case-irrelevant communication, laughter, tension and communication with external visitors) and five contextual codes (incision, last stitch, personnel changes in the sterile team, location changes around the table and incidents). Based on 5-min intervals, Cohen's κ was good to excellent for distractors (0.74-0.98) and for communication/teamwork (0.70-1). Based on frequency counts, intraclass correlation coefficient was excellent for distractors (0.86-0.99) and good to excellent for communication/teamwork (0.45-0.99). After 3 h of surgery, Cohen's κ was 0.78-0.93 for distractors, and 0.79-1 for communication/teamwork. The observational method developed allows a single observer to simultaneously assess distractors and communication/teamwork. Even for long procedures, high interobserver agreement can be achieved. Data collected with this method allow for investigating separate or combined effects of distractions and communication/teamwork on surgical performance and patient outcomes. Published by the

Reliability and Validity of 2 Self-Report Measures to Assess Sedentary Behavior in Older Adults.

PubMed

Gennuso, Keith P; Matthews, Charles E; Colbert, Lisa H

2015-05-01

The purpose of this study was to examine the reliability and validity of 2 currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults. Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin's concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity. Both surveys had moderate test-retest reliability (ICC: YPAS = 0.59 (P < .001), CHAMPS = 0.64 (P < .001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ = -0.0003); however, there was a linear increase (P < .01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin's r = .005; 95% CI, -0.010 to 0.020), and no linear trend across CHAMPS quartiles (P = .53). Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research.

Reliability and Validity of Two Self-report Measures to Assess Sedentary Behavior in Older Adults

PubMed Central

Gennuso, Keith P.; Matthews, Charles E.; Colbert, Lisa H.

2015-01-01

Background The purpose of this study was to examine the reliability and validity of two currently available physical activity surveys for assessing time spent in sedentary behavior (SB) in older adults. Methods Fifty-eight adults (≥65 years) completed the Yale Physical Activity Survey for Older Adults (YPAS) and Community Health Activities Model Program for Seniors (CHAMPS) before and after a 10-day period during which they wore an ActiGraph accelerometer (ACC). Intraclass correlation coefficients (ICC) examined test-retest reliability. Overall percent agreement and a kappa statistic examined YPAS validity. Lin’s concordance correlation, Pearson correlation, and Bland-Altman analysis examined CHAMPS validity. Results Both surveys had moderate test-retest reliability (ICC: YPAS=0.59 (P<0.001), CHAMPS=0.64 (P<0.001)) and significantly underestimated SB time. Agreement between YPAS and ACC was low (κ=−0.0003); however, there was a linear increase (P< 0.01) in ACC-derived SB time across YPAS response categories. There was poor agreement between ACC-derived SB and CHAMPS (Lin’s r=0.005; 95% CI, −0.010 to 0.020), and no linear trend across CHAMPS quartiles (p=0.53). Conclusions Neither of the surveys should be used as the sole measure of SB in a study; though the YPAS has the ability to rank individuals, providing it with some merit for use in correlational SB research. PMID:25110344

The relationship between consumer insight and provider-consumer agreement regarding consumer's quality of life.

PubMed

Hasson-Ohayon, Ilanit; Roe, David; Kravetz, Shlomo; Levy-Frank, Itamar; Meir, Taly

2011-10-01

This study examined the relationship between insight and mental health consumers and providers agreement regarding consumers rated quality of life (QoL). Seventy mental health consumers and their 23 care providers filled-out parallel questionnaires designed to measure consumer QoL. Consumers' insight was also assessed. For most QoL domains, agreement between consumers and providers was higher for persons with high insight. For the Psychological well being dimension a negative correlation was uncovered for persons with low insight indicating disagreement between consumer and provider. These findings are discussed within the context of the literature on insight and agreement between consumer and provider as related to the therapeutic alliance.

Grading of Total Mesorectal Excision Specimens: Assessment of Interrater Agreement.

PubMed

Goebel, Emily A; Stegmaier, Melissa; Gorassini, Donald R; Kubica, Matthew; Parfitt, Jeremy R; Driman, David K

2018-06-01

Total mesorectal excision is the standard of care for patients with rectal cancer. Pathological evaluation of the quality of the total mesorectal excision specimen is an important prognostic factor that correlates with local recurrence, but is potentially subjective. This study aimed to determine the degree of variation in grading, both between assessors and between fresh and formalin-fixed specimens. Raters included surgeons, pathologists, pathology residents, pathologists' assistants, and pathologists' assistant trainees. Specimens were assessed by up to 6 raters in the fresh state and by 2 raters postfixation. Four parameters were evaluated: mesorectal bulk, surface regularity, defects, and coning. Interrater agreement was measured using ordinal α-values. The study was conducted at a single academic center. The primary outcome was agreement between individuals when grading total mesorectal excision specimens. A total of 37 total mesorectal excision specimens were assessed. Reliability between all raters for fresh specimens for mesorectal bulk, surface regularity, defects, coning, and overall grade were 0.85, 0.85, 0.92, 0.84, and 0.91. When compared with all raters, pathologists and residents had higher agreement and pathologists and surgeons had lower agreement. Ordinal α-values comparing pathologist and pathologist's assistant agreement for overall grade were similar pre- and postfixation (0.78 vs 0.80), but agreement for assessing defects decreased postfixation. Among pathologists' assistants, agreement was higher when grading specimens postfixation than when grading fresh specimens. Assessment bias may have occurred because of the greater number of pathologists' assistants participating than the number of residents and pathologists. The results indicate good interrater agreement for the assessment of overall grade, with defects showing the best interrater agreement in fresh specimens. Although total mesorectal excision specimens may be consistently graded

AHRQ's hospital survey on patient safety culture: psychometric analyses.

PubMed

Blegen, Mary A; Gearhart, Susan; O'Brien, Roxanne; Sehgal, Niraj L; Alldredge, Brian K

2009-09-01

This project analyzed the psychometric properties of the Agency for Healthcare Research and Quality Hospital Survey on Patient Safety Culture (HSOPSC) including factor structure, interitem reliability and intraclass correlations, usefulness for assessment, predictive validity, and sensitivity. The survey was administered to 454 health care staff in 3 hospitals before and after a series of multidisciplinary interventions designed to improve safety culture. Respondents (before, 434; after, 368) included nurses, physicians, pharmacists, and other hospital staff members. Factor analysis partially confirmed the validity of the HSOPSC subscales. Interitem consistency reliability was above 0.7 for 5 subscales; the staffing subscale had the lowest reliability coefficients. The intraclass correlation coefficients, agreement among the members of each unit, were within recommended ranges. The pattern of high and low scores across the subscales of the HSOPSC in the study hospitals were similar to the sample of Pacific region hospitals reported by the Agency for Healthcare Research and Quality and corresponded to the proportion of items in each subscale that are worded negatively (reverse scored). Most of the unit and hospital dimensions were correlated with the Safety Grade outcome measure in the tool. Overall, the tool was shown to have moderate-to-strong validity and reliability, with the exception of the staffing subscale. The usefulness in assessing areas of strength and weakness for hospitals or units among the culture subscales is questionable. The culture subscales were shown to correlate with the perceived outcomes, but further study is needed to determine true predictive validity.

Bony defects in chronic anterior posttraumatic dislocation of the shoulder: Is there a correlation between humeral and glenoidal lesions?

PubMed

Ciais, Grégoire; Klouche, Shahnaz; Fournier, Alexandre; Rousseau, Benoit; Bauer, Thomas; Hardy, Philippe

2016-08-01

The prevalence of combined humeral and glenoid defects varies between 79 and 84 % in case of chronic posttraumatic anterior shoulder instability. The main goal of this study was to evaluate the relationship between humeral and glenoid defects based on quantitative radiological criteria. A retrospective study was performed between 2000 and 2011 including patients who underwent primary surgical shoulder stabilization for chronic posttraumatic anterior shoulder instability, with bone defects in both the glenoid and humerus and a healthy contralateral shoulder. The following measurements were taken: D/R ratio (Hill-Sachs lesion depth/humeral head radius) on an AP X-ray in internal rotation and the D1/D2 ratio [diameter of the involved glenoid articular surfaces (D1)/the healthy one (D2)] on a comparative Bernageau glenoid profile view. Measurements were taken by two observers. Correlations were determined by the Spearman correlation coefficients (r), Bland and Altman diagrams, and intra-class correlation coefficients (ICC). A sample size calculation was done. Thirty patients were included, 25 men/5 women, mean age 29.8 ± 11.2 years. The mean D/R was 23 ± 12 % for observer 1 and 23 ± 10 % for observer 2. The mean D1/D2 was 95 ± 4 % for observer 1 and 94 ± 6 % for observer 2. No significant correlation was found between humeral and glenoid bone defects by observer 1 (r = 0.23, p = 0.22) or observer 2 (r = 0.05, p = 0.78). Agreement of the observers for the D/R ratio was excellent (ICC = 0.89 ± 0.04, p < 0.00001) and good for the D1/D2 ratio (ICC = 0.54 ± 0.14, p = 0.006). Humeral and glenoid bone defects were not correlated. Inter-observer reliability was excellent for the D/R ratio and good for the D1/D2 ratio. Nonconsecutive Patients, Diagnostic Study, Level III.

Translation, cross-cultural adaptation, and psychometric properties of the German version of the hip disability and osteoarthritis outcome score.

PubMed

Blasimann, Angela; Dauphinee, Sharon Wood; Staal, J Bart

2014-12-01

Clinical measurement. To translate and cross-culturally adapt the Hip disability and Osteoarthritis Outcome Score (HOOS) from English into German, and to study its psychometric properties in patients after hip surgery. There is no specific hip questionnaire in German that not only measures symptoms and function but also contains items about hip-related quality of life. The translation and cross-cultural adaptation involved forward translation, harmonization, cognitive debriefing, back translation, and comparison to the original HOOS following international guidelines. The German version was tested in 51 Swiss inpatients 8 weeks after different types of hip surgery, mainly total hip replacement. The mean age of the participants was 62.5 years, and the age range was from 27 to 87 years. Thirty (58.8%) of the participants were women. Internal consistency and test-retest reliability were estimated using Cronbach alpha and intraclass correlation coefficients for agreement. For construct validity, total scores of the German HOOS were correlated with those of the Western Ontario and McMaster Universities Osteoarthritis Index. The HOOS was also compared to the Medical Outcomes Study 36-Item Short-Form Health Survey. Cronbach alpha values for all German HOOS subscales were between .87 and .93. For test-retest reliability, the intraclass correlation coefficient for agreement was 0.85 for the total scores of the German HOOS. The Spearman rho for the Medical Outcomes Study 36-Item Short-Form Health Survey physical functioning subscale compared to the sum of all HOOS subscales was 0.71, and that for the Medical Outcomes Study 36-Item Short-Form Health Survey physical component summary was 0.97. The German HOOS has demonstrated adequate reliability and validity. Use of the German HOOS is recommended for assessment of patients after hip surgery, with the proviso that additional psychometric testing should be done in future research.

A Comparison of EQ-5D-3L Index Scores Using Malaysian, Singaporean, Thai, and UK Value Sets in Indonesian Cervical Cancer Patients.

PubMed

Endarti, Dwi; Riewpaiboon, Arthorn; Thavorncharoensap, Montarat; Praditsitthikorn, Naiyana; Hutubessy, Raymond; Kristina, Susi Ari

2018-05-01

To gain insight into the most suitable foreign value set among Malaysian, Singaporean, Thai, and UK value sets for calculating the EuroQol five-dimensional questionnaire index score (utility) among patients with cervical cancer in Indonesia. Data from 87 patients with cervical cancer recruited from a referral hospital in Yogyakarta province, Indonesia, from an earlier study of health-related quality of life were used in this study. The differences among the utility scores derived from the four value sets were determined using the Friedman test. Performance of the psychometric properties of the four value sets versus visual analogue scale (VAS) was assessed. Intraclass correlation coefficients and Bland-Altman plots were used to test the agreement among the utility scores. Spearman ρ correlation coefficients were used to assess convergent validity between utility scores and patients' sociodemographic and clinical characteristics. With respect to known-group validity, the Kruskal-Wallis test was used to examine the differences in utility according to the stages of cancer. There was significant difference among utility scores derived from the four value sets, among which the Malaysian value set yielded higher utility than the other three value sets. Utility obtained from the Malaysian value set had more agreements with VAS than the other value sets versus VAS (intraclass correlation coefficients and Bland-Altman plot tests results). As for the validity, the four value sets showed equivalent psychometric properties as those that resulted from convergent and known-group validity tests. In the absence of an Indonesian value set, the Malaysian value set was more preferable to be used compared with the other value sets. Further studies on the development of an Indonesian value set need to be conducted. Copyright © 2018. Published by Elsevier Inc.

The Structured Interview & Scoring Tool-Massachusetts Alzheimer's Disease Research Center (SIST-M): development, reliability, and cross-sectional validation of a brief structured clinical dementia rating interview.

PubMed

Okereke, Olivia I; Copeland, Maura; Hyman, Bradley T; Wanggaard, Taylor; Albert, Marilyn S; Blacker, Deborah

2011-03-01

The Clinical Dementia Rating (CDR) and CDR Sum-of-Boxes can be used to grade mild but clinically important cognitive symptoms of Alzheimer disease. However, sensitive clinical interview formats are lengthy. To develop a brief instrument for obtaining CDR scores and to assess its reliability and cross-sectional validity. Using legacy data from expanded interviews conducted among 347 community-dwelling older adults in a longitudinal study, we identified 60 questions (from a possible 131) about cognitive functioning in daily life using clinical judgment, inter-item correlations, and principal components analysis. Items were selected in 1 cohort (n=147), and a computer algorithm for generating CDR scores was developed in this same cohort and re-run in a replication cohort (n=200) to evaluate how well the 60 items retained information from the original 131 items. Short interviews based on the 60 items were then administered to 50 consecutively recruited older individuals, with no symptoms or mild cognitive symptoms, at an Alzheimer's Disease Research Center. Clinical Dementia Rating scores based on short interviews were compared with those from independent long interviews. In the replication cohort, agreement between short and long CDR interviews ranged from κ=0.65 to 0.79, with κ=0.76 for Memory, κ=0.77 for global CDR, and intraclass correlation coefficient for CDR Sum-of-Boxes=0.89. In the cross-sectional validation, short interview scores were slightly lower than those from long interviews, but good agreement was observed for global CDR and Memory (κ≥0.70) as well as for CDR Sum-of-Boxes (intraclass correlation coefficient=0.73). The Structured Interview & Scoring Tool-Massachusetts Alzheimer's Disease Research Center is a brief, reliable, and sensitive instrument for obtaining CDR scores in persons with symptoms along the spectrum of mild cognitive change.

An Indian adaptation of the Involvement Evaluation Questionnaire: similarities and differences in assessment of caregiver burden.

PubMed

Grover, S; Chakrabarti, S; Ghormode, D; Dutt, A; Kate, N; Kulhara, P

2011-12-01

The Involvement Evaluation Questionnaire (IEQ) is a comprehensive, conceptually valid and reliable means of assessing caregiver burden. However, its psychometric properties have rarely been examined in non-European settings. The aim of the present study was to evaluate the psychometric properties of an Indian translation of the IEQ (Hindi-IEQ). The European Union (English) version of IEQ was translated into Hindi and reviewed by a group of experts and caregivers for translation accuracy, cultural appropriateness, and for relevance and acceptability of items and constructs. The Hindi-IEQ was then administered to 162 primary caregivers of patients with severe mental illnesses. Eighteen caregivers completed both the English and Hindi versions to check the level of agreement between them. Another 27 completed the Hindi-IEQ twice, a week apart, to evaluate its test-retest reliability. Factor structure of the Hindi-IEQ was examined using an exploratory, principal components and factor analysis. Pearson's correlation coefficients were significant for 24 items, while intraclass correlation coefficients were significant for 28 of the 31 items (P < 0.05), indicating a satisfactory level of agreement between the Hindi and English versions. Test-retest reliability for all items of the Hindi-IEQ was adequate, with kappa values ranging from 0.46 to 0.95 and intraclass correlation coefficients from 0.76 to 1.00. Internal consistency (Cronbach's alpha = 0.89) and the split-half reliability (Spearman-Brown coefficient = 0.68) of the Hindi-IEQ were also satisfactory. However, several differences were noted in the factor structure and distribution of scores of the Hindi-IEQ, which were quite unlike that of the European Union version. The similarities and differences between the 2 versions of the IEQ indicated that sociocultural factors could influence assessment of caregiver burden across different cultures.

Correlation energy extrapolation by many-body expansion

DOE PAGES

Boschen, Jeffery S.; Theis, Daniel; Ruedenberg, Klaus; ...

2017-01-09

Accounting for electron correlation is required for high accuracy calculations of molecular energies. The full configuration interaction (CI) approach can fully capture the electron correlation within a given basis, but it does so at a computational expense that is impractical for all but the smallest chemical systems. In this work, a new methodology is presented to approximate configuration interaction calculations at a reduced computational expense and memory requirement, namely, the correlation energy extrapolation by many-body expansion (CEEMBE). This method combines a MBE approximation of the CI energy with an extrapolated correction obtained from CI calculations using subsets of the virtualmore » orbitals. The extrapolation approach is inspired by, and analogous to, the method of correlation energy extrapolation by intrinsic scaling. Benchmark calculations of the new method are performed on diatomic fluorine and ozone. Finally, the method consistently achieves agreement with CI calculations to within a few mhartree and often achieves agreement to within ~1 millihartree or less, while requiring significantly less computational resources.« less

Correlation energy extrapolation by many-body expansion

DOE Office of Scientific and Technical Information (OSTI.GOV)

Boschen, Jeffery S.; Theis, Daniel; Ruedenberg, Klaus

Accounting for electron correlation is required for high accuracy calculations of molecular energies. The full configuration interaction (CI) approach can fully capture the electron correlation within a given basis, but it does so at a computational expense that is impractical for all but the smallest chemical systems. In this work, a new methodology is presented to approximate configuration interaction calculations at a reduced computational expense and memory requirement, namely, the correlation energy extrapolation by many-body expansion (CEEMBE). This method combines a MBE approximation of the CI energy with an extrapolated correction obtained from CI calculations using subsets of the virtualmore » orbitals. The extrapolation approach is inspired by, and analogous to, the method of correlation energy extrapolation by intrinsic scaling. Benchmark calculations of the new method are performed on diatomic fluorine and ozone. Finally, the method consistently achieves agreement with CI calculations to within a few mhartree and often achieves agreement to within ~1 millihartree or less, while requiring significantly less computational resources.« less

Psychometric properties of the Anxiety Inventory for Respiratory Disease in patients with COPD in China.

PubMed

Dong, Xiao-Yan; Wang, Lan; Tao, Yan-Xia; Suo, Xiu-Li; Li, Yue-Chuan; Liu, Fang; Zhao, Yue; Zhang, Qing

2017-01-01

Anxiety is a common comorbidity in patients with COPD in China, and it can significantly decrease patients' quality of life. Almost all anxiety measurements contain somatic items that can overlap with symptoms of COPD and side effects of medicines, which can lead to bias in measuring anxiety in patients with COPD. Therefore, a brief and disease-specific non-somatic anxiety measurement scale, the Anxiety Inventory for Respiratory Disease (AIR), which has been developed and validated in its English version, is needed for patients with COPD in China. A two-center study was conducted in two tertiary hospitals in Tianjin, China. A total of 181 outpatients with COPD (mean age 67.21±8.10 years, 32.6% women), who met the inclusion and exclusion criteria, were enrolled in the study. Test-retest reliability was examined using intraclass correlation coefficients. The internal consistency was calculated by Cronbach's α . Content validity was examined using the Content Validity Index (CVI), scale-level CVI/universal agreement, and scale-level CVI/average agreement (S-CVI/Ave). Besides, convergent validity and construct validity were also examined. The AIR-C (AIR-Chinese version) scale had high test-retest reliability (intraclass correlation coefficient =0.904) and internal consistency (Cronbach's α =0.914); the content validity of the AIR-C scale was calculated by CVI, scale-level CVI/universal agreement, and S-CVI/Ave at values of 0.89-1, 0.90, and 0.98, respectively. Meanwhile, the AIR-C scale had good convergent validity, correlating with the Hospital Anxiety and Depression Scale-Anxiety ( r =0.81, P <0.01), and there were significant correlations between the AIR-C and Clinical COPD Questionnaire (CCQ; r =0.44, P <0.01) and Activities of Daily Living Scale (ADLS; r =0.36, P <0.01). A two-factor model of general anxiety and panic symptoms in the AIR-C scale had the best fit according to Confirmatory Factor Analysis (CFA). The AIR-C scale had a good reliability and validity

22 CFR 124.8 - Clauses required both in manufacturing license agreements and technical assistance agreements.

Code of Federal Regulations, 2010 CFR

2010-04-01

... agreements and technical assistance agreements. 124.8 Section 124.8 Foreign Relations DEPARTMENT OF STATE... Clauses required both in manufacturing license agreements and technical assistance agreements. The following statements must be included both in manufacturing license agreements and in technical assistance...

Designing a composite correlation filter based on iterative optimization of training images for distortion invariant face recognition

NASA Astrophysics Data System (ADS)

Wang, Q.; Elbouz, M.; Alfalou, A.; Brosseau, C.

2017-06-01

We present a novel method to optimize the discrimination ability and noise robustness of composite filters. This method is based on the iterative preprocessing of training images which can extract boundary and detailed feature information of authentic training faces, thereby improving the peak-to-correlation energy (PCE) ratio of authentic faces and to be immune to intra-class variance and noise interference. By adding the training images directly, one can obtain a composite template with high discrimination ability and robustness for face recognition task. The proposed composite correlation filter does not involve any complicated mathematical analysis and computation which are often required in the design of correlation algorithms. Simulation tests have been conducted to check the effectiveness and feasibility of our proposal. Moreover, to assess robustness of composite filters using receiver operating characteristic (ROC) curves, we devise a new method to count the true positive and false positive rates for which the difference between PCE and threshold is involved.

Cross-Informant Agreement and Stability of the Strengths and Difficulties Questionnaire among Finnish Mainstream and Special Education Students

ERIC Educational Resources Information Center

Lappalainen, Kristiina; Savolainen, Hannu; Sointu, Erkko T.; Epstein, Michael H.

2014-01-01

This study investigated the cross-informant agreement among student self-report, teacher report, and parent report on the Strengths and Difficulties Questionnaire translated into Finnish (SDQ-Fin) and estimated mean convergent and divergent correlations with a sample of fifth-grade Finnish students (N = 588) and the cross-informant agreement among…

Evaluating Written Patient Information for Eczema in German: Comparing the Reliability of Two Instruments, DISCERN and EQIP

PubMed Central

McCool, Megan E.; Wahl, Josepha; Schlecht, Inga; Apfelbacher, Christian

2015-01-01

Patients actively seek information about how to cope with their health problems, but the quality of the information available varies. A number of instruments have been developed to assess the quality of patient information, primarily though in English. Little is known about the reliability of these instruments when applied to patient information in German. The objective of our study was to investigate and compare the reliability of two validated instruments, DISCERN and EQIP, in order to determine which of these instruments is better suited for a further study pertaining to the quality of information available to German patients with eczema. Two independent raters evaluated a random sample of 20 informational brochures in German. All the brochures addressed eczema as a disorder and/or therapy options and care. Intra-rater and inter-rater reliability were assessed by calculating intra-class correlation coefficients, agreement was tested with weighted kappas, and the correlation of the raters’ scores for each instrument was measured with Pearson’s correlation coefficient. DISCERN demonstrated substantial intra- and inter-rater reliability. It also showed slightly better agreement than EQIP. There was a strong correlation of the raters’ scores for both instruments. The findings of this study support the reliability of both DISCERN and EQIP. However, based on the results of the inter-rater reliability, agreement and correlation analyses, we consider DISCERN to be the more precise tool for our project on patient information concerning the treatment and care of eczema. PMID:26440612

Evaluating Written Patient Information for Eczema in German: Comparing the Reliability of Two Instruments, DISCERN and EQIP.

PubMed

McCool, Megan E; Wahl, Josepha; Schlecht, Inga; Apfelbacher, Christian

2015-01-01

Patients actively seek information about how to cope with their health problems, but the quality of the information available varies. A number of instruments have been developed to assess the quality of patient information, primarily though in English. Little is known about the reliability of these instruments when applied to patient information in German. The objective of our study was to investigate and compare the reliability of two validated instruments, DISCERN and EQIP, in order to determine which of these instruments is better suited for a further study pertaining to the quality of information available to German patients with eczema. Two independent raters evaluated a random sample of 20 informational brochures in German. All the brochures addressed eczema as a disorder and/or therapy options and care. Intra-rater and inter-rater reliability were assessed by calculating intra-class correlation coefficients, agreement was tested with weighted kappas, and the correlation of the raters' scores for each instrument was measured with Pearson's correlation coefficient. DISCERN demonstrated substantial intra- and inter-rater reliability. It also showed slightly better agreement than EQIP. There was a strong correlation of the raters' scores for both instruments. The findings of this study support the reliability of both DISCERN and EQIP. However, based on the results of the inter-rater reliability, agreement and correlation analyses, we consider DISCERN to be the more precise tool for our project on patient information concerning the treatment and care of eczema.

Nondisclosure Agreements | NREL

Science.gov Websites

the agreement. 5. Share Information and Maintain Records Once the nondisclosure agreement has been executed, appropriately labeled information may be shared. NREL and the other party then maintain records

The health impact of trade and investment agreements: a quantitative systematic review and network co-citation analysis.

PubMed

Barlow, Pepita; McKee, Martin; Basu, Sanjay; Stuckler, David

2017-03-08

Regional trade agreements are major international policy instruments that shape macro-economic and political systems. There is widespread debate as to whether and how these agreements pose risks to public health. Here we perform a comprehensive systematic review of quantitative studies of the health impact of trade and investment agreements. We identified studies from searches in PubMed, Web of Science, EMBASE, and Global Health Online. Research articles were eligible for inclusion if they were quantitative studies of the health impacts of trade and investment agreements or policy. We systematically reviewed study findings, evaluated quality using the Quality Assessment Tool from the Effective Public Health Practice Project, and performed network citation analysis to study disciplinary siloes. Seventeen quantitative studies met our inclusion criteria. There was consistent evidence that implementing trade agreements was associated with increased consumption of processed foods and sugar-sweetened beverages. Granting import licenses for patented drugs was associated with increased access to pharmaceuticals. Implementing trade agreements and associated policies was also correlated with higher cardiovascular disease incidence and higher Body Mass Index (BMI), whilst correlations with tobacco consumption, under-five mortality, maternal mortality, and life expectancy were inconclusive. Overall, the quality of studies is weak or moderately weak, and co-citation analysis revealed a relative isolation of public health from economics. We identified limitations in existing studies which preclude definitive conclusions of the health impacts of regional trade and investment agreements. Few address unobserved confounding, and many possible consequences and mechanisms linking trade and investment agreements to health remain poorly understood. Results from our co-citation analysis suggest scope for greater interdisciplinary collaboration. Notwithstanding these limitations, our

The Dutch Activity Card Sort institutional version was reproducible, but biased against women.

PubMed

Jong, A M; van Nes, F A; Lindeboom, R

2012-01-01

To examine the reproducibility of the institutional version of the Dutch Activity Card Sort (ACS-NL) and the possible presence of gender bias. Older rehabilitation inpatients (N = 52) were included. Intra- and inter-rater agreement for the ACS-NL total and subscale scores was examined by intraclass correlations (ICC), and agreement of individual items by the κ coefficient (k). Gender bias was examined by the proportion of men and women selecting an ACS item. ICC for inter-rater agreement of the ACS total score ranged between 0.78 and 0.87, ICC for intra-rater agreement ranged between 0.79 and 0.89. Median inter-rater κ for ACS-NL items was 0.72 (interquartile scores; 0.62-0.80). The inter-rater agreement (k = 0.43) and intra-rater agreement (k = 0.39) for the five most important activities was lower. Twenty ACS activities favoured men and seven activities favoured women. As a result, men scored systematically higher on the ACS-NL than women. Logistic regression analysis correcting for activity engagement level confirmed our findings. The reproducibility of the ACS-NL was high. The ACS-NL institutional version score may be biased in favour of men.

12 CFR 1291.9 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 12 Banks and Banking 9 2013-01-01 2013-01-01 false Agreements. 1291.9 Section 1291.9 Banks and... HOUSING PROGRAM § 1291.9 Agreements. (a) Agreements between Banks and members. A Bank shall have in place with each member receiving an AHP subsidized advance or AHP direct subsidy an agreement or agreements...

12 CFR 1291.9 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 12 Banks and Banking 10 2014-01-01 2014-01-01 false Agreements. 1291.9 Section 1291.9 Banks and... HOUSING PROGRAM § 1291.9 Agreements. (a) Agreements between Banks and members. A Bank shall have in place with each member receiving an AHP subsidized advance or AHP direct subsidy an agreement or agreements...

12 CFR 1291.9 - Agreements.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 12 Banks and Banking 7 2011-01-01 2011-01-01 false Agreements. 1291.9 Section 1291.9 Banks and... HOUSING PROGRAM § 1291.9 Agreements. (a) Agreements between Banks and members. A Bank shall have in place with each member receiving an AHP subsidized advance or AHP direct subsidy an agreement or agreements...

12 CFR 1291.9 - Agreements.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 12 Banks and Banking 7 2010-01-01 2010-01-01 false Agreements. 1291.9 Section 1291.9 Banks and... HOUSING PROGRAM § 1291.9 Agreements. (a) Agreements between Banks and members. A Bank shall have in place with each member receiving an AHP subsidized advance or AHP direct subsidy an agreement or agreements...

12 CFR 1291.9 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 12 Banks and Banking 9 2012-01-01 2012-01-01 false Agreements. 1291.9 Section 1291.9 Banks and... HOUSING PROGRAM § 1291.9 Agreements. (a) Agreements between Banks and members. A Bank shall have in place with each member receiving an AHP subsidized advance or AHP direct subsidy an agreement or agreements...

Correlational approach to turbulent saturated film boiling

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chu, T.Y.

A correlation method for saturated film boiling is proposed. The correlation is based on the analogy between film boiling and natural convection. As in the case of natural convection, the turbulent film boiling correlation takes the form of a Nusselt number versus the Raleigh number power law, Nu[sub B] [proportional to] Ra[sub B][sup 1.3]. The proposed correlation shows very good agreement with current data for film boiling of water from vertical surfaces. The general applicability of the correlation is established by comparisons with film boiling data from R-113 and cryogenic fluids. 25 refs., 8 figs.

International inter-rater agreement in scoring acne severity utilizing cloud-based image sharing of mobile phone photographs.

PubMed

Foolad, Negar; Ornelas, Jennifer N; Clark, Ashley K; Ali, Ifrah; Sharon, Victoria R; Al Mubarak, Luluah; Lopez, Andrés; Alikhan, Ali; Al Dabagh, Bishr; Firooz, Alireza; Awasthi, Smita; Liu, Yu; Li, Chin-Shang; Sivamani, Raja K

2017-09-01

Cloud-based image sharing technology allows facilitated sharing of images. Cloud-based image sharing technology has not been well-studied for acne assessments or treatment preferences, among international evaluators. We evaluated inter-rater variability of acne grading and treatment recommendations among an international group of dermatologists that assessed photographs. This is a prospective, single visit photographic study to assess inter-rater agreement of acne photographs shared through an integrated mobile device, cloud-based, and HIPAA-compliant platform. Inter-rater agreements for global acne assessment and acne lesion counts were evaluated by the Kendall's coefficient of concordance while correlations between treatment recommendations and acne severity were calculated by Spearman's rank correlation coefficient. There was good agreement for the evaluation of inflammatory lesions (KCC = 0.62, P < 0.0001), noninflammatory lesions (KCC = 0.62, P < 0.0001), and the global acne grading system score (KCC = 0.69, P < 0.0001). Topical retinoid, oral antibiotic, and isotretinoin treatment preferences correlated with photographic based acne severity. Our study supports the use of mobile phone based photography and cloud-based image sharing for acne assessment. Cloud-based sharing may facilitate acne care and research among international collaborators. © 2017 The International Society of Dermatology.

A systematic review of statistical methods used to test for reliability of medical instruments measuring continuous variables.

PubMed

Zaki, Rafdzah; Bulgiba, Awang; Nordin, Noorhaire; Azina Ismail, Noor

2013-06-01

Reliability measures precision or the extent to which test results can be replicated. This is the first ever systematic review to identify statistical methods used to measure reliability of equipment measuring continuous variables. This studyalso aims to highlight the inappropriate statistical method used in the reliability analysis and its implication in the medical practice. In 2010, five electronic databases were searched between 2007 and 2009 to look for reliability studies. A total of 5,795 titles were initially identified. Only 282 titles were potentially related, and finally 42 fitted the inclusion criteria. The Intra-class Correlation Coefficient (ICC) is the most popular method with 25 (60%) studies having used this method followed by the comparing means (8 or 19%). Out of 25 studies using the ICC, only 7 (28%) reported the confidence intervals and types of ICC used. Most studies (71%) also tested the agreement of instruments. This study finds that the Intra-class Correlation Coefficient is the most popular method used to assess the reliability of medical instruments measuring continuous outcomes. There are also inappropriate applications and interpretations of statistical methods in some studies. It is important for medical researchers to be aware of this issue, and be able to correctly perform analysis in reliability studies.

2008 Niday Perinatal Database quality audit: report of a quality assurance project.

PubMed

Dunn, S; Bottomley, J; Ali, A; Walker, M

2011-12-01

This quality assurance project was designed to determine the reliability, completeness and comprehensiveness of the data entered into Niday Perinatal Database. Quality of the data was measured by comparing data re-abstracted from the patient record to the original data entered into the Niday Perinatal Database. A representative sample of hospitals in Ontario was selected and a random sample of 100 linked mother and newborn charts were audited for each site. A subset of 33 variables (representing 96 data fields) from the Niday dataset was chosen for re-abstraction. Of the data fields for which Cohen's kappa statistic or intraclass correlation coefficient (ICC) was calculated, 44% showed substantial or almost perfect agreement (beyond chance). However, about 17% showed less than 95% agreement and a kappa or ICC value of less than 60% indicating only slight, fair or moderate agreement (beyond chance). Recommendations to improve the quality of these data fields are presented.

Experimental Investigation of Triplet Correlation Approximations for Fluid Water.

PubMed

Pallewela, Gayani N; Ploetz, Elizabeth A; Smith, Paul E

2018-08-25

Triplet correlations play a central role in our understanding of fluids and their properties. Of particular interest is the relationship between the pair and triplet correlations. Here we use a combination of Fluctuation Solution Theory and experimental pair radial distribution functions to investigate the accuracy of the Kirkwood Superposition Approximation (KSA), as given by integrals over the relevant pair and triplet correlation functions, at a series of state points for pure water using only experimental quantities. The KSA performs poorly, in agreement with a variety of other studies. Several additional approximate relationships between the pair and triplet correlations in fluids are also investigated and generally provide good agreement for the fluid thermodynamics for regions of the phase diagram where the compressibility is small. A simple power law relationship between the pair and triplet fluctuations is particularly successful for state points displaying low to moderately high compressibilities.

Italy-Japan agreement and discrepancies in diagnosis of superficial gastric lesions.

PubMed

Vindigni, Carla; Marini, Mario; Cevenini, Gabriele; Raffaella Ambrosio, Maria; Onorati, Monica; Frosini, Giorgio; Gotoda, Takuji; Taniguchi, Hirokazu; Tosi, Piero

2010-01-01

The agreement between Italian and Japanese endoscopists and pathologists on endoscopic and histopathological diagnoses of superficial gastric lesions is verified with the use of Paris and Vienna classifications. The correlations between Paris endoscopic types and Vienna histopathological categories is high in both the independent Italian and Japanese evaluations. However, the agreement between Italian and Japanese endoscopists is moderate due to the difficult evaluation of the height of the lesions, in particular when they are mixed. The agreement on the size of the lesions is fairly good. The probability of the same allocation to the Vienna categories of a single case is 87 per cent, disagreements remaining in dysplasia grading, between dysplasia, not only high-grade but also low-grade, and in situ carcinoma, and on cancer invasion of the lamina propria. The results indicate that use of the Paris and Vienna classifications has reduced the discrepancies between Western and Japanese endoscopists and pathologists in the diagnosis of these lesions.

Surrogate Agreement in Tzotzil.

ERIC Educational Resources Information Center

Aissen, Judith L.

This study investigates whether other relationships in sentence structure besides the "brother-in-law" relation sanction surrogate agreement in Zinacanteco Tzotzil (Mayan). Surrogate agreement refers to cases in which an element that lies outside the class of regular agreement controllers in a language (the surrogate) controls…

The Correlated Jacobi and the Correlated Cauchy-Lorentz Ensembles

NASA Astrophysics Data System (ADS)

Wirtz, Tim; Waltner, Daniel; Kieburg, Mario; Kumar, Santosh

2016-01-01

We calculate the k-point generating function of the correlated Jacobi ensemble using supersymmetric methods. We use the result for complex matrices for k=1 to derive a closed-form expression for the eigenvalue density. For real matrices we obtain the density in terms of a twofold integral that we evaluate numerically. For both expressions we find agreement when comparing with Monte Carlo simulations. Relations between these quantities for the Jacobi and the Cauchy-Lorentz ensemble are derived.

Sandia National Laboratories: Agreements

Science.gov Websites

Technology Partnerships Business, Industry, & Non-Profits Government Universities Center for Development Agreement (CRADA) Strategic Partnership Projects, Non-Federal Entity (SPP/NFE) Agreements New Projects, Non-Federal Entity (SPP/NFE) Agreements Sandia performs work on a reimbursable basis for a non

Placido disk-based topography versus high-resolution rotating Scheimpflug camera for corneal power measurements in keratoconic and post-LASIK eyes: reliability and agreement.

PubMed

Penna, Rachele R; de Sanctis, Ugo; Catalano, Martina; Brusasco, Luca; Grignolo, Federico M

2017-01-01

To compare the repeatability/reproducibility of measurement by high-resolution Placido disk-based topography with that of a high-resolution rotating Scheimpflug camera and assess the agreement between the two instruments in measuring corneal power in eyes with keratoconus and post-laser in situ keratomileusis (LASIK). One eye each of 36 keratoconic patients and 20 subjects who had undergone LASIK was included in this prospective observational study. Two independent examiners worked in a random order to take three measurements of each eye with both instruments. Four parameters were measured on the anterior cornea: steep keratometry (Ks), flat keratometry (Kf), mean keratometry (Km), and astigmatism (Ks-Kf). Intra-examiner repeatability and inter-examiner reproducibility were evaluated by calculating the within-subject standard deviation (Sw) the coefficient of repeatability (R), the coefficient of variation (CoV), and the intraclass correlation coefficient (ICC). Agreement between instruments was tested with the Bland-Altman method by calculating the 95% limits of agreement (95% LoA). In keratoconic eyes, the intra-examiner and inter-examiner ICC were >0.95. As compared with measurement by high-resolution Placido disk-based topography, the intra-examiner R of the high-resolution rotating Scheimpflug camera was lower for Kf (0.32 vs 0.88), Ks (0.61 vs 0.88), and Km (0.32 vs 0.84) but higher for Ks-Kf (0.70 vs 0.57). Inter-examiner R values were lower for all parameters measured using the high-resolution rotating Scheimpflug camera. The 95% LoA were -1.28 to +0.55 for Kf, -1.36 to +0.99 for Ks, -1.08 to +0.50 for Km, and -1.11 to +1.48 for Ks-Kf. In the post-LASIK eyes, the intra-examiner and inter-examiner ICC were >0.87 for all parameters. The intra-examiner and inter-examiner R were lower for all parameters measured using the high-resolution rotating Scheimpflug camera. The intra-examiner R was 0.17 vs 0.88 for Kf, 0.21 vs 0.88 for Ks, 0.17 vs 0.86 for Km, and 0

Placido disk-based topography versus high-resolution rotating Scheimpflug camera for corneal power measurements in keratoconic and post-LASIK eyes: reliability and agreement

PubMed Central

Penna, Rachele R.; de Sanctis, Ugo; Catalano, Martina; Brusasco, Luca; Grignolo, Federico M.

2017-01-01

AIM To compare the repeatability/reproducibility of measurement by high-resolution Placido disk-based topography with that of a high-resolution rotating Scheimpflug camera and assess the agreement between the two instruments in measuring corneal power in eyes with keratoconus and post-laser in situ keratomileusis (LASIK). METHODS One eye each of 36 keratoconic patients and 20 subjects who had undergone LASIK was included in this prospective observational study. Two independent examiners worked in a random order to take three measurements of each eye with both instruments. Four parameters were measured on the anterior cornea: steep keratometry (Ks), flat keratometry (Kf), mean keratometry (Km), and astigmatism (Ks-Kf). Intra-examiner repeatability and inter-examiner reproducibility were evaluated by calculating the within-subject standard deviation (Sw) the coefficient of repeatability (R), the coefficient of variation (CoV), and the intraclass correlation coefficient (ICC). Agreement between instruments was tested with the Bland-Altman method by calculating the 95% limits of agreement (95% LoA). RESULTS In keratoconic eyes, the intra-examiner and inter-examiner ICC were >0.95. As compared with measurement by high-resolution Placido disk-based topography, the intra-examiner R of the high-resolution rotating Scheimpflug camera was lower for Kf (0.32 vs 0.88), Ks (0.61 vs 0.88), and Km (0.32 vs 0.84) but higher for Ks-Kf (0.70 vs 0.57). Inter-examiner R values were lower for all parameters measured using the high-resolution rotating Scheimpflug camera. The 95% LoA were -1.28 to +0.55 for Kf, -1.36 to +0.99 for Ks, -1.08 to +0.50 for Km, and -1.11 to +1.48 for Ks-Kf. In the post-LASIK eyes, the intra-examiner and inter-examiner ICC were >0.87 for all parameters. The intra-examiner and inter-examiner R were lower for all parameters measured using the high-resolution rotating Scheimpflug camera. The intra-examiner R was 0.17 vs 0.88 for Kf, 0.21 vs 0.88 for Ks, 0.17 vs 0

Experimental characterization of pairwise correlations from triple quantum correlated beams generated by cascaded four-wave mixing processes

NASA Astrophysics Data System (ADS)

Wang, Wei; Cao, Leiming; Lou, Yanbo; Du, Jinjian; Jing, Jietai

2018-01-01

We theoretically and experimentally characterize the performance of the pairwise correlations from triple quantum correlated beams based on the cascaded four-wave mixing (FWM) processes. The pairwise correlations between any two of the beams are theoretically calculated and experimentally measured. The experimental and theoretical results are in good agreement. We find that two of the three pairwise correlations can be in the quantum regime. The other pairwise correlation is always in the classical regime. In addition, we also measure the triple-beam correlation which is always in the quantum regime. Such unbalanced and controllable pairwise correlation structures may be taken as advantages in practical quantum communications, for example, hierarchical quantum secret sharing. Our results also open the way for the classification and application of quantum states generated from the cascaded FWM processes.

Validity and reliability of an adapted arabic version of the long international physical activity questionnaire.

PubMed

Helou, Khalil; El Helou, Nour; Mahfouz, Maya; Mahfouz, Yara; Salameh, Pascale; Harmouche-Karaki, Mireille

2017-07-24

The International Physical Actvity Questionnaire (IPAQ) is a validated tool for physical activity assessment used in many countries however no Arabic version of the long-form of this questionnaire exists to this date. Hence, the aim of this study was to cross-culturally adapt and validate an Arabic version of the long International Physical Activity Questionnaire (AIPAQ) equivalent to the French version (F-IPAQ) in a Lebanese population. The guidelines for cross-cultural adaptation provided by the World Health Organization and the International Physical Activity Questionnaire committee were followed. One hundred fifty-nine students and staff members from Saint Joseph University of Beirut were randomly recruited to participate in the study. Items of the A-IPAQ were compared to those from the F-IPAQ for concurrent validity using Spearman's correlation coefficient. Content validity of the questionnaire was assessed using factor analysis for the A-IPAQ's items. The physical activity indicators derived from the A-IPAQ were compared with the body mass index (BMI) of the participants for construct validity. The instrument was also evaluated for internal consistency reliability using Cronbach's alpha and Intraclass Correlation Coefficient (ICC). Finally, thirty-one participants were asked to complete the A-IPAQ on two occasions three weeks apart to examine its test-retest reliability. Bland-Altman analyses were performed to evaluate the extent of agreement between the two versions of the questionnaire and its repeated administrations. A high correlation was observed between answers of the F-IPAQ and those of the A-IPAQ, with Spearman's correlation coefficients ranging from 0.91 to 1.00 (p < 0.05). Bland-Altman analysis showed a high level of agreement between the two versions with all values scattered around the mean for total physical activity (mean difference = 5.3 min/week, 95% limits of agreement = -145.2 to 155.8). Negative correlations were observed between

Explaining parent-child (dis)agreement in generic and short stature-specific health-related quality of life reports: do family and social relationships matter?

PubMed

Quitmann, Julia; Rohenkohl, Anja; Sommer, Rachel; Bullinger, Monika; Silva, Neuza

2016-10-21

In the context of health-related quality of life (HrQoL) assessment in pediatric short stature, the present study aimed to examine the levels of agreement/disagreement between parents' and children's reports of generic and condition-specific HrQoL, and to identify socio-demographic, clinical and psychosocial variables associated with the extent and direction of parent-child discrepancies. This study was part of the retest phase of the QoLISSY project, which was a multicenter study conducted simultaneously in France, Germany, Spain, Sweden and UK. The sample comprised 137 dyads of children/adolescents between 8 and 18 years of age, diagnosed with growth hormone deficiency (GHD) or idiopathic short stature (ISS), and one of their parents. The participants completed child- and parent-reported questionnaires on generic (KIDSCREEN-10 Index) and condition-specific HrQoL (QoLISSY Core Module). Children/adolescents also reported on social support (Oslo 3-items Social Support Scale) and parents assessed the parent-child relationships (Parental Role subscale of the Social Adjustment Scale) and burden of short stature on parents (QoLISSY- additional module). The parent-child agreement on reported HrQoL was strong (intraclass correlation coefficients between .59 and .80). The rates of parent-child discrepancies were 61.5 % for generic and 35.2 % for condition-specific HrQoL, with the parents being more prone to report lower generic (42.3 %) and condition-specific HrQoL (23.7 %) than their children. The extent of discrepancies was better explained by family and social relationships than by clinical and socio-demographic variables: poorer parent-child relationships and better children's social support were associated with larger discrepancies in generic HrQoL, while more parental burden was associated with larger discrepancies in condition-specific HrQoL reports. Regarding the direction of discrepancies, higher parental burden was significantly associated with parents

A juridical review of partnership agreements that have the elements of work agreements in Indonesia

NASA Astrophysics Data System (ADS)

Nugroho, A.; Sulistyowati, E.; Hikmah, N.

2018-01-01

The Partnership Agreements place the parties in an equal position each party has something as the bargaining power. In some cases, employers prefer to use Partnership Agreements to some individuals to complete the work in their company than Work agreements. Practicality and the absence of obligations to fulfil workers’ rights such as the right to join a Union and to get social security are some of the reasons why employers use the Partnership Agreements. Sometimes Partnership Agreement contains jobs, wages and orders which is the characteristic of work agreement. Based on the fact above, the legal issues arise whether the Partnership Agreement can be considered as the Work Agreement or not and which court is authorized to hear in the event of a dispute. To analyze the above legal issues, this research uses normative legal research type with the statute approach. The technique of legal material analysis uses prescriptive techniques to assess the issue and make recommendations. Based on the analysis, it can be concluded that the Partnership Agreement, of which the elements are: wages and orders can be categorized as Work Agreement and therefore in the event of a dispute, the authorized court is Industrial Relations Court.

Agreement between commercial assays for haptoglobin and serum amyloid A in goats.

PubMed

Czopowicz, Michał; Szaluś-Jordanow, Olga; Mickiewicz, Marcin; Moroz, Agata; Witkowski, Lucjan; Markowska-Daniel, Iwona; Reczyńska, Daria; Bagnicka, Emilia; Kaba, Jarosław

2017-10-02

Haptoglobin (Hp) and serum amyloid A (SAA) are considered as the major acute phase proteins (APPs) in goats. These APPs have been investigated in several studies during the last decade. In most studies, a colorimetric assay for Hp and a solid phase sandwich ELISA for SAA have been used for quantification. In 2015, reference intervals for APPs were determined using a new type of assay, the competitive ELISA (cELISA). Results obtained by the cELISA differed significantly from results obtained by previously used assays. The present study aimed to assess the agreement between so far used assays and cELISAs. Sera of 152 female dairy goats of two Polish national breeds were analysed. The concentration of Hp was determined using a colorimetric assay (Hp-CA) and the cELISA (Hp-cELISA), while a solid phase sandwich ELISA (SAA-sELISA) and the cELISA (SAA-cELISA) were used to measure SAA. Agreement between test results was assessed by preparing Bland-Altman plots, and analyzing 95% limits of agreement (LoA). Finally, the assays for Hp and SAA were compared using 147 and 138 serum samples, respectively, as 5 and 14 paired measurements, respectively, were excluded from agreement analyses to avoid extrapolation of Hp and SAA concentration. Measurements obtained by the Hp-CA and Hp-cELISA showed weak positive correlation (r = 0.24, P = 0.003). Limits of agreement (LoA) ranged from + 1.6 (95% CI 1.4 to 1.8) g/L to - 1.5 (95% CI - 1.7 to - 1.3) g/L. Measurements yielded by the SAA-sELISA and SAA-cELISA did not correlate (r = - 0.01, P = 0.855). LoA ranged from + 14.5 mg/L (95% CI 12.9 to 16.1) to - 8.5 mg/L (95% CI - 10.1 to - 6.9). Agreement between the two types of commercial assays for determination of Hp and SAA concentrations in goats is poor and cELISAs tend to underrate both Hp and SAA concentrations.

49 CFR 212.105 - Agreements.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 4 2011-10-01 2011-10-01 false Agreements. 212.105 Section 212.105 Transportation... TRANSPORTATION STATE SAFETY PARTICIPATION REGULATIONS State/Federal Roles § 212.105 Agreements. (a) Scope. The... agreement with FRA. An agreement may delegate investigative and surveillance authority with respect to all...

7 CFR 247.4 - Agreements.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 4 2011-01-01 2011-01-01 false Agreements. 247.4 Section 247.4 Agriculture... CHILD NUTRITION PROGRAMS COMMODITY SUPPLEMENTAL FOOD PROGRAM § 247.4 Agreements. (a) What agreements are necessary for agencies to administer CSFP? The following agreements are necessary for agencies to administer...

49 CFR 212.105 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 4 2013-10-01 2013-10-01 false Agreements. 212.105 Section 212.105 Transportation... TRANSPORTATION STATE SAFETY PARTICIPATION REGULATIONS State/Federal Roles § 212.105 Agreements. (a) Scope. The... agreement with FRA. An agreement may delegate investigative and surveillance authority with respect to all...

7 CFR 247.4 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 7 Agriculture 4 2014-01-01 2014-01-01 false Agreements. 247.4 Section 247.4 Agriculture... CHILD NUTRITION PROGRAMS COMMODITY SUPPLEMENTAL FOOD PROGRAM § 247.4 Agreements. (a) What agreements are necessary for agencies to administer CSFP? The following agreements are necessary for agencies to administer...

7 CFR 247.4 - Agreements.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 4 2010-01-01 2010-01-01 false Agreements. 247.4 Section 247.4 Agriculture... CHILD NUTRITION PROGRAMS COMMODITY SUPPLEMENTAL FOOD PROGRAM § 247.4 Agreements. (a) What agreements are necessary for agencies to administer CSFP? The following agreements are necessary for agencies to administer...

49 CFR 212.105 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 4 2014-10-01 2014-10-01 false Agreements. 212.105 Section 212.105 Transportation... TRANSPORTATION STATE SAFETY PARTICIPATION REGULATIONS State/Federal Roles § 212.105 Agreements. (a) Scope. The... agreement with FRA. An agreement may delegate investigative and surveillance authority with respect to all...

49 CFR 212.105 - Agreements.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 4 2010-10-01 2010-10-01 false Agreements. 212.105 Section 212.105 Transportation... TRANSPORTATION STATE SAFETY PARTICIPATION REGULATIONS State/Federal Roles § 212.105 Agreements. (a) Scope. The... agreement with FRA. An agreement may delegate investigative and surveillance authority with respect to all...

7 CFR 247.4 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 4 2012-01-01 2012-01-01 false Agreements. 247.4 Section 247.4 Agriculture... CHILD NUTRITION PROGRAMS COMMODITY SUPPLEMENTAL FOOD PROGRAM § 247.4 Agreements. (a) What agreements are necessary for agencies to administer CSFP? The following agreements are necessary for agencies to administer...

7 CFR 247.4 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 4 2013-01-01 2013-01-01 false Agreements. 247.4 Section 247.4 Agriculture... CHILD NUTRITION PROGRAMS COMMODITY SUPPLEMENTAL FOOD PROGRAM § 247.4 Agreements. (a) What agreements are necessary for agencies to administer CSFP? The following agreements are necessary for agencies to administer...

49 CFR 212.105 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 4 2012-10-01 2012-10-01 false Agreements. 212.105 Section 212.105 Transportation... TRANSPORTATION STATE SAFETY PARTICIPATION REGULATIONS State/Federal Roles § 212.105 Agreements. (a) Scope. The... agreement with FRA. An agreement may delegate investigative and surveillance authority with respect to all...

Assessing physical activity during youth sport: the Observational System for Recording Activity in Children: Youth Sports.

PubMed

Cohen, Alysia; McDonald, Samantha; McIver, Kerry; Pate, Russell; Trost, Stewart

2014-05-01

The purpose of this study was to evaluate the validity and interrater reliability of the Observational System for Recording Activity in Children: Youth Sports (OSRAC:YS). Children (N = 29) participating in a parks and recreation soccer program were observed during regularly scheduled practices. Physical activity (PA) intensity and contextual factors were recorded by momentary time-sampling procedures (10-second observe, 20-second record). Two observers simultaneously observed and recorded children's PA intensity, practice context, social context, coach behavior, and coach proximity. Interrater reliability was based on agreement (Kappa) between the observer's coding for each category, and the Intraclass Correlation Coefficient (ICC) for percent of time spent in MVPA. Validity was assessed by calculating the correlation between OSRAC:YS estimated and objectively measured MVPA. Kappa statistics for each category demonstrated substantial to almost perfect interobserver agreement (Kappa = 0.67-0.93). The ICC for percent time in MVPA was 0.76 (95% C.I. = 0.49-0.90). A significant correlation (r = .73) was observed for MVPA recorded by observation and MVPA measured via accelerometry. The results indicate the OSRAC:YS is a reliable and valid tool for measuring children's PA and contextual factors during a youth soccer practice.

7 CFR 1499.5 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 10 2013-01-01 2013-01-01 false Agreements. 1499.5 Section 1499.5 Agriculture... AGRICULTURE EXPORT PROGRAMS FOOD FOR PROGRESS PROGRAM § 1499.5 Agreements. (a) After FAS approves an applicant's proposal, FAS will develop an agreement in consultation with the applicant. The agreement will set...

7 CFR 1499.5 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 10 2012-01-01 2012-01-01 false Agreements. 1499.5 Section 1499.5 Agriculture... AGRICULTURE EXPORT PROGRAMS FOOD FOR PROGRESS PROGRAM § 1499.5 Agreements. (a) After FAS approves an applicant's proposal, FAS will develop an agreement in consultation with the applicant. The agreement will set...

7 CFR 1499.5 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 7 Agriculture 10 2014-01-01 2014-01-01 false Agreements. 1499.5 Section 1499.5 Agriculture... AGRICULTURE EXPORT PROGRAMS FOOD FOR PROGRESS PROGRAM § 1499.5 Agreements. (a) After FAS approves an applicant's proposal, FAS will develop an agreement in consultation with the applicant. The agreement will set...

2 CFR 3001.661 - Reimbursable Agreement.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 2 Grants and Agreements 1 2013-01-01 2013-01-01 false Reimbursable Agreement. 3001.661 Section 3001.661 Grants and Agreements Federal Agency Regulations for Grants and Agreements DEPARTMENT OF... Reimbursable Agreement. Reimbursable Agreement means an award in which the recipient is reimbursed for...

34 CFR 675.35 - Agreement.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 34 Education 3 2013-07-01 2013-07-01 false Agreement. 675.35 Section 675.35 Education Regulations..., DEPARTMENT OF EDUCATION FEDERAL WORK-STUDY PROGRAMS Job Location and Development Program § 675.35 Agreement... agreement with the Secretary. (b) The agreement must provide— (1) That the institution will administer the...

34 CFR 675.35 - Agreement.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 34 Education 3 2014-07-01 2014-07-01 false Agreement. 675.35 Section 675.35 Education Regulations..., DEPARTMENT OF EDUCATION FEDERAL WORK-STUDY PROGRAMS Job Location and Development Program § 675.35 Agreement... agreement with the Secretary. (b) The agreement must provide— (1) That the institution will administer the...

16 CFR 2.32 - Agreement.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 16 Commercial Practices 1 2013-01-01 2013-01-01 false Agreement. 2.32 Section 2.32 Commercial... Consent Order Procedure § 2.32 Agreement. Every agreement in settlement of a Commission complaint shall... of findings of fact and conclusions of law. Every agreement also shall waive further procedural steps...

34 CFR 675.35 - Agreement.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 34 Education 3 2012-07-01 2012-07-01 false Agreement. 675.35 Section 675.35 Education Regulations..., DEPARTMENT OF EDUCATION FEDERAL WORK-STUDY PROGRAMS Job Location and Development Program § 675.35 Agreement... agreement with the Secretary. (b) The agreement must provide— (1) That the institution will administer the...

34 CFR 675.35 - Agreement.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 34 Education 3 2011-07-01 2011-07-01 false Agreement. 675.35 Section 675.35 Education Regulations..., DEPARTMENT OF EDUCATION FEDERAL WORK-STUDY PROGRAMS Job Location and Development Program § 675.35 Agreement... agreement with the Secretary. (b) The agreement must provide— (1) That the institution will administer the...

16 CFR 2.32 - Agreement.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 16 Commercial Practices 1 2010-01-01 2010-01-01 false Agreement. 2.32 Section 2.32 Commercial... Consent Order Procedure § 2.32 Agreement. Every agreement in settlement of a Commission complaint shall... of findings of fact and conclusions of law. Every agreement also shall waive further procedural steps...

16 CFR 2.32 - Agreement.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 16 Commercial Practices 1 2012-01-01 2012-01-01 false Agreement. 2.32 Section 2.32 Commercial... Consent Order Procedure § 2.32 Agreement. Every agreement in settlement of a Commission complaint shall... of findings of fact and conclusions of law. Every agreement also shall waive further procedural steps...

16 CFR 2.32 - Agreement.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 16 Commercial Practices 1 2011-01-01 2011-01-01 false Agreement. 2.32 Section 2.32 Commercial... Consent Order Procedure § 2.32 Agreement. Every agreement in settlement of a Commission complaint shall... of findings of fact and conclusions of law. Every agreement also shall waive further procedural steps...

16 CFR 2.32 - Agreement.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 16 Commercial Practices 1 2014-01-01 2014-01-01 false Agreement. 2.32 Section 2.32 Commercial... Consent Order Procedure § 2.32 Agreement. Every agreement in settlement of a Commission complaint shall... of findings of fact and conclusions of law. Every agreement also shall waive further procedural steps...

34 CFR 675.35 - Agreement.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 34 Education 3 2010-07-01 2010-07-01 false Agreement. 675.35 Section 675.35 Education Regulations..., DEPARTMENT OF EDUCATION FEDERAL WORK-STUDY PROGRAMS Job Location and Development Program § 675.35 Agreement... agreement with the Secretary. (b) The agreement must provide— (1) That the institution will administer the...

Adults' past-day recall of sedentary time: reliability, validity, and responsiveness.

PubMed

Clark, Bronwyn K; Winkler, Elisabeth; Healy, Genevieve N; Gardiner, Paul G; Dunstan, David W; Owen, Neville; Reeves, Marina M

2013-06-01

Past-day recall rather than recall of past week or a usual/typical day may improve the validity of self-reported sedentary time measures. This study examined the test-retest reliability, criterion validity, and responsiveness of the seven-item questionnaire, Past-day Adults' Sedentary Time (PAST). Participants (breast cancer survivors, n = 90, age = 33-75 yr, body mass index = 25-40 kg·m) in a 6-month randomized controlled trial of a lifestyle-based weight loss intervention completed the interviewer-administered PAST questionnaire about time spent sitting/lying on the previous day for work, transport, television viewing, nonwork computer use, reading, hobbies, and other purposes (summed for total sedentary time). The instrument was administered at baseline, 7 d later for test-retest reliability (n = 86), and at follow-up. ActivPAL3-assessed sit/lie time in bouts of ≥5 min during waking hours on the recall day was used as the validity criterion measure at both baseline (n = 72) and follow-up (n = 68). Analyses included intraclass correlation coefficients, Pearson's correlations (r), and Bland-Altman plots and responsiveness index. The PAST had fair to good test-retest reliability (intraclass correlation coefficient = 0.50, 95% confidence interval [CI] = 0.32-0.64). At baseline, the correlation between PAST and activPAL sit/lie time was r = 0.57 (95% CI = 0.39-0.71). The mean difference between PAST at baseline and retest was -25 min (5.2%), 95% limits of agreement = -5.9 to 5.0 h, and the activPAL sit/lie time was -9 min (1.8%), 95% limits of agreement = -4.9 to 4.6 h. The PAST showed small but significant responsiveness (-0.44, 95% CI = -0.92 to -0.04); responsiveness of activPAL sit/lie time was not significant. The PAST questionnaire provided an easy-to-administer measure of sedentary time in this sample. Validity and reliability findings compare favorably with other sedentary time questionnaires. Past-day recall of sedentary time shows promise for use in

2 CFR 1401.220 - Cooperative agreement.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 2 Grants and Agreements 1 2013-01-01 2013-01-01 false Cooperative agreement. 1401.220 Section 1401.220 Grants and Agreements Federal Agency Regulations for Grants and Agreements DEPARTMENT OF THE... agreement. Cooperative agreement means an award of financial assistance that, consistent with 31 U.S.C. 6305...

49 CFR 605.14 - Agreement.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 7 2012-10-01 2012-10-01 false Agreement. 605.14 Section 605.14 Transportation... TRANSPORTATION SCHOOL BUS OPERATIONS School Bus Agreements § 605.14 Agreement. Except as provided in § 605.11 no... entered into a written agreement that the applicant will not engage in school bus operations exclusively...

49 CFR 605.14 - Agreement.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 7 2014-10-01 2014-10-01 false Agreement. 605.14 Section 605.14 Transportation... TRANSPORTATION SCHOOL BUS OPERATIONS School Bus Agreements § 605.14 Agreement. Except as provided in § 605.11 no... entered into a written agreement that the applicant will not engage in school bus operations exclusively...

23 CFR 660.111 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 23 Highways 1 2014-04-01 2014-04-01 false Agreements. 660.111 Section 660.111 Highways FEDERAL... (DIRECT FEDERAL) Forest Highways § 660.111 Agreements. (a) A statewide FH agreement shall be executed among the FHWA, the FS, and each SHA. This agreement shall set forth the responsibilities of each party...

23 CFR 660.111 - Agreements.

Code of Federal Regulations, 2011 CFR

2011-04-01

... 23 Highways 1 2011-04-01 2011-04-01 false Agreements. 660.111 Section 660.111 Highways FEDERAL... (DIRECT FEDERAL) Forest Highways § 660.111 Agreements. (a) A statewide FH agreement shall be executed among the FHWA, the FS, and each SHA. This agreement shall set forth the responsibilities of each party...

23 CFR 660.111 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-04-01

... 23 Highways 1 2012-04-01 2012-04-01 false Agreements. 660.111 Section 660.111 Highways FEDERAL... (DIRECT FEDERAL) Forest Highways § 660.111 Agreements. (a) A statewide FH agreement shall be executed among the FHWA, the FS, and each SHA. This agreement shall set forth the responsibilities of each party...

49 CFR 605.14 - Agreement.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 7 2013-10-01 2013-10-01 false Agreement. 605.14 Section 605.14 Transportation... TRANSPORTATION SCHOOL BUS OPERATIONS School Bus Agreements § 605.14 Agreement. Except as provided in § 605.11 no... entered into a written agreement that the applicant will not engage in school bus operations exclusively...

49 CFR 605.14 - Agreement.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 7 2011-10-01 2011-10-01 false Agreement. 605.14 Section 605.14 Transportation... TRANSPORTATION SCHOOL BUS OPERATIONS School Bus Agreements § 605.14 Agreement. Except as provided in § 605.11 no... entered into a written agreement that the applicant will not engage in school bus operations exclusively...

23 CFR 660.111 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 23 Highways 1 2013-04-01 2013-04-01 false Agreements. 660.111 Section 660.111 Highways FEDERAL... (DIRECT FEDERAL) Forest Highways § 660.111 Agreements. (a) A statewide FH agreement shall be executed among the FHWA, the FS, and each SHA. This agreement shall set forth the responsibilities of each party...

49 CFR 605.14 - Agreement.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 7 2010-10-01 2010-10-01 false Agreement. 605.14 Section 605.14 Transportation... TRANSPORTATION SCHOOL BUS OPERATIONS School Bus Agreements § 605.14 Agreement. Except as provided in § 605.11 no... entered into a written agreement that the applicant will not engage in school bus operations exclusively...

23 CFR 660.111 - Agreements.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 23 Highways 1 2010-04-01 2010-04-01 false Agreements. 660.111 Section 660.111 Highways FEDERAL... (DIRECT FEDERAL) Forest Highways § 660.111 Agreements. (a) A statewide FH agreement shall be executed among the FHWA, the FS, and each SHA. This agreement shall set forth the responsibilities of each party...

49 CFR 22.23 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 49 Transportation 1 2013-10-01 2013-10-01 false Agreements. 22.23 Section 22.23 Transportation... Agreements. (a) DOT OSDBU may enter into a cooperative agreement with a lender that meets the criteria defined in § 22.21 in order for the lender to become a Participating Lender in the STLP. Such an agreement...

49 CFR 22.23 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 49 Transportation 1 2014-10-01 2014-10-01 false Agreements. 22.23 Section 22.23 Transportation... Agreements. (a) DOT OSDBU may enter into a cooperative agreement with a lender that meets the criteria defined in § 22.21 in order for the lender to become a Participating Lender in the STLP. Such an agreement...

49 CFR 22.23 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 1 2012-10-01 2012-10-01 false Agreements. 22.23 Section 22.23 Transportation... Agreements. (a) DOT OSDBU may enter into a cooperative agreement with a lender that meets the criteria defined in § 22.21 in order for the lender to become a Participating Lender in the STLP. Such an agreement...

49 CFR 22.23 - Agreements.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 1 2010-10-01 2010-10-01 false Agreements. 22.23 Section 22.23 Transportation... Agreements. (a) DOT OSDBU may enter into a cooperative agreement with a lender that meets the criteria defined in § 22.21 in order for the lender to become a Participating Lender in the STLP. Such an agreement...

49 CFR 22.23 - Agreements.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 49 Transportation 1 2011-10-01 2011-10-01 false Agreements. 22.23 Section 22.23 Transportation... Agreements. (a) DOT OSDBU may enter into a cooperative agreement with a lender that meets the criteria defined in § 22.21 in order for the lender to become a Participating Lender in the STLP. Such an agreement...

Learning Low-Rank Class-Specific Dictionary and Sparse Intra-Class Variant Dictionary for Face Recognition.

PubMed

Tang, Xin; Feng, Guo-Can; Li, Xiao-Xin; Cai, Jia-Xin

2015-01-01

Face recognition is challenging especially when the images from different persons are similar to each other due to variations in illumination, expression, and occlusion. If we have sufficient training images of each person which can span the facial variations of that person under testing conditions, sparse representation based classification (SRC) achieves very promising results. However, in many applications, face recognition often encounters the small sample size problem arising from the small number of available training images for each person. In this paper, we present a novel face recognition framework by utilizing low-rank and sparse error matrix decomposition, and sparse coding techniques (LRSE+SC). Firstly, the low-rank matrix recovery technique is applied to decompose the face images per class into a low-rank matrix and a sparse error matrix. The low-rank matrix of each individual is a class-specific dictionary and it captures the discriminative feature of this individual. The sparse error matrix represents the intra-class variations, such as illumination, expression changes. Secondly, we combine the low-rank part (representative basis) of each person into a supervised dictionary and integrate all the sparse error matrix of each individual into a within-individual variant dictionary which can be applied to represent the possible variations between the testing and training images. Then these two dictionaries are used to code the query image. The within-individual variant dictionary can be shared by all the subjects and only contribute to explain the lighting conditions, expressions, and occlusions of the query image rather than discrimination. At last, a reconstruction-based scheme is adopted for face recognition. Since the within-individual dictionary is introduced, LRSE+SC can handle the problem of the corrupted training data and the situation that not all subjects have enough samples for training. Experimental results show that our method achieves the

Learning Low-Rank Class-Specific Dictionary and Sparse Intra-Class Variant Dictionary for Face Recognition

PubMed Central

Tang, Xin; Feng, Guo-can; Li, Xiao-xin; Cai, Jia-xin

2015-01-01

Face recognition is challenging especially when the images from different persons are similar to each other due to variations in illumination, expression, and occlusion. If we have sufficient training images of each person which can span the facial variations of that person under testing conditions, sparse representation based classification (SRC) achieves very promising results. However, in many applications, face recognition often encounters the small sample size problem arising from the small number of available training images for each person. In this paper, we present a novel face recognition framework by utilizing low-rank and sparse error matrix decomposition, and sparse coding techniques (LRSE+SC). Firstly, the low-rank matrix recovery technique is applied to decompose the face images per class into a low-rank matrix and a sparse error matrix. The low-rank matrix of each individual is a class-specific dictionary and it captures the discriminative feature of this individual. The sparse error matrix represents the intra-class variations, such as illumination, expression changes. Secondly, we combine the low-rank part (representative basis) of each person into a supervised dictionary and integrate all the sparse error matrix of each individual into a within-individual variant dictionary which can be applied to represent the possible variations between the testing and training images. Then these two dictionaries are used to code the query image. The within-individual variant dictionary can be shared by all the subjects and only contribute to explain the lighting conditions, expressions, and occlusions of the query image rather than discrimination. At last, a reconstruction-based scheme is adopted for face recognition. Since the within-individual dictionary is introduced, LRSE+SC can handle the problem of the corrupted training data and the situation that not all subjects have enough samples for training. Experimental results show that our method achieves the

Stair negotiation in women with fibromyalgia: A descriptive correlational study.

PubMed

Collado-Mateo, Daniel; Domínguez-Muñoz, Francisco J; Olivares, Pedro R; Adsuar, José C; Gusi, Narcis

2017-10-01

Walking up and down stairs is a common and important activity of daily living. Women with fibromyalgia often show a reduced ability to perform this task.The objective of this study was to evaluate the test-retest reliability of stair negotiation tasks and to assess the impact of fibromyalgia symptoms on the ability to negotiate stairs.Forty-two women with fibromyalgia participated in this descriptive correlational study. The relevance of the stair negotiation (both walking up and down) was evaluated by assessing its association with the revised version of the fibromyalgia impact questionnaire (FIQ-R) and other health-related variables. Test-retest reliability was also analyzed. The main outcome measures were time spent walking up and down stairs and impact of fibromyalgia, quality of life, number of falls, weight, and lower limb strength and endurance.The intraclass correlation coefficient (ICC) for stair descent was 0.929 whereas that for ascent was 0.972. The score in these tests correlated significantly with the total score for the FIQ-R and the score for many of dimensions and symptoms: that is, physical function, overall impact of fibromyalgia, pain, energy, stiffness, restorative sleep, tenderness, self-perceived balance problems, and sensitivity.Given the importance of the stair negotiation as activity of daily living and the high reliability, both stair ascent and descent tasks may be useful as outcome measures in studies on patients with fibromyalgia.

10 CFR 611.105 - Agreement.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 10 Energy 4 2014-01-01 2014-01-01 false Agreement. 611.105 Section 611.105 Energy DEPARTMENT OF... Direct Loan Program § 611.105 Agreement. (a) Only an Agreement executed by a duly authorized DOE... paid to DOE relating to the section 136 loan program. (d) Prior to the execution by DOE of an Agreement...

10 CFR 611.105 - Agreement.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 10 Energy 4 2012-01-01 2012-01-01 false Agreement. 611.105 Section 611.105 Energy DEPARTMENT OF... Direct Loan Program § 611.105 Agreement. (a) Only an Agreement executed by a duly authorized DOE... paid to DOE relating to the section 136 loan program. (d) Prior to the execution by DOE of an Agreement...

10 CFR 611.105 - Agreement.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 10 Energy 4 2010-01-01 2010-01-01 false Agreement. 611.105 Section 611.105 Energy DEPARTMENT OF... Direct Loan Program § 611.105 Agreement. (a) Only an Agreement executed by a duly authorized DOE... paid to DOE relating to the section 136 loan program. (d) Prior to the execution by DOE of an Agreement...

10 CFR 611.105 - Agreement.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 10 Energy 4 2011-01-01 2011-01-01 false Agreement. 611.105 Section 611.105 Energy DEPARTMENT OF... Direct Loan Program § 611.105 Agreement. (a) Only an Agreement executed by a duly authorized DOE... paid to DOE relating to the section 136 loan program. (d) Prior to the execution by DOE of an Agreement...

ACHP | Fort Monroe Agreement Signed

Science.gov Websites

Search skip specific nav links Home arrow News arrow Fort Monroe Agreement Signed Fort Monroe Agreement Signed A historic agreement has been reached on a richly historic property, Fort Monroe, Virginia. Fort Programmatic Agreement (PA) that capped a lengthy and complex Section 106 consultation process led by the

10 CFR 611.105 - Agreement.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 10 Energy 4 2013-01-01 2013-01-01 false Agreement. 611.105 Section 611.105 Energy DEPARTMENT OF... Direct Loan Program § 611.105 Agreement. (a) Only an Agreement executed by a duly authorized DOE... paid to DOE relating to the section 136 loan program. (d) Prior to the execution by DOE of an Agreement...

Agreement studies in radiology research.

PubMed

Farzin, B; Gentric, J-C; Pham, M; Tremblay-Paquet, S; Brosseau, L; Roy, C; Jamali, S; Chagnon, M; Darsaut, T E; Guilbert, F; Naggara, O; Raymond, J

2017-03-01

The goal of this study was to estimate the frequency and the quality of agreement studies published in diagnostic imaging journals. All studies published between January 2011 and December 2012 in four radiology journals were reviewed. Four trained readers evaluated agreement studies using a 24-item form that included the 15 items of the Guidelines for Reporting Reliability and Agreement Studies criteria. Of 2229 source titles, 280 studies (13%) reported agreement. The mean number of patients per study was 81±99 (SD) (range, 0-180). Justification for sample size was found in 9 studies (3%). The number of raters was≤2 in 226 studies (81%). No intra-observer study was performed in 212 (76%) articles. Confidence intervals and interpretation of statistical estimates were provided in 98 (35%) and 147 (53%) of the studies, respectively. In 168 studies (60%), the agreement study was not mentioned in the discussion section. In 8 studies (3%), reporting of the agreement study was judged to be adequate. Twenty studies (7%) were dedicated to agreement. Agreement studies are preliminary and not adequately reported. Studies dedicated to agreement are infrequent. They are research opportunities that should be promoted. Copyright © 2016 Éditions françaises de radiologie. Published by Elsevier Masson SAS. All rights reserved.

The Dutch version of the Oxford Ankle and Foot Questionnaire for Children: Useful for evaluation of pediatric foot problems in groups.

PubMed

Burger, Elise; Selles, Ruud; van Nieuwkasteele, Shelly; Bessems, Gert; Pollet, Virginie; Hovius, Steven; van Nieuwenhoven, Christianne

2017-11-04

The purpose of this study is to develop a Dutch version of the Oxford Ankle and Foot Questionnaire for Children (OxAFQ-c) to allow evaluation of pediatric foot care. The OxAFQ-c was translated into Dutch, according to the ISPOR-guidelines. Children with different foot and ankle complaints completed the OxAFQ-c at baseline, after two weeks, and after 4-6 months. Measurement properties were assessed in terms of reliability, responsiveness, and construct validity. Test-retest reliability showed moderate intraclass correlation coefficients. Bland-Altman plots showed wide limits of agreement. After 4-6 months, the group that experienced improvement also showed improved questionnaire outcomes, indicating responsiveness. Moderate correlation between the OxAFQ-c and the Kidscreen and foot-specific VAS-scores were observed, indicating moderate construct validity. The Dutch OxAFQ-c showed moderate to good measurement properties. However, because we observed limited sensitivity to changes and wide limits of agreement in individual patients, we think the questionnaire should only be used in groups. Copyright © 2017 European Foot and Ankle Society. Published by Elsevier Ltd. All rights reserved.

Radiographical measurements for distal intra-articular fractures of the radius using plain radiographs and cone beam computed tomography images.

PubMed

Suojärvi, Nora; Sillat, T; Lindfors, N; Koskinen, S K

2015-12-01

Operative treatment of an intra-articular distal radius fracture is one of the most common procedures in orthopedic and hand surgery. The intra- and interobserver agreement of common radiographical measurements of these fractures using cone beam computed tomography (CBCT) and plain radiographs were evaluated. Thirty-seven patients undergoing open reduction and volar fixation for a distal radius fracture were studied. Two radiologists analyzed the preoperative radiographs and CBCT images. Agreement of the measurements was subjected to intra-class correlation coefficient and the Bland-Altman analyses. Plain radiographs provided a slightly poorer level of agreement. For fracture diastasis, excellent intraobserver agreement was achieved for radiographs and good or excellent agreement for CBCT, compared to poor interobserver agreement (ICC 0.334) for radiographs and good interobserver agreement (ICC 0.621) for CBCT images. The Bland-Altman analyses indicated a small mean difference between the measurements but rather large variation using both imaging methods, especially in angular measurements. For most of the measurements, radiographs do well, and may be used in clinical practice. Two different measurements by the same reader or by two different readers can lead to different decisions, and therefore a standardization of the measurements is imperative. More detailed analysis of articular surface needs cross-sectional imaging modalities.

Misinterpretations in agreement and agreement attraction.

PubMed

Patson, Nikole D; Husband, E Matthew

2016-01-01

It has been well established that subject-verb number agreement can be disrupted by local noun phrases that differ in number from the subject head noun phrase. In sentence production, mismatches in the grammatical number of the head and local noun phrases lead to agreement errors on the verb as in: the key to the cabinets are. Similarly, although ungrammaticality typically causes disruption in measures of sentence comprehension, the disruption is reduced when the local noun phrase has a plural feature. Using a forced-choice comprehension question method, we report two experiments that provide evidence that comprehenders were likely to misinterpret the number information on the head noun phrase when morphosyntactic number markings on the local noun phrase and verb did not match the head. These results are consistent with a growing body of research that suggests that comprehenders often arrive at a final interpretation of a sentence that is not faithful to the linguistic input.

Spectral correlations in Anderson insulating wires

NASA Astrophysics Data System (ADS)

Marinho, M.; Micklitz, T.

2018-01-01

We calculate the spectral level-level correlation function of Anderson insulating wires for all three Wigner-Dyson classes. A measurement of its Fourier transform, the spectral form factor, is within reach of state-of-the-art cold atom quantum quench experiments, and we find good agreement with recent numerical simulations of the latter. Our derivation builds on a representation of the level-level correlation function in terms of a local generating function which may prove useful in other contexts.

A person is not a number: discourse involvement in subject-verb agreement computation.

PubMed

Mancini, Simona; Molinaro, Nicola; Rizzi, Luigi; Carreiras, Manuel

2011-09-02

Agreement is a very important mechanism for language processing. Mainstream psycholinguistic research on subject-verb agreement processing has emphasized the purely formal and encapsulated nature of this phenomenon, positing an equivalent access to person and number features. However, person and number are intrinsically different, because person conveys extra-syntactic information concerning the participants in the speech act. To test the person-number dissociation hypothesis we investigated the neural correlates of subject-verb agreement in Spanish, using person and number violations. While number agreement violations produced a left-anterior negativity followed by a P600 with a posterior distribution, the negativity elicited by person anomalies had a centro-posterior maximum and was followed by a P600 effect that was frontally distributed in the early phase and posteriorly distributed in the late phase. These data reveal that the parser is differentially sensitive to the two features and that it deals with the two anomalies by adopting different strategies, due to the different levels of analysis affected by the person and number violations. Copyright © 2011 Elsevier B.V. All rights reserved.

Measuring Quadriceps strength in adults with severe or moderate intellectual and visual disabilities: Feasibility and reliability.

PubMed

Dijkhuizen, Annemarie; Douma, Rob K; Krijnen, Wim P; van der Schans, Cees P; Waninge, Aly

2018-05-30

A feasible and reliable instrument to measure strength in persons with severe intellectual and visual disabilities (SIVD) is lacking. The aim of our study was to determine feasibility, learning period and reliability of three strength tests. Twenty-nine participants with SIVD performed the Minimum Sit-to-Stand Height test (MSST), the Leg Extension test (LE) and the 30 seconds Chair-Stand test (30sCS), once per week for 5 weeks. Feasibility was determined by the percentage of successful measurements; learning effect by using paired t test between two consecutive measurements; test-retest reliability by intraclass correlation coefficient and Limits of Agreement and, correlations by Pearson correlations. A sufficient feasibility and learning period of the tests was shown. The methods had sufficient test-retest reliability and moderate-to-sufficient correlations. The MSST, the LE, and the 30sCS are feasible tests for measuring muscle strength in persons with SIVD, having sufficient test re-test reliability. © 2018 John Wiley & Sons Ltd.

48 CFR 225.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 3 2010-10-01 2010-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 225.403 Section 225.403 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements...

48 CFR 225.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 48 Federal Acquisition Regulations System 3 2014-10-01 2014-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 225.403 Section 225.403 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements...

48 CFR 225.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 48 Federal Acquisition Regulations System 3 2012-10-01 2012-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 225.403 Section 225.403 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements...

48 CFR 225.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 3 2011-10-01 2011-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 225.403 Section 225.403 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements...

48 CFR 225.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 48 Federal Acquisition Regulations System 3 2013-10-01 2013-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 225.403 Section 225.403 Federal Acquisition Regulations System DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements...

Several submaximal exercise tests are reliable, valid and acceptable in people with chronic pain, fibromyalgia or chronic fatigue: a systematic review.

PubMed

Ratter, Julia; Radlinger, Lorenz; Lucas, Cees

2014-09-01

Are submaximal and maximal exercise tests reliable, valid and acceptable in people with chronic pain, fibromyalgia and fatigue disorders? Systematic review of studies of the psychometric properties of exercise tests. People older than 18 years with chronic pain, fibromyalgia and chronic fatigue disorders. Studies of the measurement properties of tests of physical capacity in people with chronic pain, fibromyalgia or chronic fatigue disorders were included. Studies were required to report: reliability coefficients (intraclass correlation coefficient, alpha reliability coefficient, limits of agreements and Bland-Altman plots); validity coefficients (intraclass correlation coefficient, Spearman's correlation, Kendal T coefficient, Pearson's correlation); or dropout rates. Fourteen studies were eligible: none had low risk of bias, 10 had unclear risk of bias and four had high risk of bias. The included studies evaluated: Åstrand test; modified Åstrand test; Lean body mass-based Åstrand test; submaximal bicycle ergometer test following another protocol other than Åstrand test; 2-km walk test; 5-minute, 6-minute and 10-minute walk tests; shuttle walk test; and modified symptom-limited Bruce treadmill test. None of the studies assessed maximal exercise tests. Where they had been tested, reliability and validity were generally high. Dropout rates were generally acceptable. The 2-km walk test was not recommended in fibromyalgia. Moderate evidence was found for reliability, validity and acceptability of submaximal exercise tests in patients with chronic pain, fibromyalgia or chronic fatigue. There is no evidence about maximal exercise tests in patients with chronic pain, fibromyalgia and chronic fatigue. Copyright © 2014. Published by Elsevier B.V.

Correlation of skeletal maturation stages determined by cervical vertebrae and hand-wrist evaluations.

PubMed

Flores-Mir, Carlos; Burgess, Corr A; Champney, Mitchell; Jensen, Robert J; Pitcher, Micheal R; Major, Paul W

2006-01-01

The aim of this study was to assess the correlation between the Fishman maturation prediction method (FMP) and the cervical vertebral maturation (CVM) method for skeletal maturation stage determination. Hand-wrist and lateral cephalograms from 79 subjects (52 females and 27 males) were used. Hand-wrist radiographs were analyzed using the FMP to determine skeletal maturation level (advanced, average, or delayed) and stage (relative position of the individual in the pubertal growth curve). Cervical vertebrae (C2, C3, and C4) outlines obtained from lateral cephalograms were analyzed using the CVM to determine skeletal maturation stage. Intraexaminer reliability (Intraclass correlation coefficient [ICC]) for both methods was calculated from 10 triplicate hand-wrist and lateral cephalograms from the same patients. An ICC coefficient of 0.985 for FMP and an ICC of 0.889 for CVM were obtained. A Spearman correlation value of 0.72 (P < .001) was found between the skeletal maturation stages of both methods. When the sample was subgrouped according to skeletal maturation level, the following correlation values were found: for early mature adolescents 0.73, for average mature adolescents 0.70, and for late mature adolescents 0.87. All these correlation values were statistically different from zero (P < .024). Correlation values between both skeletal maturation methods were moderately high. This may be high enough to use either of the methods indistinctively for research purposes but not for the assessment of individual patients. Skeletal level influences the correlation values and, therefore, it should be considered whenever possible.

48 CFR 25.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 48 Federal Acquisition Regulations System 1 2010-10-01 2010-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 25.403 Section 25.403 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements 25.403 World Trade Organization...

48 CFR 25.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 48 Federal Acquisition Regulations System 1 2012-10-01 2012-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 25.403 Section 25.403 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements 25.403 World Trade Organization...

48 CFR 25.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2011 CFR

2011-10-01

... 48 Federal Acquisition Regulations System 1 2011-10-01 2011-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 25.403 Section 25.403 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements 25.403 World Trade Organization...

48 CFR 25.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2014 CFR

2014-10-01

... 48 Federal Acquisition Regulations System 1 2014-10-01 2014-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 25.403 Section 25.403 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements 25.403 World Trade Organization...

48 CFR 25.403 - World Trade Organization Government Procurement Agreement and Free Trade Agreements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 48 Federal Acquisition Regulations System 1 2013-10-01 2013-10-01 false World Trade Organization Government Procurement Agreement and Free Trade Agreements. 25.403 Section 25.403 Federal Acquisition Regulations System FEDERAL ACQUISITION REGULATION SOCIOECONOMIC PROGRAMS FOREIGN ACQUISITION Trade Agreements 25.403 World Trade Organization...

Role of temperature on static correlational properties in a spin-polarized electron gas

DOE Office of Scientific and Technical Information (OSTI.GOV)

Arora, Priya; Moudgil, R. K., E-mail: rkmoudgil@kuk.ac.in; Kumar, Krishan

We have studied the effect of temperature on the static correlational properties of a spin-polarized three-dimensional electron gas (3DEG) over a wide coupling and temperature regime. This problem has been very recently studied by Brown et al. using the restricted path-integral Monte Carlo (RPIMC) technique in the warm-dense regime. To this endeavor, we have used the finite temperature version of the dynamical mean-field theory of Singwi et al, the so-called quantum STLS (qSTLS) approach. The static density structure factor and the static pair-correlation function are calculated, and compared with the RPIMC simulation data. We find an excellent agreement with themore » simulation at high temperature over a wide coupling range. However, the agreement is seen to somewhat deteriorate with decreasing temperature. The pair-correlation function is found to become small negative for small electron separation. This may be attributed to the inadequacy of the mean-field theory in dealing with the like spin electron correlations in the strong-coupling domain. A nice agreement with RPIMC data at high temperature seems to arise due to weakening of both the exchange and coulomb correlations with rising temperature.« less

2 CFR 182.620 - Cooperative agreement.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 2 Grants and Agreements 1 2013-01-01 2013-01-01 false Cooperative agreement. 182.620 Section 182.620 Grants and Agreements Office of Management and Budget Guidance for Grants and Agreements OFFICE OF MANAGEMENT AND BUDGET GOVERNMENTWIDE GUIDANCE FOR GRANTS AND AGREEMENTS NATIONAL POLICY REQUIREMENTS...

24 CFR 582.315 - Occupancy agreements.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 24 Housing and Urban Development 3 2014-04-01 2013-04-01 true Occupancy agreements. 582.315... agreements. (a) Initial occupancy agreement. Participants must enter into an occupancy agreement for a term of at least one month. The occupancy agreement must be automatically renewable upon expiration...

Spatiotemporal image correlation-derived volumetric Doppler impedance indices from spherical samples of the placenta: intraobserver reliability and correlation with conventional umbilical artery Doppler indices.

PubMed

Welsh, A W; Hou, M; Meriki, N; Martins, W P

2012-10-01

Volumetric impedance indices derived from spatiotemporal image correlation (STIC) power Doppler ultrasound (PDU) might overcome the influence of machine settings and attenuation. We examined the feasibility of obtaining these indices from spherical samples of anterior placentas in healthy pregnancies, and assessed intraobserver reliability and correlation with conventional umbilical artery (UA) impedance indices. Uncomplicated singleton pregnancies with anterior placenta were included in the study. A single observer evaluated UA pulsatility index (PI), resistance index (RI) and systolic/diastolic ratio (S/D) and acquired three STIC-PDU datasets from the placenta just above the placental cord insertion. Another observer analyzed the STIC-PDU datasets using Virtual Organ Computer-aided AnaLysis (VOCAL) spherical samples from every frame to determine the vascularization index (VI) and vascularization flow index (VFI); maximum, minimum and average values were used to determine the three volumetric impedance indices (vPI, vRI, vS/D). Intraobserver reliability was examined by intraclass correlation coefficients (ICC) and association between volumetric indices from placenta, and UA Doppler indices were assessed by Pearson's correlation coefficient. A total of 25 pregnant women were evaluated but five were excluded because of artifacts observed during analysis. The reliability of measurement of volumetric indices of both VI and VFI from three STIC-PDU datasets was similar, with all ICCs ≥ 0.78. Pearson's r values showed a weak and non-significant correlation between UA pulsed-wave Doppler indices and their respective volumetric indices from spherical samples of placenta (all r ≥ 0.23). VOCAL indices from specific phases of the cardiac cycle showed good repeatability (ICC ≥ 0.92). Volumetric impedance indices determined from spherical samples of placenta are sufficiently reliable but do not correlate with UA Doppler indices in healthy pregnancies. Copyright © 2012

Morphology vs morphokinetics: a retrospective comparison of inter-observer and intra-observer agreement between embryologists on blastocysts with known implantation outcome.

PubMed

Adolfsson, Emma; Andershed, Anna Nowosad

2018-06-18

Our primary aim was to compare the morphology and morphokinetics on inter- and intra-observer agreement for blastocyst with known implantation outcome. Our secondary aim was to validate the morphokinetic parameters' ability to predict pregnancy using a previous published selection algorithm, and to compare this to standard morphology assessments. Two embryologists made independent blinded annotations on two occasions using time-lapse images and morphology evaluations using the Gardner Schoolcraft criteria of 99 blastocysts with known implantation outcome. Inter- and intra-observer agreement was calculated and compared using the two methods. The embryos were grouped based on their morphological score, and on their morphokinetic class using a previous published selection algorithm. The implantation rates for each group was calculated and compared. There was moderate agreement for morphology, with agreement on the same embryo score in 55 of 99 cases. The highest agreement rate was found for expansion grade, followed by trophectoderm and inner cell mass. Correlation with pregnancy was inconclusive. For morphokinetics, almost perfect agreement was found for early and late embryo development events, and strong agreement for day-2 and day-3 events. When applying the selection algorithm, the embryo distributions were uneven, and correlation to pregnancy was inconclusive. Time-lapse annotation is consistent and accurate, but our external validation of a previously published selection algorithm was unsuccessful.

31 CFR 540.305 - HEU Agreements.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 31 Money and Finance:Treasury 3 2013-07-01 2013-07-01 false HEU Agreements. 540.305 Section 540... FOREIGN ASSETS CONTROL, DEPARTMENT OF THE TREASURY HIGHLY ENRICHED URANIUM (HEU) AGREEMENT ASSETS CONTROL REGULATIONS General Definitions § 540.305 HEU Agreements. The term HEU Agreements means the Agreement Between...

31 CFR 540.305 - HEU Agreements.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 31 Money and Finance: Treasury 3 2010-07-01 2010-07-01 false HEU Agreements. 540.305 Section 540... FOREIGN ASSETS CONTROL, DEPARTMENT OF THE TREASURY HIGHLY ENRICHED URANIUM (HEU) AGREEMENT ASSETS CONTROL REGULATIONS General Definitions § 540.305 HEU Agreements. The term HEU Agreements means the Agreement Between...

The Edematous and Erythematous Airway Does Not Denote Pathologic Gastroesophageal Reflux.

PubMed

Rosen, Rachel; Mitchell, Paul D; Amirault, Janine; Amin, Manali; Watters, Karen; Rahbar, Reza

2017-04-01

To determine if the reflux finding score (RFS), a validated score for airway inflammation, correlates with gastroesophageal reflux measured by multichannel intraluminal impedance (MII) testing, endoscopy, and quality of life scores. We performed a prospective, cross-sectional cohort study of 77 children with chronic cough undergoing direct laryngoscopy and bronchoscopy, esophagogastroduodenoscopy, and MII testing with pH (pH-MII) between 2006 and 2011. Airway examinations were videotaped and reviewed by 3 blinded otolaryngologists each of whom assigned RFS to the airways. RFS were compared with the results of reflux testing (endoscopy, MII, symptom scores). An intraclass correlation coefficient was calculated for the degree of agreement between otolaryngologists' RFS. Receiver operating characteristic curves were created to determine the sensitivity of the RFS. Spearman correlation was calculated between the RFS and reflux measurements by pH-MII. The mean ± SD RFS was 12 ± 4. There was no correlation between pH-MII variables and mean RFS (|r| < 0.15). The concordance correlation coefficient for RFS between otolaryngologists was low (intraclass correlation coefficient = 0.32). Using pH-metry as a gold standard, the positive predictive value for the RFS was 29%. Using MII as the gold standard, the positive predictive value for the RFS was 40%. There was no difference in the mean RFS in patients with (12 ± 4) and without (12 ± 3) esophagitis (P = .9). There was no correlation between RFS and quality of life scores (|r| < 0.15, P > .3). The RFS cannot predict pathologic gastroesophageal reflux and an airway examination should not be used as a basis for prescribing gastroesophageal reflux therapies. Copyright © 2016. Published by Elsevier Inc.

46 CFR 535.404 - Agreement provisions.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 46 Shipping 9 2013-10-01 2013-10-01 false Agreement provisions. 535.404 Section 535.404 Shipping... AND MARINE TERMINAL OPERATOR AGREEMENTS SUBJECT TO THE SHIPPING ACT OF 1984 Filing of Agreements § 535.404 Agreement provisions. Generally, each agreement should: (a) Indicate the full legal name of each...

48 CFR 1642.7001 - Management agreement.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 48 Federal Acquisition Regulations System 6 2013-10-01 2013-10-01 false Management agreement. 1642... Agreement (in Lieu of Novation Agreement) 1642.7001 Management agreement. When it is in the best interest of... operations and has entered into a Purchase and Sale Agreement (or other descriptive term), but before a...

46 CFR 535.201 - Subject agreements.

Code of Federal Regulations, 2013 CFR

2013-10-01

... 46 Shipping 9 2013-10-01 2013-10-01 false Subject agreements. 535.201 Section 535.201 Shipping... AND MARINE TERMINAL OPERATOR AGREEMENTS SUBJECT TO THE SHIPPING ACT OF 1984 Scope § 535.201 Subject agreements. (a) Ocean common carrier agreements. This part applies to agreements by or among ocean common...

8 CFR 217.6 - Carrier agreements.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 8 Aliens and Nationality 1 2013-01-01 2013-01-01 false Carrier agreements. 217.6 Section 217.6....6 Carrier agreements. (a) General. The carrier agreements referred to in section 217(e) of the Act... Waiver Pilot Program Agreement. (b) Termination of agreements. The Commissioner, on behalf of the...

8 CFR 217.6 - Carrier agreements.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 8 Aliens and Nationality 1 2012-01-01 2012-01-01 false Carrier agreements. 217.6 Section 217.6....6 Carrier agreements. (a) General. The carrier agreements referred to in section 217(e) of the Act... Waiver Pilot Program Agreement. (b) Termination of agreements. The Commissioner, on behalf of the...

Validation of a score tool for measurement of histological severity in juvenile dermatomyositis and association with clinical severity of disease

PubMed Central

Varsani, Hemlata; Charman, Susan C; Li, Charles K; Marie, Suely K N; Amato, Anthony A; Banwell, Brenda; Bove, Kevin E; Corse, Andrea M; Emslie-Smith, Alison M; Jacques, Thomas S; Lundberg, Ingrid E; Minetti, Carlo; Nennesmo, Inger; Rushing, Elisabeth J; Sallum, Adriana M E; Sewry, Caroline; Pilkington, Clarissa A; Holton, Janice L; Wedderburn, Lucy R

2015-01-01

Objectives To study muscle biopsy tissue from patients with juvenile dermatomyositis (JDM) in order to test the reliability of a score tool designed to quantify the severity of histological abnormalities when applied to biceps humeri in addition to quadriceps femoris. Additionally, to evaluate whether elements of the tool correlate with clinical measures of disease severity. Methods 55 patients with JDM with muscle biopsy tissue and clinical data available were included. Biopsy samples (33 quadriceps, 22 biceps) were prepared and stained using standardised protocols. A Latin square design was used by the International Juvenile Dermatomyositis Biopsy Consensus Group to score cases using our previously published score tool. Reliability was assessed by intraclass correlation coefficient (ICC) and scorer agreement (α) by assessing variation in scorers’ ratings. Scores from the most reliable tool items correlated with clinical measures of disease activity at the time of biopsy. Results Inter- and intraobserver agreement was good or high for many tool items, including overall assessment of severity using a Visual Analogue Scale. The tool functioned equally well on biceps and quadriceps samples. A modified tool using the most reliable score items showed good correlation with measures of disease activity. Conclusions The JDM biopsy score tool has high inter- and intraobserver agreement and can be used on both biceps and quadriceps muscle tissue. Importantly, the modified tool correlates well with clinical measures of disease activity. We propose that standardised assessment of muscle biopsy tissue should be considered in diagnostic investigation and clinical trials in JDM. PMID:24064003

49 CFR 1325.2 - Credit agreements.

Code of Federal Regulations, 2012 CFR

2012-10-01

... 49 Transportation 9 2012-10-01 2012-10-01 false Credit agreements. 1325.2 Section 1325.2... FEDERAL OFFICE OR THEIR REPRESENTATIVES § 1325.2 Credit agreements. (a) All agreements to extend credit to... parties to the agreement. A copy of each such agreement must be filed with this Board's Bureau of...

22 CFR 33.5 - Guaranty agreements.

Code of Federal Regulations, 2013 CFR

2013-04-01

... 22 Foreign Relations 1 2013-04-01 2013-04-01 false Guaranty agreements. 33.5 Section 33.5 Foreign... UNDER SECTION 7 § 33.5 Guaranty agreements. (a) Period in effect. Agreements are effective for a Fiscal... September 30. (b) Guaranty agreement transfer. A guaranty agreement may, with the Secretary's prior consent...

49 CFR 1325.2 - Credit agreements.

Code of Federal Regulations, 2010 CFR

2010-10-01

... 49 Transportation 9 2010-10-01 2010-10-01 false Credit agreements. 1325.2 Section 1325.2... FEDERAL OFFICE OR THEIR REPRESENTATIVES § 1325.2 Credit agreements. (a) All agreements to extend credit to... parties to the agreement. A copy of each such agreement must be filed with this Board's Bureau of...

22 CFR 33.5 - Guaranty agreements.

Code of Federal Regulations, 2014 CFR

2014-04-01

... 22 Foreign Relations 1 2014-04-01 2014-04-01 false Guaranty agreements. 33.5 Section 33.5 Foreign... UNDER SECTION 7 § 33.5 Guaranty agreements. (a) Period in effect. Agreements are effective for a Fiscal... September 30. (b) Guaranty agreement transfer. A guaranty agreement may, with the Secretary's prior consent...

29 CFR 1908.10 - Cooperative Agreements.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 29 Labor 5 2012-07-01 2012-07-01 false Cooperative Agreements. 1908.10 Section 1908.10 Labor... CONSULTATION AGREEMENTS § 1908.10 Cooperative Agreements. (a) Who may make Agreements. The Assistant Secretary may make a Cooperative Agreement under this part with the Governor of a State or with any State agency...

22 CFR 33.5 - Guaranty agreements.

Code of Federal Regulations, 2010 CFR

2010-04-01

... 22 Foreign Relations 1 2010-04-01 2010-04-01 false Guaranty agreements. 33.5 Section 33.5 Foreign... UNDER SECTION 7 § 33.5 Guaranty agreements. (a) Period in effect. Agreements are effective for a Fiscal... September 30. (b) Guaranty agreement transfer. A guaranty agreement may, with the Secretary's prior consent...

29 CFR 1908.10 - Cooperative Agreements.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 29 Labor 5 2010-07-01 2010-07-01 false Cooperative Agreements. 1908.10 Section 1908.10 Labor... CONSULTATION AGREEMENTS § 1908.10 Cooperative Agreements. (a) Who may make Agreements. The Assistant Secretary may make a Cooperative Agreement under this part with the Governor of a State or with any State agency...

29 CFR 1908.10 - Cooperative Agreements.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 29 Labor 5 2014-07-01 2014-07-01 false Cooperative Agreements. 1908.10 Section 1908.10 Labor... CONSULTATION AGREEMENTS § 1908.10 Cooperative Agreements. (a) Who may make Agreements. The Assistant Secretary may make a Cooperative Agreement under this part with the Governor of a State or with any State agency...

48 CFR 242.1204 - Agreement to recognize a successor in interest (novation agreement).

Code of Federal Regulations, 2011 CFR

2011-10-01

... DEFENSE ACQUISITION REGULATIONS SYSTEM, DEPARTMENT OF DEFENSE CONTRACT MANAGEMENT CONTRACT ADMINISTRATION AND AUDIT SERVICES Novation and Change-of-Name Agreements 242.1204 Agreement to recognize a successor...

Measurement of the perfusion fraction in brain tumors with intravoxel incoherent motion MR imaging: validation with histopathological vascular density in meningiomas.

PubMed

Togao, Osamu; Hiwatashi, Akio; Yamashita, Koji; Kikuchi, Kazufumi; Momosaka, Daichi; Yoshimoto, Koji; Kuga, Daisuke; Mizoguchi, Masahiro; Suzuki, Satoshi O; Iwaki, Toru; Van Cauteren, Marc; Iihara, Koji; Honda, Hiroshi

2018-05-01

To evaluate the quantification performance of the perfusion fraction (f) measured with intravoxel incoherent motion (IVIM) MR imaging in a comparison with the histological vascular density in meningiomas. 29 consecutive patients with meningioma (59.0 ± 16.8 years old, 8 males and 21 females) who underwent a subsequent surgical resection were examined with both IVIM imaging and a histopathological analysis. IVIM imaging was conducted using a single-shot SE-EPI sequence with 13 b-factors (0, 10, 20, 30, 50, 80, 100, 200, 300, 400, 600, 800, 1000 s mm - 2 ) at 3T. The perfusion fraction (f) was calculated by fitting the IVIM bi-exponential model. The 90-percentile f-value in the tumor region-of-interest (ROI) was defined as the maximum f-value (f-max). Histopathological vascular density (%Vessel) was measured on CD31-immunostainted histopathological specimens. The correlation and agreement between the f-values and %Vessel was assessed. The f-max (15.5 ± 5.5%) showed excellent agreement [intraclass correlation coefficient (ICC) = 0.754] and a significant correlation (r = 0.69, p < 0.0001) with the %Vessel (12.9 ± 9.4%) of the tumors. The Bland-Altman plot analysis showed excellent agreement between the f-max and %Vessel (bias, -2.6%; 95% limits of agreement, from -16.0 to 10.8%). The f-max was not significantly different among the histological subtypes of meningioma. An excellent agreement and a significant correlation were observed between the f-values and %Vessel. The f-value can be used as a noninvasive quantitative imaging measure to directly assess the vascular volume fraction in brain tumors. Advances in knowledge: The f-value measured by IVIM imaging showed a significant correlation and an excellent agreement with the histological vascular density in the meningiomas. The f-value can be used as a noninvasive and quantitative imaging measure to directly assess the volume fraction of capillaries in brain tumors.

Compressed Secret Key Agreement:Maximizing Multivariate Mutual Information per Bit

NASA Astrophysics Data System (ADS)

Chan, Chung

2017-10-01

The multiterminal secret key agreement problem by public discussion is formulated with an additional source compression step where, prior to the public discussion phase, users independently compress their private sources to filter out strongly correlated components for generating a common secret key. The objective is to maximize the achievable key rate as a function of the joint entropy of the compressed sources. Since the maximum achievable key rate captures the total amount of information mutual to the compressed sources, an optimal compression scheme essentially maximizes the multivariate mutual information per bit of randomness of the private sources, and can therefore be viewed more generally as a dimension reduction technique. Single-letter lower and upper bounds on the maximum achievable key rate are derived for the general source model, and an explicit polynomial-time computable formula is obtained for the pairwise independent network model. In particular, the converse results and the upper bounds are obtained from those of the related secret key agreement problem with rate-limited discussion. A precise duality is shown for the two-user case with one-way discussion, and such duality is extended to obtain the desired converse results in the multi-user case. In addition to posing new challenges in information processing and dimension reduction, the compressed secret key agreement problem helps shed new light on resolving the difficult problem of secret key agreement with rate-limited discussion, by offering a more structured achieving scheme and some simpler conjectures to prove.

Reliability of internal oblique elbow radiographs for measuring displacement of medial epicondyle humerus fractures: a cadaveric study.

PubMed

Gottschalk, Hilton P; Bastrom, Tracey P; Edmonds, Eric W

2013-01-01

Standard elbow radiographs (AP and lateral views) are not accurate enough to measure true displacement of medial epicondyle fractures of the humerus. The amount of perceived displacement has been used to determine treatment options. This study assesses the utility of internal oblique radiographs for measurement of true displacement in these fractures. A medial epicondyle fracture was created in a cadaveric specimen. Displacement of the fragment (mm) was set at 5, 10, and 15 in line with the vector of the flexor pronator mass. The fragment was sutured temporarily in place. Radiographs were obtained at 0 (AP), 15, 30, 45, 60, 75, and 90 degrees (lateral) of internal rotation, with the elbow in set positions of flexion. This was done with and without radio-opaque markers placed on the fragment and fracture bed. The 45 and 60 degrees internal oblique radiographs were then presented to 5 separate reviewers (of different levels of training) to evaluate intraobserver and interobserver agreement. Change in elbow position did not affect the perceived displacement (P=0.82) with excellent intraobserver reliability (intraclass correlation coefficient range, 0.979 to 0.988) and interobserver agreement of 0.953. The intraclass correlation coefficient for intraobserver reliability on 45 degrees internal oblique films for all groups ranged from 0.985 to 0.998, with interobserver agreement of 0.953. For predicting displacement, the observers were 60% accurate in predicting the true displacement on the 45 degrees internal oblique films and only 35% accurate using the 60 degrees internal oblique view. Standardizing to a 45 degrees internal oblique radiograph of the elbow (regardless of elbow flexion) can augment the treating surgeon's ability to determine true displacement. At this degree of rotation, the measured number can be multiplied by 1.4 to better estimate displacement. The addition of a 45 degrees internal oblique radiograph in medial humeral epicondyle fractures has good

Inter and intra-observer reliability in assessment of the position of the lateral sesamoid in determining the severity of hallux valgus.

PubMed

Panchani, Sunil; Reading, Jonathan; Mehta, Jaysheel

2016-06-01

The position of the lateral sesamoid on standard dorso-plantar weight bearing radiographs, with respect to the lateral cortex of the first metatarsal, has been shown to correlate well with the degree of the hallux valgus angle. This study aimed to assess the inter- and intra-observer error of this new classification system. Five orthopaedic consultants and five trainee orthopaedic surgeons were recruited to assess and document the degree of displacement of the lateral sesamoid on 144 weight-bearing dorso-plantar radiographs on two separate occasions. The severity of hallux valgus was defined as normal (0%), mild (≤50%), moderate (51-≤99%) or severe (≥100%) depending on the percentage displacement of the lateral sesamoid body from the lateral cortical border of the first metatarsal. Consultant intra-observer variability showed good agreement between repeated assessment of the radiographs (mean Kappa=0.75). Intra-observer variability for trainee orthopaedic surgeons also showed good agreement with a mean Kappa=0.73. Intraclass correlations for consultants and trainee surgeons was also high. The new classification system of assessing the severity of hallux valgus shows high inter- and intra-observer variability with good agreement and reproducibility between surgeons of consultant and trainee grades. Copyright © 2015 Elsevier Ltd. All rights reserved.

A comparative analysis of Patient-Reported Expanded Disability Status Scale tools.

PubMed

Collins, Christian DE; Ivry, Ben; Bowen, James D; Cheng, Eric M; Dobson, Ruth; Goodin, Douglas S; Lechner-Scott, Jeannette; Kappos, Ludwig; Galea, Ian

2016-09-01

Patient-Reported Expanded Disability Status Scale (PREDSS) tools are an attractive alternative to the Expanded Disability Status Scale (EDSS) during long term or geographically challenging studies, or in pressured clinical service environments. Because the studies reporting these tools have used different metrics to compare the PREDSS and EDSS, we undertook an individual patient data level analysis of all available tools. Spearman's rho and the Bland-Altman method were used to assess correlation and agreement respectively. A systematic search for validated PREDSS tools covering the full EDSS range identified eight such tools. Individual patient data were available for five PREDSS tools. Excellent correlation was observed between EDSS and PREDSS with all tools. A higher level of agreement was observed with increasing levels of disability. In all tools, the 95% limits of agreement were greater than the minimum EDSS difference considered to be clinically significant. However, the intra-class coefficient was greater than that reported for EDSS raters of mixed seniority. The visual functional system was identified as the most significant predictor of the PREDSS-EDSS difference. This analysis will (1) enable researchers and service providers to make an informed choice of PREDSS tool, depending on their individual requirements, and (2) facilitate improvement of current PREDSS tools. © The Author(s), 2015.

7 CFR 250.12 - Agreements.

Code of Federal Regulations, 2014 CFR

2014-01-01

... 7 Agriculture 4 2014-01-01 2014-01-01 false Agreements. 250.12 Section 250.12 Agriculture... TERRITORIES AND POSSESSIONS AND AREAS UNDER ITS JURISDICTION General Operating Provisions § 250.12 Agreements. (a) Agreements with Department. Prior to the beginning of a distribution program, distributing...

7 CFR 250.12 - Agreements.

Code of Federal Regulations, 2010 CFR

2010-01-01

... 7 Agriculture 4 2010-01-01 2010-01-01 false Agreements. 250.12 Section 250.12 Agriculture... TERRITORIES AND POSSESSIONS AND AREAS UNDER ITS JURISDICTION General Operating Provisions § 250.12 Agreements. (a) Agreements with Department. Prior to the beginning of a distribution program, distributing...

7 CFR 250.12 - Agreements.

Code of Federal Regulations, 2012 CFR

2012-01-01

... 7 Agriculture 4 2012-01-01 2012-01-01 false Agreements. 250.12 Section 250.12 Agriculture... TERRITORIES AND POSSESSIONS AND AREAS UNDER ITS JURISDICTION General Operating Provisions § 250.12 Agreements. (a) Agreements with Department. Prior to the beginning of a distribution program, distributing...

7 CFR 250.12 - Agreements.

Code of Federal Regulations, 2011 CFR

2011-01-01

... 7 Agriculture 4 2011-01-01 2011-01-01 false Agreements. 250.12 Section 250.12 Agriculture... TERRITORIES AND POSSESSIONS AND AREAS UNDER ITS JURISDICTION General Operating Provisions § 250.12 Agreements. (a) Agreements with Department. Prior to the beginning of a distribution program, distributing...

7 CFR 250.12 - Agreements.

Code of Federal Regulations, 2013 CFR

2013-01-01

... 7 Agriculture 4 2013-01-01 2013-01-01 false Agreements. 250.12 Section 250.12 Agriculture... TERRITORIES AND POSSESSIONS AND AREAS UNDER ITS JURISDICTION General Operating Provisions § 250.12 Agreements. (a) Agreements with Department. Prior to the beginning of a distribution program, distributing...

Agreement with Subjects in Lubukusu

ERIC Educational Resources Information Center

Diercks, Michael J. K.

2010-01-01

This dissertation examines three topics in the morphosyntax of Lubukusu (Bantu, Kenya), all of which are concerned with agreement with subjects: locative inversion, complementizer agreement, and alternative agreement effects in subject extraction. Each topic reports novel Lubukusu data which are both typologically interesting and theoretically…

Comparison of transcoelomic, contrast transcoelomic, and transesophageal echocardiography in anesthetized red-tailed hawks (Buteo jamaicensis).

PubMed

Beaufrère, Hugues; Pariaut, Romain; Rodriguez, Daniel; Nevarez, Javier G; Tully, Thomas N

2012-10-01

To assess the agreement and reliability of cardiac measurements obtained with 3 echocardiographic techniques in anesthetized red-tailed hawks (Buteo jamaicensis). 10 red-tailed hawks. Transcoelomic, contrast transcoelomic, and transesophageal echocardiographic evaluations of the hawks were performed, and cineloops of imaging planes were recorded. Three observers performed echocardiographic measurements of cardiac variables 3 times on 3 days. The order in which hawks were assessed and echocardiographic techniques were used was randomized. Results were analyzed with linear mixed modeling, agreement was assessed with intraclass correlation coefficients, and variation was estimated with coefficients of variation. Significant differences were evident among the 3 echocardiographic methods for most measurements, and the agreement among findings was generally low. Interobserver agreement was generally low to medium. Intraobserver agreement was generally medium to high. Overall, better agreement was achieved for the left ventricular measurements and for the transesophageal approach than for other measurements and techniques. Echocardiographic measurements in hawks were not reliable, except when the left ventricle was measured by the same observer. Furthermore, cardiac morphometric measurements may not be clinically important. When measurements are required, one needs to consider that follow-up measurements should be performed by the same echocardiographer and should show at least a 20% difference from initial measurements to be confident that any difference is genuine.

Validation of triple pass 24-hour dietary recall in Ugandan children by simultaneous weighed food assessment.