Drug utilization review: mechanisms to improve its effectiveness and broaden its scope. The U.S. Pharmacopeia Drug Utilization Review Advisory Panel.

PubMed

2000-01-01

To address important problems and needed changes in online and retrospective drug utilization review (DUR) programs. Emphasis is placed on reliability of DUR criteria and the shift of traditional retrospective DUR programs toward disease management and health care outcomes. Published literature evaluating the role of online and retrospective DUR programs. Particular attention was given to studies assessing DUR criteria reliability and new interventions with retrospective DUR programs. A literature review was conducted along with an expert summary from the U.S. Pharmacopeia Drug Utilization Review Advisory Panel. Studies have revealed variations in DUR criteria that could be affecting clinical practice and patient care. Appropriate formal methodologies and use of consistent procedures in developing online prospective DUR programs and systems could help resolve these problems. Traditional retrospective DUR is also shifting to incorporate disease management and methodologies from health outcomes and pharmacoeconomics studies. Refinements are needed to improve the reliability and validity of online DUR criteria and to minimize false positive messages. Databases created as a result of DUR efforts have been used in new and innovative ways to incorporate health outcomes data and disease management interventions. Additional outcomes data, combined with quality assurance efforts, should increase the utility of DUR/disease management efforts in evaluating health systems while improving the effectiveness and efficiency of pharmacists' health care interventions.

The MG Composite

PubMed Central

Burns, Ted M.; Conaway, Mark; Sanders, Donald B.

2010-01-01

Objective: To study the concurrent and construct validity and test-retest reliability in the practice setting of an outcome measure for myasthenia gravis (MG). Methods: Eleven centers participated in the validation study of the Myasthenia Gravis Composite (MGC) scale. Patients with MG were evaluated at 2 consecutive visits. Concurrent and construct validities of the MGC were assessed by evaluating MGC scores in the context of other MG-specific outcome measures. We used numerous potential indicators of clinical improvement to assess the sensitivity and specificity of the MGC for detecting clinical improvement. Test-retest reliability was performed on patients at the University of Virginia. Results: A total of 175 patients with MG were enrolled at 11 sites from July 1, 2008, to January 31, 2009. A total of 151 patients were seen in follow-up. Total MGC scores showed excellent concurrent validity with other MG-specific scales. Analyses of sensitivities and specificities of the MGC revealed that a 3-point improvement in total MGC score was optimal for signifying clinical improvement. A 3-point improvement in the MGC also appears to represent a meaningful improvement to most patients, as indicated by improved 15-item myasthenia gravis quality of life scale (MG-QOL15) scores. The psychometric properties were no better for an individualized subscore made up of the 2 functional domains that the patient identified as most important to treat. The test-retest reliability coefficient of the MGC was 98%, with a lower 95% confidence interval of 97%, indicating excellent test-retest reliability. Conclusions: The Myasthenia Gravis Composite is a reliable and valid instrument for measuring clinical status of patients with myasthenia gravis in the practice setting and in clinical trials. PMID:20439845

Specialized inpatient treatment of adult anorexia nervosa: effectiveness and clinical significance of changes.

PubMed

Schlegl, Sandra; Quadflieg, Norbert; Löwe, Bernd; Cuntz, Ulrich; Voderholzer, Ulrich

2014-09-06

Previous studies have predominantly evaluated the effectiveness of inpatient treatment for anorexia nervosa at the group level. The aim of this study was to evaluate treatment outcomes at an individual level based on the clinical significance of improvement. Patients' treatment outcomes were classified into four groups: deteriorated, unchanged, reliably improved and clinically significantly improved. Furthermore, the study set out to explore predictors of clinically significant changes in eating disorder psychopathology. A total of 435 inpatients were assessed at admission and at discharge on the following measures: body-mass-index, eating disorder symptoms, general psychopathology, depression and motivation for change. 20.0-32.0% of patients showed reliable changes and 34.1-55.3% showed clinically significant changes in the various outcome measures. Between 23.0% and 34.5% remained unchanged and between 1.7% and 3.0% deteriorated. Motivation for change and depressive symptoms were identified as positive predictors of clinically significant changes in eating disorder psychopathology, whereas body dissatisfaction, impulse regulation, social insecurity and education were negative predictors. Despite high rates of reliable and clinically significant changes following intensive inpatient treatment, about one third of anorexia nervosa patients showed no significant response to treatment. Future studies should focus on the identification of non-responders as well as on the development of treatment strategies for these patients.

Reliability and Validity of the Self-Efficacy for Exercise in Epilepsy and the Outcome Expectations for Exercise in Epilepsy Scales.

PubMed

Dustin, Irene; Resnick, Barbara; Galik, Elizabeth; Klinedinst, N Jennifer; Michael, Kathleen; Wiggs, Edythe

2017-04-01

The purpose of this study was to test the psychometric properties of the revised Self-Efficacy for Exercise With Epilepsy (SEE-E) and Outcome Expectations for Exercise with Epilepsy (OEE-E) when used with people with epilepsy. The SEE-E and OEE-E were given in face-to-face interviews to 26 persons with epilepsy in an epilepsy clinic. There was some evidence of validity based on Rasch analysis INFIT and OUTFIT statistics. There was some evidence of reliability for the SEE-E and OEE-E based on person and item separation reliability indexes. These measures can be used to identify persons with epilepsy who have low self-efficacy and outcome expectations for exercise and guide design of interventions to strengthen these expectations and thereby improve exercise behavior.

Enhancing recovery rates: lessons from year one of IAPT.

PubMed

Gyani, Alex; Shafran, Roz; Layard, Richard; Clark, David M

2013-09-01

The English Improving Access to Psychological Therapies (IAPT) initiative aims to make evidence-based psychological therapies for depression and anxiety disorder more widely available in the National Health Service (NHS). 32 IAPT services based on a stepped care model were established in the first year of the programme. We report on the reliable recovery rates achieved by patients treated in the services and identify predictors of recovery at patient level, service level, and as a function of compliance with National Institute of Health and Care Excellence (NICE) Treatment Guidelines. Data from 19,395 patients who were clinical cases at intake, attended at least two sessions, had at least two outcomes scores and had completed their treatment during the period were analysed. Outcome was assessed with the patient health questionnaire depression scale (PHQ-9) and the anxiety scale (GAD-7). Data completeness was high for a routine cohort study. Over 91% of treated patients had paired (pre-post) outcome scores. Overall, 40.3% of patients were reliably recovered at post-treatment, 63.7% showed reliable improvement and 6.6% showed reliable deterioration. Most patients received treatments that were recommended by NICE. When a treatment not recommended by NICE was provided, recovery rates were reduced. Service characteristics that predicted higher reliable recovery rates were: high average number of therapy sessions; higher step-up rates among individuals who started with low intensity treatment; larger services; and a larger proportion of experienced staff. Compliance with the IAPT clinical model is associated with enhanced rates of reliable recovery. Copyright © 2013 The Authors. Published by Elsevier Ltd.. All rights reserved.

78 FR 30733 - Modernizing Federal Infrastructure Review and Permitting Regulations, Policies, and Procedures

Federal Register 2010, 2011, 2012, 2013, 2014

2013-05-22

... Heads of Executive Departments and Agencies Reliable, safe, and resilient infrastructure is the backbone... and agencies (agencies) have achieved better outcomes for communities and the environment and realized... major infrastructure projects by half, while also improving outcomes for communities and the environment...

A Study of Sustainable Assessment Theory in Higher Education Tutorials

ERIC Educational Resources Information Center

Beck, Robert J.; Skinner, William F.; Schwabrow, Lynsey A.

2013-01-01

A study of sustainable assessment theory in nine tutorial courses at four colleges demonstrated that three long-term learning outcomes improved: Independence, Intellectual Maturity and Creativity. Eight of 10 traits associated with these outcomes were validated through internal reliability, faculty and student rubrics, and faculty case studies…

The Americleft Project: A Modification of Asher-McDade Method for Rating Nasolabial Esthetics in Patients With Unilateral Cleft Lip and Palate Using Q-sort.

PubMed

Stoutland, Alicia; Long, Ross E; Mercado, Ana; Daskalogiannakis, John; Hathaway, Ronald R; Russell, Kathleen A; Singer, Emily; Semb, Gunvor; Shaw, William C

2017-11-01

The purpose of this study was to investigate ways to improve rater reliability and satisfaction in nasolabial esthetic evaluations of patients with complete unilateral cleft lip and palate (UCLP), by modifying the Asher-McDade method with use of Q-sort methodology. Blinded ratings of cropped photographs of one hundred forty-nine 5- to 7-year-old consecutively treated patients with complete UCLP from 4 different centers were used in a rating of frontal and profile nasolabial esthetic outcomes by 6 judges involved in the Americleft Project's intercenter outcome comparisons. Four judges rated in previous studies using the original Asher-McDade approach. For the Q-sort modification, rather than projection of images, each judge had cards with frontal and profile photographs of each patient and rated them on a scale of 1 to 5 for vermillion border, nasolabial frontal, and profile, using the Q-sort method with placement of cards into categories 1 to 5. Inter- and intrarater reliabilities were calculated using the Weighted Kappa (95% confidence interval). For 4 raters, the reliabilities were compared with those in previous studies. There was no significant improvement in inter-rater reliabilities using the new method. Intrarater reliability consistently improved. All raters preferred the Q-sort method with rating cards rather than a PowerPoint of photos, which improved internal consistency in rating compared to previous studies using the original Asher-McDade method. All raters preferred this method because of the ability to continuously compare photos and adjust relative ratings between patients.

The work and social adjustment scale: reliability, sensitivity and value.

PubMed

Zahra, Daniel; Qureshi, Adam; Henley, William; Taylor, Rod; Quinn, Cath; Pooler, Jill; Hardy, Gillian; Newbold, Alexandra; Byng, Richard

2014-06-01

To investigate the psychometric properties of the Work and Social Adjustment Scale (WSAS) as an outcome measure for the Improving Access to Psychological Therapy programme, assessing its value as an addition to the Patient Health (PHQ-9) and Generalised Anxiety Disorder questionnaires (GAD-7). Little research has investigated these properties to date. Reliability and responsiveness to change were assessed using data from 4,835 patients. Principal components analysis was used to determine whether the WSAS measures a factor distinct from the PHQ-9 and GAD-7. The WSAS measures a distinct social functioning factor, has high internal reliability, and is sensitive to treatment effects. The WSAS, PHQ-9 and GAD-7 perform comparably on measures of reliability and sensitivity. The WSAS also measures a distinct social functioning component suggesting it has potential as an additional outcome measure.

Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures.

PubMed

Barkham, M; Margison, F; Leach, C; Lucock, M; Mellor-Clark, J; Evans, C; Benson, L; Connell, J; Audin, K; McGrath, G

2001-04-01

To complement the evidence-based practice paradigm, the authors argued for a core outcome measure to provide practice-based evidence for the psychological therapies. Utility requires instruments that are acceptable scientifically, as well as to service users, and a coordinated implementation of the measure at a national level. The development of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is summarized. Data are presented across 39 secondary-care services (n = 2,710) and within an intensively evaluated single service (n = 1,455). Results suggest that the CORE-OM is a valid and reliable measure for multiple settings and is acceptable to users and clinicians as well as policy makers. Baseline data levels of patient presenting problem severity, including risk, are reported in addition to outcome benchmarks that use the concept of reliable and clinically significant change. Basic quality improvement in outcomes for a single service is considered.

Assessing high reliability practices in wildland fire management: an exploration and benchmarking of organizational culture

Treesearch

Anne E. Black; Brooke Baldauf McBride

2013-01-01

In an effort to improve organizational outcomes, including safety, in wildland fire management, researchers and practitioners have turned to a domain of research on organizational performance known as High Reliability Organizing (HRO). The HRO paradigm emerged in the late 1980s in an effort to identify commonalities among organizations that function under hazardous...

Cold in-place recycle phase III, supplemental - field protocol : short term field stability.

DOT National Transportation Integrated Search

2015-05-01

CIR has become a useful tool in pavement rehabilitation due to cost savings. UDOT wishes to : improve the reliability of the process as well as improve the final outcome. A balance is achieved : between fracture durability and rutting resistance by c...

The Dartmouth COOP Charts: a simple, reliable, valid and responsive quality of life tool for chronic obstructive pulmonary disease.

PubMed

Eaton, T; Young, P; Fergusson, W; Garrett, J E; Kolbe, J

2005-04-01

The negative impact of chronic obstructive pulmonary disease (COPD) on health-related quality of life (HRQL) is substantial. Measurement of HRQL is increasingly advocated in clinical practice; traditional outcome measures such as lung function are poorly responsive. However many HRQL tools are not user-friendly in the clinic setting. Hence HRQL is often neglected. The Dartmouth Cooperative Functional Assessment Charts (COOP) have the requisite attributes of a tool suitable for routine clinical practice: they are simple, reliable, quick and easy to perform and score and well accepted. We aimed to determine the reliability, validity and responsiveness of the COOP in patients with significant COPD. HRQL was assessed during a prospective, randomised, placebo-controlled, double-blind, 12 week cross-over interventional study of ambulatory oxygen in patients (n = 50) with COPD. Test-retest reliability of the COOP domains was only modest however it was measured over a 2 month period. Significant correlations ranging between 0.4 and 0.8 were observed between all comparable domains of the COOP and the Medical Outcomes Study 36-item Short-form Health Survey, Chronic Respiratory Questionnaire (CRQ) and Hospital Anxiety and Depression (HAD) scale. Following ambulatory oxygen significant improvements were noted in all CRQ and HAD domains. Several domains of the generic SF-36 (role emotional, social functioning, role-physical) showed significant improvements. Comparable domains of the COOP (social activities, feelings) also showed significant improvements. The COOP change in health domain improved very significantly. The COOP is a simple, reliable HRQL tool which proved valid and responsive in our study population of COPD patients and may have a valuable role in routine clinical practice.

The Reliability and Predictive Ability of a Biomarker of Oxidative DNA Damage on Functional Outcomes after Stroke Rehabilitation

PubMed Central

Hsieh, Yu-Wei; Lin, Keh-Chung; Korivi, Mallikarjuna; Lee, Tsong-Hai; Wu, Ching-Yi; Wu, Kuen-Yuh

2014-01-01

We evaluated the reliability of 8-hydroxy-2′-deoxyguanosine (8-OHdG), and determined its ability to predict functional outcomes in stroke survivors. The rehabilitation effect on 8-OHdG and functional outcomes were also assessed. Sixty-one stroke patients received a 4-week rehabilitation. Urinary 8-OHdG levels were determined by liquid chromatography–tandem mass spectrometry. The test-retest reliability of 8-OHdG was good (interclass correlation coefficient = 0.76). Upper-limb motor function and muscle power determined by the Fugl-Meyer Assessment (FMA) and Medical Research Council (MRC) scales before rehabilitation showed significant negative correlation with 8-OHdG (r = −0.38, r = −0.30; p < 0.05). After rehabilitation, we found a fair and significant correlation between 8-OHdG and FMA (r = −0.34) and 8-OHdG and pain (r = 0.26, p < 0.05). Baseline 8-OHdG was significantly correlated with post-treatment FMA, MRC, and pain scores (r = −0.34, −0.31, and 0.25; p < 0.05), indicating its ability to predict functional outcomes. 8-OHdG levels were significantly decreased, and functional outcomes were improved after rehabilitation. The exploratory study findings conclude that 8-OHdG is a reliable and promising biomarker of oxidative stress and could be a valid predictor of functional outcomes in patients. Monitoring of behavioral indicators along with biomarkers may have crucial benefits in translational stroke research. PMID:24743892

The inter-rater reliability and prognostic value of coma scales in Nepali children with acute encephalitis syndrome.

PubMed

Ray, Stephen; Rayamajhi, Ajit; Bonnett, Laura J; Solomon, Tom; Kneen, Rachel; Griffiths, Michael J

2018-02-01

Background Acute encephalitis syndrome (AES) is a common cause of coma in Nepali children. The Glasgow coma scale (GCS) is used to assess the level of coma in these patients and predict outcome. Alternative coma scales may have better inter-rater reliability and prognostic value in encephalitis in Nepali children, but this has not been studied. The Adelaide coma scale (ACS), Blantyre coma scale (BCS) and the Alert, Verbal, Pain, Unresponsive scale (AVPU) are alternatives to the GCS which can be used. Methods Children aged 1-14 years who presented to Kanti Children's Hospital, Kathmandu with AES between September 2010 and November 2011 were recruited. All four coma scales (GCS, ACS, BCS and AVPU) were applied on admission, 48 h later and on discharge. Inter-rater reliability (unweighted kappa) was measured for each. Correlation and agreement between total coma score and outcome (Liverpool outcome score) was measured by Spearman's rank and Bland-Altman plot. The prognostic value of coma scales alone and in combination with physiological variables was investigated in a subgroup (n = 22). A multivariable logistic regression model was fitted by backward stepwise. Results Fifty children were recruited. Inter-rater reliability using the variables scales was fair to moderate. However, the scales poorly predicted clinical outcome. Combining the scales with physiological parameters such as systolic blood pressure improved outcome prediction. Conclusion This is the first study to compare four coma scales in Nepali children with AES. The scales exhibited fair to moderate inter-rater reliability. However, the study is inadequately powered to answer the question on the relationship between coma scales and outcome. Further larger studies are required.

Validation of PROMIS ® Physical Function computerized adaptive tests for orthopaedic foot and ankle outcome research.

PubMed

Hung, Man; Baumhauer, Judith F; Latt, L Daniel; Saltzman, Charles L; SooHoo, Nelson F; Hunt, Kenneth J

2013-11-01

In 2012, the American Orthopaedic Foot & Ankle Society(®) established a national network for collecting and sharing data on treatment outcomes and improving patient care. One of the network's initiatives is to explore the use of computerized adaptive tests (CATs) for patient-level outcome reporting. We determined whether the CAT from the NIH Patient Reported Outcome Measurement Information System(®) (PROMIS(®)) Physical Function (PF) item bank provides efficient, reliable, valid, precise, and adequately covered point estimates of patients' physical function. After informed consent, 288 patients with a mean age of 51 years (range, 18-81 years) undergoing surgery for common foot and ankle problems completed a web-based questionnaire. Efficiency was determined by time for test administration. Reliability was assessed with person and item reliability estimates. Validity evaluation included content validity from expert review and construct validity measured against the PROMIS(®) Pain CAT and patient responses based on tradeoff perceptions. Precision was assessed by standard error of measurement (SEM) across patients' physical function levels. Instrument coverage was based on a person-item map. Average time of test administration was 47 seconds. Reliability was 0.96 for person and 0.99 for item. Construct validity against the Pain CAT had an r value of -0.657 (p < 0.001). Precision had an SEM of less than 3.3 (equivalent to a Cronbach's alpha of ≥ 0.90) across a broad range of function. Concerning coverage, the ceiling effect was 0.32% and there was no floor effect. The PROMIS(®) PF CAT appears to be an excellent method for measuring outcomes for patients with foot and ankle surgery. Further validation of the PROMIS(®) item banks may ultimately provide a valid and reliable tool for measuring patient-reported outcomes after injuries and treatment.

Relating engagement to outcomes in prevention: the case of a parenting program for couples.

PubMed

Brown, Louis D; Goslin, Megan C; Feinberg, Mark E

2012-09-01

Analyses of program engagement can provide critical insight into how program involvement leads to outcomes. This study examines the relation between participant engagement and program outcomes in Family Foundations (FF), a universal preventive intervention designed to help couples manage the transition to parenthood by improving coparenting relationship quality. Previous intent-to-treat outcome analyses from a randomized trial indicate FF improves parental adjustment, interparental relationships, and parenting. Analyses for the current study use the same sample, and yield statistically reliable relations between participant engagement and interparental relationships but not parental adjustment or parenting. Discussion considers implications for FF and the difficulties researchers face when examining the relation between engagement and outcomes in preventive interventions.

Relating Engagement to Outcomes in Prevention: The Case of a Parenting Program for Couples

PubMed Central

Brown, Louis D.; Goslin, Megan C.; Feinberg, Mark E.

2011-01-01

Analyses of program engagement can provide critical insight into how program involvement leads to outcomes. This study examines the relation between participant engagement and program outcomes in Family Foundations (FF), a universal preventive intervention designed to help couples manage the transition to parenthood by improving coparenting relationship quality. Previous intent-to-treat outcome analyses from a randomized trial indicate FF improves parental adjustment, interparental relationships, and parenting. Analyses for the current study use the same sample, and yield statistically reliable relations between participant engagement and interparental relationships but not parental adjustment or parenting. Discussion considers implications for FF and the difficulities researchers face when examining the relation between engagement and outcomes in preventive interventions. PMID:21826536

The Search for an Early Intervention Outcome Measurement Tool in Autism

ERIC Educational Resources Information Center

Fletcher-Watson, S.; McConachie, H.

2017-01-01

Evidence is accumulating that early intervention can be effective in improving the skills of young children with autism spectrum disorder. However, the science is hampered by the lack of agreed "gold standard" tools for the measurement of progress and outcome. What is required is a reliable, valid, and sensitive measure of change in the…

First results of a national initiative to enable quality improvement of cardiovascular care by transparently reporting on patient-relevant outcomes.

PubMed

van Veghel, Dennis; Marteijn, Marloes; de Mol, Bas

2016-06-01

The aims of this study were to assess patient-relevant outcomes of delivered cardiovascular care by focusing on disease management as determined by a multidisciplinary Heart Team, to establish and share best practices by comparing outcomes and to embed value-based decision-making to improve quality and efficiency in Dutch heart centres. In 2014, 12 Dutch heart centres pooled patient-relevant outcome data, which resulted in transparent publication of the outcomes, including long-term follow-up up to 5 years, of approximately 86 000 heart patients. This study presents the results of both disease- and treatment patient-relevant outcome measures for coronary artery disease and aortic valve disease. The patients included were presented to a Heart Team and underwent invasive or operative treatment. In-hospital and out-of-hospital patient-relevant outcome measures were collected as well as initial conditions. Quality of life was assessed using the Short Form (SF)-36 or SF-12 health survey. In the Netherlands, patient-relevant and risk-adjusted outcomes of cardiovascular care in participating heart centres are published annually. Data were sufficiently reliable to enable comparisons and to subtract best practices. The statistically lower risk-adjusted mortality rate after coronary artery bypass grafting resulted in a voluntary roll-out of a perioperative safety check. The in-depth analysis of outcomes after percutaneous coronary intervention resulted in process improvements in several heart centres, such as pre-hydration for patients with renal insufficiency and the need of target vessel revascularizations within a year. Annual data collection on follow-up of patient-relevant outcomes of cardiovascular care, initiated and organized by physicians, appears feasible. Transparent publication of outcomes drives the improvement of quality within heart centres. The system of using a limited set of patient-relevant outcome measures enables reliable comparisons and exposes the quality of decision-making and the operational process. Transparent communication on outcomes is feasible, safe and cost-effective, and stimulates professional decision-making and disease management. © The Author 2016. Published by Oxford University Press on behalf of the European Association for Cardio-Thoracic Surgery. All rights reserved.

Evaluation of a primary care adult mental health service: Year 2

PubMed Central

2013-01-01

Aims This study aimed to examine the effectiveness of a primary care adult mental health service operating within a stepped care model of service delivery. Methods Supervised by a principal psychologist manager, psychology graduate practitioners provided one-to-one brief cognitive behavioural therapy (CBT) to service users. The Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) was used to assess service user treatment outcomes. Satisfaction questionnaires were administered to service users and referring general practitioners (GPs). Results A total of 43 individuals attended for an initial appointment, of whom 19 (44.2%) completed brief CBT treatment. Of the 13 service users who were in the clinical range pre-treatment, 11 (84.6%) achieved clinical and reliably significant improvement. Of the six service users who were in the non-clinical range pre-treatment, three (50%) achieved reliably significant improvement. Both service users and GPs indicated high levels of satisfaction with the service, although service accessibility was highlighted as needing improvement. Conclusion The service was effective in treating mild to moderate mental health problems in primary care. Stricter adherence to a stepped care model through the provision of low-intensity, high-throughput interventions would be desirable for future service provision. PMID:24381655

A review and update of the Health of the Nation Outcome Scales (HoNOS).

PubMed

James, Mick; Painter, Jon; Buckingham, Bill; Stewart, Malcolm W

2018-04-01

Aims and method The Health of the Nation Outcome Scales (HoNOS) and its older adults' version (HoNOS 65+) have been used widely for 20 years, but their glossaries have not been revised to reflect clinicians' experiences or changes in service delivery. The Royal College of Psychiatrists convened an international advisory board, with UK, Australian and New Zealand expertise, to identify desirable amendments. The aim was to improve rater experience by removing ambiguity and inconsistency in the glossary rather than more radical revision. Changes proposed to the HoNOS are reported. HoNOS 65+ changes will be reported separately. Based on the views and experience of the countries involved, a series of amendments were identified. Clinical implications While effective clinician training remains critically important, these revisions aim to improve intra- and interrater reliability and improve validity. Next steps will depend on feedback from HoNOS users. Reliability and validity testing will depend on funding. Declaration of interest None.

New approaches to trials in glomerulonephritis.

PubMed

Craig, Jonathan C; Tong, Allison; Strippoli, Giovanni F M

2017-01-01

Randomized controlled trials are required to reliably identify interventions to improve the outcomes for people with glomerulonephritis (GN). Unfortunately, although easier, observational studies are inherently unreliable even though the findings of both study designs agree most of the time. Currently there are ∼790 trials in GN, but suboptimal design and reporting, together with small sample sizes, mean that they may not be reliable for decision making. If the history is somewhat bleak, the future looks bright, with recent initiatives to improve the quality, size and relevance of clinical trials in nephrology, including greater patient engagement, trial networks, core outcome sets, registry-based trials and adaptive designs. Given the current state of the evidence informing the care of people with GN, disruptive technologies and pervasive culture change is required to ensure that the potential of trials to improve the health of people with this complex condition is to be realized. © The Author 2017. Published by Oxford University Press on behalf of ERA-EDTA. All rights reserved.

Determination of Minimum Training Sample Size for Microarray-Based Cancer Outcome Prediction–An Empirical Assessment

PubMed Central

Cheng, Ningtao; Wu, Leihong; Cheng, Yiyu

2013-01-01

The promise of microarray technology in providing prediction classifiers for cancer outcome estimation has been confirmed by a number of demonstrable successes. However, the reliability of prediction results relies heavily on the accuracy of statistical parameters involved in classifiers. It cannot be reliably estimated with only a small number of training samples. Therefore, it is of vital importance to determine the minimum number of training samples and to ensure the clinical value of microarrays in cancer outcome prediction. We evaluated the impact of training sample size on model performance extensively based on 3 large-scale cancer microarray datasets provided by the second phase of MicroArray Quality Control project (MAQC-II). An SSNR-based (scale of signal-to-noise ratio) protocol was proposed in this study for minimum training sample size determination. External validation results based on another 3 cancer datasets confirmed that the SSNR-based approach could not only determine the minimum number of training samples efficiently, but also provide a valuable strategy for estimating the underlying performance of classifiers in advance. Once translated into clinical routine applications, the SSNR-based protocol would provide great convenience in microarray-based cancer outcome prediction in improving classifier reliability. PMID:23861920

A Methodological Critique of the ProPublica Surgeon Scorecard

PubMed Central

Friedberg, Mark W.; Pronovost, Peter J.; Shahian, David M.; Safran, Dana Gelb; Bilimoria, Karl Y.; Elliott, Marc N.; Damberg, Cheryl L.; Dimick, Justin B.; Zaslavsky, Alan M.

2016-01-01

Abstract On July 14, 2015, ProPublica published its Surgeon Scorecard, which displays “Adjusted Complication Rates” for individual, named surgeons for eight surgical procedures performed in hospitals. Public reports of provider performance have the potential to improve the quality of health care that patients receive. A valid performance report can drive quality improvement and usefully inform patients' choices of providers. However, performance reports with poor validity and reliability are potentially damaging to all involved. This article critiques the methods underlying the Scorecard and identifies opportunities for improvement. Until these opportunities are addressed, the authors advise users of the Scorecard—most notably, patients who might be choosing their surgeons—not to consider the Scorecard a valid or reliable predictor of the health outcomes any individual surgeon is likely to provide. The authors hope that this methodological critique will contribute to the development of more-valid and more-reliable performance reports in the future. PMID:28083411

A dissociation between engagement and learning: Enthusiastic instructions fail to reliably improve performance on a memory task.

PubMed

Motz, Benjamin A; de Leeuw, Joshua R; Carvalho, Paulo F; Liang, Kaley L; Goldstone, Robert L

2017-01-01

Despite widespread assertions that enthusiasm is an important quality of effective teaching, empirical research on the effect of enthusiasm on learning and memory is mixed and largely inconclusive. To help resolve these inconsistencies, we conducted a carefully-controlled laboratory experiment, investigating whether enthusiastic instructions for a memory task would improve recall accuracy. Scripted videos, either enthusiastic or neutral, were used to manipulate the delivery of task instructions. We also manipulated the sequence of learning items, replicating the spacing effect, a known cognitive technique for memory improvement. Although spaced study reliably improved test performance, we found no reliable effect of enthusiasm on memory performance across two experiments. We did, however, find that enthusiastic instructions caused participants to respond to more item prompts, leaving fewer test questions blank, an outcome typically associated with increased task motivation. We find no support for the popular claim that enthusiastic instruction will improve learning, although it may still improve engagement. This dissociation between motivation and learning is discussed, as well as its implications for education and future research on student learning.

A dissociation between engagement and learning: Enthusiastic instructions fail to reliably improve performance on a memory task

PubMed Central

de Leeuw, Joshua R.; Carvalho, Paulo F.; Liang, Kaley L.; Goldstone, Robert L.

2017-01-01

Despite widespread assertions that enthusiasm is an important quality of effective teaching, empirical research on the effect of enthusiasm on learning and memory is mixed and largely inconclusive. To help resolve these inconsistencies, we conducted a carefully-controlled laboratory experiment, investigating whether enthusiastic instructions for a memory task would improve recall accuracy. Scripted videos, either enthusiastic or neutral, were used to manipulate the delivery of task instructions. We also manipulated the sequence of learning items, replicating the spacing effect, a known cognitive technique for memory improvement. Although spaced study reliably improved test performance, we found no reliable effect of enthusiasm on memory performance across two experiments. We did, however, find that enthusiastic instructions caused participants to respond to more item prompts, leaving fewer test questions blank, an outcome typically associated with increased task motivation. We find no support for the popular claim that enthusiastic instruction will improve learning, although it may still improve engagement. This dissociation between motivation and learning is discussed, as well as its implications for education and future research on student learning. PMID:28732087

Validation of a method for assessing resident physicians' quality improvement proposals.

PubMed

Leenstra, James L; Beckman, Thomas J; Reed, Darcy A; Mundell, William C; Thomas, Kris G; Krajicek, Bryan J; Cha, Stephen S; Kolars, Joseph C; McDonald, Furman S

2007-09-01

Residency programs involve trainees in quality improvement (QI) projects to evaluate competency in systems-based practice and practice-based learning and improvement. Valid approaches to assess QI proposals are lacking. We developed an instrument for assessing resident QI proposals--the Quality Improvement Proposal Assessment Tool (QIPAT-7)-and determined its validity and reliability. QIPAT-7 content was initially obtained from a national panel of QI experts. Through an iterative process, the instrument was refined, pilot-tested, and revised. Seven raters used the instrument to assess 45 resident QI proposals. Principal factor analysis was used to explore the dimensionality of instrument scores. Cronbach's alpha and intraclass correlations were calculated to determine internal consistency and interrater reliability, respectively. QIPAT-7 items comprised a single factor (eigenvalue = 3.4) suggesting a single assessment dimension. Interrater reliability for each item (range 0.79 to 0.93) and internal consistency reliability among the items (Cronbach's alpha = 0.87) were high. This method for assessing resident physician QI proposals is supported by content and internal structure validity evidence. QIPAT-7 is a useful tool for assessing resident QI proposals. Future research should determine the reliability of QIPAT-7 scores in other residency and fellowship training programs. Correlations should also be made between assessment scores and criteria for QI proposal success such as implementation of QI proposals, resident scholarly productivity, and improved patient outcomes.

Effectiveness of an Internet-based preparation for psychosomatic treatment: Results of a controlled observational study.

PubMed

Zimmer, Benjamin; Moessner, Markus; Wolf, Markus; Minarik, Carla; Kindermann, Sally; Bauer, Stephanie

2015-11-01

Patients often have to sustain long waiting periods between the time they first apply for psychotherapy and the actual uptake of the treatment. To support patients who are on a wait-list for inpatient psychosomatic treatment an Internet-based preparatory treatment (VORSTAT) was developed. In a randomized controlled trial, VORSTAT proved to increase treatment motivation prior to intake and to accelerate the accommodation phase at the beginning of inpatient treatment. No impact of VORSTAT on inpatient treatment outcome was found. The aim of the present study was to investigate the effectiveness of VORSTAT after implementing the service into routine care. A large naturalistic observational study comparing VORSTAT participants (N=911) against non-participants (N=1721) was conducted. Propensity scores were used to control for potential confounding variables due to the non-randomized group allocation. Reliable improvement of self-reported impairment achieved during inpatient treatment was used as outcome measure. VORSTAT participants showed higher rates of reliable improvement in physical impairment (50.8% vs. 44.9%), psychological impairment (41.2% vs. 29.9%), and social problems (22.3% vs. 15.2%). An Internet-based preparation for psychotherapy is an effective approach to improve outcome of inpatient psychosomatic treatment. Copyright © 2015 Elsevier Inc. All rights reserved.

Psychometric evaluation of an inpatient consumer survey measuring satisfaction with psychiatric care.

PubMed

Ortiz, Glorimar; Schacht, Lucille

2012-01-01

Measurement of consumers' satisfaction in psychiatric settings is important because it has been correlated with improved clinical outcomes and administrative measures of high-quality care. These consumer satisfaction measurements are actively used as performance measures required by the accreditation process and for quality improvement activities. Our objectives were (i) to re-evaluate, through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), the structure of an instrument intended to measure consumers' satisfaction with care in psychiatric settings and (ii) to examine and publish the psychometric characteristics, validity and reliability, of the Inpatient Consumer Survey (ICS). To psychometrically test the structure of the ICS, 34 878 survey results, submitted by 90 psychiatric hospitals in 2008, were extracted from the Behavioral Healthcare Performance Measurement System (BHPMS). Basic descriptive item-response and correlation analyses were performed for total surveys. Two datasets were randomly created for analysis. A random sample of 8229 survey results was used for EFA. Another random sample of 8261 consumer survey results was used for CFA. This same sample was used to perform validity and reliability analyses. The item-response analysis showed that the mean range for a disagree/agree five-point scale was 3.10-3.94. Correlation analysis showed a strong relationship between items. Six domains (dignity, rights, environment, empowerment, participation, and outcome) with internal reliabilities between good to moderate (0.87-0.73) were shown to be related to overall care satisfaction. Overall reliability for the instrument was excellent (0.94). Results from CFA provided support for the domains structure of the ICS proposed through EFA. The overall findings from this study provide evidence that the ICS is a reliable measure of consumer satisfaction in psychiatric inpatient settings. The analysis has shown the ICS to provide valid and reliable results and to focus on the specific concerns of consumers of psychiatric inpatient care. Scores by item indicate that opportunity for improvement exists across healthcare organizations.

Operating Room of the Future: Advanced Technologies in Safe and Efficient Operating Rooms

DTIC Science & Technology

2008-10-01

fit” or compatibility with different tasks. Ideally, the optimal match between tasks and well-designed display alternatives will be self -apparent...hierarchical display environment. The FARO robot arm is used as an accurate and reliable tracker to control a virtual camera. The virtual camera pose is...in learning outcomes due to self -feedback, improvements in learning outcomes due to instructor feedback and synchronous versus asynchronous

Abdominal pain endpoints currently recommended by the FDA and EMA for adult patients with irritable bowel syndrome may not be reliable in children.

PubMed

Saps, M; Lavigne, J V

2015-06-01

The Food and Drug Administration (FDA) recommended ≥30% decrease on patient-reported outcomes for pain be considered clinically significant in clinical trials for adults with irritable bowel syndrome. This percent change approach may not be appropriate for children. We compared three alternate approaches to determining clinically significant reductions in pain among children. 80 children with functional abdominal pain participated in a study of the efficacy of amitriptyline. Endpoints included patient-reported estimates of feeling better, and pain Visual Analog Scale (VAS). The minimum clinically important difference in pain report was calculated as (i) mean change in VAS score for children reporting being 'better'; (ii) percent changes in pain (≥30% and ≥50%) on the VAS; and (iii) statistically reliable changes on the VAS for 68% and 95% confidence intervals. There was poor agreement between the three approaches. 43.6% of the children who met the FDA ≥30% criterion for clinically significant change did not achieve a reliable level of improvement (95% confidence interval). Children's self-reported ratings of being better may not be statistically reliable. A combined approach in which children must report improvement as better and achieve a statistically significant change may be more appropriate for outcomes in clinical trials. © 2015 John Wiley & Sons Ltd.

Assessing Learning Outcomes in Middle-Division Classical Mechanics: The Colorado Classical Mechanics and Math Methods Instrument

ERIC Educational Resources Information Center

Caballero, Marcos D.; Doughty, Leanne; Turnbull, Anna M.; Pepper, Rachel E.; Pollock, Steven J.

2017-01-01

Reliable and validated assessments of introductory physics have been instrumental in driving curricular and pedagogical reforms that lead to improved student learning. As part of an effort to systematically improve our sophomore-level classical mechanics and math methods course (CM 1) at CU Boulder, we have developed a tool to assess student…

Evaluating information skills training in health libraries: a systematic review.

PubMed

Brettle, Alison

2007-12-01

Systematic reviews have shown that there is limited evidence to demonstrate that the information literacy training health librarians provide is effective in improving clinicians' information skills or has an impact on patient care. Studies lack measures which demonstrate validity and reliability in evaluating the impact of training. To determine what measures have been used; the extent to which they are valid and reliable; to provide guidance for health librarians who wish to evaluate the impact of their information skills training. Systematic review methodology involved searching seven databases, and personal files. Studies were included if they were about information skills training, used an objective measure to assess outcomes, and occurred in a health setting. Fifty-four studies were included in the review. Most outcome measures used in the studies were not tested for the key criteria of validity and reliability. Three tested for validity and reliability are described in more detail. Selecting an appropriate measure to evaluate the impact of training is a key factor in carrying out any evaluation. This systematic review provides guidance to health librarians by highlighting measures used in various circumstances, and those that demonstrate validity and reliability.

Role of Leadership in Narrowing the Gap between Science and Practice: Improving Treatment Outcomes at the Systems Level.

PubMed

Saeed, Sy Atezaz; Bloch, Richard M; Silver, Stuart

2015-09-01

It's been well documented that health care does not reliably transfer what we know from science into clinical practice. As a result, Americans do not always receive the care suggested by the scientific evidence. Despite the best intentions of a dedicated and skilled healthcare workforce, this can often lead to poor clinical outcomes. As research and technology rapidly advance, this gap between science and practice appears to be widening. There is an increasing public concern about a lack of access to appropriate treatment, pervasiveness of unsafe practices, and wasteful uses of precious health care resources leading to suboptimum treatment outcomes. Leadership has a critical role in creating and sustaining the environment that supports health services for individuals and populations that increase the likelihood of desired health outcomes and are consistent with current professional knowledge. Leadership has some responsibility to improve outcomes by insuring effective use of evidence-based treatment guidelines; measurement-based care; knowledge and skills management; care coordination; and information technologies. This paper addresses leadership issues in these components of a system's ability to improve treatment outcomes.

Reliability, validity and responsiveness of the Arabic version of the Disability of Arm, Shoulder and Hand (DASH-Arabic).

PubMed

Alotaibi, Naser M; Aljadi, Sameera H; Alrowayeh, Hesham N

2016-12-01

To investigate the psychometric properties (reliability, validity and responsiveness) of the DASH-Arabic in a cohort of Arabic patients presenting with various upper extremity conditions. Participants were 139 patients with various upper extremity conditions, who completed the DASH-Arabic at the baseline, 2-5 days later and 30-36 days later. Participants completed demographic data forms, the SF-36 and VAS at baseline, and a Global Rating of Change scale at first and second follow-ups. Cronbach's alpha of the DASH-Arabic was 0.94. Test-retest reliability was excellent with an ICC of 0.97. The SEM was 3.50 and the MDC95 was 9.28. Construct validity of the DASH-Arabic with the SF-36 subscales and VAS scores ranged from r -0.32 to -0.57, all statistically significant (p < 0.001). The effect size (ES) for the DASH-Arabic was 1.39 and its standard response mean was 1.51. The area under the curve was 0.82 (95% CI = 0.72-0.92, p < 0.001). The optimally efficient cutoff for an improvement was found to be a difference of 15 DASH points. The DASH-Arabic is a reliable, valid and responsive upper extremity outcome measure for patients whose primary language is Arabic; it can be used to document patient status and outcomes and support evidence-based practice. Implications for Rehabilitation The DASH-Arabic demonstrated sound psychometric properties of reliability, validity and responsiveness. It is an effective patient status and outcome tool that will support evidence-based practice. This tool is recommended for evaluating upper extremity work-related injuries and tracking therapeutic outcomes.

Development and validation of a paediatric long-bone fracture classification. A prospective multicentre study in 13 European paediatric trauma centres

PubMed Central

2011-01-01

Background The aim of this study was to develop a child-specific classification system for long bone fractures and to examine its reliability and validity on the basis of a prospective multicentre study. Methods Using the sequentially developed classification system, three samples of between 30 and 185 paediatric limb fractures from a pool of 2308 fractures documented in two multicenter studies were analysed in a blinded fashion by eight orthopaedic surgeons, on a total of 5 occasions. Intra- and interobserver reliability and accuracy were calculated. Results The reliability improved with successive simplification of the classification. The final version resulted in an overall interobserver agreement of κ = 0.71 with no significant difference between experienced and less experienced raters. Conclusions In conclusion, the evaluation of the newly proposed classification system resulted in a reliable and routinely applicable system, for which training in its proper use may further improve the reliability. It can be recommended as a useful tool for clinical practice and offers the option for developing treatment recommendations and outcome predictions in the future. PMID:21548939

Quality and safety in pediatric anesthesia: how can guidelines, checklists, and initiatives improve the outcome?

PubMed

Hagerman, Nancy S; Varughese, Anna M; Kurth, C Dean

2014-06-01

Cognitive aids are tangible or intangible instruments that guide users in decision-making and in the completion of a complex series of tasks. Common examples include mnemonics, checklists, and algorithms. Cognitive aids constitute very effective approaches to achieve well tolerated, high quality healthcare because they promote highly reliable processes that reduce the likelihood of failure. This review describes recent advances in quality improvement for pediatric anesthesiology with emphasis on application of cognitive aids to impact patient safety and outcomes. Quality improvement encourages the examination of systems to create stable processes and ultimately high-value care. Quality improvement initiatives in pediatric anesthesiology have been shown to improve outcomes and the delivery of efficient and effective care at many institutions. The use of checklists, in particular, improves adherence to evidence-based care in crisis situations, decreases catheter-associated bloodstream infections, reduces blood product utilization, and improves communication during the patient handoff process. Use of this simple tool has been associated with decreased morbidity, fewer medical errors, improved provider satisfaction, and decreased mortality in nonanesthesia disciplines as well. Successful quality improvement initiatives utilize cognitive aids such as checklists and have been shown to optimize pediatric patient experience and anesthesia outcomes and reduce perioperative complications.

Effect of standardized training on the reliability of the Cochrane risk of bias assessment tool: a prospective study.

PubMed

da Costa, Bruno R; Beckett, Brooke; Diaz, Alison; Resta, Nina M; Johnston, Bradley C; Egger, Matthias; Jüni, Peter; Armijo-Olivo, Susan

2017-03-03

The Cochrane risk of bias tool is commonly criticized for having a low reliability. We aimed to investigate whether training of raters, with objective and standardized instructions on how to assess risk of bias, can improve the reliability of the Cochrane risk of bias tool. In this pilot study, four raters inexperienced in risk of bias assessment were randomly allocated to minimal or intensive standardized training for risk of bias assessment of randomized trials of physical therapy treatments for patients with knee osteoarthritis pain. Two raters were experienced risk of bias assessors who served as reference. The primary outcome of our study was between-group reliability, defined as the agreement of the risk of bias assessments of inexperienced raters with the reference assessments of experienced raters. Consensus-based assessments were used for this purpose. The secondary outcome was within-group reliability, defined as the agreement of assessments within pairs of inexperienced raters. We calculated the chance-corrected weighted Kappa to quantify agreement within and between groups of raters for each of the domains of the risk of bias tool. A total of 56 trials were included in our analysis. The Kappa for the agreement of inexperienced raters with reference across items of the risk of bias tool ranged from 0.10 to 0.81 for the minimal training group and from 0.41 to 0.90 for the standardized training group. The Kappa values for the agreement within pairs of inexperienced raters across the items of the risk of bias tool ranged from 0 to 0.38 for the minimal training group and from 0.93 to 1 for the standardized training group. Between-group differences in Kappa for the agreement of inexperienced raters with reference always favored the standardized training group and was most pronounced for incomplete outcome data (difference in Kappa 0.52, p < 0.001) and allocation concealment (difference in Kappa 0.30, p = 0.004). Intensive, standardized training on risk of bias assessment may significantly improve the reliability of the Cochrane risk of bias tool.

Pupillometry: Cutting Edge Biometrics for Early Intervention in Increased Intracranial Pressure.

PubMed

John, Jennilee St

2015-10-01

The pupillometer, a cutting-edge biometric device, is a valuable assessment tool that can aid in the early detection and prompt treatment of neurological abnormalities. Pupil assessment is a critical component of the neurological examination, and manual pupil assessment leaves much room for error. Automated pupillometry improves the quality and reliability of pupillary and neurological assessments, ultimately improving patient outcomes. Copyright 2015, SLACK Incorporated.

Exploring the Efficacy of Student Response System in a Sub-Saharan African Country: A Sociocultural Perspective

ERIC Educational Resources Information Center

Agbatogun, Alaba Olaoluwakotansibe

2012-01-01

The student response system (SRS) is marketed as a reliable tool for improving students' academic attainment. However, findings to the question of whether or not the SRS does improve the learning outcomes of ESL [English as a Second Language] learners in primary education are not well documented in the research literature. Despite the wide use of…

Psychometrics of the MHSIP Adult Consumer Survey.

PubMed

Jerrell, Jeanette M

2006-10-01

The reliability and validity of the Mental Health Statistics Improvement Program (MHSIP) Adult Consumer Survey were assessed in a statewide convenience sample of 459 persons with severe mental illness served through a public mental health system. Consistent with previous findings and the intent of its developers, three factors were identified that demonstrate good internal consistency, moderate test-retest reliability, and good convergent validity with consumer perceptions of other aspects of their care. The reliability and validity of the MHSIP Adult Consumer Survey documented in this study underscore its scientific and practical utility as an abbreviated tool for assessing access, quality and appropriateness, and outcome in mental health service systems.

Outcome expectations for exercise scale: utility and psychometrics.

PubMed

Resnick, B; Zimmerman, S I; Orwig, D; Furstenberg, A L; Magaziner, J

2000-11-01

The purpose of this study was to develop a measure of outcome expectations for exercise specifically for the older adult (The Outcome Expectations for Exercise [OEE] Scale), and to test the reliability and validity of this measure in a sample of older individuals. This scale was developed based on Bandura's theory of self-efficacy and the work of prior researchers in the development of measures of outcome expectations. The OEE scale, which was completed during a face-to-face interview, was tested in a sample of 175 residents in a continuing care retirement community. There was support for the internal consistency of the OEE scale (alpha coefficient of .89), and some support for reliability based on a structural equation modeling approach that used R2 estimates, although less than half of these were greater than 0.5. There was evidence of validity of the measure based on: (a) a confirmatory factor analysis in which the model fit the data (normed fit index [NFI] = .99, root mean square error of approximation [RMSEA] - .07, chi2/df = 2.8); (b) support for the hypothesis that those who exercised regularly had higher OEE scores than those who did not (F = 31.3, p < .05, eta squared = .15); and (c) a statistically significant relationship between outcome expectations and self-efficacy expectations (r = .66). This study provides some initial support for the reliability and validity of the OEE scale. Outcome expectations for exercise were related to exercise behavior in the older adult, and the OEE scale can help identify older adults with low outcome expectations for exercise. Interventions can then be implemented to help these individuals strengthen their outcome expectations, which may subsequently improve exercise behavior.

Serving the Customer – Do Patient Feedback and Questionnaires Improve Quality?

PubMed

Keshtgar, Asma; D’Cruz, Len

2017-01-01

This review article aims to analyse whether patient feedback and questionnaires improve quality of care. It is recognized that patients cannot assess the medical competence of the clinician, yet patient experience provides an insight into the process of care through the patients’ eyes. Patient experience measures are more reliable for use to assess quality than patient satisfaction surveys. It is inappropriate to use patient satisfaction surveys as a basis for remuneration of dentists within the NHS. Patient Reported Outcome Measures (PROMs) have been a successful measure of patient experience in medicine and their introduction to dentistry needs to be considered. Clinical relevance: This article will enable clinicians to understand the importance of patient experience measures as a more reliable way of improving the quality of clinical care than patient satisfaction surveys.

Is the hypothesis of preimplantation genetic screening (PGS) still supportable? A review.

PubMed

Gleicher, Norbert; Orvieto, Raoul

2017-03-27

The hypothesis of preimplantation genetic diagnosis (PGS) was first proposed 20 years ago, suggesting that elimination of aneuploid embryos prior to transfer will improve implantation rates of remaining embryos during in vitro fertilization (IVF), increase pregnancy and live birth rates and reduce miscarriages. The aforementioned improved outcome was based on 5 essential assumptions: (i) Most IVF cycles fail because of aneuploid embryos. (ii) Their elimination prior to embryo transfer will improve IVF outcomes. (iii) A single trophectoderm biopsy (TEB) at blastocyst stage is representative of the whole TE. (iv) TE ploidy reliably represents the inner cell mass (ICM). (v) Ploidy does not change (i.e., self-correct) downstream from blastocyst stage. We aim to offer a review of the aforementioned assumptions and challenge the general hypothesis of PGS. We reviewed 455 publications, which as of January 20, 2017 were listed in PubMed under the search phrase < preimplantation genetic screening (PGS) for aneuploidy>. The literature review was performed by both authors who agreed on the final 55 references. Various reports over the last 18 months have raised significant questions not only about the basic clinical utility of PGS but the biological underpinnings of the hypothesis, the technical ability of a single trophectoderm (TE) biopsy to accurately assess an embryo's ploidy, and suggested that PGS actually negatively affects IVF outcomes while not affecting miscarriage rates. Moreover, due to high rates of false positive diagnoses as a consequence of high mosaicism rates in TE, PGS leads to the discarding of large numbers of normal embryos with potential for normal euploid pregnancies if transferred rather than disposed of. We found all 5 basic assumptions underlying the hypothesis of PGS to be unsupported: (i) The association of embryo aneuploidy with IVF failure has to be reevaluated in view how much more common TE mosaicism is than has until recently been appreciated. (ii) Reliable elimination of presumed aneuploid embryos prior to embryo transfer appears unrealistic. (iii) Mathematical models demonstrate that a single TEB cannot provide reliable information about the whole TE. (iv) TE does not reliably reflect the ICM. (v) Embryos, likely, still have strong innate ability to self-correct downstream from blastocyst stage, with ICM doing so better than TE. The hypothesis of PGS, therefore, no longer appears supportable. With all 5 basic assumptions underlying the hypothesis of PGS demonstrated to have been mistaken, the hypothesis of PGS, itself, appears to be discredited. Clinical use of PGS for the purpose of IVF outcome improvements should, therefore, going forward be restricted to research studies.

MEASUREMENT: ACCOUNTING FOR RELIABILITY IN PERFORMANCE ESTIMATES.

PubMed

Waterman, Brian; Sutter, Robert; Burroughs, Thomas; Dunagan, W Claiborne

2014-01-01

When evaluating physician performance measures, physician leaders are faced with the quandary of determining whether departures from expected physician performance measurements represent a true signal or random error. This uncertainty impedes the physician leader's ability and confidence to take appropriate performance improvement actions based on physician performance measurements. Incorporating reliability adjustment into physician performance measurement is a valuable way of reducing the impact of random error in the measurements, such as those caused by small sample sizes. Consequently, the physician executive has more confidence that the results represent true performance and is positioned to make better physician performance improvement decisions. Applying reliability adjustment to physician-level performance data is relatively new. As others have noted previously, it's important to keep in mind that reliability adjustment adds significant complexity to the production, interpretation and utilization of results. Furthermore, the methods explored in this case study only scratch the surface of the range of available Bayesian methods that can be used for reliability adjustment; further study is needed to test and compare these methods in practice and to examine important extensions for handling specialty-specific concerns (e.g., average case volumes, which have been shown to be important in cardiac surgery outcomes). Moreover, it's important to note that the provider group average as a basis for shrinkage is one of several possible choices that could be employed in practice and deserves further exploration in future research. With these caveats, our results demonstrate that incorporating reliability adjustment into physician performance measurements is feasible and can notably reduce the incidence of "real" signals relative to what one would expect to see using more traditional approaches. A physician leader who is interested in catalyzing performance improvement through focused, effective physician performance improvement is well advised to consider the value of incorporating reliability adjustments into their performance measurement system.

Parents' self-efficacy, outcome expectations, and self-reported task performance when managing atopic dermatitis in children: instrument reliability and validity.

PubMed

Mitchell, Amy E; Fraser, Jennifer A

2011-02-01

Support and education for parents faced with managing a child with atopic dermatitis is crucial to the success of current treatments. Interventions aiming to improve parent management of this condition are promising. Unfortunately, evaluation is hampered by lack of precise research tools to measure change. To develop a suite of valid and reliable research instruments to appraise parents' self-efficacy for performing atopic dermatitis management tasks; outcome expectations of performing management tasks; and self-reported task performance in a community sample of parents of children with atopic dermatitis. The Parents' Eczema Management Scale (PEMS) and the Parents' Outcome Expectations of Eczema Management Scale (POEEMS) were developed from an existing self-efficacy scale, the Parental Self-Efficacy with Eczema Care Index (PASECI). Each scale was presented in a single self-administered questionnaire, to measure self-efficacy, outcome expectations, and self-reported task performance related to managing child atopic dermatitis. Each was tested with a community sample of parents of children with atopic dermatitis, and psychometric evaluation of the scales' reliability and validity was conducted. A community-based convenience sample of 120 parents of children with atopic dermatitis completed the self-administered questionnaire. Participants were recruited through schools across Australia. Satisfactory internal consistency and test-retest reliability was demonstrated for all three scales. Construct validity was satisfactory, with positive relationships between self-efficacy for managing atopic dermatitis and general perceived self-efficacy; self-efficacy for managing atopic dermatitis and self-reported task performance; and self-efficacy for managing atopic dermatitis and outcome expectations. Factor analyses revealed two-factor structures for PEMS and PASECI alike, with both scales containing factors related to performing routine management tasks, and managing the child's symptoms and behaviour. Factor analysis was also applied to POEEMS resulting in a three-factor structure. Factors relating to independent management of atopic dermatitis by the parent, involving healthcare professionals in management, and involving the child in the management of atopic dermatitis were found. Parents' self-efficacy and outcome expectations had a significant influence on self-reported task performance. Findings suggest that PEMS and POEEMS are valid and reliable instruments worthy of further psychometric evaluation. Likewise, validity and reliability of PASECI was confirmed. Copyright © 2010 Elsevier Ltd. All rights reserved.

Comparing Public, Private, and Market Schools: The International Evidence

ERIC Educational Resources Information Center

Coulson, Andrew J.

2009-01-01

Would large-scale, free-market reforms improve educational outcomes for American children? This question cannot be reliably answered by looking exclusively at domestic evidence, much less by looking exclusively at existing "school choice" programs. Though many such programs have been implemented around the United States, none has created…

The Psychological and Academic Costs of School-Based Racial and Ethnic Microaggressions

ERIC Educational Resources Information Center

Keels, Micere; Durkee, Myles; Hope, Elan

2017-01-01

Research examining links between racial-ethnic microaggressions and educational and psychological outcomes can be improved with the development of brief and reliable measurement tools. Our brief School-Based Racial and Ethnic Microaggressions Scale addresses this gap. First, we examined the prevalence of school-based microaggressions among an…

Community-acquired pneumonia management and outcomes in the era of health information technology.

PubMed

Mecham, Ian D; Vines, Caroline; Dean, Nathan C

2017-11-01

Pneumonia continues to be a leading cause of hospitalization and mortality. Implementation of health information technology (HIT) can lead to cost savings and improved care. In this review, we examine the literature on the use of HIT in the management of community-acquired pneumonia. We also discuss barriers to adoption of technology in managing pneumonia, the reliability and quality of electronic health data in pneumonia research, how technology has assisted pneumonia diagnosis and outcomes research. The goal of using HIT is to develop and deploy generalizable, real-time, computerized clinical decision support integrated into usual pneumonia care. A friendly user interface that does not disrupt efficiency and demonstrates improved clinical outcomes should result in widespread adoption. © 2017 Asian Pacific Society of Respirology.

Just Culture: A Foundation for Balanced Accountability and Patient Safety

PubMed Central

Boysen, Philip G.

2013-01-01

Background The framework of a just culture ensures balanced accountability for both individuals and the organization responsible for designing and improving systems in the workplace. Engineering principles and human factors analysis influence the design of these systems so they are safe and reliable. Methods Approaches for improving patient safety introduced here are (1) analysis of error, (2) specific tools to enhance safety, and (3) outcome engineering. Conclusion The just culture is a learning culture that is constantly improving and oriented toward patient safety. PMID:24052772

Observing practice leadership in intellectual and developmental disability services.

PubMed

Beadle-Brown, J; Bigby, C; Bould, E

2015-12-01

Improving staff performance is an issue in services for people with intellectual disability. Practice leadership, where the front line leader of a staff team focuses on service user outcomes in everything they do and provides coaching, modeling, supervision and organisation to the team, has been identified as important in improving staff performance. To date this finding is based only on self-report measures. This paper describes and tests an observational measure of practice leadership based on an interview with the front-line manager, a review of paperwork and observations in 58 disability services in Australia. The measure showed good internal consistency and acceptable inter-rater reliability. Practice leadership was associated with staff practice and outcomes for service users. The observed measure of practice leadership appears to be a useful tool for assessing whether leadership within a service promotes enabling and empowering support by staff. It was found to discriminate higher and lower performing services in terms of active support. The measure had good reliability and validity although some further testing is required to give a complete picture of the possible uses and reliability of the measure. The measure is potentially useful in contexts of both research and service development. The confirmation of previous findings from self-report measures that practice leadership is related to the quality of staff practice and outcomes for service users has implications for policy and practice in terms of the training of managers and structures for organisational management. © 2015 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Reliability of digital ulcer definitions as proposed by the UK Scleroderma Study Group: A challenge for clinical trial design.

PubMed

Hughes, Michael; Tracey, Andrew; Bhushan, Monica; Chakravarty, Kuntal; Denton, Christopher P; Dubey, Shirish; Guiducci, Serena; Muir, Lindsay; Ong, Voon; Parker, Louise; Pauling, John D; Prabu, Athiveeraramapandian; Rogers, Christine; Roberts, Christopher; Herrick, Ariane L

2018-06-01

The reliability of clinician grading of systemic sclerosis-related digital ulcers has been reported to be poor to moderate at best, which has important implications for clinical trial design. The aim of this study was to examine the reliability of new proposed UK Scleroderma Study Group digital ulcer definitions among UK clinicians with an interest in systemic sclerosis. Raters graded (through a custom-built interface) 90 images (80 unique and 10 repeat) of a range of digital lesions collected from patients with systemic sclerosis. Lesions were graded on an ordinal scale of severity: 'no ulcer', 'healed ulcer' or 'digital ulcer'. A total of 23 clinicians - 18 rheumatologists, 3 dermatologists, 1 hand surgeon and 1 specialist rheumatology nurse - completed the study. A total of 2070 (1840 unique + 230 repeat) image gradings were obtained. For intra-rater reliability, across all images, the overall weighted kappa coefficient was high (0.71) and was moderate (0.55) when averaged across individual raters. Overall inter-rater reliability was poor (0.15). Although our proposed digital ulcer definitions had high intra-rater reliability, the overall inter-rater reliability was poor. Our study highlights the challenges of digital ulcer assessment by clinicians with an interest in systemic sclerosis and provides a number of useful insights for future clinical trial design. Further research is warranted to improve the reliability of digital ulcer definition/rating as an outcome measure in clinical trials, including examining the role for objective measurement techniques, and the development of digital ulcer patient-reported outcome measures.

Reliability and validity analysis of the transfer assessment instrument.

PubMed

McClure, Laura A; Boninger, Michael L; Ozawa, Haishin; Koontz, Alicia

2011-03-01

To describe the development and evaluate the reliability and validity of a newly created outcome measure, the Transfer Assessment Instrument (TAI), to assess the quality of transfers performed by full-time wheelchair users. Repeated measures. 2009 National Veterans Wheelchair Games in Spokane, WA. A convenience sample of full-time wheelchair users (N=40) who perform sitting pivot or standing pivot transfers. Not applicable. Intraclass correlation coefficients (ICCs) for reliability and Spearman correlation coefficients for concurrent validity between the TAI and a global assessment scale (0-100 visual analog scale [VAS]). No adverse events occurred during testing. Intrarater ICCs for 3 raters ranged between .35 and .89, and the interrater ICC was .642. Correlations between the TAI and a global assessment VAS ranged between .19 (P=.285) and .69 (P>.000). Item analyses of the tool found a wide range of results, from weak to good reliability. Evaluators found the TAI to be safe and able to be completed in a short time. The TAI is a safe, quick outcome measure that uses equipment typically found in a clinical setting and does not ask participants to perform new skills. Reliability and validity testing found the TAI to have acceptable interrater and a wide range of intrarater reliability. Future work indicates the need for continued refinement including removal or modification of items found to have low reliability, improved education for clinicians, and further reliability and validity analysis with a more diverse subject population. The TAI has the potential to fill a void in assessment of transfers. Copyright © 2011 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Patient perception of nursing service quality; an applied model of Donabedian's structure-process-outcome approach theory.

PubMed

Kobayashi, Hideyuki; Takemura, Yukie; Kanda, Katsuya

2011-09-01

Nursing is a labour-intensive field, and an extensive amount of latent information exists to aid in evaluating the quality of nursing service, with patients' experiences, the primary focus of such evaluations. To effect further improvement in nursing as well as medical care, Donabedian's structure-process-outcome approach has been applied. To classify and confirm patients' specific experiences with regard to nursing service based on Donabedian's structure-process-outcomes model for improving the quality of nursing care. Items were compiled from existing scales and assigned to structure, process or outcomes in Donabedian's model through discussion among expert nurses and pilot data collection. With regard to comfort, surroundings were classified as structure (e.g. accessibility to nurses, disturbance); with regard to patient-practitioner interaction, patient participation was classified as a process (e.g. expertise and skill, patient decision-making); and with regard to changes in patients, satisfaction was classified as an outcome (e.g. information support, overall satisfaction). Patient inquiry was carried out using the finalized questionnaire at general wards in Japanese hospitals in 2005-2006. Reliability and validity were tested using psychometric methods. Data from 1,810 patients (mean age: 59.7 years; mean length of stay: 23.7 days) were analysed. Internal consistency reliability was supported (α = 0.69-0.96), with factor analysis items of structure aggregated to one factor and overall satisfaction under outcome aggregated to one. The remaining items of outcome and process were distributed together in two factors. Inter-scale correlation (r = 0.442-0.807) supported the construct validity of each structure-process-outcome approach. All structure items were represented as negative-worded examples, as they dealt with basic conditions under Japanese universal health care system, and were regarded as representative related to concepts of dissatisfaction and no dissatisfaction. Patients' experiences with nursing service were confirmed using Donabedian's approach and can therefore be applied to improve quality of nursing practice by practitioners, managers and policy makers. © 2010 The Authors. Scandinavian Journal of Caring Sciences © 2010 Nordic College of Caring Science.

Improving cardiac surgical care: a work systems approach.

PubMed

Wiegmann, Douglas A; Eggman, Ashley A; Elbardissi, Andrew W; Parker, Sarah Henrickson; Sundt, Thoralf M

2010-09-01

Over the past 50 years, significant improvements in cardiac surgical care have been achieved. Nevertheless, surgical errors that significantly impact patient safety continue to occur. In order to further improve surgical outcomes, patient safety programs must focus on rectifying work system factors in the operating room (OR) that negatively impact the delivery of reliable surgical care. The goal of this paper is to provide an integrative review of specific work system factors in the OR that may directly impact surgical care processes, as well as the subsequent recommendations that have been put forth to improve surgical outcomes and patient safety. The important role that surgeons can play in facilitating work system changes in the OR is also discussed. The paper concludes with a discussion of the challenges involved in assessing the impact that interventions have on improving surgical care. Opportunities for future research are also highlighted throughout the paper. 2010 Elsevier Ltd. All rights reserved.

Clinical Outcome Following Radiofrequency Denervation for Refractory Sacroiliac Joint Dysfunction Using the Simplicity III Probe: A 12-Month Retrospective Evaluation.

PubMed

Hegarty, Dominic

2016-01-01

Sacroiliac joint syndrome (SIJ) is diagnosed in 10% to 25% of cases of lower back pain. The response to traditional radiofrequency (RF) denervation of the SIJ has being inconsistent. The Simplicity III RF probe (Neruotherm. Inc.) offers a novel treatment option. To evaluate the long-term clinical outcome (12 months) refractory SIJ syndrome in terms of pain intensity and functional improvement. A 50% reduction in intensity pain intensity (VAS) at 12 months was deemed clinically significant. A 12-month retrospective observational evaluation all of adults treated with RF for refractory SIJ. Chronic pain management center. The medical records of all adults treated with this technique was retrospectively reviewed. The primary outcome was pain intensity scores (VAS) over a 12 months period; Secondary outcomes included Roland-Morris Functional scores (RMF), Brief Pain Inventory (BPI), general health assessment (Sf12), and patient satisfaction scores (GPI), which were recorded pre and post denervation. Pain Intensity improved by 4.7 points compared to pre-treatment representing a 61% reduction in pain at 12 months (n=11, P < 0.001). Significant improvements in (a) RMF (P < 0.01, W2 = 0.63 (large effect size); (b) BPI (P < 0.001, W2 = 0.72 (strong effect size); and (c) Sf12 (P < 0.01) were noted. Overall patients were satisfied with the outcome (GPI = 77.7%). The retrospective in nature of the study and the small sample size are limitations. As it was our policy to monitor the progress of the individuals since the introduction of this technique a reliable method of recording the baseline and outcome variables at each point of contact was in place. Access to a complete set of variables in all individuals over a 12-month period was therefore possible, which we feel contributes to the quality of the dataset. By creating a consistent radiofrequency lesion between the sacral foramen and the SIJ will reliably capture the innervation to the SIJ with significant long-term clinical improvement. This technique should be considered earlier in the treatment algorithm of individuals suffering from SIJ symptoms.

Safety, reliability, and validity of a physiologic definition of bronchopulmonary dysplasia.

PubMed

Walsh, Michele C; Wilson-Costello, Deanna; Zadell, Arlene; Newman, Nancy; Fanaroff, Avroy

2003-09-01

Bronchopulmonary dysplasia (BPD) is the focus of many intervention trials, yet the outcome measure when based solely on oxygen administration may be confounded by differing criteria for oxygen administration between physicians. Thus, we wished to define BPD by a standardized oxygen saturation monitoring at 36 weeks corrected age, and compare this physiologic definition with the standard clinical definition of BPD based solely on oxygen administration. A total of 199 consecutive very low birthweight infants (VLBW, 501 to 1500 g birthweight) were assessed prospectively at 36+/-1 weeks corrected age. Neonates on positive pressure support or receiving >30% supplemental oxygen were assigned the outcome BPD. Those receiving < or =30% oxygen underwent a stepwise 2% reduction in supplemental oxygen to room air while under continuous observation and oxygen saturation monitoring. Outcomes of the test were "no BPD" (saturations > or =88% for 60 minutes) or "BPD" (saturation < 88%). At the conclusion of the test, all infants were returned to their baseline oxygen. Safety (apnea, bradycardia, increased oxygen use), inter-rater reliability, test-retest reliability, and validity of the physiologic definition vs the clinical definition were assessed. A total of 199 VLBW were assessed, of whom 45 (36%) were diagnosed with BPD by the clinical definition of oxygen use at 36 weeks corrected age. The physiologic definition identified 15 infants treated with oxygen who successfully passed the saturation monitoring test in room air. The physiologic definition diagnosed BPD in 30 (24%) of the cohort. All infants were safely studied. The test was highly reliable (inter-rater reliability, kappa=1.0; test-retest reliability, kappa=0.83) and highly correlated with discharge home in oxygen, length of hospital stay, and hospital readmissions in the first year of life. The physiologic definition of BPD is safe, feasible, reliable, and valid and improves the precision of the diagnosis of BPD. This may be of benefit in future multicenter clinical trials.

Temporal Sensitivity Measured Shortly After Cochlear Implantation Predicts 6-Month Speech Recognition Outcome.

PubMed

Erb, Julia; Ludwig, Alexandra Annemarie; Kunke, Dunja; Fuchs, Michael; Obleser, Jonas

2018-04-24

Psychoacoustic tests assessed shortly after cochlear implantation are useful predictors of the rehabilitative speech outcome. While largely independent, both spectral and temporal resolution tests are important to provide an accurate prediction of speech recognition. However, rapid tests of temporal sensitivity are currently lacking. Here, we propose a simple amplitude modulation rate discrimination (AMRD) paradigm that is validated by predicting future speech recognition in adult cochlear implant (CI) patients. In 34 newly implanted patients, we used an adaptive AMRD paradigm, where broadband noise was modulated at the speech-relevant rate of ~4 Hz. In a longitudinal study, speech recognition in quiet was assessed using the closed-set Freiburger number test shortly after cochlear implantation (t0) as well as the open-set Freiburger monosyllabic word test 6 months later (t6). Both AMRD thresholds at t0 (r = -0.51) and speech recognition scores at t0 (r = 0.56) predicted speech recognition scores at t6. However, AMRD and speech recognition at t0 were uncorrelated, suggesting that those measures capture partially distinct perceptual abilities. A multiple regression model predicting 6-month speech recognition outcome with deafness duration and speech recognition at t0 improved from adjusted R = 0.30 to adjusted R = 0.44 when AMRD threshold was added as a predictor. These findings identify AMRD thresholds as a reliable, nonredundant predictor above and beyond established speech tests for CI outcome. This AMRD test could potentially be developed into a rapid clinical temporal-resolution test to be integrated into the postoperative test battery to improve the reliability of speech outcome prognosis.

The Well-Being 5: Development and Validation of a Diagnostic Instrument to Improve Population Well-being

PubMed Central

Sears, Lindsay E.; Agrawal, Sangeeta; Sidney, James A.; Castle, Patricia H.; Coberley, Carter R.; Witters, Dan; Pope, James E.; Harter, James K.

2014-01-01

Abstract Building upon extensive research from 2 validated well-being instruments, the objective of this research was to develop and validate a comprehensive and actionable well-being instrument that informs and facilitates improvement of well-being for individuals, communities, and nations. The goals of the measure were comprehensiveness, validity and reliability, significant relationships with health and performance outcomes, and diagnostic capability for intervention. For measure development and validation, questions from the Well-being Assessment and Wellbeing Finder were simultaneously administered as a test item pool to over 13,000 individuals across 3 independent samples. Exploratory factor analysis was conducted on a random selection from the first sample and confirmed in the other samples. Further evidence of validity was established through correlations to the established well-being scores from the Well-Being Assessment and Wellbeing Finder, and individual outcomes capturing health care utilization and productivity. Results showed the Well-Being 5 score comprehensively captures the known constructs within well-being, demonstrates good reliability and validity, significantly relates to health and performance outcomes, is diagnostic and informative for intervention, and can track and compare well-being over time and across groups. With this tool, well-being deficiencies within a population can be effectively identified, prioritized, and addressed, yielding the potential for substantial improvements to the health status, performance, and quality of life for individuals and cost savings for stakeholders. (Population Health Management 2014;17:357–365) PMID:24892873

Development and Preliminary Evaluation of a FAP Protocol: Brief Relationship Enhancement

ERIC Educational Resources Information Center

Holman, Gareth; Kohlenberg, Robert J.; Tsai, Mavis

2012-01-01

The purpose of this study was to develop a brief Functional Analytic Psychotherapy (FAP) protocol that will facilitate reliable implementation of FAP interventions, thus supporting research on FAP process and outcome. The treatment was a four-session individual therapy for clients who were interested in improving their relationship with their…

Strategies for Minimizing Variability in Progress Monitoring of Oral Reading Fluency

ERIC Educational Resources Information Center

Bundock, Kaitlin; O'Keeffe, Breda V.; Stokes, Kristen; Kladis, Kristin

2018-01-01

Research has shown that: (1) Curriculum-based monitoring (CBM) can be easily implemented and interpreted by teachers (e.g., Fuchs, Deno, & Mirkin, 1984); (2) student outcomes have improved when teachers use CBM to inform instructional decision making (e.g., Fuchs, Fuchs, Hamlett, & Stecker, 1991); (3) reliable and valid measures have been…

Enhanced recovery after surgery: Current research insights and future direction

PubMed Central

Abeles, Aliza; Kwasnicki, Richard Mark; Darzi, Ara

2017-01-01

Since the concept of enhanced recovery after surgery (ERAS) was introduced in the late 1990s the idea of implementing specific interventions throughout the peri-operative period to improve patient recovery has been proven to be beneficial. Minimally invasive surgery is an integral component to ERAS and has dramatically improved post-operative outcomes. ERAS can be applicable to all surgical specialties with the core generic principles used together with added specialty specific interventions to allow for a comprehensive protocol, leading to improved clinical outcomes. Diffusion of ERAS into mainstream practice has been hindered due to minimal evidence to support individual facets and lack of method for monitoring and encouraging compliance. No single outcome measure fully captures recovery after surgery, rather multiple measures are necessary at each stage. More recently the pre-operative period has been the target of a number of strategies to improve clinical outcomes, described as prehabilitation. Innovation of technology in the surgical setting is also providing opportunities to overcome the challenges within ERAS, e.g., the use of wearable activity monitors to record information and provide feedback and motivation to patients peri-operatively. Both modernising ERAS and providing evidence for key strategies across specialties will ultimately lead to better, more reliable patient outcomes. PMID:28289508

FLiGS Score: A New Method of Outcome Assessment for Lip Carcinoma–Treated Patients

PubMed Central

Grassi, Rita; Toia, Francesca; Di Rosa, Luigi; Cordova, Adriana

2015-01-01

Background: Lip cancer and its treatment have considerable functional and cosmetic effects with resultant nutritional and physical detriments. As we continue to investigate new treatment regimens, we are simultaneously required to assess postoperative outcomes to design interventions that lessen the adverse impact of this disease process. We wish to introduce Functional Lip Glasgow Scale (FLiGS) score as a new method of outcome assessment to measure the effect of lip cancer and its treatment on patients’ daily functioning. Methods: Fifty patients affected by lip squamous cell carcinoma were recruited between 2009 and 2013. Patients were asked to fill the FLiGS questionnaire before surgery, 1 month, 6 months, and 1 year after surgery. The subscores were used to calculate a total FLiGS score of global oral disability. Statistical analysis was performed to test validity and reliability. Results: FLiGS scores improved significantly from preoperative to 12 months postoperative values (P = 0.000). Statistical evidence of validity was provided through rs (Spearman correlation coefficient) that resulted >0.30 for all surveys and for which P < 0.001. FLiGS score reliability was shown through examination of internal consistency and test-retest reliability. Conclusions: FLiGS score is a simple way of assessing functional impairment related to lip cancer before and after surgery; it is sensitive, valid, reliable, and clinically relevant: it provides useful information to orient the physician in the postoperative management and in the rehabilitation program. PMID:26034652

Classification of instability after reverse shoulder arthroplasty guides surgical management and outcomes.

PubMed

Abdelfattah, Adham; Otto, Randall J; Simon, Peter; Christmas, Kaitlyn N; Tanner, Gregory; LaMartina, Joey; Levy, Jonathan C; Cuff, Derek J; Mighell, Mark A; Frankle, Mark A

2018-04-01

Revision of unstable reverse shoulder arthroplasty (RSA) remains a significant challenge. The purpose of this study was to determine the reliability of a new treatment-guiding classification for instability after RSA, to describe the clinical outcomes of patients stabilized operatively, and to identify those with higher risk of recurrence. All patients undergoing revision for instability after RSA were identified at our institution. Demographic, clinical, radiographic, and intraoperative data were collected. A classification was developed using all identified causes of instability after RSA and allocating them to 1 of 3 defined treatment-guiding categories. Eight surgeons reviewed all data and applied the classification scheme to each case. Interobserver and intraobserver reliability was used to evaluate the classification scheme. Preoperative clinical outcomes were compared with final follow-up in stabilized shoulders. Forty-three revision cases in 34 patients met the inclusion for study. Five patients remained unstable after revision. Persistent instability most commonly occurred in persistent deltoid dysfunction and postoperative acromial fractures but also in 1 case of soft tissue impingement. Twenty-one patients remained stable at minimum 2 years of follow-up and had significant improvement of clinical outcome scores and range of motion. Reliability of the classification scheme showed substantial and almost perfect interobserver and intraobserver agreement among all the participants (κ = 0.699 and κ = 0.851, respectively). Instability after RSA can be successfully treated with revision surgery using the reliable treatment-guiding classification scheme presented herein. However, more understanding is needed for patients with greater risk of recurrent instability after revision surgery. Copyright © 2017 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

Psychometric evaluation of dietary self-efficacy and outcome expectation scales in female college freshmen.

PubMed

Kedem, Leia E; Evans, Ellen M; Chapman-Novakofski, Karen

2014-11-01

Lifestyle interventions commonly measure psychosocial beliefs as precursors to positive behavior change, but often overlook questionnaire validation. This can affect measurement accuracy if the survey has been developed for a different population, as differing behavioral influences may affect instrument validity. The present study aimed to explore psychometric properties of self-efficacy and outcome expectation scales-originally developed for younger children-in a population of female college freshmen (N = 268). Exploratory principal component analysis was used to investigate underlying data patterns and assess validity of previously published subscales. Composite scores for reliable subscales (Cronbach's α ≥ .70) were calculated to help characterize self-efficacy and outcome expectation beliefs in this population. The outcome expectation factor structure clearly comprised of positive (α = .81-.90) and negative outcomes (α = .63-.67). The self-efficacy factor structure included themes of motivation and effort (α = .75-.94), but items pertaining to hunger and availability cross-loaded often. Based on cross-loading patterns and low Cronbach's alpha values, respectively, self-efficacy items regarding barriers to healthy eating and negative outcome expectation items should be refined to improve reliability. Composite scores suggested that eating healthfully was associated with positive outcomes, but self-efficacy to do so was lower. Thus, dietary interventions for college students may be more successful by including skill-building activities to enhance self-efficacy and increase the likelihood of behavior change. © The Author(s) 2014.

Can we predict failure in couple therapy early enough to enhance outcome?

PubMed

Pepping, Christopher A; Halford, W Kim; Doss, Brian D

2015-02-01

Feedback to therapists based on systematic monitoring of individual therapy progress reliably enhances therapy outcome. An implicit assumption of therapy progress feedback is that clients unlikely to benefit from therapy can be detected early enough in the course of therapy for corrective action to be taken. To explore the possibility of using feedback of therapy progress to enhance couple therapy outcome, the current study tested whether weekly therapy progress could detect off-track clients early in couple therapy. In an effectiveness trial of couple therapy, 136 couples were monitored weekly on relationship satisfaction and an expert derived algorithm was used to attempt to predict eventual therapy outcome. As expected, the algorithm detected a significant proportion of couples who did not benefit from couple therapy at Session 3, but prediction was substantially improved at Session 4 so that eventual outcome was accurately predicted for 70% of couples, with little improvement of prediction thereafter. More sophisticated algorithms might enhance prediction accuracy, and a trial of the effects of therapy progress feedback on couple therapy outcome is needed. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Harmonising Outcome Measures for Eczema (HOME) statement to assess clinical signs of atopic eczema in trials.

PubMed

Schmitt, Jochen; Spuls, Phyllis I; Thomas, Kim S; Simpson, Eric; Furue, Masutaka; Deckert, Stefanie; Dohil, Magdalene; Apfelbacher, Christian; Singh, Jasvinder A; Chalmers, Joanne; Williams, Hywel C

2014-10-01

The lack of core outcome sets for atopic eczema (AE) is a major obstacle for advancing evidence-based treatment. The global Harmonising Outcome Measures for Eczema (HOME) initiative has already defined clinical signs, symptoms, quality of life, and long-term control of flares as core outcome domains for AE trials. This article deals with the standardization of measurement instruments to assess clinical signs of AE. To resolve the current lack of standardization of the assessment of clinical signs of AE, we followed a structured process of systematic reviews and international consensus sessions to identify 1 core outcome measurement instrument for assessment of clinical signs in all future AE trials. Systematic reviews indicated that from 16 different instruments identified to assess clinical signs of AE, only the Eczema Area and Severity Index (EASI) and the objective Scoring Atopic Dermatitis (SCORAD) index were identified as extensively validated. The EASI has adequate validity, responsiveness, internal consistency, and intraobserver reliability. The objective SCORAD index has adequate validity, responsiveness, and interobserver reliability but unclear intraobserver reliability to measure clinical signs of AE. In an international consensus study, patients, physicians, nurses, methodologists, and pharmaceutical industry representatives agreed that the EASI is the preferred core instrument to measure clinical signs in all future AE trials. All stakeholders involved in designing, reporting, and using clinical trials on AE are asked to comply with this consensus to enable better evidence-based decision making, clearer scientific communication, and improved patient care. Copyright © 2014 American Academy of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.

Outcomes-focused knowledge translation: a framework for knowledge translation and patient outcomes improvement.

PubMed

Doran, Diane M; Sidani, Souraya

2007-01-01

Regularly accessing information that is current and reliable continues to be a challenge for front-line staff nurses. Reconceptualizing how nurses access information and designing appropriate decision support systems to facilitate timely access to information may be important for increasing research utilization. An outcomes-focused knowledge translation framework was developed to guide the continuous improvement of patient care through the uptake of research evidence and feedback data about patient outcomes. The framework operationalizes the three elements of the PARIHS framework at the point of care. Outcomes-focused knowledge translation involves four components: (a) patient outcomes measurement and real-time feedback about outcomes achievement; (b) best-practice guidelines, embedded in decision support tools that deliver key messages in response to patient assessment data; (c) clarification of patients' preferences for care; and (d) facilitation by advanced practice nurses and practice leaders. In this paper the framework is described and evidence is provided to support theorized relationships among the concepts in the framework. The framework guided the design of a knowledge translation intervention aimed at continuous improvement of patient care and evidence-based practice, which are fostered through real-time feedback data about patient outcomes, electronic access to evidence-based resources at the point of care, and facilitation by advanced practice nurses. The propositions in the framework need to be empirically tested through future research.

Inter-clinician and intra-clinician reliability of force application during joint mobilization: a systematic review.

PubMed

Gorgos, Kara S; Wasylyk, Nicole T; Van Lunen, Bonnie L; Hoch, Matthew C

2014-04-01

Joint mobilizations are commonly used by clinicians to decrease pain and restore joint arthrokinematics following musculoskeletal injury. The force applied during a joint mobilization treatment is subjective to the individual clinician but may have an effect on patient outcomes. The purpose of this systematic review was to critically appraise and synthesize the studies which examined the reliability of clinicians' force application during joint mobilization. A systematic search of PubMed and EBSCO Host databases from inception to March 1, 2013 was conducted to identify studies assessing the reliability of force application during joint mobilizations. Two reviewers utilized the Quality Appraisal of Reliability Studies (QAREL) assessment tool to determine the quality of included studies. The relative reliability of the included studies was examined through intraclass correlation coefficients (ICC) to synthesize study findings. All results were collated qualitatively with a level of evidence approach. A total of seven studies met the eligibility and were included. Five studies were included that assessed inter-clinician reliability, and six studies were included that assessed intra-clinician reliability. The overall level of evidence for inter-clinician reliability was strong for poor-to-moderate reliability (ICC = -0.04 to 0.70). The overall level of evidence for intra-clinician reliability was strong for good reliability (ICC = 0.75-0.99). This systematic review indicates there is variability in force application between clinicians but individual clinicians apply forces consistently. The results of this systematic review suggest innovative instructional methods are needed to improve consistency and validate the forces applied during of joint mobilization treatments. This is particularly evident for improving the consistency of force application across clinicians. Copyright © 2014 Elsevier Ltd. All rights reserved.

Statistical issues in reporting quality data: small samples and casemix variation.

PubMed

Zaslavsky, A M

2001-12-01

To present two key statistical issues that arise in analysis and reporting of quality data. Casemix variation is relevant to quality reporting when the units being measured have differing distributions of patient characteristics that also affect the quality outcome. When this is the case, adjustment using stratification or regression may be appropriate. Such adjustments may be controversial when the patient characteristic does not have an obvious relationship to the outcome. Stratified reporting poses problems for sample size and reporting format, but may be useful when casemix effects vary across units. Although there are no absolute standards of reliability, high reliabilities (interunit F > or = 10 or reliability > or = 0.9) are desirable for distinguishing above- and below-average units. When small or unequal sample sizes complicate reporting, precision may be improved using indirect estimation techniques that incorporate auxiliary information, and 'shrinkage' estimation can help to summarize the strength of evidence about units with small samples. With broader understanding of casemix adjustment and methods for analyzing small samples, quality data can be analysed and reported more accurately.

The National Surgical Quality Improvement Program 30-Day Challenge: Microsurgical Breast Reconstruction Outcomes Reporting Reliability

PubMed Central

Chen, Austin D.; Kamali, Parisa; Chattha, Anmol S.; Bucknor, Alexandra; Cohen, Justin B.; Bletsis, Patrick P.; Flecha-Hirsch, Renata; Tobias, Adam M.; Lee, Bernard T.

2018-01-01

Background: The aim was to assess reliability of the American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) 30-day perioperative outcomes and complications for immediate, free-tissue transfer breast reconstruction by direct comparisons with our 30-day and overall institutional data, and assessing those that occur after 30 days. Methods: Data were retrieved for consecutive immediate, free-tissue transfer breast reconstruction patients from a single-institution database (2010–2015) and the ACS-NSQIP (2011–2014). Multiple logistic regressions were performed to compare adjusted outcomes between the 2 datasets. Results: For institutional versus ACS-NSQIP outcomes, there were no significant differences in surgical-site infection (SSI; 30-day, 3.6% versus 4.1%, P = 0.818; overall, 5.3% versus 4.1%, P = 0.198), wound disruption (WD; 30-day, 1.3% versus 1.5%, P = 0.526; overall, 2.3% versus 1.5%, P = 0.560), or unplanned readmission (URA; 30-day, 2.3% versus 3.3%, P = 0.714; overall, 4.6% versus 3.3%, P = 0.061). However, the ACS-NSQIP reported a significantly higher unplanned reoperation (URO) rate (30-day, 3.6% versus 9.5%, P < 0.001; overall, 5.3% versus 9.5%, P = 0.025). Institutional complications consisted of 5.3% SSI, 2.3% WD, 5.3% URO, and 4.6% URA, of which 25.0% SSI, 28.6% WD, 12.5% URO, and 7.1% URA occurred at 30–60 days, and 6.3% SSI, 14.3% WD, 18.8% URO, and 42.9% URA occurred after 60 days. Conclusion: For immediate, free-tissue breast reconstruction, the ACS-NSQIP may be reliable for monitoring and comparing SSI, WD, URO, and URA rates. However, clinicians may find it useful to understand limitations of the ACS-NSQIP for complications and risk factors, as it may underreport complications occurring beyond 30 days. PMID:29707443

One-year test-retest reliability of intrinsic connectivity network fMRI in older adults

PubMed Central

Guo, Cong C.; Kurth, Florian; Zhou, Juan; Mayer, Emeran A.; Eickhoff, Simon B; Kramer, Joel H.; Seeley, William W.

2014-01-01

“Resting-state” or task-free fMRI can assess intrinsic connectivity network (ICN) integrity in health and disease, suggesting a potential for use of these methods as disease-monitoring biomarkers. Numerous analytical options are available, including model-driven ROI-based correlation analysis and model-free, independent component analysis (ICA). High test-retest reliability will be a necessary feature of a successful ICN biomarker, yet available reliability data remains limited. Here, we examined ICN fMRI test-retest reliability in 24 healthy older subjects scanned roughly one year apart. We focused on the salience network, a disease-relevant ICN not previously subjected to reliability analysis. Most ICN analytical methods proved reliable (intraclass coefficients > 0.4) and could be further improved by wavelet analysis. Seed-based ROI correlation analysis showed high map-wise reliability, whereas graph theoretical measures and temporal concatenation group ICA produced the most reliable individual unit-wise outcomes. Including global signal regression in ROI-based correlation analyses reduced reliability. Our study provides a direct comparison between the most commonly used ICN fMRI methods and potential guidelines for measuring intrinsic connectivity in aging control and patient populations over time. PMID:22446491

Romantic relationships and mental health.

PubMed

Braithwaite, Scott; Holt-Lunstad, Julianne

2017-02-01

This paper reviews the research on relationships and mental health. Individuals who are more mentally healthy are more likely to select into relationships, but relationships are also demonstrably associated with mental health. The type of relationship matters - evidence suggests that more established, committed relationships, such as marriage, are associated with greater benefits than less committed unions such as cohabitation. The association between relationships and mental health is clearly bidirectional, however, stronger effects are observed when mental health is the outcome and relationships are the predictor, suggesting that the causal arrow flows more strongly from relationships to mental health than vice versa. Moreover, improving relationships improves mental health, but improving mental health does not reliably improve relationships. Our review of research corroborates the view that relationships are a keystone component of human functioning that have the potential to influence a broad array of mental health outcomes. Copyright © 2016. Published by Elsevier Ltd.

Evolution and outcomes of a quality improvement program.

PubMed

Thor, Johan; Herrlin, Bo; Wittlöv, Karin; Øvretveit, John; Brommels, Mats

2010-01-01

The purpose of this paper is to examine the outcomes and evolution over a five-year period of a Swedish university hospital quality improvement program in light of enduring uncertainty regarding the effectiveness of such programs in healthcare and how best to evaluate it. The paper takes the form of a case study, using data collected as part of the program, including quality indicators from clinical improvement projects and participants' program evaluations. Overall, 58 percent of the program's projects (39/67) demonstrated success. A greater proportion of projects led by female doctors demonstrated success (91 percent, n=11) than projects led by male doctors (51 percent, n=55). Facilitators at the hospital continuously adapted the improvement methods to the local context. A lack of dedicated time for improvement efforts was the participants' biggest difficulty. The dominant benefits included an increased ability to see the "bigger picture" and the improvements achieved for patients and employees. Quality measurement, which is important for conducting and evaluating improvement efforts, was weak with limited reliability. Nevertheless, the present study adds evidence about the effectiveness of healthcare improvement programs. Gender differences in improvement team leadership merit further study. Improvement program evaluation should assess the extent to which improvement methods are locally adapted and applied. This case study reports the outcomes of all improvement projects undertaken in one healthcare organization over a five-year period and provides in-depth insight into an improvement program's changeable nature.

Patient-reported outcomes in borderline personality disorder.

PubMed

Hasler, Gregor; Hopwood, Christopher J; Jacob, Gitta A; Brändle, Laura S; Schulte-Vels, Thomas

2014-06-01

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes.

Minimising post-operative risk using a Post-Anaesthetic Care Tool (PACT): protocol for a prospective observational study and cost-effectiveness analysis

PubMed Central

Phillips, Nicole M; Kent, Bridie; Colgan, Stephen; Mohebbi, Mohammadreza

2015-01-01

Introduction While the risk of adverse events following surgery has been identified, the impact of nursing care on early detection of these events is not well established. A systematic review of the evidence and an expert consensus study in post-anaesthetic care identified essential criteria for nursing assessment of patient readiness for discharge from the post-anaesthetic care unit (PACU). These criteria were included in a new nursing assessment tool, the Post-Anaesthetic Care Tool (PACT), and incorporated into the post-anaesthetic documentation at a large health service. The aim of this study is to test the clinical reliability of the PACT and evaluate whether the use of PACT will (1) enhance the recognition and response to patients at risk of deterioration in PACU; (2) improve documentation for handover from PACU nurse to ward nurse; (3) result in improved patient outcomes and (4) reduce healthcare costs. Methods and analysis A prospective, non-randomised, pre-implementation and post-implementation design comparing: (1) patients (n=750) who have surgery prior to the implementation of the PACT and (2) patients (n=750) who have surgery after PACT. The study will examine the use of the tool through the observation of patient care and nursing handover. Patient outcomes and cost-effectiveness will be determined from health service data and medical record audit. Descriptive statistics will be used to describe the sample and compare the two patient groups (pre-intervention and post-intervention). Differences in patient outcomes between the two groups will be compared using the Cochran-Mantel-Haenszel test and regression analyses and reported as ORs with the corresponding 95% CIs. Conclusions This study will test the clinical reliability and cost-effectiveness of the PACT. It is hypothesised that the PACT will enable nurses to recognise and respond to patients at risk of deterioration, improve handover to ward nurses, improve patient outcomes, and reduce healthcare costs. PMID:26033942

Implementation of cognitive therapy for PTSD in routine clinical care: effectiveness and moderators of outcome in a consecutive sample.

PubMed

Ehlers, Anke; Grey, Nick; Wild, Jennifer; Stott, Richard; Liness, Sheena; Deale, Alicia; Handley, Rachel; Albert, Idit; Cullen, Deborah; Hackmann, Ann; Manley, John; McManus, Freda; Brady, Francesca; Salkovskis, Paul; Clark, David M

2013-11-01

Trauma-focused psychological treatments are recommended as first-line treatments for Posttraumatic Stress Disorder (PTSD), but clinicians may be concerned that the good outcomes observed in randomized controlled trials (RCTs) may not generalize to the wide range of traumas and presentations seen in clinical practice. This study investigated whether Cognitive Therapy for PTSD (CT-PTSD) can be effectively implemented into a UK National Health Service Outpatient Clinic serving a defined ethnically mixed urban catchment area. A consecutive sample of 330 patients with PTSD (age 17-83) following a wide range of traumas were treated by 34 therapists, who received training and supervision in CT-PTSD. Pre and post treatment data (PTSD symptoms, anxiety, depression) were collected for all patients, including dropouts. Hierarchical linear modeling investigated candidate moderators of outcome and therapist effects. CT-PTSD was well tolerated and led to very large improvement in PTSD symptoms, depression and anxiety. The majority of patients showed reliable improvement/clinically significant change: intent-to-treat: 78.8%/57.3%; completer: 84.5%/65.1%. Dropouts and unreliable attenders had worse outcome. Statistically reliable symptom exacerbation with treatment was observed in only 1.2% of patients. Treatment gains were maintained during follow-up (M=280 days, n=220). Few of the selection criteria used in some RCTs, demographic, diagnostic and trauma characteristics moderated treatment outcome, and only social problems and needing treatment for multiple traumas showed unique moderation effects. There were no random effects of therapist on symptom improvement, but therapists who were inexperienced in CT-PTSD had more dropouts than those with greater experience. The results support the effectiveness of CT-PTSD and suggest that trauma-focused cognitive behavior therapy can be successfully implemented in routine clinical services treating patients with a wide range of traumas. Copyright © 2013 The Authors. Published by Elsevier Ltd.. All rights reserved.

Implementation of Cognitive Therapy for PTSD in routine clinical care: Effectiveness and moderators of outcome in a consecutive sample☆

PubMed Central

Ehlers, Anke; Grey, Nick; Wild, Jennifer; Stott, Richard; Liness, Sheena; Deale, Alicia; Handley, Rachel; Albert, Idit; Cullen, Deborah; Hackmann, Ann; Manley, John; McManus, Freda; Brady, Francesca; Salkovskis, Paul; Clark, David M.

2013-01-01

Objective Trauma-focused psychological treatments are recommended as first-line treatments for Posttraumatic Stress Disorder (PTSD), but clinicians may be concerned that the good outcomes observed in randomized controlled trials (RCTs) may not generalize to the wide range of traumas and presentations seen in clinical practice. This study investigated whether Cognitive Therapy for PTSD (CT-PTSD) can be effectively implemented into a UK National Health Service Outpatient Clinic serving a defined ethnically mixed urban catchment area. Method A consecutive sample of 330 patients with PTSD (age 17–83) following a wide range of traumas were treated by 34 therapists, who received training and supervision in CT-PTSD. Pre and post treatment data (PTSD symptoms, anxiety, depression) were collected for all patients, including dropouts. Hierarchical linear modeling investigated candidate moderators of outcome and therapist effects. Results CT-PTSD was well tolerated and led to very large improvement in PTSD symptoms, depression and anxiety. The majority of patients showed reliable improvement/clinically significant change: intent-to-treat: 78.8%/57.3%; completer: 84.5%/65.1%. Dropouts and unreliable attenders had worse outcome. Statistically reliable symptom exacerbation with treatment was observed in only 1.2% of patients. Treatment gains were maintained during follow-up (M = 280 days, n = 220). Few of the selection criteria used in some RCTs, demographic, diagnostic and trauma characteristics moderated treatment outcome, and only social problems and needing treatment for multiple traumas showed unique moderation effects. There were no random effects of therapist on symptom improvement, but therapists who were inexperienced in CT-PTSD had more dropouts than those with greater experience. Conclusions The results support the effectiveness of CT-PTSD and suggest that trauma-focused cognitive behavior therapy can be successfully implemented in routine clinical services treating patients with a wide range of traumas. PMID:24076408

Reliability of joint count assessment in rheumatoid arthritis: a systematic literature review.

PubMed

Cheung, Peter P; Gossec, Laure; Mak, Anselm; March, Lyn

2014-06-01

Joint counts are central to the assessment of rheumatoid arthritis (RA) but reliability is an issue. To evaluate the reliability and agreement of joint counts (intra-observer and inter-observer) by health care professionals (physicians, nurses, and metrologists) and patients in RA, and the impact of training and standardization on joint count reliability through a systematic literature review. Articles reporting joint count reliability or agreement in RA in PubMed, EMBase, and the Cochrane library between 1960 and 2012 were selected. Data were extracted regarding tender joint counts (TJCs) and swollen joint counts (SJCs) derived by physicians, metrologists, or patients for intra-observer and inter-observer reliability. In addition, methods and effects of training or standardization were extracted. Statistics expressing reliability such as intraclass correlation coefficients (ICCs) were extracted. Data analysis was primarily descriptive due to high heterogeneity. Twenty-eight studies on health care professionals (HCP) and 20 studies on patients were included. Intra-observer reliability for TJCs and SJCs was good for HCPs and patients (range of ICC: 0.49-0.98). Inter-observer reliability between HCPs for TJCs was higher than for SJCs (range of ICC: 0.64-0.88 vs. 0.29-0.98). Patient inter-observer reliability with HCPs as comparators was better for TJCs (range of ICC: 0.31-0.91) compared to SJCs (0.16-0.64). Nine studies (7 with HCPs and 2 with patients) evaluated consensus or training, with improvement in reliability of TJCs but conflicting evidence for SJCs. Intra- and inter-observer reliability was high for TJCs for HCPs and patients: among all groups, reliability was better for TJCs than SJCs. Inter-observer reliability of SJCs was poorer for patients than HCPs. Data were inconclusive regarding the potential for training to improve SJC reliability. Overall, the results support further evaluation for patient-reported joint counts as an outcome measure. © 2013 Published by Elsevier Inc.

The Localized Scleroderma Skin Severity Index and Physician Global Assessment of Disease Activity: A Work in Progress Toward Development of Localized Scleroderma Outcome Measures

PubMed Central

ARKACHAISRI, THASCHAWEE; VILAIYUK, SOAMARAT; LI, SUZANNE; O’NEIL, KATHLEEN M.; POPE, ELENA; HIGGINS, GLORIA C.; PUNARO, MARILYNN; RABINOVICH, EGLA C.; ROSENKRANZ, MARGALIT; KIETZ, DANIEL A.; ROSEN, PAUL; SPALDING, STEVEN J.; HENNON, TERESA R.; TOROK, KATHRYN S.; CASSIDY, ELAINE; MEDSGER, THOMAS A.

2013-01-01

Objective To develop and evaluate a Localized Scleroderma (LS) Skin Severity Index (LoSSI) and global assessments’ clinimetric property and effect on quality of life (QOL). Methods A 3-phase study was conducted. The first phase involved 15 patients with LS and 14 examiners who assessed LoSSI [surface area (SA), erythema (ER), skin thickness (ST), and new lesion/extension (N/E)] twice for inter/intrarater reliability. Patient global assessment of disease severity (PtGA-S) and Children’s Dermatology Life Quality Index (CDLQI) were collected for intrarater reliability evaluation. The second phase was aimed to develop clinical determinants for physician global assessment of disease activity (PhysGA-A) and to assess its content validity. The third phase involved 2 examiners assessing LoSSI and PhysGA-A on 27 patients. Effect of training on improving reliability/validity and sensitivity to change of the LoSSI and PhysGA-A was determined. Results Interrater reliability was excellent for ER [intraclass correlation coefficient (ICC) 0.71], ST (ICC 0.70), LoSSI (ICC 0.80), and PhysGA-A (ICC 0.90) but poor for SA (ICC 0.35); thus, LoSSI was modified to mLoSSI. Examiners’ experience did not affect the scores, but training/practice improved reliability. Intrarater reliability was excellent for ER, ST, and LoSSI (Spearman’s rho = 0.71–0.89) and moderate for SA. PtGA-S and CDLQI showed good intrarater agreement (ICC 0.63 and 0.80). mLoSSI correlated moderately with PhysGA-A and PtGA-S. Both mLoSSI and PhysGA-A were sensitive to change following therapy. Conclusion mLoSSI and PhysGA-A are reliable and valid tools for assessing LS disease severity and show high sensitivity to detect change over time. These tools are feasible for use in routine clinical practice. They should be considered for inclusion in a core set of LS outcome measures for clinical trials. PMID:19833758

Pharmacological and surgical treatment of nonreproductive outcomes in polycystic ovary syndrome: An overview of systematic reviews.

PubMed

Tay, Chau T; Joham, Anju E; Hiam, Danielle S; Gadalla, Moustafa A; Pundir, Jyotsna; Thangaratinam, Shakila; Teede, Helena J; Moran, Lisa J

2018-05-30

Polycystic ovary syndrome (PCOS) affects up to 13% women and is associated with significant complications. The quality of evidence supporting the recommendations on treatment of nonreproductive outcomes in PCOS is unknown. To summarize and appraise the methodological quality of systematic reviews and meta-analyses evaluating pharmacological and surgical treatments for nonreproductive outcomes in PCOS. A literature search from MEDLINE, EMBASE, CINAHL PLUS and PROSPERO was performed from inception until 15th of September 2017. Article selection, data extraction and quality appraisal of included reviews were performed in duplicate. A narrative synthesis of the findings was conducted. This overview included 31 reviews. The quality was low for 7 (23%), moderate for sixteen (52%) and high for 8 reviews (26%). Two reviews assessed psychological outcomes. Metformin improved anthropometric (7 of 10 reviews), metabolic (4 of 14 reviews) and endocrine outcomes (3 of twelve reviews). Thiazolidinediones improved metabolic (2 of 5 reviews) and endocrine outcomes (one of 5 reviews) but worsened weight gain (5 of 5 reviews). Combined oral contraceptive pill (COCP) improved clinical hyperandrogenism (2 of 2 reviews). Statins improved lipid profile (3 of 3 reviews) and testosterone level (2 of 3 reviews). There was no conclusive evidence from included systematic reviews regarding the use of other interventions. There is reliable evidence regarding the use of metformin for anthropometric outcomes and COCPs for hyperandrogenism in women with PCOS but not for other interventions. There is significant gap in knowledge regarding the management of psychological outcomes in women with PCOS which needs further evaluation. © 2018 John Wiley & Sons Ltd.

Measuring Patient-Reported Outcomes: Key Metrics in Reconstructive Surgery.

PubMed

Voineskos, Sophocles H; Nelson, Jonas A; Klassen, Anne F; Pusic, Andrea L

2018-01-29

Satisfaction and improved quality of life are among the most important outcomes for patients undergoing plastic and reconstructive surgery for a variety of diseases and conditions. Patient-reported outcome measures (PROMs) are essential tools for evaluating the benefits of newly developed surgical techniques. Modern PROMs are being developed with new psychometric approaches, such as Rasch Measurement Theory, and their measurement properties (validity, reliability, responsiveness) are rigorously tested. These advances have resulted in the availability of PROMs that provide clinically meaningful data and effectively measure functional as well as psychosocial outcomes. This article guides the reader through the steps of creating a PROM and highlights the potential research and clinical uses of such instruments. Limitations of PROMs and anticipated future directions in this field are discussed.

The HARM score for gastrointestinal surgery: Application and validation of a novel, reliable and simple tool to measure surgical quality and outcomes.

PubMed

Crawshaw, Benjamin P; Keller, Deborah S; Brady, Justin T; Augestad, Knut M; Schiltz, Nicholas K; Koroukian, Siran M; Navale, Suparna M; Steele, Scott R; Delaney, Conor P

2017-03-01

The HospitAl length of stay, Readmissions and Mortality (HARM) score is a simple, inexpensive quality tool, linked directly to patient outcomes. We assess the HARM score for measuring surgical quality across multiple surgical populations. Upper gastrointestinal, hepatobiliary, and colorectal surgery cases between 2005 and 2009 were identified from the Healthcare Cost and Utilization Project California State Inpatient Database. Composite and individual HARM scores were calculated from length of stay, 30-day readmission and mortality, correlated to complication rates for each hospital and stratified by operative type. 71,419 admissions were analyzed. Higher HARM scores correlated with higher complication rates for all cases after risk adjustment and stratification by operation type, elective or emergent status. The HARM score is a simple and valid quality measurement for upper gastrointestinal, hepatobiliary and colorectal surgery. The HARM score could facilitate benchmarking to improve patient outcomes and resource utilization, and may facilitate outcome improvement. Copyright © 2016 Elsevier Inc. All rights reserved.

Impression management and self-report among violent offenders.

PubMed

Mills, Jeremy F; Kroner, Daryl G

2006-02-01

Offenders are assumed by many to employ socially desirable responding (SDR) response styles when completing self-report measures. Contrary to expectations, prior research has shown that accounting for SDR in self-report measures of antisocial constructs does not improve the relationship with outcome. Despite this, many self-report measures reliably predict future criminal outcome criteria. The present research examines the relationship of SDR (self-deception and impression management) with self-reported antisocial attitudes and the outcome of criminal recidivism in a sample of violent offenders. Offenders high on impression management reported lower antisocial attitudes. However, when impression management was statistically partialed from antisocial attitudes, the relationship with recidivism tended to diminish, though not to a statistically significant degree. This finding, though hypothesized based on previous empirical findings, is contrary to the theoretical assumption that controlling for SDR should improve the relationship of self-report with outcome. The discussion centers on the implications of routinely removing impression management from self-report.

Developing a Framework to Generate Evidence of Health Outcomes From Social Media Use in Chronic Disease Management

PubMed Central

Gray, Kathleen; Martin-Sanchez, Fernando

2013-01-01

Background While there is an abundance of evidence-based practice (EBP) recommendations guiding management of various chronic diseases, evidence suggesting best practice for using social media to improve health outcomes is inadequate. The variety of social media platforms, multiple potential uses, inconsistent definitions, and paucity of rigorous studies, make it difficult to measure health outcomes reliably in chronic disease management. Most published investigations report on an earlier generation of online tools, which are not as user-centered, participatory, engaging, or collaborative, and thus may work differently for health self-management. Objective The challenge to establish a sound evidence base for social media use in chronic disease starts with the need to define criteria and methods to generate and evaluate evidence. The authors’ key objective is to develop a framework for research and practice that addresses this challenge. Methods This paper forms part of a larger research project that presents a conceptual framework of how evidence of health outcomes can be generated from social media use, allowing social media to be utilized in chronic disease management more effectively. Using mixed methods incorporating a qualitative literature review, a survey and a pilot intervention, the research closely examines the therapeutic affordances of social media, people with chronic pain (PWCP) as a subset of chronic disease management, valid outcome measurement of patient-reported (health) outcomes (PRO), the individual needs of people living with chronic disease, and finally translation of the combined results to improve evidence-based decision making about social media use in this context. Results Extensive review highlights various affordances of social media that may prove valuable to understanding social media’s effect on individual health outcomes. However, without standardized PRO instruments, we are unable to definitively investigate these effects. The proposed framework that we offer outlines how therapeutic affordances of social media coupled with valid and reliable PRO measurement may be used to generate evidence of improvements in health outcomes, as well as guide evidence-based decision making in the future about social media use as part of chronic disease self-management. Conclusions The results will (1) inform a framework for conducting research into health outcomes from social media use in chronic disease, as well as support translating the findings into evidence of improved health outcomes, and (2) inform a set of recommendations for evidence-based decision making about social media use as part of chronic disease self-management. These outcomes will fill a gap in the knowledge and resources available to individuals managing a chronic disease, their clinicians and other researchers in chronic disease and the field of medicine 2.0. PMID:25075238

Developing a framework to generate evidence of health outcomes from social media use in chronic disease management.

PubMed

Merolli, Mark; Gray, Kathleen; Martin-Sanchez, Fernando

2013-01-01

While there is an abundance of evidence-based practice (EBP) recommendations guiding management of various chronic diseases, evidence suggesting best practice for using social media to improve health outcomes is inadequate. The variety of social media platforms, multiple potential uses, inconsistent definitions, and paucity of rigorous studies, make it difficult to measure health outcomes reliably in chronic disease management. Most published investigations report on an earlier generation of online tools, which are not as user-centered, participatory, engaging, or collaborative, and thus may work differently for health self-management. The challenge to establish a sound evidence base for social media use in chronic disease starts with the need to define criteria and methods to generate and evaluate evidence. The authors' key objective is to develop a framework for research and practice that addresses this challenge. This paper forms part of a larger research project that presents a conceptual framework of how evidence of health outcomes can be generated from social media use, allowing social media to be utilized in chronic disease management more effectively. Using mixed methods incorporating a qualitative literature review, a survey and a pilot intervention, the research closely examines the therapeutic affordances of social media, people with chronic pain (PWCP) as a subset of chronic disease management, valid outcome measurement of patient-reported (health) outcomes (PRO), the individual needs of people living with chronic disease, and finally translation of the combined results to improve evidence-based decision making about social media use in this context. Extensive review highlights various affordances of social media that may prove valuable to understanding social media's effect on individual health outcomes. However, without standardized PRO instruments, we are unable to definitively investigate these effects. The proposed framework that we offer outlines how therapeutic affordances of social media coupled with valid and reliable PRO measurement may be used to generate evidence of improvements in health outcomes, as well as guide evidence-based decision making in the future about social media use as part of chronic disease self-management. The results will (1) inform a framework for conducting research into health outcomes from social media use in chronic disease, as well as support translating the findings into evidence of improved health outcomes, and (2) inform a set of recommendations for evidence-based decision making about social media use as part of chronic disease self-management. These outcomes will fill a gap in the knowledge and resources available to individuals managing a chronic disease, their clinicians and other researchers in chronic disease and the field of medicine 2.0.

Evaluating multidisciplinary health care teams: taking the crisis out of CRM.

PubMed

Sutton, Gigi

2009-08-01

High-reliability organisations are those, such as within the aviation industry, which operate in complex, hazardous environments and yet despite this are able to balance safety and effectiveness. Crew resource management (CRM) training is used to improve the non-technical skills of aviation crews and other high-reliability teams. To date, CRM within the health sector has been restricted to use with "crisis teams" and "crisis events". The purpose of this discussion paper is to examine the application of CRM to acute, ward-based multidisciplinary health care teams and more broadly to argue for the repositioning of health-based CRM to address effective everyday function, of which "crisis events" form just one part. It is argued that CRM methodology could be applied to evaluate ward-based health care teams and design non-technical skills training to increase their efficacy, promote better patient outcomes, and facilitate a range of positive personal and organisational level outcomes.

Development and Validity Testing of the Worksite Health Index: An Assessment Tool to Help and Improve Korean Employees' Health-Related Outcome.

PubMed

Yun, Young Ho; Sim, Jin Ah; Lim, Ye Jin; Lim, Cheol Il; Kang, Sung-Choon; Kang, Joon-Ho; Park, Jun Dong; Noh, Dong Young

2016-06-01

The objective of this study was to develop the Worksite Health Index (WHI) and validate its psychometric properties. The development of the WHI questionnaire included item generation, item construction, and field testing. To assess the instrument's reliability and validity, we recruited 30 different Korean worksites. We developed the WHI questionnaire of 136 items categorized into five domains, namely Governance and Infrastructure, Need Assessment and Planning, Health Prevention and Promotion Program, Occupational Safety, and Monitoring and Feedback. All WHI domains demonstrated a high reliability with good internal consistency. The total WHI scores differentiated worksite groups effectively according to firm size. Each domain was associated significantly with employees' health status, absence, and financial outcome. The WHI can assess comprehensive worksite health programs. This tool is publicly available for addressing the growing need for worksite health programs.

Systematic review of patient-specific instrumentation in total knee arthroplasty: new but not improved.

PubMed

Sassoon, Adam; Nam, Denis; Nunley, Ryan; Barrack, Robert

2015-01-01

Patient-specific cutting blocks have been touted as a more efficient and reliable means of achieving neutral mechanical alignment during TKA with the proposed downstream effect of improved clinical outcomes. However, it is not clear to what degree published studies support these assumptions. We asked: (1) Do patient-specific cutting blocks achieve neutral mechanical alignment more reliably during TKA when compared with conventional methods? (2) Does patient-specific instrumentation (PSI) provide financial benefit through improved surgical efficiency? (3) Does the use of patient-specific cutting blocks translate to improved clinical results after TKA when compared with conventional instrumentation? We performed a systematic review in accordance with Cochrane guidelines of controlled studies (prospective and retrospective) in MEDLINE® and EMBASE® with respect to patient-specific cutting blocks and their effect on alignment, cost, operative time, clinical outcome scores, complications, and survivorship. Sixteen studies (Level I-III on the levels of evidence rubric) were identified and used in addressing the first question, 13 (Level I-III) for the second question, and two (Level III) for the third question. Qualitative assessment of the selected Level I studies was performed using the modified Jadad score; Level II and III studies were rated based on the Newcastle-Ottawa scoring system. The majority of studies did not show an improvement in overall limb alignment when PSI was compared with standard instrumentation. Mixed results were seen across studies with regard to the prevalence of alignment outliers when PSI was compared with conventional cutting blocks with some studies demonstrating no difference, some showing an improvement with PSI, and a single study showing worse results with PSI. The studies demonstrated mixed results regarding the influence of PSI on operative times. Decreased operative times were not uniformly observed, and when noted, they were found to be of minimal clinical or financial significance. PSI did reliably reduce the number of instrument trays required for processing perioperatively. The accuracy of the preoperative plan, generated by the PSI manufacturers, was found lacking, often leading to multiple intraoperative changes, thereby disrupting the flow of the operation and negatively impacting efficiency. Limited data exist with regard to the effect of PSI on postoperative function, improvement in pain, and patient satisfaction. Neither of the two studies we identified provided strong evidence to support an advantage favoring the use of PSI. No identified studies addressed survivorship of components placed with PSI compared with those placed with standard instrumentation. PSI for TKA has not reliably demonstrated improvement of postoperative limb or component alignment when compared with standard instrumentation. Although decisive evidence exists to support that PSI requires fewer surgical trays, PSI has not clearly been shown to improve overall surgical efficiency or the cost-effectiveness of TKA. Mid- and long-term data regarding PSI's effect on functional outcomes and component survivorship do not exist and short-term data are scarce. Limited available literature does not clearly support any improvement of postoperative pain, activity, function, or ROM when PSI is compared with traditional instrumentation.

Improving the power of an efficacy study of a social and emotional learning program: application of generalizability theory to the measurement of classroom-level outcomes.

PubMed

Mashburn, Andrew J; Downer, Jason T; Rivers, Susan E; Brackett, Marc A; Martinez, Andres

2014-04-01

Social and emotional learning programs are designed to improve the quality of social interactions in schools and classrooms in order to positively affect students' social, emotional, and academic development. The statistical power of group randomized trials to detect effects of social and emotional learning programs and other preventive interventions on setting-level outcomes is influenced by the reliability of the outcome measure. In this paper, we apply generalizability theory to an observational measure of the quality of classroom interactions that is an outcome in a study of the efficacy of a social and emotional learning program called The Recognizing, Understanding, Labeling, Expressing, and Regulating emotions Approach. We estimate multiple sources of error variance in the setting-level outcome and identify observation procedures to use in the efficacy study that most efficiently reduce these sources of error. We then discuss the implications of using different observation procedures on both the statistical power and the monetary costs of conducting the efficacy study.

Naturalistic follow-up of subjects affected with anorexia nervosa 8 years after multimodal treatment: Personality and psychopathology changes and predictors of outcome.

PubMed

Amianto, F; Spalatro, A; Ottone, L; Abbate Daga, G; Fassino, S

2017-09-01

Eating disorders (EDs) are serious mental illnesses of growing clinical and social impact. Despite their severity, there is still no satisfactory evidence-based treatment. Follow-up investigations are the most reliable studies to enlighten long-term outcome predictors and modifiers. In total, 59 subjects affected with anorexia nervosa were assessed 8 years after their admission into an outpatient multimodal treatment program for eating disorders. The follow-up changes in diagnostic criteria were compared with Chi-square test. Improved and not-improved subjects were compared. Clinical, personality and psychopathology features between T0 and T1 were compared with t-test for repeated measures. Correlation between T0 features and changes at T1 in personality and psychopathology features were assessed. The rate of complete remission was 42%, an overall rate of 67.8% improved, a rate of 18.6% worsened. Concerning personality, a significant decrease of harm avoidance and increase in self-directedness were evidenced. Interoceptive awareness, drive for thinness, bulimia were significantly reduced at follow-up. Many T0 personality facets were related to personality and psychopathology improvement at follow-up. Multimodal treatment encompassing psychiatric, nutritional and psychological approaches is at the moment the most reliable approach for the treatment of moderate to severe anorexia nervosa with a discrete rate of improvement. Some personality and psychopathology characteristics may represent specific factors which favor resistance and impair improvement. Future approaches should consider the personalization of therapeutic approach according to these features. Copyright © 2017 Elsevier Masson SAS. All rights reserved.

Improve Outcomes Study subjects Chemistry Teaching and Learning Strategies through independent study with the help of computer-based media

NASA Astrophysics Data System (ADS)

Sugiharti, Gulmah

2018-03-01

This study aims to see the improvement of student learning outcomes by independent learning using computer-based learning media in the course of STBM (Teaching and Learning Strategy) Chemistry. Population in this research all student of class of 2014 which take subject STBM Chemistry as many as 4 class. While the sample is taken by purposive as many as 2 classes, each 32 students, as control class and expriment class. The instrument used is the test of learning outcomes in the form of multiple choice with the number of questions as many as 20 questions that have been declared valid, and reliable. Data analysis techniques used one-sided t test and improved learning outcomes using a normalized gain test. Based on the learning result data, the average of normalized gain values for the experimental class is 0,530 and for the control class is 0,224. The result of the experimental student learning result is 53% and the control class is 22,4%. Hypothesis testing results obtained t count> ttable is 9.02> 1.6723 at the level of significance α = 0.05 and db = 58. This means that the acceptance of Ha is the use of computer-based learning media (CAI Computer) can improve student learning outcomes in the course Learning Teaching Strategy (STBM) Chemistry academic year 2017/2018.

Validity, reliability and responsiveness to change of the Italian palliative care outcome scale: a multicenter study of advanced cancer patients.

PubMed

Costantini, Massimo; Rabitti, Elisa; Beccaro, Monica; Fusco, Flavio; Peruselli, Carlo; La Ciura, Pietro; Valle, Alessandro; Suriani, Cinzia; Berardi, Maria Alejandra; Valenti, Danila; Mosso, Felicita; Morino, Piero; Zaninetta, Giovanni; Tubere, Giorgio; Piazza, Massimo; Sofia, Michele; Di Leo, Silvia; Higginson, Irene J

2016-02-26

There is an increasing requirement to assess outcomes, but few measures have been tested for advanced medical illness. We aimed to test the validity, reliability and responsiveness of the Palliative care Outcome Scale (POS), and to analyse predictors of change after the transition to palliative care. Phase 1: multicentre, mixed method study comprising cognitive and qualitative interviews with patients and staff, cultural refinement and adaption. Phase 2: consecutive cancer patients on admission to 8 inpatient hospices and 7 home-based teams were asked to complete the POS, the EORTC QLQ-C15-PAL and the FACIT-Sp (T0), to assess internal consistency, convergent and divergent validity. After 6 days (T1) patients and staff completed the POS to assess responsiveness to change (T1-T0), and agreement between self-assessed POS and POS completed by the staff. Finally, we asked hospices an assessment 24-48 h after T1 to assess its reliability (test re-test analysis). Phase I: 209 completed POS questionnaires and 29 cognitive interviews were assessed, revisions made and one item substituted. Phase II: 295 consecutive patients admitted to 15 PCTs were approached, 175 (59.3 %) were eligible, and 150 (85.7 %) consented. Consent was limited by the severity of illness in 40 % patients. We found good convergent validity, with strong and moderate correlations (r ranged 0.5-0.8) between similar items from the POS, the QLQ-C15-PAL and the FACIT-Sp. As hypothesised, the physical function subscale of QLQ-C15-PAL was not correlated with any POS item (r ranged -0.16-0.02). We found acceptable to good test re-test reliability in both versions for 6 items. We found significant clinical improvements during the first week of palliative care in 7/10 items assessed-pain, other symptoms, patient and family anxiety, information, feeling at peace and wasted time. Both the patient self-assessed and professional POS versions are valid and with an acceptable internal consistency. POS detected significant clinical improvements during palliative care, at a time when patients are usually expected to deteriorate. These results suggest that there is room for substantial improvement in the management of patients with advanced disease, across all key domains-symptoms, psychological, information, social and spiritual.

Using video-annotation software to identify interactions in group therapies for schizophrenia: assessing reliability and associations with outcomes.

PubMed

Orfanos, Stavros; Akther, Syeda Ferhana; Abdul-Basit, Muhammad; McCabe, Rosemarie; Priebe, Stefan

2017-02-10

Research has shown that interactions in group therapies for people with schizophrenia are associated with a reduction in negative symptoms. However, it is unclear which specific interactions in groups are linked with these improvements. The aims of this exploratory study were to i) develop and test the reliability of using video-annotation software to measure interactions in group therapies in schizophrenia and ii) explore the relationship between interactions in group therapies for schizophrenia with clinically relevant changes in negative symptoms. Video-annotation software was used to annotate interactions from participants selected across nine video-recorded out-patient therapy groups (N = 81). Using the Individual Group Member Interpersonal Process Scale, interactions were coded from participants who demonstrated either a clinically significant improvement (N = 9) or no change (N = 8) in negative symptoms at the end of therapy. Interactions were measured from the first and last sessions of attendance (>25 h of therapy). Inter-rater reliability between two independent raters was measured. Binary logistic regression analysis was used to explore the association between the frequency of interactive behaviors and changes in negative symptoms, assessed using the Positive and Negative Syndrome Scale. Of the 1275 statements that were annotated using ELAN, 1191 (93%) had sufficient audio and visual quality to be coded using the Individual Group Member Interpersonal Process Scale. Rater-agreement was high across all interaction categories (>95% average agreement). A higher frequency of self-initiated statements measured in the first session was associated with improvements in negative symptoms. The frequency of questions and giving advice measured in the first session of attendance was associated with improvements in negative symptoms; although this was only a trend. Video-annotation software can be used to reliably identify interactive behaviors in groups for schizophrenia. The results suggest that proactive communicative gestures, as assessed by the video-analysis, predict outcomes. Future research should use this novel method in larger and clinically different samples to explore which aspects of therapy facilitate such proactive communication early on in therapy.

A pilot validation of a modified Illness Perceptions Questionnaire designed to predict response to cognitive therapy for psychosis.

PubMed

Marcus, Elena; Garety, Philippa; Weinman, John; Emsley, Richard; Dunn, Graham; Bebbington, Paul; Freeman, Daniel; Kuipers, Elizabeth; Fowler, David; Hardy, Amy; Waller, Helen; Jolley, Suzanne

2014-12-01

Clinical responsiveness to cognitive behavioural therapy for psychosis (CBTp) varies. Recent research has demonstrated that illness perceptions predict active engagement in therapy, and, thereby, better outcomes. In this study, we aimed to investigate the psychometric properties of a modification of the Illness Perceptions Questionnaire (M-IPQ) designed to predict response following CBTp. Fifty-six participants with persistent, distressing delusions completed the M-IPQ; forty before a brief CBT intervention targeting persecutory ideation and sixteen before and after a control condition. Additional predictors of outcome (delusional conviction, symptom severity and belief inflexibility) were assessed at baseline. Outcomes were assessed at baseline and at follow-up four to eight weeks later. The M-IPQ comprised two factors measuring problem duration and therapy-specific perceptions of Cure/Control. Associated subscales, formed by summing the relevant items for each factor, were reliable in their structure. The Cure/Control subscale was also reliable over time; showed convergent validity with other predictors of outcome; predicted therapy outcomes; and differentially predicted treatment effects. We measured outcome without an associated measure of engagement, in a small sample. Findings are consistent with hypothesis and existing research, but require replication in a larger, purposively recruited sample. The Cure/Control subscale of the M-IPQ shows promise as a predictor of response to therapy. Specifically targeting these illness perceptions in the early stages of cognitive behavioural therapy may improve engagement and, consequently, outcomes. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Assessing Assessment: Evaluating Outcomes and Reliabilities of Grammar, Math, and Writing Skill Measures in an Introductory Journalism Course

ERIC Educational Resources Information Center

Farwell, Tricia M.; Alligood, Leon; Fitzgerald, Sharon; Blake, Ken

2016-01-01

This article introduces an objective grammar and math assessment and evaluates the assessment's outcome and reliability when fielded among eighty-one students in media writing courses. In addition, the article proposes a rubric for grading straight news leads and compares the rubric's reliability with the reliability of rating straight news leads…

Integrated Approach to Reduce Perinatal Adverse Events: Standardized Processes, Interdisciplinary Teamwork Training, and Performance Feedback.

PubMed

Riley, William; Begun, James W; Meredith, Les; Miller, Kristi K; Connolly, Kathy; Price, Rebecca; Muri, Janet H; McCullough, Mac; Davis, Stanley

2016-12-01

To improve safety practices and reduce adverse events in perinatal units of acute care hospitals. Primary data collected from perinatal units of 14 hospitals participating in the intervention between 2008 and 2012. Baseline secondary data collected from the same hospitals between 2006 and 2007. A prospective study involving 342,754 deliveries was conducted using a quality improvement collaborative that supported three primary interventions. Primary measures include adoption of three standardized care processes and four measures of outcomes. Chart audits were conducted to measure the implementation of standardized care processes. Outcome measures were collected and validated by the National Perinatal Information Center. The hospital perinatal units increased use of all three care processes, raising consolidated overall use from 38 to 81 percent between 2008 and 2012. The harms measured by the Adverse Outcome Index decreased 14 percent, and a run chart analysis revealed two special causes associated with the interventions. This study demonstrates the ability of hospital perinatal staff to implement efforts to reduce perinatal harm using a quality improvement collaborative. Findings help inform the relationship between the use of standardized care processes, teamwork training, and improved perinatal outcomes, and suggest that a multiplicity of integrated strategies, rather than a single intervention, may be essential to achieve high reliability. © Health Research and Educational Trust.

Implementation and evaluation of a low health literacy and culturally sensitive diabetes education program.

PubMed

Swavely, Deborah; Vorderstrasse, Allison; Maldonado, Edgardo; Eid, Sherrine; Etchason, Jeff

2014-01-01

Low health literacy is more prevalent in persons with limited education, members of ethnic minorities, and those who speak English as a second language, and is associated with multiple adverse diabetes-related health outcomes. This study examined the effectiveness of a low health literacy and culturally sensitive diabetes education program for economically and socially disadvantaged adult patients with type 2 diabetes. A pre-post prospective study design was used to examine outcomes over 12 months. Outcome measures included diabetes knowledge, self-efficacy, and self-care, measured using reliable and valid survey tools, and A1C. Over this period of time 277 patients were enrolled in the program, with 106 participants completing survey data. At the completion of the program patients had significant improvements in diabetes knowledge (p < .001), self-efficacy (p < .001), and three domains of self-care including diet (p < .001), foot care (p < .001), and exercise (p < .001). There were no significant improvements in the frequency of blood glucose testing (p = .345). Additionally, A1C values significantly improved 3 months after completing the program (p = .007). In conclusion, a diabetes education program designed to be culturally sensitive and meet the needs of individuals with low health literacy improves short-term outcomes. © 2013 National Association for Healthcare Quality.

Training balance with opto-kinetic stimuli in the home: a randomized controlled feasibility study in people with pure cerebellar disease.

PubMed

Bunn, Lisa M; Marsden, Jonathan F; Giunti, Paola; Day, Brian L

2015-02-01

To investigate the feasibility of a randomized controlled trial of a home-based balance intervention for people with cerebellar ataxia. A randomized controlled trial design. Intervention and assessment took place in the home environment. A total of 12 people with spinocerebellar ataxia type 6 were randomized into a therapy or control group. Both groups received identical assessments at baseline, four and eight weeks. Therapy group participants undertook balance exercises in front of optokinetic stimuli during weeks 4-8, while control group participants received no intervention. Test-retest reliability was analysed from outcome measures collected twice at baseline and four weeks later. Feasibility issues were evaluated using daily diaries and end trial exit interviews. The home-based training intervention with opto-kinetic stimuli was feasible for people with pure ataxia, with one drop-out. Test-retest reliability is strong (intraclass correlation coefficient >0.7) for selected outcome measures evaluating balance at impairment and activity levels. Some measures reveal trends towards improvement for those in the therapy group. Sample size estimations indicate that Bal-SARA scores could detect a clinically significant change of 0.8 points in this functional balance score if 80 people per group were analysed in future trials. Home-based targeted training of functional balance for people with pure cerebellar ataxia is feasible and the outcome measures employed are reliable. © The Author(s) 2014.

Optimizing Outcome Assessment in Multicenter TBI Trials: Perspectives From TRACK-TBI and the TBI Endpoints Development Initiative.

PubMed

Bodien, Yelena G; McCrea, Michael; Dikmen, Sureyya; Temkin, Nancy; Boase, Kim; Machamer, Joan; Taylor, Sabrina R; Sherer, Mark; Levin, Harvey; Kramer, Joel H; Corrigan, John D; McAllister, Thomas W; Whyte, John; Manley, Geoffrey T; Giacino, Joseph T

Traumatic brain injury (TBI) is a global public health problem that affects the long-term cognitive, physical, and psychological health of patients, while also having a major impact on family and caregivers. In stark contrast to the effective trials that have been conducted in other neurological diseases, nearly 30 studies of interventions employed during acute hospital care for TBI have failed to identify treatments that improve outcome. Many factors may confound the ability to detect true and meaningful treatment effects. One promising area for improving the precision of intervention studies is to optimize the validity of the outcome assessment battery by using well-designed tools and data collection strategies to reduce variability in the outcome data. The Transforming Research and Clinical Knowledge in TBI (TRACK-TBI) study, conducted at 18 sites across the United States, implemented a multidimensional outcome assessment battery with 22 measures aimed at characterizing TBI outcome up to 1 year postinjury. In parallel, through the TBI Endpoints Development (TED) Initiative, federal agencies and investigators have partnered to identify the most valid, reliable, and sensitive outcome assessments for TBI. Here, we present lessons learned from the TRACK-TBI and TED initiatives aimed at optimizing the validity of outcome assessment in TBI.

Near-misses are an opportunity to improve patient safety: adapting strategies of high reliability organizations to healthcare.

PubMed

Van Spall, Harriette; Kassam, Alisha; Tollefson, Travis T

2015-08-01

Near-miss investigations in high reliability organizations (HROs) aim to mitigate risk and improve system safety. Healthcare settings have a higher rate of near-misses and subsequent adverse events than most high-risk industries, but near-misses are not systematically reported or analyzed. In this review, we will describe the strategies for near-miss analysis that have facilitated a culture of safety and continuous quality improvement in HROs. Near-miss analysis is routine and systematic in HROs such as aviation. Strategies implemented in aviation include the Commercial Aviation Safety Team, which undertakes systematic analyses of near-misses, so that findings can be incorporated into Standard Operating Procedures (SOPs). Other strategies resulting from incident analyses include Crew Resource Management (CRM) for enhanced communication, situational awareness training, adoption of checklists during operations, and built-in redundancy within systems. Health care organizations should consider near-misses as opportunities for quality improvement. The systematic reporting and analysis of near-misses, commonplace in HROs, can be adapted to health care settings to prevent adverse events and improve clinical outcomes.

Depression following traumatic brain injury: Impact on post-hospital residential rehabilitation outcomes.

PubMed

Lewis, Frank D; Horn, Gordon J

2017-01-01

A need exists to better understand the impact of depression on functional outcomes following TBI. To evaluate the prevalence and severity of depression among a large group of chronic TBI adults; to determine the impact of depression on outcomes of post-hospital residential rehabilitation programs; and to assess effectiveness of post-hospital residential rehabilitation programs in treating depression. 820 adults with moderate to severe traumatic brain injury (TBI) were assigned to one of four groups based on MPAI- 4 depression ratings: (1) Not Depressed, (2) Mildly Depressed, (3) Moderately Depressed, and (4) Severely Depressed. Functional status was assessed at admission and discharge with the MPAI-4 Participation Index. Differences among groups were evaluated using conventional parametric tests. Rasch analysis established reliability and validity of MPAI-4 data. Rasch analysis demonstrated satisfactory construct validity and internal consistency (Person reliability = 0.89-0.92, Item reliability = 0.99). Of the 820 subjects, 39% presented with moderate to severe depressive symptoms at admission, These subjects demonstrated significantly higher MPAI-4 Participation scores than the mild and not depressed groups. Depressed groups realized significant improvement in symptoms, but, those remaining depressed at discharge had significantly greater disability than those who improved. Depressive symptoms had a deleterious impact on outcome. Remediation of symptoms during rehabilitation significantly improved outcomes.

Patient-reported outcomes in borderline personality disorder

PubMed Central

Hasler, Gregor; Hopwood, Christopher J.; Jacob, Gitta A.; Brändle, Laura S.; Schulte-Vels, Thomas

2014-01-01

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes. PMID:25152662

"Is My Child Developing Normally?": A Critical Review of Web-Based Resources for Parents

ERIC Educational Resources Information Center

Williams, Nia; Mughal, Sabena; Blair, Mitch

2008-01-01

Early detection of developmental problems improves outcomes for parents and children. Parents want to be involved in assessment and need high-quality, accurate, and reliable data on child development to help monitor progress and inform decisions on referral. The aim of this paper is to review which websites are readily accessible to parents on…

Virtual surgical planning and 3D printing in prosthetic orbital reconstruction with percutaneous implants: a technical case report

PubMed Central

Huang, Yu-Hui; Seelaus, Rosemary; Zhao, Linping; Patel, Pravin K; Cohen, Mimis

2016-01-01

Osseointegrated titanium implants to the cranial skeleton for retention of facial prostheses have proven to be a reliable replacement for adhesive systems. However, improper placement of the implants can jeopardize prosthetic outcomes, and long-term success of an implant-retained prosthesis. Three-dimensional (3D) computer imaging, virtual planning, and 3D printing have become accepted components of the preoperative planning and design phase of treatment. Computer-aided design and computer-assisted manufacture that employ cone-beam computed tomography data offer benefits to patient treatment by contributing to greater predictability and improved treatment efficiencies with more reliable outcomes in surgical and prosthetic reconstruction. 3D printing enables transfer of the virtual surgical plan to the operating room by fabrication of surgical guides. Previous studies have shown that accuracy improves considerably with guided implantation when compared to conventional template or freehand implant placement. This clinical case report demonstrates the use of a 3D technological pathway for preoperative virtual planning through prosthesis fabrication, utilizing 3D printing, for a patient with an acquired orbital defect that was restored with an implant-retained silicone orbital prosthesis. PMID:27843356

Virtual surgical planning and 3D printing in prosthetic orbital reconstruction with percutaneous implants: a technical case report.

PubMed

Huang, Yu-Hui; Seelaus, Rosemary; Zhao, Linping; Patel, Pravin K; Cohen, Mimis

2016-01-01

Osseointegrated titanium implants to the cranial skeleton for retention of facial prostheses have proven to be a reliable replacement for adhesive systems. However, improper placement of the implants can jeopardize prosthetic outcomes, and long-term success of an implant-retained prosthesis. Three-dimensional (3D) computer imaging, virtual planning, and 3D printing have become accepted components of the preoperative planning and design phase of treatment. Computer-aided design and computer-assisted manufacture that employ cone-beam computed tomography data offer benefits to patient treatment by contributing to greater predictability and improved treatment efficiencies with more reliable outcomes in surgical and prosthetic reconstruction. 3D printing enables transfer of the virtual surgical plan to the operating room by fabrication of surgical guides. Previous studies have shown that accuracy improves considerably with guided implantation when compared to conventional template or freehand implant placement. This clinical case report demonstrates the use of a 3D technological pathway for preoperative virtual planning through prosthesis fabrication, utilizing 3D printing, for a patient with an acquired orbital defect that was restored with an implant-retained silicone orbital prosthesis.

Reliability and validity of an audio signal modified shuttle walk test.

PubMed

Singla, Rupak; Rai, Richa; Faye, Abhishek Anil; Jain, Anil Kumar; Chowdhury, Ranadip; Bandyopadhyay, Debdutta

2017-01-01

The audio signal in the conventionally accepted protocol of shuttle walk test (SWT) is not well-understood by the patients and modification of the audio signal may improve the performance of the test. The aim of this study is to study the validity and reliability of an audio signal modified SWT, called the Singla-Richa modified SWT (SWTSR), in healthy normal adults. In SWTSR, the audio signal was modified with the addition of reverse counting to it. A total of 54 healthy normal adults underwent conventional SWT (CSWT) at one instance and two times SWTSRon the same day. The validity was assessed by comparing outcomes of the SWTSRto outcomes of CSWT using the Pearson correlation coefficient and Bland-Altman plot. Test-retest reliability of SWTSRwas assessed using the intraclass correlation coefficient (ICC). The acceptability of the modified test in comparison to the conventional test was assessed using Likert scale. The distance walked (mean ± standard deviation) in the CSWT and SWTSRtest was 853.33 ± 217.33 m and 857.22 ± 219.56 m, respectively (Pearson correlation coefficient - 0.98; P < 0.001) indicating SWTSRto be a valid test. The SWTSRwas found to be a reliable test with ICC of 0.98 (95% confidence interval: 0.97-0.99). The acceptability of SWTSRwas significantly higher than CSWT. The SWTSRwith modified audio signal with reverse counting is a reliable as well as a valid test when compared with CSWT in healthy normal adults. It better understood by subjects compared to CSWT.

Improving Value for Patients with Eczema.

PubMed

Block, Julie

2018-04-01

Chronic diseases now represent a cost majority in the United States health care system. Contributing factors to rising costs include expensive novel and emerging therapies, under-treatment of disease, under-management of comorbidities, and patient dissatisfaction with care results. Critical to identifying replicable improvement methods is a reliable model to measure value. If we understand value within healthcare consumerism to be equal to a patient's health outcome improvement over costs associated with care (Value=Outcomes/Costs), we can use this equation to measure the improvement of value. Research and literature show that patient activation-the skills and confidence that equip patients to become actively engaged in their health care-impact health outcomes, costs, and patient experience. Reaching patient activation through engagement methods including shared decision-making (SDM) lead to improved value of care received. The National Eczema Association (NEA) Shared Decision-Making Resource Center can be a transformative strategy to measure and evaluate value of health care interventions for eczema patients to advance a value-driven health care system in the United States. Through this Resource Center, NEA will measure patient value through their own perceptions using validated PRO instruments and other patient-generated health data. Assessment of this data will reveal findings that can assist researchers in evaluating the impact this care framework on patient-perceived value across other chronic diseases. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Validation of Patient-Reported Outcomes Measurement Information System Computerized Adaptive Tests Against the Foot and Ankle Outcome Score for 6 Common Foot and Ankle Pathologies.

PubMed

Koltsov, Jayme C B; Greenfield, Stephen T; Soukup, Dylan; Do, Huong T; Ellis, Scott J

2017-08-01

The field of foot and ankle surgery lacks a widely accepted gold-standard patient-reported outcome instrument. With the changing infrastructure of the medical profession, more efficient patient-reported outcome tools are needed to reduce respondent burden and increase participation while providing consistent and reliable measurement across multiple pathologies and disciplines. The primary purpose of the present study was to validate 3 Patient-Reported Outcomes Measurement Information System computer adaptive tests (CATs) most relevant to the foot and ankle discipline against the Foot and Ankle Outcome Score (FAOS) and the Short Form 12 general health status survey in patients with 6 common foot and ankle pathologies. Patients (n = 240) indicated for operative treatment for 1 of 6 common foot and ankle pathologies completed the CATs, FAOS, and Short Form 12 at their preoperative surgical visits, 1 week subsequently (before surgery), and at 6 months postoperatively. The psychometric properties of the instruments were assessed and compared. The Patient-Reported Outcomes Measurement Information System CATs each took less than 1 minute to complete, whereas the FAOS took 6.5 minutes, and the Short Form 12 took 3 minutes. CAT scores were more normally distributed and had fewer floor and ceiling effects than those on the FAOS, which reached as high as 24%. The CATs were more precise than the FAOS and had similar responsiveness and test-retest reliability. The physical function and mobility CATs correlated strongly with the activities subscale of the FAOS, and the pain interference CAT correlated strongly with the pain subscale of the FAOS. The CATs and FAOS were responsive to changes with operative treatment for 6 common foot and ankle pathologies. The CATs performed as well as or better than the FAOS in all aspects of psychometric validity. The Patient-Reported Outcomes Measurement Information System CATs show tremendous potential for improving the study of patient outcomes in foot and ankle research through improved precision and reduced respondent burden. Level II, prospective comparative study.

Comparison of reliability and responsiveness of patient-reported clinical outcome measures in knee osteoarthritis rehabilitation.

PubMed

Williams, Valerie J; Piva, Sara R; Irrgang, James J; Crossley, Chad; Fitzgerald, G Kelley

2012-08-01

Secondary analysis, pretreatment-posttreatment observational study. To compare the reliability and responsiveness of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), the Knee Outcome Survey activities of daily living subscale (KOS-ADL), and the Lower Extremity Functional Scale (LEFS) in individuals with knee osteoarthritis (OA). The WOMAC is the current standard in patient-reported measures of function in patients with knee OA. The KOS-ADL and LEFS were designed for potential use in patients with knee OA. If the KOS-ADL and LEFS are to be considered viable alternatives to the WOMAC for measuring patient-reported function in individuals with knee OA, they should have measurement properties comparable to the WOMAC. It would also be important to determine whether either of these instruments may be superior to the WOMAC in terms of reliability or responsiveness in this population. Data from 168 subjects with knee OA, who participated in a rehabilitation program, were used in the analyses. Reliability and responsiveness of each outcome measure were estimated at follow-ups of 2, 6, and 12 months. Reliability was estimated by calculating the intraclass correlation coefficient (ICC2,1) for subjects who were unchanged in status from baseline at each follow-up time, based on a global rating of change score. To examine responsiveness, the standard error of the measurement, minimal detectable change, minimal clinically important difference, and the Guyatt responsiveness index were calculated for each outcome measure at each follow-up time. All 3 outcome measures demonstrated reasonable reliability and responsiveness to change. Reliability and responsiveness tended to decrease somewhat with increasing follow-up time. There were no substantial differences between outcome measures for reliability or any of the 3 measures of responsiveness at any follow-up time. The results do not indicate that one outcome measure is more reliable or responsive than another when applied to subjects with knee OA. We believe that all 3 instruments are appropriate outcome measures to examine change in functional status of patients with knee OA.

Issues and developments related to assessing function in serious mental illness.

PubMed

Brown, Matt A; Velligan, Dawn I

2016-06-01

Serious mental illness (SMI) results in functional disability that imposes a significant burden on individuals, caregivers, and society. Development of novel treatments is under way in an effort to improve the illness domains of cognitive impairment and negative symptoms and subsequently to improve functional outcomes. The assessment of functional outcomes in SMI faces a number of challenges, including the proliferation of assessment instruments and the differential prioritization of functional goals among stakeholder groups. Functional assessments relying on self- and informant report present a number of limitations. Identifying alternative strategies to assess functioning that are reliable, valid, and sensitive to change is necessary for use in clinical trials. Measures of functional capacity have been proposed for clinical trials investigating compounds to treat cognitive impairment in schizophrenia. Alternative approaches employing effort-based decision making or daily activity recording using instruments such as the Daily Activity Report may be more appropriate for studies focused on improving negative symptoms.

Effectiveness of implementation interventions in improving physician adherence to guideline recommendations in heart failure: a systematic review

PubMed Central

Shanbhag, Deepti; Graham, Ian D; Harlos, Karen; Haynes, R. Brian; Gabizon, Itzhak; Connolly, Stuart J; Van Spall, Harriette Gillian Christine

2018-01-01

Background The uptake of guideline recommendations that improve heart failure (HF) outcomes remains suboptimal. We reviewed implementation interventions that improve physician adherence to these recommendations, and identified contextual factors associated with implementation success. Methods We searched databases from January 1990 to November 2017 for studies testing interventions to improve uptake of class I HF guidelines. We used the Cochrane Effective Practice and Organisation of Care and Process Redesign frameworks for data extraction. Primary outcomes included: proportion of eligible patients offered guideline-recommended pharmacotherapy, self-care education, left ventricular function assessment and/or intracardiac devices. We reported clinical outcomes when available. Results We included 38 studies. Provider-level interventions (n=13 studies) included audit and feedback, reminders and education. Organisation-level interventions (n=18) included medical records system changes, multidisciplinary teams, clinical pathways and continuity of care. System-level interventions (n=3) included provider/institutional incentives. Four studies assessed multi-level interventions. We could not perform meta-analyses due to statistical/conceptual heterogeneity. Thirty-two studies reported significant improvements in at least one primary outcome. Clinical pathways, multidisciplinary teams and multifaceted interventions were most consistently successful in increasing physician uptake of guidelines. Among randomised controlled trials (RCT) (n=10), pharmacist and nurse-led interventions improved target dose prescriptions. Eleven studies reported clinical outcomes; significant improvements were reported in three, including a clinical pathway, a multidisciplinary team and a multifaceted intervention. Baseline assessment of barriers, staff training, iterative intervention development, leadership commitment and policy/financial incentives were associated with intervention effectiveness. Most studies (n=20) had medium risk of bias; nine RCTs had low risk of bias. Conclusion Our study is limited by the quality and heterogeneity of the primary studies. Clinical pathways, multidisciplinary teams and multifaceted interventions appear to be most consistent in increasing guideline uptake. However, improvements in process outcomes were rarely accompanied by improvements in clinical outcomes. Our work highlights the need for improved research methodology to reliably assess the effectiveness of implementation interventions. PMID:29511005

Effectiveness of implementation interventions in improving physician adherence to guideline recommendations in heart failure: a systematic review.

PubMed

Shanbhag, Deepti; Graham, Ian D; Harlos, Karen; Haynes, R Brian; Gabizon, Itzhak; Connolly, Stuart J; Van Spall, Harriette Gillian Christine

2018-03-06

The uptake of guideline recommendations that improve heart failure (HF) outcomes remains suboptimal. We reviewed implementation interventions that improve physician adherence to these recommendations, and identified contextual factors associated with implementation success. We searched databases from January 1990 to November 2017 for studies testing interventions to improve uptake of class I HF guidelines. We used the Cochrane Effective Practice and Organisation of Care and Process Redesign frameworks for data extraction. Primary outcomes included: proportion of eligible patients offered guideline-recommended pharmacotherapy, self-care education, left ventricular function assessment and/or intracardiac devices. We reported clinical outcomes when available. We included 38 studies. Provider-level interventions (n=13 studies) included audit and feedback, reminders and education. Organisation-level interventions (n=18) included medical records system changes, multidisciplinary teams, clinical pathways and continuity of care. System-level interventions (n=3) included provider/institutional incentives. Four studies assessed multi-level interventions. We could not perform meta-analyses due to statistical/conceptual heterogeneity. Thirty-two studies reported significant improvements in at least one primary outcome. Clinical pathways, multidisciplinary teams and multifaceted interventions were most consistently successful in increasing physician uptake of guidelines. Among randomised controlled trials (RCT) (n=10), pharmacist and nurse-led interventions improved target dose prescriptions. Eleven studies reported clinical outcomes; significant improvements were reported in three, including a clinical pathway, a multidisciplinary team and a multifaceted intervention. Baseline assessment of barriers, staff training, iterative intervention development, leadership commitment and policy/financial incentives were associated with intervention effectiveness. Most studies (n=20) had medium risk of bias; nine RCTs had low risk of bias. Our study is limited by the quality and heterogeneity of the primary studies. Clinical pathways, multidisciplinary teams and multifaceted interventions appear to be most consistent in increasing guideline uptake. However, improvements in process outcomes were rarely accompanied by improvements in clinical outcomes. Our work highlights the need for improved research methodology to reliably assess the effectiveness of implementation interventions. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Applying the High Reliability Health Care Maturity Model to Assess Hospital Performance: A VA Case Study.

PubMed

Sullivan, Jennifer L; Rivard, Peter E; Shin, Marlena H; Rosen, Amy K

2016-09-01

The lack of a tool for categorizing and differentiating hospitals according to their high reliability organization (HRO)-related characteristics has hindered progress toward implementing and sustaining evidence-based HRO practices. Hospitals would benefit both from an understanding of the organizational characteristics that support HRO practices and from knowledge about the steps necessary to achieve HRO status to reduce the risk of harm and improve outcomes. The High Reliability Health Care Maturity (HRHCM) model, a model for health care organizations' achievement of high reliability with zero patient harm, incorporates three major domains critical for promoting HROs-Leadership, Safety Culture, and Robust Process Improvement ®. A study was conducted to examine the content validity of the HRHCM model and evaluate whether it can differentiate hospitals' maturity levels for each of the model's components. Staff perceptions of patient safety at six US Department of Veterans Affairs (VA) hospitals were examined to determine whether all 14 HRHCM components were present and to characterize each hospital's level of organizational maturity. Twelve of the 14 components from the HRHCM model were detected; two additional characteristics emerged that are present in the HRO literature but not represented in the model-teamwork culture and system-focused tools for learning and improvement. Each hospital's level of organizational maturity could be characterized for 9 of the 14 components. The findings suggest the HRHCM model has good content validity and that there is differentiation between hospitals on model components. Additional research is needed to understand how these components can be used to build the infrastructure necessary for reaching high reliability.

Improving Learner Handovers in Medical Education.

PubMed

Warm, Eric J; Englander, Robert; Pereira, Anne; Barach, Paul

2017-07-01

Multiple studies have demonstrated that the information included in the Medical Student Performance Evaluation fails to reliably predict medical students' future performance. This faulty transfer of information can lead to harm when poorly prepared students fail out of residency or, worse, are shuttled through the medical education system without an honest accounting of their performance. Such poor learner handovers likely arise from two root causes: (1) the absence of agreed-on outcomes of training and/or accepted assessments of those outcomes, and (2) the lack of standardized ways to communicate the results of those assessments. To improve the current learner handover situation, an authentic, shared mental model of competency is needed; high-quality tools to assess that competency must be developed and tested; and transparent, reliable, and safe ways to communicate this information must be created.To achieve these goals, the authors propose using a learner handover process modeled after a patient handover process. The CLASS model includes a description of the learner's Competency attainment, a summary of the Learner's performance, an Action list and statement of Situational awareness, and Synthesis by the receiving program. This model also includes coaching oriented towards improvement along the continuum of education and care. Just as studies have evaluated patient handover models using metrics that matter most to patients, studies must evaluate this learner handover model using metrics that matter most to providers, patients, and learners.

How blockchain-timestamped protocols could improve the trustworthiness of medical science

PubMed Central

Irving, Greg; Holden, John

2017-01-01

Trust in scientific research is diminished by evidence that data are being manipulated. Outcome switching, data dredging and selective publication are some of the problems that undermine the integrity of published research. Methods for using blockchain to provide proof of pre-specified endpoints in clinical trial protocols were first reported by Carlisle. We wished to empirically test such an approach using a clinical trial protocol where outcome switching has previously been reported. Here we confirm the use of blockchain as a low cost, independently verifiable method to audit and confirm the reliability of scientific studies. PMID:27239273

How blockchain-timestamped protocols could improve the trustworthiness of medical science.

PubMed

Irving, Greg; Holden, John

2016-01-01

Trust in scientific research is diminished by evidence that data are being manipulated. Outcome switching, data dredging and selective publication are some of the problems that undermine the integrity of published research. Methods for using blockchain to provide proof of pre-specified endpoints in clinical trial protocols were first reported by Carlisle. We wished to empirically test such an approach using a clinical trial protocol where outcome switching has previously been reported. Here we confirm the use of blockchain as a low cost, independently verifiable method to audit and confirm the reliability of scientific studies.

The Effects of an 8-Week Stabilization Exercise Program on Lumbar Multifidus Muscle Thickness and Activation as Measured With Ultrasound Imaging in Patients With Low Back Pain: An Exploratory Study.

PubMed

Larivière, Christian; Gagnon, Dany H; Henry, Sharon M; Preuss, Richard; Dumas, Jean-Pierre

2018-05-01

Lumbar stabilization exercise programs (LSEP) produce positive effects on clinical outcomes, but the underlying mechanisms remain relatively unexplored. Psychological and neuromuscular mechanisms can be involved, such as a better activation of the lumbar multifidus, which represents one possibility. To determine the following: (1) the effect of an LSEP on lumbar multifidus muscle thickness and activation, as measured with rehabilitative ultrasound imaging (RUSI), in patients with low back pain (LBP); (2) the correlation between RUSI measures and any change in clinical outcomes following the LSEP; and (3) the reliability of RUSI measures in control subjects over 8 weeks. One-arm clinical trial with healthy subjects as a control group; reliability study. LSEP delivered in a clinical setting; outcomes measured in a laboratory setting. A total of 34 patients with nonacute LBP and 28 healthy control subjects. Outcomes were measured before and after an 8-week LSEP in patients with LBP, and at the same time interval (without treatment, to assess reliability) in control subjects. Pain numeric rating scale, Oswestry Disability Index (function), as well as RUSI measures for the lumbar multifidus (LM) muscles at 3 vertebral levels (L5-S1, L4-5, and L3-4) during rest (static) and dynamic contractions (percent thickness change). Patients did not show systematic changes in RUSI measures relative to controls, even though RUSI impairments were observed at baseline (dynamic measure at L5-S1) and even though patients had significant improvements in pain and disability. Correlational analyses with these clinical outcomes suggested that patients had reduced muscle thickness at baseline that was associated with a greater reduction in disability following LSEP; however, LM activation measured at baseline showed the opposite. Static RUSI measures showed excellent reliability at the L4-5 and L3-4 levels, whereas dynamic measures were not reliable. Patients showed less muscle activation than controls at baseline (L5-S1 level), but the LSEP did not normalize this impairment. The links between RUSI measures and the change in clinical outcomes during LSEP should be further explored. This clinical trial has been recorded in the International Standard Registered Clinical/soCial sTudy Number (ISRCTN) registry (ID: ISRCTN94152969). II. Copyright © 2018 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

The new health-care quality: value, outcomes, and continuous improvement.

PubMed

O'Connor, S J; Lanning, J A

1991-01-01

No longer convinced that their viewpoint on quality is the only one, different stakeholders in the health-care arena are sharing perspectives to piece together the quality picture. Although still preoccupied with the cost of health care, purchasers are concerned about value--efficiency, appropriateness, and effectiveness--as well as price. Faced with evidence of medically unnecessary procedures and unexamined medical theory, practitioners are searching for appropriateness guidelines, useful outcome measures, and methods to elicit informed patient preferences about elective surgeries. Underlying this search for reliable indicators of quality--now expanded to include patient satisfaction--is a new interest in the Japanese notion of "Kaizen" or continuous quality improvement. The end product of this ferment may determine whether good medicine drives out the bad--or vice versa.

Interdisciplinary Team Huddles for Fetal Heart Rate Tracing Review.

PubMed

Thompson, Lisa; Krening, Cynthia; Parrett, Dolores

2018-06-01

To address an increase in unexpected poor outcomes in term neonates, our team developed a goal of high reliability and improved fetal safety in the culture of the Labor and Delivery nursing department. We implemented interdisciplinary reviews of fetal heart rate, along with a Category II fetal heart rate management algorithm and a fetal heart rate assessment rapid response alert to call for unscheduled reviews when needed. Enhanced communication between nurses and other clinicians supported an interdisciplinary approach to fetal safety, and we observed an improvement in health outcomes for term neonates. We share our experience with the intention of making our methods available to any labor and delivery unit team committed to safe, high-quality care and service excellence. Copyright © 2018 AWHONN. Published by Elsevier Inc. All rights reserved.

The Taylor saddle effacement: a new technique for correction of saddle nose deformity.

PubMed

Taylor, S Mark; Rigby, Matthew H

2008-02-01

To describe a novel technique, the Taylor saddle effacement (TSE), for correction of saddle nose deformity using autologous grafts from the lower lateral cartilages. A prospective evaluation of six patients, all of whom had the TSE performed. Photographs were taken in combination with completion of a rhinoplasty outcomes questionnaire preoperatively and at 6 months. The questionnaire included a visual analogue scale (VAS) of nasal breathing and a rhinoplasty outcomes evaluation (ROE) of nasal function and esthetics. All six patients had improvement in both their global nasal airflow on the VAS and on their ROE that was statistically significant. The mean preoperative VAS score was 5.8 compared with our postoperative mean of 8.5 of a possible 10. Mean ROE scores improved from 34.7 to 85.5. At 6 months, all patients felt that their nasal appearance had improved. The TSE is a simple and reliable technique for correction of saddle nose deformity. This prospective study has demonstrated improvement in both nasal function and esthetics when it is employed.

A quality improvement initiative to reduce necrotizing enterocolitis across hospital systems.

PubMed

Nathan, Amy T; Ward, Laura; Schibler, Kurt; Moyer, Laurel; South, Andrew; Kaplan, Heather C

2018-04-20

Necrotizing enterocolitis (NEC) is a devastating intestinal disease in premature infants. Local rates of NEC were unacceptably high. We hypothesized that utilizing quality improvement methodology to standardize care and apply evidence-based practices would reduce our rate of NEC. A multidisciplinary team used the model for improvement to prioritize interventions. Three neonatal intensive care units (NICUs) developed a standardized feeding protocol for very low birth weight (VLBW) infants, and employed strategies to increase the use of human milk, maximize intestinal perfusion, and promote a healthy microbiome. The primary outcome measure, NEC in VLBW infants, decreased from 0.17 cases/100 VLBW patient days to 0.029, an 83% reduction, while the compliance with a standardized feeding protocol improved. Through reliable implementation of evidence-based practices, this project reduced the regional rate of NEC by 83%. A key outcome and primary driver of success was standardization across multiple NICUs, resulting in consistent application of best practices and reduction in variation.

Post-operative rotator cuff integrity, based on Sugaya's classification, can reflect abduction muscle strength of the shoulder.

PubMed

Yoshida, Masahito; Collin, Phillipe; Josseaume, Thierry; Lädermann, Alexandre; Goto, Hideyuki; Sugimoto, Katumasa; Otsuka, Takanobu

2018-01-01

Magnetic resonance (MR) imaging is common in structural and qualitative assessment of the rotator cuff post-operatively. Rotator cuff integrity has been thought to be associated with clinical outcome. The purpose of this study was to evaluate the inter-observer reliability of cuff integrity (Sugaya's classification) and assess the correlation between Sugaya's classification and the clinical outcome. It was hypothesized that Sugaya's classification would show good reliability and good correlation with the clinical outcome. Post-operative MR images were taken two years post-operatively, following arthroscopic rotator cuff repair. For assessment of inter-rater reliability, all radiographic evaluations for the supraspinatus muscle were done by two orthopaedic surgeons and one radiologist. Rotator cuff integrity was classified into five categories, according to Sugaya's classification. Fatty infiltration was graded into four categories, based on the Fuchs' classification grading system. Muscle hypotrophy was graded as four grades, according to the scale proposed by Warner. The clinical outcome was assessed according to the constant scoring system pre-operatively and 2 years post-operatively. Of the sixty-two consecutive patients with full-thickness rotator cuff tears, fifty-two patients were reviewed in this study. These subjects included twenty-three men and twenty-nine women, with an average age of fifty-seven years. In terms of the inter-rater reliability between orthopaedic surgeons, Sugaya's classification showed the highest agreement [ICC (2.1) = 0.82] for rotator cuff integrity. The grade of fatty infiltration and muscle atrophy demonstrated good agreement, respectively (0.722 and 0.758). With regard to the inter-rater reliability between orthopaedic surgeon and radiologist, Sugaya's classification showed good reliability [ICC (2.1) = 0.70]. On the other hand, fatty infiltration and muscle hypotrophy classifications demonstrated fair and moderate agreement [ICC (2.1) = 0.39 and 0.49]. Although no significant correlation was found between overall post-operative constant score and Sugaya's classification, Sugaya's classification indicated significant correlation with the muscle strength score. Sugaya's classification showed repeatability and good agreement between the orthopaedist and radiologist, who are involved in the patient care for the rotator cuff tear. Common classification of rotator cuff integrity with good reliability will give appropriate information for clinicians to improve the patient care of the rotator cuff tear. This classification also would be helpful to predict the strength of arm abduction in the scapular plane. IV.

Long-term Outcomes of Operative and Nonoperative Treatment of Congenital Coxa Vara.

PubMed

Roberts, David W; Saglam, Yavuz; De La Rocha, Adriana; Frasquillo, Brigid N; Tulchin-Francis, Kirsten; Kim, Harry K W

2018-04-01

Congenital coxa vara (CCV) is a rare hip condition with few long-term studies. The purpose of this study was to assess clinical, radiographic, and functional outcomes after operative and nonoperative treatment of CCV, assess reliability of radiographic parameters, and investigate risk factors for recurrence after surgery. Retrospective review was performed of all CCV patients treated at 1 institution from 1980 to 2010. In addition, patients were recalled for additional follow-up x-rays, modified Harris Hip Score (mHHS), and gait analysis. Radiographic measurements [neck-shaft angle (NSA), head-shaft angle (HSA), Hilgenreiner-epiphyseal angle (HEA), and femoral neck length (FNL)] were assessed for reliability using intraclass correlation coefficients. Multivariate analysis was performed to identify risk factors for recurrence after surgery. Forty-six hips in 32 patients were reviewed. Mean age at presentation was 5.4±4.9 years. Mean follow-up was 11.8±5.8 years. Valgus proximal femoral osteotomy was performed in 27 hips (20 patients). Initial deformity was greater in the operative group (NSA 90±17 degrees, HEA 68±19 degrees) versus nonoperative patients (NSA 122±19 degrees, HEA 34±14 degrees) (P<0.0001), but radiographic outcomes were similar at follow-up. Most nonoperative hips had normal FNL growth rates (80%), but resolution of varus NSA occurred in only 21%. In contrast, 56% of operative hips showed decreased FNL growth rates. Interobserver reliability was excellent for HEA (0.98), NSA (0.90), and FNL (0.89), and good for HSA (0.79). Repeat osteotomy was performed in 6 cases (22%). No significant predictors for recurrence were identified. At long-term follow-up for recalled patients, 72% had significantly abnormal gait, and 50% had fair-poor functional outcomes (mHHS<79). Valgus osteotomy corrects severe deformity in CCV with improved clinical and radiographic outcomes. HEA and NSA are the most reliable radiographic measurements of proximal femoral deformity in CCV. Recurrence is not uncommon, but no predictors were identified. Many patients have persistent gait abnormalities and functional impairment at long-term follow-up, regardless of prior treatment. Level III-retrospective cohort.

Current clinical research in orthodontics: a perspective.

PubMed

Baumrind, Sheldon

2006-10-01

This essay explores briefly the approach of the Craniofacial Research Instrumentation Laboratory to the systematic and rigorous investigation of the usual outcome of orthodontic treatment in the practices of experienced clinicians. CRIL's goal is to produce a shareable electronic database of reliable, valid, and representative data on clinical practice as an aid in the production of an improved environment for truly evidence-based orthodontic treatment.

Time-to-pregnancy and pregnancy outcomes in a South African population

PubMed Central

2010-01-01

Background Time-to-pregnancy (TTP) has never been studied in an African setting and there are no data on the rates of adverse pregnancy outcomes in South Africa. The study objectives were to measure TTP and the rates of adverse pregnancy outcomes in South Africa, and to determine the reliability of the questionnaire tool. Methods The study was cross-sectional and applied systematic stratified sampling to obtain a representative sample of reproductive age women for a South African population. Data on socio-demographic, work, health and reproductive variables were collected on 1121 women using a standardized questionnaire. A small number (n = 73) of randomly selected questionnaires was repeated to determine reliability of the questionnaire. Data was described using simple summary statistics while Kappa and intra-class correlation statistics were calculated for reliability. Results Of the 1121 women, 47 (4.2%) had never been pregnant. Mean gravidity was 2.3 while mean parity was 2.0 There were a total of 2467 pregnancies; most (87%) resulted in live births, 9.5% in spontaneous abortion and 2.2% in still births. The proportion of planned pregnancies was 39% and the median TTP was 6 months. The reliability of the questionnaire for TTP data was good; 63% for all participants and 97% when censored at 14 months. Overall reliability of reporting adverse pregnancy outcomes was very high, ranging from 90 - 98% for most outcomes. Conclusion This is the first comprehensive population-based reproductive health study in South Africa, to describe the biologic fertility of the population, and provides rates for planned pregnancies and adverse pregnancy outcomes. The reliability of the study questionnaire was substantial, with most outcomes within 70 - 100% reliability index. The study provides important public information for health practitioners and researchers in reproductive health. It also highlights the need for public health intervention programmes and epidemiological research on biologic fertility and adverse pregnancy outcomes in the population. PMID:20858279

Magnetic Resonance Imaging (MRI) of the Knee as an Outcome Measure in Juvenile Idiopathic Arthritis: An OMERACT Reliability Study on MRI Scales.

PubMed

Hemke, Robert; Tzaribachev, Nikolay; Nusman, Charlotte M; van Rossum, Marion A J; Maas, Mario; Doria, Andrea S

2017-08-01

There is increasing evidence that early therapeutic intervention improves longterm joint outcome in juvenile idiopathic arthritis (JIA). Given the existence of highly effective treatments, there is an urgent need for reliable and accurate measures of disease activity and joint damage in JIA. Our objective was to assess the reliability of 2 magnetic resonance imaging (MRI) scoring methods: the Juvenile Arthritis MRI Scoring (JAMRIS) system and the International Prophylaxis Study Group (IPSG) consensus score, for evaluating disease status of the knee in patients with JIA. Four international readers independently scored an MRI dataset of 25 JIA patients with clinical knee involvement. Synovial thickening, joint effusion, bone marrow changes, cartilage lesions, bone erosions, and subchondral cysts were scored using the JAMRIS and IPSG systems. Further, synovial enhancement, infrapatellar fat pad heterogeneity, tendinopathy, and enthesopathy were scored. Interreader reliability was analyzed by using the generalized κ, ICC, and the smallest detectable difference (SDD). ICC regarding interreader reliability ranged from 0.33 (95% CI 0.12-0.52, SDD = 0.29) for enthesopathy up to 0.95 (95% CI 0.92-0.97, SDD = 3.19) for synovial thickening. Good interreader reliability was found concerning joint effusion (ICC 0.93, 95% CI 0.89-0.95, SDD = 0.51), synovial enhancement (ICC 0.90, 95% CI 0.85-0.94, SDD = 9.85), and bone marrow changes (ICC 0.87, 95% CI 0.80-0.92, SDD = 10.94). Moderate to substantial reliability was found concerning cartilage lesions and bone erosions (ICC 0.55-0.72, SDD 1.41-13.65). The preliminary results are promising for most of the scored JAMRIS and IPSG items. However, further refinement of the scoring system is warranted for unsatisfactorily reliable items such as bone erosions, cartilage lesions, and enthesopathy.

Exemplar pediatric collaborative improvement networks: achieving results.

PubMed

Billett, Amy L; Colletti, Richard B; Mandel, Keith E; Miller, Marlene; Muething, Stephen E; Sharek, Paul J; Lannon, Carole M

2013-06-01

A number of pediatric collaborative improvement networks have demonstrated improved care and outcomes for children. Regionally, Cincinnati Children's Hospital Medical Center Physician Hospital Organization has sustained key asthma processes, substantially increased the percentage of their asthma population receiving "perfect care," and implemented an innovative pay-for-performance program with a large commercial payor based on asthma performance measures. The California Perinatal Quality Care Collaborative uses its outcomes database to improve care for infants in California NICUs. It has achieved reductions in central line-associated blood stream infections (CLABSI), increased breast-milk feeding rates at hospital discharge, and is now working to improve delivery room management. Solutions for Patient Safety (SPS) has achieved significant improvements in adverse drug events and surgical site infections across all 8 Ohio children's hospitals, with 7700 fewer children harmed and >$11.8 million in avoided costs. SPS is now expanding nationally, aiming to eliminate all events of serious harm at children's hospitals. National collaborative networks include ImproveCareNow, which aims to improve care and outcomes for children with inflammatory bowel disease. Reliable adherence to Model Care Guidelines has produced improved remission rates without using new medications and a significant increase in the proportion of Crohn disease patients not taking prednisone. Data-driven collaboratives of the Children's Hospital Association Quality Transformation Network initially focused on CLABSI in PICUs. By September 2011, they had prevented an estimated 2964 CLABSI, saving 355 lives and $103,722,423. Subsequent improvement efforts include CLABSI reductions in additional settings and populations.

The Premature Ejaculation Profile: validation of self-reported outcome measures for research and practice.

PubMed

Patrick, Donald L; Giuliano, François; Ho, Kai Fai; Gagnon, Dennis D; McNulty, Pauline; Rothman, Margaret

2009-02-01

To evaluate the reliability and validity of the Premature Ejaculation Profile (PEP), a self-reported outcome instrument for evaluating domains of PE and its treatment, comprised of four single-item measures, a profile, and an index score. Data were from men participating in observational studies in the USA (PE, 207 men; non-PE, 1380) and Europe (PE, 201; non-PE, 914) and from men with PE (1238) participating in a phase III randomized, placebo-controlled clinical trial of dapoxetine. The PEP contains four measures: perceived control over ejaculation, personal distress related to ejaculation, satisfaction with sexual intercourse, and interpersonal difficulty related to ejaculation, each assessed on five-point response scales. Test-retest reliability, known-groups validity, and ability to detect a patient-reported global impression of change (PGI) in condition were evaluated for the individual PEP measures and a PEP index score (the mean of all four measures). Profile analysis was conducted using multivariate analysis of variance. All PEP measures showed acceptable reliability (intraclass correlation coefficients ranged from 0.66 to 0.83) and mean scores for all measures differed significantly between PE and non-PE groups (P < 0.001). Men who reported a reduction in PE with treatment in the phase III trial had significantly greater scores on each of the four measures. The PEP profiles of men with and without PE differed significantly (P < 0.001) in both observational studies; higher levels of PGI were associated with higher PEP profiles (P < 0.001). The PEP index score also showed acceptable reliability and was significantly different between the PE and non-PE groups (P < 0.001). Men who reported an improvement in PE with treatment in the phase III trial had significantly greater PEP index scores. In the phase III trial, nausea was the most common adverse event with dapoxetine. The PEP provides a reliable, valid, and interpretable measure for use in monitoring outcomes of men with PE.

Reliability and minimal detectable change of physical performance measures in individuals with pre-manifest and manifest Huntington disease.

PubMed

Quinn, Lori; Khalil, Hanan; Dawes, Helen; Fritz, Nora E; Kegelmeyer, Deb; Kloos, Anne D; Gillard, Jonathan W; Busse, Monica

2013-07-01

Clinical intervention trials in people with Huntington disease (HD) have been limited by a lack of reliable and appropriate outcome measures. The purpose of this study was to determine the reliability and minimal detectable change (MDC) of various outcome measures that are potentially suitable for evaluating physical functioning in individuals with HD. This was a multicenter, prospective, observational study. Participants with pre-manifest and manifest HD (early, middle, and late stages) were recruited from 8 international sites to complete a battery of physical performance and functional measures at 2 assessments, separated by 1 week. Test-retest reliability (using intraclass correlation coefficients) and MDC values were calculated for all measures. Seventy-five individuals with HD (mean age=52.12 years, SD=11.82) participated in the study. Test-retest reliability was very high (>.90) for participants with manifest HD for the Six-Minute Walk Test (6MWT), 10-Meter Walk Test, Timed "Up & Go" Test (TUG), Berg Balance Scale (BBS), Physical Performance Test (PPT), Barthel Index, Rivermead Mobility Index, and Tinetti Mobility Test (TMT). Many MDC values suggested a relatively high degree of inherent variability, particularly in the middle stage of HD. Minimum detectable change values for participants with manifest HD that were relatively low across disease stages were found for the BBS (5), PPT (5), and TUG (2.98). For individuals with pre-manifest HD (n=11), the 6MWT and Four Square Step Test had high reliability and low MDC values. The sample size for the pre-manifest HD group was small. The BBS, PPT, and TUG appear most appropriate for clinical trials aimed at improving physical functioning in people with manifest HD. Further research in people with pre-manifest HD is necessary.

Reliability and concurrent and construct validity of the Strategies for Weight Management measure for adults.

PubMed

Kolodziejczyk, Julia K; Norman, Gregory J; Rock, Cheryl L; Arredondo, Elva M; Roesch, Scott C; Madanat, Hala; Patrick, Kevin

2016-01-01

This study evaluates the reliability and validity of the strategies for weight management (SWM) measure, a questionnaire that assesses weight management strategies for adults. The SWM includes 20 items that are categorized within the following subscales: (1) energy intake, (2) energy expenditure, (3) self-monitoring, and (4) self-regulation. Baseline and 6-month data were collected from 404 overweight/obese adults (mean age=22±3.8 years, 68% ethnic minority) enrolled in a randomized controlled trial aiming to reduce weight by improving diet and physical activity behaviours. Reliability and validity were assessed for each subscale separately. Cronbach alpha was conducted to assess reliability. Concurrent, construct I (sensitivity to the study treatment condition), and construct II (relationship to the outcomes) validity were assessed using linear regressions with the following outcome measures: weight, self-reported diet, and weekly energy expenditure. All subscales showed strong internal consistency. The strength of the validity evidence depended on subscale and validity type. The strongest validity evidence was concurrent validity of the energy intake and energy expenditure subscales; construct I validity of the energy intake and self-monitoring subscales; and construct II validity of the energy intake, energy expenditure, and self-regulation subscales. Results indicate that the SWM can be used to assess weight management strategies among an ethnically diverse sample of adults as each subscale showed evidence of reliability and select types of validity. As validity is an accumulation of evidence over multiple studies, this study provides initial reliability and validity evidence in one population segment. Copyright © 2015 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

The Cambridge Otology Quality of Life Questionnaire: an otology-specific patient-recorded outcome measure. A paper describing the instrument design and a report of preliminary reliability and validity.

PubMed

Martin, T P C; Moualed, D; Paul, A; Ronan, N; Tysome, J R; Donnelly, N P; Cook, R; Axon, P R

2015-04-01

The Cambridge Otology Quality of Life Questionnaire (COQOL) is a patient-recorded outcome measurement (PROM) designed to quantify the quality of life of patients attending otology clinics. Item-reduction model. A systematically designed long-form version (74 items) was tested with patient focus groups before being presented to adult otology patients (n. 137). Preliminary item analysis tested reliability, reducing the COQOL to 24 questions. This was then presented in conjunction with the SF-36 (V1) questionnaire to a total of 203 patients. Subsequently, these were re-presented at T + 3 months, and patients recorded whether they felt their condition had improved, deteriorated or remained the same. Non-responders were contacted by post. A correlation between COQOL scores and patient perception of change was examined to analyse content validity. Teaching hospital and university psychology department. Adult patients attending otology clinics with a wide range of otological conditions. Item reliability measured by item–total correlation, internal consistency and test– retest reliability. Validity measured by correlation between COQOL scores and patient-reported symptom change. Reliability: the COQOL showed excellent internal consistency at both initial presentation (a = 0.90) and 3 months later (a = 0.93). Validity: One-way analysis of variance showed a significant difference between groups reporting change and those reporting no change in quality of life (F(2, 80) = 5.866, P < 0.01). The COQOL is the first otology-specific PROM. Initial studies demonstrate excellent reliability and encouraging preliminary criterion validity: further studies will allow a deeper validation of the instrument.

Preventing alcohol and drug exposed births in Washington state: intervention findings from three parent-child assistance program sites.

PubMed

Grant, Therese M; Ernst, Cara C; Streissguth, Ann; Stark, Kenneth

2005-01-01

Home visitation interventions show promise for helping at-risk mothers, yet few programs have been developed and evaluated specifically for alcohol and drug-abusing pregnant women. This study examines outcomes among 216 women enrolled in the Washington State Parent-Child Assistance Program, a three-year intervention program for women who abuse alcohol and drugs during an index pregnancy. Pretest-posttest comparison was made across three sites: the original demonstration (1991-1995), and the Seattle and Tacoma replications (1996-2003). In the original demonstration, the client group performed significantly better than controls. Compared to the original demonstration, outcomes at replication sites were maintained (for regular use of contraception and use of reliable method; and number of subsequent deliveries), or improved (for alcohol/drug treatment completed; alcohol/ drug abstinence; subsequent delivery unexposed to alcohol/drugs). Improved outcomes at replication sites are not attributable to enrolling lower-risk women. Public policies and programs initiated over the study period may have had a positive effect on outcomes. Study findings suggest that this community-based intervention model is effective over time and across venues.

The clinical and occupational effectiveness of condition management for Incapacity Benefit recipients.

PubMed

Kellett, Stephen; Bickerstaffe, Darren; Purdie, Fiona; Dyke, Andrew; Filer, Sarah; Lomax, Victoria; Tomlinson, Hayley

2011-06-01

OBJECTIVES. The aim of the Condition Management Programme (CMP) is to help Incapacity Benefit recipients manage their health conditions more effectively and return to work. This paper seeks to examine the clinical and employment outcomes from a group-based and mixed-condition CMP. DESIGN. In a prospective cohort design, measures of employment status and psychological well-being were taken at three time points; pre-CMP, post-CMP, and at 3-month follow-up. METHOD. Participants (N= 2,064) with a variety of physical and mental health conditions voluntarily attended a seven session cognitive-behaviourally informed psychoeducational group intervention. The psychological measures used were the Clinical Outcomes in Routine Evaluation - Outcome Measure, Work and Social Adjustment Scale, Self-Efficacy Scale, and the Intrinsic Motivation Scale. The employment status of participants was also measured at the three time points of the evaluation. RESULTS. Following CMP, 50% of participants experienced a reliable improvement in psychological well-being and 26% had either taken some steps towards work or returned to work at follow-up. Participants with a mental health condition were more likely to experience a reliable improvement in psychological well-being compared to those with physical health conditions. CONCLUSIONS. The results suggest that participation in CMP may be helpful in facilitating more effective self-management of the health conditions contributing to unemployment. The results have implications for whether formal employment assistance should be available in mental health services. ©2010 The British Psychological Society.

Measuring the suffering of end-stage dementia: reliability and validity of the Mini-Suffering State Examination.

PubMed

Aminoff, Bechor Z; Purits, Elena; Noy, Shlomo; Adunsky, Abraham

2004-01-01

Assessment of suffering is extremely important in dying end-stage dementia patients (ESDP). We have developed and examined the reliability and validity of the Mini-Suffering State Examination (MSSE), in 103 consecutive bedridden ESDP. Main outcome measures included inter-observer reliability and concurrent validity. Reliability of the MSSE questionnaire was satisfactory, with Cronbach alpha values of 0.735 and 0.718 for the two physicians (Ph-1, Ph-2), respectively. The kappa agreement coefficient was 0.791. There was a high agreement for seven items (kappa 0.882-0.972) and a substantial agreement for the other three items (kappa 0.621-0.682) of the MSSE. MSSE was validated versus the comfort assessment in dying with dementia (CAD-EOLD) scale and resulted in a significant Pearson correlation (r=-0.796, P<0.001). We conclude that the MSSE scale is a reliable and valid clinical tool, recommended for evaluating the severity of the patient's condition and the level of suffering of ESDP. Use of MSSE may improve medical management and facilitate communication between patients and caregivers.

Minimising post-operative risk using a Post-Anaesthetic Care Tool (PACT): protocol for a prospective observational study and cost-effectiveness analysis.

PubMed

Street, Maryann; Phillips, Nicole M; Kent, Bridie; Colgan, Stephen; Mohebbi, Mohammadreza

2015-06-01

While the risk of adverse events following surgery has been identified, the impact of nursing care on early detection of these events is not well established. A systematic review of the evidence and an expert consensus study in post-anaesthetic care identified essential criteria for nursing assessment of patient readiness for discharge from the post-anaesthetic care unit (PACU). These criteria were included in a new nursing assessment tool, the Post-Anaesthetic Care Tool (PACT), and incorporated into the post-anaesthetic documentation at a large health service. The aim of this study is to test the clinical reliability of the PACT and evaluate whether the use of PACT will (1) enhance the recognition and response to patients at risk of deterioration in PACU; (2) improve documentation for handover from PACU nurse to ward nurse; (3) result in improved patient outcomes and (4) reduce healthcare costs. A prospective, non-randomised, pre-implementation and post-implementation design comparing: (1) patients (n=750) who have surgery prior to the implementation of the PACT and (2) patients (n=750) who have surgery after PACT. The study will examine the use of the tool through the observation of patient care and nursing handover. Patient outcomes and cost-effectiveness will be determined from health service data and medical record audit. Descriptive statistics will be used to describe the sample and compare the two patient groups (pre-intervention and post-intervention). Differences in patient outcomes between the two groups will be compared using the Cochran-Mantel-Haenszel test and regression analyses and reported as ORs with the corresponding 95% CIs. This study will test the clinical reliability and cost-effectiveness of the PACT. It is hypothesised that the PACT will enable nurses to recognise and respond to patients at risk of deterioration, improve handover to ward nurses, improve patient outcomes, and reduce healthcare costs. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Developing a national radiation oncology registry: From acorns to oaks.

PubMed

Palta, Jatinder R; Efstathiou, Jason A; Bekelman, Justin E; Mutic, Sasa; Bogardus, Carl R; McNutt, Todd R; Gabriel, Peter E; Lawton, Colleen A; Zietman, Anthony L; Rose, Christopher M

2012-01-01

The National Radiation Oncology Registry (NROR) is a collaborative initiative of the Radiation Oncology Institute and the American Society of Radiation Oncology, with input and guidance from other major stakeholders in oncology. The overarching mission of the NROR is to improve the care of cancer patients by capturing reliable information on treatment delivery and health outcomes. The NROR will collect patient-specific radiotherapy data electronically to allow for rapid comparison of the many competing treatment modalities and account for effectiveness, outcome, utilization, quality, safety, and cost. It will provide benchmark data and quality improvement tools for individual practitioners. The NROR steering committee has determined that prostate cancer provides an appropriate model to test the concept and the data capturing software in a limited number of sites. The NROR pilot project will begin with this disease-gathering treatment and outcomes data from a limited number of treatment sites across the range of practice; once feasibility is proven, it will scale up to more sites and diseases. When the NROR is fully implemented, all radiotherapy facilities, along with their radiation oncologists, will be solicited to participate in it. With the broader participation of the radiation oncology community, NROR has the potential to serve as a resource for determining national patterns of care, gaps in treatment quality, comparative effectiveness, and hypothesis generation to identify new linkages between therapeutic processes and outcomes. The NROR will benefit radiation oncologists and other care providers, payors, vendors, policy-makers, and, most importantly, cancer patients by capturing reliable information on population-based radiation treatment delivery. Copyright © 2012 (c) 2010 American Society for Radiation Oncology. Published by Elsevier Inc. All rights reserved. Published by Elsevier Inc. All rights reserved.

Reliability, Validity, and Responsiveness of InFLUenza Patient-Reported Outcome (FLU-PRO©) Scores in Influenza-Positive Patients.

PubMed

Powers, John H; Bacci, Elizabeth D; Guerrero, M Lourdes; Leidy, Nancy Kline; Stringer, Sonja; Kim, Katherine; Memoli, Matthew J; Han, Alison; Fairchok, Mary P; Chen, Wei-Ju; Arnold, John C; Danaher, Patrick J; Lalani, Tahaniyat; Ridoré, Michelande; Burgess, Timothy H; Millar, Eugene V; Hernández, Andrés; Rodríguez-Zulueta, Patricia; Smolskis, Mary C; Ortega-Gallegos, Hilda; Pett, Sarah; Fischer, William; Gillor, Daniel; Macias, Laura Moreno; DuVal, Anna; Rothman, Richard; Dugas, Andrea; Ruiz-Palacios, Guillermo M

2018-02-01

To assess the reliability, validity, and responsiveness of InFLUenza Patient-Reported Outcome (FLU-PRO©) scores for quantifying the presence and severity of influenza symptoms. An observational prospective cohort study of adults (≥18 years) with influenza-like illness in the United States, the United Kingdom, Mexico, and South America was conducted. Participants completed the 37-item draft FLU-PRO daily for up to 14 days. Item-level and factor analyses were used to remove items and determine factor structure. Reliability of the final tool was estimated using Cronbach α and intraclass correlation coefficients (2-day reliability). Convergent and known-groups validity and responsiveness were assessed using global assessments of influenza severity and return to usual health. Of the 536 patients enrolled, 221 influenza-positive subjects comprised the analytical sample. The mean age of the patients was 40.7 years, 60.2% were women, and 59.7% were white. The final 32-item measure has six factors/domains (nose, throat, eyes, chest/respiratory, gastrointestinal, and body/systemic), with a higher order factor representing symptom severity overall (comparative fit index = 0.92; root mean square error of approximation = 0.06). Cronbach α was high (total = 0.92; domain range = 0.71-0.87); test-retest reliability (intraclass correlation coefficient, day 1-day 2) was 0.83 for total scores and 0.57 to 0.79 for domains. Day 1 FLU-PRO domain and total scores were moderately to highly correlated (≥0.30) with Patient Global Rating of Flu Severity (except nose and throat). Consistent with known-groups validity, scores differentiated severity groups on the basis of global rating (total: F = 57.2, P < 0.001; domains: F = 8.9-67.5, P < 0.001). Subjects reporting return to usual health showed significantly greater (P < 0.05) FLU-PRO score improvement by day 7 than did those who did not, suggesting score responsiveness. Results suggest that FLU-PRO scores are reliable, valid, and responsive to change in influenza-positive adults. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Abbreviation of the Follow-Up NIH Stroke Scale Using Factor Analysis

PubMed Central

Raza, Syed Ali; Frankel, Michael R.; Rangaraju, Srikant

2017-01-01

Background The NIH Stroke Scale (NIHSS) is a 15-item measure of stroke-related neurologic deficits that, when measured at 24 h, is highly predictive of long-term functional outcome. We hypothesized that a simplified 24-h scale that incorporates the most predictive components of the NIHSS can retain prognostic accuracy and have improved interrater reliability. Methods In a post hoc analysis of the Interventional Management of Stroke-3 (IMS-3) trial, we performed principal component (PC) analysis to resolve the 24-h NIHSS into PCs. In the PCs that explained the largest proportions of variance, key variables were identified. Using these key variables, the prognostic accuracies (area under the curve [AUC]) for good outcome (3-month modified Rankin Scale [mRS] 0–2) and poor outcome (mRS 5–6) of various abbreviated NIHSS iterations were compared with the total 24-h NIHSS. The results were validated in the NINDS intravenous tissue plasminogen activator (NINDS-TPA) study cohort. Based on previously published data, interrater reliability of the abbreviated 24-h NIHSS (aNIHSS) was compared to the total 24-h NIHSS. Results In 545 IMS-3 participants, 2 PCs explained 60.8% of variance in the 24-h NIHSS. The key variables in PC1 included neglect, arm and leg weakness; while PC2 included level-of-consciousness (LOC) questions, LOC commands, and aphasia. A 3-variable aNIHSS (aphasia, neglect, arm weakness) retained excellent prognostic accuracy for good outcome (AUC = 0.90) as compared to the total 24-h NIHSS (AUC = 0.91), and it was more predictive (p < 0.001) than the baseline NIHSS (AUC = 0.73). The prognostic accuracy of the aNIHSS for good outcome was validated in the NINDS-TPA trial cohort (aNIHSS: AUC = 0.89 vs. total 24-h NIHSS: 0.92). An aNIHSS >9 predicted very poor outcomes (mRS 0–2: 0%, mRS 4–6: 98.5%). The estimated interrater reliability of the aNIHSS was higher than that of the total 24-h NIHSS across 6 published datasets (mean weighted kappa 0.80 vs. 0.73, p < 0.001). Conclusions At 24 h following ischemic stroke, aphasia, neglect, and arm weakness are the most prognostically relevant neurologic findings. The aNIHSS appears to have excellent prognostic accuracy with higher reliability and may be clinically useful. PMID:28968607

Assessing the treatment effects in apraxia of speech: introduction and evaluation of the Modified Diadochokinesis Test.

PubMed

Hurkmans, Joost; Jonkers, Roel; Boonstra, Anne M; Stewart, Roy E; Reinders-Messelink, Heleen A

2012-01-01

The number of reliable and valid instruments to measure the effects of therapy in apraxia of speech (AoS) is limited. To evaluate the newly developed Modified Diadochokinesis Test (MDT), which is a task to assess the effects of rate and rhythm therapies for AoS in a multiple baseline across behaviours design. The consistency, accuracy and fluency of speech of 24 adults with AoS and 12 unaffected speakers matched for age, gender and educational level were assessed using the MDT. The reliability and validity of the instrument were considered and outcomes compared with those obtained with existing tests. The results revealed that MDT had a strong internal consistency. Scores were influenced by syllable structure complexity, while distinctive features of articulation had no measurable effect. The test-retest and intra- and inter-rater reliabilities were shown to be adequate, and the discriminant validity was good. For convergent validity different outcomes were found: apart from one correlation, the scores on tests assessing functional communication and AoS correlated significantly with the MDT outcome measures. The spontaneous speech phonology measure of the Aachen Aphasia Test (AAT) correlated significantly with the MDT outcome measures, but no correlations were found for the repetition subtest and the spontaneous speech articulation/prosody measure of the AAT. The study shows that the MDT has adequate psychometric properties, implying that it can be used to measure changes in speech motor control during treatment for apraxia of speech. The results demonstrate the validity and utility of the instrument as a supplement to speech tasks in assessing speech improvement aimed at the level of planning and programming of speech. © 2012 Royal College of Speech and Language Therapists.

Development and validation of a survey to measure features of clinical networks.

PubMed

Brown, Bernadette Bea; Haines, Mary; Middleton, Sandy; Paul, Christine; D'Este, Catherine; Klineberg, Emily; Elliott, Elizabeth

2016-09-30

Networks of clinical experts are increasingly being implemented as a strategy to improve health care processes and outcomes and achieve change in the health system. Few are ever formally evaluated and, when this is done, not all networks are equally successful in their efforts. There is a need to formatively assess the strategic and operational management and leadership of networks to identify where functioning could be improved to maximise impact. This paper outlines the development and psychometric evaluation of an Internet survey to measure features of clinical networks and provides descriptive results from a sample of members of 19 diverse clinical networks responsible for evidence-based quality improvement across a large geographical region. Instrument development was based on: a review of published and grey literature; a qualitative study of clinical network members; a program logic framework; and consultation with stakeholders. The resulting domain structure was validated for a sample of 592 clinical network members using confirmatory factor analysis. Scale reliability was assessed using Cronbach's alpha. A summary score was calculated for each domain and aggregate level means and ranges are reported. The instrument was shown to have good construct validity across seven domains as demonstrated by a high level of internal consistency, and all Cronbach's α coefficients were equal to or above 0.75. In the survey sample of network members there was strong reported commitment and belief in network-led quality improvement initiatives, which were perceived to have improved quality of care (72.8 %) and patient outcomes (63.2 %). Network managers were perceived to be effective leaders and clinical co-chairs were perceived as champions for change. Perceived external support had the lowest summary score across the seven domains. This survey, which has good construct validity and internal reliability, provides a valid instrument to use in future research related to clinical networks. The survey will be of use to health service managers to identify strengths and areas where networks can be improved to increase effectiveness and impact on quality of care and patient outcomes. Equally, the survey could be adapted for use in the assessment of other types of networks.

Classification of comorbidity in trauma: the reliability of pre-injury ASA physical status classification.

PubMed

Ringdal, Kjetil G; Skaga, Nils Oddvar; Steen, Petter Andreas; Hestnes, Morten; Laake, Petter; Jones, J Mary; Lossius, Hans Morten

2013-01-01

Pre-injury comorbidities can influence the outcomes of severely injured patients. Pre-injury comorbidity status, graded according to the American Society of Anesthesiologists Physical Status (ASA-PS) classification system, is an independent predictor of survival in trauma patients and is recommended as a comorbidity score in the Utstein Trauma Template for Uniform Reporting of Data. Little is known about the reliability of pre-injury ASA-PS scores. The objective of this study was to examine whether the pre-injury ASA-PS system was a reliable scale for grading comorbidity in trauma patients. Nineteen Norwegian trauma registry coders were invited to participate in a reliability study in which 50 real but anonymised patient medical records were distributed. Reliability was analysed using quadratic weighted kappa (κ(w)) analysis with 95% CI as the primary outcome measure and unweighted kappa (κ) analysis, which included unknown values, as a secondary outcome measure. Fifteen of the invitees responded to the invitation, and ten participated. We found moderate (κ(w)=0.77 [95% CI: 0.64-0.87]) to substantial (κ(w)=0.95 [95% CI: 0.89-0.99]) rater-against-reference standard reliability using κ(w) and fair (κ=0.46 [95% CI: 0.29-0.64]) to substantial (κ=0.83 [95% CI: 0.68-0.94]) reliability using κ. The inter-rater reliability ranged from moderate (κ(w)=0.66 [95% CI: 0.45-0.81]) to substantial (κ(w)=0.96 [95% CI: 0.88-1.00]) for κ(w) and from slight (κ=0.36 [95% CI: 0.21-0.54]) to moderate (κ=0.75 [95% CI: 0.62-0.89]) for κ. The rater-against-reference standard reliability varied from moderate to substantial for the primary outcome measure and from fair to substantial for the secondary outcome measure. The study findings indicate that the pre-injury ASA-PS scale is a reliable score for classifying comorbidity in trauma patients. Copyright © 2012 Elsevier Ltd. All rights reserved.

Physical activity within a CBT intervention improves coping with pain in traumatized refugees: results of a randomized controlled design.

PubMed

Liedl, Alexandra; Müller, Julia; Morina, Naser; Karl, Anke; Denke, Claudia; Knaevelsrud, Christine

2011-02-01

Many traumatized refugees experience both posttraumatic stress disorder and chronic pain. Based on Mutual Maintenance Theory and the Perpetual Avoidance Model, this study examined the additional effect of physical activity within a biofeedback-based cognitive behavioral therapy (CBT-BF) for traumatized refugees. In a controlled design, 36 patients were randomized into one of three conditions (CBT-BF, CBT-BF with physical activity [CBT-BF+active], and a waiting list control group [WL]). Thirty patients (n=10 in each group) completed the treatment and a follow-up assessment 3 months later. Participants' coping strategies, pain and mental health status, and physiological reactivity were assessed before and after the intervention and at 3-month follow-up. Treatment effects were analyzed using analyses of variance with baseline scores as covariates (ANCOVAs) and the Reliable Change Index. The CBT-BF and CBT-BF+active groups showed improvements in all outcome measures relative to the WL group. The effect sizes for the main outcome measures were higher in the CBT-BF+active group than in the CBT-BF group. Repeated measures analyses of covariance showed significant group effects for coping strategies--in particular, for the "cognitive restructuring" and "counter-activities" subscales as well as a marginally significant group effect for "perceived self-competence"--with the CBT-BF+active group showing more favorable outcomes than the CBT-BF group. Moreover, 60% of participants in the CBT-BF+active group showed clinically reliable intraindividual change in at least one subscale of the pain coping strategies questionnaire, compared with just 30% of participants in the CBT-BF group. Findings of improved coping strategies, larger effect sizes, and higher rates of clinical improvement in the CBT-BF+active group suggest that physical activity adds value to pain management interventions for traumatized refugees. Given the small sample size, however, these preliminary results need replication in a larger trial. Wiley Periodicals, Inc.

Testing of the SEE and OEE post-hip fracture.

PubMed

Resnick, Barbara; Orwig, Denise; Zimmerman, Sheryl; Hawkes, William; Golden, Justine; Werner-Bronzert, Michelle; Magaziner, Jay

2006-08-01

The purpose of this study was to test the reliability and validity of the Self-Efficacy for Exercise (SEE) and the Outcome Expectations for Exercise (OEE) scales in a sample of 166 older women post-hip fracture. There was some evidence of validity of the SEE and OEE based on confirmatory factor analysis and Rasch model testing, criterion based and convergent validity, and evidence of internal consistency based on alpha coefficients and separation indices and reliability based on R2 estimates. Rasch model testing demonstrated that some items had high variability. Based on these findings suggestions are made for how items could be revised and the scales improved for future use.

New high-throughput measurement systems for radioactive wastes segregation and free release.

PubMed

Suran, J; Kovar, P; Smoldasova, J; Solc, J; Skala, L; Arnold, D; Jerome, S; de Felice, P; Pedersen, B; Bogucarska, T; Tzika, F; van Ammel, R

2017-12-01

This paper addresses the measurement facilities for pre-selection of waste materials prior to measurement for repository acceptance or possible free release (segregation measurement system); and free release (free release measurement system), based on a single standardized concept characterized by unique, patented lead-free shielding. The key objective is to improve the throughput, accuracy, reliability, modularity and mobility of segregation and free-release measurement. This will result in a more reliable decision-making with regard to the safe release and disposal of radioactive wastes into the environment and, resulting in positive economic outcomes. The research was carried out within "Metrology for Decommissioning Nuclear Facilities" (MetroDecom) project. Copyright © 2017 Elsevier Ltd. All rights reserved.

Exploring cued and non-cued motor imagery interventions in people with multiple sclerosis: a randomised feasibility trial and reliability study.

PubMed

Seebacher, Barbara; Kuisma, Raija; Glynn, Angela; Berger, Thomas

2018-01-01

Motor imagery (MI) is increasingly used in neurorehabilitation to facilitate motor performance. Our previous study results demonstrated significantly improved walking after rhythmic-cued MI in people with multiple sclerosis (pwMS). The present feasibility study was aimed to obtain preliminary information of changes in walking, fatigue, quality of life (QoL) and MI ability following cued and non-cued MI in pwMS. The study further investigated the feasibility of a larger study and examined the reliability of a two-dimensional gait analysis system. At the MS-Clinic, Department of Neurology, Medical University of Innsbruck, Austria, 15 adult pwMS (1.5-4.5 on the Expanded Disability Status Scale, 13 females) were randomised to one of three groups: 24 sessions of 17 min of MI with music and verbal cueing (MVMI), with music alone (MMI), or non-cued (MI). Descriptive statistics were reported for all outcomes. Primary outcomes were walking speed (Timed 25-Foot Walk) and walking distance (6-Minute Walk Test). Secondary outcomes were recruitment rate, retention, adherence, acceptability, adverse events, MI ability (Kinaesthetic and Visual Imagery Questionnaire, Time-Dependent MI test), fatigue (Modified Fatigue Impact Scale) and QoL (Multiple Sclerosis Impact Scale-29). The reliability of a gait analysis system used to assess gait synchronisation with music beat was tested. Participants showed adequate MI abilities. Post-intervention, improvements in walking speed, walking distance, fatigue, QoL and MI ability were observed in all groups. Success of the feasibility criteria was demonstrated by recruitment and retention rates of 8.6% (95% confidence interval, CI 5.2, 13.8%) and 100% (95% CI 76.4, 100%), which exceeded the target rates of 5.7% and 80%. Additionally, the 83% (95% CI 0.42, 0.99) adherence rate surpassed the 67% target rate. Intra-rater reliability analysis of the gait measurement instruments demonstrated excellent Intra-Class Correlation coefficients for step length of 0.978 (95% CI 0.973, 0.982) and step time of 0.880 (95% CI 0.855, 0.902). Results from our study suggest that cued and non-cued MI are valuable interventions in pwMS who were able to imagine movements. A larger study appears feasible, however, substantial improvements to the methods are required such as stratified randomisation using a computer-generated sequence and blinding of the assessors. ISRCTN ISRCTN92351899. Registered 10 December 2015.

Functional Capacity Evaluation Research: Report from the Second International Functional Capacity Evaluation Research Meeting.

PubMed

James, C L; Reneman, M F; Gross, D P

2016-03-01

Functional capacity evaluations are an important component of many occupational rehabilitation programs and can play a role in facilitating reintegration to work thus improving health and disability outcomes. The field of functional capacity evaluation (FCE) research has continued to develop over recent years, with growing evidence on the reliability, validity and clinical utility of FCE within different patient and healthy worker groups. The second International FCE Research Conference was held in Toronto, Canada on October 2nd 2014 adjacent to the 2014 Work Disability Prevention Integration conference. This paper describes the outcomes of the conference. Fifty-four participants from nine countries attended the conference where eleven research projects and three workshops were presented. The conference provided an opportunity to discuss FCE practice, present new research and provide a forum for discourse around the issues pertinent to FCE use. Conference presentations covered aspects of FCE use including the ICF-FCE interface, aspects of reliability and validity, consideration of specific injury populations, comparisons of FCE components and a lively debate on the merits of 'Man versus Machine' in FCE's. Researchers, clinicians, and other professionals in the FCE area have a common desire to improve the content and quality of FCE research and to collaborate to further develop research across systems, cultures and countries.

Quality Measures for the Care of Adult Patients with Obstructive Sleep Apnea

PubMed Central

Aurora, R. Nisha; Collop, Nancy A.; Jacobowitz, Ofer; Thomas, Sherene M.; Quan, Stuart F.; Aronsky, Amy J.

2015-01-01

Obstructive sleep apnea (OSA) is a prevalent disorder associated with a multitude of adverse outcomes when left untreated. There is significant heterogeneity in the evaluation and management of OSA resulting in variation in cost and outcomes. Thus, the goal for developing these measures was to have a way to evaluate the outcomes and reliability of the processes involved with the standard care approaches used in the diagnosis and management of OSA. The OSA quality care measures presented here focus on both outcomes and processes. The AASM commissioned the Adult OSA Quality Measures Workgroup to develop quality care measures aimed at optimizing care for adult patients with OSA. These quality care measures developed by the Adult OSA Quality Measures Workgroup are an extension of the original Centers for Medicare & Medicaid Services (CMS) approved Physician Quality Reporting System (PQRS) measures group for OSA. The measures are based on the available scientific evidence, focus on public safety, and strive to improve quality of life and cardiovascular outcomes for individual OSA patients. The three outcomes that were selected were as follows: (1) improve disease detection and categorization; (2) improve quality of life; and (3) reduce cardiovascular risk. After selecting these relevant outcomes, a total of ten process measures were chosen that could be applied and assessed for the purpose of accomplishing these outcomes. In the future, the measures described in this document may be reported through the PQRS in addition to, or as a replacement for, the current OSA measures group. The overall objective for the development of these measures is that implementation of these quality measures will result in improved patient outcomes, reduce the public health burden of OSA, and provide a measurable standard for evaluating and managing OSA. Citation: Aurora RN, Collop NA, Jacobowitz O, Thomas SM, Quan SF, Aronsky AJ. Quality measures for the care of adult patients with obstructive sleep apnea. J Clin Sleep Med 2015;11(3):357–383. PMID:25700878

Improving the simple, complicated and complex realities of community-acquired pneumonia.

PubMed

Liu, S K; Homa, K; Butterly, J R; Kirkland, K B; Batalden, P B

2009-04-01

This paper first describes efforts to improve the care for patients hospitalised with community-acquired pneumonia and the associated changes in quality measures at a rural academic medical centre. The results of the improvement interventions and the associated clinical realities, expected outcomes, measures, improvement interventions and improvement aims are then re-examined using the Glouberman and Zimmerman typology of healthcare problems--simple, complicated and complex. The typology is then used to explore the future design and assessment of improvement interventions, which may allow better matching with the types of problem healthcare providers and organisations are confronted with. Matching improvement interventions with problem category has the possibility of improving the success of improvement efforts and the reliability of care while at the same time preserving needed provider autonomy and judgement to adapt care for more complex problems.

CBT Specific Process in Exposure-Based Treatments: Initial Examination in a Pediatric OCD Sample

PubMed Central

Benito, Kristen Grabill; Conelea, Christine; Garcia, Abbe M.; Freeman, Jennifer B.

2012-01-01

Cognitive-Behavioral theory and empirical support suggest that optimal activation of fear is a critical component for successful exposure treatment. Using this theory, we developed coding methodology for measuring CBT-specific process during exposure. We piloted this methodology in a sample of young children (N = 18) who previously received CBT as part of a randomized controlled trial. Results supported the preliminary reliability and predictive validity of coding variables with 12 week and 3 month treatment outcome data, generally showing results consistent with CBT theory. However, given our limited and restricted sample, additional testing is warranted. Measurement of CBT-specific process using this methodology may have implications for understanding mechanism of change in exposure-based treatments and for improving dissemination efforts through identification of therapist behaviors associated with improved outcome. PMID:22523609

Defining lactation acuity to improve patient safety and outcomes.

PubMed

Mannel, Rebecca

2011-05-01

While substantial evidence exists identifying risks factors associated with premature weaning from breastfeeding, there are no previously published definitions of patient acuity in the lactation field. This article defines evidence-based levels of lactation acuity based on maternal and infant characteristics. Patient acuity, matching severity of illness to intensity of care required, is an important determinant of patient safety and outcomes. It is often used as part of a patient classification system to determine staffing needs and acceptable workloads in health care settings. As acuity increases, more resources, including more skilled clinicians, are needed to provide optimal care. Developing an evidence-based definition of lactation acuity can help to standardize terminology, more effectively distribute health care staff resources, encourage research to verify the validity and reliability of lactation acuity, and potentially improve breastfeeding initiation and duration rates.

Modifying the Clinical Outcomes in Routine Evaluation Measure for Use with People Who Have a Learning Disability

ERIC Educational Resources Information Center

Marshall, Keith; Willoughby-Booth, Simon

2007-01-01

There are few reliable self-report measures suitable for people with a learning disability in reporting psychological distress. This study examines the modification of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM), exploring its reliability, using two different presentation styles. One style included a sequencing task then…

Patient-centered technological assessment and monitoring of depression for low-income patients.

PubMed

Wu, Shinyi; Vidyanti, Irene; Liu, Pai; Hawkins, Caitlin; Ramirez, Magaly; Guterman, Jeffrey; Gross-Schulman, Sandra; Sklaroff, Laura Myerchin; Ell, Kathleen

2014-01-01

Depression is a significant challenge for ambulatory care because it worsens health status and outcomes, increases health care utilizations and costs, and elevates suicide risk. An automatic telephonic assessment (ATA) system that links with tasks and alerts to providers may improve quality of depression care and increase provider productivity. We used ATA system in a trial to assess and monitor depressive symptoms of 444 safety-net primary care patients with diabetes. We assessed system properties, evaluated preliminary clinical outcomes, and estimated cost savings. The ATA system is feasible, reliable, valid, safe, and likely cost-effective for depression screening and monitoring for low-income primary care population.

The Association Between Sensemaking During Physician Team Rounds and Hospitalized Patients' Outcomes.

PubMed

Leykum, Luci K; Chesser, Hannah; Lanham, Holly J; Carla, Pezzia; Palmer, Ray; Ratcliffe, Temple; Reisinger, Heather; Agar, Michael; Pugh, Jacqueline

2015-12-01

Sensemaking is the social act of assigning meaning to ambiguous events. It is recognized as a means to achieve high reliability. We sought to assess sensemaking in daily patient care through examining how inpatient teams round and discuss patients. Our purpose was to assess the association between inpatient physician team sensemaking and hospitalized patients' outcomes, including length of stay (LOS), unnecessary length of stay (ULOS), and complication rates. Eleven inpatient medicine teams' daily rounds were observed for 2 to 4 weeks. Rounds were audiotaped, and field notes taken. Four patient discussions per team were assessed using a standardized Situation, Task, Intent, Concern, Calibrate (STICC) framework. Inpatient physician teams at the teaching hospitals affiliated with the University of Texas Health Science Center at San Antonio participated in the study. Outcomes of patients admitted to the teams were included. Sensemaking was assessed based on the order in which patients were seen, purposeful rounding, patient-driven rounding, and individual patient discussions. We assigned teams a score based on the number of STICC elements used in the four patient discussions sampled. The association between sensemaking and outcomes was assessed using Kruskal-Wallis sum rank and Dunn's tests. Teams rounded in several different ways. Five teams rounded purposefully, and four based rounds on patient-driven needs. Purposeful and patient-driven rounds were significantly associated with lower complication rates. Varying the order in which patients were seen and purposefully rounding were significantly associated with lower LOS, and purposeful and patient-driven rounds associated with lower ULOS. Use of a greater number of STICC elements was associated with significantly lower LOS (4.6 vs. 5.7, p = 0.01), ULOS (0.3 vs. 0.6, p = 0.02), and complications (0.2 vs. 0.5, p = 0.0001). Improving sensemaking may be a strategy for improving patient outcomes, fostering a shared understanding of a patient's clinical trajectory, and enabling high reliability.

My Therapist is a Student? The Impact of Therapist Experience and Client Severity on Cognitive Behavioural Therapy Outcomes for People with Anxiety Disorders.

PubMed

Mason, Liam; Grey, Nick; Veale, David

2016-03-01

Allocation of trainee therapist cases is often performed based on intuition and clinical circumstances, with lack of empirical evidence on the role of severity of presenting problem. This has the potential to be anxiety-provoking for supervisors, trainees and service users themselves. To determine how therapist experience interacts with symptom severity in predicting client outcomes. An intention-to-treat analysis of annual outcome data for primary and secondary care clients seen by a specialist anxiety disorders service. 196 clients were stratified into mild, moderate and baseline severe symptoms of anxiety (GAD-7) and depression (PHQ-9). We measured percentage change on these measures, as well as number of sessions and therapy dropout. We also examined rates of reliable and clinically significant change on disorder-specific measures. We hypothesized that qualified therapists would achieve better outcomes than trainees, particularly for severe presentations. Overall, outcomes were comparable between trainee and qualified therapists on all measures, and trainees additionally utilized fewer therapy sessions. There was however an interaction between anxiety severity (GAD-7) and therapist group, such that severely anxious clients achieved greater symptom improvement with qualified as compared to trainee therapists. Further, for trainee but not qualified therapists, baseline anxiety was negatively associated with rate of reliable and clinically significant change on disorder-specific measures. These findings indicate generally favourable outcomes for trainee therapists delivering manualized treatments for anxiety disorders. They additionally suggest that trainee therapists may benefit from additional support when working with clients that present with severe anxiety.

Development of the outcome expectancy scale for self-care among periodontal disease patients.

PubMed

Kakudate, Naoki; Morita, Manabu; Fukuhara, Shunichi; Sugai, Makoto; Nagayama, Masato; Isogai, Emiko; Kawanami, Masamitsu; Chiba, Itsuo

2011-12-01

The theory of self-efficacy states that specific efficacy expectations affect behaviour. Two types of efficacy expectations are described within the theory. Self-efficacy expectations are the beliefs in the capacity to perform a specific behaviour. Outcome expectations are the beliefs that carrying out a specific behaviour will lead to a desired outcome. To develop and examine the reliability and validity of an outcome expectancy scale for self-care (OESS) among periodontal disease patients. A 34-item scale was tested on 101 patients at a dental clinic. Accuracy was improved by item analysis, and internal consistency and test-retest stability were investigated. Concurrent validity was tested by examining associations of the OESS score with the self-efficacy scale for self-care (SESS) score and plaque index score. Construct validity was examined by comparing OESS scores between periodontal patients at initial visit (group 1) and those continuing maintenance care (group 2). Item analysis identified 13 items for the OESS. Factor analysis extracted three factors: social-, oral- and self-evaluative outcome expectancy. Cronbach's alpha coefficient for the OESS was 0.90. A significant association was observed between test and retest scores, and between the OESS and SESS and plaque index scores. Further, group 2 had a significantly higher mean OESS score than group 1. We developed a 13-item OESS with high reliability and validity which may be used to assess outcome expectancy for self-care. A patient's psychological condition with regard to behaviour and affective status can be accurately evaluated using the OESS with SESS. © 2011 Blackwell Publishing Ltd.

Improving Emergency Department Door to Doctor Time and Process Reliability

PubMed Central

El Sayed, Mazen J.; El-Eid, Ghada R.; Saliba, Miriam; Jabbour, Rima; Hitti, Eveline A.

2015-01-01

Abstract The aim of this study is to determine the effectiveness of using lean management methods on improving emergency department door to doctor times at a tertiary care hospital. We performed a before and after study at an academic urban emergency department with 49,000 annual visits after implementing a series of lean driven interventions over a 20 month period. The primary outcome was mean door to doctor time and the secondary outcome was length of stay of both admitted and discharged patients. A convenience sample from the preintervention phase (February 2012) was compared to another from the postintervention phase (mid-October to mid-November 2013). Individual control charts were used to assess process stability. Postintervention there was a statistically significant decrease in the mean door to doctor time measure (40.0 minutes ± 53.44 vs 25.3 minutes ± 15.93 P < 0.001). The postintervention process was more statistically in control with a drop in the upper control limits from 148.8 to 72.9 minutes. Length of stay of both admitted and discharged patients dropped from 2.6 to 2.0 hours and 9.0 to 5.5 hours, respectively. All other variables including emergency department visit daily volumes, hospital occupancy, and left without being seen rates were comparable. Using lean change management techniques can be effective in reducing door to doctor time in the Emergency Department and improving process reliability. PMID:26496278

AHRQ's hospital survey on patient safety culture: psychometric analyses.

PubMed

Blegen, Mary A; Gearhart, Susan; O'Brien, Roxanne; Sehgal, Niraj L; Alldredge, Brian K

2009-09-01

This project analyzed the psychometric properties of the Agency for Healthcare Research and Quality Hospital Survey on Patient Safety Culture (HSOPSC) including factor structure, interitem reliability and intraclass correlations, usefulness for assessment, predictive validity, and sensitivity. The survey was administered to 454 health care staff in 3 hospitals before and after a series of multidisciplinary interventions designed to improve safety culture. Respondents (before, 434; after, 368) included nurses, physicians, pharmacists, and other hospital staff members. Factor analysis partially confirmed the validity of the HSOPSC subscales. Interitem consistency reliability was above 0.7 for 5 subscales; the staffing subscale had the lowest reliability coefficients. The intraclass correlation coefficients, agreement among the members of each unit, were within recommended ranges. The pattern of high and low scores across the subscales of the HSOPSC in the study hospitals were similar to the sample of Pacific region hospitals reported by the Agency for Healthcare Research and Quality and corresponded to the proportion of items in each subscale that are worded negatively (reverse scored). Most of the unit and hospital dimensions were correlated with the Safety Grade outcome measure in the tool. Overall, the tool was shown to have moderate-to-strong validity and reliability, with the exception of the staffing subscale. The usefulness in assessing areas of strength and weakness for hospitals or units among the culture subscales is questionable. The culture subscales were shown to correlate with the perceived outcomes, but further study is needed to determine true predictive validity.

The comparative effectiveness and efficiency of cognitive behaviour therapy and generic counselling in the treatment of depression: evidence from the 2nd UK National Audit of psychological therapies.

PubMed

Pybis, Jo; Saxon, David; Hill, Andy; Barkham, Michael

2017-06-09

Cognitive Behaviour Therapy (CBT) is the front-line psychological intervention for step 3 within UK psychological therapy services. Counselling is recommended only when other interventions have failed and its effectiveness has been questioned. A secondary data analysis was conducted of data collected from 33,243 patients across 103 Improving Access to Psychological Therapies (IAPT) services as part of the second round of the National Audit of Psychological Therapies (NAPT). Initial analysis considered levels of pre-post therapy effect sizes (ESs) and reliable improvement (RI) and reliable and clinically significant improvement (RCSI). Multilevel modelling was used to model predictors of outcome, namely patient pre-post change on PHQ-9 scores at last therapy session. Counselling received more referrals from patients experiencing moderate to severe depression than CBT. For patients scoring above the clinical cut-off on the PHQ-9 at intake, the pre-post ES (95% CI) for CBT was 1.59 (1.58, 1.62) with 46.6% making RCSI criteria and for counselling the pre-post ES was 1.55 (1.52, 1.59) with 44.3% of patients meeting RCSI criteria. Multilevel modelling revealed a significant site effect of 1.8%, while therapy type was not a predictor of outcome. A significant interaction was found between the number of sessions attended and therapy type, with patients attending fewer sessions on average for counselling [M = 7.5 (5.54) sessions and a median (IQR) of 6 (3-10)] than CBT [M = 8.9 (6.34) sessions and a median (IQR) of 7 (4-12)]. Only where patients had 18 or 20 sessions was CBT significantly more effective than counselling, with recovery rates (95% CIs) of 62.2% (57.1, 66.9) and 62.4% (56.5, 68.0) respectively, compared with 44.4% (32.7, 56.6) and 42.6% (30.0, 55.9) for counselling. Counselling was significantly more effective at two sessions with a recovery rate of 34.9% (31.9, 37.9) compared with 22.2% (20.5, 24.0) for CBT. Outcomes for counselling and CBT in the treatment of depression were comparable. Research efforts should focus on factors other than therapy type that may influence outcomes, namely the inherent variability between services, and adopt multilevel modelling as the given analytic approach in order to capture the naturally nested nature of the implementation and delivery of psychological therapies. It is of concern that half of all patients, regardless of type of intervention, did not show reliable improvement.

Evaluation of interventions for informed consent for randomised controlled trials (ELICIT): protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Gillies, Katie; Entwistle, Vikki; Treweek, Shaun P; Fraser, Cynthia; Williamson, Paula R; Campbell, Marion K

2015-10-27

The process of obtaining informed consent for participation in randomised controlled trials (RCTs) was established as a mechanism to protect participants against undue harm from research and allow people to recognise any potential risks or benefits associated with the research. A number of interventions have been put forward to improve this process. Outcomes reported in trials of interventions to improve the informed consent process for decisions about trial participation tend to focus on the 'understanding' of trial information. However, the operationalization of understanding as a concept, the tools used to measure it and the timing of the measurements are heterogeneous. A lack of clarity exists regarding which outcomes matter (to whom) and why. This inconsistency between studies results in difficulties when making comparisons across studies as evidenced in two recent systematic reviews of informed consent interventions. As such, no optimal method for measuring the impact of these interventions aimed at improving informed consent for RCTs has been identified. The project will adopt and adapt methodology previously developed and used in projects developing core outcome sets for assessment of clinical treatments. Specifically, the work will consist of three stages: 1) A systematic methodology review of existing outcome measures of trial informed consent interventions; 2) Interviews with key stakeholders to explore additional outcomes relevant for trial participation decisions; and 3) A Delphi study to refine the core outcome set for evaluation of trial informed consent interventions. All stages will include the stakeholders involved in the various aspects of RCT consent: users (that is, patients), developers (that is, trialists), deliverers (focusing on research nurses) and authorisers (that is, ethics committees). A final consensus meeting including all stakeholders will be held to review outcomes. The ELICIT study aims to develop a core outcome set for the evaluation of interventions intended to improve informed consent for RCTs for use in future RCTs and reviews, thereby improving the reliability and consistency of research in this area.

Improving Metabolic Health Through Precision Dietetics in Mice

PubMed Central

Barrington, William T.; Wulfridge, Phillip; Wells, Ann E.; Rojas, Carolina Mantilla; Howe, Selene Y. F.; Perry, Amie; Hua, Kunjie; Pellizzon, Michael A.; Hansen, Kasper D.; Voy, Brynn H.; Bennett, Brian J.; Pomp, Daniel; Feinberg, Andrew P.; Threadgill, David W.

2018-01-01

The incidence of diet-induced metabolic disease has soared over the last half-century, despite national efforts to improve health through universal dietary recommendations. Studies comparing dietary patterns of populations with health outcomes have historically provided the basis for healthy diet recommendations. However, evidence that population-level diet responses are reliable indicators of responses across individuals is lacking. This study investigated how genetic differences influence health responses to several popular diets in mice, which are similar to humans in genetic composition and the propensity to develop metabolic disease, but enable precise genetic and environmental control. We designed four human-comparable mouse diets that are representative of those eaten by historical human populations. Across four genetically distinct inbred mouse strains, we compared the American diet’s impact on metabolic health to three alternative diets (Mediterranean, Japanese, and Maasai/ketogenic). Furthermore, we investigated metabolomic and epigenetic alterations associated with diet response. Health effects of the diets were highly dependent on genetic background, demonstrating that individualized diet strategies improve health outcomes in mice. If similar genetic-dependent diet responses exist in humans, then a personalized, or “precision dietetics,” approach to dietary recommendations may yield better health outcomes than the traditional one-size-fits-all approach. PMID:29158425

Weight Suppression But Not Symptom Improvement Predicts Weight Gain During Inpatient Treatment for Bulimia Nervosa.

PubMed

Hessler, Johannes Baltasar; Diedrich, Alice; Greetfeld, Martin; Schlegl, Sandra; Schwartz, Caroline; Voderholzer, Ulrich

2018-03-01

Fear of gaining weight is a common obstacle to seeking treatment for bulimia nervosa (BN). We investigated changes in body mass index (BMI) during inpatient treatment for BN in relation to treatment outcome and weight suppression (WS). Female inpatients of a specialized eating disorders clinic were grouped as deteriorated/unchanged, reliably improved, and clinically significantly improved based on Eating Disorder Inventory-2 scores. Repeated measures ANOVA was employed to examine changes in BMI between admission and discharge depending on treatment outcome and WS. One-hundred seventy-nine patients were included. Overall, the average BMI significantly increased by 0.54 kg/m 2 (SD = 1.24). Repeated measures ANOVA revealed no association of change in BMI with treatment outcome [F(df) = 1.13 (2166), p = 0.327] but with WS [F(df) = 2.76 (3166), p < 0.044]. Bulimia nervosa can be successfully treated without causing excessive weight gain. Patients with higher WS might expect somewhat more weight gain. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association. Copyright © 2017 John Wiley & Sons, Ltd and Eating Disorders Association.

Pathobiologic Markers of the Ewing Sarcoma Family of Tumors: State of the Art and Prediction of Behaviour

PubMed Central

Pinto, Alfredo; Dickman, Paul; Parham, David

2011-01-01

Over the past three decades, the outcome of Ewing sarcoma family tumor (ESFT) patients who are nonmetastatic at presentation has improved considerably. The prognosis of patients with metastatic disease at the time of diagnosis and recurrence after therapy remains dismal. Drug-resistant disease at diagnosis or at relapse remains a major cause of mortality among patients diagnosed with ESFT. In order to improve the outcome for patients with potential relapse, there is an urgent need to find reliable markers that either predict tumor behaviour at diagnosis or identify therapeutic molecular targets at the time of recurrence. An improved understanding of the cell of origin and the molecular pathways that regulate tumorigenicity in ESFT should aid us in the search for novel therapies for ESFT. The purpose of this paper is thus to outline current concepts of sarcomagenesis in ESFT and to discuss ESFT patterns of differentiation and molecular markers that might affect prognosis or direct future therapeutic development. PMID:20981347

Issues in the economic evaluation of influenza vaccination by injection of healthy working adults in the US: a review and decision analysis of ten published studies.

PubMed

Hogan, Thomas J

2012-05-01

The objective was to review recent economic evaluations of influenza vaccination by injection in the US, assess their evidence, and conclude on their collective findings. The literature was searched for economic evaluations of influenza vaccination injection in healthy working adults in the US published since 1995. Ten evaluations described in nine papers were identified. These were synopsized and their results evaluated, the basic structure of all evaluations was ascertained, and sensitivity of outcomes to changes in parameter values were explored using a decision model. Areas to improve economic evaluations were noted. Eight of nine evaluations with credible economic outcomes were favourable to vaccination, representing a statistically significant result compared with a proportion of 50% that would be expected if vaccination and no vaccination were economically equivalent. Evaluations shared a basic structure, but differed considerably with respect to cost components, assumptions, methods, and parameter estimates. Sensitivity analysis indicated that changes in parameter values within the feasible range, individually or simultaneously, could reverse economic outcomes. Given stated misgivings, the methods of estimating influenza reduction ascribed to vaccination must be researched to confirm that they produce accurate and reliable estimates. Research is also needed to improve estimates of the costs per case of influenza illness and the costs of vaccination. Based on their assumptions, the reviewed papers collectively appear to support the economic benefits of influenza vaccination of healthy adults. Yet the underlying assumptions, methods and parameter estimates themselves warrant further research to confirm they are accurate, reliable and appropriate to economic evaluation purposes.

Spinal Cord Injury Clinical Registries: Improving Care across the SCI Care Continuum by Identifying Knowledge Gaps.

PubMed

Dvorak, Marcel F; Cheng, Christiana L; Fallah, Nader; Santos, Argelio; Atkins, Derek; Humphreys, Suzanne; Rivers, Carly S; White, Barry A B; Ho, Chester; Ahn, Henry; Kwon, Brian K; Christie, Sean; Noonan, Vanessa K

2017-10-15

Timely access and ongoing delivery of care and therapeutic interventions is needed to maximize recovery and function after traumatic spinal cord injury (tSCI). To ensure these decisions are evidence-based, access to consistent, reliable, and valid sources of clinical data is required. The Access to Care and Timing Model used data from the Rick Hansen SCI Registry (RHSCIR) to generate a simulation of healthcare delivery for persons after tSCI and to test scenarios aimed at improving outcomes and reducing the economic burden of SCI. Through model development, we identified knowledge gaps and challenges in the literature and current health outcomes data collection throughout the continuum of SCI care. The objectives of this article were to describe these gaps and to provide recommendations for bridging them. Accurate information on injury severity after tSCI was hindered by difficulties in conducting neurological assessments and classifications of SCI (e.g., timing), variations in reporting, and the lack of a validated SCI-specific measure of associated injuries. There was also limited availability of reliable data on patient factors such as multi-morbidity and patient-reported measures. Knowledge gaps related to structures (e.g., protocols) and processes (e.g., costs) at each phase of care have prevented comprehensive evaluation of system performance. Addressing these knowledge gaps will enhance comparative and cost-effectiveness evaluations to inform decision-making and standards of care. Recommendations to do so were: standardize data element collection and facilitate database linkages, validate and adopt more outcome measures for SCI, and increase opportunities for collaborations with stakeholders from diverse backgrounds.

The SPADE Symptom Cluster in Primary Care Patients With Chronic Pain.

PubMed

Davis, Lorie L; Kroenke, Kurt; Monahan, Patrick; Kean, Jacob; Stump, Timothy E

2016-05-01

Sleep disturbance, pain, anxiety, depression, and low energy/fatigue, the SPADE pentad, are the most prevalent and co-occurring symptoms in the general population and clinical practice. Co-occurrence of SPADE symptoms may produce additive impairment and negatively affect treatment response, potentially undermining patients' health and functioning. The purpose of this paper is to determine: (1) prevalence and comorbidity (ie, clustering) of SPADE symptoms; (2) internal reliability and construct validity of a composite SPADE symptom score derived from the Patient-Reported Outcomes Measurement Information System (PROMIS) measures; and (3) whether improvement in somatic symptom burden represented by a composite score predicted subsequent measures of functional status at 3 and 12 months follow-up. Secondary analysis of data from the Stepped Care to Optimize Pain care Effectiveness study, a randomized trial of a collaborative care intervention for Veterans with chronic pain. Most patients had multiple SPADE symptoms; only 9.6% of patients were monosymptomatic. The composite PROMIS symptom score had good internal reliability (Cronbach's alpha=0.86) and construct validity and strongly correlated with multiple measures of functional status; improvement in the composite score significantly correlated with higher scores for 5 of 6 functional status outcomes. The standardized error of measurement (SEM) for the composite T-score was 2.84, suggesting a 3-point difference in an individual's composite score may be clinically meaningful. Brief PROMIS measures may be useful in evaluating SPADE symptoms and overall symptom burden. Because symptom burden may predict functional status outcomes, better identification and management of comorbid symptoms may be warranted.

Spinal Cord Injury Clinical Registries: Improving Care across the SCI Care Continuum by Identifying Knowledge Gaps

PubMed Central

Cheng, Christiana L.; Fallah, Nader; Santos, Argelio; Atkins, Derek; Humphreys, Suzanne; Rivers, Carly S.; White, Barry A.B.; Ho, Chester; Ahn, Henry; Kwon, Brian K.; Christie, Sean; Noonan, Vanessa K.

2017-01-01

Abstract Timely access and ongoing delivery of care and therapeutic interventions is needed to maximize recovery and function after traumatic spinal cord injury (tSCI). To ensure these decisions are evidence-based, access to consistent, reliable, and valid sources of clinical data is required. The Access to Care and Timing Model used data from the Rick Hansen SCI Registry (RHSCIR) to generate a simulation of healthcare delivery for persons after tSCI and to test scenarios aimed at improving outcomes and reducing the economic burden of SCI. Through model development, we identified knowledge gaps and challenges in the literature and current health outcomes data collection throughout the continuum of SCI care. The objectives of this article were to describe these gaps and to provide recommendations for bridging them. Accurate information on injury severity after tSCI was hindered by difficulties in conducting neurological assessments and classifications of SCI (e.g., timing), variations in reporting, and the lack of a validated SCI-specific measure of associated injuries. There was also limited availability of reliable data on patient factors such as multi-morbidity and patient-reported measures. Knowledge gaps related to structures (e.g., protocols) and processes (e.g., costs) at each phase of care have prevented comprehensive evaluation of system performance. Addressing these knowledge gaps will enhance comparative and cost-effectiveness evaluations to inform decision-making and standards of care. Recommendations to do so were: standardize data element collection and facilitate database linkages, validate and adopt more outcome measures for SCI, and increase opportunities for collaborations with stakeholders from diverse backgrounds. PMID:28745934

Accessing evidence to inform public health policy: a study to enhance advocacy.

PubMed

Tabak, R G; Eyler, A A; Dodson, E A; Brownson, R C

2015-06-01

Improving population health often involves policy changes that are the result of complex advocacy efforts. Information exchanges among researchers, advocates, and policymakers is paramount to policy interventions to improve health outcomes. This information may include evidence on what works well for whom and cost-effective strategies to improve outcomes of interest. However, this information is not always readily available or easily communicated. The purposes of this paper are to describe ways advocates seek information for health policy advocacy and to compare advocate demographics. Cross-sectional telephone survey. Seventy-seven state-level advocates were asked about the desirable characteristics of policy-relevant information including methods of obtaining information, what makes it useful, and what sources make evidence most reliable/trustworthy. Responses were explored for the full sample and variety of subsamples (i.e. gender, age, and position on social and fiscal issues). Differences between groups were tested using t-tests and one-way analysis of variance. On average, advocates rated frequency of seeking research information as 4.3 out of five. Overall, advocates rated the Internet as the top source, rated unbiased research and research with relevancy to their organization as the most important characteristics, and considered information from their organization as most reliable/believable. When ratings were examined by subgroup, the two characteristics most important for each question in the total sample (listed above) emerged as most important for nearly all subgroups. Advocates are a resource to policymakers on health topics in the policy process. This study, among the first of its kind, found that advocates seek research information, but have a need for evidence that is unbiased and relevant to their organizations and report that university-based information is reliable. Researchers and advocates should partner so research is useful in advocating for evidence-based policy change. Copyright © 2015 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

Revised scoring and improved reliability for the Communication Patterns Questionnaire.

PubMed

Crenshaw, Alexander O; Christensen, Andrew; Baucom, Donald H; Epstein, Norman B; Baucom, Brian R W

2017-07-01

The Communication Patterns Questionnaire (CPQ; Christensen, 1987) is a widely used self-report measure of couple communication behavior and is well validated for assessing the demand/withdraw interaction pattern, which is a robust predictor of poor relationship and individual outcomes (Schrodt, Witt, & Shimkowski, 2014). However, no studies have examined the CPQ's factor structure using analytic techniques sufficient by modern standards, nor have any studies replicated the factor structure using additional samples. Further, the current scoring system uses fewer than half of the total items for its 4 subscales, despite the existence of unused items that have content conceptually consistent with those subscales. These characteristics of the CPQ have likely contributed to findings that subscale scores are often troubled by suboptimal psychometric properties such as low internal reliability (e.g., Christensen, Eldridge, Catta-Preta, Lim, & Santagata, 2006). The present study uses exploratory and confirmatory factor analyses on 4 samples to reexamine the factor structure of the CPQ to improve scale score reliability and to determine if including more items in the subscales is warranted. Results indicate that a 3-factor solution (constructive communication and 2 demand/withdraw scales) provides the best fit for the data. That factor structure was confirmed in the replication samples. Compared with the original scales, the revised scales include additional items that expand the conceptual range of the constructs, substantially improve reliability of scale scores, and demonstrate stronger associations with relationship satisfaction and sensitivity to change in therapy. Implications for research and treatment are discussed. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The German Focus on the Outcomes of Communication under Six (FOCUS-G): Reliability and Validity of a Novel Assessment of Communicative Participation

ERIC Educational Resources Information Center

Neumann, Sandra; Salm, Sandra; Rietz, Christian; Stenneken, Prisca

2017-01-01

Purpose: Our purpose was to explore the validity and reliability of the German Focus on the Outcomes of Communication Under Six (FOCUS-G; Thomas-Stonell, Oddson, Robertson, & Rosenbaum, 2010, 2012), which is an authorized adaptation of the Focus on the Outcomes of Communication Under Six (Thomas-Stonell et al., 2010) tool, which measures…

A Test of the ARCC© Model Improves Implementation of Evidence-Based Practice, Healthcare Culture, and Patient Outcomes.

PubMed

Melnyk, Bernadette Mazurek; Fineout-Overholt, Ellen; Giggleman, Martha; Choy, Katie

2017-02-01

Although several models of evidence-based practice (EBP) exist, there is a paucity of studies that have been conducted to evaluate their implementation in healthcare settings. The purpose of this study was to examine the impact of the Advancing Research and Clinical practice through close Collaboration (ARCC) Model on organizational culture, clinicians' EBP beliefs and EBP implementation, and patient outcomes at one healthcare system in the western United States. A pre-test, post-test longitudinal pre-experimental study was conducted with follow-up immediately following full implementation of the ARCC Model. The study was conducted at a 341-bed acute care hospital in the western region of the United States. The sample consisted of 58 interprofessional healthcare professionals. The ARCC Model was implemented in a sequential format over 12 months with the key strategy of preparing a critical mass of EBP mentors for the healthcare system. Healthcare professionals' EBP beliefs, EBP implementation, and organizational culture were measured with valid and reliable instruments. Patient outcomes were collected in aggregate from the hospital's medical records. Findings indicated significant increases in clinicians' EBP beliefs and EBP implementation along with positive movement toward an organizational EBP culture. Study findings also indicated substantial improvements in several patient outcomes. Implementation of the ARCC Model in healthcare systems can enhance clinicians' beliefs and implementation of evidence-based care, improve patient outcomes, and move organizational culture toward EBP. © 2016 Sigma Theta Tau International.

Patients' perception of postoperative pain management: validation of the International Pain Outcomes (IPO) questionnaire.

PubMed

Rothaug, Judith; Zaslansky, Ruth; Schwenkglenks, Matthias; Komann, Marcus; Allvin, Renée; Backström, Ragnar; Brill, Silviu; Buchholz, Ingo; Engel, Christoph; Fletcher, Dominique; Fodor, Lucian; Funk, Peter; Gerbershagen, Hans J; Gordon, Debra B; Konrad, Christoph; Kopf, Andreas; Leykin, Yigal; Pogatzki-Zahn, Esther; Puig, Margarita; Rawal, Narinder; Taylor, Rod S; Ullrich, Kristin; Volk, Thomas; Yahiaoui-Doktor, Maryam; Meissner, Winfried

2013-11-01

PAIN OUT is a European Commission-funded project aiming at improving postoperative pain management. It combines a registry that can be useful for quality improvement and research using treatment and patient-reported outcome measures. The core of the project is a patient questionnaire-the International Pain Outcomes questionnaire-that comprises key patient-level outcomes of postoperative pain management, including pain intensity, physical and emotional functional interference, side effects, and perceptions of care. Its psychometric quality after translation and adaptation to European patients is the subject of this validation study. The questionnaire was administered to 9,727 patients in 10 languages in 8 European countries and Israel. Construct validity was assessed using factor analysis. Discriminant validity assessment used Mann-Whitney U tests to detect mean group differences between 2 surgical disciplines. Internal consistency reliability was calculated as Cronbach's alpha. Factor analysis resulted in a 3-factor structure explaining 53.6% of variance. Cronbach's alpha at overall scale level was high (.86), and for the 3 subscales was low, moderate, or high (range, .53-.89). Significant mean group differences between general and orthopedic surgery patients confirmed discriminant validity. The psychometric quality of the International Pain Outcomes questionnaire can be regarded as satisfactory. The International Pain Outcomes questionnaire provides an instrument for postoperative pain assessment and improvement of quality of care, which demonstrated good psychometric quality when translated into a variety of languages in a large European and Israeli patient population. This measure provides the basis for the first comprehensive postoperative pain registry in Europe and other countries. Copyright © 2013. Published by Elsevier Inc.

Exploring the validity and reliability of a questionnaire for evaluating veterinary clinical teachers' supervisory skills during clinical rotations.

PubMed

Boerboom, T B B; Dolmans, D H J M; Jaarsma, A D C; Muijtjens, A M M; Van Beukelen, P; Scherpbier, A J J A

2011-01-01

Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources. We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education. We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes. Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong. The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

Outcome Measures in Spinal Cord Injury

PubMed Central

Alexander, Marcalee S.; Anderson, Kim; Biering-Sorensen, Fin; Blight, Andrew R.; Brannon, Ruth; Bryce, Thomas; Creasey, Graham; Catz, Amiram; Curt, Armin; Donovan, William; Ditunno, John; Ellaway, Peter; Finnerup, Nanna B.; Graves, Daniel E.; Haynes, Beth Ann; Heinemann, Allen W.; Jackson, Amie B.; Johnston, Mark; Kalpakjian, Claire Z.; Kleitman, Naomi; Krassioukov, Andrei; Krogh, Klaus; Lammertse, Daniel; Magasi, Susan; Mulcahey, MJ; Schurch, Brigitte; Sherwood, Arthur; Steeves, John D.; Stiens, Steven; Tulsky, David S.; van Hedel, Hubertus J.A.; Whiteneck, Gale

2009-01-01

Study Design review by the Spinal Cord Outcomes Partnership Endeavor (SCOPE), which is a broad-based international consortium of scientists and clinical researchers representing academic institutions, industry, government agencies, not-for-profit organizations and foundations. Objectives assessment of current and evolving tools for evaluating human spinal cord injury (SCI) outcomes for both clinical diagnosis and clinical research studies. Methods a framework for the appraisal of evidence of metric properties was used to examine outcome tools or tests for accuracy, sensitivity, reliability and validity for human SCI. Results imaging, neurological, functional, autonomic, sexual health, bladder/bowel, pain, and psycho-social tools were evaluated. Several specific tools for human SCI studies have or are being developed to allow the more accurate determination for a clinically meaningful benefit (improvement in functional outcome or quality of life) being achieved as a result of a therapeutic intervention. Conclusion significant progress has been made, but further validation studies are required to identify the most appropriate tools for specific targets in a human SCI study or clinical trial. PMID:19381157

Measuring Certified Registered Nurse Anesthetist Organizational Climate: Instrument Adaptation.

PubMed

Boyd, Donald; Poghosyan, Lusine

2017-08-01

No tool exists measuring certified registered nurse anesthetist (CRNA) organizational climate. The study's purpose is to adapt a validated tool to measure CRNA organizational climate. Content validity of the Certified Registered Nurse Anesthetist Organizational Climate Questionnaire (CRNA-OCQ) was established. Pilot testing was conducted to determine internal reliability consistency of the subscales. Experts rated the tool as content valid. The subscales had high internal consistency reliability (with respective Cronbach's alphas): CRNA-Anesthesiologist Relations (.753), CRNA-Physician Relations (.833), CRNA-Administration Relations (.895), Independent Practice (.830), Support for CRNA Practice (.683), and Professional Visibility (.772). Further refinement of the CRNA-OCQ is necessary. Measurement and assessment of CRNA organizational climate may produce evidence needed to improve provider and patient outcomes.

The Reliability and Validity of Measures of Gait Variability in Community-Dwelling Older Adults

PubMed Central

Brach, Jennifer S.; Perera, Subashan; Studenski, Stephanie; Newman, Anne B.

2009-01-01

Objective To examine the test-retest reliability and concurrent validity of variability of gait characteristics. Design Cross-sectional study. Setting Research laboratory. Participants Older adults (N=558) from the Cardiovascular Health Study. Interventions Not applicable. Main Outcome Measures Gait characteristics were measured using a 4-m computerized walkway. SD determined from the steps recorded were used as the measures of variability. Intraclass correlation coefficients (ICC) were calculated to examine test-retest reliability of a 4-m walk and two 4-m walks. To establish concurrent validity, the measures of gait variability were compared across levels of health, functional status, and physical activity using independent t tests and analysis of variances. Results Gait variability measures from the two 4-m walks demonstrated greater test-retest reliability than those from the single 4-m walk (ICC=.22–.48 and ICC=.40–.63, respectively). Greater step length and stance time variability were associated with poorer health, functional status and physical activity (P<.05). Conclusions Gait variability calculated from a limited number of steps has fair to good test-retest reliability and concurrent validity. Reliability of gait variability calculated from a greater number of steps should be assessed to determine if the consistency can be improved. PMID:19061741

Baseline Neurocognitive Performance and Clearance for Athletes to Return to Contact.

PubMed

Asken, Breton M; Clugston, James R; Snyder, Aliyah R; Bauer, Russell M

2017-01-01

 Computerized neurocognitive assessments are commonly used to manage sport-related concussion. Variations in baseline performance may influence neurocognitive performance after injury as well as the amount of time needed for an athlete to be cleared for return to sport participation.  To investigate the relationship between mean baseline Immediate Post-Concussion Assessment and Cognitive Test (ImPACT) scores and postconcussion reliable decline as well as the association between postconcussion cognitive decline and days missed after injury.  Cross-sectional study.  University concussion databank.  A total of 84 collegiate athletes who sustained a concussion between 2008 and 2015 were studied. For each ImPACT composite score (verbal memory, visual memory, visual motor speed, reaction time), athletes were grouped based on the presence or absence of reliable decline and on the presence of reliable decline in 0, 1, 2, 3, or 4 cognitive domains.  Outcome measures were baseline ImPACT composite scores and days missed due to concussion.  Athletes with a reliable decline in visual memory scored higher on baseline visual memory than did athletes with no decline or an improvement (t 82 = -2.348, P = .021, d = 0.65). When comparing athletes who displayed a reliable decline with those who showed no change or an improvement in any composite score, days missed did not differ. The number of composite scores with a reliable decline demonstrated no main effect on days missed (P = .530).  Athletes who exhibited cognitive decline in most or all of the composite scores did not miss more days after injury than athletes with a decline in fewer or none of the composite scores. Athletes should be educated regarding the lack of association between baseline neurocognitive scores and the presence or absence of a reliable decline after concussion, as well as the fact that, on average, individuals with a reliable decline across multiple domains did not miss more time after concussion.

Quality management as knowledge sharing: experiences of the Napa County Health and Human Services Agency.

PubMed

Harrison, Lindsay

2012-01-01

Lacking a coordinated effort in utilizing data and tracking program outcomes, one agency developed a Quality Management (QM) division to facilitate and manage more effective data use. To support this process, the agency sought to develop a collective, agency-wide understanding and investment in improving and measuring client outcomes. Similarly, the agency also focused efforts on creating a culture of transparency and accountability, with goals of improving service, increasing agency integrity, meeting regulatory compliance, and engaging in effective risk management. Operationalizing the QM initiative involved developing procedures, systems, and guidelines that would facilitate the generation of reliable and accurate data that could be used to inform program change and decision-making. This case study describes this agency's experience in successfully creating and implementing a QM initiative aimed at engaging in greater knowledge sharing. Copyright © Taylor & Francis Group, LLC

A Scoping Review of Physical Performance Outcome Measures Used in Exercise Interventions for Older Adults With Alzheimer Disease and Related Dementias.

PubMed

McGough, Ellen L; Lin, Shih-Yin; Belza, Basia; Becofsky, Katie M; Jones, Dina L; Liu, Minhui; Wilcox, Sara; Logsdon, Rebecca G

2017-11-28

There is growing evidence that exercise interventions can mitigate functional decline and reduce fall risk in older adults with Alzheimer disease and related dementias (ADRD). Although physical performance outcome measures have been successfully used in older adults without cognitive impairment, additional research is needed regarding their use with individuals who have ADRD, and who may have difficulty following instructions regarding performance of these measures. The purpose of this scoping review was to identify commonly used physical performance outcome measures, for exercise interventions, that are responsive and reliable in older adults with ADRD. Ultimately, we aimed to provide recommendations regarding the use of outcome measures for individuals with ADRD across several domains of physical performance. A scoping review was conducted to broadly assess physical performance outcome measures used in exercise interventions for older adults with ADRD. Exercise intervention studies that included at least 1 measure of physical performance were included. All physical performance outcome measures were abstracted, coded, and categorized into 5 domains of physical performance: fitness, functional mobility, gait, balance, and strength. Criteria for recommendations were based on (1) the frequency of use, (2) responsiveness, and (3) reliability. Frequency was determined by the number of studies that used the outcome measure per physical performance domain. Responsiveness was assessed via calculated effect size of the outcome measures across studies within physical performance domains. Reliability was evaluated via published studies of psychometric properties. A total of 20 physical performance outcome measures were extracted from 48 articles that met study inclusion criteria. The most frequently used outcome measures were the 6-minute walk test, Timed Up and Go, repeated chair stand tests, short-distance gait speed, the Berg Balance Scale, and isometric strength measures. These outcome measures demonstrated a small, medium, or large effect in at least 50% of the exercise intervention studies. Good to excellent reliability was reported in samples of older adults with mild to moderate dementia. Fitness, functional mobility, gait, balance, and strength represent important domains of physical performance for older adults. The 6-minute walk test, Timed Up and Go, repeated chair stand tests, short-distance gait speed, Berg Balance Scale, and isometric strength are recommended as commonly used and reliable physical performance outcome measures for exercise interventions in older adults with mild to moderate ADRD. Further research is needed on optimal measures for individuals with severe ADRD. The results of this review will aid clinicians and researchers in selecting reliable measures to evaluate physical performance outcomes in response to exercise interventions in older adults with ADRD.

The HIV Medication Taking Self-Efficacy Scale: Psychometric Evaluation

PubMed Central

Erlen, Judith A.; Cha, EunSeok; Kim, Kevin H.; Caruthers, Donna; Sereika, Susan M.

2010-01-01

Aim This paper is a report of an examination of the psychometric properties of the HIV Medication Taking Self-efficacy Scale. Background Self-efficacy is a critically important component of strategies to improve HIV medication-taking; however, valid and reliable tools for assessing HIV medication-taking self-efficacy are limited. Method We used a cross-sectional, correlational design. Between 2003 and 2007, 326 participants were recruited from sites in Pennsylvania and Ohio in the United States of America. Six self-report questionnaires administered at baseline and 12 weeks later during “Improving Adherence to Antiretroviral Therapy” were used to examine the variables of interest. Means and variances, reliability, criterion, and construct validity of the HIV Medication Taking Self-efficacy Scale were assessed. Findings Participants reported high self-confidence in their ability to carry out specific medication-related tasks (mean=8.31) and in the medication’s ability to effect good outcomes (mean=8.56). The HIV Medication Taking Self-efficacy Scale and subscales showed excellent reliability (α = .93 ~ .94). Criterion validity was well-established by examining the relationships between the HIV Medication Taking Self-efficacy Scale and selected physiological and psychological factors, and self-reported medication adherence (r = −.20 ~ .58). A two-factor model with a correlation between self-efficacy belief and outcome expectancy fitted the data well (model χ2 = 3871.95, df = 325, p<001; CFA =.96; RMSEA =.046). Conclusion The HIV Medication Taking Self-efficacy Scale is a psychometrically sound measure of medication-taking self-efficacy for use by researchers and clinicians with people with HIV. The findings offer insight into the development of interventions to promote self-efficacy and medication adherence in persons with HIV. PMID:20722799

Reduction of diabetes-related distress predicts improved depressive symptoms: A secondary analysis of the DIAMOS study.

PubMed

Reimer, André; Schmitt, Andreas; Ehrmann, Dominic; Kulzer, Bernhard; Hermanns, Norbert

2017-01-01

Depressive symptoms in people with diabetes are associated with increased risk of adverse outcomes. Although successful psychosocial treatment options are available, little is known about factors that facilitate treatment response for depression in diabetes. This prospective study aims to examine the impact of known risk factors on improvement of depressive symptoms with a special interest in the role of diabetes-related distress. 181 people with diabetes participated in a randomized controlled trial. Diabetes-related distress was assessed using the Problem Areas In Diabetes (PAID) scale; depressive symptoms were assessed using the Center for Epidemiologic Studies Depression (CES-D) scale. Multiple logistic and linear regression analyses were used to assess associations between risk factors for depression (independent variables) and improvement of depressive symptoms (dependent variable). Reliable change indices were established as criteria of meaningful reductions in diabetes distress and depressive symptoms. A reliable reduction of diabetes-related distress (15.43 points in the PAID) was significantly associated with fourfold increased odds for reliable improvement of depressive symptoms (OR = 4.25, 95% CI: 2.05-8.79; P<0.001). This result was corroborated using continuous measures of diabetes distress and depressive symptoms, showing that greater reduction of diabetes-related distress independently predicted greater improvement in depressive symptoms (ß = -0.40; P<0.001). Higher age had a positive (Odds Ratio = 2.04, 95% CI: 1.21-3.43; P<0.01) and type 2 diabetes had a negative effect on the meaningful reduction of depressive symptoms (Odds Ratio = 0.12, 95% CI: 0.04-0.35; P<0.001). The reduction of diabetes distress is a statistical predictor of improvement of depressive symptoms. Diabetes patients with comorbid depressive symptomatology might benefit from treatments to reduce diabetes-related distress.

Training and Maintaining System-Wide Reliability in Outcome Management.

PubMed

Barwick, Melanie A; Urajnik, Diana J; Moore, Julia E

2014-01-01

The Child and Adolescent Functional Assessment Scale (CAFAS) is widely used for outcome management, for providing real time client and program level data, and the monitoring of evidence-based practices. Methods of reliability training and the assessment of rater drift are critical for service decision-making within organizations and systems of care. We assessed two approaches for CAFAS training: external technical assistance and internal technical assistance. To this end, we sampled 315 practitioners trained by external technical assistance approach from 2,344 Ontario practitioners who had achieved reliability on the CAFAS. To assess the internal technical assistance approach as a reliable alternative training method, 140 practitioners trained internally were selected from the same pool of certified raters. Reliabilities were high for both practitioners trained by external technical assistance and internal technical assistance approaches (.909-.995, .915-.997, respectively). 1 and 3-year estimates showed some drift on several scales. High and consistent reliabilities over time and training method has implications for CAFAS training of behavioral health care practitioners, and the maintenance of CAFAS as a global outcome management tool in systems of care.

Evaluation of counseling outcomes at a university counseling center: the impact of clinically significant change on problem resolution and academic functioning.

PubMed

Choi, Keum-Hyeong; Buskey, Wendy; Johnson, Bonita

2010-07-01

The main purpose of this study was to investigate how receiving personal counseling at a university counseling center helps students deal with their personal problems and facilitates academic functioning. To that end, this study used both clinical and academic outcome measures that are relevant to the practice of counseling provided at a counseling center and its unique function in an institution of higher education. In addition, this study used the clinical significance methodology (N. S. Jacobson & P. Truax, 1991) that takes into account clients' differences in making clinically reliable and significant change. Pre-intake and post-termination surveys, including the Outcome Questionnaire (M. J. Lambert, K. Lunnen, V. Umphress, N. Hansen, & G. Burlingame, 1994), were completed by 78 clients, and the responses were analyzed using clinical significance methodology. The results revealed that those who made clinically reliable and significant change (i.e., the recovered group) reported the highest level of improvement in academic commitment to their educational goals and problem resolution, compared with those who did not make clinically significant change. The implications of the findings on practice for counseling at university counseling centers and for administrators in higher education institutions are discussed. (c) 2010 APA, all rights reserved.

Correction of moderate to severe hallux valgus with combined proximal opening wedge and distal chevron osteotomies: a reliable technique.

PubMed

Jeyaseelan, L; Chandrashekar, S; Mulligan, A; Bosman, H A; Watson, A J S

2016-09-01

The mainstay of surgical correction of hallux valgus is first metatarsal osteotomy, either proximally or distally. We present a technique of combining a distal chevron osteotomy with a proximal opening wedge osteotomy, for the correction of moderate to severe hallux valgus. We reviewed 45 patients (49 feet) who had undergone double osteotomy. Outcome was assessed using the American Orthopaedic Foot and Ankle Society (AOFAS) and the Short Form (SF) -36 Health Survey scores. Radiological measurements were undertaken to assess the correction. The mean age of the patients was 60.8 years (44.2 to 75.3). The mean follow-up was 35.4 months (24 to 51). The mean AOFAS score improved from 54.7 to 92.3 (p < 0.001) and the mean SF-36 score from 59 to 86 (p < 0.001). The mean hallux valgus and intermetatarsal angles were improved from 41.6(o) to 12.8(o) (p < 0.001) and from 22.1(o) to 7.1(o), respectively (p < 0.001). The mean distal metatarsal articular angle improved from 23(o) to 9.7(o). The mean sesamoid position, as described by Hardy and Clapham, improved from 6.8 to 3.5. The mean length of the first metatarsal was unchanged. The overall rate of complications was 4.1% (two patients). These results suggest that a double osteotomy of the first metatarsal is a reliable, safe technique which, when compared with other metatarsal osteotomies, provides strong angular correction and excellent outcomes with a low rate of complications. Cite this article: Bone Joint J 2016;98-B:1202-7. ©2016 The British Editorial Society of Bone & Joint Surgery.

Measuring the Quality of University Lectures: Development and Validation of the Instructional Skills Questionnaire (ISQ).

PubMed

Knol, Mariska H; Dolan, Conor V; Mellenbergh, Gideon J; van der Maas, Han L J

2016-01-01

In higher education, student ratings are often used to evaluate and improve the quality of courses and professors' instructional skills. Unfortunately, student-rating questionnaires rarely generate specific feedback for professors to improve their instructional skills. The impact of student ratings on professors' instructional skills has proven to be low. This study concerns the psychometric properties of the Instructional Skills Questionnaire (ISQ), a new theory-based student-rating-of-teaching questionnaire with specific questions concerning lecturing skills. The ISQ is administered after a single lecture. This way, it serves as a formative feedback instrument for university professors during courses to assist them to improve and (re-) evaluate their skills if necessary. The ISQ contains seven dimensions of professors' instructional skills and three student (self perceived) learning outcomes. In this study, Dutch students in 75 courses rated three 90-minute lectures (T1, T2 and T3) of their respective professors using the ISQ. In total, 14,298 ISQ-forms were used to rate 225 lectures. The teacher level reliabilities of the seven dimensions were found to be good at each measurement occasion. In addition, confirmatory multilevel factor analysis confirmed a seven dimensional factor structure at the teacher level at each measurement occasion. Furthermore, specific teacher level factors significantly predicted students' (self-assessed) learning outcomes. These results partly supported the proposed theoretical framework on the relationship between the ISQ teaching dimensions and the student learning process, and provided evidence for the construct validity of the instrument. In sum, the ISQ is found to be a reliable and valid instrument, which can be used by professors and faculty development centers to assess and improve university teaching.

Measuring the Quality of University Lectures: Development and Validation of the Instructional Skills Questionnaire (ISQ)

PubMed Central

Mellenbergh, Gideon J.; van der Maas, Han L. J.

2016-01-01

In higher education, student ratings are often used to evaluate and improve the quality of courses and professors’ instructional skills. Unfortunately, student-rating questionnaires rarely generate specific feedback for professors to improve their instructional skills. The impact of student ratings on professors’ instructional skills has proven to be low. This study concerns the psychometric properties of the Instructional Skills Questionnaire (ISQ), a new theory-based student-rating-of-teaching questionnaire with specific questions concerning lecturing skills. The ISQ is administered after a single lecture. This way, it serves as a formative feedback instrument for university professors during courses to assist them to improve and (re-) evaluate their skills if necessary. The ISQ contains seven dimensions of professors’ instructional skills and three student (self perceived) learning outcomes. In this study, Dutch students in 75 courses rated three 90-minute lectures (T1, T2 and T3) of their respective professors using the ISQ. In total, 14,298 ISQ-forms were used to rate 225 lectures. The teacher level reliabilities of the seven dimensions were found to be good at each measurement occasion. In addition, confirmatory multilevel factor analysis confirmed a seven dimensional factor structure at the teacher level at each measurement occasion. Furthermore, specific teacher level factors significantly predicted students’ (self-assessed) learning outcomes. These results partly supported the proposed theoretical framework on the relationship between the ISQ teaching dimensions and the student learning process, and provided evidence for the construct validity of the instrument. In sum, the ISQ is found to be a reliable and valid instrument, which can be used by professors and faculty development centers to assess and improve university teaching. PMID:26918646

The Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM): An assessment of validity, reliability, and responsiveness.

PubMed

Bryant, Elizabeth; Murtagh, Shemane; Finucane, Laura; McCrum, Carol; Mercer, Christopher; Smith, Toby; Canby, Guy; Rowe, David A; Moore, Ann P

2018-05-11

In response for the need of a freely available, stand-alone, validated outcome measure for use within musculoskeletal (MSK) physiotherapy practice, sensitive enough to measure clinical effectiveness, we developed an MSK patient reported outcome measure. This study examined the validity and reliability of the newly developed Brighton musculoskeletal Patient-Reported Outcome Measure (BmPROM) within physiotherapy outpatient settings. Two hundred twenty-four patients attending physiotherapy outpatient departments in South East England with an MSK condition participated in this study. The BmPROM was assessed for user friendliness (rated feedback, N = 224), reliability (internal consistency and test-retest reliability, n = 42), validity (internal and external construct validity, N = 224), and responsiveness (internal, n = 25). Exploratory factor analysis indicated that a two-factor model provides a good fit to the data. Factors were representative of "Functionality" and "Wellbeing". Correlations observed between the BmPROM and SF-36 domains provided evidence of convergent validity. Reliability results indicated that both subscales were internally consistent with alphas above the acceptable limits for both "Functionality" (α = .85, 95% CI [.81, .88]) and 'Wellbeing' (α = .80, 95% CI [.75, .84]). Test-retest analyses (n = 42) demonstrated a high degree of reliability between "Functionality" (ICC = .84; 95% CI [.72, .91]) and "Wellbeing" scores (ICC = .84; 95% CI [.72, .91]). Further examination of test-retest reliability through the Bland-Altman analysis demonstrated that the difference between "Functionality" and "Wellbeing" test scores did not vary as a function of absolute test score. Large treatment effect sizes were found for both subscales (Functionality d = 1.10; Wellbeing 1.03). The BmPROM is a reliable and valid outcome measure for use in evaluating physiotherapy treatment of MSK conditions. Copyright © 2018 John Wiley & Sons, Ltd.

The Effect of Cognitive Load and Outcome Congruency on the Learned Predictiveness Effect in Human Predictive Learning

ERIC Educational Resources Information Center

Jorge A. Pinto,; Vogel, Edgar H.; Núñez, Daniel E.

2017-01-01

The learned predictiveness effect or LPE is the finding that when people learn that certain cues are reliable predictors of an outcome in an initial stage of training (phase 1), they exhibit a learning bias in favor of these cues in a subsequent training involving new outcomes (phase 2) despite all cues being equally reliable in phase 2. In…

Patient-Centered Technological Assessment and Monitoring of Depression for Low-Income Patients

PubMed Central

Wu, Shinyi; Vidyanti, Irene; Liu, Pai; Hawkins, Caitlin; Ramirez, Magaly; Guterman, Jeffrey; Gross-Schulman, Sandra; Sklaroff, Laura Myerchin; Ell, Kathleen

2014-01-01

Depression is a significant challenge for ambulatory care because it worsens health status and outcomes, increases health care utilizations and costs, and elevates suicide risk. An automatic telephonic assessment (ATA) system that links with tasks and alerts to providers may improve quality of depression care and increase provider productivity. We used ATA system in a trial to assess and monitor depressive symptoms of 444 safety-net primary care patients with diabetes. We assessed system properties, evaluated preliminary clinical outcomes, and estimated cost savings. The ATA system is feasible, reliable, valid, safe, and likely cost-effective for depression screening and monitoring for low-income primary care population. PMID:24525531

Searching for Elements of Evidence-based Practices in Children’s Usual Care and Examining their Impact

PubMed Central

Garland, Ann F.; Accurso, Erin C.; Haine-Schlagel, Rachel; Brookman-Frazee, Lauren; Roesch, Scott; Zhang, Jin Jin

2014-01-01

Objective Most of the knowledge generated to bridge the research - practice gap has been derived from experimental studies implementing specific treatment models. Alternatively, this study uses observational methods to generate knowledge about community-based treatment processes and outcomes. Aims are to (1) describe outcome trajectories for children with disruptive behavior problems (DBPs), and (2) test how observed delivery of a benchmark set of practice elements common in evidence-based (EB) treatments may be associated with outcome change, while accounting for potential confounding variables. Method Participants included 190 children ages 4–13 with DBPs and their caregivers, plus 85 psychotherapists, recruited from six clinics. All treatment sessions were video-taped and a random sample of four sessions in the first four months of treatment was reliably coded for intensity on 27 practice elements (benchmark set and others). Three outcomes (child symptom severity, parent discipline, and family functioning) were assessed by parent report at intake, four, and eight months. Data were collected on several potential covariates including child, parent, therapist, and service use characteristics. Multi-level modeling was used to assess relationships between observed practice and outcome slopes, while accounting for covariates. Results Children and families demonstrated improvements in all three outcomes, but few significant associations between treatment processes and outcome change were identified. Families receiving greater intensity on the benchmark practice elements did demonstrate greater improvement in the parental discipline outcome. Conclusion Observed changes in outcomes for families in community care were generally not strongly associated with the type or amount of treatment received. PMID:24555882

Interventions to improve patient understanding of cancer clinical trial participation: a systematic review.

PubMed

Kao, C Y; Aranda, S; Krishnasamy, M; Hamilton, B

2017-03-01

Patient misunderstanding of cancer clinical trial participation is identified as a critical issue and researchers have developed and tested a variety of interventions to improve patient understanding. This systematic review identified nine papers published between 2000 and 2013, to evaluate the effects of interventions to improve patient understanding of cancer clinical trial participation. Types of interventions included audio-visual information, revised written information and a communication training workshop. Interventions were conducted alone or in combination with other forms of information provision. The nine papers, all with methodological limitations, reported mixed effects on a small range of outcomes regarding improved patient understanding of cancer clinical trial participation. The methodological limitations included: (1) the intervention development process was poorly described; (2) only a small element of the communication process was addressed; (3) studies lacked evidence regarding what information is essential and critical to enable informed consent; (4) studies lacked reliable and valid outcome measures to show that patients are sufficiently informed to provide consent; and (5) the intervention development process lacked a theoretical framework. Future research needs to consider these factors when developing interventions to improve communication and patient understanding during the informed consent process. © 2016 John Wiley & Sons Ltd.

Translation and validation of the German version of the Bournemouth Questionnaire for Neck Pain.

PubMed

Soklic, Marina; Peterson, Cynthia; Humphreys, B Kim

2012-01-25

Clinical outcome measures are important tools to monitor patient improvement during treatment as well as to document changes for research purposes. The short-form Bournemouth questionnaire for neck pain patients (BQN) was developed from the biopsychosocial model and measures pain, disability, cognitive and affective domains. It has been shown to be a valid and reliable outcome measure in English, French and Dutch and more sensitive to change compared to other questionnaires. The purpose of this study was to translate and validate a German version of the Bournemouth questionnaire for neck pain patients. German translation and back translation into English of the BQN was done independently by four persons and overseen by an expert committee. Face validity of the German BQN was tested on 30 neck pain patients in a single chiropractic practice. Test-retest reliability was evaluated on 31 medical students and chiropractors before and after a lecture. The German BQN was then assessed on 102 first time neck pain patients at two chiropractic practices for internal consistency, external construct validity, external longitudinal construct validity and sensitivity to change compared to the German versions of the Neck Disability Index (NDI) and the Neck Pain and Disability Scale (NPAD). Face validity testing lead to minor changes to the German BQN. The Intraclass Correlation Coefficient for the test-retest reliability was 0.99. The internal consistency was strong for all 7 items of the BQN with Cronbach α's of .79 and .80 for the pre and post-treatment total scores. External construct validity and external longitudinal construct validity using Pearson's correlation coefficient showed statistically significant correlations for all 7 scales of the BQN with the other questionnaires. The German BQN showed greater responsiveness compared to the other questionnaires for all scales. The German BQN is a valid and reliable outcome measure that has been successfully translated and culturally adapted. It is shorter, easier to use, and more responsive to change than the NDI and NPAD.

Fibromyalgia Syndrome Module at OMERACT 9

PubMed Central

Mease, Philip; Arnold, Lesley M; Choy, Ernest H; Clauw, Daniel J.; Crofford, Leslie; Glass, Jennifer M; Martin, Susan A; Morea, Jessica; Simon, Lee; Strand, Vibeke; Williams, David A

2012-01-01

Objectives (1) Establish a core domain set for fibromyalgia (FM) assessment in clinical trials and practice, (2) review outcome measures’ performance characteristics, (3) discuss development of a responder index for the assessment of FM in clinical trials, (4) review objective markers, (5) review the domain of cognitive dysfunction, (6) establish a research agenda for work regarding outcomes research. Methods (1) Results of univariate and multivariate analysis of 10 different FM clinical trials of four different drugs, mapping key domains identified in previously presented patient focus group: Delphi exercises and a clinician/researcher Delphi exercise, breakout discussions to vote on possible essential domains and reliable measures. (2) Updates presented regarding outcome measures’ status. (3) Presented update on objective markers to measure FM disease state. 4) The issue of cognitive dysfunction (dyscognition) in FM was reviewed. Results (1) Greater than 70% of OMERACT participants agreed that pain, tenderness, fatigue, patient global, multidimensional function and sleep disturbance domains should be measured in all FM clinical trials, dyscognition and depression in some trial, and domains of research interest include stiffness, anxiety, functional imaging, and cerebrospinal fluid biomarkers. (2) FM domains’ outcome measures have generally proven to be reliable, discriminative, and feasible. More sophisticated and comprehensive measures are in development, as is a responder index for FM. (3) Increasing number of objective markers are being developed for FM assessment. (4) Cognitive dysfunction assessment by self-assessed and applied outcome measures is being developed. Conclusions A multidimensional symptom core set is proposed for the evaluation of FM in clinical trials. There is ongoing research on improved measures of single domains and composite measures. PMID:19820221

Reliability and Validity of the Self Efficacy Expectations and Outcome Expectations After ICD Implantation Scales

PubMed Central

Dougherty, Cynthia M.; Johnston, Sandra K.; Thompson, Elaine Adams

2009-01-01

The purpose of this study was to assess the reliability and validity characteristics of two new scales that measure self-efficacy expectations (SE-ICD) and outcome expectations (OE-ICD) in survivors (n=168) of sudden cardiac arrest (SCA), all of whom received an implantable cardioverter defibrillator (ICD). Cronbach's alpha reliability demonstrated good internal consistency (SE-ICD α = 0.93 and OE-ICD α = 0.81). Correlations with other self-efficacy instruments (general self-efficacy and social self-efficacy) were consistently high. The instruments were responsive to change across time with effect sizes of 0.46 for SE-ICD, and 0.26 for OE-ICD. These reliable, valid, and responsive instruments for measurement of self-efficacy expectations and outcome expectations after an ICD can be used in research and clinical settings. PMID:17693214

The Reliability of Anthropometric Measurements Used Preoperatively in Aesthetic Breast Surgery.

PubMed

Isaac, Kathryn V; Murphy, Blake D; Beber, Brett; Brown, Mitchell

2016-04-01

Patient outcomes in aesthetic breast surgery are highly dependent on breast measurements used in preoperative planning. The purpose of this study is to determine the reliability of anthropometric breast measurements. Four raters measured 28 women using 7 measurements: sternal notch to nipple distance (Sn-N), nipple to midline (N-M), nipple to inframammary-fold distance under maximal stretch (N-IMF), breast base width (BW), soft tissue pinch thickness of the upper pole (STPT:UP), STPT at the inframammary fold (STPT:IMF), and anterior pull skin stretch (APSS). Reliability was assessed using intra-class correlation coefficients (ICCs). Inter-rater reliability was excellent for Sn-N, N-M, and BW (ICC = 0.94, 0.90, and 0.76, respectively) and was good for N-IMF (ICC = 0.70). The STPT:UP, STPT:IMF, and APSS measurements were not reliable between raters (ICC < 0.2). Intra-rater reliability was excellent for Sn-N, N-M, and BW for all raters (all ICC > 0.75). The N-IMF intra-rater reliability was excellent in senior raters (ICC > 0.75) and good in junior raters (ICC > 0.6). The STPT:UP, STPT:IMF, and APSS measurements showed fair or poor reliability for most raters (ICC < 0.6). The Sn-N, N-M, and BW measurements are very reliable. Dynamic measurements including APSS, STPT:UP, and STUP:IMF are unreliable. N-IMF is the only reliable dynamic measurement, and its reliability improves with increasing clinical experience. The variable reliability of preoperative measurements must be considered in the planning of aesthetic breast surgery. 4 Diagnostic. © 2015 The American Society for Aesthetic Plastic Surgery, Inc. Reprints and permission: journals.permissions@oup.com.

Imaging outcome measures for progressive multiple sclerosis trials

PubMed Central

Moccia, Marcello; de Stefano, Nicola; Barkhof, Frederik

2017-01-01

Imaging markers that are reliable, reproducible and sensitive to neurodegenerative changes in progressive multiple sclerosis (MS) can enhance the development of new medications with a neuroprotective mode-of-action. Accordingly, in recent years, a considerable number of imaging biomarkers have been included in phase 2 and 3 clinical trials in primary and secondary progressive MS. Brain lesion count and volume are markers of inflammation and demyelination and are important outcomes even in progressive MS trials. Brain and, more recently, spinal cord atrophy are gaining relevance, considering their strong association with disability accrual; ongoing improvements in analysis methods will enhance their applicability in clinical trials, especially for cord atrophy. Advanced magnetic resonance imaging (MRI) techniques (e.g. magnetization transfer ratio (MTR), diffusion tensor imaging (DTI), spectroscopy) have been included in few trials so far and hold promise for the future, as they can reflect specific pathological changes targeted by neuroprotective treatments. Position emission tomography (PET) and optical coherence tomography have yet to be included. Applications, limitations and future perspectives of these techniques in clinical trials in progressive MS are discussed, with emphasis on measurement sensitivity, reliability and sample size calculation. PMID:29041865

Mobile Apps for the Dietary Approaches to Stop Hypertension (DASH): App Quality Evaluation.

PubMed

DiFilippo, Kristen Nicole; Huang, Wen-Hao David; Chapman-Novakofski, Karen M

2018-03-08

To identify the availability and quality of apps supporting Dietary Approaches to Stop Hypertension (DASH) education. The researchers identified DASH apps over 1 month in the Apple App Store. Five registered dietitians used the App Quality Evaluation (AQEL) to evaluate app quality on 7 domains. Interrater reliability was tested using intraclass correlations. One paid and 3 free DASH apps were evaluated. Interrater reliability (n = 5) was good for 3 apps and fair for 1 app. Only the paid app scored high (>8 of 10) on most AQEL quality domains. Based on lower quality found among the included free apps, further development of free apps is warranted. Whereas the paid app may be useful in supporting DASH education, future research should determine whether improvements in clinical outcomes are found and whether this app should be improved to address AQEL domains better. Copyright © 2018 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Validation of a Portuguese version of the Information Needs in Cardiac Rehabilitation (INCR) scale in Brazil.

PubMed

Ghisi, Gabriela Lima de Melo; Dos Santos, Rafaella Zulianello; Bonin, Christiani Batista Decker; Roussenq, Suellen; Grace, Sherry L; Oh, Paul; Benetti, Magnus

2014-01-01

To translate, culturally adapt and psychometrically validate the Information Needs in Cardiac Rehabilitation (INCR) tool to Portuguese. The identification of information needs is considered the first step to improve knowledge that ultimately could improve health outcomes. The Portuguese version generated was tested in 300 cardiac rehabilitation patients (CR) (34% women; mean age = 61.3 ± 2.1 years old). Test-retest reliability was assessed using intraclass correlation coefficient (ICC), the internal consistency using Cronbach's alpha, and the criterion validity was assessed with regard to patients' education and duration in CR. All 9 subscales were considered internally consistent (á > 0.7). Significant differences between mean total needs and educational level (p < 0.05) and duration in CR (p = 0.03) supported criterion validity. The overall mean (4.6 ± 0.4), as well as the means of the 9 subscales were high (emergency/safety was the greatest need). The Portuguese INCR was demonstrated to have sufficient reliability, consistency and validity. Copyright © 2014 Elsevier Inc. All rights reserved.

Technological iatrogenesis: the manifestation of inadequate organizational planning and the integration of health information technology.

PubMed

Palmieri, Patrick Albert; Peterson, Lori T; Corazzo, Luciano Bedoya

2011-01-01

The Institute of Medicine (IOM) views Health Information Technology (HIT) as an essential organizational prerequisite for the delivery of safe, reliable, and cost-effective health services. However, HIT presents the proverbial double-edged sword in generating solutions to improve system performance while facilitating the genesis of novel iatrogenic problems. Incongruent organizational processes give rise to technological iatrogenesis or the unintended consequences to system integrity and the resulting organizational outcomes potentiated by incongruent organizational-technological interfaces. HIT is a disruptive innovation for health services organizations but remains an overlooked organizational development (OD) concern. Recognizing the technology-organizational misalignments that result from HIT adoption is important for leaders seeking to eliminate sources of system instability. The Health Information Technology Iatrogenesis Model (HITIM) provides leaders with a conceptual framework from which to consider HIT as an instrument for organizational development. Complexity and Diffusion of Innovation theories support the framework that suggests each HIT adoption functions as a technological change agent. As such, leaders need to provide operational oversight to managers undertaking system change via HIT implementation. Traditional risk management tools, such as Failure Mode Effect Analysis and Root Cause Analysis, provide proactive pre- and post-implementation appraisals to verify system stability and to enhance system reliability. Reconsidering the use of these tools within the context of a new framework offers leaders guidance when adopting HIT to achieve performance improvement and better outcomes.

An acceptance-oriented cognitive-behavioral therapy in multimodal rehabilitation: a pre-post test evaluation in highly distressed patients with rheumatic diseases.

PubMed

Vriezekolk, Johanna E; Eijsbouts, Agnes M M; van Lankveld, Wim G J M; Beenackers, Hanneke; Geenen, Rinie; van den Ende, Cornelia H M

2013-06-01

To examine the potential effectiveness of a multimodal rehabilitation program including an acceptance-oriented cognitive-behavioral therapy for highly distressed patients with rheumatic diseases. An observational study employing a one-group pre-post test design (N=25). The primary outcome was psychological distress. Secondary outcomes were quality of life, illness acceptance, and coping flexibility. Group pre-to-post and pre-to-12 months follow-up treatment changes were evaluated by paired-samples t-tests and Cohen's effect sizes (d). Individual changes were evaluated by the reliable change index (RCI) and clinically significant change (CSC) parameters. Significant effects were found post-treatment and maintained at 12 months in psychological distress (d>0.80), illness acceptance (d=1.48) and the SF-36 subscales role physical, vitality, and mental health (d ≥ 0.65). No significant effects were found for coping flexibility and the SF-36 subscales physical functioning, bodily pain, social functioning, and role emotional. Both a reliable (RCI) and clinically significant (CSC) improvement was observed for almost half of the highly distressed patients. The patients enrolled in the multimodal rehabilitation program showed improved psychological health status from pre to post-treatment. A randomized clinical trial is needed to confirm or refute the added value of an acceptance-oriented cognitive-behavioral therapy for highly distressed patients in rehabilitation. Copyright © 2013 Elsevier Ireland Ltd. All rights reserved.

Effects of clinical communication interventions in hospitals: a systematic review of information and communication technology adoptions for improved communication between clinicians.

PubMed

Wu, Robert C; Tran, Kim; Lo, Vivian; O'Leary, Kevin J; Morra, Dante; Quan, Sherman D; Perrier, Laure

2012-11-01

To conduct a systematic review of the literature to identify, describe and assess interventions of information and communication technology on the processes of communication and associated patient outcomes within hospital settings. Studies published from the years 1996 to 2010 were considered and were selected if they described an evaluation of information and communication technology interventions to improve clinical communication within hospitals. Two authors abstracted data from full text articles, and the quality of individual articles were appraised. Results of interventions were summarized by their effect. There were 18 identified studies that evaluated the use of interventions that included alphanumeric paging, hands-free communication devices, mobile phones, smartphones, task management systems and a display based paging system. Most quantitative studies used a before and after study design and were of lower quality. Of all the studies, there was only one prospective randomized study, but this study used only simulated communication events. Quantitative studies identified improved perceptions of communication and some improvement in communication metrics. Qualitative studies described improvements in efficiency of communication but also issues of loss of control and reliability. Despite the rapid advancement in information and communications technology over the last decade, there is limited evidence suggesting improvements in the ability of health professionals to communicate effectively. Given the critical nature of communication, we advocate further evaluation of information and communication technology designed to improve communication between clinicians. Outcome measures should include measures of patient-oriented outcomes and efficiency for clinicians. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.

The patient-specific functional scale: psychometrics, clinimetrics, and application as a clinical outcome measure.

PubMed

Horn, Katyana Kowalchuk; Jennings, Sophie; Richardson, Gillian; Vliet, Ditte Van; Hefford, Cheryl; Abbott, J Haxby

2012-01-01

Systematic review of the literature. To summarize peer-reviewed literature on the reliability, validity, and responsiveness of the Patient-Specific Functional Scale (PSFS), and to identify its use as an outcome measure. Searches were performed of several electronic databases from 1995 to May 2010. Studies included were published articles containing (1) primary research investigating the psychometric and clinimetrics of the PSFS or (2) the implementation of the PSFS as an outcome measure. We assessed the methodological quality of studies included in the first category. Two hundred forty-two articles published from 1994 to May 2010 were identified. Of these, 66 met the inclusion criteria for this review, with 13 reporting the measurement properties of the PSFS, 55 implementing the PSFS as an outcome measure, and 2 doing both of the above. The PSFS was reported to be valid, reliable, and responsive in populations with knee dysfunction, cervical radiculopathy, acute low back pain, mechanical low back pain, and neck dysfunction. The PSFS was found to be reliable and responsive in populations with chronic low back pain. The PSFS was also reported to be valid, reliable, or responsive in individuals with a limited number of acute, subacute, and chronic conditions. This review found that the PSFS is also being used as an outcome measure in many other conditions, despite a lack of published evidence supporting its validity in these conditions. Although the use of the PSFS as an outcome measure is increasing in physiotherapy practice, there are gaps in the research literature regarding its validity, reliability, and responsiveness in many health conditions.

Validity and reliability of the Turkish version of the Optimality Index-US (OI-US) to assess maternity care outcomes.

PubMed

Yucel, Cigdem; Taskin, Lale; Low, Lisa Kane

2015-12-01

Although obstetrical interventions are used commonly in Turkey, there is no standardized evidence-based assessment tool to evaluate maternity care outcomes. The Optimality Index-US (OI-US) is an evidence-based tool that was developed for the purpose of measuring aggregate perinatal care processes and outcomes against an optimal or best possible standard. This index has been validated and used in Netherlands, USA and UK until now. The objective of this study was to adapt the OI-US to assess maternity care outcomes in Turkey. Translation and back translation were used to develop the Optimality Index-Turkey (OI-TR) version. To evaluate the content validity of the OI-TR, an expert panel group (n=10) reviewed the items and evidence-based quality of the OI-TR for application in Turkey. Following the content validity process, the OI-TR was used to assess 150 healthy and 150 high-risk pregnant women who gave birth at a high volume, urban maternity hospital in Turkey. The scores between the two groups were compared to assess the discriminant validity of the OI-TR. The percentage of agreement between two raters and the Kappa statistic were calculated to evaluate the reliability. Content validity was established for the OI-TR by an expert group. Discriminant validity was confirmed by comparing the OI scores of healthy pregnant women (mean OI score=77.65%) and those of high-risk pregnant women (mean OI score=78.60%). The percentage of agreement between the two raters was 96.19, and inter-rater agreement was provided for each item in the OI-TR. OI-TR is a valid and reliable tool that can be used to assess maternity care outcomes in Turkey. The results of this study indicate that although the risk statuses of the women differed, the type of care they received was essentially the same, as measured by the OI-TR. Care was not individualised based on risk and for a majority of items was inconsistent with evidence based practice, which is not optimal. Use of the OI-TR will help to provide a standardized way to assess maternity care process and outcomes of maternity care in Turkey which can inform future research aimed at improving maternity care outcomes. Copyright © 2015 Elsevier Ltd. All rights reserved.

The Emotional Resources Group: Provisional outcome data for a pilot six-session emotion regulation programme for secondary care.

PubMed

Bacon, Thomas; Doughty, Caitriona; Summers, Andrew; Wiffen, Benjamin; Stanley, Zoe; McAlpine, Susan

2018-06-01

To examine the effectiveness of a new, six-session emotion regulation group intervention designed for the secondary care setting: The Emotional Resources Group (ERG). In this pilot study, participants were recruited by referral from secondary care mental health services. Forty-seven individuals participated in the study. Participants who attended the ERG were compared on measures of emotion regulation, well-being, and self-efficacy, pre- and post-intervention. Intent-to-treat analyses indicated highly statistically significant improvements in measures of emotion regulation, well-being, and self-efficacy, accompanied by large effect sizes. In addition, improvements in emotion regulation produced good rates of both reliable and clinically significant change. The ERG may be an effective, brief intervention to improve emotion regulation in the secondary care setting, worthy of further evaluation. Clinical implications Emotion regulation may be an appropriate treatment target to improve well-being and self-efficacy in a transdiagnostic population. The ERG may be effective as a brief emotion regulation intervention for secondary care mental health settings. Outcomes of the ERG appear to be equivalent to other more intensive group-based emotion regulation interventions. The ERG's tailored design may be responsible for positive outcomes. Limitations There was a small sample size. There was no control group. There was no follow-up data. © 2018 The British Psychological Society.

The development and validation of a questionnaire for rotator cuff disorders: The Functional Shoulder Score

PubMed Central

Ibrahim, Edward F; Petrou, Charalambos; Galanos, Antonis

2015-01-01

Background The purpose of the present study was to validate the Functional Shoulder Score (FSS), a new patient-reported outcome score specifically designed to evaluate patients with rotator cuff disorders. Methods One hundred and nineteen patients were assessed using two shoulder scoring systems [the FSS and the Constant–Murley Score (CMS)] at 3 weeks pre- and 6 months post-arthroscopic rotator cuff surgery. The reliability, validity, responsiveness and interpretability of the FSS were evaluated. Results Reliability analysis (test–retest) showed an intraclass correlation coefficient value of 0.96 [95% confidence interval (CI) = 0.92 to 0.98]. Internal consistency analysis revealed a Cronbach's alpha coefficient of 0.93. The Pearson correlation coefficient FSS-CMS was 0.782 pre-operatively and 0.737 postoperatively (p < 0.0005). There was a statistically significant increase in FSS scores postoperatively, an effect size of 3.06 and standardized response mean of 2.80. The value for minimal detectable change was ±8.38 scale points (based on a 90% CI) and the minimal clinically important difference for improvement was 24.7 ± 5.4 points. Conclusions The FSS is a patient-reported outcome measure that can easily be incorporated into clinical practice, providing a quick, reliable, valid and practical measure for rotator cuff problems. The questionnaire is highly sensitive to clinical change. PMID:27582986

Scoring ultrasound synovitis in rheumatoid arthritis: a EULAR-OMERACT ultrasound taskforce-Part 2: reliability and application to multiple joints of a standardised consensus-based scoring system

PubMed Central

Terslev, Lene; Naredo, Esperanza; Aegerter, Philippe; Wakefield, Richard J; Backhaus, Marina; Balint, Peter; Bruyn, George A W; Iagnocco, Annamaria; Jousse-Joulin, Sandrine; Schmidt, Wolfgang A; Szkudlarek, Marcin; Conaghan, Philip G; Filippucci, Emilio

2017-01-01

Objectives To test the reliability of new ultrasound (US) definitions and quantification of synovial hypertrophy (SH) and power Doppler (PD) signal, separately and in combination, in a range of joints in patients with rheumatoid arthritis (RA) using the European League Against Rheumatisms–Outcomes Measures in Rheumatology (EULAR-OMERACT) combined score for PD and SH. Methods A stepwise approach was used: (1) scoring static images of metacarpophalangeal (MCP) joints in a web-based exercise and subsequently when scanning patients; (2) scoring static images of wrist, proximal interphalangeal joints, knee and metatarsophalangeal joints in a web-based exercise and subsequently when scanning patients using different acquisitions (standardised vs usual practice). For reliability, kappa coefficients (κ) were used. Results Scoring MCP joints in static images showed substantial intraobserver variability but good to excellent interobserver reliability. In patients, intraobserver reliability was the same for the two acquisition methods. Interobserver reliability for SH (κ=0.87) and PD (κ=0.79) and the EULAR-OMERACT combined score (κ=0.86) were better when using a ‘standardised’ scan. For the other joints, the intraobserver reliability was excellent in static images for all scores (κ=0.8–0.97) and the interobserver reliability marginally lower. When using standardised scanning in patients, the intraobserver was good (κ=0.64 for SH and the EULAR-OMERACT combined score, 0.66 for PD) and the interobserver reliability was also good especially for PD (κ range=0.41–0.92). Conclusion The EULAR-OMERACT score demonstrated moderate-good reliability in MCP joints using a standardised scan and is equally applicable in non-MCP joints. This scoring system should underpin improved reliability and consequently the responsiveness of US in RA clinical trials. PMID:28948984

The ACTIVATE study: results from a group-randomized controlled trial comparing a traditional worksite health promotion program with an activated consumer program.

PubMed

Terry, Paul E; Fowles, Jinnet Briggs; Xi, Min; Harvey, Lisa

2011-01-01

PURPOSE. This study compares a traditional worksite-based health promotion program with an activated consumer program and a control program DESIGN. Group randomized controlled trial with 18-month intervention. SETTING. Two large Midwestern companies. SUBJECTS. Three hundred and twenty employees (51% response). INTERVENTION. The traditional health promotion intervention offered population-level campaigns on physical activity, nutrition, and stress management. The activated consumer intervention included population-level campaigns for evaluating health information, choosing a health benefits plan, and understanding the risks of not taking medications as prescribed. The personal development intervention (control group) offered information on hobbies. The interventions also offered individual-level coaching for high risk individuals in both active intervention groups. MEASURES. Health risk status, general health status, consumer activation, productivity, and the ability to evaluate health information. ANALYSIS. Multivariate analyses controlled for baseline differences among the study groups. RESULTS. At the population level, compared with baseline performance, the traditional health promotion intervention improved health risk status, consumer activation, and the ability to recognize reliable health websites. Compared with baseline performance, the activated consumer intervention improved consumer activation, productivity, and the ability to recognize reliable health websites. At the population level, however, only the activated consumer intervention improved any outcome more than the control group did; that outcome was consumer activation. At the individual level for high risk individuals, both traditional health coaching and activated consumer coaching positively affected health risk status and consumer activation. In addition, both coaching interventions improved participant ability to recognize a reliable health website. Consumer activation coaching also significantly improved self-reported productivity. CONCLUSION. An effective intervention can change employee health risk status and activation both at the population level and at the individual high risk level. However, program engagement at the population level was low, indicating that additional promotional strategies, such as greater use of incentives, need to be examined. Less intensive coaching can be as effective as more intensive, albeit both interventions produced modest behavior change and retention in the consumer activation arm was most difficult. Further research is needed concerning recruitment and retention methods that will enable populations to realize the full potential of activated consumerism.

Reliability and validity of the German version of the Utrecht Questionnaire for Outcome Assessment in Aesthetic Rhinoplasty (D-OAR).

PubMed

Spiekermann, Christoph; Rudack, Claudia; Stenner, Markus

2017-11-01

The outcome of aesthetic rhinoplasty is determined by the patient's subjective satisfaction with the nasal appearance which is difficult to assess. The Utrecht Questionnaire for Outcome Assessment in Aesthetic Rhinoplasty (OAR) is a brief and reliable instrument to assess the influence of the subjective nasal appearance on quality of life in patients undergoing aesthetic rhinoplasty. Preoperative application of this questionnaire reveals important aspects and possible disturbances of the body image which could be negative predictors concerning the result. On the other hand, it represents an appropriate tool to assess the postoperative outcome. The aim of this study was to determine the validity, reliability and responsiveness of the adapted German version of the OAR (D-OAR). The adaption of the OAR to German language was performed by a forward and backward translation process. Patients undergoing rhinoplasty were asked to complete the D-OAR preoperatively, 1, 3 and 12 months after procedure and healthy volunteers without any nasal complaints served as controls to test validity, reliability and responsiveness. An excellent internal consistency, a good test-retest reliability and good inter-item and item-total correlations demonstrated a good reliability of the D-OAR. The convincing validity of the adapted version was proven by an excellent discriminant and a sufficient content validity. Significant differences between pre- and postoperative D-OAR scores revealed a good responsiveness of the instrument. Hence, with a sufficient validity, reliability and sensitivity to changes, the D-OAR is a short and helpful instrument to assess the subjective perception of the nasal appearance in German patients.

Vascular Access Outcomes Reported in Maintenance Hemodialysis Trials: A Systematic Review.

PubMed

Viecelli, Andrea K; O'Lone, Emma; Sautenet, Benedicte; Craig, Jonathan C; Tong, Allison; Chemla, Eric; Hooi, Lai-Seong; Lee, Timmy; Lok, Charmaine; Polkinghorne, Kevan R; Quinn, Robert R; Vachharajani, Tushar; Vanholder, Raymond; Zuo, Li; Irish, Ashley B; Mori, Trevor A; Pascoe, Elaine M; Johnson, David W; Hawley, Carmel M

2018-03-01

Many randomized controlled trials have been performed with the goal of improving outcomes related to hemodialysis vascular access. If the reported outcomes are relevant and measured consistently to allow comparison of interventions across trials, such trials can inform decision making. This study aimed to assess the scope and consistency of vascular access outcomes reported in contemporary hemodialysis trials. Systematic review. Adults requiring maintenance hemodialysis. All randomized controlled trials and trial protocols reporting vascular access outcomes identified from ClinicalTrials.gov, Embase, MEDLINE, and the Cochrane Kidney and Transplant Specialized Register from January 2011 to June 2016. Any hemodialysis-related intervention. The frequency and characteristics of vascular access outcome measures were analyzed and classified. From 168 relevant trials, 1,426 access-related outcome measures were extracted and classified into 23 different outcomes. The 3 most common outcomes were function (136 [81%] trials), infection (63 [38%]), and maturation (31 [18%]). Function was measured in 489 different ways, but most frequently reported as "mean access blood flow (mL/min)" (37 [27%] trials) and "number of thromboses" (30 [22%]). Infection was assessed in 136 different ways, with "number of access-related infections" being the most common measure. Maturation was assessed in 44 different ways at 15 different time points and most commonly characterized by vein diameter and blood flow. Patient-reported outcomes, including pain (19 [11%]) and quality of life (5 [3%]), were reported infrequently. Only a minority of trials used previously standardized outcome definitions. Restricted sampling frame for feasibility and focus on contemporary trials. The reporting of access outcomes in hemodialysis trials is very heterogeneous, with limited patient-reported outcomes and infrequent use of standardized outcome measures. Efforts to standardize outcome reporting for vascular access are critical to optimizing the comparability, reliability, and value of trial evidence to improve outcomes for patients requiring hemodialysis. Copyright © 2017 National Kidney Foundation, Inc. All rights reserved.

Risk-adjusted hospital outcomes for children's surgery.

PubMed

Saito, Jacqueline M; Chen, Li Ern; Hall, Bruce L; Kraemer, Kari; Barnhart, Douglas C; Byrd, Claudia; Cohen, Mark E; Fei, Chunyuan; Heiss, Kurt F; Huffman, Kristopher; Ko, Clifford Y; Latus, Melissa; Meara, John G; Oldham, Keith T; Raval, Mehul V; Richards, Karen E; Shah, Rahul K; Sutton, Laura C; Vinocur, Charles D; Moss, R Lawrence

2013-09-01

BACKGROUND The American College of Surgeons National Surgical Quality Improvement Program-Pediatric was initiated in 2008 to drive quality improvement in children's surgery. Low mortality and morbidity in previous analyses limited differentiation of hospital performance. Participating institutions included children's units within general hospitals and free-standing children's hospitals. Cases selected by Current Procedural Terminology codes encompassed procedures within pediatric general, otolaryngologic, orthopedic, urologic, plastic, neurologic, thoracic, and gynecologic surgery. Trained personnel abstracted demographic, surgical profile, preoperative, intraoperative, and postoperative variables. Incorporating procedure-specific risk, hierarchical models for 30-day mortality and morbidities were developed with significant predictors identified by stepwise logistic regression. Reliability was estimated to assess the balance of information versus error within models. In 2011, 46 281 patients from 43 hospitals were accrued; 1467 codes were aggregated into 226 groupings. Overall mortality was 0.3%, composite morbidity 5.8%, and surgical site infection (SSI) 1.8%. Hierarchical models revealed outlier hospitals with above or below expected performance for composite morbidity in the entire cohort, pediatric abdominal subgroup, and spine subgroup; SSI in the entire cohort and pediatric abdominal subgroup; and urinary tract infection in the entire cohort. Based on reliability estimates, mortality discriminates performance poorly due to very low event rate; however, reliable model construction for composite morbidity and SSI that differentiate institutions is feasible. The National Surgical Quality Improvement Program-Pediatric expansion has yielded risk-adjusted models to differentiate hospital performance in composite and specific morbidities. However, mortality has low utility as a children's surgery performance indicator. Programmatic improvements have resulted in actionable data.

A Study of Foreign Language Learning Outcomes Assessment in U.S. Undergraduate Education

ERIC Educational Resources Information Center

Ricardo-Osorio, Jose G.

2008-01-01

This article reports on findings obtained from an online survey answered by 97 foreign language department chairs. The Web survey was pilot tested for validity and reliability and obtained a Cronbach's reliability coefficient of .80. The results suggest that student learning outcomes assessment in American undergraduate foreign language education…

Goal setting as an outcome measure: A systematic review.

PubMed

Hurn, Jane; Kneebone, Ian; Cropley, Mark

2006-09-01

Goal achievement has been considered to be an important measure of outcome by clinicians working with patients in physical and neurological rehabilitation settings. This systematic review was undertaken to examine the reliability, validity and sensitivity of goal setting and goal attainment scaling approaches when used with working age and older people. To review the reliability, validity and sensitivity of both goal setting and goal attainment scaling when employed as an outcome measure within a physical and neurological working age and older person rehabilitation environment, by examining the research literature covering the 36 years since goal-setting theory was proposed. Data sources included a computer-aided literature search of published studies examining the reliability, validity and sensitivity of goal setting/goal attainment scaling, with further references sourced from articles obtained through this process. There is strong evidence for the reliability, validity and sensitivity of goal attainment scaling. Empirical support was found for the validity of goal setting but research demonstrating its reliability and sensitivity is limited. Goal attainment scaling appears to be a sound measure for use in physical rehabilitation settings with working age and older people. Further work needs to be carried out with goal setting to establish its reliability and sensitivity as a measurement tool.

Translation and validation of the Self-care of Heart Failure Index into Persian.

PubMed

Siabani, Soraya; Leeder, Stephen R; Davidson, Patricia M; Najafi, Farid; Hamzeh, Behrooz; Solimani, Akram; Siahbani, Sara; Driscoll, Tim

2014-01-01

Chronic heart failure (CHF) is a common burdensome health problem worldwide. Self-care improves outcomes in patients with CHF. The Self-care of Heart Failure Index (SCHFI) is a well-known scale for assessing self-care. A reliable, valid, and culturally acceptable instrument is needed to develop and test self-care interventions in Iran. We sought to translate and validate the Persian version of SCHFI v 6.2 (pSCHFI). We translated the SCHFI into Persian (pSCHFI) using standardized methods. The reliability was evaluated by assessing Cronbach's α coefficient. Expert opinion, discussion with patients, and confirmatory factor analysis were used to assess face validity, content validity, and construct validity, respectively. The analysis, using 184 participants, showed acceptable internal consistency and construct validity for the 3 subscales of pSCHFI-self-care maintenance, self-care management, and self-care self-confidence. The pSCHFI is a valid instrument with an acceptable reliability for evaluating self-care in Persian patients with heart failure.

The "RAPID" cognitive-behavioral therapy program for inattentive children: preliminary findings.

PubMed

Young, Susan

2013-08-01

The objectives of the current study were to ascertain feasibility and acceptability of directly delivering a cognitive-behavioral therapy (CBT) group intervention for inattentive children in a school setting, to examine the reliability of the RATE-CQuestionnaires that accompany the program, and to determine whether they can be used to measure outcome. Eighty-eight parents/carers, their children (age 8-11), and teachers at mainstream primary schools in London participated by completing the RATE-C Questionnaires; 48 participated in the group treatment following which the Questionnaires were readministered together with a semistructured interview. The intervention had a completion rate of 92%. Postgroup interviews supported the acceptability of a direct intervention with young children. Reliability of the RATE-C Total scores was excellent for parent/carer, child, and teacher ratings; postintervention parent/carer ratings indicated significant improvement on scales of attention, emotion, and conduct with medium to large effect. The results support the reliability of the RATE-C Scales, and feasibility and acceptability of the RAPID intervention.

Chapter 15: Disease Gene Prioritization

PubMed Central

Bromberg, Yana

2013-01-01

Disease-causing aberrations in the normal function of a gene define that gene as a disease gene. Proving a causal link between a gene and a disease experimentally is expensive and time-consuming. Comprehensive prioritization of candidate genes prior to experimental testing drastically reduces the associated costs. Computational gene prioritization is based on various pieces of correlative evidence that associate each gene with the given disease and suggest possible causal links. A fair amount of this evidence comes from high-throughput experimentation. Thus, well-developed methods are necessary to reliably deal with the quantity of information at hand. Existing gene prioritization techniques already significantly improve the outcomes of targeted experimental studies. Faster and more reliable techniques that account for novel data types are necessary for the development of new diagnostics, treatments, and cure for many diseases. PMID:23633938

Chronic Fatigue Syndrome and Myalgic Encephalomyelitis: Toward An Empirical Case Definition

PubMed Central

Jason, Leonard A.; Kot, Bobby; Sunnquist, Madison; Brown, Abigail; Evans, Meredyth; Jantke, Rachel; Williams, Yolonda; Furst, Jacob; Vernon, Suzanne D.

2015-01-01

Current case definitions of Myalgic Encephalomyelitis (ME) and chronic fatigue syndrome (CFS) have been based on consensus methods, but empirical methods could be used to identify core symptoms and thereby improve the reliability. In the present study, several methods (i.e., continuous scores of symptoms, theoretically and empirically derived cut off scores of symptoms) were used to identify core symptoms best differentiating patients from controls. In addition, data mining with decision trees was conducted. Our study found a small number of core symptoms that have good sensitivity and specificity, and these included fatigue, post-exertional malaise, a neurocognitive symptom, and unrefreshing sleep. Outcomes from these analyses suggest that using empirically selected symptoms can help guide the creation of a more reliable case definition. PMID:26029488

Connectivity Predicts Deep Brain Stimulation Outcome in Parkinson Disease

PubMed Central

Horn, Andreas; Reich, Martin; Vorwerk, Johannes; Li, Ningfei; Wenzel, Gregor; Fang, Qianqian; Schmitz-Hübsch, Tanja; Nickl, Robert; Kupsch, Andreas; Volkmann, Jens; Kühn, Andrea A.; Fox, Michael D.

2018-01-01

Objective The benefit of deep brain stimulation (DBS) for Parkinson disease (PD) may depend on connectivity between the stimulation site and other brain regions, but which regions and whether connectivity can predict outcome in patients remain unknown. Here, we identify the structural and functional connectivity profile of effective DBS to the subthalamic nucleus (STN) and test its ability to predict outcome in an independent cohort. Methods A training dataset of 51 PD patients with STN DBS was combined with publicly available human connectome data (diffusion tractography and resting state functional connectivity) to identify connections reliably associated with clinical improvement (motor score of the Unified Parkinson Disease Rating Scale [UPDRS]). This connectivity profile was then used to predict outcome in an independent cohort of 44 patients from a different center. Results In the training dataset, connectivity between the DBS electrode and a distributed network of brain regions correlated with clinical response including structural connectivity to supplementary motor area and functional anticorrelation to primary motor cortex (p<0.001). This same connectivity profile predicted response in an independent patient cohort (p<0.01). Structural and functional connectivity were independent predictors of clinical improvement (p<0.001) and estimated response in individual patients with an average error of 15% UPDRS improvement. Results were similar using connectome data from normal subjects or a connectome age, sex, and disease matched to our DBS patients. Interpretation Effective STN DBS for PD is associated with a specific connectivity profile that can predict clinical outcome across independent cohorts. This prediction does not require specialized imaging in PD patients themselves. PMID:28586141

[Psychometric properties of Q-DIO, an instrument to measure the quality of documented nursing diagnoses, interventions and outcomes].

PubMed

Müller-Staub, Maria; Lunney, Margaret; Lavin, Mary Ann; Needham, Ian; Odenbreit, Matthias; van Achterberg, Theo

2010-04-01

The instrument Q-DIO was developed in the years 2005 till 2006 to measure the quality of documented nursing diagnoses, interventions, and nursing sensitive patient outcomes. Testing psychometric properties of the Q-DIO (Quality of nursing Diagnoses, Interventions and Outcomes.) was the study aim. Instrument testing included internal consistency, test-retest reliability, interrater reliability, item analyses, and an assessment of the objectivity. To render variation in scores, a random strata sample of 60 nursing documentations was drawn. The strata represented 30 nursing documentations with and 30 without application of theory based, standardised nursing language. Internal consistency of the subscale nursing diagnoses as process showed Cronbach's Alpha 0.83 [0.78, 0.88]; nursing diagnoses as product 0.98 [0.94, 0.99]; nursing interventions 0.90 [0.85, 0.94]; and nursing-sensitive patient outcomes 0.99 [0.95, 0.99]. With Cohen's Kappa of 0.95, the intrarater reliability was good. The interrater reliability showed a Kappa of 0.94 [0.90, 0.96]. Item analyses confirmed the fulfilment of criteria for degree of difficulty and discriminative validity of the items. In this study, Q-DIO has shown to be a reliable instrument. It allows measuring the documented quality of nursing diagnoses, interventions and outcomes with and without implementation of theory based, standardised nursing languages. Studies for further testing of Q-DIO in other settings are recommended. The results implicitly support the use of nursing classifications such as NANDA, NIC and NOC.

Behavioral and cognitive outcomes for clinical trials in children with neurofibromatosis type 1.

PubMed

van der Vaart, Thijs; Rietman, André B; Plasschaert, Ellen; Legius, Eric; Elgersma, Ype; Moll, Henriëtte A

2016-01-12

To evaluate the appropriateness of cognitive and behavioral outcome measures in clinical trials in neurofibromatosis type 1 (NF1) by analyzing the degree of deficits compared to reference groups, test-retest reliability, and how scores correlate between outcome measures. Data were analyzed from the Simvastatin for cognitive deficits and behavioral problems in patients with neurofibromatosis type 1 (NF1-SIMCODA) trial, a randomized placebo-controlled trial of simvastatin for cognitive deficits and behavioral problems in children with NF1. Outcome measures were compared with age-specific reference groups to identify domains of dysfunction. Pearson r was computed for before and after measurements within the placebo group to assess test-retest reliability. Principal component analysis was used to identify the internal structure in the outcome data. Strongest mean score deviations from the reference groups were observed for full-scale intelligence (-1.1 SD), Rey Complex Figure Test delayed recall (-2.0 SD), attention problems (-1.2 SD), and social problems (-1.1 SD). Long-term test-retest reliability were excellent for Wechsler scales (r > 0.88), but poor to moderate for other neuropsychological tests (r range 0.52-0.81) and Child Behavioral Checklist subscales (r range 0.40-0.79). The correlation structure revealed 2 strong components in the outcome measures behavior and cognition, with no correlation between these components. Scores on psychosocial quality of life correlate strongly with behavioral problems and less with cognitive deficits. Children with NF1 show distinct deficits in multiple domains. Many outcome measures showed weak test-retest correlations over the 1-year trial period. Cognitive and behavioral outcomes are complementary. This analysis demonstrates the need to include reliable outcome measures on a variety of cognitive and behavioral domains in clinical trials for NF1. © 2015 American Academy of Neurology.

The Cleft Care UK study. Part 4: perceptual speech outcomes

PubMed Central

Sell, D; Mildinhall, S; Albery, L; Wills, A K; Sandy, J R; Ness, A R

2015-01-01

Structured Abstract Objectives To describe the perceptual speech outcomes from the Cleft Care UK (CCUK) study and compare them to the 1998 Clinical Standards Advisory Group (CSAG) audit. Setting and sample population A cross-sectional study of 248 children born with complete unilateral cleft lip and palate, between 1 April 2005 and 31 March 2007 who underwent speech assessment. Materials and methods Centre-based specialist speech and language therapists (SLT) took speech audio–video recordings according to nationally agreed guidelines. Two independent listeners undertook the perceptual analysis using the CAPS-A Audit tool. Intra- and inter-rater reliability were tested. Results For each speech parameter of intelligibility/distinctiveness, hypernasality, palatal/palatalization, backed to velar/uvular, glottal, weak and nasalized consonants, and nasal realizations, there was strong evidence that speech outcomes were better in the CCUK children compared to CSAG children. The parameters which did not show improvement were nasal emission, nasal turbulence, hyponasality and lateral/lateralization. Conclusion These results suggest that centralization of cleft care into high volume centres has resulted in improvements in UK speech outcomes in five-year-olds with unilateral cleft lip and palate. This may be associated with the development of a specialized workforce. Nevertheless, there still remains a group of children with significant difficulties at school entry. PMID:26567854

The Cleft Care UK study. Part 4: perceptual speech outcomes.

PubMed

Sell, D; Mildinhall, S; Albery, L; Wills, A K; Sandy, J R; Ness, A R

2015-11-01

To describe the perceptual speech outcomes from the Cleft Care UK (CCUK) study and compare them to the 1998 Clinical Standards Advisory Group (CSAG) audit. A cross-sectional study of 248 children born with complete unilateral cleft lip and palate, between 1 April 2005 and 31 March 2007 who underwent speech assessment. Centre-based specialist speech and language therapists (SLT) took speech audio-video recordings according to nationally agreed guidelines. Two independent listeners undertook the perceptual analysis using the CAPS-A Audit tool. Intra- and inter-rater reliability were tested. For each speech parameter of intelligibility/distinctiveness, hypernasality, palatal/palatalization, backed to velar/uvular, glottal, weak and nasalized consonants, and nasal realizations, there was strong evidence that speech outcomes were better in the CCUK children compared to CSAG children. The parameters which did not show improvement were nasal emission, nasal turbulence, hyponasality and lateral/lateralization. These results suggest that centralization of cleft care into high volume centres has resulted in improvements in UK speech outcomes in five-year-olds with unilateral cleft lip and palate. This may be associated with the development of a specialized workforce. Nevertheless, there still remains a group of children with significant difficulties at school entry. © The Authors. Orthodontics & Craniofacial Research Published by John Wiley & Sons Ltd.

CBT competence in novice therapists improves anxiety outcomes.

PubMed

Brown, Lily A; Craske, Michelle G; Glenn, Daniel E; Stein, Murray B; Sullivan, Greer; Sherbourne, Cathy; Bystritsky, Alexander; Welch, Stacy S; Campbell-Sills, Laura; Lang, Ariel; Roy-Byrne, Peter; Rose, Raphael D

2013-02-01

This study explores the relationships between therapist variables (cognitive behavioral therapy [CBT] competence, and CBT adherence) and clinical outcomes of computer-assisted CBT for anxiety disorders delivered by novice therapists in a primary care setting. Participants were recruited for a randomized controlled trial of evidence-based treatment, including computer-assisted CBT, versus treatment as usual. Therapists (anxiety clinical specialists; ACSs) were nonexpert clinicians, many of whom had no prior experience in delivering psychotherapy (and in particular, very little experience with CBT). Trained raters reviewed randomly selected treatment sessions from 176 participants and rated therapists on measures of CBT competence and CBT adherence. Patients were assessed at baseline and at 6-, 12-, and 18-month follow-ups on measures of anxiety, depression, and functioning, and an average Reliable Change Index was calculated as a composite measure of outcome. CBT competence and CBT adherence were entered as predictors of outcome, after controlling for baseline covariates. Higher CBT competence was associated with better clinical outcomes whereas CBT adherence was not. Also, CBT competence was inversely correlated with years of clinical experience and trended (not significantly, though) down as the study progressed. CBT adherence was inversely correlated with therapist tenure in the study. Therapist competence was related to improved clinical outcomes when CBT for anxiety disorders was delivered by novice clinicians with technology assistance. The results highlight the value of the initial training for novice therapists as well as booster training to limit declines in therapist adherence. © 2012 Wiley Periodicals, Inc.

CBT competence in novice therapists improves anxiety outcomes

PubMed Central

Brown, Lily A.; Craske, Michelle G.; Glenn, Daniel E.; Stein, Murray B.; Sullivan, Greer; Sherbourne, Cathy; Bystritsky, Alexander; Welch, Stacy S.; Campbell-Sills, Laura; Lang, Ariel; Roy-Byrne, Peter; Rose, Raphael D.

2013-01-01

Objective This study explores the relationships between therapist variables (CBT competence, and CBT adherence) and clinical outcomes of computer-assisted CBT for anxiety disorders delivered by novice therapists in a primary care setting. Methods Participants were recruited for a randomized controlled trial of evidence-based treatment, including computer-assisted CBT, versus treatment as usual. Therapists (Anxiety Clinical Specialists; ACSs) were non-expert clinicians, many of whom had no prior experience in delivering psychotherapy (and in particular, very little experience with CBT). Trained raters reviewed randomly selected treatment sessions from 176 participants and rated therapists on measures of CBT-competence and CBT-adherence. Patients were assessed at baseline and at 6, 12, and 18 month follow-ups on measures of anxiety, depression, and functioning, and an average reliable change index was calculated as a composite measure of outcome. CBT-competence and CBT-adherence were entered as predictors of outcome, after controlling for baseline covariates. Results Higher CBT-competence was associated with better clinical outcomes whereas CBT-adherence was not. Also, CBT-competence was inversely correlated with years of clinical experience and trended (not significantly, though) down as the study progressed. CBT-adherence was inversely correlated with therapist tenure in the study. Conclusions Therapist competence was related to improved clinical outcomes when CBT for anxiety disorders was delivered by novice clinicians with technology assistance. The results highlight the value of the initial training for novice therapists as well as booster training to limit declines in therapist adherence. PMID:23225338

Cost-effectiveness of an improving access to psychological therapies service.

PubMed

Mukuria, Clara; Brazier, John; Barkham, Michael; Connell, Janice; Hardy, Gillian; Hutten, Rebecca; Saxon, Dave; Dent-Brown, Kim; Parry, Glenys

2013-03-01

Effective psychological therapies have been recommended for common mental health problems, such as depression and anxiety, but provision has been poor. Improving Access to Psychological Therapies (IAPT) may provide a cost-effective solution to this problem. To determine the cost-effectiveness of IAPT at the Doncaster demonstration site (2007-2009). An economic evaluation comparing costs and health outcomes for patients at the IAPT demonstration site with those for comparator sites, including a separate assessment of lost productivity. Sensitivity analyses were undertaken. The IAPT site had higher service costs and was associated with small additional gains in quality-adjusted life-years (QALYs) compared with its comparator sites, resulting in a cost per QALY gained of £29 500 using the Short Form (SF-6D). Sensitivity analysis using predicted EQ-5D scores lowered this to £16 857. Costs per reliable and clinically significant (RCS) improvement were £9440 per participant. Improving Access to Psychological Therapies provided a service that was probably cost-effective within the usual National Institute for Health and Clinical Excellence (NICE) threshold range of £20 000-30 000, but there was considerable uncertainty surrounding the costs and outcome differences.

Response to ProPublica's Rebuttal of Our Critique of the Surgeon Scorecard

PubMed Central

Friedberg, Mark W.; Bilimoria, Karl Y.; Pronovost, Peter J.; Shahian, David M.; Damberg, Cheryl L.; Zaslavsky, Alan M.

2016-01-01

Abstract In the summer of 2015, ProPublica published its Surgeon Scorecard, which displays “Adjusted Complication Rates” for individual, named surgeons for eight surgical procedures performed in hospitals. Public reports of provider performance have the potential to improve the quality of health care that patients receive. A valid performance report can drive quality improvement and usefully inform patients' choices of providers. However, performance reports with poor validity and reliability are potentially damaging to all involved. In September 2015, RAND released a critique of the Scorecard authored by a group of health policy researchers from RAND and other institutions, and on October 7, 2015 ProPublica published a rebuttal of our critique. In this follow-on Perspective, we revisit the main points in our initial critique, summarize ProPublica's rebuttal, explain why this rebuttal fails to address our methodological concerns, provide suggestions on how to validate and improve the Scorecard, and explain why we continue to advise potential users of the Scorecard, as it is currently constructed, not to consider it a valid or reliable predictor of the health outcomes any individual surgeon is likely to provide. PMID:28083432

The development of the Nucleus Freedom Cochlear implant system.

PubMed

Patrick, James F; Busby, Peter A; Gibson, Peter J

2006-12-01

Cochlear Limited (Cochlear) released the fourth-generation cochlear implant system, Nucleus Freedom, in 2005. Freedom is based on 25 years of experience in cochlear implant research and development and incorporates advances in medicine, implantable materials, electronic technology, and sound coding. This article presents the development of Cochlear's implant systems, with an overview of the first 3 generations, and details of the Freedom system: the CI24RE receiver-stimulator, the Contour Advance electrode, the modular Freedom processor, the available speech coding strategies, the input processing options of Smart Sound to improve the signal before coding as electrical signals, and the programming software. Preliminary results from multicenter studies with the Freedom system are reported, demonstrating better levels of performance compared with the previous systems. The final section presents the most recent implant reliability data, with the early findings at 18 months showing improved reliability of the Freedom implant compared with the earlier Nucleus 3 System. Also reported are some of the findings of Cochlear's collaborative research programs to improve recipient outcomes. Included are studies showing the benefits from bilateral implants, electroacoustic stimulation using an ipsilateral and/or contralateral hearing aid, advanced speech coding, and streamlined speech processor programming.

Development of a core outcome set for clinical trials in facial aging: study protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey.

PubMed

Schlessinger, Daniel I; Iyengar, Sanjana; Yanes, Arianna F; Henley, Jill K; Ashchyan, Hovik J; Kurta, Anastasia O; Patel, Payal M; Sheikh, Umar A; Franklin, Matthew J; Hanna, Courtney C; Chen, Brian R; Chiren, Sarah G; Schmitt, Jochen; Deckert, Stefanie; Furlan, Karina C; Poon, Emily; Maher, Ian A; Cartee, Todd V; Sobanko, Joseph F; Alam, Murad

2017-08-01

Facial aging is a concern for many patients. Wrinkles, loss of volume, and discoloration are common physical manifestations of aging skin. Genetic heritage, prior ultraviolet light exposure, and Fitzpatrick skin type may be associated with the rate and type of facial aging. Although many clinical trials assess the correlates of skin aging, there is heterogeneity in the outcomes assessed, which limits the quality of evaluation and comparison of treatment modalities. To address the inconsistency in outcomes, in this project we will develop a core set of outcomes that are to be evaluated in all clinical trials relevant to facial aging. A long list of measureable outcomes will be created from four sources: (1) systematic medical literature review, (2) patient interviews, (3) other published sources, and (4) stakeholder involvement. Two rounds of Delphi processes with homogeneous groups of physicians and patients will be performed to prioritize and condense the list. At a consensus meeting attended by physicians, patients, and stakeholders, outcomes will be further condensed on the basis of participant scores. By the end of the meeting, members will vote and decide on a final recommended set of core outcomes. Subsequent to this, specific measures will be selected or created to assess these outcomes. The aim of this study is to develop a core outcome set and relevant measures for clinical trials relevant to facial aging. We hope to improve the reliability and consistency of outcome reporting of skin aging, thereby enabling improved evaluation of treatment efficacy and patient satisfaction. Core Outcome Measures in Effectiveness Trials (COMET) Initiative, accessible at http://www.comet-initiative.org/studies/details/737 . Core Outcomes Set Initiative, (CSG-COUSIN) accessible at https://www.uniklinikum-dresden.de/de/das-klinikum/universitaetscentren/zegv/cousin/meet-the-teams/project-groups/core-outcome-set-for-the-appearance-of-facial-aging . Protocol version date is 28 July 2016.

Fibromyalgia syndrome module at OMERACT 9: domain construct.

PubMed

Mease, Philip; Arnold, Lesley M; Choy, Ernest H; Clauw, Daniel J; Crofford, Leslie J; Glass, Jennifer M; Martin, Susan A; Morea, Jessica; Simon, Lee; Strand, C Vibeke; Williams, David A

2009-10-01

The objective of the module was to (1) establish a core domain set for fibromyalgia (FM) assessment in clinical trials and practice, (2) review outcome measure performance characteristics, (3) discuss development of a responder index for assessment of FM in clinical trials, (4) review objective markers, (5) review the domain of cognitive dysfunction, and (6) establish a research agenda for outcomes research. Presentations at the module included: (1) Results of univariate and multivariate analysis of 10 FM clinical trials of 4 drugs, mapping key domains identified in previous patient focus group: Delphi exercises and a clinician/researcher Delphi exercise, and breakout discussions to vote on possible essential domains and reliable measures; (2) Updates regarding outcome measure status; (3) Update on objective markers to measure FM disease state; and (4) Review of the issue of cognitive dysfunction (dyscognition) in FM. Consensus was reached as follows: (1) Greater than 70% of OMERACT participants agreed that pain, tenderness, fatigue, patient global, multidimensional function and sleep disturbance domains should be measured in all FM clinical trials; dyscognition and depression should be measured in some trials; and stiffness, anxiety, functional imaging, and cerebrospinal fluid biomarkers were identified as domains of research interest. (2) FM domain outcome measures have generally proven to be reliable, discriminative, and feasible. More sophisticated and comprehensive measures are in development, as is a responder index for FM. (3) Increasing numbers of objective markers are being developed for FM assessment. (4) Cognitive dysfunction assessment by self-assessed and applied outcome measures is being developed. In conclusion, a multidimensional symptom core set is proposed for evaluation of FM in clinical trials. Research on improved measures of single domains and composite measures is ongoing.

A clinician-administered severity rating scale for illness anxiety: development, reliability, and validity of the H-YBOCS-M.

PubMed

Skritskaya, Natalia A; Carson-Wong, Amanda R; Moeller, James R; Shen, Sa; Barsky, Arthur J; Fallon, Brian A

2012-07-01

Clinician-administered measures to assess severity of illness anxiety and response to treatment are few. The authors evaluated a modified version of the hypochondriasis-Y-BOCS (H-YBOCS-M), a 19-item, semistructured, clinician-administered instrument designed to rate severity of illness-related thoughts, behaviors, and avoidance. The scale was administered to 195 treatment-seeking adults with DSM-IV hypochondriasis. Test-retest reliability was assessed in a subsample of 20 patients. Interrater reliability was assessed by 27 interviews independently rated by four raters. Sensitivity to change was evaluated in a subsample of 149 patients. Convergent and discriminant validity was examined by comparing H-YBOCS-M scores to other measures administered. Item clustering was examined with confirmatory and exploratory factor analyses. The H-YBOCS-M demonstrated good internal consistency, interrater and test-retest reliability, and sensitivity to symptom change with treatment. Construct validity was supported by significant higher correlations with scores on other measures of hypochondriasis than with nonhypochondriacal measures. Improvement over time in response to treatment correlated with improvement both on measures of hypochondriasis and on measures of somatization, depression, anxiety, and functional status. Confirmatory factor analysis did not show adequate fit for a three-factor model. Exploratory factor analysis revealed a five-factor solution with the first two factors consistent with the separation of the H-YBOCS-M items into the subscales of illness-related avoidance and compulsions. H-YBOCS-M appears to be valid, reliable, and appropriate as an outcome measure for treatment studies of illness anxiety. Study results highlight "avoidance" as a key feature of illness anxiety-with potentially important nosologic and treatment implications. © 2012 Wiley Periodicals, Inc.

A CLINICIAN-ADMINISTERED SEVERITY RATING SCALE FOR ILLNESS ANXIETY: DEVELOPMENT, RELIABILITY, AND VALIDITY OF THE H-YBOCS-M

PubMed Central

Skritskaya, Natalia A.; Carson-Wong, Amanda R.; Moeller, James R.; Shen, Sa; Barsky, Arthur J.; Fallon, Brian A.

2012-01-01

Background Clinician-administered measures to assess severity of illness anxiety and response to treatment are few. The authors evaluated a modified version of the hypochondriasis-Y-BOCS (H-YBOCS-M), a 19-item, semistructured, clinician-administered instrument designed to rate severity of illness-related thoughts, behaviors, and avoidance. Methods The scale was administered to 195 treatment-seeking adults with DSM-IV hypochondriasis. Test–retest reliability was assessed in a subsample of 20 patients. Interrater reliability was assessed by 27 interviews independently rated by four raters. Sensitivity to change was evaluated in a subsample of 149 patients. Convergent and discriminant validity was examined by comparing H-YBOCS-M scores to other measures administered. Item clustering was examined with confirmatory and exploratory factor analyses. Results The H-YBOCS-M demonstrated good internal consistency, interrater and test–retest reliability, and sensitivity to symptom change with treatment. Construct validity was supported by significant higher correlations with scores on other measures of hypochondriasis than with nonhypochondriacal measures. Improvement over time in response to treatment correlated with improvement both on measures of hypochondriasis and on measures of somatization, depression, anxiety, and functional status. Confirmatory factor analysis did not show adequate fit for a three-factor model. Exploratory factor analysis revealed a five-factor solution with the first two factors consistent with the separation of the H-YBOCS-M items into the subscales of illness-related avoidance and compulsions. Conclusions H-YBOCS-M appears to be valid, reliable, and appropriate as an outcome measure for treatment studies of illness anxiety. Study results highlight “avoidance” as a key feature of illness anxiety—with potentially important nosologic and treatment implications. PMID:22504935

Reliability of Verbal Handoff Assessment and Handoff Quality Before and After Implementation of a Resident Handoff Bundle.

PubMed

Feraco, Angela M; Starmer, Amy J; Sectish, Theodore C; Spector, Nancy D; West, Daniel C; Landrigan, Christopher P

2016-08-01

1) To develop validity evidence for the use of the Verbal Handoff Assessment Tool (VHAT) and examine the reliability of VHAT scores, and 2) to determine whether implementation of a resident handoff bundle (RHB) was associated with improved verbal patient handoffs among pediatric resident physicians. In a pre-post design, prospectively audio recorded verbal patient handoffs conducted at Boston Children's Hospital before and after implementation of the RHB were rated using the VHAT, which was developed for this study (primary outcome). Using generalizability theory, we evaluated the reliability of VHAT scores. Overall, VHAT scores increased after RHB implementation (mean 142 vs 191, possible score 0-500; P < .0001). When accounting for clustering according to resident physician, hospital unit, unit census, and patient complexity, implementation of the RHB was associated with a 63-point increase in VHAT score. Using generalizability theory, we determined that a resident's mean VHAT score on the basis of a handoff of 15 patients assessed by a single observer was sufficiently reliable for relative ranking decisions (ie, norm-based; generalizability coefficient, 0.81), whereas a VHAT score on the basis of a handoff of 21 patients would be sufficiently reliable for high-stakes, standard-based decisions (Phi, 0.80). Verbal handoffs improved after implementation of a RHB, although gains were variable across the 2 clinical units. The VHAT shows promise as an assessment tool for resident handoff skills. If used for competency or entrustment decisions, a resident's mean VHAT score should be on the basis of observation of verbal handoff of ≥21 patients. Copyright © 2016 Academic Pediatric Association. Published by Elsevier Inc. All rights reserved.

Technology-assisted risk of bias assessment in systematic reviews: a prospective cross-sectional evaluation of the RobotReviewer machine learning tool.

PubMed

Gates, Allison; Vandermeer, Ben; Hartling, Lisa

2018-04-01

To evaluate the reliability of RobotReviewer's risk of bias judgments. In this prospective cross-sectional evaluation, we used RobotReviewer to assess risk of bias among 1,180 trials. We computed reliability with human reviewers using Cohen's kappa coefficient and calculated sensitivity and specificity. We investigated differences in reliability by risk of bias domain, topic, and outcome type using the chi-square test in meta-analysis. Reliability (95% CI) was moderate for random sequence generation (0.48 [0.43, 0.53]), allocation concealment (0.45 [0.40, 0.51]), and blinding of participants and personnel (0.42 [0.36, 0.47]); fair for overall risk of bias (0.34 [0.25, 0.44]); and slight for blinding of outcome assessors (0.10 [0.06, 0.14]), incomplete outcome data (0.14 [0.08, 0.19]), and selective reporting (0.02 [-0.02, 0.05]). Reliability for blinding of participants and personnel (P < 0.001), blinding of outcome assessors (P = 0.005), selective reporting (P < 0.001), and overall risk of bias (P < 0.001) differed by topic. Sensitivity and specificity (95% CI) ranged from 0.20 (0.18, 0.23) to 0.76 (0.72, 0.80) and from 0.61 (0.56, 0.65) to 0.95 (0.93, 0.96), respectively. Risk of bias appraisal is subjective. Compared with reliability between author groups, RobotReviewer's reliability with human reviewers was similar for most domains and better for allocation concealment, blinding of participants and personnel, and overall risk of bias. Copyright © 2018 Elsevier Inc. All rights reserved.

Design of a randomized, non-inferiority trial to evaluate the reliability of videoconferencing for remote consultation of diabetes.

PubMed

Fatehi, Farhad; Martin-Khan, Melinda; Gray, Leonard C; Russell, Anthony W

2014-02-14

An estimated 366 million people are living with diabetes worldwide and it is predicted that its prevalence will increase to 552 million by 2030. Management of this disease and its complications is a challenge for many countries. Optimal glycaemic control is necessary to minimize complications, but less than 70% of diabetic patients achieve target levels of blood glucose, partly due to poor access to qualified health care providers. Telemedicine has the potential to improve access to health care, especially for rural and remote residents. Video teleconsultation, a real-time (or synchronous) mode of telemedicine, is gaining more popularity around the world through recent improvements in digital telecommunications. If video consultation is to be offered as an alternative to face-to-face consultation in diabetes assessment and management, then it is important to demonstrate that this can be achieved without loss of clinical fidelity. This paper describes the protocol of a randomised controlled trail for assessing the reliability of remote video consultation for people with diabetes. A total of 160 people with diabetes will be randomised into either a Telemedicine or a Reference group. Participants in the Reference group will receive two sequential face-to-face consultations whereas in the Telemedicine group one consultation will be conducted face-to-face and the other via videoconference. The primary outcome measure will be a change in the patient's medication. Secondary outcome measures will be findings in physical examination, detecting complications, and patient satisfaction. A difference of less than 20% in the aggregated level of agreement between the two study groups will be used to identify if videoconference is non-inferior to traditional mode of clinical care (face-to-face). Despite rapid growth in application of telemedicine in a variety of medical specialties, little is known about the reliability of videoconferencing for remote consultation of people with diabetes. Results of this proposed study will provide evidence of the reliability of specialist consultation offered by videoconference for people with diabetes. Australian New Zealand Clinical Trials Registry ACTRN12612000315819.

Design of a randomized, non-inferiority trial to evaluate the reliability of videoconferencing for remote consultation of diabetes

PubMed Central

2014-01-01

Background An estimated 366 million people are living with diabetes worldwide and it is predicted that its prevalence will increase to 552 million by 2030. Management of this disease and its complications is a challenge for many countries. Optimal glycaemic control is necessary to minimize complications, but less than 70% of diabetic patients achieve target levels of blood glucose, partly due to poor access to qualified health care providers. Telemedicine has the potential to improve access to health care, especially for rural and remote residents. Video teleconsultation, a real-time (or synchronous) mode of telemedicine, is gaining more popularity around the world through recent improvements in digital telecommunications. If video consultation is to be offered as an alternative to face-to-face consultation in diabetes assessment and management, then it is important to demonstrate that this can be achieved without loss of clinical fidelity. This paper describes the protocol of a randomised controlled trail for assessing the reliability of remote video consultation for people with diabetes. Methods/Design A total of 160 people with diabetes will be randomised into either a Telemedicine or a Reference group. Participants in the Reference group will receive two sequential face-to-face consultations whereas in the Telemedicine group one consultation will be conducted face-to-face and the other via videoconference. The primary outcome measure will be a change in the patient’s medication. Secondary outcome measures will be findings in physical examination, detecting complications, and patient satisfaction. A difference of less than 20% in the aggregated level of agreement between the two study groups will be used to identify if videoconference is non-inferior to traditional mode of clinical care (face-to-face). Discussion Despite rapid growth in application of telemedicine in a variety of medical specialities, little is known about the reliability of videoconferencing for remote consultation of people with diabetes. Results of this proposed study will provide evidence of the reliability of specialist consultation offered by videoconference for people with diabetes. Trial registration number Australian New Zealand Clinical Trials Registry ACTRN12612000315819. PMID:24528569

Therapeutic hypothermia after cardiac arrest: outcome predictors

PubMed Central

Leão, Rodrigo Nazário; Ávila, Paulo; Cavaco, Raquel; Germano, Nuno; Bento, Luís

2015-01-01

Objective The determination of coma patient prognosis after cardiac arrest has clinical, ethical and social implications. Neurological examination, imaging and biochemical markers are helpful tools accepted as reliable in predicting recovery. With the advent of therapeutic hypothermia, these data need to be reconfirmed. In this study, we attempted to determine the validity of different markers, which can be used in the detection of patients with poor prognosis under hypothermia. Methods Data from adult patients admitted to our intensive care unit for a hypothermia protocol after cardiac arrest were recorded prospectively to generate a descriptive and analytical study analyzing the relationship between clinical, neurophysiological, imaging and biochemical parameters with 6-month outcomes defined according to the Cerebral Performance Categories scale (good 1-2, poor 3-5). Neuron-specific enolase was collected at 72 hours. Imaging and neurophysiologic exams were carried out in the 24 hours after the rewarming period. Results Sixty-seven patients were included in the study, of which 12 had good neurological outcomes. Ventricular fibrillation and electroencephalographic theta activity were associated with increased likelihood of survival and improved neurological outcomes. Patients who had more rapid cooling (mean time of 163 versus 312 minutes), hypoxic-ischemic brain injury on magnetic resonance imaging or neuron-specific enolase > 58ng/mL had poor neurological outcomes (p < 0.05). Conclusion Hypoxic-ischemic brain injury on magnetic resonance imaging and neuron-specific enolase were strong predictors of poor neurological outcomes. Although there is the belief that early achievement of target temperature improves neurological prognoses, in our study, there were increased mortality and worse neurological outcomes with earlier target-temperature achievement. PMID:26761469

What do I do? Developing a taxonomy of chaplaincy activities and interventions for spiritual care in intensive care unit palliative care.

PubMed

Massey, Kevin; Barnes, Marilyn J D; Villines, Dana; Goldstein, Julie D; Pierson, Anna Lee Hisey; Scherer, Cheryl; Vander Laan, Betty; Summerfelt, Wm Thomas

2015-01-01

Chaplains are increasingly seen as key members of interdisciplinary palliative care teams, yet the specific interventions and hoped for outcomes of their work are poorly understood. This project served to develop a standard terminology inventory for the chaplaincy field, to be called the chaplaincy taxonomy. The research team used a mixed methods approach to generate, evaluate and validate items for the taxonomy. We conducted a literature review, retrospective chart review, focus groups, self-observation, experience sampling, concept mapping, and reliability testing. Chaplaincy activities focused primarily on palliative care in an intensive care unit setting in order to capture a broad cross section of chaplaincy activities. Literature and chart review resulted in 438 taxonomy items for testing. Chaplain focus groups generated an additional 100 items and removed 421 items as duplications. Self-Observation, Experience Sampling and Concept Mapping provided validity that the taxonomy items were actual activities that chaplains perform in their spiritual care. Inter-rater reliability for chaplains to identify taxonomy items from vignettes was 0.903. The 100 item chaplaincy taxonomy provides a strong foundation for a normative inventory of chaplaincy activities and outcomes. A deliberative process is proposed to further expand and refine the taxonomy to create a standard terminological inventory for the field of chaplaincy. A standard terminology could improve the ways inter-disciplinary palliative care teams communicate about chaplaincy activities and outcomes.

Cognitive outcome and reliable change indices two years following bilateral subthalamic nucleus deep brain stimulation.

PubMed

Williams, Amy E; Arzola, Gladys Marina; Strutt, Adriana M; Simpson, Richard; Jankovic, Joseph; York, Michele K

2011-06-01

Subthalamic nucleus deep brain stimulation (STN-DBS) is currently the treatment of choice for medication-resistant levodopa-related motor complications in patients with Parkinson's disease (PD). While STN-DBS often results in meaningful motor improvements, consensus regarding long-term neuropsychological outcome continues to be debated. We assessed the cognitive outcomes of 19 STN-DBS patients compared to a group of 18 medically-managed PD patients on a comprehensive neuropsychological battery at baseline and two years post-surgery. Patients did not demonstrate changes in global cognitive functioning on screening measures. However, neuropsychological results revealed impairments in nonverbal recall, oral information processing speed, and lexical and semantic fluency in STN-DBS patients compared to PD controls 2 years post-surgery in these preliminary analyses. Additionally, reliable change indices revealed that approximately 50% of STN-DBS patients demonstrated significant declines in nonverbal memory and oral information processing speed compared to 25-30% of PD controls, and 26% of STN-DBS patients declined on lexical fluency compared to 11% of PD patients. Approximately 30% of both groups declined on semantic fluency. The number of STN-DBS patients who converted to dementia 2 years following surgery was not significantly different from the PD participants (32% versus 16%, respectively). Our results suggest that neuropsychological evaluations may identify possible mild cognitive changes following surgery. Copyright © 2011 Elsevier Ltd. All rights reserved.

A novel approach to leveraging electronic health record data to enhance pediatric surgical quality improvement bundle process compliance.

PubMed

Fisher, Jason C; Godfried, David H; Lighter-Fisher, Jennifer; Pratko, Joseph; Sheldon, Mary Ellen; Diago, Thelma; Kuenzler, Keith A; Tomita, Sandra S; Ginsburg, Howard B

2016-06-01

Quality improvement (QI) bundles have been widely adopted to reduce surgical site infections (SSI). Improvement science suggests when organizations achieve high-reliability to QI processes, outcomes dramatically improve. However, measuring QI process compliance is poorly supported by electronic health record (EHR) systems. We developed a custom EHR tool to facilitate capture of process data for SSI prevention with the aim of increasing bundle compliance and reducing adverse events. Ten SSI prevention bundle processes were linked to EHR data elements that were then aggregated into a snapshot display superimposed on weekly case-log reports. The data aggregation and user interface facilitated efficient review of all SSI bundle elements, providing an exact bundle compliance rate without random sampling or chart review. Nine months after implementation of our custom EHR tool, we observed centerline shifts in median SSI bundle compliance (46% to 72%). Additionally, as predicted by high reliability principles, we began to see a trend toward improvement in SSI rates (1.68 to 0.87 per 100 operations), but a discrete centerline shift was not detected. Simple informatics solutions can facilitate extraction of QI process data from the EHR without relying on adjunctive systems. Analyses of these data may drive reductions in adverse events. Pediatric surgical departments should consider leveraging the EHR to enhance bundle compliance as they implement QI strategies. Copyright © 2016 Elsevier Inc. All rights reserved.

Measuring first-line nurse manager work: instrument: development and testing.

PubMed

Cadmus, Edna; Wisniewska, Edyta K

2013-12-01

The objective of this study was to develop and test a 1st-line nurse manager (FLNM) work instrument to measure categories of work and frequency of activities. First-line nurse managers have been demonstrated to be key contributors in meeting organizational outcomes and patient and nurse satisfaction. Identifying the work of FLNMs is essential to help in the development of prioritization and sequence. The need for an instrument that can measure and categorize the work of FLNMs is indicated. The author-developed instrument was administered as a pilot study to 173 FLNMs in New Jersey. Descriptive statistics were analyzed, and validity and reliability were measured. Content validity was established through 2 focus groups using 10 FLNMs and conducting a survey of 5 chief nursing officers. Reliability was assessed by 13 of 16 FLNM participants using the test/retest method and quantified using percent agreement within a 10-day period. Those items with 70% agreement or more were identified as reliable and retained on the instrument. The content validity of the instrument is strong; further refinement and testing of the tool are indicated to improve the reliability and generalizability across multiple populations of leaders and settings.

78 FR 21879 - Improving 9-1-1 Reliability; Reliability and Continuity of Communications Networks, Including...

Federal Register 2010, 2011, 2012, 2013, 2014

2013-04-12

... maps? What are the public safety and homeland security implications of public disclosure of key network... 13-33] Improving 9-1-1 Reliability; Reliability and Continuity of Communications Networks, Including... improve the reliability and resiliency of the Nation's 9-1-1 networks. The Notice of Proposed Rulemaking...

International Endometrial Tumor Analysis (IETA) terminology in women with postmenopausal bleeding and sonographic endometrial thickness ≥ 4.5 mm: agreement and reliability study.

PubMed

Sladkevicius, P; Installé, A; Van Den Bosch, T; Timmerman, D; Benacerraf, B; Jokubkiene, L; Di Legge, A; Votino, A; Zannoni, L; De Moor, B; De Cock, B; Van Calster, B; Valentin, L

2018-02-01

To estimate intra- and interrater agreement and reliability with regard to describing ultrasound images of the endometrium using the International Endometrial Tumor Analysis (IETA) terminology. Four expert and four non-expert raters assessed videoclips of transvaginal ultrasound examinations of the endometrium obtained from 99 women with postmenopausal bleeding and sonographic endometrial thickness ≥ 4.5 mm but without fluid in the uterine cavity. The following features were rated: endometrial echogenicity, endometrial midline, bright edge, endometrial-myometrial junction, color score, vascular pattern, irregularly branching vessels and color splashes. The color content of the endometrial scan was estimated using a visual analog scale graded from 0 to 100. To estimate intrarater agreement and reliability, the same videoclips were assessed twice with a minimum of 2 months' interval. The raters were blinded to their own results and to those of the other raters. Interrater differences in the described prevalence of most IETA variables were substantial, and some variable categories were observed rarely. Specific agreement was poor for variables with many categories. For binary variables, specific agreement was better for absence than for presence of a category. For variables with more than two outcome categories, specific agreement for expert and non-expert raters was best for not-defined endometrial midline (93% and 96%), regular endometrial-myometrial junction (72% and 70%) and three-layer endometrial pattern (67% and 56%). The grayscale ultrasound variable with the best reliability was uniform vs non-uniform echogenicity (multirater kappa (κ), 0.55 for expert and 0.52 for non-expert raters), and the variables with the lowest reliability were appearance of the endometrial-myometrial junction (κ, 0.25 and 0.16) and the nine-category endometrial echogenicity variable (κ, 0.29 and 0.28). The most reliable color Doppler variable was color score (mean weighted κ, 0.77 and 0.69). Intra- and interrater agreement and reliability were similar for experts and non-experts. Inter- and intrarater agreement and reliability when using IETA terminology were limited. This may have implications when assessing the association between a particular ultrasound feature and a specific histological diagnosis, because lack of reproducibility reduces the reliability of the association between a feature and the outcome. Future studies should investigate whether using fewer categories of variable or offering practical training could improve agreement and reliability. Copyright © 2017 ISUOG. Published by John Wiley & Sons Ltd. Copyright © 2017 ISUOG. Published by John Wiley & Sons Ltd.

Gait assessment using the Microsoft Xbox One Kinect: Concurrent validity and inter-day reliability of spatiotemporal and kinematic variables.

PubMed

Mentiplay, Benjamin F; Perraton, Luke G; Bower, Kelly J; Pua, Yong-Hao; McGaw, Rebekah; Heywood, Sophie; Clark, Ross A

2015-07-16

The revised Xbox One Kinect, also known as the Microsoft Kinect V2 for Windows, includes enhanced hardware which may improve its utility as a gait assessment tool. This study examined the concurrent validity and inter-day reliability of spatiotemporal and kinematic gait parameters estimated using the Kinect V2 automated body tracking system and a criterion reference three-dimensional motion analysis (3DMA) marker-based camera system. Thirty healthy adults performed two testing sessions consisting of comfortable and fast paced walking trials. Spatiotemporal outcome measures related to gait speed, speed variability, step length, width and time, foot swing velocity and medial-lateral and vertical pelvis displacement were examined. Kinematic outcome measures including ankle flexion, knee flexion and adduction and hip flexion were examined. To assess the agreement between Kinect and 3DMA systems, Bland-Altman plots, relative agreement (Pearson's correlation) and overall agreement (concordance correlation coefficients) were determined. Reliability was assessed using intraclass correlation coefficients, Cronbach's alpha and standard error of measurement. The spatiotemporal measurements had consistently excellent (r≥0.75) concurrent validity, with the exception of modest validity for medial-lateral pelvis sway (r=0.45-0.46) and fast paced gait speed variability (r=0.73). In contrast kinematic validity was consistently poor to modest, with all associations between the systems weak (r<0.50). In those measures with acceptable validity, the inter-day reliability was similar between systems. In conclusion, while the Kinect V2 body tracking may not accurately obtain lower body kinematic data, it shows great potential as a tool for measuring spatiotemporal aspects of gait. Copyright © 2015 Elsevier Ltd. All rights reserved.

Validation of the Turkish Version of the Sexual Health Outcomes in Women Questionnaire (SHOW-Q) in Turkish-Speaking Women.

PubMed

Selcuk, Selcuk; Kucukbas, Mehmet; Cam, Cetin; Eser, Ahmet; Devranoglu, Belgin; Turkyilmaz, Sebnem; Karateke, Ates

2016-06-01

The Sexual Health Outcomes in Women Questionnaire (SHOW-Q) is designed to evaluate the sexual life of women for satisfaction, orgasm, desire, and pelvic problem interference. The SHOW-Q is important for evaluating worsening of sexual life for patients with pelvic problems and the management of these women to improve their sexual life. To validate the Turkish versions of the SHOW-Q for Turkish-speaking women. The Turkish version of the SHOW-Q was generated by two independent professional English-to-Turkish translators. The translated version of the SHOW-Q was reverse translated by two bilingual translators whose native language was English. Women with at least one symptom related to pelvic problems (n = 71) and those with no symptoms (n = 38) were included in the present study. Test-retest reliability analysis, content-face validity, internal consistency reliability, item-total correlations, convergent validity, construct validity, and factorial validity were performed to assess the psychometric properties of the Turkish versions of the SHOW-Q. Test-retest reliability demonstrated good correlation for all subscales. Cronbach α values ranged from 0.735 to 0.892 and indicated high internal consistency. There was a strong correlation for the corresponding subscales between the SHOW-Q and the Female Sexual Function Index. The mean score of each SHOW-Q subscale showed significant differences between symptomatic and asymptomatic patients. The Turkish version of the SHOW-Q is a valid and reliable instrument that can be used to evaluate the sexual life of Turkish-speaking women with different pelvic problems. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

Which is the most useful patient-reported outcome in femoroacetabular impingement? Test-retest reliability of six questionnaires.

PubMed

Hinman, Rana S; Dobson, Fiona; Takla, Amir; O'Donnell, John; Bennell, Kim L

2014-03-01

The most reliable patient-reported outcomes (PROs) for people with femoroacetabular impingement (FAI) is unknown because there have been no direct comparisons of questionnaires. Thus, the aim was to evaluate the test-retest reliability of six existing PROs in a single cohort of young active people with hip/groin pain consistent with a clinical diagnosis of FAI. Young adults with clinical FAI completed six PRO questionnaires on two occasions, 1-2 weeks apart. The PROs were modified Harris Hip Score, Hip dysfunction and Osteoarthritis Score, Hip Outcome Score, Non-Arthritic Hip Score, International Hip Outcome Tool, Copenhagen Hip and Groin Outcome Score. 30 young adults (mean age 24 years, SD 4 years, range 18-30 years; 15 men) with stable symptoms participated. Intraclass correlation coefficient(3,1) values ranged from 0.73 to 0.93 (95% CI 0.38 to 0.98) indicating that most questionnaires reached minimal reliability benchmarks. Measurement error at the individual level was quite large for most questionnaires (minimal detectable change (MDC95) 12.4-35.6, 95% CI 8.7 to 54.0). In contrast, measurement error at the group level was quite small for most questionnaires (MDC95 2.2-7.3, 95% CI 1.6 to 11). The majority of the questionnaires were reliable and precise enough for use at the group level. Samples of only 23-30 individuals were required to achieve acceptable measurement variation at the group level. Further direct comparisons of these questionnaires are required to assess other measurement properties such as validity, responsiveness and meaningful change in young people with FAI.

Reliability and validity analysis of the open-source Chinese Foot and Ankle Outcome Score (FAOS).

PubMed

Ling, Samuel K K; Chan, Vincent; Ho, Karen; Ling, Fona; Lui, T H

2017-12-21

Develop the first reliable and validated open-source outcome scoring system in the Chinese language for foot and ankle problems. Translation of the English FAOS into Chinese following regular protocols. First, two forward-translations were created separately, these were then combined into a preliminary version by an expert committee, and was subsequently back-translated into English. The process was repeated until the original and back translations were congruent. This version was then field tested on actual patients who provided feedback for modification. The final Chinese FAOS version was then tested for reliability and validity. Reliability analysis was performed on 20 subjects while validity analysis was performed on 50 subjects. Tools used to validate the Chinese FAOS were the SF36 and Pain Numeric Rating Scale (NRS). Internal consistency between the FAOS subgroups was measured using Cronbach's alpha. Spearman's correlation was calculated between each subgroup in the FAOS, SF36 and NRS. The Chinese FAOS passed both reliability and validity testing; meaning it is reliable, internally consistent and correlates positively with the SF36 and the NRS. The Chinese FAOS is a free, open-source scoring system that can be used to provide a relatively standardised outcome measure for foot and ankle studies. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Feasibility of First Step to Success with Preschoolers.

PubMed

Frey, Andy J; Small, Jason; Feil, Edward; Seeley, John; Walker, Hill; Golly, Annemieke

2013-07-01

The primary purpose of this study was to examine feasibility of the preschool version of the First Step to Success (FSS) intervention. Toward this end, the following four research questions were addressed: (1) To what extent was the intervention implemented with integrity? (2) To what extent do teachers and parents perceive the intervention to be socially valid? (3) To what extent were teachers and parents satisfied with the intervention? and (4) To what extent was the intervention effective in reducing problem behavior and improving social skills? Twelve students participated in the study. Treatment integrity, social validity, and satisfaction results were analyzed at the aggregate level, and a reliable change index was calculated at the case level for primary outcome measures to assess the potential efficacy of the intervention. Fidelity data suggest the preschool version of the intervention can be implemented with acceptable integrity by coaches and teachers in preschool settings. Social validity outcomes suggest parents' perceptions of the program's goals, procedures, and outcomes were extremely favorable, and social validity from the teacher perspective was acceptable. The results provide initial evidence that participating in the preschool version of the FSS intervention improves children's social skills and decreases problem behavior.

The Feasibility of First Step to Success with Preschoolers

PubMed Central

Frey, Andy J.; Small, Jason; Feil, Edward; Seeley, John; Walker, Hill; Golly, Annemieke

2017-01-01

The primary purpose of this study was to examine feasibility of the preschool version of the First Step to Success (FSS) intervention. Toward this end, the following four research questions were addressed: (1) To what extent was the intervention implemented with integrity? (2) To what extent do teachers and parents perceive the intervention to be socially valid? (3) To what extent were teachers and parents satisfied with the intervention? and (4) To what extent was the intervention effective in reducing problem behavior and improving social skills? Twelve students participated in the study. Treatment integrity, social validity, and satisfaction results were analyzed at the aggregate level, and a reliable change index was calculated at the case level for primary outcome measures to assess the potential efficacy of the intervention. Fidelity data suggest the preschool version of the intervention can be implemented with acceptable integrity by coaches and teachers in preschool settings. Social validity outcomes suggest parents’ perceptions of the program’s goals, procedures, and outcomes were extremely favorable, and social validity from the teacher perspective was acceptable. The results provide initial evidence that participating in the preschool version of the FSS intervention improves children’s social skills and decreases problem behavior. PMID:29225519

The reliability, precision and clinically meaningful change of walking assessments in multiple sclerosis.

PubMed

Learmonth, Yvonne C; Dlugonski, Deirdre D; Pilutti, Lara A; Sandroff, Brian M; Motl, Robert W

2013-11-01

Assessing walking impairment in those with multiple sclerosis (MS) is common, however little is known about the reliability, precision and clinically important change of walking outcomes. The purpose of this study was to determine the reliability, precision and clinically important change of the Timed 25-Foot Walk (T25FW), Six-Minute Walk (6MW), Multiple Sclerosis Walking Scale-12 (MSWS-12) and accelerometry. Data were collected from 82 persons with MS at two time points, six months apart. Analyses were undertaken for the whole sample and stratified based on disability level and usage of walking aids. Intraclass correlation coefficient (ICC) analyses established reliability: standard error of measurement (SEM) and coefficient of variation (CV) determined precision; and minimal detectable change (MDC) defined clinically important change. All outcome measures were reliable with precision and MDC varying between measures in the whole sample: T25FW: ICC=0.991; SEM=1 s; CV=6.2%; MDC=2.7 s (36%), 6MW: ICC=0.959; SEM=32 m; CV=6.2%; MDC=88 m (20%), MSWS-12: ICC=0.927; SEM=8; CV=27%; MDC=22 (53%), accelerometry counts/day: ICC=0.883; SEM=28450; CV=17%; MDC=78860 (52%), accelerometry steps/day: ICC=0.907; SEM=726; CV=16%; MDC=2011 (45%). Variation in these estimates was seen based on disability level and walking aid. The reliability of these outcomes is good and falls within acceptable ranges. Precision and clinically important change estimates provide guidelines for interpreting these outcomes in clinical and research settings.

Patient-Reported Outcome Measures for Hand and Wrist Trauma: Is There Sufficient Evidence of Reliability, Validity, and Responsiveness?

PubMed

Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

2016-03-01

Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology.

Draft Genome Sequence of Mycobacterium chimaera Type ...

EPA Pesticide Factsheets

We report the draft genome sequence of the type strain Mycobacterium chimaera Fl-0169T, a member of the Mycobacterium avium complex (MAC). M. chimaera Fl-0169T was isolated from a patient in Italy and is highly similar to strains of M. chimaera isolated in Ireland, though Fl-0169T possesses unique virulence genes. Evidence suggests that M. avium, M. intracellulare, and M. chimaera are differently virulent and a comparative genomic analysis is critically needed to identify diagnostic targets that reliably differentiate species of MAC. With treatment costs for Mycobacterium infections estimated to be >$1.8 B annually in the U.S., correct species identification will result in improved treatment selection, lower costs, and improved patient outcomes.

Do Personality Problems Improve During Psychodynamic Supportive-Expressive Psychotherapy? Secondary Outcome Results From a Randomized Controlled Trial for Psychiatric Outpatients with Personality Disorders

PubMed Central

Vinnars, Bo; Thormählen, Barbro; Gallop, Robert; Norén, Kristina; Barber, Jacques P.

2009-01-01

Studies involving patients with personality disorders (PD) have not focused on improvement of core aspects of the PD. This paper examines changes in quality of object relations, interpersonal problems, psychological mindedness, and personality traits in a sample of 156 patients with DSM-IV PD diagnoses being randomized to either manualized or non manualized dynamic psychotherapy. Effect sizes adjusted for symptomatic change and reliable change indices were calculated. We found that both treatments were equally effective at reducing personality pathology. Only in neuroticism did the non manualized group do better during the follow-up period. The largest improvement was found in quality of object relations. For the remaining variables only small and clinically insignificant magnitudes of change were found. PMID:20161588

Why do ineffective treatments seem helpful? A brief review.

PubMed

Hartman, Steve E

2009-10-12

After any therapy, when symptoms improve, healthcare providers (and patients) are tempted to award credit to treatment. Over time, a particular treatment can seem so undeniably helpful that scientific verification of efficacy is judged an inconvenient waste of time and resources. Unfortunately, practitioners' accumulated, day-to-day, informal impressions of diagnostic reliability and clinical efficacy are of limited value. To help clarify why even treatments entirely lacking in direct effect can seem helpful, I will explain why real signs and symptoms often improve, independent of treatment. Then, I will detail quirks of human perception, interpretation, and memory that often make symptoms seem improved, when they are not. I conclude that healthcare will grow to full potential only when judgments of clinical efficacy routinely are based in properly scientific, placebo-controlled, outcome analysis.

Parameter Optimization for Selected Correlation Analysis of Intracranial Pathophysiology.

PubMed

Faltermeier, Rupert; Proescholdt, Martin A; Bele, Sylvia; Brawanski, Alexander

2015-01-01

Recently we proposed a mathematical tool set, called selected correlation analysis, that reliably detects positive and negative correlations between arterial blood pressure (ABP) and intracranial pressure (ICP). Such correlations are associated with severe impairment of the cerebral autoregulation and intracranial compliance, as predicted by a mathematical model. The time resolved selected correlation analysis is based on a windowing technique combined with Fourier-based coherence calculations and therefore depends on several parameters. For real time application of this method at an ICU it is inevitable to adjust this mathematical tool for high sensitivity and distinct reliability. In this study, we will introduce a method to optimize the parameters of the selected correlation analysis by correlating an index, called selected correlation positive (SCP), with the outcome of the patients represented by the Glasgow Outcome Scale (GOS). For that purpose, the data of twenty-five patients were used to calculate the SCP value for each patient and multitude of feasible parameter sets of the selected correlation analysis. It could be shown that an optimized set of parameters is able to improve the sensitivity of the method by a factor greater than four in comparison to our first analyses.

Parameter Optimization for Selected Correlation Analysis of Intracranial Pathophysiology

PubMed Central

Faltermeier, Rupert; Proescholdt, Martin A.; Bele, Sylvia; Brawanski, Alexander

2015-01-01

Recently we proposed a mathematical tool set, called selected correlation analysis, that reliably detects positive and negative correlations between arterial blood pressure (ABP) and intracranial pressure (ICP). Such correlations are associated with severe impairment of the cerebral autoregulation and intracranial compliance, as predicted by a mathematical model. The time resolved selected correlation analysis is based on a windowing technique combined with Fourier-based coherence calculations and therefore depends on several parameters. For real time application of this method at an ICU it is inevitable to adjust this mathematical tool for high sensitivity and distinct reliability. In this study, we will introduce a method to optimize the parameters of the selected correlation analysis by correlating an index, called selected correlation positive (SCP), with the outcome of the patients represented by the Glasgow Outcome Scale (GOS). For that purpose, the data of twenty-five patients were used to calculate the SCP value for each patient and multitude of feasible parameter sets of the selected correlation analysis. It could be shown that an optimized set of parameters is able to improve the sensitivity of the method by a factor greater than four in comparison to our first analyses. PMID:26693250

The impact of positive affect on health cognitions and behaviours: a meta-analysis of the experimental evidence.

PubMed

Cameron, David S; Bertenshaw, Emma J; Sheeran, Paschal

2015-01-01

Several reviews suggest that positive affect is associated with improved longevity, fewer physical symptoms, and biological indicators of good health. It is possible that positive affect could influence these outcomes by promoting healthful cognitions and behaviours. The present review identified conceptual pathways from positive affect to health cognitions and behaviour, and used random effects meta-analysis to quantify the impact of positive affect inductions (versus neutral affect conditions) on these outcomes. Literature searches located 54 independent tests that could be included in the review. Across all studies, the findings revealed no reliable effects on intentions (d+ = -.12, 95% CI = -.32 to .08, k = 15) or behaviour (d+ = .15, 95% CI = -.03 to .33, k = 23). There were four reliable effects involving specific cognitions and behaviours, but little clear evidence for generalised benefits or adverse effects of positive emotions on health-related cognitions or actions. Conclusions must be cautious given the paucity of tests available for analysis. The review offers suggestions about research designs that might profitably be deployed in future studies, and calls for additional tests of the impact of discrete positive emotions on health cognitions and behaviour.

Measuring voice outcomes: state of the science review.

PubMed

Carding, Pau N; Wilson, J A; MacKenzie, K; Deary, I J

2009-08-01

Researchers evaluating voice disorder interventions currently have a plethora of voice outcome measurement tools from which to choose. Faced with such a wide choice, it would be beneficial to establish a clear rationale to guide selection. This article reviews the published literature on the three main areas of voice outcome assessment: (1) perceptual rating of voice quality, (2) acoustic measurement of the speech signal and (3) patient self-reporting of voice problems. We analysed the published reliability, validity, sensitivity to change and utility of the common outcome measurement tools in each area. From the data, we suggest that routine voice outcome measurement should include (1) an expert rating of voice quality (using the Grade-Roughness-Breathiness-Asthenia-Strain rating scale) and (2) a short self-reporting tool (either the Vocal Performance Questionnaire or the Vocal Handicap Index 10). These measures have high validity, the best reported reliability to date, good sensitivity to change data and excellent utility ratings. However, their application and administration require attention to detail. Acoustic measurement has arguable validity and poor reliability data at the present time. Other areas of voice outcome measurement (e.g. stroboscopy and aerodynamic phonatory measurements) require similarly detailed research and analysis.

Improving Interdisciplinary Provider Communication Through a Unified Paging System.

PubMed

Heidemann, Lauren; Petrilli, Christopher; Gupta, Ashwin; Campbell, Ian; Thompson, Maureen; Cinti, Sandro; Stewart, David A

2016-06-01

Interdisciplinary communication at a Veterans Affairs (VA) academic teaching hospital is largely dependent on alphanumeric paging, which has limitations as a result of one-way communication and lack of reliable physician identification. Adverse patient outcomes related to difficulty contacting the correct consulting provider in a timely manner have been reported. House officers were surveyed on the level of satisfaction with the current VA communication system and the rate of perceived adverse patient outcomes caused by potential delays within this system. Respondents were then asked to identify the ideal paging system. These results were used to develop and deploy a new Web site. A postimplementation survey was repeated 1 year later. This study was conducted as a quality improvement project. House officer satisfaction with the preintervention system was 3%. The majority used more than four modalities to identify consultants, with 59% stating that word of mouth was a typical source. The preferred mode of paging was the university hospital paging system, a Web-based program that is used at the partnering academic institution. Following integration of VA consulting services within the university hospital paging system, the level of satisfaction improved to 87%. Significant decreases were seen in perceived adverse patient outcomes (from 16% to 2%), delays in patient care (from 90% to 16%), and extended hospitalizations (from 46% to 4%). Our study demonstrates significant improvement in physician satisfaction with a newly implemented paging system that was associated with a decreased perceived number of adverse patient events and delays in care.

Development, reliability, and validity of the Alberta Perinatal Stroke Project Parental Outcome Measure.

PubMed

Bemister, Taryn B; Brooks, Brian L; Kirton, Adam

2014-07-01

Perinatal stroke is a leading cause of cerebral palsy and lifelong disability, although parent and family outcomes have not yet been studied in this specific population. The Alberta Perinatal Stroke Project Parental Outcome Measure was developed as a 26-item questionnaire on the impact of perinatal stroke on parents and families. The items were derived from expert opinion and scientific literature on issues salient to parents of children with perinatal stroke, including guilt and blame, which are not well captured in existing measures of family impact. Data were collected from 82 mothers and 28 fathers who completed the Parental Outcome Measure and related questionnaires (mean age, 39.5 years; mean child age, 7.4 years). Analyses examined the Parental Outcome Measure's internal consistency, test-retest reliability, validity, and factor structure. The Parental Outcome Measure demonstrated three unique theoretical constructs: Psychosocial Impact, Guilt, and Blame. The Parental Outcome Measure has excellent internal consistency (Cronbach α = 0.91) and very good test-retest reliability more than 2-5 weeks (r = 0.87). Regarding validity, the Parental Outcome Measure is sensitive to condition severity, accounts for additional variance in parent outcomes, and strongly correlates with measures of anxiety, depression, stress, quality of life, family functioning, and parent adjustment. The Parental Outcome Measure contributes to the literature as the first brief measure of family impact designed for parents of children with perinatal stroke. Copyright © 2014 Elsevier Inc. All rights reserved.

Psychometric Properties of the Perceived Wellness Culture and Environment Support Scale.

PubMed

Melnyk, Bernadette Mazurek; Szalacha, Laura A; Amaya, Megan

2018-05-01

This study reports on the psychometric properties of the 11-item Perceived Wellness Culture and Environment Support Scale (PWCESS) and its relationship with employee healthy lifestyle beliefs and behaviors. Faculty and staff (N = 3959) at a large public university in the United States mid-west completed the PWCESS along with healthy lifestyle beliefs and behaviors scales. Data were randomly split into 2 halves to explore the PWCESS' validity and reliability and the second half to confirm findings. Principal components analysis indicated a unidimensional construct. The PWCESS was positively related to healthy lifestyle beliefs and behaviors supporting the scale's validity. Confirmatory factor analysis supported the unidimensional construct (Cronbach's α = .92). Strong evidence supports the validity and reliability of the PWCESS. Future use of this scale could guide workplace intervention strategies to improve organizational wellness culture and employee health outcomes.

Assessing barriers to adherence in routine clinical care for pediatric kidney transplant patients.

PubMed

Varnell, Charles D; Rich, Kristin L; Nichols, Melissa; Dahale, Devesh; Goebel, Jens W; Pai, Ahna L H; Hooper, David K; Modi, Avani C

2017-11-01

Patient-identified barriers to immunosuppressive medications are associated with poor adherence and negative clinical outcomes in transplant patients. Assessment of adherence barriers is not part of routine post-transplant care, and studies regarding implementing such a process in a reliable way are lacking. Using the Model for Improvement and PDSA cycles, we implemented a system to identify adherence barriers, including patient-centered design of a barriers assessment tool, identification of eligible patients, clear roles for clinic staff, and creating a culture of non-judgmental discussion around adherence. We performed time-series analysis of our process measure. Secondary analyses examined the endorsement and concordance of adherence barriers between patient-caregiver dyads. After three methods of testing, the most reliable delivery system was an EHR-integrated tablet that alerted staff of patient eligibility for assessment. Barriers were endorsed by 35% of caregivers (n=85) and 43% of patients (n=60). The most frequently patient-endorsed barriers were forgetting, poor taste, and side effects. Caregivers endorsed forgetting and side effects. Concordance between patient-caregiver dyads was fair (k=0.299). Standardized adherence barriers assessment is feasible in the clinical care of pediatric kidney transplant patients. Features necessary for success included automation, redundant systems with designated staff to identify and mitigate failures, aligned reporting structures, and reliable measurement approaches. Future studies will examine whether barriers predict clinical outcomes (eg, organ rejection, graft loss). © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Auckland Stroke Outcomes Study. Part 1: Gender, stroke types, ethnicity, and functional outcomes 5 years poststroke.

PubMed

Feigin, V L; Barker-Collo, S; Parag, V; Senior, H; Lawes, C M M; Ratnasabapathy, Y; Glen, E

2010-11-02

Studying long-term stroke outcomes including body functioning (neurologic and neuropsychological impairments) and activity limitations and participation is essential for long-term evidence-based rehabilitation and service planning, resource allocation, and improving health outcomes in stroke. However, reliable data to address these issues is lacking. This study (February 2007-December 2008) sourced its participants from the population-based incidence study conducted in Auckland in 2002-2003. Participants completed structured self-administered questionnaires, and a face-to-face interview including a battery of neuropsychological tests. Logistic regression analysis was used to analyze associations between and within functional outcomes and their potential predictors. Of 418 5-year stroke survivors, two-thirds had good functional outcome in terms of neurologic impairment and disability (defined as modified Rankin Score <3), 22.5% had cognitive impairment indicative of dementia, 20% had experienced a recurrent stroke, almost 15% were institutionalized, and 29.6% had symptoms suggesting depression. Highly significant correlations were found between and within various measurements of body functioning (especially neuropsychological impairments), activity, and participation. Age, dependency, and depression were independently associated with most outcomes analyzed. The strong associations between neuropsychological impairment and other functional outcomes and across various measurements of body functioning, activity, and participation justify utilizing a multidisciplinary approach to studying and managing long-term stroke outcomes. Observed gender and ethnic differences in some important stroke outcomes warrant further investigations.

Reduction of diabetes-related distress predicts improved depressive symptoms: A secondary analysis of the DIAMOS study

PubMed Central

Schmitt, Andreas; Ehrmann, Dominic; Kulzer, Bernhard; Hermanns, Norbert

2017-01-01

Objective Depressive symptoms in people with diabetes are associated with increased risk of adverse outcomes. Although successful psychosocial treatment options are available, little is known about factors that facilitate treatment response for depression in diabetes. This prospective study aims to examine the impact of known risk factors on improvement of depressive symptoms with a special interest in the role of diabetes-related distress. Methods 181 people with diabetes participated in a randomized controlled trial. Diabetes-related distress was assessed using the Problem Areas In Diabetes (PAID) scale; depressive symptoms were assessed using the Center for Epidemiologic Studies Depression (CES-D) scale. Multiple logistic and linear regression analyses were used to assess associations between risk factors for depression (independent variables) and improvement of depressive symptoms (dependent variable). Reliable change indices were established as criteria of meaningful reductions in diabetes distress and depressive symptoms. Results A reliable reduction of diabetes-related distress (15.43 points in the PAID) was significantly associated with fourfold increased odds for reliable improvement of depressive symptoms (OR = 4.25, 95% CI: 2.05–8.79; P<0.001). This result was corroborated using continuous measures of diabetes distress and depressive symptoms, showing that greater reduction of diabetes-related distress independently predicted greater improvement in depressive symptoms (ß = -0.40; P<0.001). Higher age had a positive (Odds Ratio = 2.04, 95% CI: 1.21–3.43; P<0.01) and type 2 diabetes had a negative effect on the meaningful reduction of depressive symptoms (Odds Ratio = 0.12, 95% CI: 0.04–0.35; P<0.001). Conclusions The reduction of diabetes distress is a statistical predictor of improvement of depressive symptoms. Diabetes patients with comorbid depressive symptomatology might benefit from treatments to reduce diabetes-related distress. PMID:28700718

Assessment of the reliability of data collected for the Department of Veterans Affairs national surgical quality improvement program.

PubMed

Davis, Chester L; Pierce, John R; Henderson, William; Spencer, C David; Tyler, Christine; Langberg, Robert; Swafford, Jennan; Felan, Gladys S; Kearns, Martha A; Booker, Brigitte

2007-04-01

The Office of the Medical Inspector of the Department of Veterans Affairs (VA) studied the reliability of data collected by the VA's National Surgical Quality Improvement Program (NSQIP). The study focused on case selection bias, accuracy of reports on patients who died, and interrater reliability measurements of patient risk variables and outcomes. Surgical data from a sample of 15 VA medical centers were analyzed. For case selection bias, reviewers applied NSQIP criteria to include or exclude 2,460 patients from the database, comparing their results with those of NSQIP staff. For accurate reporting of patients who died, reviewers compared Social Security numbers of 10,444 NSQIP records with those found in the VA Beneficiary Identification and Records Locator Subsystem, VA Patient Treatment Files, and Social Security Administration death files. For measurement of interrater reliability, reviewers reabstracted 59 variables in each of 550 patient medical records that also were recorded in the NSQIP database. On case selection bias, the reviewers agreed with NSQIP decisions on 2,418 (98%) of the 2,460 cases. Computer record matching identified 4 more deaths than the NSQIP total of 198, a difference of about 2%. For 52 of the categorical variables, agreement, uncorrected for chance, was 96%. For 48 of 52 categorical variables, kappas ranged from 0.61 to 1.0 (substantial to almost perfect agreement); none of the variables had kappas of less than 0.20 (slight to poor agreement). This sample of medical centers shows adherence to criteria in selecting cases for the NSQIP database, for reporting deaths, and for collecting patient risk variables.

The assessment of fidelity in a motor speech-treatment approach

PubMed Central

Hayden, Deborah; Namasivayam, Aravind Kumar; Ward, Roslyn

2015-01-01

Objective To demonstrate the application of the constructs of treatment fidelity for research and clinical practice for motor speech disorders, using the Prompts for Restructuring Oral Muscular Phonetic Targets (PROMPT) Fidelity Measure (PFM). Treatment fidelity refers to a set of procedures used to monitor and improve the validity and reliability of behavioral intervention. While the concept of treatment fidelity has been emphasized in medical and allied health sciences, documentation of procedures for the systematic evaluation of treatment fidelity in Speech-Language Pathology is sparse. Methods The development and iterative process to improve the PFM, is discussed. Further, the PFM is evaluated against recommended measurement strategies documented in the literature. This includes evaluating the appropriateness of goals and objectives; and the training of speech–language pathologists, using direct and indirect procedures. Three expert raters scored the PFM to examine inter-rater reliability. Results Three raters, blinded to each other's scores, completed fidelity ratings on three separate occasions. Inter-rater reliability, using Krippendorff's Alpha, was >80% for the PFM on the final scoring occasion. This indicates strong inter-rater reliability. Conclusion The development of fidelity measures for the training of service providers and treatment delivery is important in specialized treatment approaches where certain ‘active ingredients’ (e.g. specific treatment targets and therapeutic techniques) must be present in order for treatment to be effective. The PFM reflects evidence-based practice by integrating treatment delivery and clinical skill as a single quantifiable metric. PFM enables researchers and clinicians to objectively measure treatment outcomes within the PROMPT approach. PMID:26213623

Evaluating test-retest reliability in patient-reported outcome measures for older people: A systematic review.

PubMed

Park, Myung Sook; Kang, Kyung Ja; Jang, Sun Joo; Lee, Joo Yun; Chang, Sun Ju

2018-03-01

This study aimed to evaluate the components of test-retest reliability including time interval, sample size, and statistical methods used in patient-reported outcome measures in older people and to provide suggestions on the methodology for calculating test-retest reliability for patient-reported outcomes in older people. This was a systematic literature review. MEDLINE, Embase, CINAHL, and PsycINFO were searched from January 1, 2000 to August 10, 2017 by an information specialist. This systematic review was guided by both the Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist and the guideline for systematic review published by the National Evidence-based Healthcare Collaborating Agency in Korea. The methodological quality was assessed by the Consensus-based Standards for the selection of health Measurement Instruments checklist box B. Ninety-five out of 12,641 studies were selected for the analysis. The median time interval for test-retest reliability was 14days, and the ratio of sample size for test-retest reliability to the number of items in each measure ranged from 1:1 to 1:4. The most frequently used statistical methods for continuous scores was intraclass correlation coefficients (ICCs). Among the 63 studies that used ICCs, 21 studies presented models for ICC calculations and 30 studies reported 95% confidence intervals of the ICCs. Additional analyses using 17 studies that reported a strong ICC (>0.09) showed that the mean time interval was 12.88days and the mean ratio of the number of items to sample size was 1:5.37. When researchers plan to assess the test-retest reliability of patient-reported outcome measures for older people, they need to consider an adequate time interval of approximately 13days and the sample size of about 5 times the number of items. Particularly, statistical methods should not only be selected based on the types of scores of the patient-reported outcome measures, but should also be described clearly in the studies that report the results of test-retest reliability. Copyright © 2017 Elsevier Ltd. All rights reserved.

New paradigm for patient-reported outcomes assessment in foot & ankle research: computerized adaptive testing.

PubMed

Hung, Man; Nickisch, Florian; Beals, Timothy C; Greene, Tom; Clegg, Daniel O; Saltzman, Charles L

2012-08-01

Accurately measuring, reporting and comparing outcomes is essential for improving health care delivery. Current challenges with available health status scales include patient fatigue, floor/ceiling effects and validity/reliability. This study compared Patient Reported Outcomes Measurement Information System (PROMIS)-based Lower Extremity Physical Function Computerized Adaptive Test (LE CAT) and two legacy scales -the Foot and Function Index (FFI) and the sport module from the Foot and Ankle Ability Measure (spFAAM) -for 287 patients scheduled for elective foot and ankle surgery. We documented the time required by patients to complete the instrument, instrument precision, and the extent to which each instrument covered the full range of physical functioning across the patient sample. Average time of test administration: 66 seconds for LE CAT, 130 seconds for spFAAM and 239 seconds for FFI. All three instruments were fairly precise at intermediate physical functioning levels (i.e., Standard Error of Measurement < 0.35), were relatively less precise at the higher trait levels and the LE CAT maintained precision in the lower range while the spFAAM and FFI's had decreased precision. The LE CAT had less floor/ceiling effects than the FFI and the spFAAM. The LE CAT showed considerable advantage compared to legacy scales for measuring patient-reported outcomes in orthopaedic patients with foot and ankle problems. A paradigm shift to broader use of PROMIS-based CATs should be considered to improve precision and reduce patient burden with patient-reported outcome measuremen foot and ankle patients.

Reliability of conditioned pain modulation: a systematic review

PubMed Central

Kennedy, Donna L.; Kemp, Harriet I.; Ridout, Deborah; Yarnitsky, David; Rice, Andrew S.C.

2016-01-01

Abstract A systematic literature review was undertaken to determine if conditioned pain modulation (CPM) is reliable. Longitudinal, English language observational studies of the repeatability of a CPM test paradigm in adult humans were included. Two independent reviewers assessed the risk of bias in 6 domains; study participation; study attrition; prognostic factor measurement; outcome measurement; confounding and analysis using the Quality in Prognosis Studies (QUIPS) critical assessment tool. Intraclass correlation coefficients (ICCs) less than 0.4 were considered to be poor; 0.4 and 0.59 to be fair; 0.6 and 0.75 good and greater than 0.75 excellent. Ten studies were included in the final review. Meta-analysis was not appropriate because of differences between studies. The intersession reliability of the CPM effect was investigated in 8 studies and reported as good (ICC = 0.6-0.75) in 3 studies and excellent (ICC > 0.75) in subgroups in 2 of those 3. The assessment of risk of bias demonstrated that reporting is not comprehensive for the description of sample demographics, recruitment strategy, and study attrition. The absence of blinding, a lack of control for confounding factors, and lack of standardisation in statistical analysis are common. Conditioned pain modulation is a reliable measure; however, the degree of reliability is heavily dependent on stimulation parameters and study methodology and this warrants consideration for investigators. The validation of CPM as a robust prognostic factor in experimental and clinical pain studies may be facilitated by improvements in the reporting of CPM reliability studies. PMID:27559835

Analyses of inter-rater reliability between professionals, medical students and trained school children as assessors of basic life support skills.

PubMed

Beck, Stefanie; Ruhnke, Bjarne; Issleib, Malte; Daubmann, Anne; Harendza, Sigrid; Zöllner, Christian

2016-10-07

Training of lay-rescuers is essential to improve survival-rates after cardiac arrest. Multiple campaigns emphasise the importance of basic life support (BLS) training for school children. Trainings require a valid assessment to give feedback to school children and to compare the outcomes of different training formats. Considering these requirements, we developed an assessment of BLS skills using MiniAnne and tested the inter-rater reliability between professionals, medical students and trained school children as assessors. Fifteen professional assessors, 10 medical students and 111-trained school children (peers) assessed 1087 school children at the end of a CPR-training event using the new assessment format. Analyses of inter-rater reliability (intraclass correlation coefficient; ICC) were performed. Overall inter-rater reliability of the summative assessment was high (ICC = 0.84, 95 %-CI: 0.84 to 0.86, n = 889). The number of comparisons between peer-peer assessors (n = 303), peer-professional assessors (n = 339), and peer-student assessors (n = 191) was adequate to demonstrate high inter-rater reliability between peer- and professional-assessors (ICC: 0.76), peer- and student-assessors (ICC: 0.88) and peer- and other peer-assessors (ICC: 0.91). Systematic variation in rating of specific items was observed for three items between professional- and peer-assessors. Using this assessment and integrating peers and medical students as assessors gives the opportunity to assess hands-on skills of school children with high reliability.

Plain film measurement error in acute displaced midshaft clavicle fractures

PubMed Central

Archer, Lori Anne; Hunt, Stephen; Squire, Daniel; Moores, Carl; Stone, Craig; O’Dea, Frank; Furey, Andrew

2016-01-01

Background Clavicle fractures are common and optimal treatment remains controversial. Recent literature suggests operative fixation of acute displaced mid-shaft clavicle fractures (DMCFs) shortened more than 2 cm improves outcomes. We aimed to identify correlation between plain film and computed tomography (CT) measurement of displacement and the inter- and intraobserver reliability of repeated radiographic measurements. Methods We obtained radiographs and CT scans of patients with acute DMCFs. Three orthopedic staff and 3 residents measured radiographic displacement at time zero and 2 weeks later. The CT measurements identified absolute shortening in 3 dimensions (by subtracting the length of the fractured from the intact clavicle). We then compared shortening measured on radiographs and shortening measured in 3 dimensions on CT. Interobserver and intraobserver reliability were calculated. Results We reviewed the fractures of 22 patients. Bland–Altman repeatability coefficient calculations indicated that radiograph and CT measurements of shortening could not be correlated owing to an unacceptable amount of measurement error (6 cm). Interobserver reliability for plain radiograph measurements was excellent (Cronbach α = 0.90). Likewise, intraobserver reliabilities for plain radiograph measurements as calculated with paired t tests indicated excellent correlation (p > 0.05 in all but 1 observer [p = 0.04]). Conclusion To establish shortening as an indication for DMCF fixation, reliable measurement tools are required. The low correlation between plain film and CT measurements we observed suggests further research is necessary to establish what imaging modality reliably predicts shortening. Our results indicate weak correlation between radiograph and CT measurement of acute DMCF shortening. PMID:27438054

Validity and Reliability of Accelerometers in Patients With COPD: A SYSTEMATIC REVIEW.

PubMed

Gore, Shweta; Blackwood, Jennifer; Guyette, Mary; Alsalaheen, Bara

2018-05-01

Reduced physical activity is associated with poor prognosis in chronic obstructive pulmonary disease (COPD). Accelerometers have greatly improved quantification of physical activity by providing information on step counts, body positions, energy expenditure, and magnitude of force. The purpose of this systematic review was to compare the validity and reliability of accelerometers used in patients with COPD. An electronic database search of MEDLINE and CINAHL was performed. Study quality was assessed with the Strengthening the Reporting of Observational Studies in Epidemiology checklist while methodological quality was assessed using the modified Quality Appraisal Tool for Reliability Studies. The search yielded 5392 studies; 25 met inclusion criteria. The SenseWear Pro armband reported high criterion validity under controlled conditions (r = 0.75-0.93) and high reliability (ICC = 0.84-0.86) for step counts. The DynaPort MiniMod demonstrated highest concurrent validity for step count using both video and manual methods. Validity of the SenseWear Pro armband varied between studies especially in free-living conditions, slower walking speeds, and with addition of weights during gait. A high degree of variability was found in the outcomes used and statistical analyses performed between studies, indicating a need for further studies to measure reliability and validity of accelerometers in COPD. The SenseWear Pro armband is the most commonly used accelerometer in COPD, but measurement properties are limited by gait speed variability and assistive device use. DynaPort MiniMod and Stepwatch accelerometers demonstrated high validity in patients with COPD but lack reliability data.

Radiation monitoring in interventional cardiology: a requirement

NASA Astrophysics Data System (ADS)

Rivera, T.; Uruchurtu, E. S.

2017-01-01

The increasing of procedures using fluoroscopy in interventional cardiology procedures may increase medical and patients to levels of radiation that manifest in unintended outcomes. Such outcomes may include skin injury and cancer. The cardiologists and other staff members in interventional cardiology are usually working close to the area under examination and they receive the dose primarily from scattered radiation from the patient. Mexico does not have a formal policy for monitoring and recording the radiation dose delivered in hemodynamic establishments. Deterministic risk management can be improved by monitoring the radiation delivered from X-ray devices. The objective of this paper is to provide cardiologist, techniques, nurses, and all medical staff an information on DR levels, about X-ray risks and a simple a reliable method to control cumulative dose.

A Reliable, Feasible Method to Observe Neighborhoods at High Spatial Resolution

PubMed Central

Kepper, Maura M.; Sothern, Melinda S.; Theall, Katherine P.; Griffiths, Lauren A.; Scribner, Richard; Tseng, Tung-Sung; Schaettle, Paul; Cwik, Jessica M.; Felker-Kantor, Erica; Broyles, Stephanie T.

2016-01-01

Introduction Systematic social observation (SSO) methods traditionally measure neighborhoods at street level and have been performed reliably using virtual applications to increase feasibility. Research indicates that collection at even higher spatial resolution may better elucidate the health impact of neighborhood factors, but whether virtual applications can reliably capture social determinants of health at the smallest geographic resolution (parcel level) remains uncertain. This paper presents a novel, parcel-level SSO methodology and assesses whether this new method can be collected reliably using Google Street View and is feasible. Methods Multiple raters (N=5) observed 42 neighborhoods. In 2016, inter-rater reliability (observed agreement and kappa coefficient) was compared for four SSO methods: (1) street-level in person; (2) street-level virtual; (3) parcel-level in person; and (4) parcel-level virtual. Intra-rater reliability (observed agreement and kappa coefficient) was calculated to determine whether parcel-level methods produce results comparable to traditional street-level observation. Results Substantial levels of inter-rater agreement were documented across all four methods; all methods had >70% of items with at least substantial agreement. Only physical decay showed higher levels of agreement (83% of items with >75% agreement) for direct versus virtual rating source. Intra-rater agreement comparing street- versus parcel-level methods resulted in observed agreement >75% for all but one item (90%). Conclusions Results support the use of Google Street View as a reliable, feasible tool for performing SSO at the smallest geographic resolution. Validation of a new parcel-level method collected virtually may improve the assessment of social determinants contributing to disparities in health behaviors and outcomes. PMID:27989289

Errors of logic and scholarship concerning dissociative identity disorder.

PubMed

Ross, Colin A

2009-01-01

The author reviewed a two-part critique of dissociative identity disorder published in the Canadian Journal of Psychiatry. The two papers contain errors of logic and scholarship. Contrary to the conclusions in the critique, dissociative identity disorder has established diagnostic reliability and concurrent validity, the trauma histories of affected individuals can be corroborated, and the existing prospective treatment outcome literature demonstrates improvement in individuals receiving psychotherapy for the disorder. The available evidence supports the inclusion of dissociative identity disorder in future editions of the Diagnostic and Statistical Manual of Mental Disorders.

The reliability of in-training assessment when performance improvement is taken into account.

PubMed

van Lohuizen, Mirjam T; Kuks, Jan B M; van Hell, Elisabeth A; Raat, A N; Stewart, Roy E; Cohen-Schotanus, Janke

2010-12-01

During in-training assessment students are frequently assessed over a longer period of time and therefore it can be expected that their performance will improve. We studied whether there really is a measurable performance improvement when students are assessed over an extended period of time and how this improvement affects the reliability of the overall judgement. In-training assessment results were obtained from 104 students on rotation at our university hospital or at one of the six affiliated hospitals. Generalisability theory was used in combination with multilevel analysis to obtain reliability coefficients and to estimate the number of assessments needed for reliable overall judgement, both including and excluding performance improvement. Students' clinical performance ratings improved significantly from a mean of 7.6 at the start to a mean of 7.8 at the end of their clerkship. When taking performance improvement into account, reliability coefficients were higher. The number of assessments needed to achieve a reliability of 0.80 or higher decreased from 17 to 11. Therefore, when studying reliability of in-training assessment, performance improvement should be considered.

Interventions to assist health consumers to find reliable online health information: a comprehensive review.

PubMed

Lee, Kenneth; Hoti, Kreshnik; Hughes, Jeffery D; Emmerton, Lynne M

2014-01-01

Health information on the Internet is ubiquitous, and its use by health consumers prevalent. Finding and understanding relevant online health information, and determining content reliability, pose real challenges for many health consumers. To identify the types of interventions that have been implemented to assist health consumers to find reliable online health information, and where possible, describe and compare the types of outcomes studied. PubMed, PsycINFO, CINAHL Plus and Cochrane Library databases; WorldCat and Scirus 'gray literature' search engines; and manual review of reference lists of selected publications. Publications were selected by firstly screening title, abstract, and then full text. Seven publications met the inclusion criteria, and were summarized in a data extraction form. The form incorporated the PICOS (Population Intervention Comparators Outcomes and Study Design) Model. Two eligible gray literature papers were also reported. Relevant data from included studies were tabulated to enable descriptive comparison. A brief critique of each study was included in the tables. This review was unable to follow systematic review methods due to the paucity of research and humanistic interventions reported. While extensive, the gray literature search may have had limited reach in some countries. The paucity of research on this topic limits conclusions that may be drawn. The few eligible studies predominantly adopted a didactic approach to assisting health consumers, whereby consumers were either taught how to find credible websites, or how to use the Internet. Common types of outcomes studied include knowledge and skills pertaining to Internet use and searching for reliable health information. These outcomes were predominantly self-assessed by participants. There is potential for further research to explore other avenues for assisting health consumers to find reliable online health information, and to assess outcomes via objective measures.

An evidence-based decision assistance model for predicting training outcome in juvenile guide dogs.

PubMed

Harvey, Naomi D; Craigon, Peter J; Blythe, Simon A; England, Gary C W; Asher, Lucy

2017-01-01

Working dog organisations, such as Guide Dogs, need to regularly assess the behaviour of the dogs they train. In this study we developed a questionnaire-style behaviour assessment completed by training supervisors of juvenile guide dogs aged 5, 8 and 12 months old (n = 1,401), and evaluated aspects of its reliability and validity. Specifically, internal reliability, temporal consistency, construct validity, predictive criterion validity (comparing against later training outcome) and concurrent criterion validity (comparing against a standardised behaviour test) were evaluated. Thirty-nine questions were sourced either from previously published literature or created to meet requirements identified via Guide Dogs staff surveys and staff feedback. Internal reliability analyses revealed seven reliable and interpretable trait scales named according to the questions within them as: Adaptability; Body Sensitivity; Distractibility; Excitability; General Anxiety; Trainability and Stair Anxiety. Intra-individual temporal consistency of the scale scores between 5-8, 8-12 and 5-12 months was high. All scales excepting Body Sensitivity showed some degree of concurrent criterion validity. Predictive criterion validity was supported for all seven scales, since associations were found with training outcome, at at-least one age. Thresholds of z-scores on the scales were identified that were able to distinguish later training outcome by identifying 8.4% of all dogs withdrawn for behaviour and 8.5% of all qualified dogs, with 84% and 85% specificity. The questionnaire assessment was reliable and could detect traits that are consistent within individuals over time, despite juvenile dogs undergoing development during the study period. By applying thresholds to scores produced from the questionnaire this assessment could prove to be a highly valuable decision-making tool for Guide Dogs. This is the first questionnaire-style assessment of juvenile dogs that has shown value in predicting the training outcome of individual working dogs.

Quantitative outcome measures for systemic sclerosis-related Microangiopathy - Reliability of image acquisition in Nailfold Capillaroscopy.

PubMed

Dinsdale, Graham; Moore, Tonia; O'Leary, Neil; Berks, Michael; Roberts, Christopher; Manning, Joanne; Allen, John; Anderson, Marina; Cutolo, Maurizio; Hesselstrand, Roger; Howell, Kevin; Pizzorni, Carmen; Smith, Vanessa; Sulli, Alberto; Wildt, Marie; Taylor, Christopher; Murray, Andrea; Herrick, Ariane L

2017-09-01

Nailfold capillaroscopic parameters hold increasing promise as outcome measures for clinical trials in systemic sclerosis (SSc). Their inclusion as outcomes would often naturally require capillaroscopy images to be captured at several time points during any one study. Our objective was to assess repeatability of image acquisition (which has been little studied), as well as of measurement. 41 patients (26 with SSc, 15 with primary Raynaud's phenomenon) and 10 healthy controls returned for repeat high-magnification (300×) videocapillaroscopy mosaic imaging of 10 digits one week after initial imaging (as part of a larger study of reliability). Images were assessed in a random order by an expert blinded observer and 4 outcome measures extracted: (1) overall image grade and then (where possible) distal vessel locations were marked, allowing (2) vessel density (across the whole nailfold) to be calculated (3) apex width measurement and (4) giant vessel count. Intra-rater, intra-visit and intra-rater inter-visit (baseline vs. 1week) reliability were examined in 475 and 392 images respectively. A linear, mixed-effects model was used to estimate variance components, from which intra-class correlation coefficients (ICCs) were determined. Intra-visit and inter-visit reliability estimates (ICCs) were (respectively): overall image grade, 0.97 and 0.90; vessel density, 0.92 and 0.65; mean vessel width, 0.91 and 0.79; presence of giant capillary, 0.68 and 0.56. These estimates were conditional on each parameter being measurable. Within-operator image analysis and acquisition are reproducible. Quantitative nailfold capillaroscopy, at least with a single observer, provides reliable outcome measures for clinical studies including randomised controlled trials. Copyright © 2017 Elsevier Inc. All rights reserved.

Psychometric analysis of the leadership environment scale (LENS): Outcome from the Oregon research initiative on the organisation of nursing (ORION).

PubMed

Ross, Amy M; Ilic, Kelley; Kiyoshi-Teo, Hiroko; Lee, Christopher S

2017-12-26

The purpose of this study was to establish the psychometric properties of the new 16-item leadership environment scale. The leadership environment scale was based on complexity science concepts relevant to complex adaptive health care systems. A workforce survey of direct-care nurses was conducted (n = 1,443) in Oregon. Confirmatory factor analysis, exploratory factor analysis, concordant validity test and reliability tests were conducted to establish the structure and internal consistency of the leadership environment scale. Confirmatory factor analysis indices approached acceptable thresholds of fit with a single factor solution. Exploratory factor analysis showed improved fit with a two-factor model solution; the factors were labelled 'influencing relationships' and 'interdependent system supports'. Moderate to strong convergent validity was observed between the leadership environment scale/subscales and both the nursing workforce index and the safety organising scale. Reliability of the leadership environment scale and subscales was strong, with all alphas ≥.85. The leadership environment scale is structurally sound and reliable. Nursing management can employ adaptive complexity leadership attributes, measure their influence on the leadership environment, subsequently modify system supports and relationships and improve the quality of health care systems. The leadership environment scale is an innovative fit to complex adaptive systems and how nurses act as leaders within these systems. © 2017 John Wiley & Sons Ltd.

Development and Validation of the Primary Care Team Dynamics Survey

PubMed Central

Song, Hummy; Chien, Alyna T; Fisher, Josephine; Martin, Julia; Peters, Antoinette S; Hacker, Karen; Rosenthal, Meredith B; Singer, Sara J

2015-01-01

Objective To develop and validate a survey instrument designed to measure team dynamics in primary care. Data Sources/Study Setting We studied 1,080 physician and nonphysician health care professionals working at 18 primary care practices participating in a learning collaborative aimed at improving team-based care. Study Design We developed a conceptual model and administered a cross-sectional survey addressing team dynamics, and we assessed reliability and discriminant validity of survey factors and the overall survey's goodness-of-fit using structural equation modeling. Data Collection We administered the survey between September 2012 and March 2013. Principal Findings Overall response rate was 68 percent (732 respondents). Results support a seven-factor model of team dynamics, suggesting that conditions for team effectiveness, shared understanding, and three supportive processes are associated with acting and feeling like a team and, in turn, perceived team effectiveness. This model demonstrated adequate fit (goodness-of-fit index: 0.91), scale reliability (Cronbach's alphas: 0.71–0.91), and discriminant validity (average factor correlations: 0.49). Conclusions It is possible to measure primary care team dynamics reliably using a 29-item survey. This survey may be used in ambulatory settings to study teamwork and explore the effect of efforts to improve team-based care. Future studies should demonstrate the importance of team dynamics for markers of team effectiveness (e.g., work satisfaction, care quality, clinical outcomes). PMID:25423886

Development and validation of the primary care team dynamics survey.

PubMed

Song, Hummy; Chien, Alyna T; Fisher, Josephine; Martin, Julia; Peters, Antoinette S; Hacker, Karen; Rosenthal, Meredith B; Singer, Sara J

2015-06-01

To develop and validate a survey instrument designed to measure team dynamics in primary care. We studied 1,080 physician and nonphysician health care professionals working at 18 primary care practices participating in a learning collaborative aimed at improving team-based care. We developed a conceptual model and administered a cross-sectional survey addressing team dynamics, and we assessed reliability and discriminant validity of survey factors and the overall survey's goodness-of-fit using structural equation modeling. We administered the survey between September 2012 and March 2013. Overall response rate was 68 percent (732 respondents). Results support a seven-factor model of team dynamics, suggesting that conditions for team effectiveness, shared understanding, and three supportive processes are associated with acting and feeling like a team and, in turn, perceived team effectiveness. This model demonstrated adequate fit (goodness-of-fit index: 0.91), scale reliability (Cronbach's alphas: 0.71-0.91), and discriminant validity (average factor correlations: 0.49). It is possible to measure primary care team dynamics reliably using a 29-item survey. This survey may be used in ambulatory settings to study teamwork and explore the effect of efforts to improve team-based care. Future studies should demonstrate the importance of team dynamics for markers of team effectiveness (e.g., work satisfaction, care quality, clinical outcomes). © Health Research and Educational Trust.

Comparison of clinical outcomes between arthroscopic subchondral drilling and microfracture for osteochondral lesions of the talus.

PubMed

Choi, Jun-Ik; Lee, Keun-Bae

2016-07-01

The objectives of this study were to compare the clinical outcomes of the two common bone marrow stimulation techniques such as subchondral drilling and microfracture for symptomatic osteochondral lesions of the talus and to evaluate prognostic factors affecting the outcomes. Ninety patients (90 ankles) who underwent arthroscopic bone marrow stimulation for small- to mid-sized osteochondral lesions of the talus constituted the study cohort. The 90 ankles were divided into two groups: a drilling group (40 ankles) and a microfracture group (50 ankles). Each group was matched for age and gender, and both groups had characteristics similar to those obtained from pre-operative demographic data. The American Orthopaedic Foot and Ankle Society (AOFAS) ankle-hindfoot score and the ankle activity score (AAS) were used to compare clinical outcomes, during a mean follow-up period of 43 months. The median AOFAS scores were 66.0 points (51-80) in drilling group and 66.5 points (45-81) in microfracture group pre-operatively, and these improved to 89.4 points (77-100) and 90.1 points (69-100) at the final follow-up, respectively. The median VAS scores improved at the final follow-up compared with the pre-operative condition. The median AAS for the drilling group improved from 4.5 (1-6) pre-operatively to 6.0 (1-8) at the final follow-up, while those for the microfracture group improved from 3.0 (2-8) to 6.0 (3-9). No significant differences were observed between the two groups in terms of the AOFAS scores, VAS, and AAS. The arthroscopic subchondral drilling and microfracture techniques that were used to stimulate bone marrow showed similar clinical outcomes. The results of this study suggest that both techniques are effective and reliable in treating small- to mid-sized osteochondral lesions of the talus, regardless of which of the two techniques is used. Level III, retrospective comparative study.

Effectiveness of home visiting programs on child outcomes: a systematic review

PubMed Central

2013-01-01

Background The effectiveness of paraprofessional home-visitations on improving the circumstances of disadvantaged families is unclear. The purpose of this paper is to systematically review the effectiveness of paraprofessional home-visiting programs on developmental and health outcomes of young children from disadvantaged families. Methods A comprehensive search of electronic databases (e.g., CINAHL PLUS, Cochrane, EMBASE, MEDLINE) from 1990 through May 2012 was supplemented by reference lists to search for relevant studies. Through the use of reliable tools, studies were assessed in duplicate. English language studies of paraprofessional home-visiting programs assessing specific outcomes for children (0-6 years) from disadvantaged families were eligible for inclusion in the review. Data extraction included the characteristics of the participants, intervention, outcomes and quality of the studies. Results Studies that scored 13 or greater out of a total of 15 on the validity tool (n = 21) are the focus of this review. All studies are randomized controlled trials and most were conducted in the United States. Significant improvements to the development and health of young children as a result of a home-visiting program are noted for particular groups. These include: (a) prevention of child abuse in some cases, particularly when the intervention is initiated prenatally; (b) developmental benefits in relation to cognition and problem behaviours, and less consistently with language skills; and (c) reduced incidence of low birth weights and health problems in older children, and increased incidence of appropriate weight gain in early childhood. However, overall home-visiting programs are limited in improving the lives of socially high-risk children who live in disadvantaged families. Conclusions Home visitation by paraprofessionals is an intervention that holds promise for socially high-risk families with young children. Initiating the intervention prenatally and increasing the number of visits improves development and health outcomes for particular groups of children. Future studies should consider what dose of the intervention is most beneficial and address retention issues. PMID:23302300

Development of the just culture assessment tool: measuring the perceptions of health-care professionals in hospitals.

PubMed

Petschonek, Sarah; Burlison, Jonathan; Cross, Carl; Martin, Kathy; Laver, Joseph; Landis, Ronald S; Hoffman, James M

2013-12-01

Given the growing support for establishing a just patient safety culture in health-care settings, a valid tool is needed to assess and improve just patient safety culture. The purpose of this study was to develop a measure of individual perceptions of just culture for a hospital setting. The 27-item survey was administered to 998 members of a health-care staff in a pediatric research hospital as part of the hospital's ongoing patient safety culture assessment process. Subscales included balancing a blame-free approach with accountability, feedback and communication, openness of communication, quality of the event reporting process, continuous improvement, and trust. The final sample of 404 participants (40% response rate) included nurses, physicians, pharmacists, and other hospital staff members involved in patient care. Confirmatory factor analysis was used to test the internal structure of the measure and reliability analyses were conducted on the subscales. Moderate support for the factor structure was established with confirmatory factor analysis. After modifications were made to improve statistical fit, the final version of the measure included 6 subscales loading onto one higher-order dimension. Additionally, Cronbach α reliability scores for the subscales were positive, with each dimension being above 0.7 with the exception of one. The instrument designed and tested in this study demonstrated adequate structure and reliability. Given the uniqueness of the current sample, further verification of the JCAT is needed from hospitals that serve broader populations. A validated tool could also be used to evaluate the relation between just culture and patient safety outcomes.

Development of the Just Culture Assessment Tool (JCAT): Measuring the Perceptions of HealthCare Professionals in Hospitals

PubMed Central

Petschonek, Sarah; Burlison, Jonathan; Cross, Carl; Martin, Kathy; Laver, Joseph; Landis, Ronald S.; Hoffman, James M.

2014-01-01

Objectives Given the growing support for establishing a just patient safety culture in healthcare settings, a valid tool is needed to assess and improve just patient safety culture. The purpose of this study was to develop a measure of individual perceptions of just culture for a hospital setting. Methods The 27 item survey was administered to 998 members of a healthcare staff in a pediatric research hospital as part of the hospital's ongoing patient safety culture assessment process. Subscales included balancing a blame-free approach with accountability, feedback and communication, openness of communication, quality of the event reporting process, continuous improvement, and trust. The final sample of 404 participants (40% response rate) included nurses, physicians, pharmacists and other hospital staff members involved in patient care. Confirmatory factor analysis was used to test the internal structure of the measure and reliability analyses were conducted on the subscales. Results Moderate support for the factor structure was established with confirmatory factor analysis. After modifications were made to improve statistical fit, the final version of the measure included six subscales loading onto one higher-order dimension. Additionally, Cronbach's alpha reliability scores for the subscales were positive, with each dimension being above 0.7 with the exception of one. Conclusions The instrument designed and tested in this study demonstrated adequate structure and reliability. Given the uniqueness of the current sample, further verification of the JCAT is needed from hospitals that serve broader populations. A validated tool could also be used to evaluate the relation between just culture and patient safety outcomes. PMID:24263549

When Does Premature Treatment Termination Occur? Examining Session-by-Session Dropout Among Clients with Gambling Disorder.

PubMed

Pfund, Rory A; Peter, Samuel C; Whelan, James P; Meyers, Andrew W

2018-06-01

Premature termination challenges the successful outcomes of psychological treatments for gambling disorder. To date, research has primarily identified clients who are at particular risk for dropping out of treatment. A smaller but growing body of literature has investigated when dropout occurs. Typically, those studies have not considered improvement in psychological distress within their operationalizations of dropout and therefore may have misrepresented when dropout occurs. The current study examined when dropout occurs using an operationalization based on the criteria of attaining reliable change in a naturalistic sample of clients with gambling disorder, and the classification rates yielded from that operationalization were compared to the rates from a more common operationalization. Participants (n = 334) were clients meeting diagnostic criteria for gambling disorder at an outpatient private practice who completed a measure of psychological distress at baseline and prior to each subsequent treatment session. A survival analysis was conducted to determine temporal patterns of treatment dropout (i.e., clients who discontinued treatment before realizing reliable changes in psychological distress) and completion (i.e., clients who discontinued treatment after realizing reliable changes in distress) at each treatment session. Forty-nine percent of clients were classified as dropouts, and the majority of those clients did so in the first few sessions. The more common operationalization of dropout classified clients as dropouts when they had improved in their distress and clients as completers when they had not improved in their distress. Discussion centers on the implications of dropout occurring at various stages of treatment and future directions.

Next-generation healthcare: a strategic appraisal.

PubMed

Montague, Terrence

2009-01-01

Successful next-generation healthcare must deliver timely access and quality for an aging population, while simultaneously promoting disease prevention and managing costs. The key factors for sustained success are a culture with aligned goals and values; coordinated team care that especially engages with physicians and patients; practical information that is collected and communicated reliably; and education in the theory and methods of collaboration, measurement and leadership. Currently, optimal population health is challenged by a high prevalence of chronic disease, with large gaps between best and usual care, a scarcity of health human resources - particularly with the skills, attitudes and training for coordinated team care - and the absence of flexible, reliable clinical measurement systems. However, to make things better, institutional models and supporting technologies are available. In the short term, a first step is to enhance the awareness of the practical opportunities to improve, including the expansion of proven community-based disease management programs that communicate knowledge, competencies and clinical measurements among professional and patient partners, leading to reduced care gaps and improved clinical and economic outcomes. Longer-term success requires two additional steps. One is formal inter-professional training to provide, on an ongoing basis, the polyvalent human resource skills and foster the culture of working with others to improve the care of whole populations. The other is the adoption of reliable information systems, including electronic health records, to allow useful and timely measurement and effective communication of clinical information in real-world settings. A better health future can commence immediately, within existing resources, and be sustained with feasible innovations in provider and patient education and information systems. The future is now.

The Movement Imagery Questionnaire-Revised, Second Edition (MIQ-RS) Is a Reliable and Valid Tool for Evaluating Motor Imagery in Stroke Populations

PubMed Central

Butler, Andrew J.; Cazeaux, Jennifer; Fidler, Anna; Jansen, Jessica; Lefkove, Nehama; Gregg, Melanie; Hall, Craig; Easley, Kirk A.; Shenvi, Neeta; Wolf, Steven L.

2012-01-01

Mental imagery can improve motor performance in stroke populations when combined with physical therapy. Valid and reliable instruments to evaluate the imagery ability of stroke survivors are needed to maximize the benefits of mental imagery therapy. The purposes of this study were to: examine and compare the test-retest intra-rate reliability of the Movement Imagery Questionnaire-Revised, Second Edition (MIQ-RS) in stroke survivors and able-bodied controls, examine internal consistency of the visual and kinesthetic items of the MIQ-RS, determine if the MIQ-RS includes both the visual and kinesthetic dimensions of mental imagery, correlate impairment and motor imagery scores, and investigate the criterion validity of the MIQ-RS in stroke survivors by comparing the results to the KVIQ-10. Test-retest analysis indicated good levels of reliability (ICC range: .83–.99) and internal consistency (Cronbach α: .95–.98) of the visual and kinesthetic subscales in both groups. The two-factor structure of the MIQ-RS was supported by factor analysis, with the visual and kinesthetic components accounting for 88.6% and 83.4% of the total variance in the able-bodied and stroke groups, respectively. The MIQ-RS is a valid and reliable instrument in the stroke population examined and able-bodied populations and therefore useful as an outcome measure for motor imagery ability. PMID:22474504

Patient-Reported Outcome Measures for Hand and Wrist Trauma

PubMed Central

Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

2016-01-01

Background: Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. Methods: A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. Results: The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. Conclusions: The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology. PMID:27418884

The operations manual: a mechanism for improving the research process.

PubMed

Bowman, Ann; Wyman, Jean F; Peters, Jennifer

2002-01-01

The development and use of an operations manual has the potential to improve the capacity of nurse scientists to address the complex, multifaceted issues associated with conducting research in today's healthcare environment. An operations manual facilitates communication, standardizes training and evaluation, and enhances the development and standard implementation of clear policies, processes, and protocols. A 10-year review of methodology articles in relevant nursing journals revealed no attention to this topic. This article will discuss how an operations manual can improve the conduct of research methods and outcomes for both small-scale and large-scale research studies. It also describes the purpose and components of a prototype operations manual for use in quantitative research. The operations manual increases reliability and reproducibility of the research while improving the management of study processes. It can prevent costly and untimely delays or errors in the conduct of research.

Cost-effective solutions to maintaining smart grid reliability

NASA Astrophysics Data System (ADS)

Qin, Qiu

As the aging power systems are increasingly working closer to the capacity and thermal limits, maintaining an sufficient reliability has been of great concern to the government agency, utility companies and users. This dissertation focuses on improving the reliability of transmission and distribution systems. Based on the wide area measurements, multiple model algorithms are developed to diagnose transmission line three-phase short to ground faults in the presence of protection misoperations. The multiple model algorithms utilize the electric network dynamics to provide prompt and reliable diagnosis outcomes. Computational complexity of the diagnosis algorithm is reduced by using a two-step heuristic. The multiple model algorithm is incorporated into a hybrid simulation framework, which consist of both continuous state simulation and discrete event simulation, to study the operation of transmission systems. With hybrid simulation, line switching strategy for enhancing the tolerance to protection misoperations is studied based on the concept of security index, which involves the faulted mode probability and stability coverage. Local measurements are used to track the generator state and faulty mode probabilities are calculated in the multiple model algorithms. FACTS devices are considered as controllers for the transmission system. The placement of FACTS devices into power systems is investigated with a criterion of maintaining a prescribed level of control reconfigurability. Control reconfigurability measures the small signal combined controllability and observability of a power system with an additional requirement on fault tolerance. For the distribution systems, a hierarchical framework, including a high level recloser allocation scheme and a low level recloser placement scheme, is presented. The impacts of recloser placement on the reliability indices is analyzed. Evaluation of reliability indices in the placement process is carried out via discrete event simulation. The reliability requirements are described with probabilities and evaluated from the empirical distributions of reliability indices.

Computed tomography and clinical outcome in patients with severe traumatic brain injury.

PubMed

Stenberg, Maud; Koskinen, Lars-Owe D; Jonasson, Per; Levi, Richard; Stålnacke, Britt-Marie

2017-01-01

To study: (i) acute computed tomography (CT) characteristics and clinical outcome; (ii) clinical course and (iii) Corticosteroid Randomisation after Significant Head Injury acute calculator protocol (CRASH) model and clinical outcome in patients with severe traumatic brain injury (sTBI). Initial CT (CT i ) and CT 24 hours post-trauma (CT 24 ) were evaluated according to Marshall and Rotterdam classifications. Rancho Los Amigos Cognitive Scale-Revised (RLAS-R) and Glasgow Outcome Scale Extended (GOSE) were assessed at three months and one year post-trauma. The prognostic value of the CRASH model was evaluated. Thirty-seven patients were included. Marshall CT i and CT 24 were significantly correlated with RLAS-R at three months. Rotterdam CT 24 was significantly correlated with GOSE at three months. RLAS-R and the GOSE improved significantly from three months to one year. CRASH predicted unfavourable outcome at six months for 81% of patients with bad outcome and for 85% of patients with favourable outcome according to GOSE at one year. Neither CT nor CRASH yielded clinically useful predictions of outcome at one year post-injury. The study showed encouragingly many instances of significant recovery in this population of sTBI. The combination of lack of reliable prognostic indicators and favourable outcomes supports the case for intensive acute management and rehabilitation as the default protocol in the cases of sTBI.

An international study of intrachromosomal amplification of chromosome 21 (iAMP21): cytogenetic characterization and outcome

PubMed Central

Harrison, CJ; Moorman, AV; Schwab, C; Carroll, AJ; Raetz, EA; Devidas, M; Strehl, S; Nebral, K; Harbott, J; Teigler-Schlegel, A; Zimmerman, M; Dastuge, N; Baruchel, A; Soulier, J; Auclerc, M-F; Attarbaschi, A; Mann, G; Stark, B; Cazzaniga, G; Chilton, L; Vandenberghe, P; Forestier, E; Haltrich, I; Raimondi, SC; Parihar, M; Bourquin, J-P; Tchinda, J; Haferlach, C; Vora, A; Hunger, SP; Heerema, NA; Haas, OA

2014-01-01

Intrachromosomal amplification of chromosome 21 (iAMP21) defines a distinct cytogenetic subgroup of childhood B-cell precursor acute lymphoblastic leukaemia (BCP-ALL). To date, fluorescence in situ hybridisation (FISH), with probes specific for the RUNX1 gene, provides the only reliable detection method (five or more RUNX1 signals per cell). Patients with iAMP21 are older (median age 9 years) with a low white cell count. Previously, we demonstrated a high relapse risk when these patients were treated as standard risk. Recent studies have shown improved outcome on intensive therapy. In view of these treatment implications, accurate identification is essential. Here we have studied the cytogenetics and outcome of 530 iAMP21 patients that highlighted the association of specific secondary chromosomal and genetic changes with iAMP21 to assist in diagnosis, including the gain of chromosome X, loss or deletion of chromosome 7, ETV6 and RB1 deletions. These iAMP21 patients when treated as high risk showed the same improved outcome as those in trial-based studies regardless of the backbone chemotherapy regimen given. This study reinforces the importance of intensified treatment to reduce the risk of relapse in iAMP21 patients. This now well-defined patient subgroup should be recognised by World Health Organisation (WHO) as a distinct entity of BCP-ALL. PMID:24166298

An international study of intrachromosomal amplification of chromosome 21 (iAMP21): cytogenetic characterization and outcome.

PubMed

Harrison, C J; Moorman, A V; Schwab, C; Carroll, A J; Raetz, E A; Devidas, M; Strehl, S; Nebral, K; Harbott, J; Teigler-Schlegel, A; Zimmerman, M; Dastuge, N; Baruchel, A; Soulier, J; Auclerc, M-F; Attarbaschi, A; Mann, G; Stark, B; Cazzaniga, G; Chilton, L; Vandenberghe, P; Forestier, E; Haltrich, I; Raimondi, S C; Parihar, M; Bourquin, J-P; Tchinda, J; Haferlach, C; Vora, A; Hunger, S P; Heerema, N A; Haas, O A

2014-05-01

Intrachromosomal amplification of chromosome 21 (iAMP21) defines a distinct cytogenetic subgroup of childhood B-cell precursor acute lymphoblastic leukaemia (BCP-ALL). To date, fluorescence in situ hybridisation (FISH), with probes specific for the RUNX1 gene, provides the only reliable detection method (five or more RUNX1 signals per cell). Patients with iAMP21 are older (median age 9 years) with a low white cell count. Previously, we demonstrated a high relapse risk when these patients were treated as standard risk. Recent studies have shown improved outcome on intensive therapy. In view of these treatment implications, accurate identification is essential. Here we have studied the cytogenetics and outcome of 530 iAMP21 patients that highlighted the association of specific secondary chromosomal and genetic changes with iAMP21 to assist in diagnosis, including the gain of chromosome X, loss or deletion of chromosome 7, ETV6 and RB1 deletions. These iAMP21 patients when treated as high risk showed the same improved outcome as those in trial-based studies regardless of the backbone chemotherapy regimen given. This study reinforces the importance of intensified treatment to reduce the risk of relapse in iAMP21 patients. This now well-defined patient subgroup should be recognised by World Health Organisation (WHO) as a distinct entity of BCP-ALL.

Using G-Theory to Enhance Evidence of Reliability and Validity for Common Uses of the Paulhus Deception Scales.

PubMed

Vispoel, Walter P; Morris, Carrie A; Kilinc, Murat

2018-01-01

We applied a new approach to Generalizability theory (G-theory) involving parallel splits and repeated measures to evaluate common uses of the Paulhus Deception Scales based on polytomous and four types of dichotomous scoring. G-theory indices of reliability and validity accounting for specific-factor, transient, and random-response measurement error supported use of polytomous over dichotomous scores as contamination checks; as control, explanatory, and outcome variables; as aspects of construct validation; and as indexes of environmental effects on socially desirable responding. Polytomous scoring also provided results for flagging faking as dependable as those when using dichotomous scoring methods. These findings argue strongly against the nearly exclusive use of dichotomous scoring for the Paulhus Deception Scales in practice and underscore the value of G-theory in demonstrating this. We provide guidelines for applying our G-theory techniques to other objectively scored clinical assessments, for using G-theory to estimate how changes to a measure might improve reliability, and for obtaining software to conduct G-theory analyses free of charge.

Development and Testing of the Healthy Work Environment Inventory: A Reliable Tool for Assessing Work Environment Health and Satisfaction.

PubMed

Clark, Cynthia M; Sattler, Victoria P; Barbosa-Leiker, Celestina

2016-10-01

Fostering healthy work environments that enhance job satisfaction and reflect high levels of employee engagement and productivity is imperative for all organizations. This is especially true for health care organizations where unhealthy work conditions can lead to poor patient outcomes. A convenience sample of 520 nursing faculty and practice-based nurses in the United States participated in a study to test the psychometric properties of the Healthy Work Environment Inventory (HWEI). A factor analysis and other reliability analyses support the use of the HWEI as a valid and reliable instrument to measure perceptions of work environment health. The HWEI is a 20-item psychometrically sound instrument to measure perceptions of the health of the work environment. It may be completed either as an individual exercise or by all members of a team to compare perceptions of work environment health, to determine areas of strength and improvement, and to form the basis for interviewing. [J Nurs Educ. 2016;55(10):555-562.]. Copyright 2016, SLACK Incorporated.

Dysphagia-related quality of life in oculopharyngeal muscular dystrophy: Psychometric properties of the SWAL-QOL instrument.

PubMed

Youssof, Sarah; Romero-Clark, Carol; Warner, Teddy; Plowman, Emily

2017-07-01

The Swallowing Quality of Life instrument (SWAL-QOL) is a patient-reported outcome measure of swallowing-related quality of life (SR-QoL). Its psychometric properties in oculopharyngeal muscular dystrophy (OPMD) are not known. We administered the SWAL-QOL to U.S. OPMD Registry participants. We described SR-QoL profiles and assessed reliability and validity. The mean composite score in 113 individuals with OPMD was 54.4 ± 20.7, indicating moderate impairment. Severe impairments were observed in eating duration, burden, and fatigue scales. Internal consistency reliability of all scales was found to be satisfactory, and 9 of 10 scales demonstrated adequate test-retest reliability. Data confirmed 86% of hypotheses, supporting construct validity. The SWAL-QOL limitations in OPMD include: floor/ceiling effects in 7 of 10 scales and low specificity of sleep, fatigue, and communication scales for dysphagia. SR-QoL is reduced in OPMD. Given several limitations of the SWAL-QOL, development of an improved dysphagia-specific QoL instrument for OPMD is warranted. Muscle Nerve 56: 28-35, 2017. © 2016 Wiley Periodicals, Inc.

The UK Out of Hospital Cardiac Arrest Outcome (OHCAO) project.

PubMed

Perkins, Gavin D; Brace-McDonnell, Samantha J

2015-10-01

Reducing premature death is a key priority for the UK National Health Service (NHS). NHS Ambulance services treat approximately 30 000 cases of suspected cardiac arrest each year but survival rates vary. The British Heart Foundation and Resuscitation Council (UK) have funded a structured research programme--the Out of Hospital Cardiac Arrest Outcomes (OHCAO) programme. The aim of the project is to establish the epidemiology and outcome of OHCA, explore sources of variation in outcome and establish the feasibility of setting up a national OHCA registry. This is a prospective observational study set in UK NHS Ambulance Services. The target population will be adults and children sustaining an OHCA who are attended by an NHS ambulance emergency response and where resuscitation is attempted. The data collected will be characterised broadly as system characteristics, emergency medical services (EMS) dispatch characteristics, patient characteristics and EMS process variables. The main outcome variables of interest will be return of spontaneous circulation and medium-long-term survival (30 days to 10-year survival). Ethics committee permissions were gained and the study also has received approval from the Confidentiality Advisory Group Ethics and Confidentiality committee which provides authorisation to lawfully hold identifiable data on patients without their consent. To identify the key characteristics contributing to better outcomes in some ambulance services, reliable and reproducible systems need to be established for collecting data on OHCA in the UK. Reports generated from the registry will focus on data completeness, timeliness and quality. Subsequent reports will summarise demographic, patient, process and outcome variables with aim of improving patient care through focus quality improvement initiatives. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Do Hospitals Performing Frequent Neuraxial Anesthesia for Hip and Knee Replacements Have Better Outcomes?

PubMed

Memtsoudis, Stavros G; Poeran, Jashvant; Zubizarreta, Nicole; Olson, Ashley; Cozowicz, Crispiana; Mörwald, Eva E; Mariano, Edward R; Mazumdar, Madhu

2018-06-07

Neuraxial anesthesia is increasingly recommended for hip/knee replacements as some studies show improved outcomes on the individual level. With hospital-level studies lacking, we assessed the relationship between hospital-level neuraxial anesthesia utilization and outcomes. National data on 808,237 total knee and 371,607 hip replacements were included (Premier Healthcare 2006 to 2014; 550 hospitals). Multivariable associations were measured between hospital-level neuraxial anesthesia volume (subgrouped into quartiles) and outcomes (respiratory/cardiac complications, blood transfusion/intensive care unit need, opioid utilization, and length/cost of hospitalization). Odds ratios (or percent change) and 95% CI are reported. Volume-outcome relationships were additionally assessed by plotting hospital-level neuraxial anesthesia volume against predicted hospital-specific outcomes; trend tests were applied with trendlines' R statistics reported. Annual hospital-specific neuraxial anesthesia volume varied greatly: interquartile range, 3 to 78 for hips and 6 to 163 for knees. Increasing frequency of neuraxial anesthesia was not associated with reliable improvements in any of the study's clinical outcomes. However, significant reductions of up to -14.1% (95% CI, -20.9% to -6.6%) and -15.6% (95% CI, -22.8% to -7.7%) were seen for hospitalization cost in knee and hip replacements, respectively, both in the third quartile of neuraxial volume. This coincided with significant volume effects for hospitalization cost; test for trend P < 0.001 for both procedures, R 0.13 and 0.41 for hip and knee replacements, respectively. Increased hospital-level use of neuraxial anesthesia is associated with lower hospitalization cost for lower joint replacements. However, additional studies are needed to elucidate all drivers of differences found before considering hospital-level neuraxial anesthesia use as a potential marker of quality.

Validity and reliability of the Dutch version of the Copenhagen Hip And Groin Outcome Score (HAGOS-NL) in patients with hip pathology.

PubMed

Giezen, Hilde; Stevens, Martin; van den Akker-Scheek, Inge; Reininga, Inge H F

2017-01-01

The Copenhagen Hip And Groin Outcome Score (HAGOS) was developed to assess disease-specific consequences in young to middle-aged, physically active hip and/or groin patients. The study aimed to determine validity and reliability of the Dutch version of the HAGOS (HAGOS-NL) for middle-aged patients with hip complaints. To assess validity, 117 participants completed five questionnaires: HAGOS-NL, international Hip Outcome Tool (iHOT-12NL), Hip disability and Osteoarthritis Outcome Score (HOOS), RAND-36 Health Survey and Tegner activity scale. Structural validity was determined by conducting confirmatory factor analysis. Construct validity was analyzed by formulating predefined hypotheses regarding relationships between the HAGOS-NL and subscales of the iHOT-12NL, HOOS, RAND-36 and Tegner activity scale. The HAGOS-NL was filled out again by 67 patients to explore test-retest reliability. Reliability was assessed in terms of Cronbach's alpha, Intraclass Correlation Coefficient (ICC), Standard Error of Measurement (SEM) and Minimal Detectable Change (MDC). The Bland and Altman method was used to explore absolute agreement. Factor analysis confirmed that the HAGOS-NL consists of six subscales. All hypotheses were confirmed, indicating good construct validity. Internal consistency was good, with Cronbach's alpha values ranging from 0.89 to 0.98. Test-retest reliability was considered good, with ICC values of 0.80 and higher. The SEM ranged from 6.6 to 12.3, and MDC at individual level from 18.3 to 34.1 and at group level from 2.3 to 4.4. Bland and Altman analyses showed no bias. The HAGOS-NL is a reliable and valid instrument for measuring pain, physical functioning and quality of life in middle-aged patients with hip complaints.

Automation of CT-based haemorrhagic stroke assessment for improved clinical outcomes: study protocol and design

PubMed Central

Chinda, Betty; Medvedev, George; Siu, William; Ester, Martin; Arab, Ali; Gu, Tao; Moreno, Sylvain; D’Arcy, Ryan C N; Song, Xiaowei

2018-01-01

Introduction Haemorrhagic stroke is of significant healthcare concern due to its association with high mortality and lasting impact on the survivors’ quality of life. Treatment decisions and clinical outcomes depend strongly on the size, spread and location of the haematoma. Non-contrast CT (NCCT) is the primary neuroimaging modality for haematoma assessment in haemorrhagic stroke diagnosis. Current procedures do not allow convenient NCCT-based haemorrhage volume calculation in clinical settings, while research-based approaches are yet to be tested for clinical utility; there is a demonstrated need for developing effective solutions. The project under review investigates the development of an automatic NCCT-based haematoma computation tool in support of accurate quantification of haematoma volumes. Methods and analysis Several existing research methods for haematoma volume estimation are studied. Selected methods are tested using NCCT images of patients diagnosed with acute haemorrhagic stroke. For inter-rater and intrarater reliability evaluation, different raters will analyse haemorrhage volumes independently. The efficiency with respect to time of haematoma volume assessments will be examined to compare with the results from routine clinical evaluations and planimetry assessment that are known to be more accurate. The project will target the development of an enhanced solution by adapting existing methods and integrating machine learning algorithms. NCCT-based information of brain haemorrhage (eg, size, volume, location) and other relevant information (eg, age, sex, risk factor, comorbidities) will be used in relation to clinical outcomes with future project development. Validity and reliability of the solution will be examined for potential clinical utility. Ethics and dissemination The project including procedures for deidentification of NCCT data has been ethically approved. The study involves secondary use of existing data and does not require new consent of participation. The team consists of clinical neuroimaging scientists, computing scientists and clinical professionals in neurology and neuroradiology and includes patient representatives. Research outputs will be disseminated following knowledge translation plans towards improving stroke patient care. Significant findings will be published in scientific journals. Anticipated deliverables include computer solutions for improved clinical assessment of haematoma using NCCT. PMID:29674371

The role of high-frequency oscillations in epilepsy surgery planning.

PubMed

Gloss, David; Nevitt, Sarah J; Staba, Richard

2017-10-05

Epilepsy is a serious brain disorder characterized by recurrent unprovoked seizures. Approximately two-thirds of seizures can be controlled with antiepileptic medications (Kwan 2000). For some of the others, surgery can completely eliminate or significantly reduce the occurrence of disabling seizures. Localization of epileptogenic areas for resective surgery is far from perfect, and new tools are being investigated to more accurately localize the epileptogenic zone (the zone of the brain where the seizures begin) and improve the likelihood of freedom from postsurgical seizures. Recordings of pathological high-frequency oscillations (HFOs) may be one such tool. To assess the ability of HFOs to improve the outcomes of epilepsy surgery by helping to identify more accurately the epileptogenic areas of the brain. For the latest update, we searched the Cochrane Epilepsy Group Specialized Register (25 July 2016), the Cochrane Central Register of Controlled Trials (CENTRAL) via the Cochrane Register of Studies Online (CRSO, 25 July 2016), MEDLINE (Ovid, 1946 to 25 July 2016), CINAHL Plus (EBSCOhost, 25 July 2016), Web of Science (Thomson Reuters, 25 July 2016), ClinicalTrials.gov (25 July 2016), and the World Health Organization International Clinical Trials Registry Platform ICTRP (25 July 2016). We included studies that provided information on the outcomes of epilepsy surgery for at least six months and which used high-frequency oscillations in making decisions about epilepsy surgery. The primary outcome of the review was the Engel Class Outcome System (class I = no disabling seizures, II = rare disabling seizures, III = worthwhile improvement, IV = no worthwhile improvement). Secondary outcomes were responder rate, International League Against Epilepsy (ILAE) epilepsy surgery outcome, frequency of adverse events from any source and quality of life outcomes. We intended to analyse outcomes via an aggregated data fixed-effect model meta-analysis. Two studies representing 11 participants met the inclusion criteria. Both studies were small non-randomised trials, with no control group and no blinding. The quality of evidence for all outcomes was very low. The combination of these two studies resulted in 11 participants who prospectively used ictal HFOs for epilepsy surgery decision making. Results of the postsurgical seizure freedom Engel class I to IV outcome were determined over a period of 12 to 38 months (average 23.4 months) and indicated that six participants had an Engel class I outcome (seizure freedom), two had class II (rare disabling seizures), three had class III (worthwhile improvement). No adverse effects were reported. Neither study compared surgical results guided by HFOs versus surgical results guided without HFOs. No reliable conclusions can be drawn regarding the efficacy of using HFOs in epilepsy surgery decision making at present.

The Medicare Health Outcomes Survey program: overview, context, and near-term prospects.

PubMed

Jones, Nathaniel; Jones, Stephanie L; Miller, Nancy A

2004-07-12

In 1996, the Centers for Medicare & Medicaid Services (CMS) initiated the Medicare Health Outcomes Survey (HOS). It is the first national survey to measure the quality of life and functional health status of Medicare beneficiaries enrolled in managed care. The program seeks to gather valid and reliable health status data in Medicare managed care for use in quality improvement activities, public reporting, plan accountability and improving health outcomes based on competition. The context that led to the development of the HOS was formed by the convergence of the following factors: 1) a recognized need to monitor the performance of managed care plans, 2) technical expertise and advancement in the areas of quality measurement and health outcomes assessment, 3) the existence of a tested functional health status assessment tool (SF-36)1, which was valid for an elderly population, 4) CMS leadership, and 5) political interest in quality improvement. Since 1998, there have been six baseline surveys and four follow up surveys. CMS, working with its partners, performs the following tasks as part of the HOS program: 1) Supports the technical/scientific development of the HOS measure, 2) Certifies survey vendors, 3) Collects Health Plan Employer Data and Information Set(HEDIS)2 HOS data, 4) Cleans, scores, and disseminates annual rounds of HOS data, public use files and reports to CMS, Quality Improvement Organizations (QIOs), Medicare+Choice Organizations (M+COs), and other stakeholders, 5) Trains M+COs and QIOs in the use of functional status measures and best practices for improving care, 6) Provides technical assistance to CMS, QIOs, M+COs and other data users, and 7) Conducts analyses using HOS data to support CMS and HHS priorities.CMS has recently sponsored an evaluation of the HOS program, which will provide the information necessary to enhance the future administration of the program. Information collected to date reveals that the HOS program is a valuable tool that provides a rich set of data that is useful for quality monitoring and improvement efforts. To enhance the future of the HOS program, many stakeholders recommend the implementation of incentives to encourage the use of the data, while others identify the need to monitor the health status of plan disenrollees.Overall, the HOS program represents an important vehicle for collecting outcomes data from Medicare beneficiaries. The new Medicare Prescription Drug, Improvement, and Modernization Act (2003) mandates the collection and use of data for outcomes measurement. Consequently, it is important to improve HOS to most effectively meet the mandate.

Interdigitation Zone Band Restoration After Treatment of Diabetic Macular Edema.

PubMed

Serizawa, Satoshi; Ohkoshi, Kishiko; Minowa, Yuko; Soejima, Kumiko

2016-09-01

To investigate whether the integrity of the interdigitation zone band, the ellipsoid zone band, and the external limiting membrane are reliable markers of treatment outcome in diabetic macular edema (DME). In this retrospective study, we examined 41 treatment-naïve eyes (38 patients) with DME that were treated with laser therapy, pharmacotherapy, and/or vitrectomy. Best-corrected visual acuity and the integrity of the interdigitation zone band, the ellipsoid zone band, and the external limiting membrane were assessed before treatment and at 3, 6, and 12 months after DME treatment. One year after treatment, the external limiting membrane, ellipsoid zone band, and interdigitation zone band were completely visible in 30 (73.2%), 24 (58.5%), and 2 (4.9%) eyes, respectively. Interdigitation zone band status improved significantly (P = 0.005) 1 year after treatment. The interdigitation zone did not improve in the absence of the ellipsoid zone band. Likewise, ellipsoid zone status did not improve in the absence of the external limiting membrane at any time after treatment. The results of this study show that restoration of the interdigitation zone band constitutes a very sensitive marker of DME treatment outcome when the ellipsoid zone band is visible before treatment.

Lipoabdominoplasty: An exponential advantage for a consistently safe and aesthetic outcome.

PubMed

Kanjoor, J R; Singh, A K

2012-01-01

Extensive liposuction along with limited dissection of abdominal flaps is slowly emerging as a well proven advantageous method over standard abdominoplasty. A retrospective study analyzed 146 patients managed for the abdominal contour deformities from March 2004 to February 2010. A simple method to project the post operative outcome by rotation of a supine lateral photograph to upright posture in 46 patients prospectively has succeeded in projecting a predictable result. All patients were encouraged to practice chest physiotherapy in 'tummy tuck' position during the preoperative counseling. Aggressive liposuction of entire upper abdomen, a limited dissection in the midline, plication of diastasis of rectus whenever indicated, panniculectomy and neoumblicoplasty were done in all patients. The patients had a mean age of 43, youngest being 29 and oldest 72 years. Majority were of normal weight (94%). Twelve were morbidly obese; 57 patients had undergone previous abdominal surgeries; 49 patients had associated hernias. Lipoabdominoplasty yielded a satisfactory result in 110 (94%) patients. The postoperative patient had a definitely less heavy harmonious abdomen with improved waistline. The complications were more with higher BMI, fat thickness of more than 7 cm and prolonged operating time when other procedures were combined. Extensive liposuction combined with limited dissection method applied to all abdominoplasty patients yielded consistently safe, reliable and predictable aesthetic results with less complications and faster recovery. The simple photographic manipulation has helped project the postoperative outcome reliably. The preoperative chest physiotherapy in tummytuck position helped prevent chest complications.

The Irvine, Beatties, and Bresnahan (IBB) Forelimb Recovery Scale: An Assessment of Reliability and Validity

PubMed Central

Irvine, Karen-Amanda; Ferguson, Adam R.; Mitchell, Kathleen D.; Beattie, Stephanie B.; Lin, Amity; Stuck, Ellen D.; Huie, J. Russell; Nielson, Jessica L.; Talbott, Jason F.; Inoue, Tomoo; Beattie, Michael S.; Bresnahan, Jacqueline C.

2014-01-01

The IBB scale is a recently developed forelimb scale for the assessment of fine control of the forelimb and digits after cervical spinal cord injury [SCI; (1)]. The present paper describes the assessment of inter-rater reliability and face, concurrent and construct validity of this scale following SCI. It demonstrates that the IBB is a reliable and valid scale that is sensitive to severity of SCI and to recovery over time. In addition, the IBB correlates with other outcome measures and is highly predictive of biological measures of tissue pathology. Multivariate analysis using principal component analysis (PCA) demonstrates that the IBB is highly predictive of the syndromic outcome after SCI (2), and is among the best predictors of bio-behavioral function, based on strong construct validity. Altogether, the data suggest that the IBB, especially in concert with other measures, is a reliable and valid tool for assessing neurological deficits in fine motor control of the distal forelimb, and represents a powerful addition to multivariate outcome batteries aimed at documenting recovery of function after cervical SCI in rats. PMID:25071704

Improving Attitudes and Perceived Competence in Caring for Dying Patients: An End-of-Life Simulation.

PubMed

Lippe, Megan Pfitzinger; Becker, Heather

2015-01-01

The aim of this study was to assess learning outcomes from a simulation on providing care to a critically ill patient from whom care is ultimately withdrawn. Nursing students have anxiety and low perceived competence for caring for dying patients. Effective strategies for teaching communication, assessment, and basic nursing skills are needed. A pretest-posttest design compared perceived competence and attitudes in caring for dying patients with three separate cohorts of undergraduate nursing students performing the simulation. The cohorts had significantly improved scores on the perceived competence (p < .001) and attitude (p < .01) measures following the simulation. Reliability for a new instrument to assess perceived competence in caring for dying patients was also established. This study's simulation offers a robust teaching strategy for improving nursing students' attitudes and perceived competence in caring for dying patients.

Outside the box: will information technology be a viable intervention to improve the quality of cancer care?

PubMed

Hesse, Bradford W; Hanna, Christopher; Massett, Holly A; Hesse, Nicola K

2010-01-01

The use of health information technology (IT) to resolve the crisis in communication inherent within the fragmented service environment of medical care in the United States is a strategic priority for the Department of Health and Human Services. Yet the deployment of health IT alone is not sufficient to improve quality in health service delivery; what is needed is a human factors approach designed to optimize the balance between health-care users, health-care providers, policies, procedures, and technologies. An evaluation of interface issues between primary and specialist care related to cancer reveals opportunities for human factors improvement along the cancer care continuum. Applications that emphasize cognitive support for prevention recommendations and that encourage patient engagement can help create a coordinated health-care environment conducive to cancer prevention and early detection. An emphasis on reliability, transparency, and accountability can help improve the coordination of activities among multiple service providers during diagnosis and treatment. A switch in emphasis from a transaction-based approach to one emphasizing long-term support for healing relationships should help improve patient outcomes during cancer survivorship and end-of-life care. Across the entire continuum of care, an emphasis on "meaningful use" of health IT-rather than on IT as an endpoint-should help put cancer on a path toward substantive continuous quality improvement. The accompanying research questions will focus on reducing the variance between the social and technical subsystems as IT is used to improve patient outcomes across the interfaces of care.

Do complexity-informed health interventions work? A scoping review.

PubMed

Brainard, Julii; Hunter, Paul R

2016-09-20

The lens of complexity theory is widely advocated to improve health care delivery. However, empirical evidence that this lens has been useful in designing health care remains elusive. This review assesses whether it is possible to reliably capture evidence for efficacy in results or process within interventions that were informed by complexity science and closely related conceptual frameworks. Systematic searches of scientific and grey literature were undertaken in late 2015/early 2016. Titles and abstracts were screened for interventions (A) delivered by the health services, (B) that explicitly stated that complexity science provided theoretical underpinning, and (C) also reported specific outcomes. Outcomes had to relate to changes in actual practice, service delivery or patient clinical indicators. Data extraction and detailed analysis was undertaken for studies in three developed countries: Canada, UK and USA. Data were extracted for intervention format, barriers encountered and quality aspects (thoroughness or possible biases) of evaluation and reporting. From 5067 initial finds in scientific literature and 171 items in grey literature, 22 interventions described in 29 articles were selected. Most interventions relied on facilitating collaboration to find solutions to specific or general problems. Many outcomes were very positive. However, some outcomes were measured only subjectively, one intervention was designed with complexity theory in mind but did not reiterate this in subsequent evaluation and other interventions were credited as compatible with complexity science but reported no relevant theoretical underpinning. Articles often omitted discussion on implementation barriers or unintended consequences, which suggests that complexity theory was not widely used in evaluation. It is hard to establish cause and effect when attempting to leverage complex adaptive systems and perhaps even harder to reliably find evidence that confirms whether complexity-informed interventions are usually effective. While it is possible to show that interventions that are compatible with complexity science seem efficacious, it remains difficult to show that explicit planning with complexity in mind was particularly valuable. Recommendations are made to improve future evaluation reports, to establish a better evidence base about whether this conceptual framework is useful in intervention design and implementation.

Motivation and Treatment Credibility Predicts Dropout, Treatment Adherence, and Clinical Outcomes in an Internet-Based Cognitive Behavioral Relaxation Program: A Randomized Controlled Trial.

PubMed

Alfonsson, Sven; Olsson, Erik; Hursti, Timo

2016-03-08

In previous research, variables such as age, education, treatment credibility, and therapeutic alliance have shown to affect patients' treatment adherence and outcome in Internet-based psychotherapy. A more detailed understanding of how such variables are associated with different measures of adherence and clinical outcomes may help in designing more effective online therapy. The aims of this study were to investigate demographical, psychological, and treatment-specific variables that could predict dropout, treatment adherence, and treatment outcomes in a study of online relaxation for mild to moderate stress symptoms. Participant dropout and attrition as well as data from self-report instruments completed before, during, and after the online relaxation program were analyzed. Multiple linear and logistical regression analyses were conducted to predict early dropout, overall attrition, online treatment progress, number of registered relaxation exercises, posttreatment symptom levels, and reliable improvement. Dropout was significantly predicted by treatment credibility, whereas overall attrition was associated with reporting a focus on immediate consequences and experiencing a low level of intrinsic motivation for the treatment. Treatment progress was predicted by education level and treatment credibility, whereas number of registered relaxation exercises was associated with experiencing intrinsic motivation for the treatment. Posttreatment stress symptoms were positively predicted by feeling external pressure to participate in the treatment and negatively predicted by treatment credibility. Reporting reliable symptom improvement after treatment was predicted by treatment credibility and therapeutic bond. This study confirmed that treatment credibility and a good working alliance are factors associated with successful Internet-based psychotherapy. Further, the study showed that measuring adherence in different ways provides somewhat different results, which underscore the importance of carefully defining treatment adherence in psychotherapy research. Lastly, the results suggest that finding the treatment interesting and engaging may help patients carry through with the intervention and complete prescribed assignments, a result that may help guide the design of future interventions. Clinicaltrials.gov NCT02535598; http://clinicaltrials.gov/ct2/show/NCT02535598 (Archived by WebCite at http://www.webcitation.org/6fl38ms7y).

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Psychometric evaluations of the efficacy expectations and Outcome Expectations for Exercise Scales in African American women.

PubMed

Murrock, Carolyn J; Gary, Faye

2014-01-01

This secondary analysis tested the reliability and validity of the Self-Efficacy for Exercise (SEE) and the Outcome Expectations for Exercise (OEE) scales in 126 community dwelling, middle aged African American women. Social Cognitive Theory postulates self-efficacy is behavior age, gender and culture specific. Therefore, it is important to determine ifself-efficacy scales developed and tested in older Caucasian female adults are reliable and valid in middle aged, minority women. Cronbach's alpha and construct validity using hypothesis testing and confirmatory factor analysis supported the reliability and validity of the SEE and OEE scales in community dwelling, middle aged African American women.

Adaptive control of Parkinson's state based on a nonlinear computational model with unknown parameters.

PubMed

Su, Fei; Wang, Jiang; Deng, Bin; Wei, Xi-Le; Chen, Ying-Yuan; Liu, Chen; Li, Hui-Yan

2015-02-01

The objective here is to explore the use of adaptive input-output feedback linearization method to achieve an improved deep brain stimulation (DBS) algorithm for closed-loop control of Parkinson's state. The control law is based on a highly nonlinear computational model of Parkinson's disease (PD) with unknown parameters. The restoration of thalamic relay reliability is formulated as the desired outcome of the adaptive control methodology, and the DBS waveform is the control input. The control input is adjusted in real time according to estimates of unknown parameters as well as the feedback signal. Simulation results show that the proposed adaptive control algorithm succeeds in restoring the relay reliability of the thalamus, and at the same time achieves accurate estimation of unknown parameters. Our findings point to the potential value of adaptive control approach that could be used to regulate DBS waveform in more effective treatment of PD.

[Quality Assurance in Sociomedical Evaluation by Peer Review: A Pilot Project of the German Statutory Pension Insurance].

PubMed

Strahl, A; Gerlich, C; Wolf, H-D; Gehrke, J; Müller-Garnn, A; Vogel, H

2016-03-01

The sociomedical evaluation by the German Pension Insurance serves the purpose of determining entitlement to disability pensions. A quality assurance concept for the sociomedical evaluation was developed, which is based on a peer Review process. Peer review is an established process of external quality assurance in health care. The review is based on a hierarchically constructed manual that was evaluated in this pilot project. The database consists of 260 medical reports for disability pension of 12 pension insurance agencies. 771 reviews from 19 peers were included in the evaluation of the inter-rater reliability. Kendall's coefficient of concordance W for more than 2 raters is used as primary measure of inter-rater reliability. Reliability appeared to be heterogeneous. Kendalls W varies for the particular criteria from 0.09 to 0.88 and reached for primary criterion reproducibility a value of 0.37. The reliability of the manual seemed acceptable in the context of existing research data and is in line with existing peer review research outcomes. Nevertheless, the concordance is limited and requires optimisation. Starting points for improvement can be seen in a systematic training and regular user meetings of the peers involved. © Georg Thieme Verlag KG Stuttgart · New York.

Quality improvement in pediatrics: past, present, and future.

PubMed

Schwartz, Stephanie P; Rehder, Kyle J

2017-01-01

Almost two decades ago, the landmark report "To Err is Human" compelled healthcare to address the large numbers of hospitalized patients experiencing preventable harm. Concurrently, it became clear that the rapidly rising cost of healthcare would be unsustainable in the long-term. As a result, quality improvement methodologies initially rooted in other high-reliability industries have become a primary focus of healthcare. Multiple pediatric studies demonstrate remarkable quality and safety improvements in several domains including handoffs, catheter-associated blood stream infections, and other serious safety events. While both quality improvement and research are data-driven processes, significant differences exist between the two. Research utilizes a hypothesis driven approach to obtain new knowledge while quality improvement often incorporates a cyclic approach to translate existing knowledge into clinical practice. Recent publications have provided guidelines and methods for effectively reporting quality and safety work and improvement implementations. This review examines not only how quality improvement in pediatrics has led to improved outcomes, but also looks to the future of quality improvement in healthcare with focus on education and collaboration to ensure best practice approaches to caring for children.

Independent predictors of reliability between full time employee-dependent acquisition of functional outcomes compared to non-full time employee-dependent methodologies: a prospective single institutional study.

PubMed

Adogwa, Owoicho; Elsamadicy, Aladine A; Cheng, Joseph; Bagley, Carlos

2016-03-01

The prospective acquisition of reliable patient-reported outcomes (PROs) measures demonstrating the effectiveness of spine surgery, or lack thereof, remains a challenge. The aims of this study are to compare the reliability of functional outcomes metrics obtained using full time employee (FTE) vs. non-FTE-dependent methodologies and to determine the independent predictors of response reliability using non FTE-dependent methodologies. One hundred and nineteen adult patients (male: 65, female: 54) undergoing one- and two-level lumbar fusions at Duke University Medical Center were enrolled in this prospective study. Enrollment criteria included available demographic, clinical and baseline functional outcomes data. All patients were administered two similar sets of baseline questionnaires-(I) phone interviews (FTE-dependent) and (II) hardcopy in clinic (patient self-survey, non-FTE-dependent). All patients had at least a two-week washout period between phone interviews and in-clinic self-surveys to minimize effect of recall. Questionnaires included Oswestry disability index (ODI) and Visual Analog Back and Leg Pain Scale (VAS-BP/LP). Reliability was assessed by the degree to which patient responses to baseline questionnaires differed between both time points. About 26.89% had a history an anxiety disorder and 28.57% reported a history of depression. At least 97.47% of patients had a High School Diploma or GED, with 49.57% attaining a 4-year college degree or post-graduate degree. 29.94% reported full-time employment and 14.28% were on disability. There was a very high correlation between baseline PRO's data captured between FTE-dependent compared to non-FTE-dependent methodologies (r=0.89). In a multivariate logistic regression model, the absence of anxiety and depression, higher levels of education (college or greater) and full-time employment, were independently associated with high response reliability using non-FTE-dependent methodologies. Our study suggests that capturing health-related quality of life data using non-FTE-dependent methodologies is highly reliable and maybe a more cost-effective alternative. Well-educated patients who are employed full-time appear to be the most reliable.

Assessing the clinical utility of combined movement examination in symptomatic degenerative lumbar spondylosis.

PubMed

Monie, A P; Price, R I; Lind, C R P; Singer, K P

2015-07-01

The aim of this study is to report the development and validation of a low back computer-aided combined movement examination protocol in normal individuals and record treatment outcomes of cases with symptomatic degenerative lumbar spondylosis. Test-retest, following intervention. Self-report assessments and combined movement examination were used to record composite spinal motion, before and following neurosurgical and pain medicine interventions. 151 normal individuals aged from 20 years to 69 years were assessed using combined movement examination between L1 and S1 spinal levels to establish a reference range. Cases with degenerative low back pain and sciatica were assessed before and after therapeutic interventions with combined movement examination and a battery of self-report pain and disability questionnaires. Change scores for combined movement examination and all outcome measures were derived. Computer-aided combined movement examination validation and intraclass correlation coefficient with 95% confidence interval and least significant change scores indicated acceptable reliability of combined movement examination when recording lumbar movement in normal subjects. In both clinical cases lumbar spine movement restrictions corresponded with self-report scores for pain and disability. Post-intervention outcomes all showed significant improvement, particularly in the most restricted combined movement examination direction. This study provides normative reference data for combined movement examination that may inform future clinical studies of the technique as a convenient objective surrogate for important clinical outcomes in lumbar degenerative spondylosis. It can be used with good reliability, may be well tolerated by individuals in pain and appears to change in concert with validated measures of lumbar spinal pain, functional limitation and quality of life. Copyright © 2015 Elsevier Ltd. All rights reserved.

A validation of the Nottingham Clavicle Score: a clavicle, acromioclavicular joint and sternoclavicular joint-specific patient-reported outcome measure.

PubMed

Charles, Edmund R; Kumar, Vinod; Blacknall, James; Edwards, Kimberley; Geoghegan, John M; Manning, Paul A; Wallace, W Angus

2017-10-01

Patients with acromioclavicular joint (ACJ) and sternoclavicular joint (SCJ) injuries and with clavicle fractures are typically younger and more active than those with other shoulder pathologies. We developed the Nottingham Clavicle Score (NCS) specifically for this group of patients to improve sensitivity for assessing the outcomes of treatment of these conditions compared with the more commonly used Constant Score (CS) and Oxford Shoulder Score (OSS). This was a cohort study in which the preoperative and 6-month postoperative NCS evaluations of outcome in 90 patients were compared with the CS, OSS, Imatani Score (IS), and the EQ-5D scores. Reliability was assessed using the Cronbach α. Reproducibility of the NCS was assessed using the test/retest method. Effect sizes were calculated for each score to assess sensitivity to change. Validity was examined by correlations between the NCS and the CS, OSS, IS, and EQ-5D scores obtained preoperatively and postoperatively. Significant correlations were demonstrated preoperatively with the OSS (P = .025) and all subcategories of the EQ-5D (P < .05) and postoperatively with the OSS (P < .001), CS (P = .008), IS (P < .001), and all subcategories of EQ-5D (P < .02). The NCS had the largest effect size (1.92) of the compared scores. Internal consistency was excellent (Cronbach α = 0.87). The NCS has been proven to be a valid, reliable and sensitive outcome measure that accurately measures the level of function and disability in the ACJ, SCJ and clavicle after traumatic injury and in degenerative disease. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.

Piloting an email-based resource package for job seekers with multiple sclerosis.

PubMed

Dorstyn, Diana; Roberts, Rachel; Murphy, Gregory; Kneebone, Ian; Migliorini, Christine; Craig, Ashley; Hutchinson, Claire; Field, Deborah

2017-05-01

Media-based rehabilitation provides a powerful opportunity to examine vocational behaviors in the disability sector. However, this research is preliminary at best. This paper reports pilot data. Eighteen adults with multiple sclerosis (MS) accessed an email-delivered, resource-based package, Work and MS. Pre- and post-access vocational self-efficacy and identity (Job-Procurement Self Efficacy Scale, My Vocational Situation Scale- primary outcomes), life orientation and depressed mood (Life Orientation Test - revised and Patient Health Questionnaire-9 - secondary outcomes) were assessed. Pre- and post-change scores were examined with Wilcoxon signed ranks tests and Hedges g effect sizes with associated 95% confidence intervals. Reliable change analyses were additionally calculated to determine the clinical significance of individual change scores. Significant and positive effects were reported for vocational self-efficacy, identity, and optimism. Reliable change scores in one or more of these key outcomes were reported by 30% of the sample. Satisfaction with the content and delivery of the email-based intervention was also noted. Preliminary evidence suggests that Work and MS can help to promote vocational goals, interests and strengths among job seekers with a disability by providing a set of tools, information and linkages relating to vocational pursuits and career development. Replication with a randomized control design is indicated. Implications for Rehabilitation Research indicates a high unemployment rate among working-age adults with MS. A combination of disease-specific, psychological, programmatic and societal variables contribute to employment instability in this group. This pilot study demonstrates that an e-mail-based resource package, Work and MS, provides an innovative and feasible option for promoting consumer engagement with vocational services and, potentially, improving vocational outcomes. Work and MS has potential applicability to other disability groups.

Accounting for measurement reliability to improve the quality of inference in dental microhardness research: a worked example.

PubMed

Sever, Ivan; Klaric, Eva; Tarle, Zrinka

2016-07-01

Dental microhardness experiments are influenced by unobserved factors related to the varying tooth characteristics that affect measurement reproducibility. This paper explores the appropriate analytical tools for modeling different sources of unobserved variability to reduce the biases encountered and increase the validity of microhardness studies. The enamel microhardness of human third molars was measured by Vickers diamond. The effects of five bleaching agents-10, 16, and 30 % carbamide peroxide, and 25 and 38 % hydrogen peroxide-were examined, as well as the effect of artificial saliva and amorphous calcium phosphate. To account for both between- and within-tooth heterogeneity in evaluating treatment effects, the statistical analysis was performed in the mixed-effects framework, which also included the appropriate weighting procedure to adjust for confounding. The results were compared to those of the standard ANOVA model usually applied. The weighted mixed-effects model produced the parameter estimates of different magnitude and significance than the standard ANOVA model. The results of the former model were more intuitive, with more precise estimates and better fit. Confounding could seriously bias the study outcomes, highlighting the need for more robust statistical procedures in dental research that account for the measurement reliability. The presented framework is more flexible and informative than existing analytical techniques and may improve the quality of inference in dental research. Reported results could be misleading if underlying heterogeneity of microhardness measurements is not taken into account. The confidence in treatment outcomes could be increased by applying the framework presented.

The effectiveness of a short-term group music therapy intervention for parents who have a child with a disability.

PubMed

Williams, Kate E; Berthelsen, Donna; Nicholson, Jan M; Walker, Sue; Abad, Vicky

2012-01-01

The positive relationship between parent-child interactions and optimal child development is well established. Families of children with disabilities may face unique challenges in establishing positive parent-child relationships; yet, there are few studies examining the effectiveness of music therapy interventions to address these issues. In particular, these studies have been limited by small sample size and the use of measures of limited reliability and validity. This study examined the effectiveness of a short-term group music therapy intervention for parents of children with disabilities and explored factors associated with better outcomes for participating families. Participants were 201 mother-child dyads, where the child had a disability. Pre- and post-intervention parental questionnaires and clinician observation measures were completed to examine outcomes of parental wellbeing, parenting behaviors, and child development. Descriptive data, t-tests for repeated measures and a predictive model tested via logistic regression are presented. Significant improvements pre to post intervention were found for parent mental health, child communication and social skills, parenting sensitivity, parental engagement with child and acceptance of child, child responsiveness to parent, and child interest and participation in program activities. There was also evidence for high parental satisfaction and that the program brought social benefits to families. Reliable change on six or more indicators of parent or child functioning was predicted by attendance and parent education. This study provides positive evidence for the effectiveness of group music therapy in promoting improved parental mental health, positive parenting and key child developmental areas.

The Implementation of Patient-Reported Outcome Measures in Yoga Therapy.

PubMed

Ross, Alyson; Birdee, Gurjeet; Touchton-Leonard, Katharine; Bevans, Margaret

2016-01-01

Yoga therapists are interested in knowing whether their therapeutic interventions are helpful in improving health and wellbeing in their yoga therapy clients. However, few yoga therapists use standardized, reliable, and valid questionnaires to determine the therapeutic effectiveness of their treatments. Patient-reported outcome (PRO) measures are paper or web-based questionnaires used to assess an individual's perceptions of their symptoms and/or quality of life. In 2004, the National Institutes of Health (NIH) launched the PROMIS ® initiative to standardize and simplify the collection of PROs in research and in clinical practice. The PROMIS ® initiative launched a multicenter cooperative group that collected and reviewed thousands of PROs, then extensively tested them in over 20,000 research participants. The result was a web-based collection of item banks of the best questions or "items" within three domains of interest: physical, mental, and social health. These item banks are housed in the Assessment Center, a free online resource for collecting PROs. 1 Incorporating PROMIS ® outcomes into yoga therapy streamlines and optimizes the collection of PROs by enabling access to reliable and valid questionnaires that are easy to read, simple to complete, and are available in multiple languages as well as in both adult and pediatric versions. The use of standardized PROs may improve yoga therapy implementation in healthcare and accelerate translation of clinical research by allowing yoga therapists to conduct indepth symptom assessments using tools that allow for comparisons to other therapeutic clinical and research interventions. The purpose of this paper is to summarize the development of the NIH PROMIS ® initiative and to provide suggestions for incorporating PRO collection into yoga therapy. Important considerations to consider when implementing PROs into yoga therapy are discussed, including the choice of questionnaires and method of delivery (paper or web-based), frequency of PRO administration, interpretation and management of PRO results, and the management of problematic issues that arise.

The Implementation of Patient-Reported Outcome Measures in Yoga Therapy.

PubMed

Ross, Alyson; Birdee, Gurjeet; Touchton-Leonard, Katharine; Bevans, Margaret

2016-09-01

Yoga therapists are interested in knowing whether their therapeutic interventions are helpful in improving health and wellbeing in their yoga therapy clients. However, few yoga therapists use standardized, reliable, and valid questionnaires to determine the therapeutic effectiveness of their treatments. Patient-reported outcome (PRO) measures are paper or web-based questionnaires used to assess an individual's perceptions of their symptoms and/or quality of life. In 2004, the National Institutes of Health (NIH) launched the PROMIS ® initiative to standardize and simplify the collection of PROs in research and in clinical practice. The PROMIS ® initiative launched a multicenter cooperative group that collected and reviewed thousands of PROs, then extensively tested them in over 20,000 research participants. The result was a web-based collection of item banks of the best questions or "items" within three domains of interest: physical, mental, and social health. These item banks are housed in the Assessment Center, a free online resource for collecting PROs. 1 Incorporating PROMIS ® outcomes into yoga therapy streamlines and optimizes the collection of PROs by enabling access to reliable and valid questionnaires that are easy to read, simple to complete, and are available in multiple languages as well as in both adult and pediatric versions. The use of standardized PROs may improve yoga therapy implementation in healthcare and accelerate translation of clinical research by allowing yoga therapists to conduct indepth symptom assessments using tools that allow for comparisons to other therapeutic clinical and research interventions. The purpose of this paper is to summarize the development of the NIH PROMIS ® initiative and to provide suggestions for incorporating PRO collection into yoga therapy. Important considerations to consider when implementing PROs into yoga therapy are discussed, including the choice of questionnaires and method of delivery (paper or web-based), frequency of PRO administration, interpretation and management of PRO results, and the management of problematic issues that arise.

The PU-PROM: A patient-reported outcome measure for peptic ulcer disease.

PubMed

Liu, Na; Lv, Jing; Liu, Jinchun; Zhang, Yanbo

2017-12-01

Patient-reported outcome measure (PROM) conceived to enable description of treatment-related effects, from the patient perspective, bring the potential to improve in clinical research, and to provide patients with accurate information. Therefore, the aim of this study was to develop a patient-centred peptic ulcer patient-reported outcome measure (PU-PROM) and evaluate its reliability, validity, differential item functioning (DIF) and feasibility. To develop a conceptual framework and item pool for the PU-PROM, we performed a literature review and consulted other measures created in China and other countries. Beyond that, we interviewed 10 patients with peptic ulcers, and consulted six key experts to ensure that all germane parameters were included. In the first item selection phase, classical test theory and item response theory were used to select and adjust items to shape the preliminary measure completed by 130 patients and 50 controls. In the next phase, the measure was evaluated used the same methods with 492 patients and 124 controls. Finally, we used the same population in the second item reselection to assess the reliability, validity, DIF and feasibility of the final measure. The final peptic ulcer PRO measure comprised four domains (physiology, psychology, society and treatment), with 11 subdomains, and 54 items. The Cronbach's α coefficient of each subdomain for the measure was >0.800. Confirmatory factory analysis indicated that the construct validity fulfilled expectations. Model fit indices, such as RMR, RMSEA, NFI, NNFI, CFI and IFI, showed acceptable fit. The measure showed a good response rate. The peptic ulcer PRO measure had good reliability, validity, DIF and feasibility, and can be used as a clinical research evaluation instrument with patients with peptic ulcers to assess their condition focus on treatment. This measure may also be applied in other health areas, especially in clinical trials of new drugs, and may be helpful in clinical decision making. © 2017 The Authors Health Expectations Published by John Wiley & Sons Ltd.

Increasing Reliability of Direct Observation Measurement Approaches in Emotional and/or Behavioral Disorders Research Using Generalizability Theory

ERIC Educational Resources Information Center

Gage, Nicholas A.; Prykanowski, Debra; Hirn, Regina

2014-01-01

Reliability of direct observation outcomes ensures the results are consistent, dependable, and trustworthy. Typically, reliability of direct observation measurement approaches is assessed using interobserver agreement (IOA) and the calculation of observer agreement (e.g., percentage of agreement). However, IOA does not address intraobserver…

The live donor assessment tool: a psychosocial assessment tool for live organ donors.

PubMed

Iacoviello, Brian M; Shenoy, Akhil; Braoude, Jenna; Jennings, Tiane; Vaidya, Swapna; Brouwer, Julianna; Haydel, Brandy; Arroyo, Hansel; Thakur, Devendra; Leinwand, Joseph; Rudow, Dianne LaPointe

2015-01-01

Psychosocial evaluation is an important part of the live organ donor evaluation process, yet it is not standardized across institutions, and although tools exist for the psychosocial evaluation of organ recipients, none exist to assess donors. We set out to develop a semistructured psychosocial evaluation tool (the Live Donor Assessment Tool, LDAT) to assess potential live organ donors and to conduct preliminary analyses of the tool's reliability and validity. Review of the literature on the psychosocial variables associated with treatment adherence, quality of life, live organ donation outcome, and resilience, as well as review of the procedures for psychosocial evaluation at our center and other centers around the country, identified 9 domains to address; these domains were distilled into several items each, in collaboration with colleagues at transplant centers across the country, for a total of 29 items. Four raters were trained to use the LDAT, and they retrospectively scored 99 psychosocial evaluations conducted on live organ donor candidates. Reliability of the LDAT was assessed by calculating the internal consistency of the items in the scale and interrater reliability between raters; validity was estimated by comparing LDAT scores between those with a "positive" evaluation outcome and "negative" outcome. The LDAT was found to have good internal consistency, inter-rater reliability, and showed signs of validity: LDAT scores differentiated the positive vs. negative outcome groups. The LDAT demonstrated good reliability and validity, but future research on the LDAT and the ability to implement the LDAT prospectively is warranted. Copyright © 2015 The Academy of Psychosomatic Medicine. Published by Elsevier Inc. All rights reserved.

Evaluation of using the Chinese version of the Spirituality Index of Well-Being (SIWB) scale in Taiwanese elders.

PubMed

Lee, Yi-Hui; Salman, Ali

2016-11-01

Spirituality and spiritual well-being have emerged as important indicators for one's quality of life and health outcomes. Nursing as a profession is concerned with a holistic approach to improve health and overall well-being. To evaluate the outcomes of holistic nursing interventions, using valid and reliable instruments to assess spiritual well-being becomes necessary. There is a lack of instruments for measuring spiritual well-being in Chinese populations. Little has been known about the feasibility of using the Spirituality Index of Well-Being (SIWB) in Taiwanese elders. The purpose of this cross-sectional study was to evaluate the uses of the translated Chinese version of the Spirituality Index of Well-Being (SIWB-C) with Taiwanese elders. A total of 150 individual who were 65 years old or older and living in southern Taiwan were recruited from a public community center. A four-step procedure was used to translate the English version of the SIWB to the traditional Chinese language. Internal consistency, factor analysis, and correlation coefficient were conducted to evaluate the reliability and validity of the SIWB-C. The SIWB-C demonstrated a high internal consistency with Cronbach's alpha .95. The construct validity of SIWB-C was supported by factor analysis and by significant correlations with its subscales and the CES-D scale. The psychometric analysis indicates that the SIWB-C is a valid and reliable instrument for measuring spiritual well-being. This instrument provides a feasible and valid approach for assessing Taiwanese elders' spiritual well-being in the future. Copyright © 2016 Elsevier Inc. All rights reserved.

Development of a multilevel health and safety climate survey tool within a mining setting.

PubMed

Parker, Anthony W; Tones, Megan J; Ritchie, Gabrielle E

2017-09-01

This study aimed to design, implement and evaluate the reliability and validity of a multifactorial and multilevel health and safety climate survey (HSCS) tool with utility in the Australian mining setting. An 84-item questionnaire was developed and pilot tested on a sample of 302 Australian miners across two open cut sites. A 67-item, 10 factor solution was obtained via exploratory factor analysis (EFA) representing prioritization and attitudes to health and safety across multiple domains and organizational levels. Each factor demonstrated a high level of internal reliability, and a series of ANOVAs determined a high level of consistency in responses across the workforce, and generally irrespective of age, experience or job category. Participants tended to hold favorable views of occupational health and safety (OH&S) climate at the management, supervisor, workgroup and individual level. The survey tool demonstrated reliability and validity for use within an open cut Australian mining setting and supports a multilevel, industry specific approach to OH&S climate. Findings suggested a need for mining companies to maintain high OH&S standards to minimize risks to employee health and safety. Future research is required to determine the ability of this measure to predict OH&S outcomes and its utility within other mine settings. As this tool integrates health and safety, it may have benefits for assessment, monitoring and evaluation in the industry, and improving the understanding of how health and safety climate interact at multiple levels to influence OH&S outcomes. Copyright © 2017 National Safety Council and Elsevier Ltd. All rights reserved.

The Brief Death Implicit Association Test: Scoring recommendations, reliability, validity, and comparisons with the Death Implicit Association Test.

PubMed

Millner, Alexander J; Coppersmith, Daniel D L; Teachman, Bethany A; Nock, Matthew K

2018-05-21

Assessing suicidal thoughts and behaviors is difficult because at-risk individuals often fail to provide honest or accurate accounts of their suicidal thoughts or intentions. Research has shown that the Death Implicit Association Test (D-IAT), a behavioral test that measures implicit (i.e., outside of conscious control) associations between oneself and death concepts, can differentiate among people with different suicidal histories, such as those with different severity or recency of suicidal behaviors. We report here on the development and evaluation of a shorter and simpler version of the D-IAT called the Death Brief Implicit Association Test (D-BIAT). We recruited large (ns > 1,500) samples of participants to complete the original D-IAT and shorter D-BIAT via a public web-based platform and evaluated different scoring approaches, assessed the reliability and validity of the D-BIAT and compared it with the D-IAT. We found that the D-BIAT was reliable, provided significant group differences with effect sizes on par with the D-IAT, as well as similarly sized classification metrics (i.e., receiver operator characteristics). Although the D-IAT was nonsignificantly better on most outcomes, the D-BIAT is 1-1[1/2] minutes shorter and provided larger effect sizes for distinguishing between past year and lifetime attempters. Thus, there is a trade-off between administration time and improved outcomes associated with increased data. The D-BIAT should be considered for use where time or participant burden needs to be minimized, such as in clinical settings. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Psychometric properties of the 25-item National Eye Institute Visual Function Questionnaire (NEI VFQ-25), Japanese version.

PubMed

Suzukamo, Yoshimi; Oshika, Tetsuro; Yuzawa, Mitsuko; Tokuda, Yoshihiro; Tomidokoro, Atsuo; Oki, Kotaro; Mangione, Carol M; Green, Joseph; Fukuhara, Shunichi

2005-10-26

The importance of evaluating the outcomes of health care from the standpoint of the patient is now widely recognized. The purpose of this study is to develop and test a Japanese version of the National Eye Institute Visual Function Questionnaire (NEI VFQ-25). A Japanese version was developed with a previously standardized method. The questionnaire and optional items were completed by 245 patients with cataracts, glaucoma, or age-related macular degeneration, by 110 others before and after cataract surgery, and by a reference group (n = 31). We computed rates of missing data, measured reproducibility and internal consistency reliability, and tested for convergent and discriminant validity, concurrent validity, known-groups validity, factor structure, and responsiveness to change. Based on information from the participants, some items were changed to 2-step items (asking if an activity was done, and if it was done, then asking how difficult it was). The near-vision and distance-vision subscales each had 1 item that was endorsed by very few participants, so these items were replaced with items that were optional in the English version. For example, more than 60% of participants did not drive, so the driving question was excluded. Reliability and validity were adequate for all subscales except driving, ocular pain, color vision, and peripheral vision. With cataract surgery, most scores improved by at least 20 points. With minor modifications from the English version, the Japanese NEI VFQ-25 can give reliable, valid, responsive data on vision-related quality of life, for group-level comparisons or for tracking therapeutic outcomes.

Brief report: do service dog providers placing dogs with children with developmental disabilities use outcome measures and, if so, what are they?

PubMed

Butterly, Felicity; Percy, Carol; Ward, Gillian

2013-11-01

The aim of this study was to identify the outcomes expected and assessed by those providing service dogs to children with developmental disabilities. Seventeen registered service dog providers were invited to complete a mixed methods online survey. Five providers, who prepared dogs to work with a wide range of conditions and behaviours, mainly Asperger's syndrome, autism and communication disorders, completed the survey. All five participants reported that they expected to see positive changes as a consequence of the service dog placement, in both the recipient child and their family, including improvements in attention span and language skills, as well as increased familial cohesion. Survey responses indicated that not all desired outcomes were routinely assessed. The range of assessments used were interviews, intake conversations, pre-placement questionnaires, child social diaries filled in by parents, follow up surveys after placement, and child observation by parents. No specifically named valid and reliable clinical or research measures were referred to, showing an emphasis on assessments from parents and service dog providers. It is not clear whether pre-intervention assessments are repeated systematically at follow-up, which could show robust intervention effects. There is scope for professionals in developmental disability to work with service dog providers to improve the evidence base in this field.

Does counseling help patients get active? Systematic review of the literature.

PubMed Central

Petrella, Robert J.; Lattanzio, Chastity N.

2002-01-01

OBJECTIVE: To determine the effect of counseling patients to become more physically active. DATA SOURCES: PubMed was searched for articles during the past 30 years on physicians promoting physical activity. Identified studies were cross-referenced, and experts were consulted for additional articles. STUDY SELECTION: Thirteen articles described primary care counseling on exercise. Six studies were randomized controlled trials (RCTs); seven were quasi-experimental designs. Three of the four RCTs and three of the five quasi-experimental studies were short term (4 weeks to 2 months); the remaining three trials lasted longer than 6 months. Most studies used strategies to address stage of change. SYNTHESIS: Outcome measures included adoption of physical activity, stage of change, and change in physical activity level. Most studies found positive relationships between counseling and these outcomes. No reliable evaluation instruments were found, nor was the long-term effect of interventions established. CONCLUSION: Interventions that included written materials for patients, considered behaviour change strategies, and provided training and materials for physicians were effective at increasing levels of physical activity. New strategies that involve measuring and prescribing specific amounts of exercise might also improve fitness levels and hence improve outcomes of chronic disease. Shortcomings of these studies include lack of long-term data, lack of sustaining activities for family physicians, and scant cost-efficacy analysis. PMID:11852615

Reliability and Construct Validity of Limits of Stability Test in Adolescents Using a Portable Forceplate System.

PubMed

Alsalaheen, Bara; Haines, Jamie; Yorke, Amy; Broglio, Steven P

2015-12-01

To examine the reliability, convergent, and discriminant validity of the limits of stability (LOS) test to assess dynamic postural stability in adolescents using a portable forceplate system. Cross-sectional reliability observational study. School setting. Adolescents (N=36) completed all measures during the first session. To examine the reliability of the LOS test, a subset of 15 participants repeated the LOS test after 1 week. Not applicable. Outcome measurements included the LOS test, Balance Error Scoring System, Instrumented Balance Error Scoring System, and Modified Clinical Test for Sensory Interaction on Balance. A significant relation was observed among LOS composite scores (r=.36-.87, P<.05). However, no relation was observed between LOS and static balance outcome measurements. The reliability of the LOS composite scores ranged from moderate to good (intraclass correlation coefficient model 2,1=.73-.96). The results suggest that the LOS composite scores provide unique information about dynamic postural stability, and the LOS test completed at 100% of the theoretical limit appeared to be a reliable test of dynamic postural stability in adolescents. Clinicians should use dynamic balance measurement as part of their balance assessment and should not use static balance testing (eg, Balance Error Scoring System) to make inferences about dynamic balance, especially when balance assessment is used to determine rehabilitation outcomes, or when making return to play decisions after injury. Copyright © 2015 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Development of a wheelchair mobility skills test for children and adolescents: combining evidence with clinical expertise.

PubMed

Sol, Marleen Elisabeth; Verschuren, Olaf; de Groot, Laura; de Groot, Janke Frederike

2017-02-13

Wheelchair mobility skills (WMS) training is regarded by children using a manual wheelchair and their parents as an important factor to improve participation and daily physical activity. Currently, there is no outcome measure available for the evaluation of WMS in children. Several wheelchair mobility outcome measures have been developed for adults, but none of these have been validated in children. Therefore the objective of this study is to develop a WMS outcome measure for children using the current knowledge from literature in combination with the clinical expertise of health care professionals, children and their parents. Mixed methods approach. Phase 1: Item identification of WMS items through a systematic review using the 'COnsensus-based Standards for the selection of health Measurement Instruments' (COSMIN) recommendations. Phase 2: Item selection and validation of relevant WMS items for children, using a focus group and interviews with children using a manual wheelchair, their parents and health care professionals. Phase 3: Feasibility of the newly developed Utrecht Pediatric Wheelchair Mobility Skills Test (UP-WMST) through pilot testing. Phase 1: Data analysis and synthesis of nine WMS related outcome measures showed there is no widely used outcome measure with levels of evidence across all measurement properties. However, four outcome measures showed some levels of evidence on reliability and validity for adults. Twenty-two WMS items with the best clinimetric properties were selected for further analysis in phase 2. Phase 2: Fifteen items were deemed as relevant for children, one item needed adaptation and six items were considered not relevant for assessing WMS in children. Phase 3: Two health care professionals administered the UP-WMST in eight children. The instructions of the UP-WMST were clear, but the scoring method of the height difference items needed adaptation. The outdoor items for rolling over soft surface and the side slope item were excluded in the final version of the UP-WMST due to logistic reasons. The newly developed 15 item UP-WMST is a validated outcome measure which is easy to administer in children using a manual wheelchair. More research regarding reliability, construct validity and responsiveness is warranted before the UP-WMST can be used in practice.

Reliability of quadriceps surface electromyography measurements is improved by two vs. single site recordings.

PubMed

Balshaw, T G; Fry, A; Maden-Wilkinson, T M; Kong, P W; Folland, J P

2017-06-01

The reliability of surface electromyography (sEMG) is typically modest even with rigorous methods, and therefore further improvements in sEMG reliability are desirable. This study compared the between-session reliability (both within participant absolute reliability and between-participant relative reliability) of sEMG amplitude from single vs. average of two distinct recording sites, for individual muscle (IM) and whole quadriceps (WQ) measures during voluntary and evoked contractions. Healthy males (n = 20) performed unilateral isometric knee extension contractions: voluntary maximum and submaximum (60%), as well as evoked twitch contractions on two separate days. sEMG was recorded from two distinct sites on each superficial quadriceps muscle. Averaging two recording sites vs. using single site measures improved reliability for IM and WQ measurements during voluntary (16-26% reduction in within-participant coefficient of variation, CV W ) and evoked contractions (40-56% reduction in CV W ). For sEMG measurements from large muscles, averaging the recording of two distinct sites is recommended as it improves within-participant reliability. This improved sensitivity has application to clinical and research measurement of sEMG amplitude.

Neurological prognostication of outcome in patients in coma after cardiac arrest.

PubMed

Rossetti, Andrea O; Rabinstein, Alejandro A; Oddo, Mauro

2016-05-01

Management of coma after cardiac arrest has improved during the past decade, allowing an increasing proportion of patients to survive, thus prognostication has become an integral part of post-resuscitation care. Neurologists are increasingly confronted with raised expectations of next of kin and the necessity to provide early predictions of long-term prognosis. During the past decade, as technology and clinical evidence have evolved, post-cardiac arrest prognostication has moved towards a multimodal paradigm combining clinical examination with additional methods, consisting of electrophysiology, blood biomarkers, and brain imaging, to optimise prognostic accuracy. Prognostication should never be based on a single indicator; although some variables have very low false positive rates for poor outcome, multimodal assessment provides resassurance about the reliability of a prognostic estimate by offering concordant evidence. Copyright © 2016 Elsevier Ltd. All rights reserved.

Reliability of diagnosis and clinical efficacy of visceral osteopathy: a systematic review.

PubMed

Guillaud, Albin; Darbois, Nelly; Monvoisin, Richard; Pinsault, Nicolas

2018-02-17

In 2010, the World Health Organization published benchmarks for training in osteopathy in which osteopathic visceral techniques are included. The purpose of this study was to identify and critically appraise the scientific literature concerning the reliability of diagnosis and the clinical efficacy of techniques used in visceral osteopathy. Databases MEDLINE, OSTMED.DR, the Cochrane Library, Osteopathic Research Web, Google Scholar, Journal of American Osteopathic Association (JAOA) website, International Journal of Osteopathic Medicine (IJOM) website, and the catalog of Académie d'ostéopathie de France website were searched through December 2017. Only inter-rater reliability studies including at least two raters or the intra-rater reliability studies including at least two assessments by the same rater were included. For efficacy studies, only randomized-controlled-trials (RCT) or crossover studies on unhealthy subjects (any condition, duration and outcome) were included. Risk of bias was determined using a modified version of the quality appraisal tool for studies of diagnostic reliability (QAREL) in reliability studies. For the efficacy studies, the Cochrane risk of bias tool was used to assess their methodological design. Two authors performed data extraction and analysis. Eight reliability studies and six efficacy studies were included. The analysis of reliability studies shows that the diagnostic techniques used in visceral osteopathy are unreliable. Regarding efficacy studies, the least biased study shows no significant difference for the main outcome. The main risks of bias found in the included studies were due to the absence of blinding of the examiners, an unsuitable statistical method or an absence of primary study outcome. The results of the systematic review lead us to conclude that well-conducted and sound evidence on the reliability and the efficacy of techniques in visceral osteopathy is absent. The review is registered PROSPERO 12th of December 2016. Registration number is CRD4201605286 .

Chapter 15: Reliability of Wind Turbines

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sheng, Shuangwen; O'Connor, Ryan

The global wind industry has witnessed exciting developments in recent years. The future will be even brighter with further reductions in capital and operation and maintenance costs, which can be accomplished with improved turbine reliability, especially when turbines are installed offshore. One opportunity for the industry to improve wind turbine reliability is through the exploration of reliability engineering life data analysis based on readily available data or maintenance records collected at typical wind plants. If adopted and conducted appropriately, these analyses can quickly save operation and maintenance costs in a potentially impactful manner. This chapter discusses wind turbine reliability bymore » highlighting the methodology of reliability engineering life data analysis. It first briefly discusses fundamentals for wind turbine reliability and the current industry status. Then, the reliability engineering method for life analysis, including data collection, model development, and forecasting, is presented in detail and illustrated through two case studies. The chapter concludes with some remarks on potential opportunities to improve wind turbine reliability. An owner and operator's perspective is taken and mechanical components are used to exemplify the potential benefits of reliability engineering analysis to improve wind turbine reliability and availability.« less

Validation of the Community Integration Questionnaire in the adult burn injury population.

PubMed

Gerrard, Paul; Kazis, Lewis E; Ryan, Colleen M; Shie, Vivian L; Holavanahalli, Radha; Lee, Austin; Jette, Alan; Fauerbach, James A; Esselman, Peter; Herndon, David; Schneider, Jeffrey C

2015-11-01

With improved survival, long-term effects of burn injuries on quality of life, particularly community integration, are important outcomes. This study aims to assess the Community Integration Questionnaire's psychometric properties in the adult burn population. Data were obtained from a multicenter longitudinal data set of burn survivors. The psychometric properties of the Community Integration Questionnaire (n = 492) were examined. The questionnaire items were evaluated for clinical and substantive relevance; validation procedures were conducted on different samples of the population; construct validity was assessed using exploratory factor analysis; internal consistency reliability was examined using Cronbach's α statistics; and item response theory was applied to the final models. The CIQ-15 was reduced by two questions to form the CIQ-13, with a two-factor structure, interpreted as self/family care and social integration. Item response theory testing suggests that Factor 2 captures a wider range of community integration levels. Cronbach's α was 0.80 for Factor 1, 0.77 for Factor 2, and 0.79 for the test as a whole. The CIQ-13 demonstrates validity and reliability in the adult burn survivor population addressing issues of self/family care and social integration. This instrument is useful in future research of community reintegration outcomes in the burn population.

[Inpatient Treatment of Complex PTSD Following Childhood Abuse: Effectiveness and Predictors of Treatment Outcome].

PubMed

Kratzer, Leonhard; Heinz, Peter; Schennach, Rebecca; Schiepek, Günter Karl; Padberg, Frank; Jobst, Andrea

2018-05-30

There is a lack of studies investigating the effectiveness of inpatient trauma-focused psychotherapy of complex post-traumatic stress disorder. The first aim of this retrospective investigation was to analyze the course of PTSD. Second, possible predictors of treatment response were investigated. 150 inpatients of Clinic St. Irmingard with complex PTSD following childhood physical and childhood sexual abuse were assessed regarding childhood abuse, PTSD symptomatology, mindfulness, dissociation and general psychopathology. Differences in pre and post scores were analyzed using regression analyses. A classification tree was used to identify predictors of response. The significant reduction of PTSD symptoms corresponded to a large effect (d=1.8) and a reponse rate of 52% according to the reliable change index (p<0.05). Effect sizes for other symptoms were medium to large (0.5

National audit of continence care: laying the foundation.

PubMed

Mian, Sarah; Wagg, Adrian; Irwin, Penny; Lowe, Derek; Potter, Jonathan; Pearson, Michael

2005-12-01

National audit provides a basis for establishing performance against national standards, benchmarking against other service providers and improving standards of care. For effective audit, clinical indicators are required that are valid, feasible to apply and reliable. This study describes the methods used to develop clinical indicators of continence care in preparation for a national audit. To describe the methods used to develop and test clinical indicators of continence care with regard to validity, feasibility and reliability. A multidisciplinary working group developed clinical indicators that measured the structure, process and outcome of care as well as case-mix variables. Literature searching, consensus workshops and a Delphi process were used to develop the indicators. The indicators were tested in 15 secondary care sites, 15 primary care sites and 15 long-term care settings. The process of development produced indicators that received a high degree of consensus within the Delphi process. Testing of the indicators demonstrated an internal reliability of 0.7 and an external reliability of 0.6. Data collection required significant investment in terms of staff time and training. The method used produced indicators that achieved a high degree of acceptance from health care professionals. The reliability of data collection was high for this audit and was similar to the level seen in other successful national audits. Data collection for the indicators was feasible to collect, however, issues of time and staffing were identified as limitations to such data collection. The study has described a systematic method for developing clinical indicators for national audit. The indicators proved robust and reliable in primary and secondary care as well as long-term care settings.

New software tools for enhanced precision in robot-assisted laser phonomicrosurgery.

PubMed

Dagnino, Giulio; Mattos, Leonardo S; Caldwell, Darwin G

2012-01-01

This paper describes a new software package created to enhance precision during robot-assisted laser phonomicrosurgery procedures. The new software is composed of three tools for camera calibration, automatic tumor segmentation, and laser tracking. These were designed and developed to improve the outcome of this demanding microsurgical technique, and were tested herein to produce quantitative performance data. The experimental setup was based on the motorized laser micromanipulator created by Istituto Italiano di Tecnologia and the experimental protocols followed are fully described in this paper. The results show the new tools are robust and effective: The camera calibration tool reduced residual errors (RMSE) to 0.009 ± 0.002 mm under 40× microscope magnification; the automatic tumor segmentation tool resulted in deep lesion segmentations comparable to manual segmentations (RMSE= 0.160 ± 0.028 mm under 40× magnification); and the laser tracker tool proved to be reliable even during cutting procedures (RMSE= 0.073 ± 0.023 mm under 40× magnification). These results demonstrate the new software package can provide excellent improvements to the previous microsurgical system, leading to important enhancements in surgical outcome.

Infrared thermography based on artificial intelligence for carpal tunnel syndrome diagnosis.

PubMed

Jesensek Papez, B; Palfy, M; Turk, Z

2008-01-01

Thermography for the measurement of surface temperatures is well known in industry, although is not established in medicine despite its safety, lack of pain and invasiveness, easy reproducibility, and low running costs. Promising results have been achieved in nerve entrapment syndromes, although thermography has never represented a real alternative to electromyography. Here an attempt is described to improve the diagnosis of carpal tunnel syndrome with thermography using a computer-based system employing artificial neural networks to analyse the images. Method reliability was tested on 112 images (depicting the dorsal and palmar sides of 26 healthy and 30 pathological hands), with the hand divided into 12 segments and compared relative to a reference. Palmar segments appeared to have no beneficial influence on classification outcome, whereas dorsal segments gave improved outcome with classification success rates near to or over 80%, and finger segments influenced by the median nerve appeared to be of greatest importance. These are preliminary results from a limited number of images and further research will be undertaken as our image database grows.

Patient engagement: an investigation at a primary care clinic

PubMed Central

Gill, Preetinder Singh

2013-01-01

Background Engaged employees are an asset to any organization. They are instrumental in ensuring good commercial outcomes through continuous innovation and incremental improvement. A health care facility is similar to a regular work setting in many ways. A health care provider and a patient have roles akin to a team leader and a team member/stakeholder, respectively. Hence it can be argued that the concept of employee engagement can be applied to patients in health care settings in order to improve health outcomes. Methods Patient engagement data were collected using a survey instrument from a primary care clinic in the northern Indian state of Punjab. Canonical correlation equations were formulated to identify combinations which were strongly related to each other. In addition, the cause-effect relationship between patient engagement and patient-perceived health outcomes was described using structural equation modeling. Results Canonical correlation analysis showed that the first set of canonical variables had a fairly strong relationship, ie, a magnitude > 0.80 at the 95% confidence interval, for five dimensions of patient engagement. Structural equation modeling analysis yielded a β ≥ 0.10 and a Student’s t statistic ≥ 2.96 for these five dimensions. The threshold Student’s t statistic was 1.99. Hence it was found the β values were significant at the 95% confidence interval for all census regions. Conclusion A scaled reliable survey instrument was developed to measured patient engagement. Better patient engagement is associated with better patient-perceived health outcomes. This study provides preliminary evidence that patient engagement has a causal relationship with patient-perceived health outcomes. PMID:23515133

Cross-cultural adaptation and validation of the Arabic version of the knee outcome survey-activities for daily living scale.

PubMed

Bouzubar, Fawzi F; Aljadi, Sameera H; Alotaibi, Naser M; Irrgang, James J

2018-07-01

The purpose of this study is to cross-culturally adapt the Knee Outcome Survey-Activities of Daily Living Scale into Arabic and to assess its psychometric properties (internal consistency, reliability, validity, and responsiveness) in patients with knee disorders. The cross-cultural adaptation process for the Knee Outcome Survey-Activities of Daily Living Scale into Arabic was performed consistent with the published guidelines. The psychometric properties of this Arabic version were then evaluated. Participants completed this version three times: at baseline, 2-4 days later, and 4 weeks later. Correlations between the Arabic version of Knee Outcome Survey-Activities of Daily Living Scale and the Arabic version of the Short Form-36 Health Survey, Get Up and Go, and Ascending/Descending stairs tests were evaluated. Linguistic and cultural issues were addressed. The Arabic version of the Knee Outcome Survey-Activities of Daily Living Scale demonstrated excellent internal consistency (Cronbach's alpha = 0.97) and excellent test-retest reliability (intraclass correlation coefficient = 0.97). Construct validity of the Arabic version of the Knee Outcome Survey-Activities of Daily Living Scale with the Arabic version of Short Form-36 Health Survey subscales ranged from r = 0.28 to 0.53, p < 0.001. Criterion validity with the Get Up and Go and Ascending/Descending stairs tests ranged from r = -0.47 to -0.60, p < 0.01. This Arabic version was able to detect changes 4 weeks later (effect size = 1.12 and minimum clinically important difference = 14 points). The Arabic version of the Knee Outcome Survey-Activities of Daily Living Scale is a reliable, valid and responsive measure for assessing knee-related symptoms and functional limitations Implications for rehabilitation The Knee Outcome Survey-Activities of Daily Living Scale-Arabic is a reliable, valid and responsive measure for assessing knee-related functional limitations. This Arabic version can be used in clinical practice and for research purposes to assess symptoms and functional limitations in Arabic-speaking patients with knee disorders. This scale is responsive to track therapeutic outcome of Arabic-speaking patients with knee disorders.

Severity of anxiety and work-related outcomes of patients with anxiety disorders.

PubMed

Erickson, Steven R; Guthrie, Sally; Vanetten-Lee, Michelle; Himle, Joseph; Hoffman, Jody; Santos, Susana F; Janeck, Amy S; Zivin, Kara; Abelson, James L

2009-01-01

This study examined associations between anxiety and work-related outcomes in an anxiety disorders clinic population, examining both pretreatment links and the impact of anxiety change over 12 weeks of treatment on work outcomes. Four validated instruments were used to also allow examination of their psychometric properties, with the goal of improving measurement of work-related quality of life in this population. Newly enrolled adult patients seeking treatment in a university-based anxiety clinic were administered four work performance measures: Work Limitations Questionnaire (WLQ), Work Productivity and Activity Impairment Questionnaire (WPAI), Endicott Work Productivity Scale (EWPS), and Functional Status Questionnaire Work Performance Scale (WPS). Anxiety severity was determined using the Beck Anxiety Inventory (BAI). The Clinical Global Impressions, Global Improvement Scale (CGI-I) was completed by patients to evaluate symptom change at a 12-week follow-up. Two severity groups (minimal/mild vs. moderate/severe, based on baseline BAI score) were compared to each other on work measures. Eighty-one patients provided complete baseline data. Anxiety severity groups did not differ in job type, time on job, job satisfaction, or job choice. Patients with greater anxiety generally showed lower work performance on all instruments. Job advancement was impaired for the moderate/severe group. The multi-item performance scales demonstrated better validity and internal consistency. The WLQ and the WPAI detected change with symptom improvement. Level of work performance was generally associated with severity of anxiety. Of the instruments tested, the WLQ and the WPAI questionnaire demonstrated acceptable validity and internal reliability.

Familia Adelante: A Multi-Risk Prevention Intervention for Latino Families

PubMed Central

Cervantes, Richard; Goldbach, Jeremy; Santos, Susana M.

2011-01-01

A comprehensive approach for providing behavioral health services to youth is becoming increasingly emphasized (IOM, 2009). Latino youth are at increased risk for substance abuse, mental health concerns, unsafe sexual practices and HIV (Prado et al., 2006), and these outcomes have been empirically connected to individual, family and community-based stress (IOM, 2009). Despite this knowledge, there is a lack of evidence-based approaches that target these negative outcomes by reducing stress in Latino families in a culturally relevant manner (Cervantes, Kappos, Duenas & Arellano, 2003). The current study examined the use of research-based strategies for reducing multiple risk behaviors in a predominantly Mexican American sample of families. Through a modular approach, participants engaged in a psycho-educational curriculum to enhance communication and psychosocial coping, increase substance abuse and HIV knowledge and perception of harm, and improve school behavior. Over 12 sessions, the curriculum aimed to achieve these outcomes through an overall decrease in family and community-based stress by focusing on acculturative stress. Findings indicate that communication and perception of substance use harm were significantly enhanced, while social norms regarding sexual behavior, HIV anxiety and past use of marijuana and other illegal drugs were significantly reduced. While many of measures were reliable (α > .80), further changes are necessary to improve the accuracy of future studies. Despite these limitations, Familia Adelante improves many areas of participant’s family life, and points toward the feasibility of multi-risk reduction behavioral health prevention approaches. PMID:21822979

The role of massage in scar management: a literature review.

PubMed

Shin, Thuzar M; Bordeaux, Jeremy S

2012-03-01

Many surgeons recommend postoperative scar massage to improve aesthetic outcome, although scar massage regimens vary greatly. To review the regimens and efficacy of scar massage. PubMed was searched using the following key words: "massage" in combination with "scar," or "linear," "hypertrophic," "keloid," "diasta*," "atrophic." Information on study type, scar type, number of patients, scar location, time to onset of massage therapy, treatment protocol, treatment duration, outcomes measured, and response to treatment was tabulated. Ten publications including 144 patients who received scar massage were examined in this review. Time to treatment onset ranged from after suture removal to longer than 2 years. Treatment protocols ranged from 10 minutes twice daily to 30 minutes twice weekly. Treatment duration varied from one treatment to 6 months. Overall, 65 patients (45.7%) experienced clinical improvement based on Patient Observer Scar Assessment Scale score, Vancouver Scar Scale score, range of motion, pruritus, pain, mood, depression, or anxiety. Of 30 surgical scars treated with massage, 27 (90%) had improved appearance or Patient Observer Scar Assessment Scale score. The evidence for the use of scar massage is weak, regimens used are varied, and outcomes measured are neither standardized nor reliably objective, although its efficacy appears to be greater in postsurgical scars than traumatic or postburn scars. Although scar massage is anecdotally effective, there is scarce scientific data in the literature to support it. © 2011 by the American Society for Dermatologic Surgery, Inc. Published by Wiley Periodicals, Inc.

Experience with developmental facial paralysis: part II. Outcomes of reconstruction.

PubMed

Terzis, Julia K; Anesti, Katerina

2012-01-01

The purpose of this study was to document the 30-year experience of the authors' center in the management of developmental facial paralysis and to analyze the outcomes of microsurgical reconstruction. Forty-two cases of developmental facial paralysis were identified in a retrospective clinical review (1980 to 2010); 34 (80.95 percent) were children (age, 8 ± 6 years) and eight (19.05 percent) were adults (age, 27 ± 12 years). Comparisons between preoperative and postoperative results were performed with electrophysiologic studies and video evaluations by three independent observers. Mean follow-up was 8 ± 6.3 years (range, 1 to 23 years). Overall, outcome scores improved in all of the patients, as was evident from the observers' mean scores (preoperatively, 2.44; 2 years postoperatively, 3.66; final, 4.11; p < 0.001, Kruskal-Wallis test) and the electrophysiologic data (p < 0.0001). The improvement in eye closure, smile, and depressor function was greater in children as compared with adults (p < 0.005, Mann-Whitney test). Early targeted screening and diagnosis, with prompt specialized treatment, improves the physical and emotional development of children with developmental facial paralysis and reduces the prevalence of aesthetic and functional sequelae of the condition, thus facilitating reintegration among their peers. The experience of this center should serve as a framework for the establishment of accurate and reliable guidelines that will facilitate early diagnosis and management of developmental facial paralysis and provide support and counseling to the family.

Current state of computer navigation and robotics in unicompartmental and total knee arthroplasty: a systematic review with meta-analysis.

PubMed

van der List, Jelle P; Chawla, Harshvardhan; Joskowicz, Leo; Pearle, Andrew D

2016-11-01

Recently, there is a growing interest in surgical variables that are intraoperatively controlled by orthopaedic surgeons, including lower leg alignment, component positioning and soft tissues balancing. Since more tight control over these factors is associated with improved outcomes of unicompartmental knee arthroplasty and total knee arthroplasty (TKA), several computer navigation and robotic-assisted systems have been developed. Although mechanical axis accuracy and component positioning have been shown to improve with computer navigation, no superiority in functional outcomes has yet been shown. This could be explained by the fact that many differences exist between the number and type of surgical variables these systems control. Most systems control lower leg alignment and component positioning, while some in addition control soft tissue balancing. Finally, robotic-assisted systems have the additional advantage of improving surgical precision. A systematic search in PubMed, Embase and Cochrane Library resulted in 40 comparative studies and three registries on computer navigation reporting outcomes of 474,197 patients, and 21 basic science and clinical studies on robotic-assisted knee arthroplasty. Twenty-eight of these comparative computer navigation studies reported Knee Society Total scores in 3504 patients. Stratifying by type of surgical variables, no significant differences were noted in outcomes between surgery with computer-navigated TKA controlling for alignment and component positioning versus conventional TKA (p = 0.63). However, significantly better outcomes were noted following computer-navigated TKA that also controlled for soft tissue balancing versus conventional TKA (mean difference 4.84, 95 % Confidence Interval 1.61, 8.07, p = 0.003). A literature review of robotic systems showed that these systems can, similarly to computer navigation, reliably improve lower leg alignment, component positioning and soft tissues balancing. Furthermore, two studies comparing robotic-assisted with computer-navigated surgery reported superiority of robotic-assisted surgery in controlling these factors. Manually controlling all these surgical variables can be difficult for the orthopaedic surgeon. Findings in this study suggest that computer navigation or robotic assistance may help managing these multiple variables and could improve outcomes. Future studies assessing the role of soft tissue balancing in knee arthroplasty and long-term follow-up studies assessing the role of computer-navigated and robotic-assisted knee arthroplasty are needed.

Reliability of questionnaires to assess the healthy eating and activity environment of a child's home and school.

PubMed

Wilson, Annabelle; Magarey, Anthea; Mastersson, Nadia

2013-01-01

Childhood overweight and obesity are a growing concern globally, and environments, including the home and school, can contribute to this epidemic. This paper assesses the reliability of two questionnaires (parent and teacher) used in the evaluation of a community-based childhood obesity prevention intervention, the eat well be active (ewba) Community Programs. Parents and teachers were recruited from two primary schools and they completed the same questionnaire twice in 2008 and 2009. Data from both questionnaires were classified into outcomes relevant to healthy eating and activity, and target outcomes, based on the goals of the ewba Community Programs, were identified. Fourteen and 12 outcomes were developed from the parent and teacher questionnaires, respectively. Sixty parents and 28 teachers participated in the reliability study. Intraclass correlation coefficients for outcomes ranged from 0.37 to 0.92 (parent) (P < 0.05) and from 0.42 to 0.86 (teacher) (P < 0.05). Internal consistency, measured by Cronbach's alpha, of teacher scores ranged from 0.11 to 0.91 and 0.13 to 0.78 for scores from the parent questionnaire. The parent and teacher questionnaires are moderately reliable tools for simultaneously assessing child intakes, environments, attitudes, and knowledge associated with healthy eating and physical activity in the home and school and may be useful for evaluation of similar programs.

Using the Patient Reported Outcomes Measurement Information System to Evaluate Psychosocial Functioning among Children with Craniofacial Anomalies.

PubMed

Shapiro, Danielle N; Waljee, Jennifer; Ranganathan, Kavitha; Buchman, Steven; Warschausky, Seth

2015-06-01

Children with craniofacial anomalies are at risk for social exclusion, bullying, and psychological symptoms, all of which are associated with poor developmental and health outcomes. The National Institutes of Health-developed Patient Reported Outcomes Measurement Information System instruments may be useful tools for monitoring psychosocial functioning in clinical settings and for integrating patient and parent perspectives. The current study included 74 children (50 percent male) with craniofacial anomalies recruited through a multidisciplinary clinic. The authors obtained child self-report and parent-proxy ratings of depression, anxiety, and peer relationship quality using National Institutes of Health Patient Reported Outcomes Measurement Information System instruments. The authors compared sample means to Patient Reported Outcomes Measurement Information System instruments norms and analyzed the reliability of parents' and children's reporting of psychosocial variables. All reliability statistics were satisfactory (α values ranging from 0.74 to 0.96) and sample standard deviations were similar to those obtained in a general population, suggesting that Patient Reported Outcomes Measurement Information System instruments are reliable among children with craniofacial anomalies. In general, children and parents did not report unusual levels of psychological distress; however, they did report poorer peer relationship quality relative to normed data, a trend that was particularly pronounced among boys. National Institutes of Health Patient Reported Outcomes Measurement Information System instruments are efficient and accurate tools for monitoring psychosocial adjustment among children with craniofacial anomalies. It may be especially important to monitor social functioning, particularly among boys.

Advanced Nursing Process quality: Comparing the International Classification for Nursing Practice (ICNP) with the NANDA-International (NANDA-I) and Nursing Interventions Classification (NIC).

PubMed

Rabelo-Silva, Eneida Rejane; Dantas Cavalcanti, Ana Carla; Ramos Goulart Caldas, Maria Cristina; Lucena, Amália de Fátima; Almeida, Miriam de Abreu; Linch, Graciele Fernanda da Costa; da Silva, Marcos Barragan; Müller-Staub, Maria

2017-02-01

To assess the quality of the advanced nursing process in nursing documentation in two hospitals. Various standardised terminologies are employed by nurses worldwide, whether for teaching, research or patient care. These systems can improve the quality of nursing records, enable care continuity, consistency in written communication and enhance safety for patients and providers alike. Cross-sectional study. A total of 138 records from two facilities (69 records from each facility) were analysed, one using the NANDA-International and Nursing Interventions Classification terminology (Centre 1) and one the International Classification for Nursing Practice (Centre 2), by means of the Quality of Diagnoses, Interventions, and Outcomes instrument. Quality of Diagnoses, Interventions, and Outcomes scores range from 0-58 points. Nursing records were dated 2012-2013 for Centre 1 and 2010-2011 for Centre 2. Centre 1 had a Quality of Diagnoses, Interventions, and Outcomes score of 35·46 (±6·45), whereas Centre 2 had a Quality of Diagnoses, Interventions, and Outcomes score of 31·72 (±4·62) (p < 0·001). Centre 2 had higher scores in the 'Nursing Diagnoses as Process' dimension, whereas in the 'Nursing Diagnoses as Product', 'Nursing Interventions' and 'Nursing Outcomes' dimensions, Centre 1 exhibited superior performance; acceptable reliability values were obtained for both centres, except for the 'Nursing Interventions' domain in Centre 1 and the 'Nursing Diagnoses as Process' and 'Nursing Diagnoses as Product' domains in Centre 2. The quality of nursing documentation was superior at Centre 1, although both facilities demonstrated moderate scores considering the maximum potential score of 58 points. Reliability analyses showed satisfactory results for both standardised terminologies. Nursing leaders should use a validated instrument to investigate the quality of nursing records after implementation of standardised terminologies. © 2016 John Wiley & Sons Ltd.

Does condom social marketing improve health outcomes and increase usage and equitable access?

PubMed

Knerr, Wendy

2011-05-01

Condom social marketing (CSM) has increased condom supplies, broadened commercial markets for condoms and introduced marketing innovations in developing countries. Yet rigorous and reliable evidence of the impact on condom usage and disease prevention is limited, as is evidence of the impact on equity of access to condoms for poor populations, women and people living with HIV. One strand of research on CSM reports mostly on output (e.g. sales and processes) and market growth; but these have been found to be highly unreliable measures of condom usage. Another strand of research reports primarily on changes in sexual behaviour, attitude or condom usage, using survey data. While random sampling is rare, these studies often use representative samples, which provide some measure of validity. There have been attempts to improve the reliability or results to good effect, but challenges remain for researchers, scholars and donors, including the need to supplement output data with measures of behaviour change, use rigorous designs which are built into programmes a priori, report on equity measures, report on potential harms of CSM programmes, and encourage external and systematic reviews. Copyright © 2011 Reproductive Health Matters. Published by Elsevier Ltd. All rights reserved.

A reliability of the prototype trunk training system for sitting balance.

PubMed

Jeong, Juri; Park, Dae-Sung; Lee, Hyelim; Eun, Seondeok

2014-11-01

[Purpose] Cerebral palsy is a disorder that affects balance in the sitting position. Cerebral palsy patients need trunk muscle strengthening and balance training. In order to improve trunk control sensory-motor control training is carried out on an unstable surface. We have developed a Trunk Training System (TTS) that can provide visual feedback using a tilt sensor for balance training in the sitting position. Before using the TTS for training children with cerebral palsy experiments were conducted with healthy adult subjects and the TTS to gather basic data for its improvement. [Subjects] The subjects were 11 healthy men (n=3) and women (n=8). [Methods] Subjects trained at two levels (5°, 10°), in four different directions (anterior, posterior, left, right), three times each. TTS outcome indices (stability index, performance time) were measured. [Results] The stability index and performance time showed high correlation (-0.6

Improving public health by improving clinical trial guidelines and their application

PubMed Central

Landray, Martin J.; Bax, Jeroen J.; Alliot, Laurence; Buyse, Marc; Cohen, Adam; Collins, Rory; Hindricks, Gerhard; James, Stefan K.; Lane, Sile; Maggioni, Aldo P.; Meeker-O'Connell, Ann; Olsson, Gunnar; Pocock, Stuart J.; Rawlins, Michael; Sellors, Jonathan; Shinagawa, Kaori; Sipido, Karin R.; Smeeth, Liam; Stephens, Richard; Stewart, Murray W.; Stough, Wendy Gattis; Sweeney, Fergus; Van de Werf, Frans; Woods, Kerrie; Casadei, Barbara

2017-01-01

Evidence generated from randomized controlled trials forms the foundation of cardiovascular therapeutics and has led to the adoption of numerous drugs and devices that prolong survival and reduce morbidity, as well as the avoidance of interventions that have been shown to be ineffective or even unsafe. Many aspects of cardiovascular research have evolved considerably since the first randomized trials in cardiology were conducted. In order to be large enough to provide reliable evidence about effects on major outcomes, cardiovascular trials may now involve thousands of patients recruited from hundreds of clinical sites in many different countries. Costly infrastructure has developed to meet the increasingly complex organizational and operational requirements of these clinical trials. Concerns have been raised that this approach is unsustainable, inhibiting the reliable evaluation of new and existing treatments, to the detriment of patient care. These issues were considered by patients, regulators, funders, and trialists at a meeting of the European Society of Cardiology Cardiovascular Roundtable in October 2015. This paper summarizes the key insights and discussions from the workshop, highlights subsequent progress, and identifies next steps to produce meaningful change in the conduct of cardiovascular clinical research. PMID:28329235

The Dutch version of the Oxford Ankle and Foot Questionnaire for Children: Useful for evaluation of pediatric foot problems in groups.

PubMed

Burger, Elise; Selles, Ruud; van Nieuwkasteele, Shelly; Bessems, Gert; Pollet, Virginie; Hovius, Steven; van Nieuwenhoven, Christianne

2017-11-04

The purpose of this study is to develop a Dutch version of the Oxford Ankle and Foot Questionnaire for Children (OxAFQ-c) to allow evaluation of pediatric foot care. The OxAFQ-c was translated into Dutch, according to the ISPOR-guidelines. Children with different foot and ankle complaints completed the OxAFQ-c at baseline, after two weeks, and after 4-6 months. Measurement properties were assessed in terms of reliability, responsiveness, and construct validity. Test-retest reliability showed moderate intraclass correlation coefficients. Bland-Altman plots showed wide limits of agreement. After 4-6 months, the group that experienced improvement also showed improved questionnaire outcomes, indicating responsiveness. Moderate correlation between the OxAFQ-c and the Kidscreen and foot-specific VAS-scores were observed, indicating moderate construct validity. The Dutch OxAFQ-c showed moderate to good measurement properties. However, because we observed limited sensitivity to changes and wide limits of agreement in individual patients, we think the questionnaire should only be used in groups. Copyright © 2017 European Foot and Ankle Society. Published by Elsevier Ltd. All rights reserved.

Validating a work group climate assessment tool for improving the performance of public health organizations

PubMed Central

Perry, Cary; LeMay, Nancy; Rodway, Greg; Tracy, Allison; Galer, Joan

2005-01-01

Background This article describes the validation of an instrument to measure work group climate in public health organizations in developing countries. The instrument, the Work Group Climate Assessment Tool (WCA), was applied in Brazil, Mozambique, and Guinea to assess the intermediate outcomes of a program to develop leadership for performance improvement. Data were collected from 305 individuals in 42 work groups, who completed a self-administered questionnaire. Methods The WCA was initially validated using Cronbach's alpha reliability coefficient and exploratory factor analysis. This article presents the results of a second validation study to refine the initial analyses to account for nested data, to provide item-level psychometrics, and to establish construct validity. Analyses included eigenvalue decomposition analysis, confirmatory factor analysis, and validity and reliability analyses. Results This study confirmed the validity and reliability of the WCA across work groups with different demographic characteristics (gender, education, management level, and geographical location). The study showed that there is agreement between the theoretical construct of work climate and the items in the WCA tool across different populations. The WCA captures a single perception of climate rather than individual sub-scales of clarity, support, and challenge. Conclusion The WCA is useful for comparing the climates of different work groups, tracking the changes in climate in a single work group over time, or examining differences among individuals' perceptions of their work group climate. Application of the WCA before and after a leadership development process can help work groups hold a discussion about current climate and select a target for improvement. The WCA provides work groups with a tool to take ownership of their own group climate through a process that is simple and objective and that protects individual confidentiality. PMID:16223447

Assessing rural small community water supply in Limpopo, South Africa: water service benchmarks and reliability.

PubMed

Majuru, Batsirai; Jagals, Paul; Hunter, Paul R

2012-10-01

Although a number of studies have reported on water supply improvements, few have simultaneously taken into account the reliability of the water services. The study aimed to assess whether upgrading water supply systems in small rural communities improved access, availability and potability of water by assessing the water services against selected benchmarks from the World Health Organisation and South African Department of Water Affairs, and to determine the impact of unreliability on the services. These benchmarks were applied in three rural communities in Limpopo, South Africa where rudimentary water supply services were being upgraded to basic services. Data were collected through structured interviews, observations and measurement, and multi-level linear regression models were used to assess the impact of water service upgrades on key outcome measures of distance to source, daily per capita water quantity and Escherichia coli count. When the basic system was operational, 72% of households met the minimum benchmarks for distance and water quantity, but only 8% met both enhanced benchmarks. During non-operational periods of the basic service, daily per capita water consumption decreased by 5.19l (p<0.001, 95% CI 4.06-6.31) and distances to water sources were 639 m further (p ≤ 0.001, 95% CI 560-718). Although both rudimentary and basic systems delivered water that met potability criteria at the sources, the quality of stored water sampled in the home was still unacceptable throughout the various service levels. These results show that basic water services can make substantial improvements to water access, availability, potability, but only if such services are reliable. Copyright © 2012 Elsevier B.V. All rights reserved.

Psychometric analyses to improve the Dutch ICF Activity Inventory.

PubMed

Bruijning, Janna E; van Rens, Ger; Knol, Dirk; van Nispen, Ruth

2013-08-01

In the past, rehabilitation centers for the visually impaired used unstructured or semistructured methods to assess rehabilitation needs of their patients. Recently, an extensive instrument, the Dutch ICF Activity Inventory (D-AI), was developed to systematically investigate rehabilitation needs of visually impaired adults and to evaluate rehabilitation outcomes. The purpose of this study was to investigate the underlying factor structure and other psychometric properties to shorten and improve the D-AI. The D-AI was administered to 241 visually impaired persons who recently enrolled in a multidisciplinary rehabilitation center. The D-AI uses graded scores to assess the importance and difficulty of 65 rehabilitation goals. For high-priority goals (e.g., daily meal preparation), the difficulty of underlying tasks (e.g., read recipes, cut vegetables) was assessed. To reduce underlying task items (>950), descriptive statistics were investigated and factor analyses were performed for several goals. The internal consistency reliability and test-retest reliability of the D-AI were investigated by calculating Cronbach α and Cohen (weighted) κ. Finally, consensus-based discussions were used to shorten and improve the D-AI. Except for one goal, factor analysis model parameters were at least reasonable. Internal consistency reliability was satisfactory (range, 0.74 to 0.93). In total, 60% of the 65 goal importance items and 84.4% of the goal difficulty items showed moderate to almost perfect κ values (≥0.40). After consensus-based discussions, a new D-AI was produced, containing 48 goals and less than 500 tasks. The analyses were an important step in the validation process of the D-AI and to develop a more feasible assessment tool to investigate rehabilitation needs of visually impaired persons in a systematic way. The D-AI is currently implemented in all Dutch rehabilitation centers serving all visually impaired adults with various rehabilitation needs.

The Effect of Technical Performance on Patient Outcomes in Surgery: A Systematic Review.

PubMed

Fecso, Andras B; Szasz, Peter; Kerezov, Georgi; Grantcharov, Teodor P

2017-03-01

Systematic review of the effect of intraoperative technical performance on patient outcomes. The operating room is a high-stakes, high-risk environment. As a result, the quality of surgical interventions affecting patient outcomes has been the subject of discussion and research for years. MEDLINE, EMBASE, PsycINFO, and Cochrane databases were searched. All surgical specialties were eligible for inclusion. Data were reviewed in regards to the methods by which technical performance was measured, what patient outcomes were assessed, and how intraoperative technical performance affected patient outcomes. Quality of evidence was assessed using the Medical Education Research Study Quality Instrument (MERSQI). Of the 12,758 studies initially identified, 24 articles (7775 total participants) were ultimately included in this review. Seventeen studies assessed the performance of the faculty alone, 2 assessed both the faculty and trainees, 1 assessed trainees alone, and in 4 studies, the level of the operating surgeon was not specified. In 18 studies, a performance assessment tool was used. Patient outcomes were evaluated using intraoperative complications, short-term morbidity, long-term morbidity, short-term mortality, and long-term mortality. The average MERSQI score was 11.67 (range 9.5-14.5). Twenty-one studies demonstrated that superior technical performance was related to improved patient outcomes. The results of this systematic review demonstrated that superior technical performance positively affects patient outcomes. Despite this initial evidence, more robust research is needed to directly assess intraoperative technical performance and its effect on postoperative patient outcomes using meaningful assessment instruments and reliable processes.

Reliability and smallest real difference of the ankle lunge test post ankle fracture.

PubMed

Simondson, David; Brock, Kim; Cotton, Susan

2012-02-01

This study aimed to determine the reliability and the smallest real difference of the Ankle Lunge test in an ankle fracture patient population. In the post immobilisation stage of ankle fracture, ankle dorsiflexion is an important measure of progress and outcome. The Ankle Lunge test measures weight bearing dorsiflexion, resulting in negative scores (knee to wall distance) and positive scores (toe to wall distance), for which the latter has proven reliability in normal subjects only. A consecutive sample of ankle fracture patients with permission to commence weight bearing, were recruited to the study. Three measurements of the Ankle Lunge Test were performed each by two raters, one senior and one junior physiotherapist. These occurred prior to therapy sessions in the second week after plaster removal. A standardised testing station was utilised and allowed for both knee to wall distance and toe to wall distance measurement. Data was collected from 10 individuals with ankle fracture, with an average age of 36 years (SD 14.8). Seventy seven percent of observations were negative. Intra and inter-rater reliability yielded intra class correlations at or above 0.97, p < .001. There was a significant systematic bias towards improved scores during repeated measurement for one rater (p = .01). The smallest real difference was calculated as 13.8mm. The Ankle Lunge test is a practical and reliable tool for measuring weightbearing dorsiflexion post ankle fracture. Copyright © 2011 Elsevier Ltd. All rights reserved.

Test-Retest Reliability of Innovated Strength Tests for Hip Muscles

PubMed Central

Meyer, Christophe; Corten, Kristoff; Wesseling, Mariska; Peers, Koen; Simon, Jean-Pierre; Jonkers, Ilse; Desloovere, Kaat

2013-01-01

The burden of hip muscles weakness and its relation to other impairments has been well documented. It is therefore a pre-requisite to have a reliable method for clinical assessment of hip muscles function allowing the design and implementation of a proper strengthening program. Motor-driven dynamometry has been widely accepted as the gold-standard for lower limb muscle strength assessment but is mainly related to the knee joint. Studies focusing on the hip joint are less exhaustive and somewhat discrepant with regard to optimal participants position, consequently influencing outcome measures. Thus, we aimed to develop a standardized test setup for the assessment of hip muscles strength, i.e. flexors/extensors and abductors/adductors, with improved participant stability and to define its psychometric characteristics. Eighteen participants performed unilateral isokinetic and isometric contractions of the hip muscles in the sagittal and coronal plane at two separate occasions. Peak torque and normalized peak torque were measured for each contraction. Relative and absolute measures of reliability were calculated using the intraclass correlation coefficient and standard error of measurement, respectively. Results from this study revealed higher levels of between-day reliability of isokinetic/isometric hip abduction/flexion peak torque compared to existing literature. The least reliable measures were found for hip extension and adduction, which could be explained by a less efficient stabilization technique. Our study additionally provided a first set of reference normalized data which can be used in future research. PMID:24260550

Couple Treatment for Alcohol Use Disorder and Posttraumatic Stress Disorder: Pilot Results From U.S. Military Veterans and Their Partners.

PubMed

Schumm, Jeremiah A; Monson, Candice M; O'Farrell, Timothy J; Gustin, Nancy G; Chard, Kathleen M

2015-06-01

We studied 13 U.S. male military veterans and their female partners who consented to participate in an uncontrolled trial of couple treatment for alcohol use disorder and posttraumatic stress disorder (CTAP). CTAP is a 15-session, manualized therapy, integrating behavioral couples therapy for alcohol use disorder (AUD) with cognitive-behavioral conjoint therapy for posttraumatic stress disorder (PTSD). Due to ineligibility (n = 1) and attrition (n = 3), 9 couples completed the study, and 7 completed 12 or more sessions. There were 8 veterans who showed clinically reliable pre- to posttreatment reduction of PTSD outcomes. There were also significant group-level reductions in clinician-, veteran-, and partner-rated PTSD symptoms (d = 0.94 to 1.71). Most veterans showed clinically reliable reductions in percentage days of heavy drinking. Group-level reduction in veterans' percentage days of heavy drinking was significant (d = 1.01). There were 4 veterans and 3 partners with clinically reliable reductions in depression, and group-level change was significant for veterans (d = 0.93) and partners (d = 1.06). On relationship satisfaction, 3 veterans and 4 partners had reliable improvements, and 2 veterans and 1 partner had reliable deterioration. Group-level findings were nonsignificant for veteran relationship satisfaction (d = 0.26) and for partners (d = 0.52). These findings indicate that CTAP may be a promising intervention for individuals with comorbid PTSD and AUD who have relationship partners. Copyright © 2015 Wiley Periodicals, Inc., A Wiley Company.

Transferring Aviation Practices into Clinical Medicine for the Promotion of High Reliability.

PubMed

Powell-Dunford, Nicole; McPherson, Mark K; Pina, Joseph S; Gaydos, Steven J

2017-05-01

Aviation is a classic example of a high reliability organization (HRO)-an organization in which catastrophic events are expected to occur without control measures. As health care systems transition toward high reliability, aviation practices are increasingly transferred for clinical implementation. A PubMed search using the terms aviation, crew resource management, and patient safety was undertaken. Manuscripts authored by physician pilots and accident investigation regulations were analyzed. Subject matter experts involved in adoption of aviation practices into the medical field were interviewed. A PubMed search yielded 621 results with 22 relevant for inclusion. Improved clinical outcomes were noted in five research trials in which aviation practices were adopted, particularly with regard to checklist usage and crew resource-management training. Effectiveness of interventions was influenced by intensity of application, leadership involvement, and provision of staff training. The usefulness of incorporating mishap investigation techniques has not been established. Whereas aviation accident investigation is highly standardized, the investigation of medical error is characterized by variation. The adoption of aviation practices into clinical medicine facilitates an evolution toward high reliability. Evidence for the efficacy of the checklist and crew resource-management training is robust. Transference of aviation accident investigation practices is preliminary. A standardized, independent investigation process could facilitate the development of a safety culture commensurate with that achieved in the aviation industry.Powell-Dunford N, McPherson MK, Pina JS, Gaydos SJ. Transferring aviation practices into clinical medicine for the promotion of high reliability. Aerosp Med Hum Perform. 2017; 88(5):487-491.

An Exploratory Factor Analysis and Reliability Analysis of the Student Online Learning Readiness (SOLR) Instrument

ERIC Educational Resources Information Center

Yu, Taeho; Richardson, Jennifer C.

2015-01-01

The purpose of this study was to develop an effective instrument to measure student readiness in online learning with reliable predictors of online learning success factors such as learning outcomes and learner satisfaction. The validity and reliability of the Student Online Learning Readiness (SOLR) instrument were tested using exploratory factor…

The multiple sclerosis work difficulties questionnaire: translation and cross-cultural adaptation to Turkish and assessment of validity and reliability.

PubMed

Kahraman, Turhan; Özdoğar, Asiye Tuba; Honan, Cynthia Alison; Ertekin, Özge; Özakbaş, Serkan

2018-05-09

To linguistically and culturally adapt the Multiple Sclerosis Work Difficulties Questionnaire-23 (MSWDQ-23) for use in Turkey, and to examine its reliability and validity. Following standard forward-back translation of the MSWDQ-23, it was administered to 124 people with multiple sclerosis (MS). Validity was evaluated using related outcome measures including those related to employment status and expectations, disability level, fatigue, walking, and quality of life. Randomly selected participants were asked to complete the MSWDQ-23 again to assess test-retest reliability. Confirmatory factor analysis on the MSWDQ-23 demonstrated a good fit for the data, and the internal consistency of each subscale was excellent. The test-retest reliability for the total score, psychological/cognitive barriers, physical barriers, and external barriers subscales were high. The MSWDQ-23 and its subscales were positively correlated with the employment, disability level, walking, and fatigue outcome measures. This study suggests that the Turkish version of MSWDQ-23 has high reliability and adequate validity, and it can be used to determine the difficulties faced by people with multiple sclerosis in workplace. Moreover, the study provides evidence about the test-retest reliability of the questionnaire. Implications for rehabilitation Multiple sclerosis affects young people of working age. Understanding work-related problems is crucial to enhance people with multiple sclerosis likelihood of maintaining their job. The Multiple Sclerosis Work Difficulties Questionnaire-23 (MSWDQ-23) is a valid and reliable measure of perceived workplace difficulties in people with multiple sclerosis: we presented its validation to Turkish. Professionals working in the field of vocational rehabilitation may benefit from using the MSWDQ-23 to predict the current work outcomes and future employment expectations.

Reliability and Validity of Survey Instruments to Measure Work-Related Fatigue in the Emergency Medical Services Setting: A Systematic Review.

PubMed

Patterson, P Daniel; Weaver, Matthew D; Fabio, Anthony; Teasley, Ellen M; Renn, Megan L; Curtis, Brett R; Matthews, Margaret E; Kroemer, Andrew J; Xun, Xiaoshuang; Bizhanova, Zhadyra; Weiss, Patricia M; Sequeira, Denisse J; Coppler, Patrick J; Lang, Eddy S; Higgins, J Stephen

2018-02-15

This study sought to systematically search the literature to identify reliable and valid survey instruments for fatigue measurement in the Emergency Medical Services (EMS) occupational setting. A systematic review study design was used and searched six databases, including one website. The research question guiding the search was developed a priori and registered with the PROSPERO database of systematic reviews: "Are there reliable and valid instruments for measuring fatigue among EMS personnel?" (2016:CRD42016040097). The primary outcome of interest was criterion-related validity. Important outcomes of interest included reliability (e.g., internal consistency), and indicators of sensitivity and specificity. Members of the research team independently screened records from the databases. Full-text articles were evaluated by adapting the Bolster and Rourke system for categorizing findings of systematic reviews, and the rated data abstracted from the body of literature as favorable, unfavorable, mixed/inconclusive, or no impact. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) methodology was used to evaluate the quality of evidence. The search strategy yielded 1,257 unique records. Thirty-four unique experimental and non-experimental studies were determined relevant following full-text review. Nineteen studies reported on the reliability and/or validity of ten different fatigue survey instruments. Eighteen different studies evaluated the reliability and/or validity of four different sleepiness survey instruments. None of the retained studies reported sensitivity or specificity. Evidence quality was rated as very low across all outcomes. In this systematic review, limited evidence of the reliability and validity of 14 different survey instruments to assess the fatigue and/or sleepiness status of EMS personnel and related shift worker groups was identified.

A Meta-Analytic Review of Stand-Alone Interventions to Improve Body Image

PubMed Central

Alleva, Jessica M.; Sheeran, Paschal; Webb, Thomas L.; Martijn, Carolien; Miles, Eleanor

2015-01-01

Objective Numerous stand-alone interventions to improve body image have been developed. The present review used meta-analysis to estimate the effectiveness of such interventions, and to identify the specific change techniques that lead to improvement in body image. Methods The inclusion criteria were that (a) the intervention was stand-alone (i.e., solely focused on improving body image), (b) a control group was used, (c) participants were randomly assigned to conditions, and (d) at least one pretest and one posttest measure of body image was taken. Effect sizes were meta-analysed and moderator analyses were conducted. A taxonomy of 48 change techniques used in interventions targeted at body image was developed; all interventions were coded using this taxonomy. Results The literature search identified 62 tests of interventions (N = 3,846). Interventions produced a small-to-medium improvement in body image (d + = 0.38), a small-to-medium reduction in beauty ideal internalisation (d + = -0.37), and a large reduction in social comparison tendencies (d + = -0.72). However, the effect size for body image was inflated by bias both within and across studies, and was reliable but of small magnitude once corrections for bias were applied. Effect sizes for the other outcomes were no longer reliable once corrections for bias were applied. Several features of the sample, intervention, and methodology moderated intervention effects. Twelve change techniques were associated with improvements in body image, and three techniques were contra-indicated. Conclusions The findings show that interventions engender only small improvements in body image, and underline the need for large-scale, high-quality trials in this area. The review identifies effective techniques that could be deployed in future interventions. PMID:26418470

GP preferences for information systems: conjoint analysis of speed, reliability, access and users.

PubMed

Wyatt, Jeremy C; Batley, Richard P; Keen, Justin

2010-10-01

To elicit the preferences and trade-offs of UK general practitioners about key features of health information systems, to help inform the design of such systems in future. A stated choice study to uncover implicit preferences based on a binary choice between scenarios presented in random order. were all 303 general practice members of the UK Internet service provider, Medix who were approached by email to participate. The main outcome measure was the number of seconds delay in system response that general practitioners were willing to trade off for each key system feature: the reliability of the system, the sites from which the system could be accessed and which staff are able to view patient data. Doctors valued speed of response most in information systems but would be prepared to wait 28 seconds to access a system in exchange for improved reliability from 95% to 99%, a further 2 seconds for an improvement to 99.9% and 27 seconds for access to data from anywhere including their own home compared with one place in a single health care premises. However, they would require a system that was 14 seconds faster to compensate for allowing social care as well as National Health Service staff to read patient data. These results provide important new evidence about which system characteristics doctors value highly, and hence which characteristics designers need to focus on when large scale health information systems are planned. © 2010 Blackwell Publishing Ltd.

Measuring Work Environment and Performance in Nursing Homes

PubMed Central

Temkin-Greener, Helena; Zheng, Nan (Tracy); Katz, Paul; Zhao, Hongwei; Mukamel, Dana B.

2008-01-01

Background Qualitative studies of the nursing home work environment have long suggested that such attributes as leadership and communication may be related to nursing home performance, including residents' outcomes. However, empirical studies examining these relationships have been scant. Objectives This study is designed to: develop an instrument for measuring nursing home work environment and perceived work effectiveness; test the reliability and validity of the instrument; and identify individual and facility-level factors associated with better facility performance. Research Design and Methods The analysis was based on survey responses provided by managers (N=308) and direct care workers (N=7,418) employed in 162 facilities throughout New York State. Exploratory factor analysis, Chronbach's alphas, analysis of variance, and regression models were used to assess instrument reliability and validity. Multivariate regression models, with fixed facility effects, were used to examine factors associated with work effectiveness. Results The reliability and the validity of the survey instrument for measuring work environment and perceived work effectiveness has been demonstrated. Several individual (e.g. occupation, race) and facility characteristics (e.g. management style, workplace conditions, staffing) that are significant predictors of perceived work effectiveness were identified. Conclusions The organizational performance model used in this study recognizes the multidimensionality of the work environment in nursing homes. Our findings suggest that efforts at improving work effectiveness must also be multifaceted. Empirical findings from such a line of research may provide insights for improving the quality of the work environment and ultimately the quality of residents' care. PMID:19330892

Teamwork Assessment Tools in Obstetric Emergencies: A Systematic Review.

PubMed

Onwochei, Desire N; Halpern, Stephen; Balki, Mrinalini

2017-06-01

Team-based training and simulation can improve patient safety, by improving communication, decision making, and performance of team members. Currently, there is no general consensus on whether or not a specific assessment tool is better adapted to evaluate teamwork in obstetric emergencies. The purpose of this qualitative systematic review was to find the tools available to assess team effectiveness in obstetric emergencies. We searched Embase, Medline, PubMed, Web of Science, PsycINFO, CINAHL, and Google Scholar for prospective studies that evaluated nontechnical skills in multidisciplinary teams involving obstetric emergencies. The search included studies from 1944 until January 11, 2016. Data on reliability and validity measures were collected and used for interpretation. A descriptive analysis was performed on the data. Thirteen studies were included in the final qualitative synthesis. All the studies assessed teams in the context of obstetric simulation scenarios, but only six included anesthetists in the simulations. One study evaluated their teamwork tool using just validity measures, five using just reliability measures, and one used both. The most reliable tools identified were the Clinical Teamwork Scale, the Global Assessment of Obstetric Team Performance, and the Global Rating Scale of performance. However, they were still lacking in terms of quality and validity. More work needs to be conducted to establish the validity of teamwork tools for nontechnical skills, and the development of an ideal tool is warranted. Further studies are required to assess how outcomes, such as performance and patient safety, are influenced when using these tools.

An evidence-based decision assistance model for predicting training outcome in juvenile guide dogs

PubMed Central

Craigon, Peter J.; Blythe, Simon A.; England, Gary C. W.; Asher, Lucy

2017-01-01

Working dog organisations, such as Guide Dogs, need to regularly assess the behaviour of the dogs they train. In this study we developed a questionnaire-style behaviour assessment completed by training supervisors of juvenile guide dogs aged 5, 8 and 12 months old (n = 1,401), and evaluated aspects of its reliability and validity. Specifically, internal reliability, temporal consistency, construct validity, predictive criterion validity (comparing against later training outcome) and concurrent criterion validity (comparing against a standardised behaviour test) were evaluated. Thirty-nine questions were sourced either from previously published literature or created to meet requirements identified via Guide Dogs staff surveys and staff feedback. Internal reliability analyses revealed seven reliable and interpretable trait scales named according to the questions within them as: Adaptability; Body Sensitivity; Distractibility; Excitability; General Anxiety; Trainability and Stair Anxiety. Intra-individual temporal consistency of the scale scores between 5–8, 8–12 and 5–12 months was high. All scales excepting Body Sensitivity showed some degree of concurrent criterion validity. Predictive criterion validity was supported for all seven scales, since associations were found with training outcome, at at-least one age. Thresholds of z-scores on the scales were identified that were able to distinguish later training outcome by identifying 8.4% of all dogs withdrawn for behaviour and 8.5% of all qualified dogs, with 84% and 85% specificity. The questionnaire assessment was reliable and could detect traits that are consistent within individuals over time, despite juvenile dogs undergoing development during the study period. By applying thresholds to scores produced from the questionnaire this assessment could prove to be a highly valuable decision-making tool for Guide Dogs. This is the first questionnaire-style assessment of juvenile dogs that has shown value in predicting the training outcome of individual working dogs. PMID:28614347

Development of a tool to measure person-centered maternity care in developing settings: validation in a rural and urban Kenyan population.

PubMed

Afulani, Patience A; Diamond-Smith, Nadia; Golub, Ginger; Sudhinaraset, May

2017-09-22

Person-centered reproductive health care is recognized as critical to improving reproductive health outcomes. Yet, little research exists on how to operationalize it. We extend the literature in this area by developing and validating a tool to measure person-centered maternity care. We describe the process of developing the tool and present the results of psychometric analyses to assess its validity and reliability in a rural and urban setting in Kenya. We followed standard procedures for scale development. First, we reviewed the literature to define our construct and identify domains, and developed items to measure each domain. Next, we conducted expert reviews to assess content validity; and cognitive interviews with potential respondents to assess clarity, appropriateness, and relevance of the questions. The questions were then refined and administered in surveys; and survey results used to assess construct and criterion validity and reliability. The exploratory factor analysis yielded one dominant factor in both the rural and urban settings. Three factors with eigenvalues greater than one were identified for the rural sample and four factors identified for the urban sample. Thirty of the 38 items administered in the survey were retained based on the factors loadings and correlation between the items. Twenty-five items load very well onto a single factor in both the rural and urban sample, with five items loading well in either the rural or urban sample, but not in both samples. These 30 items also load on three sub-scales that we created to measure dignified and respectful care, communication and autonomy, and supportive care. The Chronbach alpha for the main scale is greater than 0.8 in both samples, and that for the sub-scales are between 0.6 and 0.8. The main scale and sub-scales are correlated with global measures of satisfaction with maternity services, suggesting criterion validity. We present a 30-item scale with three sub-scales to measure person-centered maternity care. This scale has high validity and reliability in a rural and urban setting in Kenya. Validation in additional settings is however needed. This scale will facilitate measurement to improve person-centered maternity care, and subsequently improve reproductive outcomes.

The Smoking Abstinence Questionnaire: Measurement of smokers’ abstinence-related expectancies

PubMed Central

Hendricks, Peter S.; Wood, Sabrina B.; Baker, Majel R.; Delucchi, Kevin L.; Hall, Sharon M.

2011-01-01

AIM To develop and validate a measure of smokers’ expectancies for the abstinence process upon quitting smoking: the Smoking Abstinence Questionnaire (SAQ). DESIGN Principal component analysis and other psychometric analyses of self-report data. SETTING San Francisco, California. PARTICIPANTS 507 adult smokers of at least 10 cigarettes per day diverse in gender, sexual orientation, and ethnoracial status. MEASUREMENTS The primary measure was a draft version of the SAQ. Additional measures assessed a variety of other smoking-related constructs. FINDINGS Principal component analyses revealed 10 factors of the SAQ: Withdrawal, Social Improvement/Nonsmoker Identity, Adverse Outcomes, Treatment Effectiveness, Common Reasons, Barriers to Treatment, Social Support, Optimistic Outcomes, Coffee Use, and Weight Gain. The SAQ factors demonstrated internal consistencies ranging from .62 to .85 and were associated with tobacco dependence, motivation to quit, abstinence self-efficacy, withdrawal symptoms, dietary restraint, shape and weight concern, and tobacco use expectancies. The SAQ predicted smoking-related constructs above and beyond tobacco use expectancies, suggesting that abstinence-related expectancies and tobacco use expectancies are distinct from one another. CONCLUSIONS A newly developed questionnaire, the SAQ, appears to reliably capture smokers’ expectancies for abstinence (Withdrawal, Social Improvement/Nonsmoker Identity, Adverse Outcomes, Common Reasons, Optimistic Outcomes, Coffee Use, and Weight Gain) and expectancies related to the success of a quit attempt (Treatment Effectiveness, Barriers to Treatment, and Social Support). It remains to be seen how far any of these expectancies predict attempts to quit, withdrawal, treatment utilization and response, and quitting success above and beyond existing measures. PMID:21205053

Indocyanine green laser angiography improves deep inferior epigastric perforator flap outcomes following abdominal suction lipectomy.

PubMed

Casey, William J; Connolly, Katharine A; Nanda, Alisha; Rebecca, Alanna M; Perdikis, Galen; Smith, Anthony A

2015-03-01

The reliability of deep inferior epigastric artery perforator (DIEP) flap reconstruction following abdominal liposuction is controversial. The authors' early cases were technically successful; however, they experienced high partial flap loss and fat necrosis rates. The authors sought to compare DIEP flap outcomes in the setting of prior liposuction after the use of intraoperative indocyanine green angiography compared to when flaps were assessed on clinical grounds alone. A retrospective review of a consecutive series of DIEP flaps following liposuction at a single institution was performed, comparing those evaluated on clinical grounds alone and those in which indocyanine green angiography was used intraoperatively. Outcomes measured included anastomotic complications, total flap loss, partial flap loss, fat necrosis, and postoperative abdominal wounds. Thirteen DIEP flaps following prior liposuction were performed on 11 patients from July of 2003 through January of 2014. All patients had preoperative imaging with duplex ultrasound or computed tomographic angiography to analyze perforator suitability before surgical exploration. Seven flaps were evaluated intraoperatively on clinical grounds alone. Six flaps were assessed and modified based on indocyanine green angiography. All flaps were successful; however, partial flap loss and fat necrosis rates dropped from 71.4 percent to 0 percent when indocyanine green angiography was used intraoperatively (p = 0.02). Indocyanine green angiography is an excellent vascular imaging modality for intraoperative use to assess flap perfusion, and improves outcomes in DIEP flaps when harvested after prior abdominal suction lipectomy.

2017 NREL Photovoltaic Reliability Workshop

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, Sarah

NREL's Photovoltaic (PV) Reliability Workshop (PVRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology -- both critical goals for moving PV technologies deeper into the electricity marketplace.

An intelligent healthcare management system: a new approach in work-order prioritization for medical equipment maintenance requests.

PubMed

Hamdi, Naser; Oweis, Rami; Abu Zraiq, Hamzeh; Abu Sammour, Denis

2012-04-01

The effective maintenance management of medical technology influences the quality of care delivered and the profitability of healthcare facilities. Medical equipment maintenance in Jordan lacks an objective prioritization system; consequently, the system is not sensitive to the impact of equipment downtime on patient morbidity and mortality. The current work presents a novel software system (EQUIMEDCOMP) that is designed to achieve valuable improvements in the maintenance management of medical technology. This work-order prioritization model sorts medical maintenance requests by calculating a priority index for each request. Model performance was assessed by utilizing maintenance requests from several Jordanian hospitals. The system proved highly efficient in minimizing equipment downtime based on healthcare delivery capacity, and, consequently, patient outcome. Additionally, a preventive maintenance optimization module and an equipment quality control system are incorporated. The system is, therefore, expected to improve the reliability of medical equipment and significantly improve safety and cost-efficiency.

Improving Therapeutic Relationships: Joint Crisis Planning for Individuals With Psychotic Disorders.

PubMed

Farrelly, Simone; Lester, Helen; Rose, Diana; Birchwood, Max; Marshall, Max; Waheed, Waquas; Henderson, R Claire; Szmukler, George; Thornicroft, Graham

2015-12-01

Outcomes for individuals with psychosis remain far from acceptable. Recently, prominent psychiatrists have called for an improved understanding of the impact of social contexts, and how social contexts might influence the development and maintenance of mental health problems. A key social context for individuals with psychosis is the therapeutic relationship. As part of a trial of joint crisis planning in England, this qualitative study aimed to determine the mechanism through which joint crisis planning might affect the therapeutic relationship. Results suggest that routine processes in mental health care are affected by policy and organizational requirements for risk mitigation-aspects that undermine person-centered approaches. In contrast, strong therapeutic relationships are characterized by individualized care and reliable and respectful treatment. The Joint Crisis Plan intervention partially succeeded in reducing contextual influences on routine role enactments, facilitating the demonstration of respect and improving the therapeutic relationship. © The Author(s) 2015.

Assessment of reliability, validity, responsiveness and minimally important change of the German Hip dysfunction and osteoarthritis outcome score (HOOS) in patients with osteoarthritis of the hip.

PubMed

Arbab, Dariusch; van Ochten, Johannes H M; Schnurr, Christoph; Bouillon, Bertil; König, Dietmar

2017-12-01

Patient-reported outcome measures are a critical tool in evaluating the efficacy of orthopedic procedures. The intention of this study was to evaluate reliability, validity, responsiveness and minimally important change of the German version of the Hip dysfunction and osteoarthritis outcome score (HOOS). The German HOOS was investigated in 251 consecutive patients before and 6 months after total hip arthroplasty. All patients completed HOOS, Oxford-Hip Score, Short-Form (SF-36) and numeric scales for pain and disability. Test-retest reliability, internal consistency, floor and ceiling effects, construct validity and minimal important change were analyzed. The German HOOS demonstrated excellent test-retest reliability with intraclass correlation coefficient values > 0.7. Cronbach´s alpha values demonstrated strong internal consistency. As hypothesized, HOOS subscales strongly correlated with corresponding OHS and SF-36 domains. All subscales showed excellent (effect size/standardized response means > 0.8) responsiveness between preoperative assessment and postoperative follow-up. The HOOS and all subdomains showed higher changes than the minimal detectable change which indicates true changes. The German version of the HOOS demonstrated good psychometric properties. It proved to be valid, reliable and responsive to the changes instrument for use in patients with hip osteoarthritis undergoing total hip replacement.

Reliability and responsiveness of the Self-Efficacy in Assessing, Training and Spotting wheelchair skills (SEATS) outcome measure.

PubMed

Rushton, Paula W; Smith, Emma M; Miller, William C; Kirby, R Lee; Daoust, Geneviève

2018-01-31

The aim of this study was to evaluate the internal consistency, test-retest reliability and responsiveness of the Self-Efficacy in Assessing, Training and Spotting manual wheelchair skills (SEATS-M) and Self-Efficacy in Assessing, Training and Spotting power wheelchair skills (SEATS-P). A 2-week test-retest design was used with a convenience sample of occupational and physical therapists who worked at a provincial rehabilitation centre (inpatient and outpatient services). Sixteen participants completed the SEATS-M and 18 participants completed the SEATS-P. For the SEATS-M assessment, training, spotting and documentation sections, Cronbach's alpha coefficients ranged from 0.90 to 0.97, the 2-week intraclass correlation coefficients (ICC 1,1 ) ranged from 0.81 to 0.95, the standard error of measurements (SEM) ranged from 5.06 to 8.70 and the smallest real differences (SRD) ranged from 6.24 to 8.18. For the SEATS-P assessment, training, spotting and documentation sections, Cronbach's alpha coefficients ranged from 0.83 to 0.92, the ICCs ranged from 0.72 to 0.86, the SEMs ranged from 4.54 to 8.91 and the SRDs ranged from 5.90 to 8.27. There is preliminary evidence that both the SEATS-M and the SEATS-P have high internal consistency, good test-retest reliability and support for responsiveness. These tools can be used in evaluating clinician self-efficacy with assessing, training, spotting and documenting wheelchair skills included on the Wheelchair Skills Test. Implications for Rehabilitation There is preliminary evidence that the SEATS-M and SEATS-P are reliable and responsive outcome measures that can be used to evaluate the self-efficacy of clinicians to administer the Wheelchair Skills Program. Measurement of clinicians' self-efficacy in this area of practice may enable an enhanced understanding of the areas in which clinicians lack self-efficacy, thereby informing the development of improved knowledge translation interventions.

The Validation of a Case-Based, Cumulative Assessment and Progressions Examination

PubMed Central

Coker, Adeola O.; Copeland, Jeffrey T.; Gottlieb, Helmut B.; Horlen, Cheryl; Smith, Helen E.; Urteaga, Elizabeth M.; Ramsinghani, Sushma; Zertuche, Alejandra; Maize, David

2016-01-01

Objective. To assess content and criterion validity, as well as reliability of an internally developed, case-based, cumulative, high-stakes third-year Annual Student Assessment and Progression Examination (P3 ASAP Exam). Methods. Content validity was assessed through the writing-reviewing process. Criterion validity was assessed by comparing student scores on the P3 ASAP Exam with the nationally validated Pharmacy Curriculum Outcomes Assessment (PCOA). Reliability was assessed with psychometric analysis comparing student performance over four years. Results. The P3 ASAP Exam showed content validity through representation of didactic courses and professional outcomes. Similar scores on the P3 ASAP Exam and PCOA with Pearson correlation coefficient established criterion validity. Consistent student performance using Kuder-Richardson coefficient (KR-20) since 2012 reflected reliability of the examination. Conclusion. Pharmacy schools can implement internally developed, high-stakes, cumulative progression examinations that are valid and reliable using a robust writing-reviewing process and psychometric analyses. PMID:26941435

Reliability and validation of the Dutch Achilles tendon Total Rupture Score.

PubMed

Opdam, K T M; Zwiers, R; Wiegerinck, J I; Kleipool, A E B; Haverlag, R; Goslings, J C; van Dijk, C N

2018-03-01

Patient-reported outcome measures (PROMs) have become a cornerstone for the evaluation of the effectiveness of treatment. The Achilles tendon Total Rupture Score (ATRS) is a PROM for outcome and assessment of an Achilles tendon rupture. The aim of this study was to translate the ATRS to Dutch and evaluate its reliability and validity in the Dutch population. A forward-backward translation procedure was performed according to the guidelines of cross-cultural adaptation process. The Dutch ATRS was evaluated for reliability and validity in patients treated for a total Achilles tendon rupture from 1 January 2012 to 31 December 2014 in one teaching hospital and one academic hospital. Reliability was assessed by the intraclass correlation coefficients (ICC), Cronbach's alpha and minimal detectable change (MDC). We assessed construct validity by calculation of Spearman's rho correlation coefficient with domains of the Foot and Ankle Outcome Score (FAOS), Victorian Institute of Sports Assessment-Achilles questionnaire (VISA-A) and Numeric Rating Scale (NRS) for pain in rest and during running. The Dutch ATRS had a good test-retest reliability (ICC = 0.852) and a high internal consistency (Cronbach's alpha = 0.96). MDC was 30.2 at individual level and 3.5 at group level. Construct validity was supported by 75 % of the hypothesized correlations. The Dutch ATRS had a strong correlation with NRS for pain during running (r = -0.746) and all the five subscales of the Dutch FAOS (r = 0.724-0.867). There was a moderate correlation with the VISA-A-NL (r = 0.691) and NRS for pain in rest (r = -0.580). The Dutch ATRS shows an adequate reliability and validity and can be used in the Dutch population for measuring the outcome of treatment of a total Achilles tendon rupture and for research purposes. Diagnostic study, Level I.

Photovoltaic Module Reliability Workshop 2011: February 16-17, 2011

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, S.

2013-11-01

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology--both critical goals for moving PV technologies deeper into the electricity marketplace.

Photovoltaic Module Reliability Workshop 2014: February 25-26, 2014

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, S.

2014-02-01

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology--both critical goals for moving PV technologies deeper into the electricity marketplace.

Photovoltaic Module Reliability Workshop 2013: February 26-27, 2013

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, S.

2013-10-01

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology--both critical goals for moving PV technologies deeper into the electricity marketplace.

Photovoltaic Module Reliability Workshop 2010: February 18-19, 2010

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, J.

2013-11-01

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology--both critical goals for moving PV technologies deeper into the electricity marketplace.

2016 NREL Photovoltaic Module Reliability Workshop

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, Sarah

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology - both critical goals for moving PV technologies deeper into the electricity marketplace.

2015 NREL Photovoltaic Module Reliability Workshops

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, Sarah

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology--both critical goals for moving PV technologies deeper into the electricity marketplace.

Intra-and inter-observer reliability of nailfold videocapillaroscopy - A possible outcome measure for systemic sclerosis-related microangiopathy.

PubMed

Dinsdale, Graham; Moore, Tonia; O'Leary, Neil; Tresadern, Philip; Berks, Michael; Roberts, Christopher; Manning, Joanne; Allen, John; Anderson, Marina; Cutolo, Maurizio; Hesselstrand, Roger; Howell, Kevin; Pizzorni, Carmen; Smith, Vanessa; Sulli, Alberto; Wildt, Marie; Taylor, Christopher; Murray, Andrea; Herrick, Ariane L

2017-07-01

Our aim was to assess the reliability of nailfold capillary assessment in terms of image evaluability, image severity grade ('normal', 'early', 'active', 'late'), capillary density, capillary (apex) width, and presence of giant capillaries, and also to gain further insight into differences in these parameters between patients with systemic sclerosis (SSc), patients with primary Raynaud's phenomenon (PRP) and healthy control subjects. Videocapillaroscopy images (magnification 300×) were acquired from all 10 digits from 173 participants: 101 patients with SSc, 22 with PRP and 50 healthy controls. Ten capillaroscopy experts from 7 European centres evaluated the images. Custom image mark-up software allowed extraction of the following outcome measures: overall grade ('normal', 'early', 'active', 'late', 'non-specific', or 'ungradeable'), capillary density (vessels/mm), mean vessel apical width, and presence of giant capillaries. Observers analysed a median of 129 images each. Evaluability (i.e. the availability of measures) varied across outcome measures (e.g. 73.0% for density and 46.2% for overall grade in patients with SSc). Intra-observer reliability for evaluability was consistently higher than inter- (e.g. for density, intra-class correlation coefficient [ICC] was 0.71 within and 0.14 between observers). Conditional on evaluability, both intra- and inter-observer reliability were high for grade (ICC 0.93 and 0.78 respectively), density (0.91 and 0.64) and width (0.91 and 0.85). Evaluability is one of the major challenges in assessing nailfold capillaries. However, when images are evaluable, the high intra- and inter-reliabilities suggest that overall image grade, capillary density and apex width have potential as outcome measures in longitudinal studies. Copyright © 2017 Elsevier Inc. All rights reserved.

[Interventions to improve the management of diabetes mellitus in primary health care and outpatient community settings].

PubMed

Hansen, Lars Jørgen; Drivsholm, Thomas B

2002-01-28

This review should be cited as: Renders CM, Valk GD, Griffin S. Wagner EH, Eijk JThM van, Assendelft WJJ. Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings (Cochrane Review). In: The Cochrane Library, Issue 2, 2001. Oxford: Update Software. A substantive amendment to this systematic review was last made on 29 June 2000. Cochrane reviews are regularly checked and updated if necessary. Diabetes is a common chronic disease that is increasingly managed in primary care. Different systems have been proposed to manage diabetes care. To assess the effects of different interventions, targeted at health professionals or the structure in which they deliver care, on the management of patients with diabetes in primary care, outpatient and community settings. We searched the Cochrane Effective Practice and Organisation of Care Group specialised register, the Cochrane Controlled Trials Register (Issue 4 1999), MEDLINE (1966-1999), EMBASE (1980-1999), Cinahl (1982-1999), and reference lists of articles. Randomised trials (RCTs), controlled clinical trials (CCTs), controlled before and after studies (CBAs) and interrupted time series (ITS) analyses of professional, financial and organisational strategies aimed at improving care for people with Type 1 or Type 2 diabetes. The participants were health care professionals, including physicians, nurses and pharmacists. The outcomes included objectively measured health professional performance or patient outcomes, and self-report measures with known validity and reliability. Two reviewers independently extracted data and assessed study quality. Forty-one studies were included involving more than 200 practices and 48,000 patients. Twenty-seven studies were RCTs, 12 were CBAs, and two were ITS. The studies were heterogeneous in terms of interventions, participants, settings and outcomes. The methodological quality of the studies was often poor. In all studies the intervention strategy was multifaceted. In 12 studies the interventions were targeted at health professionals, in nine they were targeted at the organization of care, and 20 studies targeted both. In 15 studies patient education was added to the professional and organisational interventions. A combination of professional interventions improved process outcomes. The effect on patient outcomes remained less clear as these were rarely assessed. Arrangements for follow-up (organisational intervention) also showed a favourable effect on process outcomes. Multiple interventions in which patient education was added or in which the role of the nurse was enhanced also reported favourable effects on patients' health outcomes. REVIEWERS' CONCLUSION: Multifaceted professional interventions can enhance the performance of health professionals in managing patients with diabetes. Organisational interventions that improve regular prompted recall and review of patients (central computerised tracking systems or nurses who regularly contact the patient) can also improve diabetes management. The addition of patient-oriented interventions can lead to improved patient health outcomes. Nurses can play an important role in patient-oriented interventions, through patient education or facilitating adherence to treatment.

Outside the Box: Will Information Technology Be a Viable Intervention to Improve the Quality of Cancer Care?

PubMed Central

Hanna, Christopher; Massett, Holly A.

2010-01-01

The use of health information technology (IT) to resolve the crisis in communication inherent within the fragmented service environment of medical care in the United States is a strategic priority for the Department of Health and Human Services. Yet the deployment of health IT alone is not sufficient to improve quality in health service delivery; what is needed is a human factors approach designed to optimize the balance between health-care users, health-care providers, policies, procedures, and technologies. An evaluation of interface issues between primary and specialist care related to cancer reveals opportunities for human factors improvement along the cancer care continuum. Applications that emphasize cognitive support for prevention recommendations and that encourage patient engagement can help create a coordinated health-care environment conducive to cancer prevention and early detection. An emphasis on reliability, transparency, and accountability can help improve the coordination of activities among multiple service providers during diagnosis and treatment. A switch in emphasis from a transaction-based approach to one emphasizing long-term support for healing relationships should help improve patient outcomes during cancer survivorship and end-of-life care. Across the entire continuum of care, an emphasis on “meaningful use” of health IT—rather than on IT as an endpoint—should help put cancer on a path toward substantive continuous quality improvement. The accompanying research questions will focus on reducing the variance between the social and technical subsystems as IT is used to improve patient outcomes across the interfaces of care. PMID:20386056

Normative Data for an Instrumental Assessment of the Upper-Limb Functionality.

PubMed

Caimmi, Marco; Guanziroli, Eleonora; Malosio, Matteo; Pedrocchi, Nicola; Vicentini, Federico; Molinari Tosatti, Lorenzo; Molteni, Franco

2015-01-01

Upper-limb movement analysis is important to monitor objectively rehabilitation interventions, contributing to improving the overall treatments outcomes. Simple, fast, easy-to-use, and applicable methods are required to allow routinely functional evaluation of patients with different pathologies and clinical conditions. This paper describes the Reaching and Hand-to-Mouth Evaluation Method, a fast procedure to assess the upper-limb motor control and functional ability, providing a set of normative data from 42 healthy subjects of different ages, evaluated for both the dominant and the nondominant limb motor performance. Sixteen of them were reevaluated after two weeks to perform test-retest reliability analysis. Data were clustered into three subgroups of different ages to test the method sensitivity to motor control differences. Experimental data show notable test-retest reliability in all tasks. Data from older and younger subjects show significant differences in the measures related to the ability for coordination thus showing the high sensitivity of the method to motor control differences. The presented method, provided with control data from healthy subjects, appears to be a suitable and reliable tool for the upper-limb functional assessment in the clinical environment.

Normative Data for an Instrumental Assessment of the Upper-Limb Functionality

PubMed Central

Caimmi, Marco; Guanziroli, Eleonora; Malosio, Matteo; Pedrocchi, Nicola; Vicentini, Federico; Molinari Tosatti, Lorenzo; Molteni, Franco

2015-01-01

Upper-limb movement analysis is important to monitor objectively rehabilitation interventions, contributing to improving the overall treatments outcomes. Simple, fast, easy-to-use, and applicable methods are required to allow routinely functional evaluation of patients with different pathologies and clinical conditions. This paper describes the Reaching and Hand-to-Mouth Evaluation Method, a fast procedure to assess the upper-limb motor control and functional ability, providing a set of normative data from 42 healthy subjects of different ages, evaluated for both the dominant and the nondominant limb motor performance. Sixteen of them were reevaluated after two weeks to perform test-retest reliability analysis. Data were clustered into three subgroups of different ages to test the method sensitivity to motor control differences. Experimental data show notable test-retest reliability in all tasks. Data from older and younger subjects show significant differences in the measures related to the ability for coordination thus showing the high sensitivity of the method to motor control differences. The presented method, provided with control data from healthy subjects, appears to be a suitable and reliable tool for the upper-limb functional assessment in the clinical environment. PMID:26539500

The Survey of Treatment Entry Pressures (STEP): identifying client's reasons for entering substance abuse treatment.

PubMed

Dugosh, Karen Leggett; Festinger, David S; Lynch, Kevin G; Marlowe, Douglas B

2014-10-01

Systematically identifying reasons that clients enter substance abuse treatment may allow clinicians to immediately focus on issues of greatest relevance to the individual and enhance treatment engagement. We developed the Survey of Treatment Entry Pressures (STEP) to identify the specific factors that precipitated an individual's treatment entry. The instrument contains 121 items from 6 psychosocial domains (i.e., family, financial, social, medical, psychiatric, legal). The current study examined the STEP's psychometric properties. A total of 761 participants from various treatment settings and modalities completed the STEP prior to treatment admission and 4-7 days later. Analyses were performed to examine the instrument's psychometric properties including item response rates, test-retest reliability, internal consistency, and factor structure. The items displayed adequate test-retest reliability and internal consistency within each psychosocial domain. Generally, results from exploratory and confirmatory factor analyses support a 2-factor structure reflecting type of reinforcement schedule. The study provides preliminary support for the psychometric properties of the STEP. The STEP may provide a reliable way for clinicians to characterize and capitalize on a client's treatment motivation early on which may serve to improve treatment retention and therapeutic outcomes. © 2014 Wiley Periodicals, Inc.

Experimental and numerical investigations on reliability of air barrier on oil containment in flowing water.

PubMed

Lu, Jinshu; Xu, Zhenfeng; Xu, Song; Xie, Sensen; Wu, Haoxiao; Yang, Zhenbo; Liu, Xueqiang

2015-06-15

Air barriers have been recently developed and employed as a new type of oil containment boom. This paper presents systematic investigations on the reliability of air barriers on oil containments with the involvement of flowing water, which represents the commonly-seen shearing current in reality, by using both laboratory experiments and numerical simulations. Both the numerical and experimental investigations are carried out in a model scale. In the investigations, a submerged pipe with apertures is installed near the bottom of a tank to generate the air bubbles forming the air curtain; and, the shearing water flow is introduced by a narrow inlet near the mean free surface. The effects of the aperture configurations (including the size and the spacing of the aperture) and the location of the pipe on the effectiveness of the air barrier on preventing oil spreading are discussed in details with consideration of different air discharges and velocities of the flowing water. The research outcome provides a foundation for evaluating and/or improve the reliability of a air barrier on preventing spilled oil from further spreading. Copyright © 2015 Elsevier Ltd. All rights reserved.

Blending forest fire smoke forecasts with observed data can improve their utility for public health applications

NASA Astrophysics Data System (ADS)

Yuchi, Weiran; Yao, Jiayun; McLean, Kathleen E.; Stull, Roland; Pavlovic, Radenko; Davignon, Didier; Moran, Michael D.; Henderson, Sarah B.

2016-11-01

Fine particulate matter (PM2.5) generated by forest fires has been associated with a wide range of adverse health outcomes, including exacerbation of respiratory diseases and increased risk of mortality. Due to the unpredictable nature of forest fires, it is challenging for public health authorities to reliably evaluate the magnitude and duration of potential exposures before they occur. Smoke forecasting tools are a promising development from the public health perspective, but their widespread adoption is limited by their inherent uncertainties. Observed measurements from air quality monitoring networks and remote sensing platforms are more reliable, but they are inherently retrospective. It would be ideal to reduce the uncertainty in smoke forecasts by integrating any available observations. This study takes spatially resolved PM2.5 estimates from an empirical model that integrates air quality measurements with satellite data, and averages them with PM2.5 predictions from two smoke forecasting systems. Two different indicators of population respiratory health are then used to evaluate whether the blending improved the utility of the smoke forecasts. Among a total of six models, including two single forecasts and four blended forecasts, the blended estimates always performed better than the forecast values alone. Integrating measured observations into smoke forecasts could improve public health preparedness for smoke events, which are becoming more frequent and intense as the climate changes.

A System for Integrated Reliability and Safety Analyses

NASA Technical Reports Server (NTRS)

Kostiuk, Peter; Shapiro, Gerald; Hanson, Dave; Kolitz, Stephan; Leong, Frank; Rosch, Gene; Coumeri, Marc; Scheidler, Peter, Jr.; Bonesteel, Charles

1999-01-01

We present an integrated reliability and aviation safety analysis tool. The reliability models for selected infrastructure components of the air traffic control system are described. The results of this model are used to evaluate the likelihood of seeing outcomes predicted by simulations with failures injected. We discuss the design of the simulation model, and the user interface to the integrated toolset.

Linguistic Changes in Expressive Writing Predict Psychological Outcomes in Women With History of Childhood Sexual Abuse and Adult Sexual Dysfunction

PubMed Central

Pulverman, Carey S.; Lorenz, Tierney A.; Meston, Cindy M.

2015-01-01

An expressive writing treatment was recently reported to reduce depressive symptoms and improve sexual function and satisfaction in a sample of female survivors of childhood sexual abuse (Meston, Lorenz, & Stephenson, 2013). We conducted a linguistic analysis of this data to determine whether pre-to posttreatment changes in participants’ language use were associated with the improvements in sexuality and depression. Linguistic Inquiry and Word Count (LIWC), a program that counts the use of word categories within a text, was used to evaluate the impact of several word categories, previously associated with changes in mental health (Frattaroli, 2006), and shown to differ between childhood sexual abuse survivors and nonabused women (Lorenz & Meston, 2012), on treatment outcomes. A reduction in the use of the word “I” and an increase in positive emotion words were associated with decreased depression symptoms. A reduction in the use of “I” and negative emotion words were associated with improvement in sexual function and sexual satisfaction. The findings suggest that, because language may serve as an implicit measure of depression and sexual health, monitoring language changes during treatment may provide a reliable indicator of treatment response free of the biases of traditional self-report assessments. PMID:25793593

Physical therapy in Huntington's disease--toward objective assessments?

PubMed

Bohlen, S; Ekwall, C; Hellström, K; Vesterlin, H; Björnefur, M; Wiklund, L; Reilmann, R

2013-02-01

Physical therapy is recommended for the treatment of Huntington's disease, but reliable studies investigating its efficacy are almost non-existent. This may in part be due to the lack of suitable outcome measures. Therefore, we investigated the applicability of novel quantitative and objective assessments of motor dysfunction in the evaluation of physical therapy interventions aimed at improving gait and posture. Twelve patients with Huntington disease received a predefined twice-weekly intervention focusing on posture and gait over 6 weeks. The GAITRite mat and a force plate were used for objective and quantitative assessments. The Unified Huntingtons Disease Rating Scale Total Motor Score, the timed Up &Go test, and the Berg Balance Scale were used as clinical outcome measures. Significant improvements were seen in GAITRite measures after therapy. Improvements were also seen in the Up & Go test and Berg Balance Scale, whereas force plate measures and Total Motor Scores did not change. The results suggest that physical therapy has a positive effect on gait in Huntington's disease. The study shows that objective and quantitative measures of gait and posture may serve as endpoints in trials assessing the efficacy of physical therapy. They should be explored further in larger trials applying a randomized controlled setting. © 2012 The Author(s) European Journal of Neurology © 2012 EFNS.

Interrater reliability of the international consensus definition of drug-resistant epilepsy: a pilot study.

PubMed

Hao, Xiao-ting; Wong, Irina S M; Kwan, Patrick

2011-10-01

We evaluated the interrater reliability of the consensus definition of drug-resistant epilepsy proposed by the International League Against Epilepsy. According to the definition framework, outcome of each antiepileptic drug (AED) trial was categorized as "seizure freedom" or "treatment failure." This level 1 assessment was used to determine the level 2 classification, which defined drug-resistant epilepsy as the failure of adequate trials of two or more AED schedules to achieve sustained seizure freedom. Two raters classified treatment outcomes of 150 patients independently. The patients had received a total of 428 trials of AEDs. Categorization of level 1 outcome to individual AED trials by the raters was consistent in 413 (96.5%). For the level 2 classification of drug-resistant or drug-responsive epilepsy, there was absolute agreement between the raters in 141 patients (94%), with a κ index of 0.91 (P<0.001). The definition appeared to have a high degree of interrater reliability in this setting. Copyright © 2011 Elsevier Inc. All rights reserved.

Assessing the impact of continuous quality improvement/total quality management: concept versus implementation.

PubMed Central

Shortell, S M; O'Brien, J L; Carman, J M; Foster, R W; Hughes, E F; Boerstler, H; O'Connor, E J

1995-01-01

OBJECTIVE: This study examines the relationships among organizational culture, quality improvement processes and selected outcomes for a sample of up to 61 U. S. hospitals. DATA SOURCES AND STUDY SETTING: Primary data were collected from 61 U. S. hospitals (located primarily in the midwest and the west) on measures related to continuous quality improvement/total quality management (CQI/TQM), organizational culture, implementation approaches, and degree of quality improvement implementation based on the Baldrige Award criteria. These data were combined with independently collected data on perceived impact and objective measures of clinical efficiency (i.e., charges and length of stay) for six clinical conditions. STUDY DESIGN: The study involved cross-sectional examination of the named relationships. DATA COLLECTION/EXTRACTION METHODS: Reliable and valid scales for the organizational culture and quality improvement implementation measures were developed based on responses from over 7,000 individuals across the 61 hospitals with an overall completion rate of 72 percent. Independent data on perceived impact were collected from a national survey and independent data on clinical efficiency from a companion study of managed care. PRINCIPAL FINDINGS: A participative, flexible, risk-taking organizational culture was significantly related to quality improvement implementation. Quality improvement implementation, in turn, was positively associated with greater perceived patient outcomes and human resource development. Larger-size hospitals experienced lower clinical efficiency with regard to higher charges and higher length of stay, due in part to having more bureaucratic and hierarchical cultures that serve as a barrier to quality improvement implementation. CONCLUSIONS: What really matters is whether or not a hospital has a culture that supports quality improvement work and an approach that encourages flexible implementation. Larger-size hospitals face more difficult challenges in this regard. PMID:7782222

Assessing the impact of continuous quality improvement/total quality management: concept versus implementation.

PubMed

Shortell, S M; O'Brien, J L; Carman, J M; Foster, R W; Hughes, E F; Boerstler, H; O'Connor, E J

1995-06-01

This study examines the relationships among organizational culture, quality improvement processes and selected outcomes for a sample of up to 61 U. S. hospitals. Primary data were collected from 61 U. S. hospitals (located primarily in the midwest and the west) on measures related to continuous quality improvement/total quality management (CQI/TQM), organizational culture, implementation approaches, and degree of quality improvement implementation based on the Baldrige Award criteria. These data were combined with independently collected data on perceived impact and objective measures of clinical efficiency (i.e., charges and length of stay) for six clinical conditions. The study involved cross-sectional examination of the named relationships. Reliable and valid scales for the organizational culture and quality improvement implementation measures were developed based on responses from over 7,000 individuals across the 61 hospitals with an overall completion rate of 72 percent. Independent data on perceived impact were collected from a national survey and independent data on clinical efficiency from a companion study of managed care. A participative, flexible, risk-taking organizational culture was significantly related to quality improvement implementation. Quality improvement implementation, in turn, was positively associated with greater perceived patient outcomes and human resource development. Larger-size hospitals experienced lower clinical efficiency with regard to higher charges and higher length of stay, due in part to having more bureaucratic and hierarchical cultures that serve as a barrier to quality improvement implementation. What really matters is whether or not a hospital has a culture that supports quality improvement work and an approach that encourages flexible implementation. Larger-size hospitals face more difficult challenges in this regard.

Does metacognitive strategy instruction improve impaired receptive cognitive-communication skills following acquired brain injury?

PubMed

Copley, Anna; Smith, Kathleen; Savill, Katelyn; Finch, Emma

2015-01-01

To investigate if metacognitive strategy instruction (MSI) improves the receptive language skills of adults with cognitive-communication disorders secondary to acquired brain injury (ABI). An ABA intervention programme was implemented with eight adults with ABI, aged 25-70 years. The Measure of Cognitive-Linguistic Abilities (MCLA) was administered at baseline and following treatment. The treatment employed in this study involved three components: individual goal-based therapy, group remediation therapy using self-instruction and home practice. No receptive language sub-tests of the MCLA reached statistical significance. However, participants' raw score improvements in receptive language sub-tests indicated that MSI may be effective at remediating CCDs following ABI. Preliminary findings indicate that MSI may be effective in improving receptive language skills in adults with CCDs following ABI. Further research involving a more rigorous study, a larger sample size and a more reliable outcome measure is necessary and may provide statistically significant evidence for the effectiveness of MSI for remediating receptive language disorders.

Mindfulness Meditation for Fibromyalgia: Mechanistic and Clinical Considerations.

PubMed

Adler-Neal, Adrienne L; Zeidan, Fadel

2017-09-01

Fibromyalgia is a disorder characterized by widespread pain and a spectrum of psychological comorbidities, rendering treatment difficult and often a financial burden. Fibromyalgia is a complicated chronic pain condition that requires a multimodal therapeutic approach to optimize treatment efficacy. Thus, it has been postulated that mind-body techniques may prove fruitful in treating fibromyalgia. Mindfulness meditation, a behavioral technique premised on non-reactive sensory awareness, attenuates pain and improves mental health outcomes. However, the impact of mindfulness meditation on fibromyalgia-related outcomes has not been comprehensively characterized. The present review delineates the existing evidence supporting the effectiveness and hypothesized mechanisms of mindfulness meditation in treating fibromyalgia-related outcomes. Mindfulness-based interventions premised on cultivating acceptance, non-attachment, and social engagement may be most effective in decreasing fibromyalgia-related pain and psychological symptoms. Mindfulness-based therapies may alleviate fibromyalgia-related outcomes through multiple neural, psychological, and physiological processes. Mindfulness meditation may provide an effective complementary treatment approach for fibromyalgia patients, especially when combined with other reliable techniques (exercise; cognitive behavioral therapy). However, characterizing the specific analgesic mechanisms supporting mindfulness meditation is a critical step to fostering the clinical validity of this technique. Identification of the specific analgesic mechanisms supporting mindfulness-based pain relief could be utilized to better design behavioral interventions to specifically target fibromyalgia-related outcomes.

Disorders of Sex Development (DSD): Networking and Standardization Considerations.

PubMed

Sandberg, D E; Callens, N; Wisniewski, A B

2015-05-01

Syndromes resulting in Disorders of Sex Development (DSD) are individually rare. Historically, this fact has hindered both clinical research and the delivery of evidence-based care. Recognizing the need for advancement, members of European and North American medical societies produced policy statements, notably the Consensus Statement on Management of Intersex Disorders, which recognize that optimal healthcare in DSD requires multidisciplinary teams in conjunction with networking of treatment centers and continued development of patient registries. This paper summarizes efforts in Europe and the U.S. toward creating networks focused on expanding discovery and improving healthcare and quality of life outcomes in DSD. The objectives and function of registry-based networks (EuroDSD/I-DSD), learning collaboratives (DSD-net), clinical outcomes research (DSD-Life), and networking hybrids (DSD-TRN) are reviewed. Opportunities for, and barriers to standardization in research and care are highlighted in light of practical considerations, for example, limitations in reliably classifying anatomic phenotypes and gaps in behavioral health staffing resources. The role of patient-reported outcomes is considered, with emphasis on integrating patient perspectives, given findings of limited agreement in outcome ratings by healthcare providers and patients. Finally, the characteristics of clinical centers likely to deliver the highest quality outcomes are discussed. © Georg Thieme Verlag KG Stuttgart · New York.

The prognostic reliability of intracranial pressure monitoring and MRI data in severe traumatic brain injury.

PubMed

Woischneck, Dieter; Kapapa, Thomas

2017-02-01

The predictive quality of intracranial pressure (ICP) monitoring has for many years been a matter of debate. We correlate ICP data comparing MRI data with the outcome after severe traumatic brain injury to evaluate their prognostic potency. This study compares the results of ICP monitoring, MRI, coma duration and outcome according to Glasgow Outcome Scale obtained in 32 patients having suffered severe TBI. Level of significance was set to p≤0.05 in statistical tests. The MRI results were closely correlated with coma duration and Glasgow Outcome Scale, but the ICP measurements were not. With the exception of severe, bipontine lesions, there is no other region of the brain in which increased evidence of traumatogenic lesions emerges as the intracranial pressure rises. Just bipontine lesions that proof to be infaust correlate with elevated ICP values. ICP monitoring does not allow individual prognostic conclusions to be made. Implantation of an intracranial pressure sensor alone for making a prognostic estimate is not advisable. The use of intracranial pressure measurements in the retrospective appraisal of disease progress is highly problematic. However, MRI diagnostic in patients with severe TBI improves prognostic potency of clinical parameters. Copyright © 2016 Elsevier Inc. All rights reserved.

Group power through the lens of the 21st century and beyond: further validation of the Sieloff-King Assessment of Group Power within Organizations.

PubMed

Sieloff, Christina L; Bularzik, Anne M

2011-11-01

The purpose was to determine the content validity of a semantic revision of items on a reliable and valid instrument, the Sieloff-King Assessment of Group Power within Organizations (SKAGPO). Research participants expressed negative perceptions regarding the use of the concept of 'power' in SKAGPO items. The SKAGPO is the only instrument measuring a nursing group's power or outcome attainment. Using a survey method, the instrument and grading scale were sent to 12 expert judges. Six participants completed the grading scale. The Content Validity Index (CVI) for seven questions was at or above 83% agreement. Overall, the CVI for the eight revised questions was 93.75%. Subsequently, the instrument was renamed the Sieloff-King Assessment of Group Outcome Attainment within Organizations (SKAGOAO). The semantic revision demonstrated content validity for the revised SKAGOAO. When used by nursing groups to assess their level of outcome attainment, the instrument should continue to be psychometrically evaluated. A nursing group of any size can use the SKAGOAO to both assess the group's level of outcome attainment or empowerment and direct plans to further improve that level. © 2011 Blackwell Publishing Ltd.

Photovoltaic Module Reliability Workshop 2012: February 28 - March 1, 2012

DOE Office of Scientific and Technical Information (OSTI.GOV)

Kurtz, S.

2013-11-01

NREL's Photovoltaic (PV) Module Reliability Workshop (PVMRW) brings together PV reliability experts to share information, leading to the improvement of PV module reliability. Such improvement reduces the cost of solar electricity and promotes investor confidence in the technology--both critical goals for moving PV technologies deeper into the electricity marketplace.

The reliability and predictive value of an amniotic fluid scoring system in severe second-trimester oligohydramnios.

PubMed

Moore, T R; Longo, J; Leopold, G R; Casola, G; Gosink, B B

1989-05-01

Sixty-two cases of oligohydramnios diagnosed by ultrasound between 13-28 weeks' gestation were reviewed. Three experienced ultrasonographers used a subjective scale to rate the oligohydramnios as mild, moderate, severe, or anhydramniotic. Interobserver reliability was excellent (intraclass correlation coefficient 0.81). The overall perinatal mortality rate was 43%, and the incidence of pulmonary hypoplasia was 33%. One-third had lethal congenital anomalies. The frequency of adverse outcome correlated strongly with the most severe degrees of oligohydramnios; 88% of the fetuses with severe oligohydramnios or anhydramnios had lethal outcomes, compared with 11% in the mild/moderate group. The presence of an anuric urinary tract anomaly was associated with the most severe grades of oligohydramnios and was uniformly fatal. Pulmonary hypoplasia was diagnosed in 60% of the severe group versus 6% in the moderate group. We conclude that subjective grading of oligohydramnios by experienced observers is both reliable and predictive of outcome. The finding of severe oligohydramnios in the second trimester is highly predictive of poor fetal outcome and should stimulate a thorough search for etiology and consideration of intervention. Moderate grades of reduced amniotic fluid may be managed with relative optimism.

A systematic review of the passive straight leg raising test as a diagnostic aid for low back pain (1989 to 2000).

PubMed

Rebain, Richard; Baxter, G David; McDonough, Suzanne

2002-09-01

A systematic review. This systematic review sought papers (January 1989-January 2000) on the passive straight leg raising test (PSLR) as a diagnostic component for low back pain (LBP) to identify, summarize, and assess developments in the test procedure, the factors influencing PSLR outcome, and the clinical significance of that outcome. Previous studies suggested that the PSLR tractioned the sciatic nerve and that diminished leg elevation with reproduced pain indicated low lumbar intervertebral disc pathology. Searches on six computerized bibliographic databases identified publications written about the PSLR. Papers were excluded if they were published before January 1989, were non-English language papers, or employed either an active SLR or a PSLR for purposes other than LBP diagnosis. The references of qualifying papers (and the references of references) were searched. Contact with primary authors, and others known to be active in this field, was attempted. The PSLR procedure remains unchanged. The influence of hip rotation during the PSLR was discussed without consensus. Biomechanical devices improved intra- and interobserver reliability and so increased test reproducibility. Hamstrings were found to have a defensive role in protecting nerve roots by limiting PSLR range in cases of nerve root inflammation. A small diurnal variation in the PSLR may imply a poorer prognosis. A positive PSLR at 4 months after lumbar intervertebral disc surgery predicted poor reoperative outcome, and a negative 4-month PSLR predicted excellent outcome. The influence of psychosocial factors was not discussed, neither was the diagnostic significance of a negative PSLR outcome. There remains no standard PSLR procedure, no consensus on interpretation of results, and little recognition that a negative PSLR test outcome may be of greater diagnostic value than a positive one. The causal link between LBP pathology and hamstring action remains unclear. There is a need for research into the clinical use of the PSLR; its intra- and interobserver reliability; the influences of age, gender, diurnal variation, and psychosocial factors; and its predictive value in lumbar intervertebral disc surgery.

A telephone questionnaire in order to assess functional outcome after post-traumatic limb salvage surgery: Development and preliminary validation.

PubMed

Wulterkens, Leonie; Aurégan, Jean-Charles; Letellier, Thomas; Mebtouche, Nasser; Levante, Stéphane; Cottin, Philippe; Bégué, Thierry

2015-12-01

Post-traumatic limb salvage surgery is challenging and evaluation of the results remains arduous. No questionnaire specifically assessing functional outcome after post-traumatic limb salvage surgery of the lower extremity exists. Due to regionalization of specialized care, the patients' travel time to the hospital increases. To overcome a higher patients' travel burden, patients' follow up by telephone is an option. We aimed to develop a telephone questionnaire in order to assess functional outcome after post-traumatic limb salvage surgery of the lower extremity. From a review of scores of functional assessment of the lower limb surgery, we have developed a telephone questionnaire. A prospective study was performed to validate this telephone questionnaire. Twenty patients were included. The participants were called to complete the telephone questionnaire twice with an interval of a week. The Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) was completed during the second telephone call. The internal consistency was analyzed by the Cronbach's alpha (α). With the outcome scores of both completions, the test-retest reliability was analyzed by the interclass correlation coefficient (ICC) 2,k with a 95% confidence interval (95% CI). The outcome scores of the second telephone questionnaire and the WOMAC questionnaire were used for the construct validity analysis by the Spearman's rank correlation coefficient (r(s)) with a 95% CI. The internal consistency analysis revealed a α=0.62 which improved to α=0.92 after removing one question from the telephone questionnaire. The final version of the telephone questionnaire comprises 32 questions, divided in 3 subscales: function, daily life and psychology. The total score varies between 0 and 86 points. The test-retest reliability was ICC 2,k=0.93 (95% CI: 0.82-0.97) and the construct validity was r(s)=0.92 (95% CI: 0.81-0.97). We present a specific telephone questionnaire in order to assess functional outcomes after posttraumatic limb salvage surgery of the lower extremity. Further research on a large number of patients will be necessary to validate this newly developed questionnaire. Copyright © 2015 Elsevier Ltd. All rights reserved.

Derivation, Validation and Application of a Pragmatic Risk Prediction Index for Benchmarking of Surgical Outcomes.

PubMed

Spence, Richard T; Chang, David C; Kaafarani, Haytham M A; Panieri, Eugenio; Anderson, Geoffrey A; Hutter, Matthew M

2018-02-01

Despite the existence of multiple validated risk assessment and quality benchmarking tools in surgery, their utility outside of high-income countries is limited. We sought to derive, validate and apply a scoring system that is both (1) feasible, and (2) reliably predicts mortality in a middle-income country (MIC) context. A 5-step methodology was used: (1) development of a de novo surgical outcomes database modeled around the American College of Surgeons' National Surgical Quality Improvement Program (ACS-NSQIP) in South Africa (SA dataset), (2) use of the resultant data to identify all predictors of in-hospital death with more than 90% capture indicating feasibility of collection, (3) use these predictors to derive and validate an integer-based score that reliably predicts in-hospital death in the 2012 ACS-NSQIP, (4) apply the score in the original SA dataset and demonstrate its performance, (5) identify threshold cutoffs of the score to prompt action and drive quality improvement. Following step one-three above, the 13 point Codman's score was derived and validated on 211,737 and 109,079 patients, respectively, and includes: age 65 (1), partially or completely dependent functional status (1), preoperative transfusions ≥4 units (1), emergency operation (2), sepsis or septic shock (2) American Society of Anesthesia score ≥3 (3) and operative procedure (1-3). Application of the score to 373 patients in the SA dataset showed good discrimination and calibration to predict an in-hospital death. A Codman Score of 8 is an optimal cutoff point for defining expected and unexpected deaths. We have designed a novel risk prediction score specific for a MIC context. The Codman Score can prove useful for both (1) preoperative decision-making and (2) benchmarking the quality of surgical care in MIC's.

Developing a Cognitive and Communications Tool for Burn Intensive Care Unit Clinicians.

PubMed

Nemeth, Christopher; Anders, Shilo; Strouse, Robert; Grome, Anna; Crandall, Beth; Pamplin, Jeremy; Salinas, Jose; Mann-Salinas, Elizabeth

2016-05-01

Burn Intensive Care Unit (BICU) work is necessarily complex and depends on clinician actions, resources, and variable patient responses to interventions. Clinicians use large volumes of data that are condensed in time, but separated across resources, to care for patients. Correctly designed health information technology (IT) systems may help clinicians to treat these patients more efficiently, accurately, and reliably. We report on a 3-year project to design and develop an ecologically valid IT system for use in a military BICU. We use a mixed methods Cognitive Systems Engineering approach for research and development. Observations, interviews, artifact analysis, survey, and thematic analysis methods were used to reveal underlying factors that mold the work environment and affect clinician decisions that may affect patient outcomes. Participatory design and prototyping methods have been used to develop solutions. We developed 39 requirements for the IT system and used them to create three use cases to help developers better understand how the system might support clinician work to develop interface prototypes. We also incorporated data mining functions that offer the potential to aid clinicians by recognizing patterns recognition of clinically significant events, such as incipient sepsis. The gaps between information sources and accurate, reliable, and efficient clinical decision that we have identified will enable us to create scenarios to evaluate prototype systems with BICU clinicians, to develop increasingly improved designs, and to measure outcomes. The link from data to analyses, requirements, prototypes, and their evaluation ensures that the solution will reflect and support work in the BICU as it actually occurs, improving staff efficiency and patient care quality. Reprint & Copyright © 2016 Association of Military Surgeons of the U.S.

An evaluation of the effectiveness of psychological therapy in reducing general psychological distress for adults with autism spectrum conditions and comorbid mental health problems.

PubMed

Blainey, Sarah H; Rumball, Freya; Mercer, Louise; Evans, Lauren Jayne; Beck, Alison

2017-11-01

To investigate the effectiveness of psychological therapy in reducing psychological distress for adults with autism spectrum conditions (ASC) and co-morbid mental health conditions in routine clinical practice. To explore the effect of individual characteristics and service factors on change in general distress. In a specialist psychological therapies service for adults with ASC, the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) self-report questionnaire of psychological distress is completed by clients at start and end of therapy. Change over time and reliable and clinical change was assessed for 81 of a total of 122 clients (66.4%). Factors which may influence change over time were explored using available clinical information. Overall, there was a significant reduction in CORE-OM score during therapy with a small effect size. Most clients showed an improvement in psychological distress over therapy (75.4% improved, with 36.9% of these showing reliable changes). Significant and comparable reductions from pre-therapy to post-therapy were seen across the sample, showing that individual differences did not mediate therapy effectiveness. CORE-OM scores mediate the association between age of ASD diagnosis and hours of therapeutic input required, with greater age at diagnosis and higher distress associated with longer therapy duration. Our preliminary findings suggest that psychological therapy may be effective in reducing general distress for clients with ASC and co-morbid mental health conditions and should be routinely offered. Individuals who are diagnosed with ASD in adulthood are likely to require a longer course of therapy when their general distress scores are high. Copyright © 2017 John Wiley & Sons, Ltd.

The development and validation of the Physical Appearance Comparison Scale-3 (PACS-3).

PubMed

Schaefer, Lauren M; Thompson, J Kevin

2018-05-21

Appearance comparison processes are implicated in the development of body-image disturbance and disordered eating. The Physical Appearance Comparison Scale-Revised (PACS-R) assesses the simple frequency of appearance comparisons; however, research has suggested that other aspects of appearance comparisons (e.g., comparison direction) may moderate the association between comparisons and their negative outcomes. In the current study, the PACS-R was revised to examine aspects of comparisons with relevance to body-image and eating outcomes. Specifically, the measure was modified to examine (a) dimensions of physical appearance relevant to men and women (i.e., weight-shape, muscularity, and overall physical appearance), (b) comparisons with proximal and distal targets, (c) upward versus downward comparisons, and (d) the acute emotional impact of comparisons. The newly revised measure, labeled the PACS-3, along with existing measures of appearance comparison, body satisfaction, eating pathology, and self-esteem, was completed by 1,533 college men and women. Exploratory and confirmatory factor analyses were conducted to examine the factor structure of the PACS-3. In addition, the reliability, convergent validity, and incremental validity of the PACS-3 scores were examined. The final PACS-3 comprises 27 items and 9 subscales: Proximal: Frequency, Distal: Frequency, Muscular: Frequency, Proximal: Direction, Distal: Direction, Muscular: Direction, Proximal: Effect, Distal: Effect, and Muscular: Effect. the PACS-3 subscale scores demonstrated good reliability and convergent validity. Moreover, the PACS-3 subscales greatly improved the prediction of body satisfaction and disordered eating relative to existing measures of appearance comparison. Overall, the PACS-3 improves upon existing scales and offers a comprehensive assessment of appearance-comparison processes. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Combining satellite imagery and machine learning to predict poverty.

PubMed

Jean, Neal; Burke, Marshall; Xie, Michael; Davis, W Matthew; Lobell, David B; Ermon, Stefano

2016-08-19

Reliable data on economic livelihoods remain scarce in the developing world, hampering efforts to study these outcomes and to design policies that improve them. Here we demonstrate an accurate, inexpensive, and scalable method for estimating consumption expenditure and asset wealth from high-resolution satellite imagery. Using survey and satellite data from five African countries--Nigeria, Tanzania, Uganda, Malawi, and Rwanda--we show how a convolutional neural network can be trained to identify image features that can explain up to 75% of the variation in local-level economic outcomes. Our method, which requires only publicly available data, could transform efforts to track and target poverty in developing countries. It also demonstrates how powerful machine learning techniques can be applied in a setting with limited training data, suggesting broad potential application across many scientific domains. Copyright © 2016, American Association for the Advancement of Science.

Fear-relevant illusory correlations in different fears and anxiety disorders: A review of the literature.

PubMed

Wiemer, Julian; Pauli, Paul

2016-08-01

Fearful individuals often overestimate the relationship between fear-relevant stimuli and aversive consequences. Such fear-relevant illusory correlations (ICs) might be involved in the maintenance of anxiety disorders. In this literature review, we found clear evidence that ICs are present and enhanced in fear of animals. We also revealed some evidence for ICs related to fear of flying, social anxiety, contamination fear, panic disorder, and post-traumatic stress disorder, but with considerably less clarity. Fear-relevant ICs seem to be best explained by both a priori expectancies and biased encoding of the experienced associations. Studies to date suggest that one important biased encoding process is the enhanced aversiveness/salience of fear-relevant outcomes. Future studies may improve insight by developing more reliable IC measures and testing the effect of encoding processes on treatment outcomes. Copyright © 2016 Elsevier Ltd. All rights reserved.

Portfolio as a tool to evaluate clinical competences of traumatology in medical students

PubMed Central

Santonja-Medina, Fernando; García-Sanz, M Paz; Martínez-Martínez, Francisco; Bó, David; García-Estañ, Joaquín

2016-01-01

This article investigates whether a reflexive portfolio is instrumental in determining the level of acquisition of clinical competences in traumatology, a subject in the 5th year of the degree of medicine. A total of 131 students used the portfolio during their clinical rotation of traumatology. The students’ portfolios were blind evaluated by four professors who annotated the existence (yes/no) of 23 learning outcomes. The reliability of the portfolio was moderate, according to the kappa index (0.48), but the evaluation scores between evaluators were very similar. Considering the mean percentage, 59.8% of the students obtained all the competences established and only 13 of the 23 learning outcomes (56.5%) were fulfilled by >50% of the students. Our study suggests that the portfolio may be an important tool to quantitatively analyze the acquisition of traumatology competences of medical students, thus allowing the implementation of methods to improve its teaching. PMID:26929675

EEG as an Indicator of Cerebral Functioning in Postanoxic Coma.

PubMed

Juan, Elsa; Kaplan, Peter W; Oddo, Mauro; Rossetti, Andrea O

2015-12-01

Postanoxic coma after cardiac arrest is one of the most serious acute cerebral conditions and a frequent cause of admission to critical care units. Given substantial improvement of outcome over the recent years, a reliable and timely assessment of clinical evolution and prognosis is essential in this context, but may be challenging. In addition to the classic neurologic examination, EEG is increasingly emerging as an important tool to assess cerebral functions noninvasively. Although targeted temperature management and related sedation may delay clinical assessment, EEG provides accurate prognostic information in the early phase of coma. Here, the most frequently encountered EEG patterns in postanoxic coma are summarized and their relations with outcome prediction are discussed. This article also addresses the influence of targeted temperature management on brain signals and the implication of the evolution of EEG patterns over time. Finally, the article ends with a view of the future prospects for EEG in postanoxic management and prognostication.

Using food-web theory to conserve ecosystems

PubMed Central

McDonald-Madden, E.; Sabbadin, R.; Game, E. T.; Baxter, P. W. J.; Chadès, I.; Possingham, H. P.

2016-01-01

Food-web theory can be a powerful guide to the management of complex ecosystems. However, we show that indices of species importance common in food-web and network theory can be a poor guide to ecosystem management, resulting in significantly more extinctions than necessary. We use Bayesian Networks and Constrained Combinatorial Optimization to find optimal management strategies for a wide range of real and hypothetical food webs. This Artificial Intelligence approach provides the ability to test the performance of any index for prioritizing species management in a network. While no single network theory index provides an appropriate guide to management for all food webs, a modified version of the Google PageRank algorithm reliably minimizes the chance and severity of negative outcomes. Our analysis shows that by prioritizing ecosystem management based on the network-wide impact of species protection rather than species loss, we can substantially improve conservation outcomes. PMID:26776253

Portfolio as a tool to evaluate clinical competences of traumatology in medical students.

PubMed

Santonja-Medina, Fernando; García-Sanz, M Paz; Martínez-Martínez, Francisco; Bó, David; García-Estañ, Joaquín

2016-01-01

This article investigates whether a reflexive portfolio is instrumental in determining the level of acquisition of clinical competences in traumatology, a subject in the 5th year of the degree of medicine. A total of 131 students used the portfolio during their clinical rotation of traumatology. The students' portfolios were blind evaluated by four professors who annotated the existence (yes/no) of 23 learning outcomes. The reliability of the portfolio was moderate, according to the kappa index (0.48), but the evaluation scores between evaluators were very similar. Considering the mean percentage, 59.8% of the students obtained all the competences established and only 13 of the 23 learning outcomes (56.5%) were fulfilled by >50% of the students. Our study suggests that the portfolio may be an important tool to quantitatively analyze the acquisition of traumatology competences of medical students, thus allowing the implementation of methods to improve its teaching.

Interventions for Hip Pain in the Maturing Athlete

PubMed Central

Gomberawalla, M. Mustafa; Kelly, Bryan T.; Bedi, Asheesh

2014-01-01

Context: Femoroacetabular impingement (FAI) alters hip mechanics, results in hip pain, and may lead to secondary osteoarthritis (OA) in the maturing athlete. Hip impingement can be caused by osseous abnormalities in the proximal femur or acetabulum. These impingement lesions may cause altered loads within the hip joint, which result in repetitive collision damage or sheer forces to the chondral surfaces and acetabular labrum. These anatomic lesions and resultant abnormal mechanics may lead to early osteoarthritic changes. Evidence Acquisition: Relevant articles from the years 1995 to 2013 were identified using MEDLINE, EMBASE, and the bibliographies of reviewed publications. Level of Evidence: Level 4. Results: Improvements in hip arthroscopy have allowed FAI to be addressed utilizing the arthroscope. Adequately resecting the underlying osseous abnormalities is essential to improving hip symptomatology and preventing further chondral damage. Additionally, preserving the labrum by repairing the damaged tissue and restoring the suction seal may theoretically help normalize hip mechanics and prevent further arthritic changes. The outcomes of joint-preserving treatment options may be varied in the maturing athlete due to the degree of underlying OA. Irreversible damage to the hip joint may have already occurred in patients with moderate to advanced OA. In the presence of preexisting arthritis, these patients may only experience fair or even poor results after hip arthroscopy, with early conversion to hip replacement. For patients with advanced hip arthritis, total hip arthroplasty remains a treatment option to reliably improve symptoms with good to excellent outcomes and return to low-impact activities. Conclusion: Advances in the knowledge base and treatment techniques of intra-articular hip pain have allowed surgeons to address this complex clinical problem with promising outcomes. Traditionally, open surgical dislocations for hip preservation surgery have shown good long-term results. Improvements in hip arthroscopy have led to outcomes equivalent to open surgery while utilizing significantly less invasive techniques. However, outcomes may ultimately depend on the degree of underlying OA. When counseling the mature athlete with hip pain, an understanding of the underlying anatomy, degree of arthritis, and expectations will help guide the treating surgeon in offering appropriate treatment options. PMID:24427445

Disease-specific quality of life after septoplasty and bilateral inferior turbinate outfracture in patients with nasal obstruction.

PubMed

Resende, Lucas; Carmo, Carolina do; Mocellin, Leão; Pasinato, Rogério; Mocellin, Marcos

2017-07-29

Septal deviations might cause nasal obstruction and negative impact on the quality of life of individuals. The efficacy of septoplasty for treatment of septal deviation and the predictors of satisfactory surgical outcomes remain controversial. Technical variability, heterogeneity of research samples and absence of a solid tool for clinical evaluation are the main hindrances to the establishment of reliable statistical data regarding the procedure. To evaluate the clinical improvements in the disease-specific quality-of-life between patients submitted to septoplasty with bilateral outfracture of the inferior turbinate under sedation and local anesthesia in a tertiary hospital and to assess possible clinical-epidemiological variables associated with functional outcome. Fifty-two patients consecutively submitted to septoplasty with bilateral outfracture of the inferior turbinate for treatment of nasal obstruction filled in forms regarding clinical and epidemiological information during enrollment and had their symptom objectively quantified using the Nose Obstruction Symptom Evaluation (NOSE) scale preoperatively and one and three months after the procedure. Statistical analysis aimed to determine overall and stratified surgical outcomes and to investigate correlations between the clinical-epidemiological variables with the scores obtained. Statistically significant improvement in the preoperative NOSE questionnaire compared to the scores obtained three months after surgery was demonstrated (p<0.001, T-Wilcoxon), with strong correlation between the preoperative score and the postoperative improvement during this period (r=-0.614, p<0.001, Spearman). After one month, patients reached in average 87.15% of the result obtained at the study termination. Smokers and patients with rhinitis and/or pulmonary comorbidity showed increased average preoperative NOSE scores, although without statistical significance (p>0.05). Gender, age, history of rhinitis and presence of pulmonary comorbidity did not influence significantly surgical outcomes (p>0.05). Smokers presented greater reduction in NOSE scores during the study (p=0.043, U-Mann-Whitney). Septoplasty with bilateral outfracture of the inferior turbinate has proven to significantly improve disease-specific quality-of-life and this favorable outcome seems to occur precociously. Copyright © 2017 Associação Brasileira de Otorrinolaringologia e Cirurgia Cérvico-Facial. Published by Elsevier Editora Ltda. All rights reserved.

Strategy for continuous improvement in IC manufacturability, yield, and reliability

NASA Astrophysics Data System (ADS)

Dreier, Dean J.; Berry, Mark; Schani, Phil; Phillips, Michael; Steinberg, Joe; DePinto, Gary

1993-01-01

Continual improvements in yield, reliability and manufacturability measure a fab and ultimately result in Total Customer Satisfaction. A new organizational and technical methodology for continuous defect reduction has been established in a formal feedback loop, which relies on yield and reliability, failed bit map analysis, analytical tools, inline monitoring, cross functional teams and a defect engineering group. The strategy requires the fastest detection, identification and implementation of possible corrective actions. Feedback cycle time is minimized at all points to improve yield and reliability and reduce costs, essential for competitiveness in the memory business. Payoff was a 9.4X reduction in defectivity and a 6.2X improvement in reliability of 256 K fast SRAMs over 20 months.

[Reliability of nursing outcomes classification label "Knowledge: cardiac disease management (1830)" in outpatients with heart failure].

PubMed

Cañón-Montañez, Wilson; Oróstegui-Arenas, Myriam

2015-01-01

To determine the reliability (internal consistency, inter-rater reproducibility and level of agreement) of nursing outcome: "Knowledge: cardiac disease management (1830)" of the version published in Spanish, in outpatients with heart failure. A reliability study was conducted on 116 outpatients with heart failure. Six indicators of nursing outcome were operationalized. All participants were assessed simultaneously by two evaluators. Three evaluation periods were defined: initial (at baseline), final (a month later), and follow-up (two months later). Internal consistency by Cronbach alpha coefficient, inter-rater reproducibility with intraclass correlation coefficient of reproducibility or agreement and level agreement using the 95% limits of Bland and Altman. Cronbach's alpha was 0.83 (95% CI: 0.77 - 0.89) in the final evaluation, and follow-up values of 0.85 (95% CI: 0.82-0.89) and 0.83 (95% CI: 0.78 - 0.88) were found for the first and second evaluator, respectively. The intraclass correlation coefficient showed values greater 0.9 in the three evaluation periods in both the random and mixed model. The Bland-Altman 95% limits of agreement were close to zero in the three evaluations performed. The questionnaire operationalized to assess the nursing outcome: "Knowledge: cardiac disease management (1830)" in its Spanish version, is a reliable method to measure skills and knowledge in outpatients with heart failure in the Colombian context. Copyright © 2015 Elsevier España, S.L.U. All rights reserved.

Confidence in outcome estimates from systematic reviews used in informed consent.

PubMed

Fritz, Robert; Bauer, Janet G; Spackman, Sue S; Bains, Amanjyot K; Jetton-Rangel, Jeanette

2016-12-01

Evidence-based dentistry now guides informed consent in which clinicians are obliged to provide patients with the most current, best evidence, or best estimates of outcomes, of regimens, therapies, treatments, procedures, materials, and equipment or devices when developing personal oral health care, treatment plans. Yet, clinicians require that the estimates provided from systematic reviews be verified to their validity, reliability, and contextualized as to performance competency so that clinicians may have confidence in explaining outcomes to patients in clinical practice. The purpose of this paper was to describe types of informed estimates from which clinicians may have confidence in their capacity to assist patients in competent decision-making, one of the most important concepts of informed consent. Using systematic review methodology, researchers provide clinicians with valid best estimates of outcomes regarding a subject of interest from best evidence. Best evidence is verified through critical appraisals using acceptable sampling methodology either by scoring instruments (Timmer analysis) or checklist (grade), a Cochrane Collaboration standard that allows transparency in open reviews. These valid best estimates are then tested for reliability using large databases. Finally, valid and reliable best estimates are assessed for meaning using quantification of margins and uncertainties. Through manufacturer and researcher specifications, quantification of margins and uncertainties develops a performance competency continuum by which valid, reliable best estimates may be contextualized for their performance competency: at a lowest margin performance competency (structural failure), high margin performance competency (estimated true value of success), or clinically determined critical values (clinical failure). Informed consent may be achieved when clinicians are confident of their ability to provide useful and accurate best estimates of outcomes regarding regimens, therapies, treatments, and equipment or devices to patients in their clinical practices and when developing personal, oral health care, treatment plans. Copyright © 2016 Elsevier Inc. All rights reserved.

Reliability and reproducibility of several methods of arthroscopic assessment of femoral tunnel position during anterior cruciate ligament reconstruction.

PubMed

Ilahi, Omer A; Mansfield, David J; Urrea, Luis H; Qadeer, Ali A

2014-10-01

To assess interobserver and intraobserver agreement of estimating anterior cruciate ligament (ACL) femoral tunnel positioning arthroscopically using circular and linear (noncircular) estimation methods and to determine whether overlay template visual aids improve agreement. Standardized intraoperative pictures of femoral tunnel pilot holes (taken with a 30° arthroscope through an anterolateral portal at 90° of knee flexion with horizontal being parallel to the tibial surface) in 27 patients undergoing single-bundle ACL reconstruction were presented to 3 fellowship-trained arthroscopists on 2 separate occasions. On both viewings, each surgeon estimated the femoral tunnel pilot hole location to the nearest half-hour mark using a whole clock face and half clock face, to the nearest 15° using a whole compass and half compass, in the top or bottom half of a linear quadrant, and in the top or bottom half of a linear trisector. Evaluations were performed first without and then with an overlay template of each estimation method. The average difference among reviewers was quite similar for all 4 circular methods with the use of visual aids. Without overlay template visual aids, pair-wise κ statistic values for interobserver agreement ranged from -0.14 to 0.56 for the whole clock face and from 0.16 to 0.42 for the half clock face. With overlay visual guides, interobserver agreement ranged from 0.29 to 0.63 for the whole clock face and from 0.17 to 0.66 for the half clock face. The quadrant method's interobserver agreement ranged from 0.22 to 0.60, and that of the trisection method ranged from 0.17 to 0.57. Neither linear estimation method's reliability uniformly improved with the use of overlay templates. Intraobserver agreement without overlay templates ranged from 0.17 to 0.49 for the whole clock face, 0.11 to 0.47 for the half clock face, 0.01 to 0.66 for the quadrant method, and 0.20 to 0.57 for the trisection method. Use of overlay templates did not uniformly improve intraobserver agreement for any estimation method. There does not appear to be any advantage of using a half clock face or compass for estimating femoral tunnel position compared with a whole clock-face analogy. Visual reference aids appear to improve interobserver agreement (reliability) of circular analogies. The linear quadrant appears to be the most reliable method (fair to moderate agreement) for estimating femoral tunnel position without a visual aid for reference, but even better reliability, ranging from fair to good agreement, may be obtained by using the whole clock-face analogy with a visual aid. Increasing femoral tunnel position reliability may improve outcomes of ACL reconstruction surgery. Copyright © 2014 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Reliability of a Computerized Neurocognitive Test in Baseline Concussion Testing of High School Athletes.

PubMed

MacDonald, James; Duerson, Drew

2015-07-01

Baseline assessments using computerized neurocognitive tests are frequently used in the management of sport-related concussions. Such testing is often done on an annual basis in a community setting. Reliability is a fundamental test characteristic that should be established for such tests. Our study examined the test-retest reliability of a computerized neurocognitive test in high school athletes over 1 year. Repeated measures design. Two American high schools. High school athletes (N = 117) participating in American football or soccer during the 2011-2012 and 2012-2013 academic years. All study participants completed 2 baseline computerized neurocognitive tests taken 1 year apart at their respective schools. The test measures performance on 4 cognitive tasks: identification speed (Attention), detection speed (Processing Speed), one card learning accuracy (Learning), and one back speed (Working Memory). Reliability was assessed by measuring the intraclass correlation coefficient (ICC) between the repeated measures of the 4 cognitive tasks. Pearson and Spearman correlation coefficients were calculated as a secondary outcome measure. The measure for identification speed performed best (ICC = 0.672; 95% confidence interval, 0.559-0.760) and the measure for one card learning accuracy performed worst (ICC = 0.401; 95% confidence interval, 0.237-0.542). All tests had marginal or low reliability. In a population of high school athletes, computerized neurocognitive testing performed in a community setting demonstrated low to marginal test-retest reliability on baseline assessments 1 year apart. Further investigation should focus on (1) improving the reliability of individual tasks tested, (2) controlling for external factors that might affect test performance, and (3) identifying the ideal time interval to repeat baseline testing in high school athletes. Computerized neurocognitive tests are used frequently in high school athletes, often within a model of baseline testing of asymptomatic individuals before the start of a sporting season. This study adds to the evidence that suggests in this population such testing may lack sufficient reliability to support clinical decision making.

Introducing the Body-QoL®: A New Patient-Reported Outcome Instrument for Measuring Body Satisfaction-Related Quality of Life in Aesthetic and Post-bariatric Body Contouring Patients.

PubMed

Danilla, Stefan; Cuevas, Pedro; Aedo, Sócrates; Dominguez, Carlos; Jara, Rocío; Calderón, María E; Al-Himdani, Sarah; Rios, Marco A; Taladriz, Cristián; Rodriguez, Diego; Gonzalez, Rolando; Lazo, Ángel; Erazo, Cristián; Benitez, Susana; Andrades, Patricio; Sepúlveda, Sergio

2016-02-01

To develop a new patient-reported outcome instrument (PRO) to measure body-related satisfaction quality of life (QoL). Standard 3-phase PRO design was followed; in the first phase, a qualitative design was used in 45 patients to develop a conceptual framework and to create preliminary scale domains and items. In phase 2, large-scale population testing on 1340 subjects was performed to reduce items and domains. In phase 3, final testing of the developed instrument on 34 patients was performed. Statistics used include Factor, RASCH, and multivariate regression analysis. Psychometric properties measured were internal reliability, item-rest, item-test, and test-retest correlations. The PRO-developed instrument is composed of four domains (satisfaction with the abdomen, sex life, self-esteem and social life, and physical symptoms) and 20 items in total. The score can range from 20 (worst) to 100 (best). Responsiveness was 100 %, internal reliability 93.3 %, and test-retest concordance 97.7 %. Body image-related QoL was superior in men than women (p < 0.001) and decreased with increasing age (p = 0.004) and BMI (p < 0.001). Post-bariatric body contouring patients score lower than cosmetic patients in all domains of the Body-QoL instrument (p < 0.001). After surgery, the score improves by on average 21.9 ± 16.9 (effect size 1.8, p < 0.001). Body satisfaction-related QoL can be measured reliably with the Body-QoL instrument. It can be used to quantify the improvement in cosmetic and post-bariatric patients including non- or minimally invasive procedures, suction assisted lipectomy, abdominoplasty, lipoabdominoplasty, and lower body lift and to give an evidence-based approach to standard practice. This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.springer.com/00266.

Transportation of Organs by Air: Safety, Quality, and Sustainability Criteria.

PubMed

Mantecchini, L; Paganelli, F; Morabito, V; Ricci, A; Peritore, D; Trapani, S; Montemurro, A; Rizzo, A; Del Sordo, E; Gaeta, A; Rizzato, L; Nanni Costa, A

2016-03-01

The outcomes of organ transplantation activities are greatly affected by the ability to haul organs and medical teams quickly and safely. Organ allocation and usage criteria have greatly improved over time, whereas the same result has not been achieved so far from the transport point of view. Safety and the highest level of service and efficiency must be reached to grant transplant recipients the healthiest outcome. The Italian National Transplant Centre (CNT), in partnership with the regions and the University of Bologna, has promoted a thorough analysis of all stages of organ transportation logistics chains to produce homogeneous and shared guidelines throughout the national territory, capable of ensuring safety, reliability, and sustainability at the highest levels. The mapping of all 44 transplant centers and the pertaining airport network has been implemented. An analysis of technical requirements among organ shipping agents at both national and international level has been promoted. A national campaign of real-time monitoring of organ transport activities at all stages of the supply chain has been implemented. Parameters investigated have been hospital and region of both origin and destination, number and type of organs involved, transport type (with or without medical team), stations of arrival and departure, and shipping agents, as well as actual times of activities involved. National guidelines have been issued to select organ storage units and shipping agents on the basis of evaluation of efficiency, reliability, and equipment with reference to organ type and ischemia time. Guidelines provide EU-level standards on technical equipment of aircrafts, professional requirements of shipping agencies and cabin crew, and requirements on service provision, including pricing criteria. The introduction in the Italian legislation of guidelines issuing minimum requirements on topics such as the medical team, packaging, labeling, safety and integrity, identification, real-time monitoring of temperature, and traceability of the organ during the logistics chain is deemed a valid response to the necessity of improving safety, reliability, and sustainability of organ transplantation activities in Italy. Copyright © 2016 Elsevier Inc. All rights reserved.

The role of high-frequency oscillations in epilepsy surgery planning

PubMed Central

Gloss, David; Nolan, Sarah J; Staba, Richard

2014-01-01

Background Epilepsy is a serious brain disorder characterized by recurrent unprovoked seizures. Approximately two-thirds of seizures can be controlled with antiepileptic medications (Kwan 2000). For some of the others, surgery can completely eliminate or significantly reduce the occurrence of disabling seizures. Localization of epileptogenic areas for resective surgery is far from perfect, and new tools are being investigated to more accurately localize the epileptogenic zone (the zone of the brain where the seizures begin) and improve the likelihood of freedom from postsurgical seizures. Recordings of pathological high-frequency oscillations (HFOs) may be one such tool. Objectives To assess the ability of HFOs to improve the outcomes of epilepsy surgery by helping to identify more accurately the epileptogenic areas of the brain. Search methods We searched the Cochrane Epilepsy Group Specialized Register (15 April 2013), the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library (2013, Issue 3), MEDLINE (Ovid) (1946 to 15 April 2013), CINAHL (EBSCOhost) (15 April 2013), Web of Knowledge (Thomson Reuters) (15 April 2013), www.clinicaltrials.gov (15 April 2013), and the World Health Organization International Clinical Trials Registry Platform (15 April 2013). Selection criteria We included studies that provided information on the outcomes of epilepsy surgery at at least six months and which used high-frequency oscillations in making decisions about epilepsy surgery. Data collection and analysis The primary outcome of the review was the Engel Class Outcome System. Secondary outcomes were responder rate, International League Against Epilepsy (ILAE) epilepsy surgery outcome, frequency of adverse events from any source and quality of life outcomes. We intended to analyse outcomes via an aggregated data fixed-effect model meta-analysis. Main results Two studies met the inclusion criteria. Both studies were small non-randomised trials, with no control group and no blinding. The quality of evidence for all outcomes was very low. The combination of these two studies resulted in 11 participants who prospectively used ictal HFOs for epilepsy surgery decision making. Results of the postsurgical seizure freedom Engel class I to IV outcome were determined over a period of 12 to 38 months (average 23.4 months) and indicated that six participants had an Engel class I outcome (seizure freedom), two had class II (rare disabling seizures), three had class III (worthwhile improvement). No adverse effects were reported. Neither study compared surgical results guided by HFOs versus surgical results guided without HFOs. Authors’ conclusions No reliable conclusions can be drawn regarding the efficacy of using HFOs in epilepsy surgery decision making at present. PMID:24431136

The role of high-frequency oscillations in epilepsy surgery planning.

PubMed

Gloss, David; Nolan, Sarah J; Staba, Richard

2014-01-15

Epilepsy is a serious brain disorder characterized by recurrent unprovoked seizures. Approximately two-thirds of seizures can be controlled with antiepileptic medications (Kwan 2000). For some of the others, surgery can completely eliminate or significantly reduce the occurrence of disabling seizures. Localization of epileptogenic areas for resective surgery is far from perfect, and new tools are being investigated to more accurately localize the epileptogenic zone (the zone of the brain where the seizures begin) and improve the likelihood of freedom from postsurgical seizures. Recordings of pathological high-frequency oscillations (HFOs) may be one such tool. To assess the ability of HFOs to improve the outcomes of epilepsy surgery by helping to identify more accurately the epileptogenic areas of the brain. We searched the Cochrane Epilepsy Group Specialized Register (15 April 2013), the Cochrane Central Register of Controlled Trials (CENTRAL) in The Cochrane Library (2013, Issue 3), MEDLINE (Ovid) (1946 to 15 April 2013), CINAHL (EBSCOhost) (15 April 2013), Web of Knowledge (Thomson Reuters) (15 April 2013), www.clinicaltrials.gov (15 April 2013), and the World Health Organization International Clinical Trials Registry Platform (15 April 2013). We included studies that provided information on the outcomes of epilepsy surgery at at least six months and which used high-frequency oscillations in making decisions about epilepsy surgery. The primary outcome of the review was the Engel Class Outcome System. Secondary outcomes were responder rate, International League Against Epilepsy (ILAE) epilepsy surgery outcome, frequency of adverse events from any source and quality of life outcomes. We intended to analyse outcomes via an aggregated data fixed-effect model meta-analysis. Two studies met the inclusion criteria. Both studies were small non-randomised trials, with no control group and no blinding. The quality of evidence for all outcomes was very low. The combination of these two studies resulted in 11 participants who prospectively used ictal HFOs for epilepsy surgery decision making. Results of the postsurgical seizure freedom Engel class I to IV outcome were determined over a period of 12 to 38 months (average 23.4 months) and indicated that six participants had an Engel class I outcome (seizure freedom), two had class II (rare disabling seizures), three had class III (worthwhile improvement). No adverse effects were reported. Neither study compared surgical results guided by HFOs versus surgical results guided without HFOs. No reliable conclusions can be drawn regarding the efficacy of using HFOs in epilepsy surgery decision making at present.

Poor concordance among nine immunohistochemistry classifiers of cell-of-origin for Diffuse Large B-cell Lymphoma: implications for therapeutic strategies

PubMed Central

Coutinho, Rita; Clear, Andrew James; Owen, Andrew; Wilson, Andrew; Matthews, Janet; Lee, Abigail; Alvarez, Rute; da Silva, Maria Gomes; Cabeçadas, José; Calaminici, Maria; Gribben, John G.

2014-01-01

Purpose The opportunity to improve therapeutic choices on the basis of molecular features of the tumour cells is on the horizon in Diffuse Large B-cell Lymphoma (DLBCL). Agents such as bortezomib exhibit selective activity against the poor outcome activated B-cell type DLBCL. In order for targeted therapies to succeed in this disease, robust strategies that segregate patients into molecular groups with high reliability are needed. While molecular studies are considered gold standard, several immunohistochemistry (IHC) algorithms have been published that claim to be able to stratify patients according to their cell-of-origin and to be relevant for patient outcome. However results are poorly reproducible by independent groups. Experimental design We investigated nine IHC algorithms for molecular classification in a dataset of DLBCL diagnostic biopsies, incorporating immunostaining for CD10, BCL6, BCL2, MUM1, FOXP1, GCET1 and LMO2. IHC profiles were assessed and agreed among three expert observers. A consensus matrix based on all scoring combinations and the number of subjects for each combination allowed to assess reliability. The survival impact of individual markers and classifiers was evaluated using Kaplan-Meier curves and the log-rank test. Results The concordance in patient’s classification across the different algorithms was low. Only 4% the tumors have been classified as GCB and 21% as ABC/non-GCB by all methods. None of the algorithms provided prognostic information in the R-CHOP treated cohort. Conclusion Further work is required to standardize IHC algorithms for DLBCL cell-of-origin classification for these to be considered reliable alternatives to molecular-based methods to be used for clinical decisions. PMID:24122791

Poor concordance among nine immunohistochemistry classifiers of cell-of-origin for diffuse large B-cell lymphoma: implications for therapeutic strategies.

PubMed

Coutinho, Rita; Clear, Andrew James; Owen, Andrew; Wilson, Andrew; Matthews, Janet; Lee, Abigail; Alvarez, Rute; Gomes da Silva, Maria; Cabeçadas, José; Calaminici, Maria; Gribben, John G

2013-12-15

The opportunity to improve therapeutic choices on the basis of molecular features of the tumor cells is on the horizon in diffuse large B-cell lymphoma (DLBCL). Agents such as bortezomib exhibit selective activity against the poor outcome activated B-cell type (ABC) DLBCL. In order for targeted therapies to succeed in this disease, robust strategies that segregate patients into molecular groups with high reliability are needed. Although molecular studies are considered gold standard, several immunohistochemistry (IHC) algorithms have been published that claim to be able to stratify patients according to their cell-of-origin and to be relevant for patient outcome. However, results are poorly reproducible by independent groups. We investigated nine IHC algorithms for molecular classification in a dataset of DLBCL diagnostic biopsies, incorporating immunostaining for CD10, BCL6, BCL2, MUM1, FOXP1, GCET1, and LMO2. IHC profiles were assessed and agreed among three expert observers. A consensus matrix based on all scoring combinations and the number of subjects for each combination allowed us to assess reliability. The survival impact of individual markers and classifiers was evaluated using Kaplan-Meier curves and the log-rank test. The concordance in patient's classification across the different algorithms was low. Only 4% of the tumors have been classified as germinal center B-cell type (GCB) and 21% as ABC/non-GCB by all methods. None of the algorithms provided prognostic information in the R-CHOP (rituximab plus cyclophosphamide-adriamycin-vincristine-prednisone)-treated cohort. Further work is required to standardize IHC algorithms for DLBCL cell-of-origin classification for these to be considered reliable alternatives to molecular-based methods to be used for clinical decisions. ©2013 AACR.

Reliability and validity of the French-Canadian version of the scoliosis research society 22 questionnaire in France.

PubMed

Lonjon, Guillaume; Ilharreborde, Brice; Odent, Thierry; Moreau, Sébastien; Glorion, Christophe; Mazda, Keyvan

2014-01-01

Outcome study to determine the internal consistency, reproducibility, and concurrent validity of the French-Canadian version of the Scoliosis Research Society 22 (SRS-22 fcv) patient questionnaire in France. To determine whether the SRS-22 fcv can be used in a population from France. The SRS-22 has been translated and validated in multiple countries, notably in the French-Canadian language in Quebec, Canada. Use of SRS-22 fcv seems appropriate for evaluating adolescent idiopathic scoliosis in France. However, French-Canadian French is noticeably different from the French spoken in France, and no study has investigated the use of a French-Canadian version of a health-quality questionnaire in another French population. The methods used for validating the SRS-22 fcv in Quebec were adopted for use with a group of 200 adolescents with idiopathic scoliosis and 60 healthy adolescents in France. Reliability and reproducibility were measured by the Cronbach α and intraclass correlation coefficient (ICC), construct validity by factorial analysis, concurrent validity by the Short-Form of the survey, and discriminant validity by analysis of variance and multivariate linear regression. In France, the SRS-22 fcv showed good global internal consistency (Cronbach α = 0.87, intraclass correlation coefficient = 0.92), a coherent factorial structure, and high correlation coefficients between the SRS-22 fcv and Short-Form of the survey (P < 0.001). However, reliability and validity were slightly less than that for the instrument's original validation and the validation of the SRS-22 fcv in Quebec. These differences could be explained by language and cultural differences. The SRS-22 fcv is relevant for use in France, but further development and validation of a specific French questionnaire remain necessary to improve the assessment of functional outcomes of adolescents with scoliosis in France. N/A.

Do patient characteristics predict outcome in the outpatient treatment of chronic tinnitus?

PubMed

Kröner-Herwig, Birgit; Zachriat, Claudia; Weigand, Doreen

2006-12-06

Various patient characteristics were assessed before offering a treatment to reduce tinnitus related distress to 57 individuals suffering from chronic idiopathic tinnitus. Patients were randomly assigned to a cognitive-behavioral tinnitus coping training (TCT) and a habituation-based training (HT) modelled after Tinnitus Retraining Therapy (TRT) as conceived by Jastreboff. Both trainings were conducted in groups. It was hypothesized that comorbidity regarding mental disorders or psychopathological symptoms (DSM-IV diagnoses, SCL-90R score) and a high level of dysfunctional cognitions relating to tinnitus would have a negative effect on therapy outcome while both trainings proved to be highly efficacious for the average patient. Also further patient features (assessed at baseline) were explored as potential predictors of outcome. None of the hypotheses was corroborated by the data. On the contrary, a higher number of diagnoses was associated with better outcome (statistical trend) and a higher extent of annoyance and interference led to a larger positive change in patients if treated by TCT. No predictor could be identified for long-term success (follow-up ≥18 months) except regarding education. The higher the educational level, the larger was the improvement in HT patients. It is concluded that therapy outcome of TCT and HT can not reliably be predicted by patient characteristics and that early variables of the therapeutic process should be analysed as potentially predicting subsequent therapeutic outcome.

Do patient characteristics predict outcome in the outpatient treatment of chronic tinnitus?

PubMed Central

Kröner-Herwig, Birgit; Zachriat, Claudia; Weigand, Doreen

2006-01-01

Various patient characteristics were assessed before offering a treatment to reduce tinnitus related distress to 57 individuals suffering from chronic idiopathic tinnitus. Patients were randomly assigned to a cognitive-behavioral tinnitus coping training (TCT) and a habituation-based training (HT) modelled after Tinnitus Retraining Therapy (TRT) as conceived by Jastreboff. Both trainings were conducted in groups. It was hypothesized that comorbidity regarding mental disorders or psychopathological symptoms (DSM-IV diagnoses, SCL-90R score) and a high level of dysfunctional cognitions relating to tinnitus would have a negative effect on therapy outcome while both trainings proved to be highly efficacious for the average patient. Also further patient features (assessed at baseline) were explored as potential predictors of outcome. None of the hypotheses was corroborated by the data. On the contrary, a higher number of diagnoses was associated with better outcome (statistical trend) and a higher extent of annoyance and interference led to a larger positive change in patients if treated by TCT. No predictor could be identified for long-term success (follow-up ≥18 months) except regarding education. The higher the educational level, the larger was the improvement in HT patients. It is concluded that therapy outcome of TCT and HT can not reliably be predicted by patient characteristics and that early variables of the therapeutic process should be analysed as potentially predicting subsequent therapeutic outcome. PMID:19742075

English-language videos on YouTube as a source of information on self-administer subcutaneous anti-tumour necrosis factor agent injections.

PubMed

Tolu, Sena; Yurdakul, Ozan Volkan; Basaran, Betul; Rezvani, Aylin

2018-05-14

The aim of this study was to evaluate the reliability, content, and quality of videos for patients available on YouTube for learning how to self-administer subcutaneous anti-tumour necrosis factor (TNF) injections. We searched for the terms Humira injection, Enbrel injection, Simponi injection, and Cimzia injection. Videos were categorised as useful information, misleading information, useful patient opinion, and misleading patient opinion by two physicians. Videos were rated for quality on a 5-point global quality scale (GQS; 1 = poor quality, 5 = excellent quality) and reliability and content using the 5-point DISCERN scale (higher scores represent greater reliability and more comprehensive videos). Of the 142 English videos, 24 (16.9%) videos were classified as useful information, 6 (4.2%) as misleading information, 47 (33.1%) as useful patient opinion, and 65 (45.8%) as misleading patient opinion. Useful videos were the most comprehensive and had the highest reliability and quality scores. The useful information and useful patient opinion videos had the highest numbers of views per day (median 8.32, IQR: 3.40-14.28 and 5.46, IQR: 3.06-14.44), as compared with 2.32, IQR: 1.63-6.26 for misleading information videos and 2.15, IQR: 1.17-7.43 for misleading patient opinion videos (p = 0.001). Almost all (91.5%) misleading videos were uploaded by individual users. There are a substantial number of English-language YouTube videos, with high quality, and rich content and reliability that can be sources of information on proper technique of anti-TNF self-injections. Physicians should direct patients to the reliable resources of information and educate them in online resource assessment, thereby improving treatment outcomes.

Development of the adult PedsQL™ neurofibromatosis type 1 module: initial feasibility, reliability and validity.

PubMed

Nutakki, Kavitha; Hingtgen, Cynthia M; Monahan, Patrick; Varni, James W; Swigonski, Nancy L

2013-02-21

Neurofibromatosis type 1 (NF1) is a common autosomal dominant genetic disorder with significant impact on health-related quality of life (HRQOL). Research in understanding the pathogenetic mechanisms of neurofibroma development has led to the use of new clinical trials for the treatment of NF1. One of the most important outcomes of a trial is improvement in quality of life, however, no condition specific HRQOL instrument for NF1 exists. The objective of this study was to develop an NF1 HRQOL instrument as a module of PedsQL™ and to test for its initial feasibility, internal consistency reliability and validity in adults with NF1. The NF1 specific HRQOL instrument was developed using a standard method of PedsQL™ module development - literature review, focus group/semi-structured interviews, cognitive interviews and experts' review of initial draft, pilot testing and field testing. Field testing involved 134 adults with NF1. Feasibility was measured by the percentage of missing responses, internal consistency reliability was measured with Cronbach's alpha and validity was measured by the known-groups method. Feasibility, measured by the percentage of missing responses was 4.8% for all subscales on the adult version of the NF1-specific instrument. Internal consistency reliability for the Total Score (alpha =0.97) and subscale reliabilities ranging from 0.72 to 0.96 were acceptable for group comparisons. The PedsQL™ NF1 module distinguished between NF1 adults with excellent to very good, good, and fair to poor health status. The results demonstrate the initial feasibility, reliability and validity of the PedsQL™ NF1 module in adult patients. The PedsQL™ NF1 Module can be used to understand the multidimensional nature of NF1 on the HRQOL patients with this disorder.

PROMIS Physical Function Correlation With NDI and mJOA in the Surgical Cervical Myelopathy Patient Population.

PubMed

Owen, Robert J; Zebala, Lukas P; Peters, Colleen; McAnany, Steven

2018-04-15

Retrospective review. To determine the correlation of Patient-Reported Outcomes Measurement Information System (PROMIS) physical function with Neck Disability Index (NDI) and Modified Japanese Orthopedic Association (mJOA) scores in the surgical cervical myelopathy patient population. Outcome measures such as NDI and mJOA are essential for analyzing treatments for cervical myelopathy. Administrative burdens impose limits on completion of these measures. The PROMIS group developed an outcome measure to improve reporting of patient symptoms and function and to reduce administrative burden. Despite early success, NDI and mJOA have not been compared with PROMIS in patients with cervical myelopathy. This study determines the correlation of NDI and mJOA with PROMIS in surgical patients with cervical myelopathy. A total of 60 patients with cervical myelopathy undergoing surgery were included. PROMIS, NDI, and mJOA were collected preoperatively, and in the first 6 months postoperatively. Correlations between NDI, mJOA, and PROMIS were quantified using Pearson correlation coefficients. Students t tests were used to test significance. All 60 (100%) of patients completed preoperative questionnaires. Fifty-five (92%) of patients completed initial follow-up questionnaires within the first 6 months. PROMIS physical function and NDI demonstrated a strong negative correlation at baseline and in initial follow-up (R = -0.69, -0.76). PROMIS and mJOA demonstrated a strong positive correlation at baseline and in initial follow-up (R = 0.61, 0.72). PROMIS physical function has a strong negative correlation with NDI and a strong positive correlation with mJOA at baseline and in the early postoperative course in patients undergoing surgery for cervical myelopathy. Surgeons may factor these outcomes into the delivery and interpretation of patient-reported outcome measures in this population. Use of PROMIS may improve completion of outcome measures in the office and reduce administrative burden while still providing reliable outcomes data. 3.

Military Occupational Outcomes in Canadian Armed Forces Personnel with and without Deployment-Related Mental Disorders

PubMed Central

Zamorski, Mark A.

2016-01-01

Objective: Mental disorders are common in military organizations, and these frequently lead to functional impairments that can interfere with duties and lead to costly attrition. In Canada, the military mental health system has received heavy investment to improve occupational outcomes. We investigated military occupational outcomes of diagnosed mental disorders in a cohort of 30,513 personnel who deployed on the Afghanistan mission. Methods: Cohort members were military personnel who deployed on the Afghanistan mission from 2001 to 2008. Mental disorder diagnoses and their attribution to the Afghanistan mission were ascertained via medical records in a stratified random sample (n = 2014). Career-limiting medical conditions (that is, condition-associated restrictions that reliably lead to medically related attrition) were determined using administrative data. Outcomes were assessed from first Afghanistan-related deployment return. Results: At 5 years of follow-up, the Kaplan-Meier estimated cumulative fraction with career-limiting medical conditions was 40.9% (95% confidence interval [CI] 35.5 to 46.4) among individuals with Afghanistan service–related mental disorders (ARMD), 23.6% (CI 15.5 to 31.8) with other mental disorders, and 11.1% (CI 8.9 to 13.3) without mental disorders. The adjusted Cox regression hazard ratios for career-limiting medical condition risk were 4.89 (CI 3.85 to 6.23) among individuals with ARMD and 2.31 (CI 1.48 to 3.60) with other mental disorders, relative to those without mental disorders. Conclusions: Notwithstanding the Canadian military’s mental health system investments, mental disorders (particularly ARMD) still led to a high risk of adverse military occupational outcomes. Such investments have intrinsic value but may not translate into reduced medically related attrition without improvements in prevention and treatment effectiveness. PMID:27254844

The Watch-and-Wait Task: On the Reliability and Validity of a New Method of Assessing Self-Control in Preschool Children

ERIC Educational Resources Information Center

Neubauer, Anna; Gawrilow, Caterina; Hasselhorn, Marcus

2012-01-01

A preschooler's ability to delay gratification in the waiting task is predictive of several developmental outcomes, despite this task's relatively low reliability level. Success in this task depends on the use of distraction strategies. The new Watch-and-Wait Task (WWT) has been developed to enhance reliability and to investigate whether the…

Automation of CT-based haemorrhagic stroke assessment for improved clinical outcomes: study protocol and design.

PubMed

Chinda, Betty; Medvedev, George; Siu, William; Ester, Martin; Arab, Ali; Gu, Tao; Moreno, Sylvain; D'Arcy, Ryan C N; Song, Xiaowei

2018-04-19

Haemorrhagic stroke is of significant healthcare concern due to its association with high mortality and lasting impact on the survivors' quality of life. Treatment decisions and clinical outcomes depend strongly on the size, spread and location of the haematoma. Non-contrast CT (NCCT) is the primary neuroimaging modality for haematoma assessment in haemorrhagic stroke diagnosis. Current procedures do not allow convenient NCCT-based haemorrhage volume calculation in clinical settings, while research-based approaches are yet to be tested for clinical utility; there is a demonstrated need for developing effective solutions. The project under review investigates the development of an automatic NCCT-based haematoma computation tool in support of accurate quantification of haematoma volumes. Several existing research methods for haematoma volume estimation are studied. Selected methods are tested using NCCT images of patients diagnosed with acute haemorrhagic stroke. For inter-rater and intrarater reliability evaluation, different raters will analyse haemorrhage volumes independently. The efficiency with respect to time of haematoma volume assessments will be examined to compare with the results from routine clinical evaluations and planimetry assessment that are known to be more accurate. The project will target the development of an enhanced solution by adapting existing methods and integrating machine learning algorithms. NCCT-based information of brain haemorrhage (eg, size, volume, location) and other relevant information (eg, age, sex, risk factor, comorbidities) will be used in relation to clinical outcomes with future project development. Validity and reliability of the solution will be examined for potential clinical utility. The project including procedures for deidentification of NCCT data has been ethically approved. The study involves secondary use of existing data and does not require new consent of participation. The team consists of clinical neuroimaging scientists, computing scientists and clinical professionals in neurology and neuroradiology and includes patient representatives. Research outputs will be disseminated following knowledge translation plans towards improving stroke patient care. Significant findings will be published in scientific journals. Anticipated deliverables include computer solutions for improved clinical assessment of haematoma using NCCT. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Assuring reliability program effectiveness.

NASA Technical Reports Server (NTRS)

Ball, L. W.

1973-01-01

An attempt is made to provide simple identification and description of techniques that have proved to be most useful either in developing a new product or in improving reliability of an established product. The first reliability task is obtaining and organizing parts failure rate data. Other tasks are parts screening, tabulation of general failure rates, preventive maintenance, prediction of new product reliability, and statistical demonstration of achieved reliability. Five principal tasks for improving reliability involve the physics of failure research, derating of internal stresses, control of external stresses, functional redundancy, and failure effects control. A final task is the training and motivation of reliability specialist engineers.

A Feasibility Randomised Controlled Trial of the New Orleans Intervention for Infant Mental Health: A Study Protocol

PubMed Central

Fitzpatrick, Bridie; Watson, Nicholas; Cotmore, Richard; Wilson, Philip; Donaldson, Julia; Boyd, Kathleen; Zeanah, Charles; Norrie, John; Messow, Martina; Turner, Fiona; Irving, Susan

2013-01-01

Child maltreatment is associated with life-long social, physical, and mental health problems. Intervening early to provide maltreated children with safe, nurturing care can improve outcomes. The need for prompt decisions about permanent placement (i.e., regarding adoption or return home) is internationally recognised. However, a recent Glasgow audit showed that many maltreated children “revolve” between birth families and foster carers. This paper describes the protocol of the first exploratory randomised controlled trial of a mental health intervention aimed at improving placement permanency decisions for maltreated children. This trial compares an infant's mental health intervention with the new enhanced service as usual for maltreated children entering care in Glasgow. As both are new services, the trial is being conducted from a position of equipoise. The outcome assessment covers various fields of a child's neurodevelopment to identify problems in any ESSENCE domain. The feasibility, reliability, and developmental appropriateness of all outcome measures are examined. Additionally, the potential for linkage with routinely collected data on health and social care and, in the future, education is explored. The results will inform a definitive randomised controlled trial that could potentially lead to long lasting benefits for the Scottish population and which may be applicable to other areas of the world. This trial is registered with ClinicalTrials.gov (NC01485510). PMID:24023537

Evaluation of a preliminary physical function item bank supported the expected advantages of the Patient-Reported Outcomes Measurement Information System (PROMIS).

PubMed

Rose, M; Bjorner, J B; Becker, J; Fries, J F; Ware, J E

2008-01-01

The Patient-Reported Outcomes Measurement Information System (PROMIS) was initiated to improve precision, reduce respondent burden, and enhance the comparability of health outcomes measures. We used item response theory (IRT) to construct and evaluate a preliminary item bank for physical function assuming four subdomains. Data from seven samples (N=17,726) using 136 items from nine questionnaires were evaluated. A generalized partial credit model was used to estimate item parameters, which were normed to a mean of 50 (SD=10) in the US population. Item bank properties were evaluated through Computerized Adaptive Test (CAT) simulations. IRT requirements were fulfilled by 70 items covering activities of daily living, lower extremity, and central body functions. The original item context partly affected parameter stability. Items on upper body function, and need for aid or devices did not fit the IRT model. In simulations, a 10-item CAT eliminated floor and decreased ceiling effects, achieving a small standard error (< 2.2) across scores from 20 to 50 (reliability >0.95 for a representative US sample). This precision was not achieved over a similar range by any comparable fixed length item sets. The methods of the PROMIS project are likely to substantially improve measures of physical function and to increase the efficiency of their administration using CAT.

Quality assessments for cancer centers in the European Union.

PubMed

Wind, Anke; Rajan, Abinaya; van Harten, Wim H

2016-09-07

Cancer centers are pressured to deliver high-quality services that can be measured and improved, which has led to an increase of assessments in many countries. A critical area of quality improvement is to improve patient outcome. An overview of existing assessments can help stakeholders (e.g., healthcare professionals, managers and policy makers) improve the quality of cancer research and care and lead to patient benefits. This paper presents key aspects of assessments undertaken by European cancer centers, such as: are assessments mandatory or voluntary? Do they focus on evaluating research, care or both? And are they international or national? A survey was sent to 33 cancer centers in 28 European Union member states. Participants were asked to score the specifics for each assessment that they listed. Based on the responses from 19 cancer centers from 18 member states, we found 109 assessments. The numbers have steadily increased from 1990's till 2015. Although, a majority of assessments are on patient-care aspects (n = 45), it is unclear how many of those include assessing patient benefits. Only few assessments cover basic research. There is an increasing trend towards mixed assessments (i.e., combining research and patient-care aspects) The need for assessments in cancer centers is increasing. To improve efforts in the quality of research and patient care and to prevent new assessments that "reinvent the wheel", it is advised to start comparative research into the assessments that are likely to bring patient benefits and improve patient outcome. Do assessments provide consistent and reliable information that create added value for all key stakeholders?

Reliability, validity and responsiveness of the German self-reported foot and ankle score (SEFAS) in patients with foot or ankle surgery.

PubMed

Arbab, Dariusch; Kuhlmann, Katharina; Schnurr, Christoph; Bouillon, Bertil; Lüring, Christian; König, Dietmar

2017-10-10

Patient-reported outcome measures are a critical tool in evaluating the efficacy of orthopedic procedures and are increasingly used in clinical trials to assess outcomes of health care. The intention of this study was to develop and culturally adapt a German version of the Self-reported Foot and Ankle Score (SEFAS) and to evaluate reliability, validity and responsiveness. According to Cross Cultural Adaptation of Self-Reported Measure guidelines forward and backward translation has been performed. The German SEFAS was investigated in 177 consecutive patients. 177 Patients completed the German SEFAS, Foot and Ankle Outcome Score (FAOS), Short-Form 36 and numeric scales for pain and disability (NRS) before and 118 patients 6 months after foot or ankle surgery. Test-Retest reliability, internal consistency, floor and ceiling effects, construct validity and minimal important change were analyzed. The German SEFAS demonstrated excellent test-retest reliability with ICC values of 0.97. Cronbach's alpha (α) value of 0.89 demonstrated strong internal consistency. No floor or ceiling effects were observed for the German version of the SEFAS. As hypothesized SEFAS correlated strongly with FAOS and SF-36 domains. It showed moderate (ES/SRM > 0.5) responsiveness between preoperative assessment and postoperative follow-up. The German version of the SEFAS demonstrated good psychometric properties. It proofed to be a valid and reliable instrument for use in foot and ankle patients. DRKS00007585.

Clinical utility of measures of breathlessness.

PubMed

Cullen, Deborah L; Rodak, Bernadette

2002-09-01

The clinical utility of measures of dyspnea has been debated in the health care community. Although breathlessness can be evaluated with various instruments, the most effective dyspnea measurement tool for patients with chronic lung disease or for measuring treatment effectiveness remains uncertain. Understanding the evidence for the validity and reliability of these instruments may provide a basis for appropriate clinical application. Evaluate instruments designed to measure breathlessness, either as single-symptom or multidimensional instruments, based on psychometrics foundations such as validity, reliability, and discriminative and evaluative properties. Classification of each dyspnea measurement instrument will recommend clinical application in terms of exercise, benchmarking patients, activities of daily living, patient outcomes, clinical trials, and responsiveness to treatment. Eleven dyspnea measurement instruments were selected. Each instrument was assessed as discriminative or evaluative and then analyzed as to its psychometric properties and purpose of design. Descriptive data from all studies were described according to their primary patient application (ie, chronic obstructive pulmonary disease, asthma, or other patient populations). The Borg Scale and the Visual Analogue Scale are applicable to exertion and thus can be applied to any cardiopulmonary patient to determine dyspnea. All other measures were determined appropriate for chronic obstructive pulmonary disease, whereas the Shortness of Breath Questionnaire can be applied to cystic fibrosis and lung transplant patients. The most appropriate utility for all instruments was measuring the effects on activities of daily living and for benchmarking patient progress. Instruments that quantify function and health-related quality of life have great utility for documenting outcomes but may be limited as to documenting treatment responsiveness in terms of clinically important changes. The dyspnea measurement instruments we studied meet important standards of validity and reliability. Discriminative measures have limited clinical utility and, when used for populations or conditions for which they are not designed or validated, the data collected may not be clinically relevant. Evaluative measures have greater clinical utility and can be applied for outcome purposes. Measures should be applied to the populations and conditions for which they were designed. The relationship between clinical therapies and the measurement of dyspnea as an outcome can develop as respiratory therapists become more comfortable with implementing dyspnea measurement instruments and use the data to improve patient treatment. Dyspnea evaluation should be considered for all clinical practice guidelines and care pathways.

Reliability of lower limb transcranial magnetic stimulation outcomes in the ipsi- and contralesional hemispheres of adults with chronic stroke.

PubMed

Beaulieu, Louis-David; Massé-Alarie, Hugo; Ribot-Ciscar, Edith; Schneider, Cyril

2017-07-01

To investigate the ability of transcranial magnetic stimulation (TMS) outcomes in the chronic stroke population to (i) track individual plastic changes and (ii) detect differences between individuals. To this end, intrarater "test-retest" reliability (relative and absolute) was tested for the ipsilesional and contralesional hemispheres. Thirteen participants with a unilateral stroke (≥6months ago) and sensorimotor impairments were enrolled. Single and paired-pulse TMS outcomes were obtained from the primary motor cortex (M1) representation of the tibialis anterior muscle in both hemispheres and at two sessions separated by one week. The standard error of the measurement (SEM eas ), minimal detectable change (MDC) and intraclass correlation coefficient (ICC) were studied. Active motor threshold and latency of motor evoked potentials provided the lowest SEM eas and highest ICCs for both ipsi- and contralesional hemispheres. However, MDC were generally large, thus questioning the use of TMS outcomes to track individual plastic changes of M1. Our study provided supporting evidence of good to excellent intrarater reliability for a few TMS outcomes and proposed recommendations on the interpretation and the use of that knowledge in future work. Psychometric properties of TMS measures should be further addressed in order to better understand how to refine their use in clinical settings. Copyright © 2017 International Federation of Clinical Neurophysiology. Published by Elsevier B.V. All rights reserved.

Mobility Device Quality Affects Participation Outcomes for People With Disabilities: A Structural Equation Modeling Analysis.

PubMed

Magasi, Susan; Wong, Alex; Miskovic, Ana; Tulsky, David; Heinemann, Allen W

2018-01-01

To test the effect that indicators of mobility device quality have on participation outcomes in community-dwelling adults with spinal cord injury, traumatic brain injury, and stroke by using structural equation modeling. Survey, cross-sectional study, and model testing. Clinical research space at 2 academic medical centers and 1 free-standing rehabilitation hospital. Community-dwelling adults (N=250; mean age, 48±14.3y) with spinal cord injury, traumatic brain injury, and stroke. Not applicable. The Mobility Device Impact Scale, Patient-Reported Outcomes Measurement Information System Social Function (version 2.0) scale, including Ability to Participate in Social Roles and Activities and Satisfaction with Social Roles and Activities, and the 2 Community Participation Indicators' enfranchisement scales. Details about device quality (reparability, reliability, ease of maintenance) and device type were also collected. Respondents used ambulation aids (30%), manual (34%), and power wheelchairs (30%). Indicators of device quality had a moderating effect on participation outcomes, with 3 device quality variables (repairability, ease of maintenance, device reliability) accounting for 20% of the variance in participation. Wheelchair users reported lower participation enfranchisement than did ambulation aid users. Mobility device quality plays an important role in participation outcomes. It is critical that people have access to mobility devices and that these devices be reliable. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Clinical global impression of cognition in schizophrenia (CGI-CogS): reliability and validity of a co-primary measure of cognition.

PubMed

Ventura, Joseph; Cienfuegos, Angel; Boxer, Oren; Bilder, Robert

2008-11-01

Cognitive deficits are core features of schizophrenia that have been associated reliably with functional outcomes and now are a focus of treatment research. New rating scales are needed to complement current psychometric testing procedures, both to enable wider clinical use, and to serve as endpoints in clinical trials. Subjects were 35 schizophrenia patient-and-caregiver pairs recruited from the UCLA and West Los Angeles VA Outpatient Psychiatry Departments. Participants were assessed with the Clinical Global Impression of Cognition in Schizophrenia (CGI-CogS), an interview-based rating scale of cognitive functioning, on 3 occasions (baseline, 1 month, and 3 months). A computerized neurocognitive battery (Cogtest), an assessment of functioning, and symptom measures were administered at two occasions (baseline and one month). The CGI-CogS ratings generally showed a high level of internal consistency (Cronbach's alpha=.69 to .96), adequate levels of inter-rater reliability (ICC's=.71 to .80), and high test-retest stability (ICC's=.92 to .95). Correlations of caregiver and rater global (but not "patient only rating") CGI-CogS ratings with neurocognitive performance were in the moderate range (r's=-.27 to -.48), while most of the correlations with functional outcome were moderate to high (r's=-.41 to -.72). In fact, the CGI-CogS ratings were significantly more correlated with Social Functioning than were objective neurocognitive test scores (p=.02) and showed a trend in the same direction for predicting Instrumental Functioning (p=.06). We found moderate correlations between CGI-CogS global ratings and PANSS positive (r's=.36 to .49) and SANS negative symptoms (r=.41 to .61), but not with BPRS depression (r's=.11 to .13). An interview-based measure of cognition demonstrated high internal consistency, good inter-rater reliability, and high test-retest reliability. Caregiver ratings appear to add important clinical information over patient-only ratings. The CGI-CogS showed moderate validity with respect to neurocognitive performance and functional outcome, and correlations of CGI-CogS with functional outcomes were stronger than correlations of objective neurocognitive performance with functional outcomes. The CGI-CogS appears to offer a reliable and valid method for clinical rating of cognitive deficits and their impact on everyday functioning in schizophrenia.

Future technology in cochlear implants: assessing the benefit.

PubMed

Briggs, Robert J S

2011-05-01

It has been over 50 years since Djourno and Eyries first attempted electric stimulation in a patient with deafness. Over this time, the Cochlear Implant (CI) has become not only remarkably successful, but increasingly complex. Although the basic components of the system still comprise an implanted receiver stimulator and electrode, externally worn speech processor, microphone, control system, and power source, there are now several alternative designs of these components with different attributes that can be variably combined to meet the needs of specific patient groups. Development by the manufacturers has been driven both by these various patient needs, and also by the desire to achieve technological superiority, or at least differentiation, ultimately in pursuit of market share. Assessment of benefit is the responsibility of clinicians. It is incumbent on both industry and clinicians to ensure appropriate, safe, and affordable introduction of new technology. For example, experience with the totally implanted cochlear implant (TIKI) has demonstrated that quality of hearing is the over-riding consideration for CI users. To date, improved hearing outcomes have been achieved by improvements in: speech processing strategies; microphone technology; pre-processing strategies; electrode placement; bilateral implantation; use of a hearing aid in the opposite ear (bimodal stimulation); and the combination of electric and acoustic stimulation in the same ear. The resulting expansion of CI candidacy, with more residual hearing, further improves the outcomes achieved. Largely facilitated by advances in electronic capability and computerization, it can be expected that these improvements will continue. However, marked variability of results still occurs and we cannot assure any individual patient of their outcome. Realistic goals for implementation of new technology include: improved hearing in noise and music perception; effective invisible hearing (no external apparatus); automated fitting; and reduction in outcome variability. This paper provides examples of relevant potential future technologies that can be applied to reach these goals. In the quest for better outcomes, future technology must deliver improved reliability and usability for both clinicians and recipients that does not compromise safety and is affordable. One of the challenges related to the introduction of new technologies is the 'classification' of CI systems and the framework under which sufficient change and increased benefit can be demonstrated to establish a claim of 'new generation CI' and hence increased reimbursement from third-party payers. Significant improvements in hearing outcomes and quality of life associated with CI design changes are difficult to measure, particularly when there is such dramatic benefit from the intervention of cochlear implantation from the individual's perspective. Manufacturers and clinicians need to be objective and undertake appropriate safety studies and long-term and multi-centre clinical trials to ensure that the introduction of new technology is both safe and effective and supported by health systems worldwide.

Quality of Computationally Inferred Gene Ontology Annotations

PubMed Central

Škunca, Nives; Altenhoff, Adrian; Dessimoz, Christophe

2012-01-01

Gene Ontology (GO) has established itself as the undisputed standard for protein function annotation. Most annotations are inferred electronically, i.e. without individual curator supervision, but they are widely considered unreliable. At the same time, we crucially depend on those automated annotations, as most newly sequenced genomes are non-model organisms. Here, we introduce a methodology to systematically and quantitatively evaluate electronic annotations. By exploiting changes in successive releases of the UniProt Gene Ontology Annotation database, we assessed the quality of electronic annotations in terms of specificity, reliability, and coverage. Overall, we not only found that electronic annotations have significantly improved in recent years, but also that their reliability now rivals that of annotations inferred by curators when they use evidence other than experiments from primary literature. This work provides the means to identify the subset of electronic annotations that can be relied upon—an important outcome given that >98% of all annotations are inferred without direct curation. PMID:22693439

Operating Experience and Reliability Improvements on the 5 kW CW Klystron at Jefferson Lab

NASA Astrophysics Data System (ADS)

Nelson, R.; Holben, S.

1997-05-01

With substantial operating hours on the RF system, considerable information on reliability of the 5 kW CW klystrons has been obtained. High early failure rates led to examination of the operating conditions and failure modes. Internal ceramic contamination caused premature failure of gun potting material and ultimate tube demise through arcing or ceramic fracture. A planned course of repotting and reconditioning of approximately 300 klystrons, plus careful attention to operating conditions and periodic analysis of operational data, has substantially reduced the failure rate. It is anticipated that implementation of planned supplemental monitoring systems for the klystrons will allow most catastrophic failures to be avoided. By predicting end of life, tubes can be changed out before they fail, thus minimizing unplanned downtime. Initial tests have also been conducted on this same klystron operated at higher voltages with resultant higher output power. The outcome of these tests will provide information to be considered for future upgrades to the accelerator.

New graduate RN work satisfaction after completing an interactive nurse residency.

PubMed

Anderson, Teresa; Linden, Lois; Allen, Marsha; Gibbs, Elizabeth

2009-04-01

The aims of this study were to measure job satisfaction and engagement perceptions of new nurses after completing interactive residency modules and to test the reliability and validity of the Halfer-Graf Job/Work Environment Nursing Satisfaction Survey. US nursing shortages are estimated to increase to 36% by 2020, requiring emphasis on hiring new graduate nurses. Improved retention of new graduates through innovative orientations such as interactive nurse residencies is one option. This mixed qualitative and quantitative study compared perceived job satisfaction and employee engagement of 90 new graduate nurses completing an interactive nurse residency. Reliability and validity of the Halfer-Graf tool were supported. Qualitative analysis yielded trends related to satisfiers (patients, patient outcomes, and teamwork) and dissatisfiers (staffing/scheduling, lack of teamwork, and physician disrespect). Simulation scenarios, debriefing, and e-mail communication with peers ranked high as beneficial teaching strategies. Study findings support previous research. An interactive learning environment was perceived as beneficial. First and second year nurse retention was consistent with previous residency programming.

Development of a Valid and Reliable Knee Articular Cartilage Condition-Specific Study Methodological Quality Score.

PubMed

Harris, Joshua D; Erickson, Brandon J; Cvetanovich, Gregory L; Abrams, Geoffrey D; McCormick, Frank M; Gupta, Anil K; Verma, Nikhil N; Bach, Bernard R; Cole, Brian J

2014-02-01

Condition-specific questionnaires are important components in evaluation of outcomes of surgical interventions. No condition-specific study methodological quality questionnaire exists for evaluation of outcomes of articular cartilage surgery in the knee. To develop a reliable and valid knee articular cartilage-specific study methodological quality questionnaire. Cross-sectional study. A stepwise, a priori-designed framework was created for development of a novel questionnaire. Relevant items to the topic were identified and extracted from a recent systematic review of 194 investigations of knee articular cartilage surgery. In addition, relevant items from existing generic study methodological quality questionnaires were identified. Items for a preliminary questionnaire were generated. Redundant and irrelevant items were eliminated, and acceptable items modified. The instrument was pretested and items weighed. The instrument, the MARK score (Methodological quality of ARticular cartilage studies of the Knee), was tested for validity (criterion validity) and reliability (inter- and intraobserver). A 19-item, 3-domain MARK score was developed. The 100-point scale score demonstrated face validity (focus group of 8 orthopaedic surgeons) and criterion validity (strong correlation to Cochrane Quality Assessment score and Modified Coleman Methodology Score). Interobserver reliability for the overall score was good (intraclass correlation coefficient [ICC], 0.842), and for all individual items of the MARK score, acceptable to perfect (ICC, 0.70-1.000). Intraobserver reliability ICC assessed over a 3-week interval was strong for 2 reviewers (≥0.90). The MARK score is a valid and reliable knee articular cartilage condition-specific study methodological quality instrument. This condition-specific questionnaire may be used to evaluate the quality of studies reporting outcomes of articular cartilage surgery in the knee.

Validity and reliability of the Nintendo Wii Balance Board to assess standing balance and sensory integration in highly functional older adults.

PubMed

Scaglioni-Solano, Pietro; Aragón-Vargas, Luis F

2014-06-01

Standing balance is an important motor task. Postural instability associated with age typically arises from deterioration of peripheral sensory systems. The modified Clinical Test of Sensory Integration for Balance and the Tandem test have been used to screen for balance. Timed tests present some limitations, whereas quantification of the motions of the center of pressure (CoP) with portable and inexpensive equipment may help to improve the sensitivity of these tests and give the possibility of widespread use. This study determines the validity and reliability of the Wii Balance Board (Wii BB) to quantify CoP motions during the mentioned tests. Thirty-seven older adults completed three repetitions of five balance conditions: eyes open, eyes closed, eyes open on a compliant surface, eyes closed on a compliant surface, and tandem stance, all performed on a force plate and a Wii BB simultaneously. Twenty participants repeated the trials for reliability purposes. CoP displacement was the main outcome measure. Regression analysis indicated that the Wii BB has excellent concurrent validity, and Bland-Altman plots showed good agreement between devices with small mean differences and no relationship between the difference and the mean. Intraclass correlation coefficients (ICCs) indicated modest-to-excellent test-retest reliability (ICC=0.64-0.85). Standard error of measurement and minimal detectable change were similar for both devices, except the 'eyes closed' condition, with greater standard error of measurement for the Wii BB. In conclusion, the Wii BB is shown to be a valid and reliable method to quantify CoP displacement in older adults.

Development and validation of a work stressor scale for Australian farming families.

PubMed

McShane, Connar J; Quirk, Frances; Swinbourne, Anne

2016-08-01

The aim of this research was to gain insight into the key stressors for Australian farming families. It is well established that the farming work environment consists of a number of unique stressors which arise from dependency on factors beyond an individual's control (e.g. climate conditions) as well as the overlap between work and family environments. Despite this, limited research has included family factors in the assessment of stress felt by farmers and their families. This research sought to develop a scale of stressors for farming families in an Australian sample. A survey design was used for validity and reliability studies. The validity study involved assessment of factor structure, concurrent validity and discriminant validity. The reliability study used a test-retest reliability design. Participants were recruited from across Australia (38% Queensland; 30% New South Wales) and multiple industries (43% beef; 27% broadacre cropping; 26% horticulture). The validity study involved 278 participants and the reliability study involved 53 participants. Development of a Farming Family Stressor scale. The generated Farming Family Stressor scale presented satisfactory levels of concurrent validity (e.g. r = .73 against the Farm Stress Survey total score), discriminant validity (e.g. r = -.42 to r = .53 against the Satisfaction with Life and Kessler-10 total scores, respectively), internal consistency (Cronbach's alpha >.90) and test-retest reliability (rho > .66). This research lends insight into the complexity of stressors for farming families and has implications for occupational health and mental health programs that seek to reduce stress and improve health outcomes for that group. © 2015 National Rural Health Alliance Inc.

Influential input classification in probabilistic multimedia models

DOE Office of Scientific and Technical Information (OSTI.GOV)

Maddalena, Randy L.; McKone, Thomas E.; Hsieh, Dennis P.H.

1999-05-01

Monte Carlo analysis is a statistical simulation method that is often used to assess and quantify the outcome variance in complex environmental fate and effects models. Total outcome variance of these models is a function of (1) the uncertainty and/or variability associated with each model input and (2) the sensitivity of the model outcome to changes in the inputs. To propagate variance through a model using Monte Carlo techniques, each variable must be assigned a probability distribution. The validity of these distributions directly influences the accuracy and reliability of the model outcome. To efficiently allocate resources for constructing distributions onemore » should first identify the most influential set of variables in the model. Although existing sensitivity and uncertainty analysis methods can provide a relative ranking of the importance of model inputs, they fail to identify the minimum set of stochastic inputs necessary to sufficiently characterize the outcome variance. In this paper, we describe and demonstrate a novel sensitivity/uncertainty analysis method for assessing the importance of each variable in a multimedia environmental fate model. Our analyses show that for a given scenario, a relatively small number of input variables influence the central tendency of the model and an even smaller set determines the shape of the outcome distribution. For each input, the level of influence depends on the scenario under consideration. This information is useful for developing site specific models and improving our understanding of the processes that have the greatest influence on the variance in outcomes from multimedia models.« less

Psycho-oncology assessment in Chinese populations: a systematic review of quality of life and psychosocial measures.

PubMed

Hyde, M K; Chambers, S K; Shum, D; Ip, D; Dunn, J

2016-09-01

This systematic review describes psychosocial and quality of life (QOL) measures used in psycho-oncology research with cancer patients and caregivers in China. Medline and PsycINFO databases were searched (1980-2014). Studies reviewed met the following criteria: English language; peer-reviewed; sampled Chinese cancer patients/caregivers; developed, validated or assessed psychometric properties of psychosocial or QOL outcome measures; and reported validation data. The review examined characteristics of measures and participants, translation and cultural adaptation processes and psychometric properties of the measures. Ninety five studies met review criteria. Common characteristics of studies reviewed were they: assessed primarily QOL measures, sampled patients with breast, colorectal, or head and neck cancer, and validated existing measures (>80%) originating in North America or Europe. Few studies reported difficulties translating measures. Regarding psychometric properties of the measures >50% of studies reported subscale reliabilities <α = 0.70, <50% reported test-retest reliability, and <30% reported divergent validity. Few reported sensitivity, specificity or responsiveness. Improved accuracy and transparency of reporting for translation, cultural adaptation and psychometric testing of psychosocial measures is needed. Developing support structures for translating and validating psychosocial measures would enable this and ensure Chinese psycho-oncology clinical practice and research keeps pace with international focus on patient reported outcome measures and data management. © 2015 John Wiley & Sons Ltd.

The medication appropriateness index at 20: where it started, where it has been, and where it may be going.

PubMed

Hanlon, Joseph T; Schmader, Kenneth E

2013-11-01

Potentially inappropriate prescribing for older adults is a major public health concern. While there are multiple measures of potentially inappropriate prescribing, the medication appropriateness index (MAI) is one of the most common implicit approaches published in the scientific literature. The objective of this narrative review is to describe findings regarding the MAI's reliability, comparison of the MAI with other quality measures of potentially inappropriate prescribing, its predictive validity with important health outcomes, and its responsiveness to change within the framework of randomized controlled trials. A search restricted to English-language literature involving humans aged 65+ years from January 1992 to June 2013 was conducted using MEDLINE and EMBASE databases using the search term 'medication appropriateness index'. A manual search of the reference lists from identified articles and the authors' article files, book chapters, and recent reviews was conducted to identify additional articles. A total of 26 articles were identified for inclusion in this narrative review. The main findings were that the MAI has acceptable inter- and intra-rater reliability, it more frequently detects potentially inappropriate prescribing than a commonly used set of explicit criteria, it predicts adverse health outcomes, and it is able to demonstrate the positive impact of interventions to improve this public health problem. We conclude that the MAI may serve as a valuable tool for measuring potentially inappropriate prescribing in older adults.

Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: A systematic review.

PubMed

Milette, Katherine; Roseman, Michelle; Thombs, Brett D

2011-03-01

The most reliable evidence for evaluating healthcare interventions comes from well-designed and conducted randomized controlled trials (RCTs). The extent to which published RCTs reflect the efficacy of interventions, however, depends on the completeness and accuracy of published results. The Consolidated Standards of Reporting Trials statement, initially developed in 1996, provides guidelines intended to improve the transparency of published RCT reports. A policy of the International Committee of Medical Journal Editors, initiated in 2005, requires clinical trials published in member journals to be registered in publicly accessible registries prior to patient enrollment. The objective of this study was to assess the clarity of outcome reporting, proportion of registered trials, and adequacy of outcome registration in RCTs published in top behavioral health journals. Eligible studies were primary or secondary reports of RCTs published in Annals of Behavioral Medicine, Health Psychology, Journal of Psychosomatic Research, and Psychosomatic Medicine from January 2008 to September 2009. Data were extracted for each study on adequacy of outcome reporting and registration. Of 63 articles reviewed, only 25 (39.7%) had adequately declared primary or secondary outcomes, whereas 38 (60.3%) had multiple primary outcomes or did not define outcomes. Only 13 studies (20.6%) were registered. Only 1 study registered sufficiently precise outcome information to compare with published outcomes, and registered and published outcomes were discrepant in that study. Greater attention to outcome reporting and trial registration by researchers, peer reviewers, and journal editors will increase the likelihood that effective behavioral health interventions are readily identified and made available to patients. Copyright © 2011 Elsevier Inc. All rights reserved.

The postoperative COFAS end-stage ankle arthritis classification system: interobserver and intraobserver reliability.

PubMed

Krause, Fabian G; Di Silvestro, Matthew; Penner, Murray J; Wing, Kevin J; Glazebrook, Mark A; Daniels, Timothy R; Lau, Johnny T C; Younger, Alastair S E

2012-02-01

End-stage ankle arthritis is operatively treated with numerous designs of total ankle replacement and different techniques for ankle fusion. For superior comparison of these procedures, outcome research requires a classification system to stratify patients appropriately. A postoperative 4-type classification system was designed by 6 fellowship-trained foot and ankle surgeons. Four surgeons reviewed blinded patient profiles and radiographs on 2 occasions to determine the interobserver and intraobserver reliability of the classification. Excellent interobserver reliability (κ = .89) and intraobserver reproducibility (κ = .87) were demonstrated for the postoperative classification system. In conclusion, the postoperative Canadian Orthopaedic Foot and Ankle Society (COFAS) end-stage ankle arthritis classification system appears to be a valid tool to evaluate the outcome of patients operated for end-stage ankle arthritis.

The use and reliability of SymNose for quantitative measurement of the nose and lip in unilateral cleft lip and palate patients.

PubMed

Mosmuller, David; Tan, Robin; Mulder, Frans; Bachour, Yara; de Vet, Henrica; Don Griot, Peter

2016-10-01

It is essential to have a reliable assessment method in order to compare the results of cleft lip and palate surgery. In this study the computer-based program SymNose, a method for quantitative assessment of the nose and lip, will be assessed on usability and reliability. The symmetry of the nose and lip was measured twice in 50 six-year-old complete and incomplete unilateral cleft lip and palate patients by four observers. For the frontal view the asymmetry level of the nose and upper lip were evaluated and for the basal view the asymmetry level of the nose and nostrils were evaluated. A mean inter-observer reliability when tracing each image once or twice was 0.70 and 0.75, respectively. Tracing the photographs with 2 observers and 4 observers gave a mean inter-observer score of 0.86 and 0.92, respectively. The mean intra-observer reliability varied between 0.80 and 0.84. SymNose is a practical and reliable tool for the retrospective assessment of large caseloads of 2D photographs of cleft patients for research purposes. Moderate to high single inter-observer reliability was found. For future research with SymNose reliable outcomes can be achieved by using the average outcomes of single tracings of two observers. Copyright © 2016 European Association for Cranio-Maxillo-Facial Surgery. Published by Elsevier Ltd. All rights reserved.

Enhancing point of care vigilance using computers.

PubMed

St Jacques, Paul; Rothman, Brian

2011-09-01

Information technology has the potential to provide a tremendous step forward in perioperative patient safety. Through automated delivery of information through fixed and portable computer resources, clinicians may achieve improved situational awareness of the overall operation of the operating room suite and the state of individual patients in various stages of surgical care. Coupling the raw, but integrated, information with decision support and alerting algorithms enables clinicians to achieve high reliability in documentation compliance and response to care protocols. Future studies and outcomes analysis are needed to quantify the degree of benefit of these new components of perioperative information systems. Copyright © 2011 Elsevier Inc. All rights reserved.

Solar powered oxygen systems in remote health centers in Papua New Guinea: a large scale implementation effectiveness trial.

PubMed

Duke, Trevor; Hwaihwanje, Ilomo; Kaupa, Magdalynn; Karubi, Jonah; Panauwe, Doreen; Sa'avu, Martin; Pulsan, Francis; Prasad, Peter; Maru, Freddy; Tenambo, Henry; Kwaramb, Ambrose; Neal, Eleanor; Graham, Hamish; Izadnegahdar, Rasa

2017-06-01

Pneumonia is the largest cause of child deaths in Papua New Guinea (PNG), and hypoxaemia is the major complication causing death in childhood pneumonia, and hypoxaemia is a major factor in deaths from many other common conditions, including bronchiolitis, asthma, sepsis, malaria, trauma, perinatal problems, and obstetric emergencies. A reliable source of oxygen therapy can reduce mortality from pneumonia by up to 35%. However, in low and middle income countries throughout the world, improved oxygen systems have not been implemented at large scale in remote, difficult to access health care settings, and oxygen is often unavailable at smaller rural hospitals or district health centers which serve as the first point of referral for childhood illnesses. These hospitals are hampered by lack of reliable power, staff training and other basic services. We report the methodology of a large implementation effectiveness trial involving sustainable and renewable oxygen and power systems in 36 health facilities in remote rural areas of PNG. The methodology is a before-and after evaluation involving continuous quality improvement, and a health systems approach. We describe this model of implementation as the considerations and steps involved have wider implications in health systems in other countries. The implementation steps include: defining the criteria for where such an intervention is appropriate, assessment of power supplies and power requirements, the optimal design of a solar power system, specifications for oxygen concentrators and other oxygen equipment that will function in remote environments, installation logistics in remote settings, the role of oxygen analyzers in monitoring oxygen concentrator performance, the engineering capacity required to sustain a program at scale, clinical guidelines and training on oxygen equipment and the treatment of children with severe respiratory infection and other critical illnesses, program costs, and measurement of processes and outcomes to support continuous quality improvement. This study will evaluate the feasibility and sustainability issues in improving oxygen systems and providing reliable power on a large scale in remote rural settings in PNG, and the impact of this on child mortality from pneumonia over 3 years post-intervention. Taking a continuous quality improvement approach can be transformational for remote health services.

Validation of the Mayo Hip Score: construct validity, reliability and responsiveness to change.

PubMed

Singh, Jasvinder A; Schleck, Cathy; Harmsen, W Scott; Lewallen, David G

2016-01-19

Previous studies have provided the initial evidence for construct validity and test-retest reliability of the Mayo Hip Score. Instruments used for Total Hip Arthroplasty (THA) outcomes assessment should be valid, reliable and responsive to change. Our main objective was to examine the responsiveness to change, association with subsequent revision and the construct validity of the Mayo hip score. Discriminant ability was assessed by calculating effect size (ES), standardized response mean (SRM) and Guyatt's responsiveness index (GRI). Minimal clinically important difference (MCII) and moderate improvement thresholds were calculated. We assessed construct validity by examining association of scores with preoperative patient characteristics and correlation with Harris hip score, and assessed association of scores with the risk of subsequent revision. Five thousand three hundred seven provided baseline data; of those with baseline data, 2,278 and 2,089 (39%) provided 2- and 5-year data, respectively. Large ES, SRM and GRI ranging 2.66-2.78, 2.42-2.61 and 1.67-1.88 were noted for Mayo hip scores with THA, respectively. The MCII and moderate improvement thresholds were 22.4-22.7 and 39.4-40.5 respectively. Hazard ratios of revision surgery were higher with lower final score or less improvement in Mayo hip score at 2-years and borderline significant/non-significant at 5-years, respectively: (1) score ≤55 with hazard ratios of 2.24 (95% CI, 1.45, 3.46; p = 0.0003) and 1.70 (95% CI, 1.00, 2.92; p = 0.05) of implant revision subsequently, compared to 72-80 points; (2) no improvement or worsening score with hazard ratios 3.94 (95% CI, 1.50, 10.30; p = 0.005) and 2.72 (95% CI, 0.85,8.70; p = 0.09), compared to improvement >50-points. Mayo hip score had significant positive correlation with younger age, male gender, lower BMI, lower ASA class and lower Deyo-Charlson index (p ≤ 0.003 for each) and with Harris hip scores (p < 0.001). Mayo Hip Score is valid, sensitive to change and associated with future risk of revision surgery in patients with primary THA.

A Correlational Study on Critical Thinking in Nursing as an Outcome Variable for Success

ERIC Educational Resources Information Center

Porter, Rebecca Jean

2018-01-01

Critical thinking is a required curricular outcome for nursing education; however, the literature shows a gap related to valid and reliable tools to measure critical thinking specific to nursing and relating that critical thinking measurement to meaningful outcomes. This study examined critical thinking scores, as measured by Assessment…

Improving reliability of a residency interview process.

PubMed

Peeters, Michael J; Serres, Michelle L; Gundrum, Todd E

2013-10-14

To improve the reliability and discrimination of a pharmacy resident interview evaluation form, and thereby improve the reliability of the interview process. In phase 1 of the study, authors used a Many-Facet Rasch Measurement model to optimize an existing evaluation form for reliability and discrimination. In phase 2, interviewer pairs used the modified evaluation form within 4 separate interview stations. In phase 3, 8 interviewers individually-evaluated each candidate in one-on-one interviews. In phase 1, the evaluation form had a reliability of 0.98 with person separation of 6.56; reproducibly, the form separated applicants into 6 distinct groups. Using that form in phase 2 and 3, our largest variation source was candidates, while content specificity was the next largest variation source. The phase 2 g-coefficient was 0.787, while confirmatory phase 3 was 0.922. Process reliability improved with more stations despite fewer interviewers per station-impact of content specificity was greatly reduced with more interview stations. A more reliable, discriminating evaluation form was developed to evaluate candidates during resident interviews, and a process was designed that reduced the impact from content specificity.

The GRADE approach is reproducible in assessing the quality of evidence of quantitative evidence syntheses.

PubMed

Mustafa, Reem A; Santesso, Nancy; Brozek, Jan; Akl, Elie A; Walter, Stephen D; Norman, Geoff; Kulasegaram, Mahan; Christensen, Robin; Guyatt, Gordon H; Falck-Ytter, Yngve; Chang, Stephanie; Murad, Mohammad Hassan; Vist, Gunn E; Lasserson, Toby; Gartlehner, Gerald; Shukla, Vijay; Sun, Xin; Whittington, Craig; Post, Piet N; Lang, Eddy; Thaler, Kylie; Kunnamo, Ilkka; Alenius, Heidi; Meerpohl, Joerg J; Alba, Ana C; Nevis, Immaculate F; Gentles, Stephen; Ethier, Marie-Chantal; Carrasco-Labra, Alonso; Khatib, Rasha; Nesrallah, Gihad; Kroft, Jamie; Selk, Amanda; Brignardello-Petersen, Romina; Schünemann, Holger J

2013-07-01

We evaluated the inter-rater reliability (IRR) of assessing the quality of evidence (QoE) using the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach. On completing two training exercises, participants worked independently as individual raters to assess the QoE of 16 outcomes. After recording their initial impression using a global rating, raters graded the QoE following the GRADE approach. Subsequently, randomly paired raters submitted a consensus rating. The IRR without using the GRADE approach for two individual raters was 0.31 (95% confidence interval [95% CI] = 0.21-0.42) among Health Research Methodology students (n = 10) and 0.27 (95% CI = 0.19-0.37) among the GRADE working group members (n = 15). The corresponding IRR of the GRADE approach in assessing the QoE was significantly higher, that is, 0.66 (95% CI = 0.56-0.75) and 0.72 (95% CI = 0.61-0.79), respectively. The IRR further increased for three (0.80 [95% CI = 0.73-0.86] and 0.74 [95% CI = 0.65-0.81]) or four raters (0.84 [95% CI = 0.78-0.89] and 0.79 [95% CI = 0.71-0.85]). The IRR did not improve when QoE was assessed through a consensus rating. Our findings suggest that trained individuals using the GRADE approach improves reliability in comparison to intuitive judgments about the QoE and that two individual raters can reliably assess the QoE using the GRADE system. Copyright © 2013 Elsevier Inc. All rights reserved.

CT-guided sternoclavicular joint injections: description of the procedure, reliability of imaging diagnosis, and short-term patient responses.

PubMed

Peterson, Cynthia K; Saupe, Nadja; Buck, Florian; Pfirrmann, Christian W A; Zanetti, Marco; Hodler, Juerg

2010-12-01

The purpose of this study was to evaluate pain relief 20 to 30 minutes after diagnostic or therapeutic injections into the sternoclavicular joint and to compare patient outcomes based on the CT diagnosis. Informed consent was obtained from each patient. Ethics approval was not required. Fifty patients who had CT-guided injections of corticosteroid and local anesthetic into their sternoclavicular joints were included in the study. Preinjection and 20- to 30-minute postinjection visual analog scale data were recorded and compared with the imaging findings agreed by consensus. Kappa statistics were calculated for the reliability of imaging diagnosis. The percentage of patients improving after joint injection was calculated, and the risk ratio comparing the response of patients with osteoarthritis to those without osteoarthritis was completed. The correlation between the severity of each patient's osteoarthritis and the pain response was calculated using Spearman's correlation coefficient. Sixty-six percent of the patients reported clinically significant pain reduction at between 20 and 30 minutes after injection. The proportion of patients with osteoarthritis who had a clinically significant response was 67% compared with 64% for patients who did not have osteoarthritis. This difference was not statistically or clinically significant. There was no correlation between the severity of osteoarthritis and the amount of pain reduction (r = 0.03). The reliability of imaging diagnosis was substantial. Two thirds of patients having sternoclavicular joint injections of corticosteroids and local anesthetics report clinically significant improvement regardless of the abnormalities detected on their CT images.

Validity of the Special Needs Education Assessment Tool (SNEAT), a Newly Developed Scale for Children with Disabilities.

PubMed

Kohara, Aiko; Han, ChangWan; Kwon, HaeJin; Kohzuki, Masahiro

2015-11-01

The improvement of the quality of life (QOL) of children with disabilities has been considered important. Therefore, the Special Needs Education Assessment Tool (SNEAT) was developed based on the concept of QOL to objectively evaluate the educational outcome of children with disabilities. SNEAT consists of 11 items in three domains: physical functioning, mental health, and social functioning. This study aimed to verify the reliability and construct validity of SNEAT using 93 children collected from the classes on independent activities of daily living for children with disabilities in Okinawa Prefecture between October and November 2014. Survey data were collected in a longitudinal prospective cohort study. The reliability of SNEAT was verified via the internal consistency method and the test-pretest method; both the coefficient of Cronbach's α and the intra-class correlation coefficient were over 0.7. The validity of SNEAT was also verified via one-way repeated-measures ANOVA and the latent growth curve model. The scores of all the items and domains and the total scores obtained from one-way repeated-measures ANOVA were the same as the predicted scores. SNEAT is valid based on its goodness-of-fit values obtained using the latent growth curve model, where the values of comparative fit index (0.983) and root mean square error of approximation (0.062) were within the goodness-of-fit range. These results indicate that SNEAT has high reliability and construct validity and may contribute to improve QOL of children with disabilities in the classes on independent activities of daily living for children with disabilities.

Reaching clinically relevant outcome measures for new pharmacotherapy and immunotherapy of atopic eczema.

PubMed

Chalmers, Joanne; Deckert, Stefanie; Schmitt, Jochen

2015-06-01

This article describes the core outcome set (COS) for atopic eczema trials. COS describe a minimum set of outcomes to be assessed in a defined situation. COS are required to overcome the current situation of different trials using different endpoints with unclear/insufficient measurement properties resulting in incomparable trials. The global multi-stakeholder Harmonising Outcomes Measures for Eczema initiative developed the Harmonising Outcomes Measures for Eczema roadmap as a generic framework for COS development. Following the establishment of a panel representing all stakeholders, a core set of outcome domains need to be selected based on systematic reviews and consensus methods. Outcome measurement instruments to assess these core domains need to be valid, reliable, and feasible. There is broad global consensus that clinical signs, quality of life, symptoms, and long-term control of flares form the COS for atopic eczema trials. The Eczema Area and Severity Index is recommended to assess clinical signs in atopic eczema trials. Systematic reviews to identify adequate outcome measurement instruments for the other core outcome domains are underway. Clinical signs should be assessed in all atopic eczema trials by at least the Eczema Area and Severity Index. Quality of life, symptoms, and flares should also be assessed in all atopic eczema trials by a valid, reliable, and feasible instrument.

Using an evidence-based approach to measure outcomes in clinical practice.

PubMed

MacDermid, Joy C; Grewal, Ruby; MacIntyre, Norma J

2009-02-01

Evaluation of the outcome of evidence-based practice decisions in individual patients or patient groups is step five in the evidence-based practice approach. Outcome measures are any measures that reflect patient status. Status or outcome measures can be used to detect change over time (eg, treatment effects), to discriminate among clinical groups, or to predict future outcomes (eg, return to work). A variety of reliable and valid physical impairment and disability measures are available to assess treatment outcomes in hand surgery and therapy. Evidence from research studies that includes normative data, standard error of measurement, or comparative scores for important clinical subgroups can be used to set treatment goals, monitor recovery, and compare individual patient outcomes to those reported in the literature. Clinicians tend to rely on impairment measures, such as radiographic measures, grip strength, and range of motion, although self-report measures are known to be equally reliable and more related to global effects, such as return-to-work. The process of selecting and implementing outcome measures is crucial. This process works best when team members are involved and willing to trial new measures. In this way, the team can develop customized outcome assessment procedures that meet their needs for assessing individual patients and providing data for program evaluation.

Analysis of Outcomes for High Tibial Osteotomies Performed With Cartilage Restoration Techniques.

PubMed

Kahlenberg, Cynthia A; Nwachukwu, Benedict U; Hamid, Kamran S; Steinhaus, Michael E; Williams, Riley J

2017-02-01

To evaluate reported medium- to long-term outcomes after high tibial osteotomy (HTO) with associated cartilage restoration procedures. A review of the MEDLINE database was performed. The inclusion criteria were English language, clinical outcome study with HTO as the primary procedure, use of a form of cartilage repair included, and the mean follow-up period of at least 2 years. Each identified study was reviewed for study design, patient demographics, type of procedures performed, clinical outcomes, progression to total knee arthroplasty, and complications. Eight hundred and twenty-seven patients (839 knees) were included. The most common cartilage preservation technique used in conjunction with HTO was microfracture (4 studies; 22.2%). The mean Lyscholm scores, reported in 50% of the studies, ranged from 40 to 65.7 preoperatively and improved to a range of 67 to 94.6 postoperatively. Four studies (22.2%) used a visual analog scale for evaluation of pain and all had a mean visual analog scale of less than 3 postoperatively. Among studies evaluating conversion to arthroplasty, the rate of conversion was 6.8% and the range of mean number of years from HTO to conversion was 4.9 to 13.0. The overall reported complication rate was 10.3%. HTO with cartilage restoration procedures provides reliable improvement in functional status in the medium- to long-term period after surgery and has potential to delay or avoid the need for knee arthroplasty surgery. Level IV, systematic review of Level I to IV studies. Copyright © 2016 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Pediatric American College of Surgeons National Surgical Quality Improvement Program: feasibility of a novel, prospective assessment of surgical outcomes.

PubMed

Raval, Mehul V; Dillon, Peter W; Bruny, Jennifer L; Ko, Clifford Y; Hall, Bruce L; Moss, R Lawrence; Oldham, Keith T; Richards, Karen E; Vinocur, Charles D; Ziegler, Moritz M

2011-01-01

The American College of Surgeons (ACS) National Surgical Quality Improvement Program (NSQIP) provides validated assessment of surgical outcomes. This study reports initiation of an ACS NSQIP Pediatric at 4 children's hospitals. From October 2008 to June 2009, 121 data variables were prospectively collected for 3315 patients, including 30-day outcomes and tailoring the ACS NSQIP methodology to children's surgical specialties. Three hundred seven postoperative complications/occurrences were detected in 231 patients representing 7.0% of the study population. Of the patients with complications, 175 (75.7%) had 1, 39 (16.9%) had 2, and 17 (7.4%) had 3 or more complications. There were 13 deaths (0.39%) and 14 intraoperative occurrences (0.42%) detected. The most common complications were infection, 105 (34%) (SSI, 54; sepsis, 31; pneumonia, 13; urinary tract infection, 7); airway/respiratory events, 27 (9%); wound disruption, 18 (6%); neurologic events, 8 (3%) (nerve injury, 4; stroke/vascular event, 2; hemorrhage, 2); deep vein thrombosis, 3 (<1%); renal failure, 3 (<1%); and cardiac events, 3 (<1%). Current sampling captures 17.5% of cases across institutions with unadjusted complication rates ranging from 6.8% to 10.2%. Completeness of data collection for all variables exceeded 95% with 98% interrater reliability and 87% of patients having full 30-day follow-up. These data represent the first multiinstitutional prospective assessment of specialty-specific surgical outcomes in children. The ACS NSQIP Pediatric is poised for institutional expansion and future development of risk-adjusted models. Copyright © 2011 Elsevier Inc. All rights reserved.

Improving the Test-Retest Reliability of Resting State fMRI by Removing the Impact of Sleep.

PubMed

Wang, Jiahui; Han, Junwei; Nguyen, Vinh T; Guo, Lei; Guo, Christine C

2017-01-01

Resting state functional magnetic resonance imaging (rs-fMRI) provides a powerful tool to examine large-scale neural networks in the human brain and their disturbances in neuropsychiatric disorders. Thanks to its low demand and high tolerance, resting state paradigms can be easily acquired from clinical population. However, due to the unconstrained nature, resting state paradigm is associated with excessive head movement and proneness to sleep. Consequently, the test-retest reliability of rs-fMRI measures is moderate at best, falling short of widespread use in the clinic. Here, we characterized the effect of sleep on the test-retest reliability of rs-fMRI. Using measures of heart rate variability (HRV) derived from simultaneous electrocardiogram (ECG) recording, we identified portions of fMRI data when subjects were more alert or sleepy, and examined their effects on the test-retest reliability of functional connectivity measures. When volumes of sleep were excluded, the reliability of rs-fMRI is significantly improved, and the improvement appears to be general across brain networks. The amount of improvement is robust with the removal of as much as 60% volumes of sleepiness. Therefore, test-retest reliability of rs-fMRI is affected by sleep and could be improved by excluding volumes of sleepiness as indexed by HRV. Our results suggest a novel and practical method to improve test-retest reliability of rs-fMRI measures.

Assessing learning outcomes in middle-division classical mechanics: The Colorado Classical Mechanics and Math Methods Instrument

NASA Astrophysics Data System (ADS)

Caballero, Marcos D.; Doughty, Leanne; Turnbull, Anna M.; Pepper, Rachel E.; Pollock, Steven J.

2017-06-01

Reliable and validated assessments of introductory physics have been instrumental in driving curricular and pedagogical reforms that lead to improved student learning. As part of an effort to systematically improve our sophomore-level classical mechanics and math methods course (CM 1) at CU Boulder, we have developed a tool to assess student learning of CM 1 concepts in the upper division. The Colorado Classical Mechanics and Math Methods Instrument (CCMI) builds on faculty consensus learning goals and systematic observations of student difficulties. The result is a 9-question open-ended post test that probes student learning in the first half of a two-semester classical mechanics and math methods sequence. In this paper, we describe the design and development of this instrument, its validation, and measurements made in classes at CU Boulder and elsewhere.