Measuring outcomes in children's rehabilitation: a decision protocol.

PubMed

Law, M; King, G; Russell, D; MacKinnon, E; Hurley, P; Murphy, C

1999-06-01

To develop and test the feasibility and clinical utility of a computerized self-directed software program designed to enable service providers in children's rehabilitation to make decisions about the most appropriate outcome measures to use in client and program evaluation. A before-and-after design was used to test the feasibility and initial impact of the decision-making outcome software in improving knowledge and use of clinical outcome measures. A children's rehabilitation center in a city of 50,000. All service providers in the children's rehabilitation center. Disciplines represented included early childhood education, occupational therapy, physical therapy, speech and language pathology, audiology, social work, and psychology. Using a conceptual framework based on the International Classification of Impairment, Disability, and Handicap (ICIDH), an outcome measurement decision-making protocol was developed. The decision-making protocol was computerized in an educational software program with an attached database of critically appraised measures. Participants learned about outcome measures through the program and selected outcome measures that met their specifications. The computer software was tested for feasibility in the children's rehabilitation center for 6 months. Knowledge and use of clinical outcome measures were determined before and after the feasibility testing using a survey of all service providers currently at the centre and audits of 30 randomly selected rehabilitation records (at pretest, posttest, and follow-up). Service providers indicated that the outcomes software was easy to follow and believed that the use of the ICIDH framework helped them in making decisions about selecting outcome measures. Results of the survey indicated that there were significant changes in the service providers' level of comfort with selecting measures and knowing what measures were available. Use of outcome measures as identified through the audit did not change. The "All About Outcomes" software is clinically useful. Further research should evaluate whether using the software affects the use of outcome measures in clinical practice.

Implicit Measures: A Normative Analysis and Review

ERIC Educational Resources Information Center

De Houwer, Jan; Teige-Mocigemba, Sarah; Spruyt, Adriaan; Moors, Agnes

2009-01-01

Implicit measures can be defined as outcomes of measurement procedures that are caused in an automatic manner by psychological attributes. To establish that a measurement outcome is an implicit measure, one should examine (a) whether the outcome is causally produced by the psychological attribute it was designed to measure, (b) the nature of the…

Clinical assessment and patient-reported outcome measures in low-back pain - a survey among primary health care physiotherapists.

PubMed

Östhols, Sara; Boström, Carina; Rasmussen-Barr, Eva

2018-05-09

We aimed to map the physiotherapy practice in Sweden of clinical tests and patient-reported outcome measures in low-back pain (LBP), and to study advantages and barriers in using patient-reported outcome measures. An online survey was mailed to 4934 physiotherapists in primary health care in Sweden. Multiple choice questions investigated the use of clinical tests and patient-reported outcome measures in assessing patients with LBP. Open questions investigating the advantages and barriers to the use of patient-reported outcome measures were analyzed with content analysis. The response rate was 25% (n = 1217). Clinical tests were used "always/often" by >60% of the participants, while most patient-reported outcome measures were used by <15%. Advantages in using patient-reported outcome measures were: the clinical reasoning process, to increase the quality of assessment, to get the patient's voice, education and motivation of patients, and communication with health professionals. Barriers were lack of time and knowledge, administrative aspects, the interaction between physiotherapist and patient and, the applicability and validity of the patient-reported outcome measures. Our findings show that physiotherapists working in primary health care use clinical testing in LBP to a great extent, while various patient-reported outcome measures are used to a low-to-very-low extent. Several barriers to the use of patient-reported outcome measures were reported such as time, knowledge, and administrative issues, while important findings on advantages were to enhance the clinical reasoning process and to educate and motivate the patient. Barriers might be changed through education or organizational change-work. To enhance the use of patient-reported outcome measures and thus person-centered care in low-back pain, recommendation, and education on various patient-reported outcome measures need to be advocated. Implications for rehabilitation To increase the effects of rehabilitation in low-back pain, yellow flags, and other factors need to be taken into the consideration in the assessment which means the use of patient-reported outcome measures in addition to clinical testing. The use of patient-reported outcome measures is an advantage in the clinical reasoning process to enhance the quality of assessment and to educate and motivate the patient. Barriers to use patient-reported outcome measures are mainly lack of time and knowledge, and administrative aspects. Through education or organizational change-work, barriers to the use of patient-reported outcome measures might be changed.

Staff perceptions of using outcome measures in stroke rehabilitation.

PubMed

Burton, Louisa-Jane; Tyson, Sarah; McGovern, Alison

2013-05-01

The use of standardised outcome measures is an integral part of stroke rehabilitation and is widely recommended as good practice. However, little is known about how measures are actually used or their impact. This study aimed to identify current clinical practice; how healthcare professionals working in stroke rehabilitation use outcome measures and their perceptions of the benefits and barriers to use. Eighty-four Health Care Professionals and 12 service managers and commissioners working in stroke services across a large UK county were surveyed by postal questionnaire. Ninety-six percent of clinical respondents used at least one measure, however, less than half used measures regularly during a patient's stay. The mean number of tools used was 3.2 (SD = 1.9). Eighty-one different tools were identified; 16 of which were unpublished and unvalidated. Perceived barriers in using outcome measures in day-to-day clinical practice included lack of resources (time and training) and lack of knowledge of appropriate measures. Benefits identified were to demonstrate the effectiveness of rehabilitation interventions and monitor patients' progress. Although the use of outcome measures is prevalent in clinical practice, there is little consistency in the tools utilised. The term "outcome measures" is used, but staff rarely used the measures at appropriate time points to formally assess and evaluate outcome. The term "measurement tool" more accurately reflects the purposes to which they were put and potential benefits. Further research to overcome the barriers in using standardised measurement tools and evaluate the impact of implementation on clinical practice is needed. • Health professionals working in stroke rehabilitation should work together to agree when and how outcome measures can be most effectively used in their service. • Efforts should be made to ensure that standardised tools are used to measure outcome at set time-points during rehabilitation, in order to achieve the anticipated benefits. • Communication between service providers and commissioners could be improved to highlight the barriers in using standardised measures of outcome.

Development, reliability, and validity of the Alberta Perinatal Stroke Project Parental Outcome Measure.

PubMed

Bemister, Taryn B; Brooks, Brian L; Kirton, Adam

2014-07-01

Perinatal stroke is a leading cause of cerebral palsy and lifelong disability, although parent and family outcomes have not yet been studied in this specific population. The Alberta Perinatal Stroke Project Parental Outcome Measure was developed as a 26-item questionnaire on the impact of perinatal stroke on parents and families. The items were derived from expert opinion and scientific literature on issues salient to parents of children with perinatal stroke, including guilt and blame, which are not well captured in existing measures of family impact. Data were collected from 82 mothers and 28 fathers who completed the Parental Outcome Measure and related questionnaires (mean age, 39.5 years; mean child age, 7.4 years). Analyses examined the Parental Outcome Measure's internal consistency, test-retest reliability, validity, and factor structure. The Parental Outcome Measure demonstrated three unique theoretical constructs: Psychosocial Impact, Guilt, and Blame. The Parental Outcome Measure has excellent internal consistency (Cronbach α = 0.91) and very good test-retest reliability more than 2-5 weeks (r = 0.87). Regarding validity, the Parental Outcome Measure is sensitive to condition severity, accounts for additional variance in parent outcomes, and strongly correlates with measures of anxiety, depression, stress, quality of life, family functioning, and parent adjustment. The Parental Outcome Measure contributes to the literature as the first brief measure of family impact designed for parents of children with perinatal stroke. Copyright © 2014 Elsevier Inc. All rights reserved.

Factors influencing the use of outcome measures in physical therapy practice.

PubMed

Wedge, Frances M; Braswell-Christy, Jennifer; Brown, Cynthia J; Foley, Kathleen T; Graham, Cecilia; Shaw, Sharon

2012-02-01

Use of outcome measures in physical therapy practice is central to evaluating the effectiveness of treatment interventions, providing accountability and addressing quality of physical therapy programs. There is limited discussion on barriers and facilitators to using outcome measures in physical therapy practice. The purpose of this study was to identify factors that influence a physical therapist when deciding to use outcome measures in clinical practice. Participants were 21 physical therapists, seven each from skilled nursing facilities, outpatient clinics, and inpatient rehabilitation facilities. A grounded theory approach was used for interview and data collection. Common themes were determined from the data and a theory developed to explain the rationale behind physical therapists' decisions to use or not use outcome measures in clinical practice. Three overlapping themes related to (1) concepts of time, (2) knowledge, and (3) facility culture were indentified as factors influencing the use of outcome measures. A fourth encompassing theme, professionalism, identified the value placed on the use of outcome measures in practice. Data revealed that therapists require more information on the outcome measures available, and this information needs to be easily accessible within the workplace. Therapists value information generated by using outcome measures in the clinical setting, but need information on what measures are available and psychometric properties. Information must be easily accessible and measures easy to use. Newer graduates and recent learners have a foundation in the use of outcome measures, but more needs to be done in the clinic and through continuing education to promote increased use and understanding.

Quality, Safety, Value: From Theory to Practice Management What Should We Measure?

PubMed

Shore, Benjamin J; Murphy, Robert F; Hogue, Grant D

2015-01-01

Over the past 35 years the health care community and in particular orthopaedic surgery, has undergone a transformation from retrospective case-series-based expert opinion to randomized prospective clinical trials. During this transition, orthopaedic surgeons have become very skilled in the measurement of physician-derived outcomes (radiographic angles, complications, recurrences, and mortality); however, these are not patient-centered outcomes and they are of little importance to our patients' satisfaction. Moving forward outcome measurement needs to be restructured to focus more on patient-reported outcomes. This paper outlines why outcome measurement is important, reviews outcome strategies that have been used historically, introduces a new outcome measurement tool and identifies strategies for future implementation and measurement of health care quality and value within pediatric orthopaedics.

A method for developing outcome measures in the clinical laboratory.

PubMed

Jones, J

1996-01-01

Measuring and reporting outcomes in health care is becoming more important for quality assessment, utilization assessment, accreditation standards, and negotiating contracts in managed care. How does one develop an outcome measure for the laboratory to assess the value of the services? A method is described which outlines seven steps in developing outcome measures for a laboratory service or process. These steps include the following: 1. Identify the process or service to be monitored for performance and outcome assessment. 2. If necessary, form an multidisciplinary team of laboratory staff, other department staff, physicians, and pathologists. 3. State the purpose of the test or service including a review of published data for the clinical pathological correlation. 4. Prepare a process cause and effect diagram including steps critical to the outcome. 5. Identify key process variables that contribute to positive or negative outcomes. 6. Identify outcome measures that are not process measures. 7. Develop an operational definition, identify data sources, and collect data. Examples, including a process cause and effect diagram, process variables, and outcome measures, are given using the Therapeutic Drug Monitoring service (TDM). A summary of conclusions and precautions for outcome measurement is then provided.

Health Plan Performance Measurement within Medicare Subvention.

DTIC Science & Technology

1998-06-01

the causes of poor performance (Siren & Laffel, 1996). Although outcomes measures such as nosocomial infection rates, admission rates for select...defined. Traditional outcomes measures include infection rates, morbidity, and mortality. The problem with these traditional measures is... Maternal /Child Care Indicators Nursing Staffing Indicators Outcome Indicators Technical Outcomes Plan Performance Stability of Health Plan

Measurement tools and outcome measures used in transitional patient safety; a systematic review.

PubMed

van Melle, Marije A; van Stel, Henk F; Poldervaart, Judith M; de Wit, Niek J; Zwart, Dorien L M

2018-01-01

Patients are at risk for harm when treated simultaneously by healthcare providers from different healthcare organisations. To assess current practice and improvements of transitional patient safety, valid measurement tools are needed. To identify and appraise all measurement tools and outcomes that measure aspects of transitional patient safety, PubMed, Cinahl, Embase and Psychinfo were systematically searched. Two researchers performed the title and abstract and full-text selection. First, publications about validation of measurement tools were appraised for quality following COSMIN criteria. Second, we inventoried all measurement tools and outcome measures found in our search that assessed current transitional patient safety or the effect of interventions targeting transitional patient safety. The initial search yielded 8288 studies, of which 18 assessed validity of measurement tools of different aspects of transitional safety, and 191 assessed current transitional patient safety or effect of interventions. In the validated measurement tools, the overall quality of content and structural validity was acceptable; other COSMIN criteria, such as reliability, measurement error and responsiveness, were mostly poor or not reported. In our outcome inventory, the most frequently used validated outcome measure was the Care Transition Measure (n = 9). The most frequently used non-validated outcome measures were: medication discrepancies (n = 98), hospital readmissions (n = 55), adverse events (n = 34), emergency department visits (n = 33), (mental or physical) health status (n = 28), quality and timeliness of discharge summary, and patient satisfaction (n = 23). Although no validated measures exist that assess all aspects of transitional patient safety, we found validated measurement tools on specific aspects. Reporting of validity of transitional measurement tools was incomplete. Numerous outcome measures with unknown measurement properties are used in current studies on safety of care transitions, which makes interpretation or comparison of their results uncertain.

Quality Measures for the Care of Adult Patients with Obstructive Sleep Apnea

PubMed Central

Aurora, R. Nisha; Collop, Nancy A.; Jacobowitz, Ofer; Thomas, Sherene M.; Quan, Stuart F.; Aronsky, Amy J.

2015-01-01

Obstructive sleep apnea (OSA) is a prevalent disorder associated with a multitude of adverse outcomes when left untreated. There is significant heterogeneity in the evaluation and management of OSA resulting in variation in cost and outcomes. Thus, the goal for developing these measures was to have a way to evaluate the outcomes and reliability of the processes involved with the standard care approaches used in the diagnosis and management of OSA. The OSA quality care measures presented here focus on both outcomes and processes. The AASM commissioned the Adult OSA Quality Measures Workgroup to develop quality care measures aimed at optimizing care for adult patients with OSA. These quality care measures developed by the Adult OSA Quality Measures Workgroup are an extension of the original Centers for Medicare & Medicaid Services (CMS) approved Physician Quality Reporting System (PQRS) measures group for OSA. The measures are based on the available scientific evidence, focus on public safety, and strive to improve quality of life and cardiovascular outcomes for individual OSA patients. The three outcomes that were selected were as follows: (1) improve disease detection and categorization; (2) improve quality of life; and (3) reduce cardiovascular risk. After selecting these relevant outcomes, a total of ten process measures were chosen that could be applied and assessed for the purpose of accomplishing these outcomes. In the future, the measures described in this document may be reported through the PQRS in addition to, or as a replacement for, the current OSA measures group. The overall objective for the development of these measures is that implementation of these quality measures will result in improved patient outcomes, reduce the public health burden of OSA, and provide a measurable standard for evaluating and managing OSA. Citation: Aurora RN, Collop NA, Jacobowitz O, Thomas SM, Quan SF, Aronsky AJ. Quality measures for the care of adult patients with obstructive sleep apnea. J Clin Sleep Med 2015;11(3):357–383. PMID:25700878

A Scoping Review of Physical Performance Outcome Measures Used in Exercise Interventions for Older Adults With Alzheimer Disease and Related Dementias.

PubMed

McGough, Ellen L; Lin, Shih-Yin; Belza, Basia; Becofsky, Katie M; Jones, Dina L; Liu, Minhui; Wilcox, Sara; Logsdon, Rebecca G

2017-11-28

There is growing evidence that exercise interventions can mitigate functional decline and reduce fall risk in older adults with Alzheimer disease and related dementias (ADRD). Although physical performance outcome measures have been successfully used in older adults without cognitive impairment, additional research is needed regarding their use with individuals who have ADRD, and who may have difficulty following instructions regarding performance of these measures. The purpose of this scoping review was to identify commonly used physical performance outcome measures, for exercise interventions, that are responsive and reliable in older adults with ADRD. Ultimately, we aimed to provide recommendations regarding the use of outcome measures for individuals with ADRD across several domains of physical performance. A scoping review was conducted to broadly assess physical performance outcome measures used in exercise interventions for older adults with ADRD. Exercise intervention studies that included at least 1 measure of physical performance were included. All physical performance outcome measures were abstracted, coded, and categorized into 5 domains of physical performance: fitness, functional mobility, gait, balance, and strength. Criteria for recommendations were based on (1) the frequency of use, (2) responsiveness, and (3) reliability. Frequency was determined by the number of studies that used the outcome measure per physical performance domain. Responsiveness was assessed via calculated effect size of the outcome measures across studies within physical performance domains. Reliability was evaluated via published studies of psychometric properties. A total of 20 physical performance outcome measures were extracted from 48 articles that met study inclusion criteria. The most frequently used outcome measures were the 6-minute walk test, Timed Up and Go, repeated chair stand tests, short-distance gait speed, the Berg Balance Scale, and isometric strength measures. These outcome measures demonstrated a small, medium, or large effect in at least 50% of the exercise intervention studies. Good to excellent reliability was reported in samples of older adults with mild to moderate dementia. Fitness, functional mobility, gait, balance, and strength represent important domains of physical performance for older adults. The 6-minute walk test, Timed Up and Go, repeated chair stand tests, short-distance gait speed, Berg Balance Scale, and isometric strength are recommended as commonly used and reliable physical performance outcome measures for exercise interventions in older adults with mild to moderate ADRD. Further research is needed on optimal measures for individuals with severe ADRD. The results of this review will aid clinicians and researchers in selecting reliable measures to evaluate physical performance outcomes in response to exercise interventions in older adults with ADRD.

NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

PubMed

Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

2016-12-07

Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately improve care provided to infants with HD.

Generating Outcome Measurements: Economic and Societal. A Guide to Educational Outcomes Measurements and Their Uses. Seminar No. 4.

ERIC Educational Resources Information Center

Mushkin, Selma J.; Billings, Bradley B.

This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministires, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with generating outcome measurements:…

Quality Measures for the Care of Patients with Narcolepsy

PubMed Central

Krahn, Lois E.; Hershner, Shelley; Loeding, Lauren D.; Maski, Kiran P.; Rifkin, Daniel I.; Selim, Bernardo; Watson, Nathaniel F.

2015-01-01

The American Academy of Sleep Medicine (AASM) commissioned a Workgroup to develop quality measures for the care of patients with narcolepsy. Following a comprehensive literature search, 306 publications were found addressing quality care or measures. Strength of association was graded between proposed process measures and desired outcomes. Following the AASM process for quality measure development, we identified three outcomes (including one outcome measure) and seven process measures. The first desired outcome was to reduce excessive daytime sleepiness by employing two process measures: quantifying sleepiness and initiating treatment. The second outcome was to improve the accuracy of diagnosis by employing the two process measures: completing both a comprehensive sleep history and an objective sleep assessment. The third outcome was to reduce adverse events through three steps: ensuring treatment follow-up, documenting medical comorbidities, and documenting safety measures counseling. All narcolepsy measures described in this report were developed by the Narcolepsy Quality Measures Work-group and approved by the AASM Quality Measures Task Force and the AASM Board of Directors. The AASM recommends the use of these measures as part of quality improvement programs that will enhance the ability to improve care for patients with narcolepsy. Citation: Krahn LE, Hershner S, Loeding LD, Maski KP, Rifkin DI, Selim B, Watson NF. Quality measures for the care of patients with narcolepsy. J Clin Sleep Med 2015;11(3):335–355. PMID:25700880

Standards for definitions and use of outcome measures for clinical effectiveness research in perioperative medicine: European Perioperative Clinical Outcome (EPCO) definitions: a statement from the ESA-ESICM joint taskforce on perioperative outcome measures.

PubMed

Jammer, Ib; Wickboldt, Nadine; Sander, Michael; Smith, Andrew; Schultz, Marcus J; Pelosi, Paolo; Leva, Brigitte; Rhodes, Andrew; Hoeft, Andreas; Walder, Bernhard; Chew, Michelle S; Pearse, Rupert M

2015-02-01

There is a need for large trials that test the clinical effectiveness of interventions in the field of perioperative medicine. Clinical outcome measures used in such trials must be robust, clearly defined and patient-relevant. Our objective was to develop standards for the use of clinical outcome measures to strengthen the methodological quality of perioperative medicine research. A literature search was conducted using PubMed and opinion leaders worldwide were invited to nominate papers that they believed the group should consider. The full texts of relevant articles were reviewed by the taskforce members and then discussed to reach a consensus on the required standards. The report was then circulated to opinion leaders for comment and review. This report describes definitions for 22 individual adverse events with a system of severity grading for each. In addition, four composite outcome measures were identified, which were designed to evaluate postoperative outcomes. The group also agreed on standards for four outcome measures for the evaluation of healthcare resource use and quality of life. Guidance for use of these outcome measures is provided, with particular emphasis on appropriate duration of follow-up. This report provides clearly defined and patient-relevant outcome measures for large clinical trials in perioperative medicine. These outcome measures may also be of use in clinical audit. This report is intended to complement and not replace other related work to improve assessment of clinical outcomes following specific surgical procedures.

Standardized Outcome Measurement for Patients With Coronary Artery Disease: Consensus From the International Consortium for Health Outcomes Measurement (ICHOM).

PubMed

McNamara, Robert L; Spatz, Erica S; Kelley, Thomas A; Stowell, Caleb J; Beltrame, John; Heidenreich, Paul; Tresserras, Ricard; Jernberg, Tomas; Chua, Terrance; Morgan, Louise; Panigrahi, Bishnu; Rosas Ruiz, Alba; Rumsfeld, John S; Sadwin, Lawrence; Schoeberl, Mark; Shahian, David; Weston, Clive; Yeh, Robert; Lewin, Jack

2015-05-19

Coronary artery disease (CAD) outcomes consistently improve when they are routinely measured and provided back to physicians and hospitals. However, few centers around the world systematically track outcomes, and no global standards exist. Furthermore, patient-centered outcomes and longitudinal outcomes are under-represented in current assessments. The nonprofit International Consortium for Health Outcomes Measurement (ICHOM) convened an international Working Group to define a consensus standard set of outcome measures and risk factors for tracking, comparing, and improving the outcomes of CAD care. Members were drawn from 4 continents and 6 countries. Using a modified Delphi method, the ICHOM Working Group defined who should be tracked, what should be measured, and when such measurements should be performed. The ICHOM CAD consensus measures were designed to be relevant for all patients diagnosed with CAD, including those with acute myocardial infarction, angina, and asymptomatic CAD. Thirteen specific outcomes were chosen, including acute complications occurring within 30 days of acute myocardial infarction, coronary artery bypass grafting surgery, or percutaneous coronary intervention; and longitudinal outcomes for up to 5 years for patient-reported health status (Seattle Angina Questionnaire [SAQ-7], elements of Rose Dyspnea Score, and Patient Health Questionnaire [PHQ-2]), cardiovascular hospital admissions, cardiovascular procedures, renal failure, and mortality. Baseline demographic, cardiovascular disease, and comorbidity information is included to improve the interpretability of comparisons. ICHOM recommends that this set of outcomes and other patient information be measured for all patients with CAD. © 2015 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley Blackwell.

The Development of NOAA Education Common Outcome Performance Measures (Invited)

NASA Astrophysics Data System (ADS)

Baek, J.

2013-12-01

The National Oceanic and Atmospheric Administration (NOAA) Education Council has embarked on an ambitious Monitoring and Evaluation (M&E) project that will allow it to assess education program outcomes and impacts across the agency, line offices, and programs. The purpose of this internal effort is to link outcome measures to program efforts and to evaluate the success of the agency's education programs in meeting the strategic goals. Using an outcome-based evaluation approach, the NOAA Education Council is developing two sets of common outcome performance measures, environmental stewardship and professional development. This presentation will examine the benefits and tradeoffs of common outcome performance measures that collect program results across a portfolio of education programs focused on common outcomes. Common outcome performance measures have a few benefits to our agency and to the climate education field at large. The primary benefit is shared understanding, which comes from our process for writing common outcome performance measures. Without a shared and agreed upon set of definitions for the measure of an outcome, the reported results may not be measuring the same things and would incorrectly indicate levels of performance. Therefore, our writing process relies on a commitment to developing a shared set of definitions based on consensus. We hope that by taking the time to debate and coming to agreement across a diverse set of programs, the strength of our common measures can indicate real progress towards outcomes we care about. An additional benefit is that these common measures can be adopted and adapted by other agencies and organizations that share similar theories of change. The measures are not without their drawbacks, and we do make tradeoffs as part of our process in order to continue making progress. We know that any measure is necessarily a narrow slice of performance. A slice that may not best represent the unique and remarkable contribution of an individual program, but does reflect a variety of contributions along a single dimension across a large portfolio of programs. The process has ended up pushing our working group to call for even more measures, to capture an increasing number of dimensions that reflect the nature of the portfolio of programs. This past year we have been working on developing two sets of common outcome performance measures for professional development (PD) and stewardship education programs. The outcome we chose for PD programs was the use of what was learned in the educator's practice. The outcome we chose for stewardship programs was the stewardship behaviors that participants learn and practice. The measurement of these outcomes will inform whether our strategies are having their intended impact. By knowing how and how much these outcomes are occurring as a result of our program, we can improve program performance over time. The common outcome performance measures help demonstrate how these programs engage audiences in supporting NOAA's mission. As AGU climate literacy community continues to grow, it is important to consider an approach to demonstrate the community's contribution to the Nation's climate literacy. Development of common outcome performance measures is one approach that could help focus the community in meeting its goals.

Systematic Review of Treatment Outcome Measures for Vulvodynia.

PubMed

Sadownik, Leslie A; Yong, Paul J; Smith, Kelly B

2018-07-01

To systematically evaluate the literature regarding vulvodynia treatment outcome measures. A systematic literature search on OVID, PubMed, and PsycINFO databases was conducted from inception until May 2016. Studies were included/excluded based on prespecified criteria. Reported outcome measures were organized into 6 core outcome domains recommended by the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT): pain; physical functioning, emotional functioning, participant ratings of global improvement and satisfaction with treatment, symptoms and adverse events, and participant disposition. Of the 206 articles identified for full-text screening, 33 met our criteria. One study adhered to all IMMPACT recommendations. The number of outcomes measured per study ranged from 1 to greater than 20. Patient-reported pain outcomes were found in the majority (27/33; 82%) of studies. Pain severity with intercourse was reported by 24 (73%) of 33 studies-9 different scales were used to measure this outcome. Clinician-reported outcomes were present in 14 (42%) of 33 studies. Methods of measuring vestibular sensitivity by "cotton swab" test were different in 8 of 10 studies. Other domains reported included; physical function (8/33 studies; 24%), sexual function (23/33 studies; 70%), and emotional function (13/33 studies; 39%). Symptoms and adverse events were reported by 15 (45%) of 33 studies. One study formally reported participant disposition using all the information recommended by CONSORT. Comparison of clinical trial results in vulvodynia is not possible because of a lack of standard treatment outcome measures. Vulvodynia researchers should apply the IMMPACT criteria to guide the development of a minimum core set of standard outcome measures that measure holistic health.

Recommendations for the Use of Common Outcome Measures in Pediatric Traumatic Brain Injury Research

PubMed Central

Wilde, Elisabeth A.; Anderson, Vicki A.; Bedell, Gary; Beers, Sue R.; Campbell, Thomas F.; Chapman, Sandra B.; Ewing-Cobbs, Linda; Gerring, Joan P.; Gioia, Gerard A.; Levin, Harvey S.; Michaud, Linda J.; Prasad, Mary R.; Swaine, Bonnie R.; Turkstra, Lyn S.; Wade, Shari L.; Yeates, Keith O.

2012-01-01

Abstract This article addresses the need for age-relevant outcome measures for traumatic brain injury (TBI) research and summarizes the recommendations by the inter-agency Pediatric TBI Outcomes Workgroup. The Pediatric Workgroup's recommendations address primary clinical research objectives including characterizing course of recovery from TBI, prediction of later outcome, measurement of treatment effects, and comparison of outcomes across studies. Consistent with other Common Data Elements (CDE) Workgroups, the Pediatric TBI Outcomes Workgroup adopted the standard three-tier system in its selection of measures. In the first tier, core measures included valid, robust, and widely applicable outcome measures with proven utility in pediatric TBI from each identified domain including academics, adaptive and daily living skills, family and environment, global outcome, health-related quality of life, infant and toddler measures, language and communication, neuropsychological impairment, physical functioning, psychiatric and psychological functioning, recovery of consciousness, social role participation and social competence, social cognition, and TBI-related symptoms. In the second tier, supplemental measures were recommended for consideration in TBI research focusing on specific topics or populations. In the third tier, emerging measures included important instruments currently under development, in the process of validation, or nearing the point of published findings that have significant potential to be superior to measures in the core and supplemental lists and may eventually replace them as evidence for their utility emerges. PMID:21644810

An investigation of outcome expectancies as a predictor of treatment response for combat veterans with PTSD: comparison of clinician, self-report, and biological measures.

PubMed

Price, Matthew; Maples, Jessica L; Jovanovic, Tanja; Norrholm, Seth D; Heekin, Mary; Rothbaum, Barbara O

2015-06-01

Outcome expectancy, or the degree to which a client believes that therapy will result in improvement, is related to improved treatment outcomes for multiple disorders. There is a paucity of research investigating this relation in regards to posttraumatic stress disorder (PTSD). Additionally, the bulk of the research on outcome expectancy and treatment outcomes has relied mostly on self-report outcome measures. The relation between outcome expectancy on self-report measures, clinician-rated measures, and two biological indices (fear-potentiated startle and cortisol reactivity) of PTSD symptoms was explored. The sample included combat veterans (N = 116) treated with virtual reality exposure therapy for PTSD. Results supported a negative association between outcome expectancy and both self-report and clinician-rated symptoms at the conclusion of treatment, but outcome expectancy was related to the magnitude of change during treatment for self-report measures only. Outcome expectancy was unrelated to biological measures of treatment response. These findings suggest that outcome expectancy may be related to patient and clinician perceptions of outcomes, but not biological indices of outcome for PTSD. © 2015 Wiley Periodicals, Inc.

Outcome measures for clinical rehabilitation trials: impairment, function, quality of life, or value?

PubMed

Wade, Derick T

2003-10-01

Choosing outcome measures in rehabilitation research depends on the standard research skills of clear thinking, attention to detail, and minimizing the amount of data collected. In rehabilitation, outcome is more difficult to measure because (1) usually several outcomes are relevant, (2) relevant outcomes are affected by multiple factors in addition to treatment, and (3) even good measures rarely reflect the specific interest of any individual patient or member of the rehabilitation team, leading to some dissent. Measurement of general quality of life is not possible because there is little agreement as to the nature of the construct; moreover, measurement of relevant aspects of quality of life would probably give similar results. Cost in terms of resources can be estimated, but there is no validated or even widely accepted method of relating this to benefit in a fair, open, and rational way. Outcome is best measured at the level of behavior (activities), with other measures being used to aid interpretation.

Facility-level outcome performance measures for nursing homes.

PubMed

Porell, F; Caro, F G

1998-12-01

Risk-adjusted nursing home performance scores were developed for four health outcomes and five quality indicators from resident-level longitudinal case-mix reimbursement data for Medicaid residents of more than 500 nursing homes in Massachusetts. Facility performance was measured by comparing actual resident outcomes with expected outcomes derived from quarterly predictions of resident-level econometric models over a 3-year period (1991-1994). Performance measures were tightly distributed among facilities in the state. The intercorrelations among the nine outcome performance measures were relatively low and not uniformly positive. Performance measures were not highly associated with various structural facility attributes. For most outcomes, longitudinal analyses revealed only modest correlations between a facility's performance score from one time period to the next. Relatively few facilities exhibited consistent superior or inferior performance over time. The findings have implications toward the practical use of facility outcome performance measures for quality assurance and reimbursement purposes in the near future.

Development of a core outcome set for use in determining the overall success of gastroschisis treatment.

PubMed

Allin, Benjamin; Ross, Andrew; Marven, Sean; J Hall, Nigel; Knight, Marian

2016-07-27

Gastroschisis research is limited in quality by the presence of significant heterogeneity in outcome measure reporting (PloS One 10(1):e0116908, 2015). Using core outcome sets in research is one proposed method for addressing this problem (Trials 13:103, 2012; Clin Rheumatol 33(9):1313-1322, 2014; Health Serv Res Policy 17(1):1-2, 2012). Ultimately, standardising outcome measure reporting will improve research quality and translate into improvements in patient care. Candidate outcome measures have been identified through systematic reviews. These outcome measures will form the starting point for an online, three-phase Delphi process that will be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel, panel 2 is a non-neonatal panel and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1-9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's gastroschisis treatment. In round 2, experts will be presented with the same list of outcome measures and with graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. The results of the Delphi process will be discussed, and outcomes re-scored. Outcome measures where > 70 % of the participants at the meeting scored them as 7-9 and < 15 % scored them as 1-3 will form the core outcome set. Development of a core outcome set will help to reduce the heterogeneity of the outcome measure reporting in gastroschisis. This will increase the quality of research taking place and ultimately improve care provided to infants with gastroschisis.

Current Status, Goals, and Research Agenda for Outcome Measures Development in Behçet Syndrome: Report from OMERACT 2014.

PubMed

Hatemi, Gulen; Ozguler, Yesim; Direskeneli, Haner; Mahr, Alfred; Gul, Ahmet; Levi, Virna; Aydin, Sibel Z; Mumcu, Gonca; Sertel-Berk, Ozlem; Stevens, Randall M; Yazici, Hasan; Merkel, Peter A

2015-12-01

There is an unmet need for reliable, validated, and widely accepted outcomes and outcome measures for use in clinical trials in Behçet syndrome (BS). Our report summarizes initial steps taken by the Outcome Measures in Rheumatology (OMERACT) vasculitis working group toward developing a core set of outcome measures for BS according to the OMERACT methodology, including the OMERACT Filter 2.0, and discussions during the first meeting of the BS working group held during OMERACT 12 (2014). During OMERACT 12, some of the important challenges in developing outcomes for BS were outlined and discussed, and a research agenda was drafted. Among topics discussed were the advantages and disadvantages of a composite measure for BS that evaluates several organs/organ systems; bringing patients and physicians together for discussions about how to assess disease activity; use of organ-specific measures developed for other diseases; and the inclusion of generic, disease-specific, or organ-specific measures. The importance of incorporating patients' perspectives, concerns, and ideas into outcome measure development was emphasized. The planned research agenda includes conducting a Delphi exercise among physicians from different specialties that are involved in the care of patients with BS and among patients with BS, with the aim of identifying candidate domains and subdomains to be assessed in randomized clinical trials of BS, and candidate items for a composite measure. The ultimate goal of the group is to develop a validated and widely accepted core set of outcomes and outcome measures for use in clinical trials in BS.

Current Status, Goals, and Research Agenda for Outcome Measures Development in Behçet Syndrome: Report from OMERACT 2014

PubMed Central

Hatemi, Gulen; Ozguler, Yesim; Direskeneli, Haner; Mahr, Alfred; Gul, Ahmet; Levi, Virna; Aydin, Sibel Z.; Mumcu, Gonca; Sertel-Berk, Ozlem; Stevens, Randall M.; Yazici, Hasan; Merkel, Peter A.

2016-01-01

Objective There is an unmet need for reliable, validated, and widely accepted outcomes and outcome measures for use in clinical trials in Behçet syndrome (BS). Our report summarizes initial steps taken by the Outcome Measures in Rheumatology (OMERACT) vasculitis working group toward developing a core set of outcome measures for BS according to the OMERACT methodology, including the OMERACT Filter 2.0, and discussions during the first meeting of the BS working group held during OMERACT 12 (2014). Methods During OMERACT 12, some of the important challenges in developing outcomes for BS were outlined and discussed, and a research agenda was drafted. Results Among topics discussed were the advantages and disadvantages of a composite measure for BS that evaluates several organs/organ systems; bringing patients and physicians together for discussions about how to assess disease activity; use of organ-specific measures developed for other diseases; and the inclusion of generic, disease-specific, or organ-specific measures. The importance of incorporating patients’ perspectives, concerns, and ideas into outcome measure development was emphasized. Conclusion The planned research agenda includes conducting a Delphi exercise among physicians from different specialties that are involved in the care of patients with BS and among patients with BS, with the aim of identifying candidate domains and subdomains to be assessed in randomized clinical trials of BS, and candidate items for a composite measure. The ultimate goal of the group is to develop a validated and widely accepted core set of outcomes and outcome measures for use in clinical trials in BS. PMID:26373563

Safety outcomes in the United States: trends and challenges in measurement.

PubMed

Greenberg, Michael D; Haviland, Amelia M; Yu, Hao; Farley, Donna O

2009-04-01

To prepare Agency for Healthcare Research and Quality (AHRQ) for monitoring the impact of its own patient safety initiative, by exploring available outcomes data, assessing usability of measures, and estimating national trends in patient outcomes. Annual summary data on incidence of Joint Commission Sentinel Events, MEDMARX medication error events, and MDS measures of falls and pressure ulcers in nursing home residents. HCUP National Inpatient Sample (NIS) administrative claims data. Description and assessment of published summary data on selected safety measures. Analysis of selected Patient Safety Indicators (PSIs) and Utah–Missouri adverse event measures using HCUP NIS claims data (1994–2003). Interpretation of safety outcome trends requires close attention to the characteristics of underlying data sources and measures. Encounter-based measures have been affected by changes in definitions and ICD-9 coding, as well as by changes in the structure of administrative datasets like HCUP NIS. Historical trends are mixed for the safety outcome measures reviewed, with some measures showing improvement, others deterioration, and still others remaining fairly stable. Constructing national trends of safety outcomes is difficult because of limitations in available data sources and measures. Tracking growth in the adoption of safe practices could offer an important strategy for complementing existing safety measurement capabilities.

Measurement properties of outcome measures for vitiligo. A systematic review.

PubMed

Vrijman, Charlotte; Linthorst Homan, May W; Limpens, Jacqueline; van der Veen, Wietze; Wolkerstorfer, Albert; Terwee, Caroline B; Spuls, Phyllis I

2012-11-01

OBJECTIVE To summarize and critically appraise the evidence on the measurement properties of clinician-, patient-, and observer-reported outcomes, measuring any construct of interest in patients with all types of vitiligo. DATA SOURCES Electronic databases including PubMed (1948 to July 2011), OVID EMBASE (1980 to July 2011), and CINAHL (EBSCOhost) (1982 to July 2011) were searched. STUDY SELECTION Two authors independently screened all records for eligibility. For inclusion, the study population had to include patients with vitiligo, for which outcome measures were developed or evaluated on their measurement properties. The initial search retrieved 1249 records, of which 14 articles met the inclusion criteria. DATA EXTRACTION Characteristics of the included instruments, study population, and results of the measurement properties were extracted. The Consensus-Based Standards for the Selection of Health Status Measurement Instruments (COSMIN) 4-point checklist, combined with quality criteria for measurement properties, was used to calculate the overall level of evidence per measurement property of each instrument. Independent extraction and assessment was performed by 2 authors. DATA SYNTHESIS Eleven different measurement instruments were identified. Strong evidence was found for a positive internal consistency of the Dermatology Life Quality Index. For other instruments, the evidence of measurement properties was limited or unknown. CONCLUSIONS Recommendations on the use of specific outcome measures for vitiligo should be formulated with caution because current evidence is insufficient owing to a low number of studies with poor methodological quality and unclear clinical relevance. To recommend outcome measures for vitiligo, further research on measurement properties of clinical relevant outcome measures for vitiligo according to COSMIN quality criteria is needed.

Performance measurement in surgery through the National Quality Forum.

PubMed

Hyder, Joseph A; Roy, Nathalie; Wakeam, Elliot; Hernandez, Roland; Kim, Simon P; Bader, Angela M; Cima, Robert R; Nguyen, Louis L

2014-11-01

Performance measurement has become central to surgical practice. We systematically reviewed all endorsed performance measures from the National Quality Forum, the national clearing house for performance measures in health care, to identify measures relevant to surgical practice and describe measure stewardship, measure types, and identify gaps in measurement. Performance measures current to June 2014 were categorized by denominator statement as either assessing surgical practice in specific or as part of a mixed medical and surgical population. Measures were further classified by surgical specialty, Donabedian measure type, patients, disease and events targeted, reporting eligibility, and measure stewards. Of 637 measures, 123 measures assessed surgical performance in specific and 123 assessed surgical performance in aggregate. Physician societies (51 of 123, 41.5%) were more common than government agencies (32 of 123, 26.0%) among measure stewards for surgical measures, in particular, the Society for Thoracic Surgery (n = 32). Outcomes measures rather than process measures were common among surgical measures (62 of 123, 50.4%) compared with aggregate medical/surgical measures (46 of 123, 37.4%). Among outcomes measures, death alone was the most commonly specified outcome (24 of 62, 38.7%). Only 1 surgical measure addressed patient-centered care and only 1 measure addressed hospital readmission. We found 7 current surgical measures eligible for value-based purchasing. Surgical society stewards and outcomes measure types, particularly for cardiac surgery, were well represented in the National Quality Forum. Measures addressing patient-centered outcomes and the value of surgical decision-making were not well represented and may be suitable targets for measure innovation. Copyright © 2014 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Outcome Measurement in the Treatment of Spasmodic Dysphonia: A Systematic Review of the Literature.

PubMed

Rumbach, Anna; Aiken, Patrick; Novakovic, Daniel

2018-04-11

The aim of this review was to systematically identify all available studies reporting outcomes measures to assess treatment outcomes for people with spasmodic dysphonia (SD). Full-text journal articles were identified through searches of PubMed, Embase, CINAHL, and Cochrane databases and hand searching of journals. A total of 4,714 articles were retrieved from searching databases; 1,165 were duplicates. Titles and abstracts of 3,549 were screened, with 171 being selected for full-text review. During full-text review, 101 articles were deemed suitable for inclusion. An additional 24 articles were identified as suitable for inclusion through a hand search of reference lists. Data were extracted from 125 studies. A total of 220 outcome measures were identified. Considered in reference to the World Health Organization International Classification of Functioning, Disability and Health (ICF), the majority of outcomes were measured at a Body Function level (n = 212, 96%). Outcomes that explored communication and participation in everyday life and attitudes toward communication (ie, activity and participation domains) were infrequent (n = 8; 4%). Quality of life, a construct not measured within the ICF, was also captured by four outcome measures. No instruments evaluating communication partners' perspectives or burden/disability were identified. The outcome measures used in SD treatment studies are many and varied. The outcome measures identified predominately measure constructs within the Body Functions component of the ICF. In order to facilitate data synthesis across trials, the development of a core outcome set is recommended. Crown Copyright © 2018. Published by Elsevier Inc. All rights reserved.

Lower Anogenital Tract Disease Therapy Outcomes, COMET, and CROWN: Call for Research Submissions.

PubMed

Andrews, Jeffrey

2015-10-01

There is a problem of inconsistent and inappropriate outcome selection for research studies. We can improve the relevance of research results for women and for their physicians and clinicians by encouraging researchers to critically evaluate outcome measures, and use valid, appropriate, standardized measures. To this purpose, and to facilitate synthesis of the evidence, outcomes reported by clinical studies should be standardized for different disease conditions through the development of core outcome sets (COS). There is an international effort for reaching consensus on outcome measures and establishing COS that represent agreed-upon standardized collections of outcome measures that will be reported in all studies within a clinical area. Across clinical specialties, the Core Outcome Measures in Effectiveness Trials (COMET) initiative launched in 2010. In 2014, the editors of women's health journals answered the challenge of COMET and formed the Core Outcomes in Women's Health initiative. The Journal of Lower Genital Tract Diseases is a participating member of the Core Outcomes in Women's Health consortium. There is broad inconsistency in outcome measures and reporting in the field of lower anogenital tract diseases. No core outcome sets currently exist. Suggested target conditions in anogenital disease are vulvar dermatoses, cervical intraepithelial neoplasia, and vulvodynia. Investigators are encouraged to conduct secondary systematic research to determine previously reported primary outcome measures and suggest domains for COS. Core Outcomes in Women's health initiative and COMET encourage the formation of consensus panels of stakeholders (researchers, health care providers, patients, and others) to recommend outcome domains and COS and then publish their report.

Recommendations for Self-Report Outcome Measures in Vulvodynia Clinical Trials.

PubMed

Pukall, Caroline F; Bergeron, Sophie; Brown, Candace; Bachmann, Gloria; Wesselmann, Ursula

2017-08-01

Vulvodynia (idiopathic chronic vulvar pain) is a prevalent condition associated with significant and negative impacts in many areas of function. Despite the increased research interest in vulvodynia in recent years, recommendations for outcome measures for use in clinical trials are missing. The purpose of this paper, therefore, was to provide recommendations for outcome measures for vulvodynia clinical trials so that consistent measures are used across trials to facilitate between-study comparisons and the conduct of large multicenter trials, and to improve measurement of the multiple dimensions of vulvodynia. Given that provoked vestibulodynia (PVD)-characterized by provoked pain localized to the vaginal opening-is the most common subtype of vulvodynia and the current main focus of clinical trials, this paper focused on recommended outcome measures in PVD clinical trials. The framework used to guide the selection of outcome measures was based on the one proposed by the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT). The IMMPACT framework provided a well-suited guideline for outcome measure recommendations in PVD clinical trials. However, given the provoked presentation of PVD and the significant impact it has on sexuality, modifications to some of the IMMPACT recommendations were made and specific additional measures were suggested. Measures that are specific to vulvovaginal pain are ideal for adoption in PVD clinical trials, and many such measures currently exist that allow the relevant IMMPACT domains to be captured.

Upper Limb Outcome Measures Used in Stroke Rehabilitation Studies: A Systematic Literature Review

PubMed Central

Santisteban, Leire; Térémetz, Maxime; Bleton, Jean-Pierre; Baron, Jean-Claude; Maier, Marc A.; Lindberg, Påvel G.

2016-01-01

Background Establishing which upper limb outcome measures are most commonly used in stroke studies may help in improving consensus among scientists and clinicians. Objective In this study we aimed to identify the most commonly used upper limb outcome measures in intervention studies after stroke and to describe domains covered according to ICF, how measures are combined, and how their use varies geographically and over time. Methods Pubmed, CinHAL, and PeDRO databases were searched for upper limb intervention studies in stroke according to PRISMA guidelines and477 studies were included. Results In studies 48different outcome measures were found. Only 15 of these outcome measures were used in more than 5% of the studies. The Fugl-Meyer Test (FMT)was the most commonly used measure (in 36% of studies). Commonly used measures covered ICF domains of body function and activity to varying extents. Most studies (72%) combined multiple outcome measures: the FMT was often combined with the Motor Activity Log (MAL), the Wolf Motor Function Test and the Action Research Arm Test, but infrequently combined with the Motor Assessment Scale or the Nine Hole Peg Test. Key components of manual dexterity such as selective finger movements were rarely measured. Frequency of use increased over a twelve-year period for the FMT and for assessments of kinematics, whereas other measures, such as the MAL and the Jebsen Taylor Hand Test showed decreased use over time. Use varied largely between countries showing low international consensus. Conclusions The results showed a large diversity of outcome measures used across studies. However, a growing number of studies used the FMT, a neurological test with good psychometric properties. For thorough assessment the FMT needs to be combined with functional measures. These findings illustrate the need for strategies to build international consensus on appropriate outcome measures for upper limb function after stroke. PMID:27152853

The Aphasia Communication Outcome Measure (ACOM): Dimensionality, Item Bank Calibration, and Initial Validation

ERIC Educational Resources Information Center

Hula, William D.; Doyle, Patrick J.; Stone, Clement A.; Hula, Shannon N. Austermann; Kellough, Stacey; Wambaugh, Julie L.; Ross, Katherine B.; Schumacher, James G.; St. Jacque, Ann

2015-01-01

Purpose: The purpose of this study is to investigate the structure and measurement properties of the Aphasia Communication Outcome Measure (ACOM), a patient-reported outcome measure of communicative functioning for persons with aphasia. Method: Three hundred twenty-nine participants with aphasia responded to 177 items asking about communicative…

Physician outcome measurement: review and proposed model.

PubMed

Siha, S

1998-01-01

As health care moves from a free-for-service environment to a capitated arena, outcome measurements must change. ABC Children's Medical Center is challenged with developing comprehensive outcome measures for an employed physician group. An extensive literature review validates that physician outcomes must move beyond revenue production and measure all aspects of care delivery. The proposed measurement model for this physician group is a trilogy model. It includes measures of cost, quality, and service. While these measures can be examined separately, it is imperative to understand their integration in determining an organization's competitive advantage. The recommended measurements for the physician group must be consistent with the overall organizational goals. The long-term impact will be better utilization of resources. This will result in the most cost effective, quality care for the health care consumer.

Implicit measures: A normative analysis and review.

PubMed

De Houwer, Jan; Teige-Mocigemba, Sarah; Spruyt, Adriaan; Moors, Agnes

2009-05-01

Implicit measures can be defined as outcomes of measurement procedures that are caused in an automatic manner by psychological attributes. To establish that a measurement outcome is an implicit measure, one should examine (a) whether the outcome is causally produced by the psychological attribute it was designed to measure, (b) the nature of the processes by which the attribute causes the outcome, and (c) whether these processes operate automatically. This normative analysis provides a heuristic framework for organizing past and future research on implicit measures. The authors illustrate the heuristic function of their framework by using it to review past research on the 2 implicit measures that are currently most popular: effects in implicit association tests and affective priming tasks. (PsycINFO Database Record (c) 2009 APA, all rights reserved).

Measuring voice outcomes: state of the science review.

PubMed

Carding, Pau N; Wilson, J A; MacKenzie, K; Deary, I J

2009-08-01

Researchers evaluating voice disorder interventions currently have a plethora of voice outcome measurement tools from which to choose. Faced with such a wide choice, it would be beneficial to establish a clear rationale to guide selection. This article reviews the published literature on the three main areas of voice outcome assessment: (1) perceptual rating of voice quality, (2) acoustic measurement of the speech signal and (3) patient self-reporting of voice problems. We analysed the published reliability, validity, sensitivity to change and utility of the common outcome measurement tools in each area. From the data, we suggest that routine voice outcome measurement should include (1) an expert rating of voice quality (using the Grade-Roughness-Breathiness-Asthenia-Strain rating scale) and (2) a short self-reporting tool (either the Vocal Performance Questionnaire or the Vocal Handicap Index 10). These measures have high validity, the best reported reliability to date, good sensitivity to change data and excellent utility ratings. However, their application and administration require attention to detail. Acoustic measurement has arguable validity and poor reliability data at the present time. Other areas of voice outcome measurement (e.g. stroboscopy and aerodynamic phonatory measurements) require similarly detailed research and analysis.

Identifying an outcome measure to assess the impact of Mobility Dogs.

PubMed

Mudge, Suzie; Rewi, Dallas; Channon, Alexis

2017-01-01

Mobility Dogs® trains dogs to work with people with physical disabilities to increase independence, confidence, self-esteem and participation. Mobility Dogs® seeks to critically evaluate and improve its services as it grows. This study aimed to identify and implement a standardised outcome measure into practice at Mobility Dogs®. Based on the Consolidated Framework for Implementation Research and guided by a steering group of key stakeholders, a three-phase approach was developed to identify and assess an outcome measure. The steering group highlighted the organisation's specific needs, selected participation as the assessment domain and identified core utility requirements of the measure. A comprehensive review of evidence was undertaken to identify and rank potential measures according to the specified needs. Of the seven participation outcome measures that met inclusion criteria, the three highest ranked measures were critically evaluated by the steering group to determine suitability against the organisation's needs. The Impact on Participation and Autonomy (IPA) was selected for implementation into practice at Mobility Dogs®. Use of the IPA is an important first step for Mobility Dogs® to test the benefits of trained service dogs. This process could be replicated by other service dog organisations to identify outcome measures to assess their own services. Implications for Rehabilitation Service dogs (such as Mobility Dogs® in New Zealand) assist people living with physical impairments by performing tasks, however there is limited evidence on outcomes. The process for selecting an appropriate outcome measure for Mobility Dogs® involving partnership between Mobility Dogs® personnel and academics was an effective way to steer the project by determining important properties of the measure, before a search of the literature was undertaken. While the IPA was selected as the most appropriate outcome measure for use at Mobility Dogs®, it was the process that is valuable to replicate if other organisations wish to select an outcome measure for use in their own practice.

Optimal functional outcome measures for assessing treatment for Dupuytren’s disease: a systematic review and recommendations for future practice

PubMed Central

2013-01-01

Background Dupuytren's disease of the hand is a common condition affecting the palmar fascia, resulting in progressive flexion deformities of the digits and hence limitation of hand function. The optimal treatment remains unclear as outcomes studies have used a variety of measures for assessment. Methods A literature search was performed for all publications describing surgical treatment, percutaneous needle aponeurotomy or collagenase injection for primary or recurrent Dupuytren’s disease where outcomes had been monitored using functional measures. Results Ninety-one studies met the inclusion criteria. Twenty-two studies reported outcomes using patient reported outcome measures (PROMs) ranging from validated questionnaires to self-reported measures for return to work and self-rated disability. The Disability of Arm, Shoulder and Hand (DASH) score was the most utilised patient-reported function measure (n=11). Patient satisfaction was reported by eighteen studies but no single method was used consistently. Range of movement was the most frequent physical measure and was reported in all 91 studies. However, the methods of measurement and reporting varied, with seventeen different techniques being used. Other physical measures included grip and pinch strength and sensibility, again with variations in measurement protocols. The mean follow-up time ranged from 2 weeks to 17 years. Conclusions There is little consistency in the reporting of outcomes for interventions in patients with Dupuytren’s disease, making it impossible to compare the efficacy of different treatment modalities. Although there are limitations to the existing generic patient reported outcomes measures, a combination of these together with a disease-specific questionnaire, and physical measures of active and passive individual joint Range of movement (ROM), grip and sensibility using standardised protocols should be used for future outcomes studies. As Dupuytren’s disease tends to recur following treatment as well as extend to involve other areas of the hand, follow-up times should be standardised and designed to capture both short and long term outcomes. PMID:23575442

Measurement issues in the evaluation of chronic disease self-management programs.

PubMed

Nolte, Sandra; Elsworth, Gerald R; Newman, Stanton; Osborne, Richard H

2013-09-01

To provide an in-depth analysis of outcome measures used in the evaluation of chronic disease self-management programs consistent with the Stanford curricula. Based on a systematic review on self-management programs, effect sizes derived from reported outcome measures are categorized according to the quality of life appraisal model developed by Schwartz and Rapkin which classifies outcomes from performance-based measures (e.g., clinical outcomes) to evaluation-based measures (e.g., emotional well-being). The majority of outcomes assessed in self-management trials are based on evaluation-based methods. Overall, effects on knowledge--the only performance-based measure observed in selected trials--are generally medium to large. In contrast, substantially more inconsistent results are found for both perception- and evaluation-based measures that mostly range between nil and small positive effects. Effectiveness of self-management interventions and resulting recommendations for health policy makers are most frequently derived from highly variable evaluation-based measures, that is, types of outcomes that potentially carry a substantial amount of measurement error and/or bias such as response shift. Therefore, decisions regarding the value and efficacy of chronic disease self-management programs need to be interpreted with care. More research, especially qualitative studies, is needed to unravel cognitive processes and the role of response shift bias in the measurement of change.

Developing a Set of Uniform Outcome Measures for Adult Day Services.

PubMed

Anderson, Keith A; Geboy, Lyn; Jarrott, Shannon E; Missaelides, Lydia; Ogletree, Aaron M; Peters-Beumer, Lisa; Zarit, Steven H

2018-06-01

Adult day services (ADS) provide care to adults with physical, functional, and/or cognitive limitations in nonresidential, congregate, community-based settings. ADS programs have emerged as a growing and affordable approach within the home and community-based services sector. Although promising, the growth of ADS has been hampered by a lack of uniform outcome measures and data collection protocols. In this article, the authors detail a recent effort by leading researchers and practitioners in ADS to develop a set of uniform outcome measures. Based upon three recent efforts to develop outcome measures, selection criteria were established and an iterative process was conducted to debate the merits of outcome measures across three domains-participant well-being, caregiver well-being, and health care utilization. The authors conclude by proposing a uniform set of outcome measures to (a) standardize data collection, (b) aid in the development of programming, and (c) facilitate the leveraging of additional funding for ADS.

Evaluation of the ProPublica Surgeon Scorecard "Adjusted Complication Rate" Measure Specifications.

PubMed

Ban, Kristen A; Cohen, Mark E; Ko, Clifford Y; Friedberg, Mark W; Stulberg, Jonah J; Zhou, Lynn; Hall, Bruce L; Hoyt, David B; Bilimoria, Karl Y

2016-10-01

The ProPublica Surgeon Scorecard is the first nationwide, multispecialty public reporting of individual surgeon outcomes. However, ProPublica's use of a previously undescribed outcome measure (composite of in-hospital mortality or 30-day related readmission) and inclusion of only inpatients have been questioned. Our objectives were to (1) determine the proportion of cases excluded by ProPublica's specifications, (2) assess the proportion of inpatient complications excluded from ProPublica's measure, and (3) examine the validity of ProPublica's outcome measure by comparing performance on the measure to well-established postoperative outcome measures. Using ACS-NSQIP data (2012-2014) for 8 ProPublica procedures and for All Operations, the proportion of cases meeting all ProPublica inclusion criteria was determined. We assessed the proportion of complications occurring inpatient, and thus not considered by ProPublica's measure. Finally, we compared risk-adjusted performance based on ProPublica's measure specifications to established ACS-NSQIP outcome measure performance (eg, death/serious morbidity, mortality). ProPublica's inclusion criteria resulted in elimination of 82% of all operations from assessment (range: 42% for total knee arthroplasty to 96% for laparoscopic cholecystectomy). For all ProPublica operations combined, 84% of complications occur during inpatient hospitalization (range: 61% for TURP to 88% for total hip arthroplasty), and are thus missed by the ProPublica measure. Hospital-level performance on the ProPublica measure correlated weakly with established complication measures, but correlated strongly with readmission (R = 0.834, P < 0.001). ProPublica's outcome measure specifications exclude 82% of cases, miss 84% of postoperative complications, and correlate poorly with well-established postoperative outcomes. Thus, the validity of the ProPublica Surgeon Scorecard is questionable.

Evaluating the results of stress urinary incontinence surgery with objective and subjective outcome measures.

PubMed

Diez-Itza, I; Espuña-Pons, M

2014-09-01

To assess the outcomes of stress urinary incontinence (SUI) surgery using objective and subjective measures in women with pure SUI and mixed urinary incontinence (MUI). The degree of correlation between the different outcome measures was also evaluated for both groups. A multicentre prospective cohort study of women who underwent surgery for SUI. A standardized cough stress test was used as the objective outcome measure, and specific items of the Epidemiology of Prolapse and Incontinence Questionnaire were used as the subjective outcome measure. The International Consultation on Incontinence Questionnaire-Urinary Incontinence Short Form (ICIQ-UI SF) and the Patient Global Impression of Improvement (PGI-I) questionnaires were used for global assessment. Kappa test was used to measure the degree of correlation between the outcome measures. The participants were categorized into two groups before surgery: pure SUI (n=116) and MUI (n=161). Six months after surgery, the cure rate of the SUI component was high in both groups according to the objective and subjective outcome measures. Global assessment showed lower cure rates. The degree of agreement between objective and subjective outcome measures was moderate (kappa 0.541, p<0.001) for women with pure SUI, and fair (kappa 0.377, p<0.001) for women with MUI. Correlation between the change in ICIQ-UI SF score (pre to post surgery) and the degree of satisfaction (PGI-I) was significant (p<0.01) for both the pure SUI group (0.43) and the MUI group (0.48). Both objective and subjective cure rates are high for women with pure SUI and MUI following SUI surgery in Spain. The degree of agreement between different outcome measures varies. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The use of routine outcome measures in two child and adolescent mental health services: a completed audit cycle

PubMed Central

2013-01-01

Background Routine outcome measurement (ROM) is important for assessing the clinical effectiveness of health services and for monitoring patient outcomes. Within Child and Adolescent Mental Health Services (CAMHS) in the UK the adoption of ROM in CAMHS has been supported by both national and local initiatives (such as government strategies, local commissioning policy, and research). Methods With the aim of assessing how these policies and initiatives may have influenced the uptake of ROM within two different CAMHS we report the findings of two case-note audits: a baseline audit conducted in January 2011 and a re-audit conducted two years later in December 2012-February 2013. Results The findings show an increase in both the single and repeated use of outcome measures from the time of the original audit, with repeated use (baseline and follow-up) of the Health of the Nation Outcome Scale for Children and Adolescents (HoNOSCA) scale increasing from 10% to 50% of cases. Re-audited case-notes contained more combined use of different outcome measures, with greater consensus on which measures to use. Outcome measures that were applicable across a wide range of clinical conditions were more likely to be used than symptom-specific measures, and measures that were completed by the clinician were found more often than measures completed by the service user. Conclusions The findings show a substantial improvement in the use of outcome measures within CAMHS. These increases in use were found across different service organisations which were subject to different types of local service priorities and drivers. PMID:24139139

A Systematic Review of Palliative Care Intervention Outcomes and Outcome Measures in Low-Resource Countries.

PubMed

Potts, Maryellen; Cartmell, Kathleen B; Nemeth, Lynne; Bhattacharjee, Gautam; Qanungo, Suparna

2018-05-01

To meet the growing need for palliative care in low-resource countries, palliative care programs should be evidence based and contextually appropriate. This study was conducted to synthesize the current evidence to guide future programmatic and research efforts. This systematic review evaluated palliative care outcome measures, outcomes, and interventions in low-resource countries. After title searches, abstracts and full-text articles were screened for inclusion. Data were extracted to report on intervention models, outcome measures used, and intervention outcomes. Eighteen papers were reviewed, reporting on interventions conducted across nine low-resource countries. These interventions evaluated home-based palliative care models; a community-managed model; palliative care integrated with hospitals, hospices, or HIV clinics; and models focused on patients' self-management. Three studies were randomized controlled trials. Other studies used nonrandomized trials, cohort studies, mixed methods, pre-post test evaluation, cost-accounting evaluation, and cross-sectional surveys. Thirteen studies measured physical outcomes, 10 using multidimensional instruments. Nine studies measured psychological outcomes, eight using multidimensional instruments. Nine studies measured social outcomes, seven using multidimensional instruments. Nine studies measured outcomes across multiple domains. Across outcomes evaluated, results were reported in the direction of benefit associated with palliative care interventions. Many palliative care intervention models exist to serve patients in low-resource countries. Yet, limited high-quality evidence from low-resource countries is available to document intervention outcomes. Rigorous experimental studies and greater measurement of multidimensional aspects of palliative care are needed to advance the science of palliative care in low-resource settings. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

Patient-reported outcome measures in reconstructive breast surgery: is there a role for generic measures?

PubMed

Korus, Lisa J; Cypel, Tatiana; Zhong, Toni; Wu, Albert W

2015-03-01

Patient-reported outcomes provide an invaluable tool in the assessment of outcomes in plastic surgery. Traditionally, patient-reported outcomes have consisted of either generic or ad hoc measures; however, more recently, there has been interest in formally constructed and validated questionnaires that are specifically designed for a particular patient population. The purpose of this systematic review was to determine whether generic measures still have a role in the evaluation of breast reconstruction outcomes, given the recent popularity and push for use of specific measures. A systematic review was performed to identify all articles using patient-reported outcomes in the assessment of postmastectomy breast reconstruction. Frequency of use was tabulated and the most frequently used tools were assessed for success of use, using criteria described previously by the Medical Outcomes Trust. To date, the most frequently used measures are still generic measures. The 36-Item Short-Form Health Survey was the most frequently used and most successfully applied showing evidence of responsiveness in multiple settings. Other measures such as the Hospital Anxiety and Depression Scale, the Hopwood Body Image Scale, and the Rosenberg Self-Esteem Scale were able to show responsiveness in certain settings but lacked evidence as universal tools for the assessment of outcomes in reconstructive breast surgery. Despite the recent advent of measures designed specifically to assess patient-reported outcomes in the breast reconstruction population, there still appears to be a role for the use of generic instruments. Many of these tools would benefit from undergoing formal validation in the breast reconstruction population.

45 CFR 287.145 - What measures will be used to determine NEW Program outcomes?

Code of Federal Regulations, 2010 CFR

2010-10-01

... Program outcomes? 287.145 Section 287.145 Public Welfare Regulations Relating to Public Welfare OFFICE OF... What measures will be used to determine NEW Program outcomes? Each grantee must develop its own... must identify planned program outcomes and the measures the Tribe will use to determine them. ACF will...

Outcomes measurement: compliance tool or strategic initiative?

PubMed

Linder, J C

1991-01-01

This article explores how hospitals are using outcomes measurement to deal with their changing environment. Based on interviews at thirty-one hospitals, the study reveals three very different management approaches and three different uses of the same outcomes measurement tool.

The Harmonizing Outcome Measures for Eczema (HOME) roadmap: a methodological framework to develop core sets of outcome measurements in dermatology.

PubMed

Schmitt, Jochen; Apfelbacher, Christian; Spuls, Phyllis I; Thomas, Kim S; Simpson, Eric L; Furue, Masutaka; Chalmers, Joanne; Williams, Hywel C

2015-01-01

Core outcome sets (COSs) are consensus-derived minimum sets of outcomes to be assessed in a specific situation. COSs are being increasingly developed to limit outcome-reporting bias, allow comparisons across trials, and strengthen clinical decision making. Despite the increasing interest in outcomes research, methods to develop COSs have not yet been standardized. The aim of this paper is to present the Harmonizing Outcomes Measures for Eczema (HOME) roadmap for the development and implementation of COSs, which was developed on the basis of our experience in the standardization of outcome measurements for atopic eczema. Following the establishment of a panel representing all relevant stakeholders and a research team experienced in outcomes research, the scope and setting of the core set should be defined. The next steps are the definition of a core set of outcome domains such as symptoms or quality of life, followed by the identification or development and validation of appropriate outcome measurement instruments to measure these core domains. Finally, the consented COS needs to be disseminated, implemented, and reviewed. We believe that the HOME roadmap is a useful methodological framework to develop COSs in dermatology, with the ultimate goal of better decision making and promoting patient-centered health care.

Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

PubMed

Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

2014-06-25

The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our study. Based upon this consultation process, a guideline will be developed on instrument selection for outcomes to be included in a COS.

Outcome measurement in Australian rehabilitation environments.

PubMed

Douglas, Heather; Swanson, Cheryl; Gee, Travis; Bellamy, Nicholas

2005-09-01

To determine the frequency and pattern of methods of outcome assessment used in Australian physical rehabilitation environments. Postal survey. A questionnaire on service type, staffing, numbers of adults treated and outcome measures used for 7 conditions related to injury and road trauma as well as stroke and neuromuscular disorders was sent to 973 services providing adult physical rehabilitation treatment. Questionnaires were completed by 440 service providers for a response rate of 45%, similar to that reported in a recent European survey reported in this journal. A small number of measures were reported as in use by most respondents, while a large number of measures were used by a few respondents. Measures of physical changes were used more frequently than those of generic well-being or quality of life. Ease of use and reporting to other professionals were cited as the most important reasons in selection of outcome measures. This Australian-wide survey detected considerable heterogeneity in outcome measurement procedures used in rehabilitation environments. While the goal of measurement may vary between providers and differ between conditions, the results highlight opportunities for harmonization, bench-marking and measurement of health-related quality of life.

Associations between nine family dinner frequency measures and child weight, dietary and psychosocial outcomes

PubMed Central

Fulkerson, Jayne A.; Friend, Sarah E.; Neumark-Sztainer, Dianne

2015-01-01

Background Family meal frequency has been consistently and significantly associated with positive youth dietary and psychosocial outcomes but less consistently associated with weight outcomes. Family meal frequency measurement has varied widely and it is unclear how this variation may impact relationships with youth weight, dietary, and psychosocial outcomes. Objective This study assesses how five parent/caregiver-reported and four child-reported family dinner frequency measures correlate with each other and are associated with health-related outcomes. Design/Participants This secondary, cross-sectional analysis uses baseline, parent/caregiver (n=160) and 8–12 year old child (n=160) data from the Healthy Home Offerings via the Mealtime Environment (HOME) Plus trial (collected 2011–2012). Data were obtained from objective measurements, dietary recall interviews, and psychosocial surveys. Outcome measures Outcomes included child body mass index z-scores (BMIz), fruit, vegetable and sugar-sweetened beverage intake, dietary quality (Healthy Eating Index-2010 [HEI-2010]), family connectedness, and meal conversations. Statistical analyses performed Pearson correlations and general linear models were used to assess associations between family dinner frequency measures and outcomes. Results All family dinner frequency measures had comparable means and were correlated within and across parent/caregiver- and child-reporters (r=0.17–0.94, p<0.01). In unadjusted analyses, 78% of family dinner frequency measures were significantly associated with BMIz scores and 100% were significantly associated with fruit/vegetable intake and HEI-2010. In adjusted models, most significant associations with dietary and psychosocial outcomes remained but associations with child BMIz remained significant only for parent/caregiver- (β±SE= −0.07±0.03; p<0.05) and child-reported (β±SE= −0.06+0.02; p<0.01) family dinner frequency measures asking about ‘sitting and eating’ dinner. Conclusions In spite of phrasing variations in family dinner frequency measures (e.g., which family members were present and how meals were occurring), few differences were found in associations with dietary and psychosocial outcomes but differences were apparent for child BMIz, which suggests phrasing of family dinner frequency measures may influence associations found with weight outcomes. PMID:26875023

TROPHI: development of a tool to measure complex, multi-factorial patient handling interventions.

PubMed

Fray, Mike; Hignett, Sue

2013-01-01

Patient handling interventions are complex and multi-factorial. It has been difficult to make comparisons across different strategies due to the lack of a comprehensive outcome measurement method. The Tool for Risk Outstanding in Patient Handling Interventions (TROPHI) was developed to address this gap by measuring outcomes and comparing performance across interventions. Focus groups were held with expert patient handling practitioners (n = 36) in four European countries (Finland, Italy, Portugal and the UK) to identify preferred outcomes to be measured for interventions. A systematic literature review identified 598 outcome measures; these were critically appraised and the most appropriate measurement tool was selected for each outcome. TROPHI was evaluated in the four EU countries (eight sites) and by an expert panel (n = 16) from the European Panel of Patient Handling Ergonomics for usability and practical application. This final stage added external validity to the research by exploring transferability potential and presenting the data and analysis to allow respondent (participant) validation. Patient handling interventions are complex and multi-factorial and it has been difficult to make comparisons due to the lack of a comprehensive outcome measurement method. The Tool for Risk Outstanding in Patient Handling Interventions (TROPHI) was developed to address this gap by measuring outcomes to compare performance across interventions.

Report from the third international consensus meeting to harmonise core outcome measures for atopic eczema/dermatitis clinical trials (HOME)

PubMed Central

Chalmers, JR; Schmitt, J; Apfelbacher, C; Dohil, M; Eichenfield, LF; Simpson, EL; Singh, J; Spuls, P; Thomas, KS; Admani, S; Aoki, V; Ardeleanu, M; Barbarot, S; Berger, T; Bergman, JN; Block, J; Borok, N; Burton, T; Chamlin, SL; Deckert, S; DeKlotz, CC; Graff, LB; Hanifin, JM; Hebert, AA; Humphreys, R; Katoh, N; Kisa, RM; Margolis, DJ; Merhand, S; Minnillo, R; Mizutani, H; Nankervis, H; Ohya, Y; Rodgers, P; Schram, ME; Stalder, JF; Svensson, A; Takaoka, R; Teper, A; Tom, WL; von Kobyletzki, L; Weisshaar, E; Zelt, S; Williams, HC

2014-01-01

Summary This report provides a summary of the third meeting of the Harmonising Outcome Measures for Eczema (HOME) initiative held in San Diego, CA, U.S.A., 6–7 April 2013 (HOME III). The meeting addressed the four domains that had previously been agreed should be measured in every eczema clinical trial: clinical signs, patient-reported symptoms, long-term control and quality of life. Formal presentations and nominal group techniques were used at this working meeting, attended by 56 voting participants (31 of whom were dermatologists). Significant progress was made on the domain of clinical signs. Without reference to any named scales, it was agreed that the intensity and extent of erythema, excoriation, oedema/papulation and lichenification should be included in the core outcome measure for the scale to have content validity. The group then discussed a systematic review of all scales measuring the clinical signs of eczema and their measurement properties, followed by a consensus vote on which scale to recommend for inclusion in the core outcome set. Research into the remaining three domains was presented, followed by discussions. The symptoms group and quality of life groups need to systematically identify all available tools and rate the quality of the tools. A definition of long-term control is needed before progress can be made towards recommending a core outcome measure. What's already known about this topic? Many different scales have been used to measure eczema, making it difficult to compare trials in meta-analyses and hampering improvements in clinical practice. HOME core outcome measures must pass the OMERACT (Outcome Measures in Rheumatology) filter of truth (validity), discrimination (sensitivity to change and responsiveness) and feasibility (ease of use, costs, time to perform and interpret). It has been previously agreed as part of the consensus process that four domains should be measured by the core outcomes: clinical signs, patient-reported symptoms, long-term control and health-related quality of life. What does this study add? Progress was made towards developing a core outcome set for measuring eczema in clinical trials. The group established the essential items to be included in the outcome measure for the clinical signs of eczema and was able to recommend a scale for the core set. The remaining three domains of patient-reported symptoms, long-term control and health-related quality of life require further work and meetings to determine the core outcome measures. PMID:24980543

Using Cross-Cultural Dimensions Exercises to Improve and Measure Learning Outcomes in International Business Courses

ERIC Educational Resources Information Center

Zainuba, Mohamed; Rahal, Ahmad

2012-01-01

This article proposes an approach for using cross-cultural dimensions exercises to improve and measure learning outcomes in international business courses. The following key issues are highlighted: (a) what are the targeted learning outcomes to be assessed, (b) how to measure the accomplishment of these learning outcomes, (c) the input measures…

Developing a General Outcome Measure of Growth in Social Skills for Infants and Toddlers

ERIC Educational Resources Information Center

Carta, Judith; Greenwood, Charles; Luze, Gayle; Cline, Gabriel; Kuntz, Susan

2004-01-01

Proficiency in social interaction with adults and peers is an important outcome in early childhood. The development of an experimental measure for assessing growth in social skills in children birth to 3 years is described. Based on the general outcome measurement (GOM) approach (e.g., Deno, 1997), the measure is intended for use by early…

Developing a General Outcome Measure Off Growth in Social Skills for Infants and Toddlers

ERIC Educational Resources Information Center

Carta, Judith; Greenwood, Charles; Luze, Gayle; Cline, Gabriel; Kuntz, Susan

2004-01-01

Proficiency in social interaction with adults and peers is an important outcome in early childhood. The development of an experimental measure for assessing growth in social skills in children birth to 3 years is described. Based on the general outcome measurement (GOM) approach (e.g., Deno, 1997), the measure is intended for use by early…

Healthcare quality measurement in orthopaedic surgery: current state of the art.

PubMed

Auerbach, Andrew

2009-10-01

Improving quality of care in arthroplasty is of increasing importance to payors, hospitals, surgeons, and patients. Efforts to compel improvement have traditionally focused measurement and reporting of data describing structural factors, care processes (or 'quality measures'), and clinical outcomes. Reporting structural measures (eg, surgical case volume) has been used with varying degrees of success. Care process measures, exemplified by initiatives such as the Surgical Care Improvement Project measures, are chosen based on the strength of randomized trial evidence linking the process to improved outcomes. However, evidence linking improved performance on Surgical Care Improvement Project measures with improved outcomes is limited. Outcome measures in surgery are of increasing importance as an approach to compel care improvement with prominent examples represented by the National Surgical Quality Improvement Project. Although outcomes-focused approaches are often costly, when linked to active benchmarking and collaborative activities, they may improve care broadly. Moreover, implementation of computerized data systems collecting information formerly collected on paper only will facilitate benchmarking. In the end, care will only be improved if these data are used to define methods for innovating care systems that deliver better outcomes at lower or equivalent costs.

Core outcome measures for opioid abuse liability laboratory assessment studies in humans: IMMPACT recommendations

PubMed Central

Comer, Sandra D.; Zacny, James P.; Dworkin, Robert H.; Turk, Dennis C.; Bigelow, George E.; Foltin, Richard W.; Jasinski, Donald R.; Sellers, Edward M.; Adams, Edgar H.; Balster, Robert; Burke, Laurie B.; Cerny, Igor; Colucci, Robert D.; Cone, Edward; Cowan, Penney; Farrar, John T.; Haddox, J. David; Haythornthwaite, Jennifer A.; Hertz, Sharon; Jay, Gary W.; Johanson, Chris-Ellyn; Junor, Roderick; Katz, Nathaniel P.; Klein, Michael; Kopecky, Ernest A.; Leiderman, Deborah B.; McDermott, Michael P.; O’Brien, Charles; O’Connor, Alec B.; Palmer, Pamela P.; Raja, Srinivasa N.; Rappaport, Bob A.; Rauschkolb, Christine; Rowbotham, Michael C.; Sampaio, Cristina; Setnik, Beatrice; Sokolowska, Marta; Stauffer, Joseph W.; Walsh, Sharon L.

2012-01-01

A critical component in development of opioid analgesics is assessment of their abuse liability (AL). Standardization of approaches and measures used in assessing AL has the potential to facilitate comparisons across studies, research laboratories, and drugs. The goal of this report is to provide consensus recommendations regarding core outcome measures for assessing abuse potential of opioid medications in humans in a controlled laboratory setting. Although many of the recommended measures are appropriate for assessing the AL of medications from other drug classes, the focus here is on opioid medications because they present unique risks from both physiological (e.g., respiratory depression, physical dependence) and public health (e.g., individuals in pain) perspectives. A brief historical perspective on AL testing is provided and then those measures that can be considered primary and secondary outcomes and possible additional outcomes in AL assessment are discussed. These outcome measures include: (1) subjective effects (some of which comprise the primary outcome measures, including drug liking); (2) physiological responses; (3) drug self-administration behavior; and (4) cognitive and psychomotor performance. Prior to presenting recommendations for standardized approaches and measures to be used in AL assessments, the appropriateness of using these measures in clinical trials with patients in pain is discussed. PMID:22998781

Use of cancer performance measures in population health: a macro-level perspective.

PubMed

Clauser, Steven B

2004-01-01

The use of performance measurement to inform macro-level studies of cancer control and quality of care is receiving increasing interest at the state, national, and international level. This article describes the use of these measures to inform health policy and monitor cancer disparities and disease burden. Applications are discussed in clinical and provider-reported outcomes such as cancer incidence, mortality and survival, and outcome-linked processes of care, and patient-reported outcomes such as health-related quality of life and patient satisfaction/experience with care. The use of economic measures to monitor and evaluate the burden of illness is also discussed. The growing demand for surveillance capability coupled with the need to expand both the quality and breadth of available measure sets, suggests that there is a need to supplement traditional clinical and provider-reported process and outcomes measures with patient-reported outcomes measures such as health-related quality of life and patient satisfaction and experience with care. In addition, there is also a need to broaden and standardize outcome-linked process-of-care measures to improve the ability to measure and monitor incremental progress in improving cancer care. Finally, better measures of indirect costs of cancer care, such as loss productivity and caregiver burden among the aged, would improve national estimates of the cost of illness associated with cancer.

Responsiveness of a Neuromuscular Recovery Scale for Spinal Cord Injury: Inpatient and Outpatient Rehabilitation

DTIC Science & Technology

2013-10-01

Velozo’s research focus is on the development of functional outcome measures using Rasch measurement theory. Dr. Velozo’s research team has...functional outcome measures using Rasch measurement theory. Dr. Velozo’s research team has developed computerized adaptive measurement of physical

Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures.

PubMed

Barkham, M; Margison, F; Leach, C; Lucock, M; Mellor-Clark, J; Evans, C; Benson, L; Connell, J; Audin, K; McGrath, G

2001-04-01

To complement the evidence-based practice paradigm, the authors argued for a core outcome measure to provide practice-based evidence for the psychological therapies. Utility requires instruments that are acceptable scientifically, as well as to service users, and a coordinated implementation of the measure at a national level. The development of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is summarized. Data are presented across 39 secondary-care services (n = 2,710) and within an intensively evaluated single service (n = 1,455). Results suggest that the CORE-OM is a valid and reliable measure for multiple settings and is acceptable to users and clinicians as well as policy makers. Baseline data levels of patient presenting problem severity, including risk, are reported in addition to outcome benchmarks that use the concept of reliable and clinically significant change. Basic quality improvement in outcomes for a single service is considered.

Understanding the outcomes measures used in Huntington disease pharmacologicaltrials: A systematic review

PubMed Central

Carlozzi, Noelle E; Miciura, Angela; Migliore, Nicholas; Dayalu, Praveen

2014-01-01

Background The identification of the gene mutation causing Huntington disease has raised hopes for new treatments to ease symptoms and slow functional decline. As such, there has been a push towards designing efficient pharmacological trials (i.e., drug trials), especially with regard to selecting outcomes measures that are both brief and sensitive to changes across the course of the disease, from subtle prodromal changes, to more severe end-stage changes. Objectives Recently, to aid in efficient development of new HD research studies, the National Institute of Neurological Disorders and Stroke (NINDS) published recommendations for measurement selection in HD. While these recommendations are helpful, many of the recommended measures have little published data in HD. As such, we conducted a systematic review of the literature to identify the most common outcomes measures used in HD clinical trials. Methods Major medical databases, including PubMed, Embase, CINAHL, and the Cochrane Central Register of Controlled Trials, were used to identify peer-reviewed journal articles in English from 2001 through April 2013; 151 pharmacological trials were identified. Results The majority of HD clinical trials employed clinician-reported outcomes measures (93%); patient reported outcome measures (11%) and observer reported outcome measures (3%) were used with much less frequency. Conclusions We provide a review of the most commonly used measures across these trials, compare these measures to the clinical recommendations made by the NINDS working groups, and provide recommendations for selecting measures for future clinical trials that meet the Food and Drug Administration standards. PMID:25300328

Magnetic resonance imaging-based measures predictive of short-term surgical outcome in patients with Chiari malformation Type I: a pilot study.

PubMed

Alperin, Noam; Loftus, James Ryan; Bagci, Ahmet M; Lee, Sang H; Oliu, Carlos J; Shah, Ashish H; Green, Barth A

2017-01-01

OBJECTIVE This study identifies quantitative imaging-based measures in patients with Chiari malformation Type I (CM-I) that are associated with positive outcomes after suboccipital decompression with duraplasty. METHODS Fifteen patients in whom CM-I was newly diagnosed underwent MRI preoperatively and 3 months postoperatively. More than 20 previously described morphological and physiological parameters were derived to assess quantitatively the impact of surgery. Postsurgical clinical outcomes were assessed in 2 ways, based on resolution of the patient's chief complaint and using a modified Chicago Chiari Outcome Scale (CCOS). Statistical analyses were performed to identify measures that were different between the unfavorable- and favorable-outcome cohorts. Multivariate analysis was used to identify the strongest predictors of outcome. RESULTS The strongest physiological parameter predictive of outcome was the preoperative maximal cord displacement in the upper cervical region during the cardiac cycle, which was significantly larger in the favorable-outcome subcohorts for both outcome types (p < 0.05). Several hydrodynamic measures revealed significantly larger preoperative-to-postoperative changes in the favorable-outcome subcohort. Predictor sets for the chief-complaint classification included the cord displacement, percent venous drainage through the jugular veins, and normalized cerebral blood flow with 93.3% accuracy. Maximal cord displacement combined with intracranial volume change predicted outcome based on the modified CCOS classification with similar accuracy. CONCLUSIONS Tested physiological measures were stronger predictors of outcome than the morphological measures in patients with CM-I. Maximal cord displacement and intracranial volume change during the cardiac cycle together with a measure that reflects the cerebral venous drainage pathway emerged as likely predictors of decompression outcome in patients with CM-I.

Need and greed in dermatology: disease and outcome measures in dermatological healthcare planning.

PubMed

Dalgard, Florence; Finlay, Andrew Y

2006-01-01

Assessing dermatological needs in the population and our ability to meet them is a challenge. The choice of outcome measures is central in dermatological healthcare planning. The concept of ill health and its relationship to dermatological outcome measures is described. Outcome measures used should provide information on these issues in order to gain insight into genuine needs and illness behavior in the population and to ensure quality of healthcare. Nevertheless, the dilemma of assigning priorities in healthcare planning remains; outcome measures in dermatology should be perceived as appropriate by patients as well as by caregivers and policy makers. It is important to stimulate research to develop and refine person-focused outcome measures. Their use is essential to assess dermatological health needs and to understand illness behavior. The information they can provide can enable provision and evaluation of healthcare quality and contribute to the challenge of making appropriate priority decisions in healthcare. Copyright (c) 2006 S. Karger AG, Basel.

Recommendations for a first Core Outcome Measurement set for complex regional PAin syndrome Clinical sTudies (COMPACT)

PubMed Central

Grieve, Sharon; Perez, Roberto SGM; Birklein, Frank; Brunner, Florian; Bruehl, Stephen; Harden R, Norman; Packham, Tara; Gobeil, Francois; Haigh, Richard; Holly, Janet; Terkelsen, Astrid; Davies, Lindsay; Lewis, Jennifer; Thomassen, Ilona; Connett, Robyn; Worth, Tina; Vatine, Jean-Jacques; McCabe, Candida S

2017-01-01

Complex Regional Pain Syndrome (CRPS) is a persistent pain condition that remains incompletely understood and challenging to treat. Historically, a wide range of different outcome measures have been used to capture the multidimensional nature of CRPS. This has been a significant limiting factor in the advancement of our understanding of the mechanisms and management of CRPS. In 2013, an international consortium of patients, clinicians, researchers and industry representatives was established, to develop and agree on a minimum core set of standardised outcome measures for use in future CRPS clinical research, including but not limited to clinical trials within adult populations The development of a core measurement set was informed through workshops and supplementary work, using an iterative consensus process. ‘What is the clinical presentation and course of CRPS, and what factors influence it?’ was agreed as the most pertinent research question that our standardised set of patient-reported outcome measures should be selected to answer. The domains encompassing the key concepts necessary to answer the research question were agreed as: pain, disease severity, participation and physical function, emotional and psychological function, self efficacy, catastrophizing and patient's global impression of change. The final core measurement set included the optimum generic or condition-specific patient-reported questionnaire outcome measures, which captured the essence of each domain, and one clinician reported outcome measure to capture the degree of severity of CRPS. The next step is to test the feasibility and acceptability of collecting outcome measure data using the core measurement set in the CRPS population internationally. PMID:28178071

Hand therapist use of patient report outcome (PRO) in practice: a survey study.

PubMed

Valdes, Kristin; MacDermid, Joy; Algar, Lori; Connors, Brian; Cyr, Lisa M; Dickmann, Sharon; Lucado, Ann M; Naughton, Nancy

2014-01-01

The purpose of this survey was to gain greater insight into hand therapists' use of Patient Report Outcome (PRO) measures. An 11-question survey that evaluated therapists' perceptions, preferences, and patterns of use of patient report outcome measures was sent to members of ASHT. A total of 633 ASHT members participated in the survey study. A large majority of participants (92%) responded affirmatively to using a PRO measure in practice. The DASH was reported as the most frequently used measure (90%). The majority of therapists (84%) discuss the results of the outcome measurement score with their patients. Of the participants who use more than one outcome measure, 44% report that this allows them to better establish their patient's functional and physical limitations. The findings in this study suggest that a large percentage of hand therapists are currently including a PRO measure in their hand therapy practice. Copyright © 2014 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.

Effect of choice of outcome measure on studies of the etiology of obesity in children.

PubMed

Basterfield, Laura; Pearce, Mark S; Adamson, Ashley J; Reilly, Jessica K; Parkinson, Kathryn N; Reilly, John J

2012-12-01

Epidemiologic studies of the etiology of childhood obesity often use proxies for adiposity as outcomes. This study aimed to compare the ability of a range of proxy measures to detect associations with sedentary behavior. Longitudinal study of children in the Gateshead Millennium Study who were 7 years at baseline and 9 years at follow-up. Associations between 2-year changes in objectively measured sedentary behavior and changes in proxies for adiposity (waist circumference, waist Z score, body mass index, body mass index Z score) and measurement of body composition (fat mass index from bioelectric impedance) were examined. Associations were tested with linear regression. Associations between 2-year increases in sedentary behavior and increases in adiposity were detectable by using the fat mass index as the outcome, but not the simple proxy measures of adiposity, as outcomes. Proxy measures are inferior to measures of body composition as outcomes in epidemiologic studies. Copyright © 2012 Elsevier Inc. All rights reserved.

Focused Evidence Review: Psychometric Properties of Patient-Reported Outcome Measures for Chronic Musculoskeletal Pain.

PubMed

Goldsmith, Elizabeth S; Taylor, Brent C; Greer, Nancy; Murdoch, Maureen; MacDonald, Roderick; McKenzie, Lauren; Rosebush, Christina E; Wilt, Timothy J

2018-05-01

Developing successful interventions for chronic musculoskeletal pain requires valid, responsive, and reliable outcome measures. The Minneapolis VA Evidence-based Synthesis Program completed a focused evidence review on key psychometric properties of 17 self-report measures of pain severity and pain-related functional impairment suitable for clinical research on chronic musculoskeletal pain. Pain experts of the VA Pain Measurement Outcomes Workgroup identified 17 pain measures to undergo systematic review. In addition to a MEDLINE search on these 17 measures (1/2000-1/2017), we hand-searched (without publication date limits) the reference lists of all included studies, prior systematic reviews, and-when available-Web sites dedicated to each measure (PROSPERO registration CRD42017056610). Our primary outcome was the measure's minimal important difference (MID). Secondary outcomes included responsiveness, validity, and test-retest reliability. Outcomes were synthesized through evidence mapping and qualitative comparison. Of 1635 abstracts identified, 331 articles underwent full-text review, and 43 met inclusion criteria. Five measures (Oswestry Disability Index (ODI), Roland-Morris Disability Questionnaire (RMDQ), SF-36 Bodily Pain Scale (SF-36 BPS), Numeric Rating Scale (NRS), and Visual Analog Scale (VAS)) had data reported on MID, responsiveness, validity, and test-retest reliability. Seven measures had data reported on three of the four psychometric outcomes. Eight measures had reported MIDs, though estimation methods differed substantially and often were not clinically anchored. In this focused evidence review, the most evidence on key psychometric properties in chronic musculoskeletal pain populations was found for the ODI, RMDQ, SF-36 BPS, NRS, and VAS. Key limitations in the field include substantial variation in methods of estimating psychometric properties, defining chronic musculoskeletal pain, and reporting patient demographics. Registered in the PROSPERO database: CRD42017056610.

The Popularity of Outcome Measures for Hip and Knee Arthroplasties.

PubMed

Lovelock, Thomas M; Broughton, Nigel S; Williams, Cylie M

2018-01-01

The optimal methods of determining outcomes following hip and knee arthroplasty remain controversial. The objectives of this study were to determine the most frequently used outcome measures in randomized controlled trials (RCT) and study protocols registered with clinical trials registries (CTR) on hip and knee arthroplasty. A systematic search strategy was undertaken to identify the outcome measures used in RCT and CTR following joint arthroplasty. Databases searched included Embase, Ovid MEDLINE (including In-Process), Cochrane Central Register of Controlled Trials, CINAHL Plus, clinicaltrials.gov, ISRCTN registry, and ANZCTR. Differences in the use of outcome measures between RCT and CTR were assessed using logistic regression. There were 291 RCT and 113 CTR on hip arthroplasty and 452 RCT and 184 CTR on knee arthroplasty that met the inclusion criteria. The most popular outcome measures were the Harris Hip Score and the Knee Society Score. Multiple outcome measures were used in greater than 50% of the included studies. The Oxford Hip Score, Oxford Knee Score, EuroQol-5D, and Knee Injury and Osteoarthritis Outcome Score (all P < .001) were used in significantly more CTR than RCT. There is a clear preference for the use of the Harris Hip Score and Knee Society Score, contrary to existing international guidelines and reviews on the topic. Both measures require clinician input, which potentially influences their validity and increases their overall administration cost. Some patient-reported outcome measures, such as the Oxford Hip and Knee Scores, EuroQol-5D, and KOOS, appear to be increasing in popularity. Copyright © 2017 Elsevier Inc. All rights reserved.

The use of shoulder scoring systems and outcome measures in the UK

PubMed Central

Lamb, J; Rambani, R; Venkateswaran, B

2014-01-01

Introduction In future, outcomes following shoulder surgery may be subject to public survey. Many outcome measures exist but we do not know whether there is a consensus between shoulder surgeons in the UK. The aim of this study was to survey the preferred outcome measures used by National Health Service (NHS) shoulder surgeons operating in the UK. Methods A total of 350 shoulder surgeons working in NHS hospitals were asked to complete a short written questionnaire regarding their use of scoring systems and outcome measures. Questionnaires were sent and responses were received by post. Results Overall, 217 responses were received (62%). Of the respondents, 171 (79%) use an outcome measure in their shoulder practice while 46 (21%) do not. There were 118 surgeons (69%) who use more than one outcome measure. The Oxford shoulder score was most commonly used by 150 surgeons (69%), followed by the Constant score with 106 (49%), the Oxford shoulder instability score with 82 (38%), and the Disabilities of the Arm, Shoulder and Hand score with 54 (25%). The less commonly used outcome measures were the SF-36® and SF-12® health questionnaires with 19 (9%), the University of California at Los Angeles activity score with 8 (4%), the American Shoulder and Elbow Surgeons shoulder assessment form with 8 (4%) and the EQ-5D™ with 10 (3%). Conclusions Validated outcome measures should be adopted by all practising surgeons in all specialties. This will allow better assessment of treatments in addition to assessment of surgical performance in a transparent way. PMID:25350180

The use of shoulder scoring systems and outcome measures in the UK.

PubMed

Varghese, M; Lamb, J; Rambani, R; Venkateswaran, B

2014-11-01

In future, outcomes following shoulder surgery may be subject to public survey. Many outcome measures exist but we do not know whether there is a consensus between shoulder surgeons in the UK. The aim of this study was to survey the preferred outcome measures used by National Health Service (NHS) shoulder surgeons operating in the UK. A total of 350 shoulder surgeons working in NHS hospitals were asked to complete a short written questionnaire regarding their use of scoring systems and outcome measures. Questionnaires were sent and responses were received by post. Overall, 217 responses were received (62%). Of the respondents, 171 (79%) use an outcome measure in their shoulder practice while 46 (21%) do not. There were 118 surgeons (69%) who use more than one outcome measure. The Oxford shoulder score was most commonly used by 150 surgeons (69%), followed by the Constant score with 106 (49%), the Oxford shoulder instability score with 82 (38%), and the Disabilities of the Arm, Shoulder and Hand score with 54 (25%). The less commonly used outcome measures were the SF-36® and SF-12® health questionnaires with 19 (9%), the University of California at Los Angeles activity score with 8 (4%), the American Shoulder and Elbow Surgeons shoulder assessment form with 8 (4%) and the EQ-5D™ with 10 (3%). Conclusions Validated outcome measures should be adopted by all practising surgeons in all specialties. This will allow better assessment of treatments in addition to assessment of surgical performance in a transparent way.

Measuring Outcomes for Young Children and Their Families. Outcome Indicators for Everyday Kids, Everyday Lives: A Vision for Pennsylvania's Children

ERIC Educational Resources Information Center

Trivette, Carol M.; Dunst, Carl J.

2011-01-01

This monograph includes the final report for a project funded by the Pennsylvania Developmental Disabilities Council for "Measuring Outcomes for Children" (2008 RFP). The goal of the project was to "develop and demonstrate the effectiveness of an instrument designed to measure life outcomes of children with disabilities being…

Quality measures for nurse practitioner practice evaluation.

PubMed

Kleinpell, Ruth; Kapu, April N

2017-08-01

Evaluating the impact of nurse practitioner (NP) practice has become a priority area of focus for demonstrating outcomes. A number of quality measures are available to enable practice-specific evaluation of NP roles and initiatives. This article reviews sources of quality measures that can be used to facilitate quantifying the outcomes of NP practice as part of an overall evaluation agenda. National resources and published literature on NP quality measures were reviewed. Various resources and toolkits exist to assist NPs in identifying outcomes of practice using quality measures. The need to demonstrate outcomes of NP practice remains an ongoing priority area regardless of the clinical practice setting. A variety of sources of quality measures exist that can be used to showcase the effect of NP care. The use of quality measures can be effectively integrated into evaluation of NP role and NP-directed initiatives to demonstrate impact, and enhance the conduct of an NP outcomes assessment. The use of organizational, NP-specific, and national-related quality measures can help to showcase how NP care improves the quality, safety, and costs of health care. ©2017 American Association of Nurse Practitioners.

Reaching clinically relevant outcome measures for new pharmacotherapy and immunotherapy of atopic eczema.

PubMed

Chalmers, Joanne; Deckert, Stefanie; Schmitt, Jochen

2015-06-01

This article describes the core outcome set (COS) for atopic eczema trials. COS describe a minimum set of outcomes to be assessed in a defined situation. COS are required to overcome the current situation of different trials using different endpoints with unclear/insufficient measurement properties resulting in incomparable trials. The global multi-stakeholder Harmonising Outcomes Measures for Eczema initiative developed the Harmonising Outcomes Measures for Eczema roadmap as a generic framework for COS development. Following the establishment of a panel representing all stakeholders, a core set of outcome domains need to be selected based on systematic reviews and consensus methods. Outcome measurement instruments to assess these core domains need to be valid, reliable, and feasible. There is broad global consensus that clinical signs, quality of life, symptoms, and long-term control of flares form the COS for atopic eczema trials. The Eczema Area and Severity Index is recommended to assess clinical signs in atopic eczema trials. Systematic reviews to identify adequate outcome measurement instruments for the other core outcome domains are underway. Clinical signs should be assessed in all atopic eczema trials by at least the Eczema Area and Severity Index. Quality of life, symptoms, and flares should also be assessed in all atopic eczema trials by a valid, reliable, and feasible instrument.

Association of surgical care improvement project infection-related process measure compliance with risk-adjusted outcomes: implications for quality measurement.

PubMed

Ingraham, Angela M; Cohen, Mark E; Bilimoria, Karl Y; Dimick, Justin B; Richards, Karen E; Raval, Mehul V; Fleisher, Lee A; Hall, Bruce L; Ko, Clifford Y

2010-12-01

Facility-level process measure adherence is being publicly reported. However, the association between measure adherence and surgical outcomes is not well-established. Our objective was to determine the degree to which Surgical Care Improvement Project (SCIP) process measures are associated with American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) risk-adjusted outcomes. This cross-sectional study included hospitals participating in the ACS NSQIP and SCIP (n = 200). ACS NSQIP outcomes (30-day overall morbidity, serious morbidity, surgical site infections [SSI], and mortality) and adherence to SCIP SSI-related process measures (from the Hospital Compare database) were collected from January 1, 2008, through December 31, 2008. Hospital-level correlation coefficients between compliance with 4 process measures (ie, antibiotic administration within 1 hour before incision [SCIP-1]; appropriate antibiotic prophylaxis [SCIP-2]; antibiotic discontinuation within 24 hours after surgery [SCIP-3]; and appropriate hair removal [SCIP 6]) and 4 risk-adjusted outcomes were calculated. Regression analyses estimated the contribution of process measure adherence to risk-adjusted outcomes. Of 211 ACS NSQIP hospitals, 95% had data reported by Hospital Compare. Depending on the measure, hospital-level compliance ranged from 60% to 100%. Of the 16 correlations, 15 demonstrated nonsignificant associations with risk-adjusted outcomes. The exception was the relationship between SCIP-2 and SSI (p = 0.004). SCIP-1 demonstrated an intriguing but nonsignificant relationship with SSI (p = 0.08) and overall morbidity (p = 0.08). Although adherence to SCIP-2 was a significant predictor of risk-adjusted SSI (p < 0.0001) and overall morbidity (p < 0.0001), inclusion of compliance for SCIP-1 and SCIP-2 caused only slight improvement in model quality. Better adherence to infection-related process measures over the observed range was not significantly associated with better outcomes with one exception. Different measures of quality might be needed for surgical infection. Copyright © 2010 American College of Surgeons. Published by Elsevier Inc. All rights reserved.

Learning Outcomes across Disciplines and Professions: Measurement and Interpretation

ERIC Educational Resources Information Center

Caspersen, Joakim; Frølich, Nicoline; Karlsen, Hilde; Aamodt, Per Olaf

2014-01-01

Learning outcomes of higher education are a quality tool in a changing higher education landscape but cannot be seen as neutral measures across professions and disciplines. Survey results from graduates and recent graduates indicate that prevailing measures of learning outcomes yield the same result within and across disciplinary and professional…

Measurement of Outcomes in Vision-Related Rehabilitation.

ERIC Educational Resources Information Center

Head, Daniel

1998-01-01

Comments on an earlier article by Lorraine Lidoff on health insurance coverage of vision-related rehabilitation services. Urges a standard model of services involving selection of measurable outcomes that reflect treatment processes, selection of the most appropriate time to measure outcomes, and selection of the best method for collecting outcome…

Measuring outcomes of community aged care programs: challenges, opportunities and the Australian Community Outcomes Measurement ACCOM tool.

PubMed

Cardona, Beatriz

2018-05-29

Measuring health and wellbeing outcomes of community aged care programs is a complex task given the diverse settings in which care takes place and the intersection of numerous factors affecting an individual's quality of life outcomes. Knowledge of a strong causal relationship between services provided and the final outcome enables confidence in assuming the care provided was largely responsible for the outcome achieved (Courtney et al., Aust J Adv Nurs 26:49-57, 2009). The Department of Health has recently reported on the findings of The National Aged Care Quality Indicator Program - Home Care Pilot (KPMG, National Aged Care Quality Indicator Program - Home Care Pilot, 2017). The Program sought to test various tools to measure quality of life outcomes of their community aged care programs. Some of the key issues raised in the study reiterate the findings from The Australian Community Care Outcome Measurement (ACCOM) pilot study (Cardona et al., Australas J Ageing 36: 69-71, 2017), including the value of the ASCOT SCT4 tool (Adult Social care Outcomes Toolkit, http://www.pssru.ac.uk/ascot/downloads/questionnaires/sct4.pdf ) to measure social care related quality of life (SCRQoL) in community aged care programs in the Australian context, the collection of additional data to map the relationship of various variables such as functional ability, demographic characteristics and quality of life scores and the governance and administration of measurement tools for the purpose of quality reporting and consumer choice.

Positive psychology outcome measures for family caregivers of people living with dementia: a systematic review.

PubMed

Stansfeld, Jacki; Stoner, Charlotte R; Wenborn, Jennifer; Vernooij-Dassen, Myrra; Moniz-Cook, Esme; Orrell, Martin

2017-08-01

Family caregivers of people living with dementia can have both positive and negative experiences of caregiving. Despite this, existing outcome measures predominately focus on negative aspects of caregiving such as burden and depression. This review aimed to evaluate the development and psychometric properties of existing positive psychology measures for family caregivers of people living with dementia to determine their potential utility in research and practice. A systematic review of positive psychology outcome measures for family caregivers of people with dementia was conducted. The databases searched were as follows: PsychINFO, CINAHL, MEDLINE, EMBASE, and PubMed. Scale development papers were subject to a quality assessment to appraise psychometric properties. Twelve positive outcome measures and six validation papers of these scales were identified. The emerging constructs of self-efficacy, spirituality, resilience, rewards, gain, and meaning are in line with positive psychology theory. There are some robust positive measures in existence for family caregivers of people living with dementia. However, lack of reporting of the psychometric properties hindered the quality assessment of some outcome measures identified in this review. Future research should aim to include positive outcome measures in interventional research to facilitate a greater understanding of the positive aspects of caregiving and how these contribute to well-being.

Outcome Measures Used in Clinical Trials for Behçet Syndrome: A Systematic Review

PubMed Central

Hatemi, Gulen; Merkel, Peter A.; Hamuryudan, Vedat; Boers, Maarten; Direskeneli, Haner; Aydin, Sibel Z.; Yazici, Hasan

2015-01-01

Behçet syndrome (BS) is a multisystem vasculitis that is most active during young adulthood, causing serious disability and significant impairment in quality of life. Differences in the disease course, severity, and organ involvement between patients, depending on the age at presentation and sex, makes it impossible to determine a single management strategy. The diversity and variability in the outcome measures used in clinical trials in BS makes it difficult to compare the results or inform physicians about the best management strategy for individual patients. There is a large unmet need to determine or develop validated outcome measures for use in clinical trials in BS that are acceptable to researchers and regulatory agencies. We conducted a systematic review to describe the outcomes and outcome measures that have been used in clinical trials in BS. This review revealed the diversity and variability in the outcomes and outcome measures and the lack of standard definitions for most outcomes and rarity of validated outcome tools for disease assessment in BS. This systematic literature review will identify domains and candidate instruments for use in a Delphi exercise, the next step in the development of a core set of outcome measures that are properly validated and widely accepted by the collaboration of researchers from many different regions of the world and from different specialties, including rheumatology, ophthalmology, dermatology, gastroenterology, and neurology. PMID:24488418

Outcome measures used in clinical trials for Behçet syndrome: a systematic review.

PubMed

Hatemi, Gulen; Merkel, Peter A; Hamuryudan, Vedat; Boers, Maarten; Direskeneli, Haner; Aydin, Sibel Z; Yazici, Hasan

2014-03-01

Behçet syndrome (BS) is a multisystem vasculitis that is most active during young adulthood, causing serious disability and significant impairment in quality of life. Differences in the disease course, severity, and organ involvement between patients, depending on the age at presentation and sex, makes it impossible to determine a single management strategy. The diversity and variability in the outcome measures used in clinical trials in BS makes it difficult to compare the results or inform physicians about the best management strategy for individual patients. There is a large unmet need to determine or develop validated outcome measures for use in clinical trials in BS that are acceptable to researchers and regulatory agencies. We conducted a systematic review to describe the outcomes and outcome measures that have been used in clinical trials in BS. This review revealed the diversity and variability in the outcomes and outcome measures and the lack of standard definitions for most outcomes and rarity of validated outcome tools for disease assessment in BS. This systematic literature review will identify domains and candidate instruments for use in a Delphi exercise, the next step in the development of a core set of outcome measures that are properly validated and widely accepted by the collaboration of researchers from many different regions of the world and from different specialties, including rheumatology, ophthalmology, dermatology, gastroenterology, and neurology.

Towards global consensus on outcome measures for atopic eczema research: results of the HOME II meeting.

PubMed

Schmitt, Jochen; Spuls, Phyllis; Boers, Maarten; Thomas, Kim; Chalmers, Joanne; Roekevisch, Evelien; Schram, Mandy; Allsopp, Richard; Aoki, Valeria; Apfelbacher, Christian; Bruijnzeel-Koomen, Carla; Bruin-Weller, Marjolein; Charman, Carolyn; Cohen, Arnon; Dohil, Magdalene; Flohr, Carsten; Furue, Masutaka; Gieler, Uwe; Hooft, Lotty; Humphreys, Rosemary; Ishii, Henrique Akira; Katayama, Ichiro; Kouwenhoven, Willem; Langan, Sinéad; Lewis-Jones, Sue; Merhand, Stephanie; Murota, Hiroyuki; Murrell, Dedee F; Nankervis, Helen; Ohya, Yukihiro; Oranje, Arnold; Otsuka, Hiromi; Paul, Carle; Rosenbluth, Yael; Saeki, Hidehisa; Schuttelaar, Marie-Louise; Stalder, Jean-Francois; Svensson, Ake; Takaoka, Roberto; Wahlgren, Carl-Fredrik; Weidinger, Stephan; Wollenberg, Andreas; Williams, Hywel

2012-09-01

The use of nonstandardized and inadequately validated outcome measures in atopic eczema trials is a major obstacle to practising evidence-based dermatology. The Harmonising Outcome Measures for Eczema (HOME) initiative is an international multiprofessional group dedicated to atopic eczema outcomes research. In June 2011, the HOME initiative conducted a consensus study involving 43 individuals from 10 countries, representing different stakeholders (patients, clinicians, methodologists, pharmaceutical industry) to determine core outcome domains for atopic eczema trials, to define quality criteria for atopic eczema outcome measures and to prioritize topics for atopic eczema outcomes research. Delegates were given evidence-based information, followed by structured group discussion and anonymous consensus voting. Consensus was achieved to include clinical signs, symptoms, long-term control of flares and quality of life into the core set of outcome domains for atopic eczema trials. The HOME initiative strongly recommends including and reporting these core outcome domains as primary or secondary endpoints in all future atopic eczema trials. Measures of these core outcome domains need to be valid, sensitive to change and feasible. Prioritized topics of the HOME initiative are the identification/development of the most appropriate instruments for the four core outcome domains. HOME is open to anyone with an interest in atopic eczema outcomes research. © 2012 John Wiley & Sons A/S.

Patient-reported outcomes (PROs): the significance of using humanistic measures in clinical trial and clinical practice.

PubMed

Refolo, P; Minacori, R; Mele, V; Sacchini, D; Spagnolo, A G

2012-10-01

Patient-reported outcome (PRO) is an "umbrella term" that covers a whole range of potential types of measurement but it is used specifically to refer to all measures quantifying the state of health through the evaluation of outcomes reported by the patient himself/herself. PROs are increasingly seen as complementary to biomedical measures and they are being incorporated more frequently into clinical trials and clinical practice. After considering the cultural background of PROs - that is the well known patient-centered model of medicine -, their historical profile (since 1914, the year of the first outcome measure) and typologies, the paper aims at debating their methodological complexity and implementation into practice. Some clinical trials and therapeutic managements utilizing patient-centered measures will be also analyzed.

Systematic review of tools to measure outcomes for young children with autism spectrum disorder.

PubMed

McConachie, Helen; Parr, Jeremy R; Glod, Magdalena; Hanratty, Jennifer; Livingstone, Nuala; Oono, Inalegwu P; Robalino, Shannon; Baird, Gillian; Beresford, Bryony; Charman, Tony; Garland, Deborah; Green, Jonathan; Gringras, Paul; Jones, Glenys; Law, James; Le Couteur, Ann S; Macdonald, Geraldine; McColl, Elaine M; Morris, Christopher; Rodgers, Jacqueline; Simonoff, Emily; Terwee, Caroline B; Williams, Katrina

2015-06-01

The needs of children with autism spectrum disorder (ASD) are complex and this is reflected in the number and diversity of outcomes assessed and measurement tools used to collect evidence about children's progress. Relevant outcomes include improvement in core ASD impairments, such as communication, social awareness, sensory sensitivities and repetitiveness; skills such as social functioning and play; participation outcomes such as social inclusion; and parent and family impact. To examine the measurement properties of tools used to measure progress and outcomes in children with ASD up to the age of 6 years. To identify outcome areas regarded as important by people with ASD and parents. The MeASURe (Measurement in Autism Spectrum disorder Under Review) research collaboration included ASD experts and review methodologists. We undertook systematic review of tools used in ASD early intervention and observational studies from 1992 to 2013; systematic review, using the COSMIN checklist (Consensus-based Standards for the selection of health Measurement Instruments) of papers addressing the measurement properties of identified tools in children with ASD; and synthesis of evidence and gaps. The review design and process was informed throughout by consultation with stakeholders including parents, young people with ASD, clinicians and researchers. The conceptual framework developed for the review was drawn from the International Classification of Functioning, Disability and Health, including the domains 'Impairments', 'Activity Level Indicators', 'Participation', and 'Family Measures'. In review 1, 10,154 papers were sifted - 3091 by full text - and data extracted from 184; in total, 131 tools were identified, excluding observational coding, study-specific measures and those not in English. In review 2, 2665 papers were sifted and data concerning measurement properties of 57 (43%) tools were extracted from 128 papers. Evidence for the measurement properties of the reviewed tools was combined with information about their accessibility and presentation. Twelve tools were identified as having the strongest supporting evidence, the majority measuring autism characteristics and problem behaviour. The patchy evidence and limited scope of outcomes measured mean these tools do not constitute a 'recommended battery' for use. In particular, there is little evidence that the identified tools would be good at detecting change in intervention studies. The obvious gaps in available outcome measurement include well-being and participation outcomes for children, and family quality-of-life outcomes, domains particularly valued by our informants (young people with ASD and parents). This is the first systematic review of the quality and appropriateness of tools designed to monitor progress and outcomes of young children with ASD. Although it was not possible to recommend fully robust tools at this stage, the review consolidates what is known about the field and will act as a benchmark for future developments. With input from parents and other stakeholders, recommendations are made about priority targets for research. Priorities include development of a tool to measure child quality of life in ASD, and validation of a potential primary outcome tool for trials of early social communication intervention. This study is registered as PROSPERO CRD42012002223. The National Institute for Health Research Health Technology Assessment programme.

Patient-reported outcome measures versus inertial performance-based outcome measures: A prospective study in patients undergoing primary total knee arthroplasty.

PubMed

Bolink, S A A N; Grimm, B; Heyligers, I C

2015-12-01

Outcome assessment of total knee arthroplasty (TKA) by subjective patient reported outcome measures (PROMs) may not fully capture the functional (dis-)abilities of relevance. Objective performance-based outcome measures could provide distinct information. An ambulant inertial measurement unit (IMU) allows kinematic assessment of physical performance and could potentially be used for routine follow-up. To investigate the responsiveness of IMU measures in patients following TKA and compare outcomes with conventional PROMs. Patients with end stage knee OA (n=20, m/f=7/13; age=67.4 standard deviation 7.7 years) were measured preoperatively and one year postoperatively. IMU measures were derived during gait, sit-stand transfers and block step-up transfers. PROMs were assessed by using the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and Knee Society Score (KSS). Responsiveness was calculated by the effect size, correlations were calculated with Spearman's rho correlation coefficient. One year after TKA, patients performed significantly better at gait, sit-to-stand transfers and block step-up transfers. Measures of time and kinematic IMU measures demonstrated significant improvements postoperatively for each performance-based test. The largest improvement was found in block step-up transfers (effect size=0.56-1.20). WOMAC function score and KSS function score demonstrated moderate correlations (Spearman's rho=0.45-0.74) with some of the physical performance-based measures pre- and postoperatively. To characterize the changes in physical function after TKA, PROMs could be supplemented by performance-based measures, assessing function during different activities and allowing kinematic characterization with an ambulant IMU. Copyright © 2015 Elsevier B.V. All rights reserved.

The uses of outcome measures within multidisciplinary early childhood intervention services: a systematic review.

PubMed

Calder, Samuel; Ward, Roslyn; Jones, Megan; Johnston, Jenelle; Claessen, Mary

2017-07-18

Purpose of the article: To review the use of outcome measures, across the domains of activity, participation, and environment, within multidisciplinary early childhood intervention services. A systematic literature search was undertaken that included four electronic databases: Medline, CINAHL, EMBASE, and the Cochrane Library and Cochrane Database of Systematic Review. Inclusion criteria were age 0-24 months, having or at risk of a developmental disability, in receipt of multidisciplinary early childhood intervention services, and included outcome measures across all domains of the International Classification of Functioning-Child & Youth (ICF-CY). Only peer-reviewed journal articles were considered. Eligible studies were coded using the Oxford Levels of Evidence. Methodological quality was assessed using the Physiotherapy Evidence Database (PEDro) Scale for randomised controlled trials and the QualSyst for non-randomised control trials. Of the total of 5764 records identified, 10 were considered to meet inclusion criteria. Fourteen outcome measures were identified, addressing the domains of activity, participation, and environment. Of these, eight have been recommended in the early intervention literature. While the methodological quality of the 10 studies varied, these papers make a contribution to the body of research that acknowledges the role of routine and enriched environments. Implications for Rehabilitation Core practice elements of multidisciplinary early childhood intervention services indicate it is necessary to select outcome measures framed within the International Classification of Functioning-Child & Youth to inform clinical decision-making for measuring intervention effectiveness across the domains of activity, participation and environment. Of the identified measures, three (Canadian Occupational Performance Measure, Pediatric Evaluation of Disability Inventory, and Goal Attainment Scaling) are well-established and identified in the literature as multidisciplinary outcome measures for children with developmental disability. The selection of an appropriate outcome measure depends on the age of the child, individual goals of the family, and the type of intervention. This requires the combination of measures as no one measure alone will capture all components of the International Classification of Functioning-Child & Youth.

Use of Objective Metrics in Dynamic Facial Reanimation: A Systematic Review.

PubMed

Revenaugh, Peter C; Smith, Ryan M; Plitt, Max A; Ishii, Lisa; Boahene, Kofi; Byrne, Patrick J

2018-06-21

Facial nerve deficits cause significant functional and social consequences for those affected. Existing techniques for dynamic restoration of facial nerve function are imperfect and result in a wide variety of outcomes. Currently, there is no standard objective instrument for facial movement as it relates to restorative techniques. To determine what objective instruments of midface movement are used in outcome measurements for patients treated with dynamic methods for facial paralysis. Database searches from January 1970 to June 2017 were performed in PubMed, Embase, Cochrane Library, Web of Science, and Scopus. Only English-language articles on studies performed in humans were considered. The search terms used were ("Surgical Flaps"[Mesh] OR "Nerve Transfer"[Mesh] OR "nerve graft" OR "nerve grafts") AND (face [mh] OR facial paralysis [mh]) AND (innervation [sh]) OR ("Face"[Mesh] OR facial paralysis [mh]) AND (reanimation [tiab]). Two independent reviewers evaluated the titles and abstracts of all articles and included those that reported objective outcomes of a surgical technique in at least 2 patients. The presence or absence of an objective instrument for evaluating outcomes of midface reanimation. Additional outcome measures were reproducibility of the test, reporting of symmetry, measurement of multiple variables, and test validity. Of 241 articles describing dynamic facial reanimation techniques, 49 (20.3%) reported objective outcome measures for 1898 patients. Of those articles reporting objective measures, there were 29 different instruments, only 3 of which reported all outcome measures. Although instruments are available to objectively measure facial movement after reanimation techniques, most studies do not report objective outcomes. Of objective facial reanimation instruments, few are reproducible and able to measure symmetry and multiple data points. To accurately compare objective outcomes in facial reanimation, a reproducible, objective, and universally applied instrument is needed.

Data for free--can an electronic medical record provide outcome data for incontinence/prolapse repair procedures?

PubMed

Steidl, Matthew; Zimmern, Philippe

2013-01-01

We determined whether a custom computer program can improve the extraction and accuracy of key outcome measures from progress notes in an electronic medical record compared to a traditional data recording system for incontinence and prolapse repair procedures. Following institutional review board approval, progress notes were exported from the Epic electronic medical record system for outcome measure extraction by a custom computer program. The extracted data (D1) were compared against a manually maintained outcome measures database (D2). This work took place in 2 phases. During the first phase, volatile data such as questionnaires and standardized physical examination findings using the POP-Q (pelvic organ prolapse quantification) system were extracted from existing progress notes. The second phase used a progress note template incorporating key outcome measures to evaluate improvement in data accuracy and extraction rates. Phase 1 compared 6,625 individual outcome measures from 316 patients in D2 to 3,534 outcome measures extracted from progress notes in D1, resulting in an extraction rate of 53.3%. A subset of 3,763 outcome measures from D1 was created by excluding data that did not exist in the extraction, yielding an accuracy rate of 93.9%. With the use of the template in phase 2, the extraction rate improved to 91.9% (273 of 297) and the accuracy rate improved to 100% (273 of 273). In the field of incontinence and prolapse, the disciplined use of an electronic medical record template containing a preestablished set of key outcome measures can provide the ideal interface between required documentation and clinical research. Copyright © 2013 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Do Activity Level Outcome Measures Commonly Used in Neurological Practice Assess Upper-Limb Movement Quality?

PubMed

Demers, Marika; Levin, Mindy F

2017-07-01

Movement is described in terms of task-related end point characteristics in external space and movement quality (joint rotations in body space). Assessment of upper-limb (UL) movement quality can assist therapists in designing effective treatment approaches for retraining lost motor elements and provide more detailed measurements of UL motor improvements over time. To determine the extent to which current activity level outcome measures used in neurological practice assess UL movement quality. Outcome measures assessing arm/hand function at the International Classification of Function activity level recommended by neurological clinical practice guidelines were reviewed. Measures assessing the UL as part of a general mobility assessment, those strictly evaluating body function/structure or participation, and paediatric measures were excluded. In all, 15 activity level outcome measures were identified; 9 measures assess how movement is performed by measuring either end point characteristics or movement quality. However, except for the Reaching Performance Scale for Stroke and the Motor Evaluation Scale for Upper Extremity in Stroke Patients, these measures only account for deficits indirectly by giving a partial score if movements are slower or if the person experiences difficulties. Six outcome measures neither assess any parameters related to movement quality, nor distinguish between improvements resulting from motor compensation or recovery of desired movement strategies. Current activity measures may not distinguish recovery from compensation and adequately track changes in movement quality over time. Movement quality may be incorporated into clinical assessment using observational kinematics with or without low-cost motion tracking technology.

Use of quality measures for Medicaid behavioral health services by state agencies: implications for health care reform.

PubMed

Seibert, Julie; Fields, Suzanne; Fullerton, Catherine Anne; Mark, Tami L; Malkani, Sabrina; Walsh, Christine; Ehrlich, Emily; Imshaug, Melina; Tabrizi, Maryam

2015-06-01

The structure-process-outcome quality framework espoused by Donabedian provides a conceptual way to examine and prioritize behavioral health quality measures used by states. This report presents an environmental scan of the quality measures and satisfaction surveys that state Medicaid managed care and behavioral health agencies used prior to Medicaid expansion in 2014. Data were collected by reviewing online documents related to Medicaid managed care contracts for behavioral health, quality strategies, quality improvement plans, quality and performance indicators data, annual outcomes reports, performance measure specification manuals, legislative reports, and Medicaid waiver requests for proposals. Information was publicly available for 29 states. Most states relied on process measures, along with some structure and outcome measures. Although all states reported on at least one process measure of behavioral health quality, 52% of states did not use any outcomes measures and 48% of states had no structure measures. A majority of the states (69%) used behavioral health measures from the National Committee for Quality Assurance's Healthcare Effectiveness Data and Information Set, and all but one state in the sample (97%) used consumer experience-of-care surveys. Many states supplemented these data with locally developed behavioral health indicators that rely on administrative and nonadministrative data. State Medicaid agencies are using nationally recognized as well as local measures to assess quality of behavioral health care. Findings indicate a need for additional nationally endorsed measures in the area of substance use disorders and treatment outcomes.

The development and preliminary psychometric properties of two positive psychology outcome measures for people with dementia: the PPOM and the EID-Q.

PubMed

Stoner, Charlotte R; Orrell, Martin; Long, Maria; Csipke, Emese; Spector, Aimee

2017-03-21

Positive psychology research in dementia care has largely been confined to the qualitative literature because of the lack of robust outcome measures. The aim of this study was to develop positive psychology outcome measures for people with dementia. Two measures were each developed in four stages. Firstly, literature reviews were conducted to identify and operationalise salient positive psychology themes in the qualitative literature and to examine existing measures of positive psychology. Secondly, themes were discussed within a qualitative study to add content validity for identified concepts (n = 17). Thirdly, draft measures were submitted to a panel of experts for feedback (n = 6). Finally, measures were used in a small-scale pilot study (n = 33) to establish psychometric properties. Salient positive psychology themes were identified as hope, resilience, a sense of independence and social engagement. Existing measures of hope and resilience were adapted to form the Positive Psychology Outcome Measure (PPOM). Due to the inter-relatedness of independence and engagement for people with dementia, 28 items were developed for a new scale of Engagement and Independence in Dementia Questionnaire (EID-Q) following extensive qualitative work. Both measures demonstrated acceptable internal consistency (α = .849 and α = .907 respectively) and convergent validity. Two new positive psychology outcome measures were developed using a robust four-stage procedure. Preliminary psychometric data was adequate and the measures were easy to use, and acceptable for people with dementia.

Measuring what matters to rare disease patients - reflections on the work by the IRDiRC taskforce on patient-centered outcome measures.

PubMed

Morel, Thomas; Cano, Stefan J

2017-11-02

Our ability to evaluate outcomes which genuinely reflect patients' unmet needs, hopes and concerns is of pivotal importance. However, much current clinical research and practice falls short of this objective by selecting outcome measures which do not capture patient value to the fullest. In this Opinion, we discuss Patient-Centered Outcomes Measures (PCOMs), which have the potential to systematically incorporate patient perspectives to measure those outcomes that matter most to patients. We argue for greater multi-stakeholder collaboration to develop PCOMs, with rare disease patients and families at the center. Beyond advancing the science of patient input, PCOMs are powerful tools to translate care or observed treatment benefit into an 'interpretable' measure of patient benefit, and thereby help demonstrate clinical effectiveness. We propose mixed methods psychometric research as the best route to deliver fit-for-purpose PCOMs in rare diseases, as this methodology brings together qualitative and quantitative research methods in tandem with the explicit aim to efficiently utilise data from small samples. And, whether one opts to develop a brand-new PCOM or to select or adapt an existing outcome measure for use in a rare disease, the anchors remain the same: patients, their daily experience of the rare disease, their preferences, core concepts and values. Ultimately, existing value frameworks, registries, and outcomes-based contracts largely fall short of consistently measuring the full range of outcomes that matter to patients. We argue that greater use of PCOMs in rare diseases would enable a fast track to Patient-Centered Care.

Modeling and Predicting Hearing Aid Outcome

PubMed Central

Humes, Larry E.

2003-01-01

Following a brief tutorial on the application of factor analysis to hearing aid outcome measures, three studies of hearing aid outcome measures in elderly adults are presented and analyzed. Two of the studies were completed at Indiana University (IU-1 and IU-2), and one was a collaborative multisite study by the Veterans Administration and the National Institute of Deafness and other Communication Disorders (NIDCD/VA). IU-1 measured hearing aid outcome in 173 elderly wearers of single-channel, linear, in-the-ear hearing aids with output-limiting compression, whereas IU-2 obtained the same extensive set of outcome measures from 53 elderly wearers of two-channel, wide-dynamic-range compression, in-the-canal hearing aids. In the NIDCD/VA study, 333 to 338 participants wore three single-channel circuits in succession, with each circuit housed within an in-the-ear shell. The three circuits included in that study and in this analysis were: (1) linear with peak clipping, (2) linear with output-limiting compression, and (3) single-channel, wide-dynamic-range compression. Evaluation of the many outcome measures completed in each study using principal components factor analysis revealed that from three (both IU studies) to five (NIDCD/VA study) principal components captured the individual differences in hearing aid outcome. This was independent of hearing aid type (in-the-ear or in-the-canal) and circuitry. Subsequent multiple regression analyses of individual differences in performance along each dimension of hearing aid outcome revealed that these individual differences could be accounted for reasonably well by various prefit variables for some dimensions of outcome, but not others. In general, measures of speech recognition performance were well accounted for by prefit measures, with the best predictors being hearing loss, cognitive performance, and age. Measures of hearing aid usage were less well accounted for by prefit measures, with the most accurate predictor of current hearing aid use being prior hearing aid use. The outcome dimension accounted for most poorly was that associated with hearing aid satisfaction, with subjective measures of aided sound quality being the best predictor of performance along this dimension of hearing aid outcome. Additional multicenter, large-scale studies are needed to develop more complete models of hearing aid outcome and to identify the variables that influence various aspects of hearing aid outcome. It is only through this additional research that it will be possible to optimize outcome for hearing aid wearers. PMID:15004647

Benchmarking: measuring the outcomes of evidence-based practice.

PubMed

DeLise, D C; Leasure, A R

2001-01-01

Measurement of the outcomes associated with implementation of evidence-based practice changes is becoming increasingly emphasized by multiple health care disciplines. A final step to the process of implementing and sustaining evidence-supported practice changes is that of outcomes evaluation and monitoring. The comparison of outcomes to internal and external measures is known as benchmarking. This article discusses evidence-based practice, provides an overview of outcomes evaluation, and describes the process of benchmarking to improve practice. A case study is used to illustrate this concept.

A multicenter study analyzing the relationship of a standardized radiographic scoring system of adolescent idiopathic scoliosis and the Scoliosis Research Society outcomes instrument.

PubMed

Wilson, Philip L; Newton, Peter O; Wenger, Dennis R; Haher, Thomas; Merola, Andrew; Lenke, Larry; Lowe, Thomas; Clements, David; Betz, Randy

2002-09-15

A multicenter study examining the association between radiographic and outcomes measures in adolescent idiopathic scoliosis. To evaluate the association between an objective radiographic scoring system and patient quality of life measures as determined by the Scoliosis Research Society outcomes instrument. Although surgical correction of scoliosis has been reported to be positively correlated with patient outcomes, studies to date have been unable to demonstrate an association between radiographic measures of deformity and outcomes measures in patients with adolescent idiopathic scoliosis. A standardized radiographic deformity scoring system and the Scoliosis Research Society outcome tool were used prospectively in seven scoliosis centers to collect data on patients with adolescent idiopathic scoliosis. A total of 354 data points for 265 patients consisting of those with nonoperative or preoperative curves >or=10 degrees, as well as those with surgically treated curves, were analyzed. Correlation analysis was performed to identify significant relationships between any of the radiographic measures, the Harms Study Group radiographic deformity scores (total, sagittal, coronal), and the seven Scoliosis Research Society outcome domains (Total Pain, General Self-Image, General Function, Activity, Postoperative Self-Image, Postoperative Function, and Satisfaction) as well as Scoliosis Research Society outcomes instrument total scores. Radiographic measures that were identified as significantly correlated with Scoliosis Research Society outcome scores were then entered into a stepwise regression analysis. The coronal measures of thoracic curve and lumbar curve magnitude were found to be significantly correlated with the Total Pain, General Self-Image, and total Scoliosis Research Society scores (P < 0.0001). The thoracic and upper thoracic curve magnitudes were also correlated with General Function (P < 0.002). The "coronal" subscore as well as the "total" score of the Harms Study Group radiographic scoring system were also significantly correlated with these Scoliosis Research Society domain and total scores. No radiographic measures taken after surgery were significantly correlated with the postoperative domains of the Scoliosis Research Society outcomes instrument. Stepwise regression analysis of these radiographic measures as predictors of Scoliosis Research Society scores resulted in adjusted R2 values of 0.03-0.07 (P < 0.0001). Although these results show that a significant association exists between the radiographic Cobb angle measure of the scoliosis and the Scoliosis Research Society outcomes scores, the low R2 values indicate that variables other than the radiographic appearance of the deformity (e.g., psychosocial, functional) must also be affecting these scores. The Cobb angle measure of the major deformity has a small, but statistically significant, correlation with the reported Total Pain, General Self-Image, and General Function as measured by the Scoliosis Research Society outcomes instrument. None of the radiographic measures in this population correlated with postoperative domain scores of the Scoliosis Research Society outcomes tool.

Applying Outcome Measurements: A Guide to Educational Outcome Measurements and Their Uses. Seminar No. 5.

ERIC Educational Resources Information Center

Glaser, Ezra

This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with the application of outcome…

A Correlational Study on Critical Thinking in Nursing as an Outcome Variable for Success

ERIC Educational Resources Information Center

Porter, Rebecca Jean

2018-01-01

Critical thinking is a required curricular outcome for nursing education; however, the literature shows a gap related to valid and reliable tools to measure critical thinking specific to nursing and relating that critical thinking measurement to meaningful outcomes. This study examined critical thinking scores, as measured by Assessment…

Comparison of reliability and responsiveness of patient-reported clinical outcome measures in knee osteoarthritis rehabilitation.

PubMed

Williams, Valerie J; Piva, Sara R; Irrgang, James J; Crossley, Chad; Fitzgerald, G Kelley

2012-08-01

Secondary analysis, pretreatment-posttreatment observational study. To compare the reliability and responsiveness of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), the Knee Outcome Survey activities of daily living subscale (KOS-ADL), and the Lower Extremity Functional Scale (LEFS) in individuals with knee osteoarthritis (OA). The WOMAC is the current standard in patient-reported measures of function in patients with knee OA. The KOS-ADL and LEFS were designed for potential use in patients with knee OA. If the KOS-ADL and LEFS are to be considered viable alternatives to the WOMAC for measuring patient-reported function in individuals with knee OA, they should have measurement properties comparable to the WOMAC. It would also be important to determine whether either of these instruments may be superior to the WOMAC in terms of reliability or responsiveness in this population. Data from 168 subjects with knee OA, who participated in a rehabilitation program, were used in the analyses. Reliability and responsiveness of each outcome measure were estimated at follow-ups of 2, 6, and 12 months. Reliability was estimated by calculating the intraclass correlation coefficient (ICC2,1) for subjects who were unchanged in status from baseline at each follow-up time, based on a global rating of change score. To examine responsiveness, the standard error of the measurement, minimal detectable change, minimal clinically important difference, and the Guyatt responsiveness index were calculated for each outcome measure at each follow-up time. All 3 outcome measures demonstrated reasonable reliability and responsiveness to change. Reliability and responsiveness tended to decrease somewhat with increasing follow-up time. There were no substantial differences between outcome measures for reliability or any of the 3 measures of responsiveness at any follow-up time. The results do not indicate that one outcome measure is more reliable or responsive than another when applied to subjects with knee OA. We believe that all 3 instruments are appropriate outcome measures to examine change in functional status of patients with knee OA.

Surrogacy assessment using principal stratification when surrogate and outcome measures are multivariate normal.

PubMed

Conlon, Anna S C; Taylor, Jeremy M G; Elliott, Michael R

2014-04-01

In clinical trials, a surrogate outcome variable (S) can be measured before the outcome of interest (T) and may provide early information regarding the treatment (Z) effect on T. Using the principal surrogacy framework introduced by Frangakis and Rubin (2002. Principal stratification in causal inference. Biometrics 58, 21-29), we consider an approach that has a causal interpretation and develop a Bayesian estimation strategy for surrogate validation when the joint distribution of potential surrogate and outcome measures is multivariate normal. From the joint conditional distribution of the potential outcomes of T, given the potential outcomes of S, we propose surrogacy validation measures from this model. As the model is not fully identifiable from the data, we propose some reasonable prior distributions and assumptions that can be placed on weakly identified parameters to aid in estimation. We explore the relationship between our surrogacy measures and the surrogacy measures proposed by Prentice (1989. Surrogate endpoints in clinical trials: definition and operational criteria. Statistics in Medicine 8, 431-440). The method is applied to data from a macular degeneration study and an ovarian cancer study.

Surrogacy assessment using principal stratification when surrogate and outcome measures are multivariate normal

PubMed Central

Conlon, Anna S. C.; Taylor, Jeremy M. G.; Elliott, Michael R.

2014-01-01

In clinical trials, a surrogate outcome variable (S) can be measured before the outcome of interest (T) and may provide early information regarding the treatment (Z) effect on T. Using the principal surrogacy framework introduced by Frangakis and Rubin (2002. Principal stratification in causal inference. Biometrics 58, 21–29), we consider an approach that has a causal interpretation and develop a Bayesian estimation strategy for surrogate validation when the joint distribution of potential surrogate and outcome measures is multivariate normal. From the joint conditional distribution of the potential outcomes of T, given the potential outcomes of S, we propose surrogacy validation measures from this model. As the model is not fully identifiable from the data, we propose some reasonable prior distributions and assumptions that can be placed on weakly identified parameters to aid in estimation. We explore the relationship between our surrogacy measures and the surrogacy measures proposed by Prentice (1989. Surrogate endpoints in clinical trials: definition and operational criteria. Statistics in Medicine 8, 431–440). The method is applied to data from a macular degeneration study and an ovarian cancer study. PMID:24285772

Ancillary outcome measures for assessment of individuals with cervical spondylotic myelopathy.

PubMed

Kalsi-Ryan, Sukhvinder; Singh, Anoushka; Massicotte, Eric M; Arnold, Paul M; Brodke, Darrel S; Norvell, Daniel C; Hermsmeyer, Jeffrey T; Fehlings, Michael G

2013-10-15

Narrative review. To identify suitable outcome measures that can be used to quantify neurological and functional impairment in the management of cervical spondylotic myelopathy (CSM). CSM is the leading cause of acquired spinal cord disability, causing varying degrees of neurological impairment which impact on independence and quality of life. Because this impairment can have a heterogeneous presentation, a single outcome measure cannot define the broad range of deficits seen in this population. Therefore, it is necessary to define outcome measures that characterize the deficits with greater validity and sensitivity. This review was conducted in 3 stages. Stage I: To evaluate the current use of outcome measures in CSM, PubMed was searched using the name of the outcome measure and the common abbreviation combined with "CSM" or "myelopathy." Stage II: Having identified a lack of appropriate outcome measures, we constructed criteria by which measures appropriate for assessing the various aspects of CSM could be identified. Stage III: A second literature search was then conducted looking at specified outcomes that met these criteria. All literature was reviewed to determine specificity and psychometric properties of outcomes for CSM. Nurick grade, modified Japanese Orthopaedic Association Scale, visual analogue scale (VAS) for pain, Short Form (36) Health Survey (SF-36), and Neck Disability Index were the most commonly cited measures. The Short-Form 36 Health Survey and Myelopathy Disability Index have been validated in the CSM population with multiple studies, whereas the modified Japanese Orthopaedic Association Scale score, Nurick grade, and European Myelopathy Scale each had only one study assessing psychometric characteristics. No validity, reliability, or responsiveness studies were found for the VAS or Neck Disability Index in the CSM population. We recommend that the modified Japanese Orthopaedic Association Scale, Nurick grade, Myelopathy Disability Index, Neck Disability Index, and 30-Meter Walk Test are most appropriate for the assessment of CSM. However, 6 additional outcome measures (QuickDASH, Berg Balance Scale, Graded Redefined Assessment of Strength Sensibility and Prehension, Grip Dynamometer, and GAITRite Analysis) were identified, which provide complementary assessments for CSM. SUMMARY STATEMENTS: There does not exist a single or composite of outcome instruments that measures myelopathy impairment, function/disability, and participation that have also demonstrated reliability, validity, and responsiveness in a CSM population. More work in the development and psychometric evaluation of new or existing measures is necessary to identify the ideal composite of measures to be used in the clinical and research settings. The mJOA, Nurick grade, NDI, MDI, and 30MWT should be adopted in any clinical practice that treats CSM both for screening and clinical follow-up. We propose that clinicians and researchers consider using the ancillary measures identified, such as the QuickDASH, Berg Balance Scale, GRASSP version 1.0, Grip Strength, and GAITRite Analysis. It is highly recommended that baseline and follow-up measurements should be performed in patients with CSM.

Development of an outcome measurement system for service planning for children and youth with special needs

PubMed Central

Kertoy, M K; Russell, D J; Rosenbaum, P; Jaffer, S; Law, M; McCauley, D; Gorter, J W

2013-01-01

Aim This study described the process used in developing an outcome measurement framework for system planning to improve services for children and youth with special needs and their families in a Canadian province. The study reports the results of several parent-completed measures, which would be useful in service planning as well as the acceptability and utility of these measures for use by families and service centres. Methods/results Development of a theoretical framework, consultation with key stakeholders, testing the utility of selected outcome measures and initial dissemination of results were critical elements in the successful development of an outcome system. Consultation with stakeholders confirmed use of the International Classification of Functioning, Disability and Health and the child-within-family-within community model as theoretical frameworks while building valuable partnerships and identifying potential barriers to implementation. Pilot testing showed three outcome measures were feasible for families to complete and the measures provided information about services for children that was valuable to families as well as service providers. Gaps in service delivery were identified and the need for better communication between service providers and communities to facilitate integrated services was highlighted. Conclusion The findings from this study can be used to implement an outcome measurement system for children with special needs and may serve as a resource for international researchers who are working to develop valid tools as well as outcome systems that are useful for system planning. PMID:22845889

Performance Measurement using KPKU- BUMN in X School Education Foundation

NASA Astrophysics Data System (ADS)

Arijanto, Sugih; Harsono, Ambar; Taroepratjeka, Harsono

2016-01-01

The purpose of this research is to determine X School's Strengths and Opportunity of Improvement through performance measurement using KPKU-BUMN (Kriteria Penilaian Kinerja Unggul - Kementerian Badan Usaha Milik Negara). KPKU-BUMN is developed based on Malcolm Baldrige Criteria for Performance Excellent (MBCfPE). X school is an education foundation at Bandung that has provides education from kindergarten, elementary school, to junior and senior high school. The measurement is implemented by two aspects, Process and Result. The Process is measured by A-D-L-I approaches (Approach- Deployment-Learning- Integration), on the other hand The Result is measured by Le-T-C-I approach (Level-Trend- Comparison-Integration). There are six processes that will be measured: (1) Leadership, (2) Strategic Planning, (3) Customer Focus, (4) Measurement, Analysis and Knowledge Management, (5) Work Force Focus, and (6) Operation Focus. Meanwhile, the result are (a) product & process outcomes, (b) customer-focused outcomes, (c) workforce-focused outcomes, (d) leadership & governance outcomes, and (e) financial & market outcomes. The overall score for X School is 284/1000, which means X School is at “early result” level at “poor” global image.

CONSIDER - Core Outcome Set in IAD Research: study protocol for establishing a core set of outcomes and measurements in incontinence-associated dermatitis research.

PubMed

Van den Bussche, Karen; De Meyer, Dorien; Van Damme, Nele; Kottner, Jan; Beeckman, Dimitri

2017-10-01

This study protocol describes the methodology for the development of a core set of outcomes and a core set of measurements for incontinence-associated dermatitis. Incontinence is a widespread disorder with an important impact on quality of life. One of the most common complications is incontinence-associated dermatitis, resulting from chemical and physical irritation of the skin barrier, triggering inflammation and skin damage. Managing incontinence-associated dermatitis is an important challenge for nurses. Several interventions have been assessed in clinical trials, but heterogeneity in study outcomes complicates the comparability and standardization. To overcome this challenge, the development of a core outcome set, a minimum set of outcomes and measurements to be assessed in clinical research, is needed. A project team, International Steering Committee and panelists will be involved to guide the development of the core outcome set. The framework of the Harmonizing Outcomes Measures for Eczema roadmap endorsed by Cochrane Skin Group Core Outcomes Set Initiative, is used to inform the project design. A systematic literature review, interviews to integrate the patients' perspective and a consensus study with healthcare researchers and providers using the Delphi procedure will be performed. The project was approved by the Ethics review Committee (April 2016). This is the first project that will identify a core outcome set of outcomes and measurements for incontinence-associated dermatitis research. A core outcome set will reduce possible reporting bias, allow results comparisons and statistical pooling across trials and strengthen evidence-based practice and decision-making. This project has been registered in the Core Outcome Measures in Effectiveness Trials (COMET) database and is part of the Cochrane Skin Group Core Outcomes Set Initiative (CSG-COUSIN). © 2016 John Wiley & Sons Ltd.

A core outcome set for all types of cardiac surgery effectiveness trials: a study protocol for an international eDelphi survey to achieve consensus on what to measure and the subsequent selection of measurement instruments.

PubMed

Moza, A; Benstoem, C; Autschbach, R; Stoppe, C; Goetzenich, A

2015-12-02

Cardiovascular disease (CVD) is a major contributor to the burden of disease and the number one cause of death worldwide. From 1990 until today, more people died from coronary heart disease than from any other cause. CVD is regularly treated with minimally or non-minimally invasive off- or on-pump cardiothoracic surgery and several interventions related to the outcome of the surgical procedures have been evaluated in clinical trials, but heterogeneity in outcome reporting hinders comparison of interventions across trials and limits the ability of research synthesis. This problem is encountered with the introduction of core outcome sets (COSs), which should be measured and reported, as a minimum, in all clinical trials for a specific clinical field. This study protocol describes the methods used to develop a COS for all types of cardiac surgery effectiveness trials. We aim to reach consensus on what to measure in an international three-round eDelphi exercise involving adult patients in need or after cardiothoracic surgery, cardiothoracic surgeons, cardiologists, anaesthesiologists, nursing staff and researchers with expertise in this particular field of medical research. Subsequently, outcome measurement instruments (how to measure) will be determined. Recommendations on COS development given by the Core Outcome Measures in Effectiveness Trials (COMET) Initiative and the Outcome Measures in Rheumatology (OMERACT) Initiative were followed. The proposed COS aims to provide methodological guidance for future cardiothoracic surgical trials to ensure the comparability of effects of interventions across studies and enable research synthesis. This does not imply that primary outcomes should always and exclusively be those of the COS. However, to ensure the comparability of results across trials, the outcomes included in this COS should be considered for inclusion besides measuring trial-specific clinical endpoints.

Presurgery resting-state local graph-theory measures predict neurocognitive outcomes after brain surgery in temporal lobe epilepsy.

PubMed

Doucet, Gaelle E; Rider, Robert; Taylor, Nathan; Skidmore, Christopher; Sharan, Ashwini; Sperling, Michael; Tracy, Joseph I

2015-04-01

This study determined the ability of resting-state functional connectivity (rsFC) graph-theory measures to predict neurocognitive status postsurgery in patients with temporal lobe epilepsy (TLE) who underwent anterior temporal lobectomy (ATL). A presurgical resting-state functional magnetic resonance imaging (fMRI) condition was collected in 16 left and 16 right TLE patients who underwent ATL. In addition, patients received neuropsychological testing pre- and postsurgery in verbal and nonverbal episodic memory, language, working memory, and attention domains. Regarding the functional data, we investigated three graph-theory properties (local efficiency, distance, and participation), measuring segregation, integration and centrality, respectively. These measures were only computed in regions of functional relevance to the ictal pathology, or the cognitive domain. Linear regression analyses were computed to predict the change in each neurocognitive domain. Our analyses revealed that cognitive outcome was successfully predicted with at least 68% of the variance explained in each model, for both TLE groups. The only model not significantly predictive involved nonverbal episodic memory outcome in right TLE. Measures involving the healthy hippocampus were the most common among the predictors, suggesting that enhanced integration of this structure with the rest of the brain may improve cognitive outcomes. Regardless of TLE group, left inferior frontal regions were the best predictors of language outcome. Working memory outcome was predicted mostly by right-sided regions, in both groups. Overall, the results indicated our integration measure was the most predictive of neurocognitive outcome. In contrast, our segregation measure was the least predictive. This study provides evidence that presurgery rsFC measures may help determine neurocognitive outcomes following ATL. The results have implications for refining our understanding of compensatory reorganization and predicting cognitive outcome after ATL. The results are encouraging with regard to the clinical relevance of using graph-theory measures in presurgical algorithms in the setting of TLE. Wiley Periodicals, Inc. © 2015 International League Against Epilepsy.

Health economics research into supporting carers of people with dementia: A systematic review of outcome measures

PubMed Central

2012-01-01

Advisory bodies, such as the National Institute for Health and Clinical Excellence (NICE) in the UK, advocate using preference based instruments to measure the quality of life (QoL) component of the quality-adjusted life year (QALY). Cost per QALY is used to determine cost-effectiveness, and hence funding, of interventions. QALYs allow policy makers to compare the effects of different interventions across different patient groups. Generic measures may not be sensitive enough to fully capture the QoL effects for certain populations, such as carers, so there is a need to consider additional outcome measures, which are preference based where possible to enable cost-effectiveness analysis to be undertaken. This paper reviews outcome measures commonly used in health services research and health economics research involving carers of people with dementia. An electronic database search was conducted in PubMed, Medline, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, the National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE) and Health Technology Assessment database. Studies were eligible for inclusion if they included an outcome measure for carers of people with dementia. 2262 articles were identified. 455 articles describing 361 studies remained after exclusion criteria were applied. 228 outcome measures were extracted from the studies. Measures were categorised into 44 burden measures, 43 mastery measures, 61 mood measures, 32 QoL measures, 27 social support and relationships measures and 21 staff competency and morale measures. The choice of instrument has implications on funding decisions; therefore, researchers need to choose appropriate instruments for the population being measured and the type of intervention undertaken. If an instrument is not sensitive enough to detect changes in certain populations, the effect of an intervention may be underestimated, and hence interventions which may appear to be beneficial to participants are not deemed cost-effective and are not funded. If this is the case, it is essential that additional outcome measures which detect changes in broader QoL are included, whilst still retaining preference based utility measures such as EQ-5D to allow QALY calculation for comparability with other interventions. PMID:23181515

Health economics research into supporting carers of people with dementia: a systematic review of outcome measures.

PubMed

Jones, Carys; Edwards, Rhiannon Tudor; Hounsome, Barry

2012-11-26

Advisory bodies, such as the National Institute for Health and Clinical Excellence (NICE) in the UK, advocate using preference based instruments to measure the quality of life (QoL) component of the quality-adjusted life year (QALY). Cost per QALY is used to determine cost-effectiveness, and hence funding, of interventions. QALYs allow policy makers to compare the effects of different interventions across different patient groups. Generic measures may not be sensitive enough to fully capture the QoL effects for certain populations, such as carers, so there is a need to consider additional outcome measures, which are preference based where possible to enable cost-effectiveness analysis to be undertaken. This paper reviews outcome measures commonly used in health services research and health economics research involving carers of people with dementia. An electronic database search was conducted in PubMed, Medline, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, the National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE) and Health Technology Assessment database. Studies were eligible for inclusion if they included an outcome measure for carers of people with dementia. 2262 articles were identified. 455 articles describing 361 studies remained after exclusion criteria were applied. 228 outcome measures were extracted from the studies. Measures were categorised into 44 burden measures, 43 mastery measures, 61 mood measures, 32 QoL measures, 27 social support and relationships measures and 21 staff competency and morale measures. The choice of instrument has implications on funding decisions; therefore, researchers need to choose appropriate instruments for the population being measured and the type of intervention undertaken. If an instrument is not sensitive enough to detect changes in certain populations, the effect of an intervention may be underestimated, and hence interventions which may appear to be beneficial to participants are not deemed cost-effective and are not funded. If this is the case, it is essential that additional outcome measures which detect changes in broader QoL are included, whilst still retaining preference based utility measures such as EQ-5D to allow QALY calculation for comparability with other interventions.

Kinematic measures for upper limb motor assessment during robot-mediated training in patients with severe sub-acute stroke.

PubMed

Duret, Christophe; Courtial, Ophélie; Grosmaire, Anne Gaelle

2016-01-01

Kinematic assessments are increasingly used as motor outcome measures during upper limb robot-assisted training, in addition to clinical scales. However, their relevance has not been evaluated much. Thirty-eight patients with severe sub-acute stroke (age 56 ± 17 [19-87] years; time since stroke, 55 ± 22 days) carried out 16 sessions (average 3/week, 35 ± 15 days) of upper limb robot-assisted training combined with standard therapy. Pre/post motor performance was evaluated using the Fugl-Meyer Assessment scale, Motor Status Scale (MSS) and kinematic measures. Motor outcomes were compared and relationships between clinical and kinematic outcomes were analyzed. All clinical and kinematic outcomes improved after training (p <  0.01). FM score increased from 17.7 ± 10.0 to 28.6 ± 15.4. All baseline kinematic measures were strongly correlated with clinical scores. Correlations between clinical and kinematic changes were moderate (r = -0.65 for change in FM Proximal score and change in accuracy measure). However, smoothness and accuracy indicators were shown to be responsive measures. This study demonstrated that baseline kinematic measures and their pre/post training changes were significantly correlated with clinical motor outcome measures. However, even if kinematic measures are valid for the evaluation of motor impairment we cannot propose to substitute common clinical measures of motor function which also evaluate functional abilities of the upper limb.

Comparison of Nurse Staffing Measurements in Staffing-Outcomes Research.

PubMed

Park, Shin Hye; Blegen, Mary A; Spetz, Joanne; Chapman, Susan A; De Groot, Holly A

2015-01-01

Investigators have used a variety of operational definitions of nursing hours of care in measuring nurse staffing for health services research. However, little is known about which approach is best for nurse staffing measurement. To examine whether various nursing hours measures yield different model estimations when predicting patient outcomes and to determine the best method to measure nurse staffing based on the model estimations. We analyzed data from the University HealthSystem Consortium for 2005. The sample comprised 208 hospital-quarter observations from 54 hospitals, representing information on 971 adult-care units and about 1 million inpatient discharges. We compared regression models using different combinations of staffing measures based on productive/nonproductive and direct-care/indirect-care hours. Akaike Information Criterion and Bayesian Information Criterion were used in the assessment of staffing measure performance. The models that included the staffing measure calculated from productive hours by direct-care providers were best, in general. However, the Akaike Information Criterion and Bayesian Information Criterion differences between models were small, indicating that distinguishing nonproductive and indirect-care hours from productive direct-care hours does not substantially affect the approximation of the relationship between nurse staffing and patient outcomes. This study is the first to explicitly evaluate various measures of nurse staffing. Productive hours by direct-care providers are the strongest measure related to patient outcomes and thus should be preferred in research on nurse staffing and patient outcomes.

Outcome Measurement in Economic Evaluations of Public Health Interventions: a Role for the Capability Approach?

PubMed Central

Lorgelly, Paula K.; Lawson, Kenny D.; Fenwick, Elisabeth A.L.; Briggs, Andrew H.

2010-01-01

Public health interventions have received increased attention from policy makers, and there has been a corresponding increase in the number of economic evaluations within the domain of public health. However, methods to evaluate public health interventions are less well established than those for medical interventions. Focusing on health as an outcome measure is likely to underestimate the impact of many public health interventions. This paper provides a review of outcome measures in public health; and describes the benefits of using the capability approach as a means to developing an all encompassing outcome measure. PMID:20623024

Routine measurement of outcomes in Australia's public sector mental health services

PubMed Central

Pirkis, Jane; Burgess, Philip; Coombs, Tim; Clarke, Adam; Jones-Ellis, David; Dickson, Rosemary

2005-01-01

Objective This paper describes the Australian experience to date with a national 'roll out' of routine outcome measurement in public sector mental health services. Methods Consultations were held with 123 stakeholders representing a range of roles. Results Australia has made an impressive start to nationally implementing routine outcome measurement in mental health services, although it still has a long way to go. All States/Territories have established data collection systems, although some are more streamlined than others. Significant numbers of clinicians and managers have been trained in the use of routine outcome measures, and thought is now being given to ongoing training strategies. Outcome measurement is now occurring 'on the ground'; all States/Territories will be reporting data for 2003–04, and a number have been doing so for several years. Having said this, there is considerable variability regarding data coverage, completeness and compliance. Some States/Territories have gone to considerable lengths to 'embed' outcome measurement in day-to-day practice. To date, reporting of outcome data has largely been limited to reports profiling individual consumers and/or aggregate reports that focus on compliance and data quality issues, although a few States/Territories have begun to turn their attention to producing aggregate reports of consumers by clinician, team or service. Conclusion Routine outcome measurement is possible if it is supported by a co-ordinated, strategic approach and strong leadership, and there is commitment from clinicians and managers. The Australian experience can provide lessons for other countries. PMID:15840170

Proposed Test of Relative Phase as Hidden Variable in Quantum Mechanics

DTIC Science & Technology

2012-01-01

implicitly due to its ubiquity in quantum theory , but searches for dependence of measurement outcome on other parameters have been lacking. For a two -state...implemen- tation for the specific case of an atomic two -state system with laser-induced fluores- cence for measurement. Keywords Quantum measurement...Measurement postulate · Born rule 1 Introduction 1.1 Problems with Quantum Measurement Quantum theory prescribes probabilities for outcomes of measurements

Improving health care, Part 1: The clinical value compass.

PubMed

Nelson, E C; Mohr, J J; Batalden, P B; Plume, S K

1996-04-01

CLINICAL VALUE COMPASS APPROACH: The clinical Value Compass, named to reflect its similarity in layout to a directional compass, has at its four cardinal points (1) functional status, risk status, and well-being; (2) costs; (3) satisfaction with health care and perceived benefit; and (4) clinical outcomes. To manage and improve the value of health care services, providers will need to measure the value of care for similar patient populations, analyze the internal delivery processes, run tests of changed delivery processes, and determine if these changes lead to better outcomes and lower costs. GETTING STARTED--OUTCOMES AND AIM: In the case example, the team's aim is "to find ways to continually improve the quality and value of care for AMI (acute myocardial infection) patients." VALUE MEASURES--SELECT A SET OF OUTCOME AND COST MEASURES: Four to 12 outcome and cost measures are sufficient to get started. In the case example, the team chose 1 or more measures for each quadrant of the value compass. An operational definition is a clearly specified method explaining how to measure a variable. Measures in the case example were based on information from the medical record, administrative and financial records, and patient reports and ratings at eight weeks postdischarge. Measurement systems that quantify the quality of processes and results of care are often add-ons to routine care delivery. However, the process of measurement should be intertwined with the process of care delivery so that front-line providers are involved in both managing the patient and measuring the process and related outcomes and costs.

Developing a Standard Set of Patient-Centred Outcomes for Inflammatory Bowel Disease-an International, Cross-disciplinary Consensus.

PubMed

Kim, Andrew H; Roberts, Charlotte; Feagan, Brian G; Banerjee, Rupa; Bemelman, Willem; Bodger, Keith; Derieppe, Marc; Dignass, Axel; Driscoll, Richard; Fitzpatrick, Ray; Gaarentstroom-Lunt, Janette; Higgins, Peter D; Kotze, Paulo Gustavo; Meissner, Jillian; O'Connor, Marian; Ran, Zhi-Hua; Siegel, Corey A; Terry, Helen; van Deen, Welmoed K; van der Woude, C Janneke; Weaver, Alandra; Yang, Suk-Kyun; Sands, Bruce E; Vermeire, Séverine; Travis, Simon Pl

2018-03-28

Success in delivering value-based healthcare involves measuring outcomes that matter most to patients. Our aim was to develop a minimum Standard Set of patient-centred outcome measures for inflammatory bowel disease [IBD], for use in different healthcare settings. An international working group [n = 25] representing patients, patient associations, gastroenterologists, surgeons, specialist nurses, IBD registries and patient-reported outcome measure [PROM] methodologists participated in a series of teleconferences incorporating a modified Delphi process. Systematic review of existing literature, registry data, patient focus groups and open review periods were used to reach consensus on a minimum set of standard outcome measures and risk adjustment variables. Similar methodology has been used in 21 other disease areas [www.ichom.org]. A minimum Standard Set of outcomes was developed for patients [aged ≥16] with IBD. Outcome domains included survival and disease control [survival, disease activity/remission, colorectal cancer, anaemia], disutility of care [treatment-related complications], healthcare utilization [IBD-related admissions, emergency room visits] and patient-reported outcomes [including quality of life, nutritional status and impact of fistulae] measured at baseline and at 6 or 12 month intervals. A single PROM [IBD-Control questionnaire] was recommended in the Standard Set and minimum risk adjustment data collected at baseline and annually were included: demographics, basic clinical information and treatment factors. A Standard Set of outcome measures for IBD has been developed based on evidence, patient input and specialist consensus. It provides an international template for meaningful, comparable and easy-to-interpret measures as a step towards achieving value-based healthcare in IBD.

Health-related quality-of-life outcome measures in paediatric palliative care: A systematic review of psychometric properties and feasibility of use

PubMed Central

Coombes, Lucy H; Wiseman, Theresa; Lucas, Grace; Sangha, Amrit; Murtagh, Fliss EM

2016-01-01

Background: The number of children worldwide requiring palliative care services is increasing due to advances in medical care and technology. The use of outcome measures is important to improve the quality and effectiveness of care. Aim: To systematically identify health-related quality-of-life outcome measures that could be used in paediatric palliative care and examine their feasibility of use and psychometric properties. Design: A systematic literature review and analysis of psychometric properties. Data sources: PsychInfo, Medline and EMBASE were searched from 1 January 1990 to 10 December 2014. Hand searches of the reference list of included studies and relevant reviews were also performed. Results: From 3460 articles, 125 papers were selected for full-text assessment. A total of 41 articles met the eligibility criteria and examined the psychometric properties of 22 health-related quality-of-life measures. Evidence was limited as at least half of the information on psychometric properties per instrument was missing. Measurement error was not analysed in any of the included articles and responsiveness was only analysed in one study. The methodological quality of included studies varied greatly. Conclusion: There is currently no ‘ideal’ outcome assessment measure for use in paediatric palliative care. The domains of generic health-related quality-of-life measures are not relevant to all children receiving palliative care and some domains within disease-specific measures are only relevant for that specific population. Potential solutions include adapting an existing measure or developing more individualized patient-centred outcome and experience measures. Either way, it is important to continue work on outcome measurement in this field. PMID:27247087

Use of continuous glucose monitoring as an outcome measure in clinical trials.

PubMed

Beck, Roy W; Calhoun, Peter; Kollman, Craig

2012-10-01

Although developed to be a management tool for individuals with diabetes, continuous glucose monitoring (CGM) also has potential value for the assessment of outcomes in clinical studies. We evaluated using CGM as such an outcome measure. Data were analyzed from six previously completed inpatient studies in which both CGM (Freestyle Navigator™ [Abbott Diabetes Care, Alameda, CA] or Guardian(®) [Medtronic, Northridge, CA]) and reference glucose measurements were available. The analyses included 97 days of data from 93 participants with type 1 diabetes (age range, 5-57 years; mean, 18 ± 12 years). Mean glucose levels per day were similar for the CGM and reference measurements (median, 148 mg/dL vs. 143 mg/dL, respectively; P = 0.92), and the correlation of the two was high (r = 0.89). Similarly, most glycemia metrics showed no significant differences comparing CGM and reference values, except that the nadir glucose tended to be slightly lower and peak glucose slightly higher with reference measurements than CGM measurements (respective median, 59 mg/dL vs. 66 mg/dL [P = 0.05] and 262 mg/dL vs. 257 mg/dL [P = 0.003]) and glucose variability as measured with the coefficient of variation was slightly lower with CGM than reference measurements (respective median, 31% vs. 35%; P<0.001). A reasonably high degree of concordance exists when comparing outcomes based on CGM measurements with outcomes based on reference blood glucose measurements. CGM inaccuracy and underestimation of the extremes of hyperglycemia and hypoglycemia can be accounted for in a clinical trial's study design. Thus, in appropriate settings, CGM can be a very meaningful and feasible outcome measure for clinical trials.

Use of Continuous Glucose Monitoring as an Outcome Measure in Clinical Trials

PubMed Central

Calhoun, Peter; Kollman, Craig

2012-01-01

Abstract Objective Although developed to be a management tool for individuals with diabetes, continuous glucose monitoring (CGM) also has potential value for the assessment of outcomes in clinical studies. We evaluated using CGM as such an outcome measure. Research Design and Methods Data were analyzed from six previously completed inpatient studies in which both CGM (Freestyle Navigator™ [Abbott Diabetes Care, Alameda, CA] or Guardian® [Medtronic, Northridge, CA]) and reference glucose measurements were available. The analyses included 97 days of data from 93 participants with type 1 diabetes (age range, 5–57 years; mean, 18±12 years). Results Mean glucose levels per day were similar for the CGM and reference measurements (median, 148 mg/dL vs. 143 mg/dL, respectively; P=0.92), and the correlation of the two was high (r=0.89). Similarly, most glycemia metrics showed no significant differences comparing CGM and reference values, except that the nadir glucose tended to be slightly lower and peak glucose slightly higher with reference measurements than CGM measurements (respective median, 59 mg/dL vs. 66 mg/dL [P=0.05] and 262 mg/dL vs. 257 mg/dL [P=0.003]) and glucose variability as measured with the coefficient of variation was slightly lower with CGM than reference measurements (respective median, 31% vs. 35%; P<0.001). Conclusions A reasonably high degree of concordance exists when comparing outcomes based on CGM measurements with outcomes based on reference blood glucose measurements. CGM inaccuracy and underestimation of the extremes of hyperglycemia and hypoglycemia can be accounted for in a clinical trial's study design. Thus, in appropriate settings, CGM can be a very meaningful and feasible outcome measure for clinical trials. PMID:23013201

Establishing a Core Outcome Measure for Fatigue in Patients on Hemodialysis: A Standardized Outcomes in Nephrology-Hemodialysis (SONG-HD) Consensus Workshop Report.

PubMed

Ju, Angela; Unruh, Mark; Davison, Sara; Dapueto, Juan; Dew, Mary Amanda; Fluck, Richard; Germain, Michael; Jassal, Sarbjit V; Obrador, Gregorio; O'Donoghue, Donal; Josephson, Michelle A; Craig, Jonathan C; Viecelli, Andrea; O'Lone, Emma; Hanson, Camilla S; Manns, Braden; Sautenet, Benedicte; Howell, Martin; Reddy, Bharathi; Wilkie, Caroline; Rutherford, Claudia; Tong, Allison

2018-03-15

Fatigue is one of the most highly prioritized outcomes for patients and clinicians, but remains infrequently and inconsistently reported across trials in hemodialysis. We convened an international Standardized Outcomes in Nephrology-Hemodialysis (SONG-HD) consensus workshop with stakeholders to discuss the development and implementation of a core outcome measure for fatigue. 15 patients/caregivers and 42 health professionals (clinicians, researchers, policy makers, and industry representatives) from 9 countries participated in breakout discussions. Transcripts were analyzed thematically. 4 themes for a core outcome measure emerged. Drawing attention to a distinct and all-encompassing symptom was explicitly recognizing fatigue as a multifaceted symptom unique to hemodialysis. Emphasizing the pervasive impact of fatigue on life participation justified the focus on how fatigue severely impaired the patient's ability to do usual activities. Ensuring relevance and accuracy in measuring fatigue would facilitate shared decision making about treatment. Minimizing burden of administration meant avoiding the cognitive burden, additional time, and resources required to use the measure. A core outcome measure that is simple, is short, and includes a focus on the severity of the impact of fatigue on life participation may facilitate consistent and meaningful measurement of fatigue in all trials to inform decision making and care of patients receiving hemodialysis. Copyright © 2018 National Kidney Foundation, Inc. Published by Elsevier Inc. All rights reserved.

Measurement properties of patient-reported outcome measures (PROMS) in Patellofemoral Pain Syndrome: a systematic review.

PubMed

Green, Andrew; Liles, Clive; Rushton, Alison; Kyte, Derek G

2014-12-01

This systematic review investigated the measurement properties of disease-specific patient-reported outcome measures used in Patellofemoral Pain Syndrome. Two independent reviewers conducted a systematic search of key databases (MEDLINE, EMBASE, AMED, CINHAL+ and the Cochrane Library from inception to August 2013) to identify relevant studies. A third reviewer mediated in the event of disagreement. Methodological quality was evaluated using the validated COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) tool. Data synthesis across studies determined the level of evidence for each patient-reported outcome measure. The search strategy returned 2177 citations. Following the eligibility review phase, seven studies, evaluating twelve different patient-reported outcome measures, met inclusion criteria. A 'moderate' level of evidence supported the structural validity of several measures: the Flandry Questionnaire, Anterior Knee Pain Scale, Functional Index Questionnaire, Eng and Pierrynowski Questionnaire and Visual Analogue Scales for 'usual' and 'worst' pain. In addition, there was a 'Limited' level of evidence supporting the test-retest reliability and validity (cross-cultural, hypothesis testing) of the Persian version of the Anterior Knee Pain Scale. Other measurement properties were evaluated with poor methodological quality, and many properties were not evaluated in any of the included papers. Current disease-specific outcome measures for Patellofemoral Pain Syndrome require further investigation. Future studies should evaluate all important measurement properties, utilising an appropriate framework such as COSMIN to guide study design, to facilitate optimal methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures.

PubMed

Deighton, Jessica; Croudace, Tim; Fonagy, Peter; Brown, Jeb; Patalay, Praveetha; Wolpert, Miranda

2014-01-01

There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures' psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against standards of feasibility and psychometric credibility in relation to use for practice and policy.

Measuring Patient-Reported Outcomes: Key Metrics in Reconstructive Surgery.

PubMed

Voineskos, Sophocles H; Nelson, Jonas A; Klassen, Anne F; Pusic, Andrea L

2018-01-29

Satisfaction and improved quality of life are among the most important outcomes for patients undergoing plastic and reconstructive surgery for a variety of diseases and conditions. Patient-reported outcome measures (PROMs) are essential tools for evaluating the benefits of newly developed surgical techniques. Modern PROMs are being developed with new psychometric approaches, such as Rasch Measurement Theory, and their measurement properties (validity, reliability, responsiveness) are rigorously tested. These advances have resulted in the availability of PROMs that provide clinically meaningful data and effectively measure functional as well as psychosocial outcomes. This article guides the reader through the steps of creating a PROM and highlights the potential research and clinical uses of such instruments. Limitations of PROMs and anticipated future directions in this field are discussed.

Modifying the Clinical Outcomes in Routine Evaluation Measure for Use with People Who Have a Learning Disability

ERIC Educational Resources Information Center

Marshall, Keith; Willoughby-Booth, Simon

2007-01-01

There are few reliable self-report measures suitable for people with a learning disability in reporting psychological distress. This study examines the modification of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM), exploring its reliability, using two different presentation styles. One style included a sequencing task then…

Generating Outcome Measurements: Achievement and Attitudes. A Guide to Educational Outcome Measurements and Their Uses. Seminar No. 3.

ERIC Educational Resources Information Center

Mushkin, Selma J.; Billings, Bradley B.

This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with how to obtain information on…

Systematic review of mental health and well-being outcomes following community-based obesity prevention interventions among adolescents

PubMed Central

Hoare, Erin; Fuller-Tyszkiewicz, Matthew; Skouteris, Helen; Millar, Lynne; Nichols, Melanie; Allender, Steven

2015-01-01

Objectives This paper aimed to systematically evaluate the mental health and well-being outcomes observed in previous community-based obesity prevention interventions in adolescent populations. Setting Systematic review of literature from database inception to October 2014. Articles were sourced from CINAHL, Global Health, Health Source: Nursing and Academic Edition, MEDLINE, PsycARTICLES and PsycINFO, all of which were accessed through EBSCOhost. The Cochrane Database was also searched to identify all eligible articles. PRISMA guidelines were followed and search terms and search strategy ensured all possible studies were identified for review. Participants Intervention studies were eligible for inclusion if they were: focused on overweight or obesity prevention, community-based, targeted adolescents (aged 10–19 years), reported a mental health or well-being measure, and included a comparison or control group. Studies that focused on specific adolescent groups or were treatment interventions were excluded from review. Quality of evidence was assessed using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) guidelines. Primary and secondary outcome measures Primary outcomes were measures of mental health and well-being, including diagnostic and symptomatic measures. Secondary outcomes included adiposity or weight-related measures. Results Seven studies met the inclusion criteria; one reported anxiety/depressive outcomes, two reported on self-perception well-being measures such as self-esteem and self-efficacy, and four studies reported outcomes of quality of life. Positive mental health outcomes demonstrated that following obesity prevention, interventions included a decrease in anxiety and improved health-related quality of life. Quality of evidence was graded as very low. Conclusions Although positive outcomes for mental health and well-being do exist, controlled evaluations of community-based obesity prevention interventions have not often included mental health measures (n=7). It is recommended that future interventions incorporate mental health and well-being measures to identify any potential mechanisms influencing adolescent weight-related outcomes, and equally to ensure interventions are not causing harm to adolescent mental health. PMID:25564145

Measuring spine fracture outcomes: common scales and checklists.

PubMed

Schoenfeld, Andrew J; Bono, Christopher M

2011-03-01

Although outcome instruments have been used extensively in spine surgical research, few studies at present specifically address their use in investigations regarding spine trauma. In this review we provide a summary of the outcome instruments used most frequently in spine trauma research, identify the unique challenges of studying outcomes of spine trauma patients, and propose an integrated approach that may be beneficial for future studies. We reviewed the use of outcome instruments applicable to spine trauma research, including generic health measures, inventories of back-specific function, pain scales, health related quality of life (HRQOL) instruments, and radiographic determinants of outcome. Several inventories have been utilised to measure clinical outcomes following spinal trauma. Excluding measures of neurological function (e.g. ASIA motor score), none have been specifically validated for use with spine fractures. The SF-36, RMDQ, and ODI are amongst the most commonly used instruments. Importantly, the use of validated functional outcome measures in spine trauma research is hampered by the fact that the pre-morbid state of patients who sustain spine trauma may not be accurately represented by normative values established for the general population. The VAS is used most frequently to assess degree of neck and back pain. Most studies have relied on non-validated measures to determine radiographic results of treatment, although more elegant radiographic metrics exist. Functional outcome measurement of traumatically injured spine patients is challenging because available generic and spine-specific instruments were not designed for or validated in this population. Furthermore, no single inventory is capable of capturing global data necessary to evaluate results following these injuries. Investigations seeking to quantify outcomes following spine trauma should consider the use of a combination of existing surveys in a complementary fashion that should include a generic health survey, a measure of back-specific function, and determinants of bodily pain and work-related disability. Copyright © 2010 Elsevier Ltd. All rights reserved.

Development of a core set of outcome measures for OAB treatment.

PubMed

Foust-Wright, Caroline; Wissig, Stephanie; Stowell, Caleb; Olson, Elizabeth; Anderson, Anita; Anger, Jennifer; Cardozo, Linda; Cotterill, Nikki; Gormley, Elizabeth Ann; Toozs-Hobson, Philip; Heesakkers, John; Herbison, Peter; Moore, Kate; McKinney, Jessica; Morse, Abraham; Pulliam, Samantha; Szonyi, George; Wagg, Adrian; Milsom, Ian

2017-12-01

Standardized measures enable the comparison of outcomes across providers and treatments giving valuable information for improving care quality and efficacy. The aim of this project was to define a minimum standard set of outcome measures and case-mix factors for evaluating the care of patients with overactive bladder (OAB). The International Consortium for Health Outcomes Measurement (ICHOM) convened an international working group (WG) of leading clinicians and patients to engage in a structured method for developing a core outcome set. Consensus was determined by a modified Delphi process, and discussions were supported by both literature review and patient input. The standard set measures outcomes of care for adults seeking treatment for OAB, excluding residents of long-term care facilities. The WG focused on treatment outcomes identified as most important key outcome domains to patients: symptom burden and bother, physical functioning, emotional health, impact of symptoms and treatment on quality of life, and success of treatment. Demographic information and case-mix factors that may affect these outcomes were also included. The standardized outcome set for evaluating clinical care is appropriate for use by all health providers caring for patients with OAB, regardless of specialty or geographic location, and provides key data for quality improvement activities and research.

Clinical outcome assessment in malignant glioma trials: measuring signs, symptoms, and functional limitations.

PubMed

Blakeley, Jaishri O; Coons, Stephen Joel; Corboy, John R; Kline Leidy, Nancy; Mendoza, Tito R; Wefel, Jeffrey S

2016-03-01

The shared goal of all parties developing therapeutics against malignant gliomas is to positively impact the lives of people affected by these cancers. Clinical outcome assessment (COA) tools, including measures of patient-reported outcome, performance outcome, clinician-reported outcome, and observer-reported outcome, allow patient-focused assessments to complement traditional efficacy measures such as overall survival and radiographic endpoints. This review examines the properties of various COA measures used in malignant glioma clinical trials to date and cross references their content to the priority signs, symptoms, and functional limitations defined through a community survey conducted by the National Brain Tumor Society. The overarching goal of this initiative is to identify COA measures that are feasible and have appropriate psychometric properties for use in this patient population as well as highlight where further development is needed. Published by Oxford University Press on behalf of the Society for Neuro-Oncology 2016. This work is written by (a) US Government employee(s) and is in the public domain in the US.

Objective Assessment of Vergence after Treatment of Concussion-Related CI: A Pilot Study

PubMed Central

Scheiman, Mitchell; Talasan, Henry; Mitchell, Gladys L; Alvarez, Tara L.

2016-01-01

Purpose To evaluate changes in objective measures of disparity vergence after office-based vision therapy (OBVT) for concussion-related convergence insufficiency (CI), and determine the feasibility of using this objective assessment as an outcome measure in a clinical trial. Methods This was a prospective, observational trial. All participants were treated with weekly OBVT with home reinforcement. Participants included two adolescents and three young adults with concussion-related, symptomatic CI. The primary outcome measure was average peak velocity for 4-degree symmetrical convergence steps. Other objective outcome measures of disparity vergence included time to peak velocity, latency, accuracy, settling time, and main sequence. We also evaluated saccadic eye movements using the same outcome measures. Changes in clinical measures (near point of convergence, positive fusional vergence at near, Convergence Insufficiency Symptom Survey (CISS) score) were evaluated. Results There were statistically significant and clinically meaningful changes in all clinical measures for convergence. Four of the five subjects met clinical success criteria. For the objective measures, we found a statistically significant increase in peak velocity, response accuracy to 4° symmetrical convergence and divergence step stimuli and the main sequence ratio for convergence step stimuli. Objective saccadic eye movements (5° and 10°) appeared normal pre-OBVT, and did not show any significant change after treatment. Conclusions This is the first report of the use of objective measures of disparity vergence as outcome measures for concussion-related convergence insufficiency. These measures provide additional information that is not accessible with clinical tests about underlying physiological mechanisms leading to changes in clinical findings and symptoms. The study results also demonstrate that patients with concussion can tolerate the visual demands (over 200 vergence and versional eye movements) during the 25-minute testing time and suggest that these measures could be used in a large-scale randomized clinical trial of concussion-related CI as outcome measures. PMID:27464574

Objective Assessment of Vergence after Treatment of Concussion-Related CI: A Pilot Study.

PubMed

Scheiman, Mitchell M; Talasan, Henry; Mitchell, G Lynn; Alvarez, Tara L

2017-01-01

To evaluate changes in objective measures of disparity vergence after office-based vision therapy (OBVT) for concussion-related convergence insufficiency (CI) and determine the feasibility of using this objective assessment as an outcome measure in a clinical trial. This was a prospective, observational trial. All participants were treated with weekly OBVT with home reinforcement. Participants included two adolescents and three young adults with concussion-related, symptomatic CI. The primary outcome measure was average peak velocity for 4° symmetrical convergence steps. Other objective outcome measures of disparity vergence included time to peak velocity, latency, accuracy, settling time, and main sequence. We also evaluated saccadic eye movements using the same outcome measures. Changes in clinical measures (near point of convergence, positive fusional vergence at near, Convergence Insufficiency Symptom Survey [CISS] score) were evaluated. There were statistically significant and clinically meaningful changes in all clinical measures for convergence. Four of the five subjects met clinical success criteria. For the objective measures, we found a statistically significant increase in peak velocity, response accuracy to 4° symmetrical convergence and divergence step stimuli, and the main sequence ratio for convergence step stimuli. Objective saccadic eye movements (5 and 10°) appeared normal pre-OBVT and did not show any significant change after treatment. This is the first report of the use of objective measures of disparity vergence as outcome measures for concussion-related convergence insufficiency. These measures provide additional information that is not accessible with clinical tests about underlying physiological mechanisms leading to changes in clinical findings and symptoms. The study results also demonstrate that patients with concussion can tolerate the visual demands (over 200 vergence and versional eye movements) during the 25-minute testing time and suggest that these measures could be used in a large-scale randomized clinical trial of concussion-related CI as outcome measures.

Rasch Measurement Analysis of the Mayo-Portland Adaptability Inventory (MPAI-4) in a Community-Based Rehabilitation Sample

PubMed Central

Malec, James F.; Altman, Irwin M.; Swick, Shannon

2011-01-01

Abstract The precise measurement of patient outcomes depends upon clearly articulated constructs and refined clinical assessment instruments that work equally well for all subgroups within a population. This is a challenging task in those with acquired brain injury (ABI) because of the marked heterogeneity of the disorder and subsequent outcomes. Alhough essential, the iterative process of instrument refinement is often neglected. This present study was undertaken to examine validity, reliability, dimensionality and item estimate invariance of the Mayo-Portland Adaptability Inventory – 4 (MPAI-4), an outcome measure for persons with ABI. The sampled population included 603 persons with traumatic ABI participating in a home- and community-based rehabilitation program. Results indicated that the MPAI-4 is a valid, reliable measure of outcome following traumatic ABI, which measures a broad but unitary core construct of outcome after ABI. Further, the MPAI-4 is composed of items that are unbiased toward selected subgroups except where differences could be expected [e.g., more chronic traumatic brain injury (TBI) patients are better able to negotiate demands of transportation than more acute TBI patients]. We address the trade-offs between strict unidimensionality and clinical applicability in measuring outcome, and illustrate the advantages and disadvantages of applying single-parameter measurement models to broad constructs. PMID:21332409

Rasch measurement analysis of the Mayo-Portland Adaptability Inventory (MPAI-4) in a community-based rehabilitation sample.

PubMed

Kean, Jacob; Malec, James F; Altman, Irwin M; Swick, Shannon

2011-05-01

The precise measurement of patient outcomes depends upon clearly articulated constructs and refined clinical assessment instruments that work equally well for all subgroups within a population. This is a challenging task in those with acquired brain injury (ABI) because of the marked heterogeneity of the disorder and subsequent outcomes. Although essential, the iterative process of instrument refinement is often neglected. This present study was undertaken to examine validity, reliability, dimensionality and item estimate invariance of the Mayo-Portland Adaptability Inventory - 4 (MPAI-4), an outcome measure for persons with ABI. The sampled population included 603 persons with traumatic ABI participating in a home- and community-based rehabilitation program. Results indicated that the MPAI-4 is a valid, reliable measure of outcome following traumatic ABI, which measures a broad but unitary core construct of outcome after ABI. Further, the MPAI-4 is composed of items that are unbiased toward selected subgroups except where differences could be expected [e.g., more chronic traumatic brain injury (TBI) patients are better able to negotiate demands of transportation than more acute TBI patients]. We address the trade-offs between strict unidimensionality and clinical applicability in measuring outcome, and illustrate the advantages and disadvantages of applying single-parameter measurement models to broad constructs.

Predictive performance of four frailty measures in an older Australian population

PubMed Central

Widagdo, Imaina S.; Pratt, Nicole; Russell, Mary; Roughead, Elizabeth E.

2015-01-01

Background: there are several different frailty measures available for identifying the frail elderly. However, their predictive performance in an Australian population has not been examined. Objective: to examine the predictive performance of four internationally validated frailty measures in an older Australian population. Methods: a retrospective study in the Australian Longitudinal Study of Ageing (ALSA) with 2,087 participants. Frailty was measured at baseline using frailty phenotype (FP), simplified frailty phenotype (SFP), frailty index (FI) and prognostic frailty score (PFS). Odds ratios (OR) were calculated to measure the association between frailty and outcomes at Wave 3 including mortality, hospitalisation, nursing home admission, fall and a combination of all outcomes. Predictive performance was measured by assessing sensitivity, specificity, positive and negative predictive values (PPV and NPV) and likelihood ratio (LR). Area under the curve (AUC) of dichotomised and the multilevel or continuous model of the measures was examined. Results: prevalence of frailty varied from 2% up to 49% between the measures. Frailty was significantly associated with an increased risk of any outcome, OR (95% confidence interval) for FP: 1.9 (1.4–2.8), SFP: 3.6 (1.5–8.8), FI: 3.4 (2.7–4.3) and PFS: 2.3 (1.8–2.8). PFS had high sensitivity across all outcomes (sensitivity: 55.2–77.1%). The PPV for any outcome was highest for SFP and FI (70.8 and 69.7%, respectively). Only FI had acceptable accuracy in predicting outcomes, AUC: 0.59–0.70. Conclusions: being identified as frail by any of the four measures was associated with an increased risk of outcomes; however, their predictive accuracy varied. PMID:26504118

Stroke outcomes measures must be appropriately risk adjusted to ensure quality care of patients: a presidential advisory from the American Heart Association/American Stroke Association.

PubMed

Fonarow, Gregg C; Alberts, Mark J; Broderick, Joseph P; Jauch, Edward C; Kleindorfer, Dawn O; Saver, Jeffrey L; Solis, Penelope; Suter, Robert; Schwamm, Lee H

2014-05-01

Because stroke is among the leading causes of death, disability, hospitalizations, and healthcare expenditures in the United States, there is interest in reporting outcomes for patients hospitalized with acute ischemic stroke. The American Heart Association/American Stroke Association, as part of its commitment to promote high-quality, evidence-based care for cardiovascular and stroke patients, fully supports the development of properly risk-adjusted outcome measures for stroke. To accurately assess and report hospital-level outcomes, adequate risk adjustment for case mix is essential. During the development of the Centers for Medicare & Medicaid Services 30-day stroke mortality and 30-day stroke readmission measures, concerns were expressed that these measures were not adequately designed because they do not include a valid initial stroke severity measure, such as the National Institutes of Health Stroke Scale. These outcome measures, as currently constructed, may be prone to mischaracterizing the quality of stroke care being delivered by hospitals and may ultimately harm acute ischemic stroke patients. This article details (1) why the Centers for Medicare & Medicaid Services acute ischemic stroke outcome measures in their present form may not provide adequate risk adjustment, (2) why the measures as currently designed may lead to inaccurate representation of hospital performance and have the potential for serious unintended consequences, (3) what activities the American Heart Association/American Stroke Association has engaged in to highlight these concerns to the Centers for Medicare & Medicaid Services and other interested parties, and (4) alternative approaches and opportunities that should be considered for more accurately risk-adjusting 30-day outcomes measures in patients with ischemic stroke.

Reproducibility and Temporal Structure in Weekly Resting-State fMRI over a Period of 3.5 Years

PubMed Central

Choe, Ann S.; Jones, Craig K.; Joel, Suresh E.; Muschelli, John; Belegu, Visar; Caffo, Brian S.; Lindquist, Martin A.; van Zijl, Peter C. M.; Pekar, James J.

2015-01-01

Resting-state functional MRI (rs-fMRI) permits study of the brain’s functional networks without requiring participants to perform tasks. Robust changes in such resting state networks (RSNs) have been observed in neurologic disorders, and rs-fMRI outcome measures are candidate biomarkers for monitoring clinical trials, including trials of extended therapeutic interventions for rehabilitation of patients with chronic conditions. In this study, we aim to present a unique longitudinal dataset reporting on a healthy adult subject scanned weekly over 3.5 years and identify rs-fMRI outcome measures appropriate for clinical trials. Accordingly, we assessed the reproducibility, and characterized the temporal structure of, rs-fMRI outcome measures derived using independent component analysis (ICA). Data was compared to a 21-person dataset acquired on the same scanner in order to confirm that the values of the single-subject RSN measures were within the expected range as assessed from the multi-participant dataset. Fourteen RSNs were identified, and the inter-session reproducibility of outcome measures—network spatial map, temporal signal fluctuation magnitude, and between-network connectivity (BNC)–was high, with executive RSNs showing the highest reproducibility. Analysis of the weekly outcome measures also showed that many rs-fMRI outcome measures had a significant linear trend, annual periodicity, and persistence. Such temporal structure was most prominent in spatial map similarity, and least prominent in BNC. High reproducibility supports the candidacy of rs-fMRI outcome measures as biomarkers, but the presence of significant temporal structure needs to be taken into account when such outcome measures are considered as biomarkers for rehabilitation-style therapeutic interventions in chronic conditions. PMID:26517540

Patient-reported outcomes in child and adolescent mental health services (CAMHS): use of idiographic and standardized measures.

PubMed

Wolpert, Miranda; Ford, Tamsin; Trustam, Emma; Law, Duncan; Deighton, Jessica; Flannery, Halina; Fugard, Andrew J B; Fugard, Rew J B

2012-04-01

There is increasing emphasis on use of patient-reported outcome measures (PROMs) in mental health but little research on the best approach, especially where there are multiple perspectives. To present emerging findings from both standardized and idiographic child-, parent- and clinician-rated outcomes in child and adolescent mental health services (CAMHS) and consider their correlations. Outcomes were collected in CAMHS across the UK. These comprised idiographic measures (goal-based outcomes) and standardized measures (practitioner-rated Children's Global Assessment Scale; child- and parent-rated Strengths and Difficulties Questionnaire). There was reliable positive change from the beginning of treatment to later follow-up according to all informants. Standardized clinician function report was correlated with standardized child difficulty report (r  =  - 0.26), standardized parent report (r  =  - 0.28) and idiographic joint client-determined goals (r  =  0.38) in the expected directions. These results suggest that routine outcome monitoring is feasible, and suggest the possibility of using jointly agreed idiographic measures alongside particular perspectives on outcome as part of a PROMs approach.

Clinical Outcome Assessments: Conceptual Foundation-Report of the ISPOR Clinical Outcomes Assessment - Emerging Good Practices for Outcomes Research Task Force.

PubMed

Walton, Marc K; Powers, John H; Hobart, Jeremy; Patrick, Donald; Marquis, Patrick; Vamvakas, Spiros; Isaac, Maria; Molsen, Elizabeth; Cano, Stefan; Burke, Laurie B

2015-09-01

An outcome assessment, the patient assessment used in an endpoint, is the measuring instrument that provides a rating or score (categorical or continuous) that is intended to represent some aspect of the patient's health status. Outcome assessments are used to define efficacy endpoints when developing a therapy for a disease or condition. Most efficacy endpoints are based on specified clinical assessments of patients. When clinical assessments are used as clinical trial outcomes, they are called clinical outcome assessments (COAs). COAs include any assessment that may be influenced by human choices, judgment, or motivation. COAs must be well-defined and possess adequate measurement properties to demonstrate (directly or indirectly) the benefits of a treatment. In contrast, a biomarker assessment is one that is subject to little, if any, patient motivational or rater judgmental influence. This is the first of two reports by the ISPOR Clinical Outcomes Assessment - Emerging Good Practices for Outcomes Research Task Force. This report provides foundational definitions important for an understanding of COA measurement principles. The foundation provided in this report includes what it means to demonstrate a beneficial effect, how assessments of patients relate to the objective of showing a treatment's benefit, and how these assessments are used in clinical trial endpoints. In addition, this report describes intrinsic attributes of patient assessments and clinical trial factors that can affect the properties of the measurements. These factors should be considered when developing or refining assessments. These considerations will aid investigators designing trials in their choice of using an existing assessment or developing a new outcome assessment. Although the focus of this report is on the development of a new COA to define endpoints in a clinical trial, these principles may be applied more generally. A critical element in appraising or developing a COA is to describe the treatment's intended benefit as an effect on a clearly identified aspect of how a patient feels or functions. This aspect must have importance to the patient and be part of the patient's typical life. This meaningful health aspect can be measured directly or measured indirectly when it is impractical to evaluate it directly or when it is difficult to measure. For indirect measurement, a concept of interest (COI) can be identified. The COI must be related to how a patient feels or functions. Procedures are then developed to measure the COI. The relationship of these measurements with how a patient feels or functions in the intended setting and manner of use of the COA (the context of use) could then be defined. A COA has identifiable attributes or characteristics that affect the measurement properties of the COA when used in endpoints. One of these features is whether judgment can influence the measurement, and if so, whose judgment. This attribute defines four categories of COAs: patient reported outcomes, clinician reported outcomes, observer reported outcomes, and performance outcomes. A full description as well as explanation of other important COA features is included in this report. The information in this report should aid in the development, refinement, and standardization of COAs, and, ultimately, improve their measurement properties. Copyright © 2015 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Measurement of Religiosity/Spirituality in Adolescent Health Outcomes Research: Trends and Recommendations

PubMed Central

McGrady, Meghan E.; Rosenthal, Susan L.

2010-01-01

The relationship between religious/spiritual (R/S) factors and adolescent health outcomes has been studied for decades; however, the R/S measurement tools used may not be developmentally relevant for adolescents. A systematic literature review was conducted to review and evaluate trends in measuring R/S in adolescent health outcomes research. In this review a total of 100 articles met criteria for inclusion. Relatively few (n = 15) included adolescent-specific R/S measures or items accounting for developmentally relevant issues such as parental religiosity or age-appropriate language. Future R/S and health research with adolescents would be strengthened by incorporating developmentally relevant R/S measurement tools, psychometrics, and multidimensional measures. PMID:20127172

Progress on core outcome sets for critical care research.

PubMed

Blackwood, Bronagh; Marshall, John; Rose, Louise

2015-10-01

Appropriate selection and definition of outcome measures are essential for clinical trials to be maximally informative. Core outcome sets (an agreed, standardized collection of outcomes measured and reported in all trials for a specific clinical area) were developed due to established inconsistencies in trial outcome selection. This review discusses the rationale for, and methods of, core outcome set development, as well as current initiatives in critical care. Recent systematic reviews of reported outcomes and measurement instruments relevant to the critically ill highlight inconsistencies in outcome selection, definition, and measurement, thus establishing the need for core outcome sets. Current critical care initiatives include development of core outcome sets for trials aimed at reducing mechanical ventilation duration; rehabilitation following critical illness; long-term outcomes in acute respiratory failure; and epidemic and pandemic studies of severe acute respiratory infection. Development and utilization of core outcome sets for studies relevant to the critically ill is in its infancy compared to other specialties. Notwithstanding, core outcome set development frameworks and guidelines are available, several sets are in various stages of development, and there is strong support from international investigator-led collaborations including the International Forum for Acute Care Trialists.

Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0.

PubMed

Boers, Maarten; Kirwan, John R; Wells, George; Beaton, Dorcas; Gossec, Laure; d'Agostino, Maria-Antonietta; Conaghan, Philip G; Bingham, Clifton O; Brooks, Peter; Landewé, Robert; March, Lyn; Simon, Lee S; Singh, Jasvinder A; Strand, Vibeke; Tugwell, Peter

2014-07-01

Lack of standardization of outcome measures limits the usefulness of clinical trial evidence to inform health care decisions. This can be addressed by agreeing on a minimum core set of outcome measures per health condition, containing measures relevant to patients and decision makers. Since 1992, the Outcome Measures in Rheumatology (OMERACT) consensus initiative has successfully developed core sets for many rheumatologic conditions, actively involving patients since 2002. Its expanding scope required an explicit formulation of its underlying conceptual framework and process. Literature searches and iterative consensus process (surveys and group meetings) of stakeholders including patients, health professionals, and methodologists within and outside rheumatology. To comprehensively sample patient-centered and intervention-specific outcomes, a framework emerged that comprises three core "Areas," namely Death, Life Impact, and Pathophysiological Manifestations; and one strongly recommended Resource Use. Through literature review and consensus process, core set development for any specific health condition starts by identifying at least one core "Domain" within each of the Areas to formulate the "Core Domain Set." Next, at least one applicable measurement instrument for each core Domain is identified to formulate a "Core Outcome Measurement Set." Each instrument must prove to be truthful (valid), discriminative, and feasible. In 2012, 96% of the voting participants (n=125) at the OMERACT 11 consensus conference endorsed this model and process. The OMERACT Filter 2.0 explicitly describes a comprehensive conceptual framework and a recommended process to develop core outcome measurement sets for rheumatology likely to be useful as a template in other areas of health care. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

The incremental value of self-reported mental health measures in predicting functional outcomes of veterans.

PubMed

Eisen, Susan V; Bottonari, Kathryn A; Glickman, Mark E; Spiro, Avron; Schultz, Mark R; Herz, Lawrence; Rosenheck, Robert; Rofman, Ethan S

2011-04-01

Research on patient-centered care supports use of patient/consumer self-report measures in monitoring health outcomes. This study examined the incremental value of self-report mental health measures relative to a clinician-rated measure in predicting functional outcomes among mental health service recipients. Participants (n = 446) completed the Behavior and Symptom Identification Scale, the Brief Symptom Inventory, and the Veterans/Rand Short Form-36 at enrollment in the study (T1) and 3 months later (T2). Global Assessment of Functioning (GAF) ratings, mental health service utilization, and psychiatric diagnoses were obtained from administrative data files. Controlling for demographic and clinical variables, results indicated that improvement based on the self-report measures significantly predicted one or more functional outcomes (i.e., decreased likelihood of post-enrollment psychiatric hospitalization and increased likelihood of paid employment), above and beyond the predictive value of the GAF. Inclusion of self-report measures may be a useful addition to performance measurement efforts.

Identification of desired outcomes for school nursing practice.

PubMed

Selekman, Janice; Guilday, Patricia

2003-12-01

The Scope and Standards of Professional School Nursing Practice states that school nurses should evaluate the quality and effectiveness of their practice. School nurses have not yet identified and adopted outcomes by which this effectiveness can be measured. This study used focus groups during a national meeting of school nurse leaders to identify the desired outcomes that could be used to measure the efficacy of school nursing practice. Ten desired outcome themes were identified with numerous specific indicators as possible ways to measure the desired outcome in each theme. The student-, school-, and nurse-focused outcome themes were as follows: (a) increased student seat time, (b) receipt of first aid and acute care measures, (c) receipt of competent health-related interventions or skills, (d) meeting of the comprehensive needs of children with chronic conditions, (e) enhanced school health via wellness promotion and disease prevention measures, (f) referrals, (g) safe environment, (h) enhanced school health via community outreach, (i) cost-effective school nurse services, and (j) student, parent, and staff satisfaction. The school nurse participants were supportive of having potential outcomes identified and unanimously endorsed the findings at the conclusion of the study. They have provided a comprehensive framework from which evaluation tools can be developed to measure the efficacy of school nursing.

The quiet revolution: reporting of health outcomes in general medical journals.

PubMed

Seymour, J; Newell, D; Shiell, A

1997-01-01

This study reviews the extent of evaluation of health outcomes in three general medical journals over the past decade by examining papers published in the original research section of the New England Journal of Medicine (NEJM), The Lancet, and the Medical Journal of Australia (MJA) in 1982 and 1992. Evaluations were identified and classified according to the type of comparison group and the type of outcome measures employed. They were divided into three categories: those employing a comparison group; those employing a before-and-after study design (or own comparison group); and those with no comparison group. The categories of outcome measures were mortality, clinical or intermediate measures of health state, and final outcome measures (quality of life). Results show that the proportion of papers evaluating a health services intervention remained stable over the period. However, the MJA published considerably fewer evaluations than the other journals. In the NEJM and The Lancet, 75 per cent of evaluations incorporated comparison groups, in the MJA, less than 40 per cent. Overall, the proportion of papers reporting final outcome measures increased significantly between 1982 and 1992 (p = 0.04) but the change in each journal individually did not reach statistical significance. This study indicates that the reporting of health outcomes evaluations has remained constant but there has been some change in the use of comparison groups and final outcome measures over time.

Vascular Access Outcomes Reported in Maintenance Hemodialysis Trials: A Systematic Review.

PubMed

Viecelli, Andrea K; O'Lone, Emma; Sautenet, Benedicte; Craig, Jonathan C; Tong, Allison; Chemla, Eric; Hooi, Lai-Seong; Lee, Timmy; Lok, Charmaine; Polkinghorne, Kevan R; Quinn, Robert R; Vachharajani, Tushar; Vanholder, Raymond; Zuo, Li; Irish, Ashley B; Mori, Trevor A; Pascoe, Elaine M; Johnson, David W; Hawley, Carmel M

2018-03-01

Many randomized controlled trials have been performed with the goal of improving outcomes related to hemodialysis vascular access. If the reported outcomes are relevant and measured consistently to allow comparison of interventions across trials, such trials can inform decision making. This study aimed to assess the scope and consistency of vascular access outcomes reported in contemporary hemodialysis trials. Systematic review. Adults requiring maintenance hemodialysis. All randomized controlled trials and trial protocols reporting vascular access outcomes identified from ClinicalTrials.gov, Embase, MEDLINE, and the Cochrane Kidney and Transplant Specialized Register from January 2011 to June 2016. Any hemodialysis-related intervention. The frequency and characteristics of vascular access outcome measures were analyzed and classified. From 168 relevant trials, 1,426 access-related outcome measures were extracted and classified into 23 different outcomes. The 3 most common outcomes were function (136 [81%] trials), infection (63 [38%]), and maturation (31 [18%]). Function was measured in 489 different ways, but most frequently reported as "mean access blood flow (mL/min)" (37 [27%] trials) and "number of thromboses" (30 [22%]). Infection was assessed in 136 different ways, with "number of access-related infections" being the most common measure. Maturation was assessed in 44 different ways at 15 different time points and most commonly characterized by vein diameter and blood flow. Patient-reported outcomes, including pain (19 [11%]) and quality of life (5 [3%]), were reported infrequently. Only a minority of trials used previously standardized outcome definitions. Restricted sampling frame for feasibility and focus on contemporary trials. The reporting of access outcomes in hemodialysis trials is very heterogeneous, with limited patient-reported outcomes and infrequent use of standardized outcome measures. Efforts to standardize outcome reporting for vascular access are critical to optimizing the comparability, reliability, and value of trial evidence to improve outcomes for patients requiring hemodialysis. Copyright © 2017 National Kidney Foundation, Inc. All rights reserved.

Effect of quality chronic disease management for alcohol and drug dependence on addiction outcomes.

PubMed

Kim, Theresa W; Saitz, Richard; Cheng, Debbie M; Winter, Michael R; Witas, Julie; Samet, Jeffrey H

2012-12-01

We examined the effect of the quality of primary care-based chronic disease management (CDM) for alcohol and/or other drug (AOD) dependence on addiction outcomes. We assessed quality using (1) a visit frequency based measure and (2) a self-reported assessment measuring alignment with the chronic care model. The visit frequency based measure had no significant association with addiction outcomes. The self-reported measure of care-when care was at a CDM clinic-was associated with lower drug addiction severity. The self-reported assessment of care from any healthcare source (CDM clinic or elsewhere) was associated with lower alcohol addiction severity and abstinence. These findings suggest that high quality CDM for AOD dependence may improve addiction outcomes. Quality measures based upon alignment with the chronic care model may better capture features of effective CDM care than a visit frequency measure. Copyright © 2012 Elsevier Inc. All rights reserved.

A core outcome set for clinical trials in acute diarrhoea.

PubMed

Karas, Jacek; Ashkenazi, Shai; Guarino, Alfredo; Lo Vecchio, Andrea; Shamir, Raanan; Vandenplas, Yvan; Szajewska, Hania

2015-04-01

Core outcome sets are the baseline for what should be measured in clinical research and, thus, should serve as a guide for what should be collected and reported. The Consensus Group on Outcome Measures Made in Pediatric Enteral Nutrition Clinical Trials, established in 2012, agreed that consensus on a core set of outcomes with agreed-upon definitions that should be measured and reported in clinical trials was needed. To achieve this goal, six working groups (WGs) were setup, including WG on acute diarrhoea, whose main goal was to develop a core outcome set for trials in acute diarrhoea. The first step identified how published outcomes related to acute diarrhoea were reported. The second focused on the methodology for determining which outcomes to measure in clinical trials. The third employed a two-phase questionnaire study using the Delphi technique to define clinically important outcomes to clinicians and parents. For therapeutic studies, the five most important outcome measures were diarrhoea duration, degree of dehydration, need for hospitalisation (or duration of hospitalisation for inpatients), the proportion of patients recovered by 48 h and adverse effects. The prophylactic core outcome set included prevention of diarrhoea, prevention of dehydration, prevention of hospitalisation and adverse effects. The outcome sets for therapy and prevention can be recommended for use in future trials of patients with gastroenteritis. Their envisioned goal is to decrease study heterogeneity and to ease the comparability of studies. WG's next step is to determine how to measure the outcomes included in the core set. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Outcome measures for oral health based on clinical assessments and claims data: feasibility evaluation in practice.

PubMed

Hummel, Riët; Bruers, Josef; van der Galiën, Onno; van der Sanden, Wil; van der Heijden, Geert

2017-10-05

It is well known that treatment variation exists in oral healthcare, but the consequences for oral health are unknown as the development of outcome measures is still in its infancy. The aim of this study was to identify and develop outcome measures for oral health and explore their performance using health insurance claims records and clinical data from general dental practices. The Dutch healthcare insurance company Achmea collaborated with researchers, oral health experts, and general dental practitioners (GDPs) in a proof of practice study to test the feasibility of measures in general dental practices. A literature search identified previously described outcome measures for oral healthcare. Using a structured approach, identified measures were (i) prioritized, adjusted and added to after discussion and then (ii) tested for feasibility of data collection, their face validity and discriminative validity. Data sources were claims records from Achmea, clinical records from dental practices, and prospective, pre-determined clinical assessment data obtained during routine consultations. In total eight measures (four on dental caries, one on tooth wear, two on periodontal health, one on retreatment) were identified, prioritized and tested. The retreatment measure and three measures for dental caries were found promising as data collection was feasible, they had face validity and discriminative validity. Deployment of these measures demonstrated variation in clinical practices of GDPs. Feedback of this data to GDPs led to vivid discussions on best practices and quality of care. The measure 'tooth wear' was not considered sufficiently responsive; 'changes in periodontal health score' was considered a controversial measure. The available data for the measures 'percentage of 18-year-olds with no tooth decay' and 'improvement in gingival bleeding index at reassessment' was too limited to provide accurate estimates per dental practice. The evaluated measures 'time to first restoration', 'distribution of risk categories for dental caries', 'filled-and-missing score' and 'retreatment after restoration', were considered valid and relevant measures and a proxy for oral health status. As such, they improve the transparency of oral health services delivery that can be related to oral health outcomes, and with time may serve to improve these oral health outcomes.

Clinical outcome measurement: Models, theory, psychometrics and practice.

PubMed

McClimans, Leah; Browne, John; Cano, Stefan

In the last decade much has been made of the role that models play in the epistemology of measurement. Specifically, philosophers have been interested in the role of models in producing measurement outcomes. This discussion has proceeded largely within the context of the physical sciences, with notable exceptions considering measurement in economics. However, models also play a central role in the methods used to develop instruments that purport to quantify psychological phenomena. These methods fall under the umbrella term 'psychometrics'. In this paper, we focus on Clinical Outcome Assessments (COAs) and discuss two measurement theories and their associated models: Classical Test Theory (CTT) and Rasch Measurement Theory. We argue that models have an important role to play in coordinating theoretical terms with empirical content, but to do so they must serve: 1) as a representation of the measurement interaction; and 2) in conjunction with a theory of the attribute in which we are interested. We conclude that Rasch Measurement Theory is a more promising approach than CTT in these regards despite the latter's popularity with health outcomes researchers. Copyright © 2017. Published by Elsevier Ltd.

Responsiveness of performance-based outcome measures for mobility, balance, muscle strength and manual dexterity in adults with myotonic dystrophy type 1.

PubMed

Kierkegaard, Marie; Petitclerc, Émilie; Hébert, Luc J; Mathieu, Jean; Gagnon, Cynthia

2018-02-28

To assess changes and responsiveness in outcome measures of mobility, balance, muscle strength and manual dexterity in adults with myotonic dystrophy type 1. A 9-year longitudinal study conducted with 113 patients. The responsiveness of the Timed Up and Go test, Berg Balance Scale, quantitative muscle testing, grip and pinch-grip strength, and Purdue Pegboard Test was assessed using criterion and construct approaches. Patient-reported perceived changes (worse/stable) in balance, walking, lower-limb weakness, stair-climbing and hand weakness were used as criteria. Predefined hypotheses about expected area under the receiver operating characteristic curves (criterion approach) and correlations between relative changes (construct approach) were explored. The direction and magnitude of median changes in outcome measures corresponded with patient-reported changes. Median changes in the Timed Up and Go test, grip strength, pinch-grip strength and Purdue Pegboard Test did not, in general, exceed known measurement errors. Most criterion (72%) and construct (70%) approach hypotheses were supported. Promising responsiveness was found for outcome measures of mobility, balance and muscle strength. Grip strength and manual dexterity measures showed poorer responsiveness. The performance-based outcome measures captured changes over the 9-year period and responsiveness was promising. Knowledge of measurement errors is needed to interpret the meaning of these longitudinal changes.

The International Dermatology Outcome Measures Group: formation of patient-centered outcome measures in dermatology.

PubMed

Gottlieb, Alice B; Levin, Adriane A; Armstrong, April W; Abernethy, April; Duffin, Kristina Callis; Bhushan, Reva; Garg, Amit; Merola, Joseph F; Maccarone, Mara; Christensen, Robin

2015-02-01

As quality standards are increasingly in demand throughout medicine, dermatology needs to establish outcome measures to quantify the effectiveness of treatments and providers. The International Dermatology Outcome Measures Group was established to address this need. Beginning with psoriasis, the group aims to create a tool considerate of patients and providers using the input of all relevant stakeholders in assessment of disease severity and response to treatment. Herein, we delineate the procedures through which consensus is being reached and the future directions of the project. Copyright © 2014 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

Use of standardized outcome measures in physical therapist practice: perceptions and applications.

PubMed

Jette, Diane U; Halbert, James; Iverson, Courtney; Miceli, Erin; Shah, Palak

2009-02-01

Standardized instruments for measuring patients' activity limitations and participation restrictions have been advocated for use by rehabilitation professionals for many years. The available literature provides few recent reports of the use of these measures by physical therapists in the United States. The primary purpose of this study was to determine: (1) the extent of the use of standardized outcome measures and (2) perceptions regarding their benefits and barriers to their use. A secondary purpose was to examine factors associated with their use among physical therapists in clinical practice. The study used an observational design. A survey questionnaire comprising items regarding the use and perceived benefits and barriers of standardized outcome measures was sent to 1,000 randomly selected members of the American Physical Therapy Association (APTA). Forty-eight percent of participants used standardized outcome measures. The majority of participants (>90%) who used such measures believed that they enhanced communication with patients and helped direct the plan of care. The most frequently reported reasons for not using such measures included length of time for patients to complete them, length of time for clinicians to analyze the data, and difficulty for patients in completing them independently. Use of standardized outcome measures was related to specialty certification status, practice setting, and the age of the majority of patients treated. The limitations included an unvalidated survey for data collection and a sample limited to APTA members. Despite more than a decade of development and testing of standardized outcome measures appropriate for various conditions and practice settings, physical therapists have some distance to go in implementing their use routinely in most clinical settings. Based on the perceived barriers, alterations in practice management strategies and the instruments themselves may be necessary to increase their use.

Do the EULAR Sjögren's syndrome outcome measures correlate with health status in primary Sjögren's syndrome?

PubMed

Lendrem, Dennis; Mitchell, Sheryl; McMeekin, Peter; Gompels, Luke; Hackett, Katie; Bowman, Simon; Price, Elizabeth; Pease, Colin T; Emery, Paul; Andrews, Jacqueline; Lanyon, Peter; Hunter, John; Gupta, Monica; Bombardieri, Michele; Sutcliffe, Nurhan; Pitzalis, Costantino; McLaren, John; Cooper, Annie; Regan, Marian; Giles, Ian; Isenberg, David; Saravanan, Vadivelu; Coady, David; Dasgupta, Bhaskar; McHugh, Neil; Young-Min, Steven; Moots, Robert; Gendi, Nagui; Akil, Mohammed; Griffiths, Bridget; Ng, Wan-Fai

2015-04-01

This study sets out to investigate the relationship between health status [EuroQol five-dimensions questionnaire (EQ-5D)] in primary SS and three of the European League Against Rheumatism (EULAR) SS outcome measures-the disease activity index (ESSDAI), the patient reported index (ESSPRI) and the sicca score. In particular, the goal was to establish whether there is a relationship between the EULAR outcome measures and quality of life. Health status was evaluated using a standardized measure developed by the EuroQol Group-the EQ5D. This permits calculation of two measures of health status: time trade-off (TTO) values and the EQ-5D visual analogue scale (VAS) scores. We used Spearman's rank correlation analysis to investigate the strength of association between health status and three EULAR measures of physician- and patient-reported disease activity in 639 patients from the UK primary SS registry (UKPSSR) cohort. This study demonstrates that the EULAR SS disease-specific outcome measures are significantly correlated with health outcome values (P < 0.001). Higher scores on the ESSDAI, EULAR sicca score and ESSPRI are associated with poorer health states-i.e. lower TTO values and lower VAS scores. While all three are significantly correlated with TTO values and EQ-5D VAS scores, the effect is strongest for the ESSPRI. This study provides further evidence supporting the use of ESSDAI, EULAR sicca score and ESSPRI measures in the clinic. We also discuss the need for disease-specific measures of health status and their comparison with standardized health outcome measures. © The Author 2014. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Evaluation of hospital outcomes: the relation between length-of-stay, readmission, and mortality in a large international administrative database.

PubMed

Lingsma, Hester F; Bottle, Alex; Middleton, Steve; Kievit, Job; Steyerberg, Ewout W; Marang-van de Mheen, Perla J

2018-02-14

Hospital mortality, readmission and length of stay (LOS) are commonly used measures for quality of care. We aimed to disentangle the correlations between these interrelated measures and propose a new way of combining them to evaluate the quality of hospital care. We analyzed administrative data from the Global Comparators Project from 26 hospitals on patients discharged between 2007 and 2012. We correlated standardized and risk-adjusted hospital outcomes on mortality, readmission and long LOS. We constructed a composite measure with 5 levels, based on literature review and expert advice, from survival without readmission and normal LOS (best) to mortality (worst outcome). This composite measure was analyzed using ordinal regression, to obtain a standardized outcome measure to compare hospitals. Overall, we observed a 3.1% mortality rate, 7.8% readmission rate (in survivors) and 20.8% long LOS rate among 4,327,105 admissions. Mortality and LOS were correlated at the patient and the hospital level. A patient in the upper quartile LOS had higher odds of mortality (odds ratio = 1.45, 95% confidence interval 1.43-1.47) than those in the lowest quartile. Hospitals with a high standardized mortality had higher proportions of long LOS (r = 0.79, p < 0.01). Readmission rates did not correlate with either mortality or long LOS rates. The interquartile range of the standardized ordinal composite outcome was 74-117. The composite outcome had similar or better reliability in ranking hospitals than individual outcomes. Correlations between different outcome measures are complex and differ between hospital- and patient-level. The proposed composite measure combines three outcomes in an ordinal fashion for a more comprehensive and reliable view of hospital performance than its component indicators.

Behavioral and cognitive outcomes for clinical trials in children with neurofibromatosis type 1.

PubMed

van der Vaart, Thijs; Rietman, André B; Plasschaert, Ellen; Legius, Eric; Elgersma, Ype; Moll, Henriëtte A

2016-01-12

To evaluate the appropriateness of cognitive and behavioral outcome measures in clinical trials in neurofibromatosis type 1 (NF1) by analyzing the degree of deficits compared to reference groups, test-retest reliability, and how scores correlate between outcome measures. Data were analyzed from the Simvastatin for cognitive deficits and behavioral problems in patients with neurofibromatosis type 1 (NF1-SIMCODA) trial, a randomized placebo-controlled trial of simvastatin for cognitive deficits and behavioral problems in children with NF1. Outcome measures were compared with age-specific reference groups to identify domains of dysfunction. Pearson r was computed for before and after measurements within the placebo group to assess test-retest reliability. Principal component analysis was used to identify the internal structure in the outcome data. Strongest mean score deviations from the reference groups were observed for full-scale intelligence (-1.1 SD), Rey Complex Figure Test delayed recall (-2.0 SD), attention problems (-1.2 SD), and social problems (-1.1 SD). Long-term test-retest reliability were excellent for Wechsler scales (r > 0.88), but poor to moderate for other neuropsychological tests (r range 0.52-0.81) and Child Behavioral Checklist subscales (r range 0.40-0.79). The correlation structure revealed 2 strong components in the outcome measures behavior and cognition, with no correlation between these components. Scores on psychosocial quality of life correlate strongly with behavioral problems and less with cognitive deficits. Children with NF1 show distinct deficits in multiple domains. Many outcome measures showed weak test-retest correlations over the 1-year trial period. Cognitive and behavioral outcomes are complementary. This analysis demonstrates the need to include reliable outcome measures on a variety of cognitive and behavioral domains in clinical trials for NF1. © 2015 American Academy of Neurology.

CHoice of Outcome In Cbt for psychosEs (CHOICE): The Development of a New Service User–Led Outcome Measure of CBT for Psychosis

PubMed Central

Greenwood, Kathryn E.; Sweeney, Angela; Williams, Sally; Garety, Philippa; Kuipers, Elizabeth; Scott, Jan; Peters, Emmanuelle

2010-01-01

Outcome measures for cognitive behavior therapy for psychosis (CBTp) have been derived from pharmacological studies, focusing on symptom change rather than outcomes such as distress or fulfilment. This study presents the development and psychometric properties of a new outcome measure (CHoice of Outcome In Cbt for psychosEs [CHOICE]), which reflects more strongly the aims of CBTp and the priorities of service users. Service users who had received CBTp participated in focus groups to discuss their outcome priorities, using a topic guide generated by a panel of experts in CBTp. A qualitative thematic analysis was undertaken to reach consensus on themes and generate items. Response scales were constructed for 3 dimensions: severity, satisfaction, and importance. The resulting questionnaire was piloted with service users who had not received CBTp, stratified by service type, ethnicity, and first language to ensure that it was user friendly and applicable prior to CBTp. The psychometric properties of the measure were then examined in a sample of 152 service users. Twenty-four items, and 2 of the dimensions (severity and satisfaction), were retained in the final measure. A factor analysis revealed a single psychological recovery factor interspersed throughout with both CBTp and recovery items. Test-retest reliability, construct validity, and sensitivity to change following CBTp were confirmed. The CHOICE measure is unique in being the first psychometrically adequate service user–led outcome measure of CBTp. It provides the opportunity to examine the evidence base for CBTp with an assessment approach that prioritizes service user definitions of recovery and CBT aims. PMID:19880823

Discrepancy between results and abstract conclusions in industry- vs nonindustry-funded studies comparing topical prostaglandins.

PubMed

Alasbali, Tariq; Smith, Michael; Geffen, Noa; Trope, Graham E; Flanagan, John G; Jin, Yaping; Buys, Yvonne M

2009-01-01

To investigate the relationship between industry- vs nonindustry-funded publications comparing the efficacy of topical prostaglandin analogs by evaluating the correspondence between the statistical significance of the publication's main outcome measure and its abstract conclusions. Retrospective, observational cohort study. English publications comparing the ocular hypotensive efficacy between any or all of latanoprost, travoprost, and bimatoprost were searched from the MEDLINE database. Each article was reviewed by three independent observers and was evaluated for source of funding, study quality, statistically significant main outcome measure, correspondence between results of main outcome measure and abstract conclusion, number of intraocular pressure outcomes compared, and journal impact factor. Funding was determined by published disclosure or, in cases of no documented disclosure, the corresponding author was contacted directly to confirm industry funding. Discrepancies were resolved by consensus. The main outcome measure was correspondence between abstract conclusion and reported statistical significance of the publications' main outcome measure. Thirty-nine publications were included, of which 29 were industry funded and 10 were nonindustry funded. The published abstract conclusion was not consistent with the results of the main outcome measure in 18 (62%) of 29 of the industry-funded studies compared with zero (0%) of 10 of the nonindustry-funded studies (P = .0006). Twenty-six (90%) of the industry-funded studies had proindustry abstract conclusions. Twenty-four percent of the industry-funded publications had a statistically significant main outcome measure; however, 90% of the industry-funded studies had proindustry abstract conclusions. Both readers and reviewers should scrutinize publications carefully to ensure that data support the authors' conclusions.

[Improving care for cleft lip and palate patients: uniform and patient-orientated outcome measures].

PubMed

Haj, M; de Gier, H H W; van Veen-van der Hoek, M; Versnel, S L; van Adrichem, L N; Wolvius, E B; Hazelzet, J A; Koudstaal, M J

2018-02-01

The quality of care for patients with cleft lip and palate is extremely variable across the world. Treatment protocols differ and methods of data registration are not uniform. Improving this care by means of comparative research is challenging. The best treatment programmes can be identified by uniformly registering patient-orientated outcomes and comparing the outcomes with those of other treatment centres. That knowledge can be used to improve one's own care. An international team consisting of specialists and cleft lip and palate patients has developed a set of outcome measures that are considered by patients to be most important. This team is coordinated by the International Consortium of Health Outcomes Measurement (ICHOM). The cleft lip and palate outcome set can be used by all centres worldwide in following up on cleft lip and palate patients. In the Erasmus Medical Centre in Rotterdam, the 'Zorgmonitor Schisis' (Care Monitor Cleft Lip and Palate) has been built, an application in which these outcome measures are collected at fixed times. Implementing this set of outcome measures in other cleft lip and palate treatment centres and using the outcomes as (inter)national benchmarks will result in transparency and the improvement of the treatment of cleft lip and palate worldwide.

Learning disability and epilepsy. 2, a review of available outcome measures and position statement on development priorities.

PubMed

Espie, C A; Kerr, M; Paul, A; O'Brien, G; Betts, T; Clark, J; Jacoby, A; Baker, G

1997-10-01

People with epilepsy plus learning disabilities pose a challenge in terms of clinical management and research investigation, and, to date, the measurement of outcomes in this population has been limited. There have been uncertainties concerning both the 'what' and the 'how' of assessment. This paper presents a comprehensive review of available outcome measures across nine domains, i.e. relating to seizures, drugs, cognitive function, behaviour, social functioning, carer functioning, attitudes, motivation and 'quality of life'. This last domain reflects more global measures designed to encompass several assessment strands. The uses and limitations of each scale is discussed and, where data are available, psychometric properties are also presented. The paper concludes with suggestions for the further development of outcome measures in this population.

Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures

PubMed Central

2014-01-01

There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures’ psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against standards of feasibility and psychometric credibility in relation to use for practice and policy. PMID:24834111

Radiographic Measurement of Displacement in Acetabular Fractures: A Systematic Review of the Literature.

PubMed

Dodd, Andrew; Osterhoff, Georg; Guy, Pierre; Lefaivre, Kelly A

2016-06-01

To report methods of measurement of radiographic displacement and radiographic outcomes in acetabular fractures described in the literature. A systematic review of the English literature was performed using EMBASE and Medline in August 2014. Inclusion criteria were studies of operatively treated acetabular fractures in adults with acute (<6 weeks) open reduction and internal fixation that reported radiographic outcomes. Exclusion criteria included case series with <10 patients, fractures managed >6 weeks from injury, acute total hip arthroplasty, periprosthetic fractures, time frame of radiographic outcomes not stated, missing radiographic outcome data, and non-English language articles. Basic information collected included journal, author, year published, number of fractures, and fracture types. Specific data collected included radiographic outcome data, method of measuring radiographic displacement, and methods of interpreting or categorizing radiographic outcomes. The number of reproducible radiographic measurement techniques (2/64) and previously described radiographic interpretation methods (4) were recorded. One radiographic reduction grading criterion (Matta) was used nearly universally in articles that used previously described criteria. Overall, 70% of articles using this criteria documented anatomic reductions. The current standard of measuring radiographic displacement in publications dealing with acetabulum fractures almost universally lacks basic description, making further scientific rigor, such as testing reproducibility, impossible. Further work is necessary to standardize radiographic measurement techniques, test their reproducibility, and qualify their validity or determine which measurements are important to clinical outcomes. Diagnostic Level IV. See Instructions for Authors for a complete description of levels of evidence.

Capturing and missing the patient's story through outcome measures: A thematic comparison of patient-generated items in PSYCHLOPS with CORE-OM and PHQ-9.

PubMed

Sales, Célia Md; Neves, Inês Td; Alves, Paula G; Ashworth, Mark

2017-11-22

There is increasing interest in individualized patient-reported outcome measures (I-PROMS), where patients themselves indicate the specific problems they want to address in therapy and these problems are used as items within the outcome measurement tool. This paper examined the extent to which 279 items reported in an I-PROM (PSYCHLOPS) added qualitative information which was not captured by two well-established outcome measures (CORE-OM and PHQ-9). Comparison of items was only conducted for patients scoring above the "caseness" threshold on the standardized measures. 107 patients were participating in therapy within addiction and general psychiatric clinical settings. Almost every patient (95%) reported at least one item whose content was not covered by PHQ-9, and 71% reported at least one item not covered by CORE-OM. Results demonstrate the relevance of individualized outcome assessment for capturing data describing the issues of greatest concern to patients, as nomothetic measures do not always seem to capture the whole story. © 2017 The Authors Health Expectations Published by John Wiley & Sons Ltd.

Retail price as an outcome measure for the effectiveness of drug law enforcement.

PubMed

Bright, David A; Ritter, Alison

2010-09-01

One outcome measure of law enforcement effectiveness is the reduction in drug consumption which occurs as a result of law enforcement interventions. A theoretical relationship between drug consumption and retail price has promoted the use of retail price as a surrogate measure for consumption. In the current article, retail price is examined as a potential outcome measure for the effectiveness of law enforcement. The predictions regarding the relationship between law enforcement intensity and price are only partially supported by research. Explanations for the disconnect between the drug law enforcement activity and retail price include: rapid adaptation by market players, enforcement swamping, assumptions of rational actors, short-run versus long-run effects, structure of the illicit market, simultaneous changes that affect price in perverse ways, the role of violence in markets, and data limitations. Researchers who use retail price as an outcome measure need to take into account the complex relationship between drug law enforcement interventions and the retail price of illicit drugs. Viable outcome measures which can be used as complements to retail price are worth investigation. Copyright 2009 Elsevier B.V. All rights reserved.

Excellent Patient Care Processes in Poor Hospitals? Why Hospital-Level and Patient-Level Care Quality-Outcome Relationships Can Differ.

PubMed

Finney, John W; Humphreys, Keith; Kivlahan, Daniel R; Harris, Alex H S

2016-04-01

Studies finding weak or nonexistent relationships between hospital performance on providing recommended care and hospital-level clinical outcomes raise questions about the value and validity of process of care performance measures. Such findings may cause clinicians to question the effectiveness of the care process presumably captured by the performance measure. However, one cannot infer from hospital-level results whether patients who received the specified care had comparable, worse or superior outcomes relative to patients not receiving that care. To make such an inference has been labeled the "ecological fallacy," an error that is well known among epidemiologists and sociologists, but less so among health care researchers and policy makers. We discuss such inappropriate inferences in the health care performance measurement field and illustrate how and why process measure-outcome relationships can differ at the patient and hospital levels. We also offer recommendations for appropriate multilevel analyses to evaluate process measure-outcome relationships at the patient and hospital levels and for a more effective role for performance measure bodies and research funding organizations in encouraging such multilevel analyses.

Measuring the General Education Outcomes: Practical Strategies.

ERIC Educational Resources Information Center

Peterson, Anne; And Others

Prepared in an effort to more clearly define and measure general education outcomes at Columbus State Community College, in Ohio, this handbook describes outcomes and associated student behaviors and provides suggestions for assessing the outcomes. Following introductory materials, a list is provided of the college's six general education…

The evolving landscape of quality measurement for heart failure

PubMed Central

Fitzgerald, Ashley A.; Allen, Larry A.; Masoudi, Frederick A.

2013-01-01

Heart failure (HF) is a major cause of mortality and morbidity, representing a leading cause of death and hospitalization among U.S. Medicare beneficiaries. Advances in science have generated effective interventions to reduce adverse outcomes in HF, particularly in patients with reduced left ventricular ejection fraction. Unfortunately, effective therapies for heart failure are often not utilized in an effective, safe, timely, equitable, patient-centered, and efficient manner. Further, the risk of adverse outcomes for HF remains high. The last decades have witnessed the growth of efforts to measure and improve the care and outcomes of patients with HF. This paper will review the evolution of quality measurement for HF, including a brief history of quality measurement in medicine; the measures that have been employed to characterize quality in heart failure; how the measures are obtained; how measures are employed; and present and future challenges surrounding quality measurement in heart failure. PMID:22548579

Developing a General Outcome Measure of Growth in Movement for Infants and Toddlers.

ERIC Educational Resources Information Center

Greenwood, Charles R.; Luze, Gayle J.; Cline, Gabriel; Kuntz, Susan; Leitschuh, Carol

2002-01-01

The development of an experimental measure for assessing growth in movement in children (ages birth-3) is described. Results from the use of the Movement General Outcome Measurement with 29 infants and toddlers demonstrated the feasibility of the measure. The 6-minute assessment was found reliable in terms of inter-observer agreement. (Contains…

Connecting Stuttering Management and Measurement: I. Core Speech Measures of Clinical Process and Outcome

ERIC Educational Resources Information Center

Shenker, Rosalee C.

2006-01-01

Background: There will always be a place for stuttering treatments designed to eliminate or reduce stuttered speech. When those treatments are required, direct speech measures of treatment process and outcome are needed in clinical practice. Aims: Based on the contents of published clinical trials of such treatments, three "core" measures of…

Validation of a Measure of College Students' Intoxicated Behaviors: Associations with Alcohol Outcome Expectancies, Drinking Motives, and Personality

ERIC Educational Resources Information Center

Westmaas, Johann; Moeller, Scott; Woicik, Patricia Butler

2007-01-01

Objective: The authors aimed to develop a measure of college students' intoxicated behaviors and to validate the measure using scales assessing alcohol outcome expectancies, motives for drinking, and personality traits. Participants and Method Summary: The authors administered these measures and an inventory describing 50 intoxicated behaviors to…

The quality dilemma.

PubMed

Lucassen, Peter

2007-06-01

In the language and logic of the free market, providers of health care will have to demonstrate the quality of their work. However, in this setting quality is only interpreted in quantitative ways and consequently does not necessarily do justice to good physicians. Moreover, both outcome measures and process measures have serious drawbacks. An emphasis on outcome measures will disadvantage physicians working in deprived areas and doctors managing more complicated cases. Although process measures give the most direct information on the physician's performance, their evidence base is not always as straightforward as commonly supposed. Finally, measurement of quality indicators is complicated and time consuming. Physicians should be aware of the drawbacks of quality measurement and of the poor effects of quality improvement strategies on patient outcomes.

Young drivers' responses to anti-speeding advertisements: Comparison of self-report and objective measures of persuasive processing and outcomes.

PubMed

Kaye, Sherrie-Anne; Lewis, Ioni; Algie, Jennifer; White, Melanie J

2016-05-18

Self-report measures are typically used to assess the effectiveness of road safety advertisements. However, psychophysiological measures of persuasive processing (i.e., skin conductance response [SCR]) and objective driving measures of persuasive outcomes (i.e., in-vehicle Global Positioning System [GPS] devices) may provide further insights into the effectiveness of these advertisements. This study aimed to explore the persuasive processing and outcomes of 2 anti-speeding advertisements by incorporating both self-report and objective measures of speeding behavior. In addition, this study aimed to compare the findings derived from these different measurement approaches. Young drivers (N = 20, M age = 21.01 years) viewed either a positive or negative emotion-based anti-speeding television advertisement. While viewing the advertisement, SCR activity was measured to assess ad-evoked arousal responses. The RoadScout GPS device was then installed in participants' vehicles for 1 week to measure on-road speed-related driving behavior. Self-report measures assessed persuasive processing (emotional and arousal responses) and actual driving behavior. There was general correspondence between the self-report measures of arousal and the SCR and between the self-report measure of actual driving behavior and the objective driving data (as assessed via the GPS devices). This study provides insights into how psychophysiological and GPS devices could be used as objective measures in conjunction with self-report measures to further understand the persuasive processes and outcomes of emotion-based anti-speeding advertisements.

Outcome science in practice: an overview and initial experience at the Vanderbilt Spine Center.

PubMed

McGirt, Matthew J; Speroff, Theodore; Godil, Saniya Siraj; Cheng, Joseph S; Selden, Nathan R; Asher, Anthony L

2013-01-01

In terms of policy, research, quality improvement, and practice-based learning, there are essential principles--namely, quality, effectiveness, and value of care--needed to navigate changes in the current and future US health care environment. Patient-centered outcome measurement lies at the core of all 3 principles. Multiple measures of disease-specific disability, generic health-related quality of life, and preference-based health state have been introduced to quantify disease impact and define effectiveness of care. This paper reviews the basic principles of patient outcome measurement and commonly used outcome instruments. The authors provide examples of how utilization of outcome measurement tools in everyday neurosurgical practice can facilitate practice-based learning, quality improvement, and real-world comparative effectiveness research, as well as promote the value of neurosurgical care.

Patient-reported outcomes in borderline personality disorder.

PubMed

Hasler, Gregor; Hopwood, Christopher J; Jacob, Gitta A; Brändle, Laura S; Schulte-Vels, Thomas

2014-06-01

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes.

Development of a spanish version of the Schwartz Outcome Scale-10: a brief mental health outcome measure.

PubMed

Rivas-Vazquez, R A; Rivas-Vazquez, A; Blais, M A; Rey, G J; Rivas-Vasquez, F; Jacobo, M; Carrazana, E J

2001-12-01

The lack of culturally appropriate psychometric instruments for the assessment of cognitive and emotional functioning in minority populations has been a concern often discussed in the assessment literature. With the increased focus on the measurement of outcome in mental health treatment, the lack of appropriate instruments for minorities has become readily apparent in this venue as well. We report on the Spanish translation of a brief and reliable measure of psychological health and well-being that has been shown to be sensitive to treatment outcomes. The original and Spanish translated versions of this measure are highly correlated, providing clinicians and organizations with a instrument that can be used for assessment of psychological well-being and treatment outcomes with Hispanic patients.

Standardized Reporting of the Eczema Area and Severity Index (EASI) and the Patient-Oriented Eczema Measure (POEM): A Recommendation by the Harmonising Outcome Measures for Eczema (HOME) Initiative.

PubMed

Grinich, E; Schmitt, J; Küster, D; Spuls, P I; Williams, H C; Chalmers, J R; Thomas, K S; Apfelbacher, C; Prinsen, C A C; Furue, M; Stuart, B; Carter, B; Simpson, E

2018-05-10

Several organizations from multiple fields of medicine are setting standards for clinical research including protocol development, 1 harmonization of outcome reporting, 2 statistical analysis, 3 quality assessment 4 and reporting of findings. 1 Clinical research standardization facilitates the interpretation and synthesis of data, increases the usability of trial results for guideline groups and shared decision-making, and reduces selective outcome reporting bias. The mission of the Harmonising Outcome Measures for Eczema (HOME) initiative is to establish an agreed-upon core set of outcomes to be measured and reported in all clinical trials of atopic dermatitis (AD). This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

Outcomes measurement in hospitals: can the system change the organization?

PubMed

Linder, J C

1992-01-01

The U.S. health care industry is in crisis--a crisis of accountability. Many believe that improved information, especially outcomes information, is at least part of the solution. If this assessment is accurate, outcomes measurement could offer a powerful opportunity to help mold our dysfunctional health care machinery into an effective infrastructure. This article explores whether implementing an outcomes measurement system in a hospital compels this kind of change. It examines the experiences of 31 hospitals that implemented a market-leading outcomes measurement system. Despite its potential, MedisGroups did not compel important improvements in hospitals' quality of care or their internal practices. Hospitals found it particularly difficult to maintain momentum throughout implementation and to structure the system as a supporting tool, rather than a driving influence, in their pursuit of operating improvements.

Assessing medication effects in the MTA study using neuropsychological outcomes.

PubMed

Epstein, Jeffery N; Conners, C Keith; Hervey, Aaron S; Tonev, Simon T; Arnold, L Eugene; Abikoff, Howard B; Elliott, Glen; Greenhill, Laurence L; Hechtman, Lily; Hoagwood, Kimberly; Hinshaw, Stephen P; Hoza, Betsy; Jensen, Peter S; March, John S; Newcorn, Jeffrey H; Pelham, William E; Severe, Joanne B; Swanson, James M; Wells, Karen; Vitiello, Benedetto; Wigal, Timothy

2006-05-01

While studies have increasingly investigated deficits in reaction time (RT) and RT variability in children with attention deficit/hyperactivity disorder (ADHD), few studies have examined the effects of stimulant medication on these important neuropsychological outcome measures. 316 children who participated in the Multimodal Treatment Study of Children with ADHD (MTA) completed the Conners' Continuous Performance Test (CPT) at the 24-month assessment point. Outcome measures included standard CPT outcomes (e.g., errors of commission, mean hit reaction time (RT)) and RT indicators derived from an Ex-Gaussian distributional model (i.e., mu, sigma, and tau). Analyses revealed significant effects of medication across all neuropsychological outcome measures. Results on the Ex-Gaussian outcome measures revealed that stimulant medication slows RT and reduces RT variability. This demonstrates the importance of including analytic strategies that can accurately model the actual distributional pattern, including the positive skew. Further, the results of the study relate to several theoretical models of ADHD.

Toward spanning the quality chasm: an examination of team functioning measures.

PubMed

Strasser, Dale C; Burridge, Andrea Backscheider; Falconer, Judith A; Uomoto, Jay M; Herrin, Jeph

2014-11-01

To examine the effect of 5 measures of team functioning on patient outcomes. Observational, exploratory, measurement. Team functioning surveys and patient outcomes collected 1 year apart in a clinical trial were analyzed. The findings are discussed in context of the domains of team functioning, team effectiveness, and quality improvement. 27 Veterans Affairs medical centers. Staff (t1: N=356; t2: N=273) on inpatient teams and patients (t1: N=4266; t2: N=3213) treated by the teams. Not applicable. Five measures of team functioning (Physician Engagement, Shared Leadership, Supervisor Team Support, Teamness, and Team Effectiveness scales) and 3 measures of patient outcomes (functional improvement, discharge destination, and length of stay) were assessed at 2 time points with hierarchical generalized linear models to evaluate the association between team functioning measures and changes in patient outcomes. Associations (P<.05) between team functioning measures and patient outcomes were found for 3 of the 15 analyses over the study period. Higher Physician Engagement scale score was associated with lower length of stay (P=.017), and increased scores on Teamness and Team Effectiveness scales correlated with higher rates of community discharge (P=.044 and .049, respectively). This exploratory analysis revealed trends that team functioning corresponds with patient outcomes in clinically relevant patterns. An increase in community discharge and a decrease in length of stay were associated with higher scores of team functioning. Here, we find evidence that modifiable attributes of team functioning have a measurable effect on patient outcomes. Such findings are promising and support the need for further research on team effectiveness. Copyright © 2014 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.

Outcome Evaluation: Student Development Program, Special Studies Division, Cleveland State University.

ERIC Educational Resources Information Center

Pasch, Marvin

Techniques and procedures used to evaluate the outcomes of the student development program, and to use the evaluation results, are presented. Specific evaluation questions are posed that address overall outcomes, not individual student outcomes, and quantitative measures are suggested to accompany the questions. The measures include statistical…

Outcome-Reporting Bias in Education Research

ERIC Educational Resources Information Center

Pigott, Therese D.; Valentine, Jeffrey C.; Polanin, Joshua R.; Williams, Ryan T.; Canada, Dericka D.

2013-01-01

Outcome-reporting bias occurs when primary studies do not include information about all outcomes measured in a study. When studies omit findings on important measures, efforts to synthesize the research using systematic review techniques will be biased and interpretations of individual studies will be incomplete. Outcome-reporting bias has been…

Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review

PubMed Central

Pollard, Beth; Johnston, Marie; Dixon, Diane

2007-01-01

Subjective measures involving clinician ratings or patient self-assessments have become recognised as an important tool for the assessment of health outcome. The value of a health outcome measure is usually assessed by a psychometric evaluation of its reliability, validity and responsiveness. However, psychometric testing involves an accumulation of evidence and has recognised limitations. It has been suggested that an evaluation of how well a measure has been developed would be a useful additional criteria in assessing the value of a measure. This paper explored the theoretical background and methodological development of subjective health status measures commonly used in osteoarthritis research. Fourteen subjective health outcome measures commonly used in osteoarthritis research were examined. Each measure was explored on the basis of their i) theoretical framework (was there a definition of what was being assessed and was it part of a theoretical model?) and ii) methodological development (what was the scaling strategy, how were the items generated and reduced, what was the response format and what was the scoring method?). Only the AIMS, SF-36 and WHOQOL defined what they were assessing (i.e. the construct of interest) and no measure assessed was part of a theoretical model. None of the clinician report measures appeared to have implemented a scaling procedure or described the rationale for the items selected or scoring system. Of the patient self-report measures, the AIMS, MPQ, OXFORD, SF-36, WHOQOL and WOMAC appeared to follow a standard psychometric scaling method. The DRP and EuroQol used alternative scaling methods. The review highlighted the general lack of theoretical framework for both clinician report and patient self-report measures. This review also drew attention to the wide variation in the methodological development of commonly used measures in OA. While, in general the patient self-report measures had good methodological development, the clinician report measures appeared less well developed. It would be of value if new measures defined the construct of interest and, that the construct, be part of theoretical model. By ensuring measures are both theoretically and empirically valid then improvements in subjective health outcome measures should be possible. PMID:17343739

Definition of delayed cerebral ischemia after aneurysmal subarachnoid hemorrhage as an outcome event in clinical trials and observational studies: proposal of a multidisciplinary research group.

PubMed

Vergouwen, Mervyn D I; Vermeulen, Marinus; van Gijn, Jan; Rinkel, Gabriel J E; Wijdicks, Eelco F; Muizelaar, J Paul; Mendelow, A David; Juvela, Seppo; Yonas, Howard; Terbrugge, Karel G; Macdonald, R Loch; Diringer, Michael N; Broderick, Joseph P; Dreier, Jens P; Roos, Yvo B W E M

2010-10-01

In clinical trials and observational studies there is considerable inconsistency in the use of definitions to describe delayed cerebral ischemia (DCI) after aneurysmal subarachnoid hemorrhage. A major cause for this inconsistency is the combining of radiographic evidence of vasospasm with clinical features of cerebral ischemia, although multiple factors may contribute to DCI. The second issue is the variability and overlap of terms used to describe each phenomenon. This makes comparisons among studies difficult. An international ad hoc panel of experts involved in subarachnoid hemorrhage research developed and proposed a definition of DCI to be used as an outcome measure in clinical trials and observational studies. We used a consensus-building approach. It is proposed that in observational studies and clinical trials aiming to investigate strategies to prevent DCI, the 2 main outcome measures should be: (1) cerebral infarction identified on CT or MRI or proven at autopsy, after exclusion of procedure-related infarctions; and (2) functional outcome. Secondary outcome measure should be clinical deterioration caused by DCI, after exclusion of other potential causes of clinical deterioration. Vasospasm on angiography or transcranial Doppler can also be used as an outcome measure to investigate proof of concept but should be interpreted in conjunction with DCI or functional outcome. The proposed measures reflect the most relevant morphological and clinical features of DCI without regard to pathogenesis to be used as an outcome measure in clinical trials and observational studies.

EFFECT OF QUALITY CHRONIC DISEASE MANAGEMENT FOR ALCOHOL AND DRUG DEPENDENCE ON ADDICTION OUTCOMES

PubMed Central

Kim, Theresa W.; Saitz, Richard; Cheng, Debbie M.; Winter, Michael R; Witas, Julie; Samet, Jeffrey H.

2012-01-01

We examinedthe effect ofthe quality of primary care-basedchronic disease management (CDM)for alcohol and/or other drug (AOD) dependenceonaddiction outcomes.We assessed qualityusing 1)avisit frequencybased measure and 2) a self-reported assessment measuring alignment with the chronic care model. The visit frequency based measure had no significant association with addiction outcomes. Theself-reported measure of care - when care was at a CDM clinic - was associated with lower drug addiction severity.The self-reported assessment of care from any healthcare source (CDM clinic or elsewhere)was associated with lower alcoholaddiction severity and abstinence.These findings suggest that high quality CDM for AOD dependence may improve addiction outcomes.Quality measuresbased upon alignment with the chronic care model may better capture features of effective CDM care than a visitfrequency measure. PMID:22840687

Mismatch negativity is a stronger indicator of functional outcomes than neurocognition or theory of mind in patients with schizophrenia.

PubMed

Lee, Seung-Hwan; Sung, Kyongae; Lee, Kyong-Sang; Moon, Eunok; Kim, Chang-Gyu

2014-01-03

Mismatch negativity (MMN) is known to be associated with neurocognition, social cognition, and functional outcomes. The present study explored the relationships of MMN with neurocognition, theory of mind, and functional outcomes in patients with schizophrenia, first-degree relatives of patients with schizophrenia, and healthy controls. Twenty-five patients with schizophrenia, 21 first-degree relatives of patients with schizophrenia, and 29 healthy controls were recruited. We examined symptom severity, neurocognition, theory of mind, functional outcomes, and MMN. MMN amplitudes decreased in order of patients with schizophrenia, then first-degree relatives, then healthy controls. MMN amplitude was significantly correlated with measures of neurocognition, theory of mind, and functional outcome measurements in patients with schizophrenia. However, the most powerful correlations were those between MMN in the frontal region and measures of functional outcomes. The power and frequency of the correlations were weaker in first-degree relatives and healthy controls than in patients with schizophrenia. Hierarchical regression analysis revealed that functional outcomes (relative to measures of neurocognition and theory of mind) constituted the most powerful predictor of MMN. Our results suggest that MMN reflects functional outcomes more efficiently than do measures of neurocognition and theory of mind in patients with schizophrenia. © 2013.

Racial disparities in African Americans with diabetes: process and outcome mismatch.

PubMed

Bulger, John B; Shubrook, Jay H; Snow, Richard

2012-08-01

Over the past 2 decades, numerous studies have demonstrated the existence of racial disparities in patient care in the United States. Specifically, African Americans with diabetes are less likely to have recommended process of care measures performed and outcome benchmarks for quality of care. To evaluate the delivery of diabetes care (processes and outcomes) associated with racial categories using a national web-based registry-the American Osteopathic Association Clinical Assessment Program (AOA-CAP). A retrospective analysis of data retrieved from the AOA-CAP database on outcomes and process measures for diabetes. A total of 10,699 Caucasian and African American patients who received diabetes care had data entered into the AOA-CAP registry between July 1, 2005, and October 30, 2010. African Americans represented 3123 patients (29%), Caucasians 7576 (71%). Demographic, process of care, and outcomes comparisons between ethnicities were carried out using ?2 and t tests. Composite measures of process and outcomes of diabetes care were created to investigate the effect of race on care. The process of care composite measure was significantly different among African American patients (P = .02) who were more likely to receive all indicated care than Caucasian patients (33.9% vs 31.6%). Evaluation of the composite outcome measure, which quantifies the percentage of patients achieving control of all 3 intermediate outcomes, was (P <.001) lower in African Americans than in Caucasians (8.1% vs 12.3%). African American patients with diabetes were as likely or more likely to have recommended process of care measures performed. In spite of this, intermediate diabetes outcomes were still poorer in the same African American population.

Creation of a core outcome set for clinical trials of people with shoulder pain: a study protocol.

PubMed

Gagnier, Joel J; Page, Matthew J; Huang, Hsiaomin; Verhagen, Arianne P; Buchbinder, Rachelle

2017-07-20

The selection of appropriate outcomes or domains is crucial when designing clinical trials, to appreciate the effects of different interventions, pool results, and make valid comparisons between trials. If the findings are to influence policy and practice, then the chosen outcomes need to be relevant and important to key stakeholders, including patients and the public, healthcare professionals and others making decisions about health care. There is a growing recognition that insufficient attention has been paid to the outcomes measured in clinical trials. Recent reviews of the measurement properties of patient-reported outcome measures for shoulder disorders revealed a large selection of diverse measures, many with questionable validity, reliability, and responsiveness. These issues could be addressed through the development and use of an agreed standardized collection of outcomes, known as a core outcome set (COS), which should be measured and reported in all trials of shoulder disorders. The purpose of the present project is to develop and disseminate a COS for clinical trials in shoulder disorders. The methods for the COS development will include 3 phases: (1) a comprehensive review of the core domains used in shoulder disorder trials; (2) an international Delphi study involving relevant stakeholders (patients, clinicians, scientists) to define which domains should be core; and (3) an international focus group informed by the evidence identified in phases 1 and 2, to determine which measurement instruments best measure the core domains and identification of any evidence gaps that require further empiric evidence. The aim of the current proposal is to convene several meetings of international experts and patients to develop a COS for clinical trials of shoulder disorders and to develop an implementation strategy to ensure rapid uptake of the core set of outcomes in clinical trials. There would be an expectation that the core set of outcomes would always be collected and reported, but it would not preclude use of additional outcomes in a particular trial.

Cost-effectiveness with multiple outcomes.

PubMed

Bjørner, Jakob; Keiding, Hans

2004-12-01

In a large number of situations, activities in health care have to be measured in terms of outcome and cost. However, the cases where outcome is fully captured by a single measure are rather few, so that one uses some index for outcome, computed by weighing together several outcome measures using subjective and somewhat arbitrary weights. In the paper we propose an approach to cost-effectiveness analysis where such artificial aggregation is avoided. This is achieved by assigning to each activity the weights which are the most favourable in a comparison with the other options available, so that activities which have a poor score in this method are guaranteed to be inferior. The method corresponds to applying Data envelopment analysis, known from the theory of productivity, to the context of health economic evaluations. The method is applied to an analysis of the cost-effectiveness of alternative health plans using data from the Medical Outcome Study (JAMA 1996; 276: 1039-1047), where outcome is measured as improvement in mental and physical health. 2004 John Wiley & Sons, Ltd.

Quantum reversibility is relative, or does a quantum measurement reset initial conditions?

PubMed

Zurek, Wojciech H

2018-07-13

I compare the role of the information in classical and quantum dynamics by examining the relation between information flows in measurements and the ability of observers to reverse evolutions. I show that in the Newtonian dynamics reversibility is unaffected by the observer's retention of the information about the measurement outcome. By contrast-even though quantum dynamics is unitary, hence, reversible-reversing quantum evolution that led to a measurement becomes, in principle, impossible for an observer who keeps the record of its outcome. Thus, quantum irreversibility can result from the information gain rather than just its loss-rather than just an increase of the (von Neumann) entropy. Recording of the outcome of the measurement resets, in effect, initial conditions within the observer's (branch of) the Universe. Nevertheless, I also show that the observer's friend-an agent who knows what measurement was successfully carried out and can confirm that the observer knows the outcome but resists his curiosity and does not find out the result-can, in principle, undo the measurement. This relativity of quantum reversibility sheds new light on the origin of the arrow of time and elucidates the role of information in classical and quantum physics. Quantum discord appears as a natural measure of the extent to which dissemination of information about the outcome affects the ability to reverse the measurement.This article is part of a discussion meeting issue 'Foundations of quantum mechanics and their impact on contemporary society'. © 2018 The Author(s).

Lest we forget: comparing retrospective and prospective assessments of adverse childhood experiences in the prediction of adult health.

PubMed

Reuben, Aaron; Moffitt, Terrie E; Caspi, Avshalom; Belsky, Daniel W; Harrington, Honalee; Schroeder, Felix; Hogan, Sean; Ramrakha, Sandhya; Poulton, Richie; Danese, Andrea

2016-10-01

Adverse childhood experiences (ACEs; e.g. abuse, neglect, and parental loss) have been associated with increased risk for later-life disease and dysfunction using adults' retrospective self-reports of ACEs. Research should test whether associations between ACEs and health outcomes are the same for prospective and retrospective ACE measures. We estimated agreement between ACEs prospectively recorded throughout childhood (by Study staff at Study member ages 3, 5, 7, 9, 11, 13, and 15) and retrospectively recalled in adulthood (by Study members when they reached age 38), in the population-representative Dunedin cohort (N = 1,037). We related both retrospective and prospective ACE measures to physical, mental, cognitive, and social health at midlife measured through both objective (e.g. biomarkers and neuropsychological tests) and subjective (e.g. self-reported) means. Dunedin and U.S. Centers for Disease Control ACE distributions were similar. Retrospective and prospective measures of adversity showed moderate agreement (r = .47, p < .001; weighted Kappa = .31, 95% CI: .27-.35). Both associated with all midlife outcomes. As compared to prospective ACEs, retrospective ACEs showed stronger associations with life outcomes that were subjectively assessed, and weaker associations with life outcomes that were objectively assessed. Recalled ACEs and poor subjective outcomes were correlated regardless of whether prospectively recorded ACEs were evident. Individuals who recalled more ACEs than had been prospectively recorded were more neurotic than average, and individuals who recalled fewer ACEs than recorded were more agreeable. Prospective ACE records confirm associations between childhood adversity and negative life outcomes found previously using retrospective ACE reports. However, more agreeable and neurotic dispositions may, respectively, bias retrospective ACE measures toward underestimating the impact of adversity on objectively measured life outcomes and overestimating the impact of adversity on self-reported outcomes. Associations between personality factors and the propensity to recall adversity were extremely modest and warrant further investigation. Risk predictions based on retrospective ACE reports should utilize objective outcome measures. Where objective outcome measurements are difficult to obtain, correction factors may be warranted. © 2016 Association for Child and Adolescent Mental Health.

Lest we forget: Comparing retrospective and prospective assessments of adverse childhood experiences in the prediction of adult health

PubMed Central

Reuben, Aaron; Moffitt, Terrie E.; Caspi, Avshalom; Belsky, Daniel W.; Harrington, Honalee; Schroeder, Felix; Hogan, Sean; Ramrakha, Sandhya; Poulton, Richie; Danese, Andrea

2017-01-01

Background Adverse childhood experiences (ACEs; e.g., abuse, neglect, parental loss, etc.) have been associated with increased risk for later-life disease and dysfunction using adults’ retrospective self-reports of ACEs. Research should test whether associations between ACEs and health outcomes are the same for prospective and retrospective ACE measures. Methods We estimated agreement between ACEs prospectively-recorded throughout childhood (by Study staff at Study member ages 3, 5, 7, 9, 11, 13, and 15) and retrospectively-recalled in adulthood (by Study members when they reached age 38), in the population-representative Dunedin cohort (N=1,037). We related both retrospective and prospective ACE measures to physical, mental, cognitive, and social health at midlife measured through both objective (e.g., biomarkers and neuropsychological tests) and subjective (e.g., self-reported) means. Results Dunedin and CDC ACE distributions were similar. Retrospective and prospective measures of adversity showed moderate agreement (r=.47, p<.001; weighted Kappa = .31, 95% CI: .27–.35). Both associated with all midlife outcomes. As compared to prospective ACEs, retrospective ACEs showed stronger associations with life outcomes that were subjectively assessed, and weaker associations with life outcomes that were objectively assessed. Recalled ACEs and poor subjective outcomes were correlated regardless of whether prospectively-recorded ACEs were evident. Individuals who recalled more ACEs than had been prospectively recorded were more neurotic than average, and individuals who recalled fewer ACEs than recorded were more agreeable. Conclusions Prospective ACE records confirm associations between childhood adversity and negative life outcomes found previously using retrospective ACE reports. However, more agreeable and neurotic dispositions may respectively bias retrospective ACE measures toward underestimating the impact of adversity on objectively-measured life outcomes and overestimating the impact of adversity on self-reported outcomes. Associations between personality factors and the propensity to recall adversity were extremely modest and warrant further investigation. Risk predictions based on retrospective ACE reports should utilize objective outcome measures. Where objective outcome measurements are difficult to obtain, correction factors may be warranted. PMID:27647050

Core outcome measures for interventions to prevent or slow the progress of dementia for people living with mild to moderate dementia: Systematic review and consensus recommendations

PubMed Central

Groskreutz, Derek; Grinbergs-Saull, Anna; Howard, Rob; O’Brien, John T.; Mountain, Gail; Woods, Bob; Perneczky, Robert; McCleery, Jenny; Pickett, James; Challis, David; Charlesworth, Georgina; Featherstone, Katie; Jones, Roy; Schneider, Justine; Shepperd, Sasha; Thompson-Coon, Jo; Ballard, Clive; Burns, Alistair; Garrard, Peter; Kehoe, Patrick; Passmore, Peter; Robinson, Louise

2017-01-01

Background There are no disease-modifying treatments for dementia. There is also no consensus on disease modifying outcomes. We aimed to produce the first evidence-based consensus on core outcome measures for trials of disease modification in mild-to-moderate dementia. Methods and findings We defined disease-modification interventions as those aiming to change the underlying pathology. We systematically searched electronic databases and previous systematic reviews for published and ongoing trials of disease-modifying treatments in mild-to-moderate dementia. We included 149/22,918 of the references found; with 81 outcome measures from 125 trials. Trials involved participants with Alzheimer’s disease (AD) alone (n = 111), or AD and mild cognitive impairment (n = 8) and three vascular dementia. We divided outcomes by the domain measured (cognition, activities of daily living, biological markers, neuropsychiatric symptoms, quality of life, global). We calculated the number of trials and of participants using each outcome. We detailed psychometric properties of each outcome. We sought the views of people living with dementia and family carers in three cities through Alzheimer’s society focus groups. Attendees at a consensus conference (experts in dementia research, disease-modification and harmonisation measures) decided on the core set of outcomes using these results. Recommended core outcomes were cognition as the fundamental deficit in dementia and to indicate disease modification, serial structural MRIs. Cognition should be measured by Mini Mental State Examination or Alzheimer's Disease Assessment Scale-Cognitive Subscale. MRIs would be optional for patients. We also made recommendations for measuring important, but non-core domains which may not change despite disease modification. Limitations Most trials were about AD. Specific instruments may be superseded. We searched one database for psychometric properties. Interpretation This is the first review to identify the 81 outcome measures the research community uses for disease-modifying trials in mild-to-moderate dementia. Our recommendations will facilitate designing, comparing and meta-analysing disease modification trials in mild-to-moderate dementia, increasing their value. Trial registration PROSPERO no. CRD42015027346. PMID:28662127

Effectiveness of IT-based diabetes management interventions: a review of the literature.

PubMed

Costa, Beth M; Fitzgerald, Kristine J; Jones, Kay M; Dunning Am, Trisha

2009-11-17

Information technology (IT) is increasingly being used in general practice to manage health care including type 2 diabetes. However, there is conflicting evidence about whether IT improves diabetes outcomes. This review of the literature about IT-based diabetes management interventions explores whether methodological issues such as sample characteristics, outcome measures, and mechanisms causing change in the outcome measures could explain some of the inconsistent findings evident in IT-based diabetes management studies. Databases were searched using terms related to IT and diabetes management. Articles eligible for review evaluated an IT-based diabetes management intervention in general practice and were published between 1999 and 2009 inclusive in English. Studies that did not include outcome measures were excluded. Four hundred and twenty-five articles were identified, sixteen met the inclusion criteria: eleven GP focussed and five patient focused interventions were evaluated. Nine were RCTs, five non-randomised control trials, and two single-sample before and after designs. Important sample characteristics such as diabetes type, familiarity with IT, and baseline diabetes knowledge were not addressed in any of the studies reviewed. All studies used HbA1c as a primary outcome measure, and nine reported a significant improvement in mean HbA1c over the study period; only two studies reported the HbA1c assay method. Five studies measured diabetes medications and two measured psychological outcomes. Patient lifestyle variables were not included in any of the studies reviewed. IT was the intervention method considered to effect changes in the outcome measures. Only two studies mentioned alternative possible causal mechanisms. Several limitations could affect the outcomes of IT-based diabetes management interventions to an unknown degree. These limitations make it difficult to attribute changes solely to such interventions.

Patient-reported outcomes in obsessive-compulsive disorder

PubMed Central

Subramaniam, Mythily; Soh, Pauline; Ong, Clarissa; Esmond Seow, Lee Seng; Picco, Louisa; Vaingankar, Janhavi Ajit; Chong, Siow Ann

2014-01-01

The purpose of the article was to provide an overview of patient-reported outcomes (PROs) and related measures that have been examined in the context of obsessive-compulsive disorder (OCD). The current review focused on patient-reported outcome measures (PROMs) that evaluated three broad outcome domains: functioning, health-related quality of life (HRQoL), and OCD-related symptoms. The present review ultimately included a total of 155 unique articles and 22 PROMs. An examination of the PROs revealed that OCD patients tend to suffer from significant functional disability, and report lower HRQoL than controls. OCD patients report greater symptom severity than patients with other mental disorders and evidence indicates that PROMs are sensitive to change and may be even better than clinician-rated measures at predicting treatment outcomes. Nonetheless, it should be noted that the measures reviewed lacked patient input in their development. Future research on PROMs must involve patient perspectives and include rigorous psychometric evaluation of these measures. PMID:25152661

The effect of measuring serum doxycycline concentrations on clinical outcomes during treatment of chronic Q fever.

PubMed

van Roeden, S E; Bleeker-Rovers, C P; Kampschreur, L M; de Regt, M J A; Vermeulen Windsant, A; Hoepelman, A I M; Wever, P C; Oosterheert, J J

2018-04-01

First choice treatment for chronic Q fever is doxycycline plus hydroxychloroquine. Serum doxycycline concentration (SDC) >5 μg/mL has been associated with a favourable serological response, but the effect on clinical outcomes is unknown. To assess the effect of measuring SDC during treatment of chronic Q fever on clinical outcomes. We performed a retrospective cohort study, to assess the effect of measuring SDC on clinical outcomes in patients treated with doxycycline and hydroxychloroquine for chronic Q fever. Primary outcome was the first disease-related event (new complication or chronic Q fever-related mortality); secondary outcomes were all-cause mortality and PCR-positivity. Multivariable analysis was performed with a Cox proportional hazards model, with shared-frailty terms for different hospitals included. We included 201 patients (mean age 68 years, 83% male): in 167 patients (83%) SDC was measured, 34 patients (17%) were treated without SDC measurement. First SDC was >5 μg/mL in 106 patients (63%), all with 200 mg doxycycline daily. In patients with SDC measured, dosage was adjusted in 41% (n = 68), concerning an increase in 64 patients. Mean SDC was 4.1 μg/mL before dosage increase, and 5.9 μg/mL afterwards. SDC measurement was associated with a lower risk for disease-related events (HR 0.51, 95% CI 0.26-0.97, P = 0.04), but not with all-cause mortality or PCR-positivity. SDC measurement decreases the risk for disease-related events, potentially through more optimal dosing or improved compliance. We recommend measurement of SDC and striving for SDC >5 μg/mL and <10 μg/mL during treatment of chronic Q fever.

A systematic review finds limited data on measurement properties of instruments measuring outcomes in adult intensive care unit survivors.

PubMed

Robinson, Karen A; Davis, Wesley E; Dinglas, Victor D; Mendez-Tellez, Pedro A; Rabiee, Anahita; Sukrithan, Vineeth; Yalamanchilli, Ramakrishna; Turnbull, Alison E; Needham, Dale M

2017-02-01

There is a growing number of studies evaluating the physical, cognitive, mental health, and health-related quality of life (HRQOL) outcomes of adults surviving critical illness. However, there is little consensus on the most appropriate instruments to measure these outcomes. To inform the development of such consensus, we conducted a systematic review of the performance characteristics of instruments measuring physical, cognitive, mental health, and HRQOL outcomes in adult intensive care unit (ICU) survivors. We searched PubMed, Embase, PsycInfo, Cumulative Index of Nursing and Allied Health Literature, and The Cochrane Library in March 2015. We also conducted manual searches of reference lists of eligible studies and relevant review articles. Two people independently selected studies, completed data abstraction, and assessed the quality of eligible studies using the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) initiative checklist. We identified 20 studies which explicitly evaluated measurement properties for 21 different instruments assessing outcomes in ICU survivors. Eleven of the instruments assessed quality of life, with few instruments assessing other domains. Of the nine measurement properties evaluated on the COSMIN checklist, six were assessed in <10% of the evaluations. Overall quality of eligible studies was generally poor to fair based on the COSMIN checklist. Although an increasing number of studies measure physical, cognitive, mental health, and HRQOL outcomes in adult ICU survivors, data on the measurement properties of such instruments are sparse and generally of poor to fair quality. Empirical analyses evaluating the performance of instruments in adult ICU survivors are needed to advance research in this field. Copyright © 2016 Elsevier Inc. All rights reserved.

Application of WHO recommendations in outcome assessment of clinical series published in hand surgery journals with five years interval.

PubMed

Alarab, H; Dubert, T

2015-02-01

Outcome measurement is becoming increasingly important in hand surgery. The International classification of functioning, disability and health (ICF), is a WHO multi-dimensional approach to health condition including three domains: body "functions and structures", activities and participation. The aim of this study was to measure how often these three ICF domains were included in outcome measurements of the clinical series published in the American, European and French hand surgery journals. Our study included clinical series published in 2007 and 2012 in the American Journal Of Hand Surgery, European Journal Of Hand Surgery and Chirurgie de la Main. Analysis of each of these publications was done in two steps. First, we checked the presence or absence of the three domains of ICF in outcome measurement without considering the way it was measured. Then, we reported the use of evaluation instruments and/or quantitative measurement for each domain. We included 54 series in 2007 and 119 in 2012. The number of series reporting on the three domains and using at least one quantitative measurement for each domain represents 6% of articles in 2007 and 10% in 2012. This study shows that the quality of outcome measurement has improved over these 5 years, but remains poor according to the ICF recommendation. Copyright © 2015 Elsevier Masson SAS. All rights reserved.

Patient Reported Outcomes in Preoperative and Postoperative Patients with Hypospadias.

PubMed

Keays, Melise A; Starke, Nathan; Lee, Simon C; Bernstein, Ira; Snodgrass, Warren T; Bush, Nicol C

2016-04-01

Current outcome tools for hypospadias have limited focus on the caregiver or patient perspective of important patient centered outcomes. In this study we collaborated with patients, caregivers, and lay and medical experts to develop and pilot a patient reported outcome measure for hypospadias. We developed a patient reported outcome measure based on systematic review of the literature and focus group input. The patient reported outcome measure was piloted in caregivers for boys younger than 8 years and in patients older than 8 years who presented for urology consultation before meeting with the surgeon. Patients were classified with uncorrected hypospadias, successful repair or failed repair based on the presence or absence of complications (fistula, diverticulum, meatal stenosis/stricture, greater than 30-degree recurrent curvature, glans dehiscence and/or skin reoperation). A patient reported outcome measure was developed and administered to 347 patients and/or caregivers-proxies, including 105 uncorrected cases, 162 successful repair cases and 80 failed cases. Satisfaction with appearance was highest in those with successful hypospadias repair compared to failed repair and uncorrected hypospadias (93% vs 77% and 67%, respectively). Voiding symptoms such as spraying or a deviated stream were highest in failed and uncorrected cases (39% and 37%, respectively). Overall dissatisfaction with voiding was highest for uncorrected hypospadias and failed repair compared to successful cases (54% and 47%, respectively, vs 15%). The evaluation of patient and caregiver-proxy reported outcomes in preoperative and postoperative patients with hypospadias allows for the quantification of benefits derived from hypospadias repair and may ultimately represent the gold standard outcome measure for hypospadias. This pilot study identified preliminary patient centered themes and demonstrated the feasibility of administering hypospadias patient reported outcome measures in clinical practice. Copyright © 2016 American Urological Association Education and Research, Inc. Published by Elsevier Inc. All rights reserved.

Physical outcome measures for conductive and mixed hearing loss treatment: A systematic review.

PubMed

Johansson, M L; Tysome, J R; Hill-Feltham, P; Hodgetts, W E; Ostevik, A; McKinnon, B J; Monksfield, P; Sockalingam, R; Wright, T

2018-05-07

The number of potential options for rehabilitation of patients with conductive or mixed hearing loss is continually expanding. To be able to inform patients and other stakeholders there is a need to identify and develop patient-centred outcomes for treatment of hearing loss. To identify outcome measures in the physical core area used when reporting the outcome after treatment of conductive and mixed hearing loss in adult patients. Systematic review. Systematic review of literature related to reported physical outcome measures after treatment of mixed or conductive hearing loss without restrictions regarding type of intervention, treatment or device. Any measure reporting the physical outcome after treatment or intervention of mixed or conductive hearing loss was sought and categorised. The physical outcomes measures that had been extracted were then grouped into domains. The literature search resulted in the identification of 1,434 studies, of which 153 were selected for inclusion in the review. The majority (57%) of papers reported results from middle ear surgery, with the remainder reporting results from either bone conduction hearing devices or middle ear implants. Outcomes related to complications were categorised into 17 domains, whereas outcomes related to treatment success was categorised in 22 domains. The importance of these domains to patients and other stakeholders needs to be further explored in order to establish which of these domains are most relevant to interventions for conductive or mixed hearing loss. This will allow us to then assess which outcomes measures are most suitable for inclusion in the core set This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

A Consensus Set of Outcomes for Parkinson’s Disease from the International Consortium for Health Outcomes Measurement

PubMed Central

de Roos, Paul; Bloem, Bastiaan R.; Kelley, Thomas A.; Antonini, Angelo; Dodel, Richard; Hagell, Peter; Marras, Connie; Martinez-Martin, Pablo; Mehta, Shyamal H.; Odin, Per; Chaudhuri, Kallol Ray; Weintraub, Daniel; Wilson, Bil; Uitti, Ryan J.

2017-01-01

Background Parkinson’s disease (PD) is a progressive neurodegenerative condition that is expected to double in prevalence due to demographic shifts. Value-based healthcare is a proposed strategy to improve outcomes and decrease costs. To move towards an actual value-based health care system, condition-specific outcomes that are meaningful to patients are essential. Objective Propose a global consensus standard set of outcome measures for PD. Methods Established methods for outcome measure development were applied, as outlined and used previously by the International Consortium for Health Outcomes Measurement (ICHOM). An international group, representing both patients and experts from the fields of neurology, psychiatry, nursing, and existing outcome measurement efforts, was convened. The group participated in six teleconferences over a six-month period, reviewed existing data and practices, and ultimately proposed a standard set of measures by which patients should be tracked, and how often data should be collected. Results The standard set applies to all cases of idiopathic PD, and includes assessments of motor and non-motor symptoms, ability to work, PD-related health status, and hospital admissions. Baseline demographic and clinical variables are included to enable case mix adjustment. Conclusions The Standard Set is now ready for use and pilot testing in the clinical setting. Ultimately, we believe that using the set of outcomes proposed here will allow clinicians and scientists across the world to document, report, and compare PD-related outcomes in a standardized fashion. Such international benchmarks will improve our understanding of the disease course and allow for identification of ‘best practices’, ultimately leading to better informed treatment decisions. PMID:28671140

Outcomes assessment in rotator cuff pathology: what are we measuring?

PubMed

Makhni, Eric C; Steinhaus, Michael E; Morrow, Zachary S; Jobin, Charles M; Verma, Nikhil N; Cole, Brian J; Bach, Bernard R

2015-12-01

Assessments used to measure outcomes associated with rotator cuff pathology and after repair are varied. This lack of standardization leads to difficulty drawing comparisons across studies. We hypothesize that this variability in patient-reported outcome measures and objective metrics used in rotator cuff studies persists even in high-impact, peer reviewed journals. All studies assessing rotator cuff tear and repair outcomes in 6 orthopedic journals with a high impact factor from January 2010 to December 2014 were reviewed. Cadaveric and animal studies and those without outcomes were excluded. Outcome measures included range of motion (forward elevation, abduction, external rotation, and internal rotation), strength (in the same 4 planes), tendon integrity imaging, patient satisfaction, and functional assessment scores. Of the 156 included studies, 63% documented range of motion measurements, with 18% reporting range of motion in all 4 planes. Only 38% of studies reported quantitative strength measurements. In 65% of studies, tendon integrity was documented with imaging (38% magnetic resonance imaging/magnetic resonance anrhrogram, 31% ultrasound, and 8% computed tomography arthrogram). Finally, functional score reporting varied significantly, with the 5 most frequently reported scores ranging from 16% to 61% in studies, and 15 of the least reported outcomes were each reported in ≤6% of studies. Significant variability exists in outcomes reporting after rotator cuff tear and repair, making comparisons between clinical studies difficult. Creating a uniformly accepted, validated outcomes tool that assesses pain, function, patient satisfaction, and anatomic integrity would enable consistent outcomes assessment after operative and nonoperative management and allow comparisons across the literature. Copyright © 2015 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

Post-injury personality in the prediction of outcome following severe acquired brain injury.

PubMed

Cattran, Charlotte Jane; Oddy, Michael; Wood, Rodger Llewellyn; Moir, Jane Frances

2011-01-01

The aim of the study was to examine the utility of five measures of non-cognitive neurobehavioural (NCNB) changes that often occur following acquired brain injury, in predicting outcome (measured in terms of participation and social adaptation) at 1-year follow-up. The study employed a longitudinal, correlational design. Multiple regression was employed to investigate the value of five new NCNB measures of social perception, emotional regulation, motivation, impulsivity and disinhibition in the prediction of outcome as measured by the Mayo-Portland Adaptability Inventory (MPAI). Two NCNB measures (motivation and emotional regulation) were found to significantly predict outcome at 1-year follow-up, accounting for 53% of the variance in MPAI total scores. These measures provide a method of quantifying the extent of NCNB changes following brain injury. The predictive value of the measures indicates that they may represent a useful tool which could aid clinicians in identifying early-on those whose symptoms are likely to persist and who may require ongoing intervention. This could facilitate the planning of rehabilitation programmes.

Association between changes on the Negative Symptom Assessment scale (NSA-16) and measures of functional outcome in schizophrenia.

PubMed

Velligan, Dawn I; Alphs, Larry; Lancaster, Scott; Morlock, Robert; Mintz, Jim

2009-09-30

We examined whether changes in negative symptoms, as measured by scores on the 16-item Negative Symptom Assessment scale (NSA-16), were associated with changes in functional outcome. A group of 125 stable outpatients with schizophrenia were assessed at baseline and at 6 months using the NSA-16, the Brief Psychiatric Rating Scale, and multiple measures of functional outcome. Baseline adjusted regression coefficients indicated moderate correlations between negative symptoms and functional outcomes when baseline values of both variables were controlled. Results were nearly identical when we controlled for positive symptoms. Cross-lag panel correlations and Structural Equation Modeling were used to examine whether changes in negative symptoms drove changes in functional outcomes over time. Results indicated that negative symptoms drove the changes in the Social and Occupational Functioning Scale (SOFAS) rather than the reverse. Measures of Quality of Life and measures of negative symptoms may be assessing overlapping constructs or changes in both may be driven by a third variable. Negative symptoms were unrelated over time to scores on a performance-based measure of functional capacity. This study indicates that the relationship between negative symptom change and the change in functional outcomes is complex, and points to potential issues in selection of assessments.

Food environments and dietary intakes among adults: does the type of spatial exposure measurement matter? A systematic review.

PubMed

Bivoltsis, Alexia; Cervigni, Eleanor; Trapp, Gina; Knuiman, Matthew; Hooper, Paula; Ambrosini, Gina Leslie

2018-06-09

The relationships between food environments and dietary intake have been assessed via a range of methodologically diverse measures of spatial exposure to food outlets, resulting in a largely inconclusive body of evidence, limiting informed policy intervention. This systematic review aims to evaluate the influence of methodological choice on study outcomes by examining the within-study effect of availability (e.g., counts) versus accessibility (e.g., proximity) spatial exposure measures on associations with diet. (PROSPERO registration: CRD42018085250). PubMed, Web of Science, Scopus and ScienceDirect databases were searched for empirical studies from 1980 to 2017, in the English language, involving adults and reporting on the statistical association between a dietary outcome and spatial exposure measures of both availability and accessibility. Studies were appraised using an eight-point quality criteria with a narrative synthesis of results. A total of 205 associations and 44 relationships (i.e., multiple measures of spatial exposure relating to a particular food outlet type and dietary outcome) were extracted from 14 eligible articles. Comparative measures were dominated by counts (availability) and proximity (accessibility). Few studies compared more complex measures and all counts were derived from place-based measures of exposure. Sixteen of the 44 relationships had a significant effect involving an availability measure whilst only 8 had a significant effect from an accessibility measure. The largest effect sizes in relationships were mostly for availability measures. After stratification by scale, availability measure had the greatest effect size in 139 of the 176 pairwise comparisons. Of the 33% (68/205) of associations that reached significance, 53/68 (78%) were from availability measures. There was no relationship between study quality and reported study outcomes. The limited evidence suggests that availability measures may produce significant and greater effect sizes than accessibility measures. However, both availability and accessibility measures may be important concepts of spatial exposure depending on the food outlet type and dietary outcome examined. More studies reporting on multi-method effects are required to differentiate findings by the type of spatial exposure assessment and build an evidence base regarding the appropriateness and robustness of measures under different circumstances.

Development and classification of a robust inventory of near real-time outcome measurements for assessing information technology interventions in health care.

PubMed

Colicchio, Tiago K; Del Fiol, Guilherme; Scammon, Debra L; Bowes, Watson A; Facelli, Julio C; Narus, Scott P

2017-09-01

To develop and classify an inventory of near real-time outcome measures for assessing information technology (IT) interventions in health care and assess their relevance as perceived by experts in the field. To verify the robustness and coverage of a previously published inventory of measures and taxonomy, we conducted semi-structured interviews with clinical and administrative leaders from a large care delivery system to collect suggestions of outcome measures that can be calculated with data available in electronic format for near real-time monitoring of EHR implementations. We combined these measures with the most commonly reported in the literature. We then conducted two online surveys with subject-matter experts to collect their perceptions of the relevance of the measures, and identify other potentially relevant measures. With input from experienced health care leaders and informaticists, we developed an inventory of 102 outcome measures. These measures were classified into a taxonomy of commonly used measures around the categories of quality, productivity, and safety. Safety measures were rated as most relevant by subject-matter experts, especially those measuring medication processes. Clinician satisfaction and measures assessing mean time to complete tasks and time spent on electronic documentation were also rated as highly relevant. By expanding the coverage of our previously published inventory and taxonomy, we expect to help providers, health IT vendors and researchers to more effectively and consistently monitor the impact of EHR implementations in near real-time, and report more standardized outcomes in future studies. We identified several measures not commonly assessed by previous studies of IT implementations, especially those of safety and productivity, which deserve more attention from the broader informatics community. Our inventory of measures and taxonomy will help researchers identify gaps in their measurement approaches and report more standardized measurements of IT interventions that could be shared among researchers, hopefully facilitating comparison across future studies and increasing our understanding of the impact of IT interventions in health care. Copyright © 2017 Elsevier Inc. All rights reserved.

Role of subdural electrocorticography in prediction of long-term seizure outcome in epilepsy surgery

PubMed Central

Juhász, Csaba; Shah, Aashit; Sood, Sandeep; Chugani, Harry T.

2009-01-01

Since prediction of long-term seizure outcome using preoperative diagnostic modalities remains suboptimal in epilepsy surgery, we evaluated whether interictal spike frequency measures obtained from extraoperative subdural electrocorticography (ECoG) recording could predict long-term seizure outcome. This study included 61 young patients (age 0.4–23.0 years), who underwent extraoperative ECoG recording prior to cortical resection for alleviation of uncontrolled focal seizures. Patient age, frequency of preoperative seizures, neuroimaging findings, ictal and interictal ECoG measures were preoperatively obtained. The seizure outcome was prospectively measured [follow-up period: 2.5–6.4 years (mean 4.6 years)]. Univariate and multivariate logistic regression analyses determined how well preoperative demographic and diagnostic measures predicted long-term seizure outcome. Following the initial cortical resection, Engel Class I, II, III and IV outcomes were noted in 35, 6, 12 and 7 patients, respectively. One child died due to disseminated intravascular coagulation associated with pseudomonas sepsis 2 days after surgery. Univariate regression analyses revealed that incomplete removal of seizure onset zone, higher interictal spike-frequency in the preserved cortex and incomplete removal of cortical abnormalities on neuroimaging were associated with a greater risk of failing to obtain Class I outcome. Multivariate logistic regression analysis revealed that incomplete removal of seizure onset zone was the only independent predictor of failure to obtain Class I outcome. The goodness of regression model fit and the predictive ability of regression model were greatest in the full regression model incorporating both ictal and interictal measures [R2 0.44; Area under the receiver operating characteristic (ROC) curve: 0.81], slightly smaller in the reduced model incorporating ictal but not interictal measures (R2 0.40; Area under the ROC curve: 0.79) and slightly smaller again in the reduced model incorporating interictal but not ictal measures (R2 0.27; Area under the ROC curve: 0.77). Seizure onset zone and interictal spike frequency measures on subdural ECoG recording may both be useful in predicting the long-term seizure outcome of epilepsy surgery. Yet, the additive clinical impact of interictal spike frequency measures to predict long-term surgical outcome may be modest in the presence of ictal ECoG and neuroimaging data. PMID:19286694

Fibromyalgia syndrome module at OMERACT 9: domain construct.

PubMed

Mease, Philip; Arnold, Lesley M; Choy, Ernest H; Clauw, Daniel J; Crofford, Leslie J; Glass, Jennifer M; Martin, Susan A; Morea, Jessica; Simon, Lee; Strand, C Vibeke; Williams, David A

2009-10-01

The objective of the module was to (1) establish a core domain set for fibromyalgia (FM) assessment in clinical trials and practice, (2) review outcome measure performance characteristics, (3) discuss development of a responder index for assessment of FM in clinical trials, (4) review objective markers, (5) review the domain of cognitive dysfunction, and (6) establish a research agenda for outcomes research. Presentations at the module included: (1) Results of univariate and multivariate analysis of 10 FM clinical trials of 4 drugs, mapping key domains identified in previous patient focus group: Delphi exercises and a clinician/researcher Delphi exercise, and breakout discussions to vote on possible essential domains and reliable measures; (2) Updates regarding outcome measure status; (3) Update on objective markers to measure FM disease state; and (4) Review of the issue of cognitive dysfunction (dyscognition) in FM. Consensus was reached as follows: (1) Greater than 70% of OMERACT participants agreed that pain, tenderness, fatigue, patient global, multidimensional function and sleep disturbance domains should be measured in all FM clinical trials; dyscognition and depression should be measured in some trials; and stiffness, anxiety, functional imaging, and cerebrospinal fluid biomarkers were identified as domains of research interest. (2) FM domain outcome measures have generally proven to be reliable, discriminative, and feasible. More sophisticated and comprehensive measures are in development, as is a responder index for FM. (3) Increasing numbers of objective markers are being developed for FM assessment. (4) Cognitive dysfunction assessment by self-assessed and applied outcome measures is being developed. In conclusion, a multidimensional symptom core set is proposed for evaluation of FM in clinical trials. Research on improved measures of single domains and composite measures is ongoing.

Evaluation of the Validity and Response Burden of Patient Self-Report Measures of the Pain Assessment Screening Tool and Outcomes Registry (PASTOR).

PubMed

Cook, Karon F; Kallen, Michael A; Buckenmaier, Chester; Flynn, Diane M; Hanling, Steven R; Collins, Teresa S; Joltes, Kristin; Kwon, Kyung; Medina-Torne, Sheila; Nahavandi, Parisa; Suen, Joshua; Gershon, Richard

2017-07-01

In 2009, the Army Pain Management Task Force was chartered. On the basis of their findings, the Department of Defense recommended a comprehensive pain management strategy that included development of a standardized pain assessment system that would collect patient-reported outcomes data to inform the patient-provider clinical encounter. The result was the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). The purpose of this study was to assess the validity and response burden of the patient-reported outcome measures in PASTOR. Data for analyses were collected from 681 individuals who completed PASTOR at baseline and follow-up as part of their routine clinical care. The survey tool included self-report measures of pain severity and pain interference (measured using the National Institutes of Health Patient-Reported Outcome Measurement Information System [PROMIS] and the Defense and Veterans Pain Rating scale). PROMIS measures of pain correlates also were administered. Validation analyses included estimation of score associations among measures, comparison of scores of known groups, responsiveness, ceiling and floor effects, and response burden. Results of psychometric testing provided substantial evidence for the validity of PASTOR self-report measures in this population. Expected associations among scores largely supported the concurrent validity of the measures. Scores effectively distinguished among respondents on the basis of their self-reported impressions of general health. PROMIS measures were administered using computer adaptive testing and each, on average, required less than 1 minute to administer. Statistical and graphical analyses demonstrated the responsiveness of PASTOR measures over time. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Responsiveness of outcome measures for upper limb prosthetic rehabilitation.

PubMed

Resnik, Linda; Borgia, Matthew

2016-02-01

There is limited research on responsiveness of prosthetic rehabilitation outcome measures. To examine responsiveness of the Box and Block test, Jebsen-Taylor Hand Function tests, Upper Extremity Functional Scale, University of New Brunswick skill and spontaneity tests, Activity Measure for Upper Limb Amputation, and the Patient-Specific Functional Scale. This was a quasi-experimental study with repeated measurements in a convenience sample of upper limb amputees. Measures were collected before, during, and after training with the DEKA Arm. Largest effect sizes were observed for Patient-Specific Functional Scale (effect size: 1.59, confidence interval: 1.00, 2.14), Activity Measure for Upper Limb Amputation (effect size: 1.33, confidence interval: 0.73, 1.90), and University of New Brunswick skill test (effect size: 1.18, confidence interval: 0.61, 1.73). Other measures that were responsive to change were Box and Block test, Jebsen-Taylor Hand Function light and heavy can tests, and University of New Brunswick spontaneity test. Responsiveness and pattern of responsiveness varied by prosthetic level. The Box and Block test, Jebsen-Taylor Hand Function light and heavy can tests, University of New Brunswick skill and spontaneity tests, Activities Measure for Upper Limb Amputation, and the Patient-Specific Functional Scale were responsive to change during prosthetic training. These findings have implications for choice of measures for research and practice and inform clinicians about the amount of training necessary to maximize outcomes with the DEKA Arm. Findings on responsiveness of outcome measures have implications for the choice of measures for clinical trials and practice. Findings regarding the responsiveness to change over the course of training can inform clinicians about the amount of training that may be necessary to maximize specific outcomes with the DEKA Arm. © The International Society for Prosthetics and Orthotics 2014.

Outcome measures in older persons with acquired joint contractures: a systematic review and content analysis using the ICF (International Classification of Functioning, Disability and Health) as a reference.

PubMed

Bartoszek, Gabriele; Fischer, Uli; Müller, Martin; Strobl, Ralf; Grill, Eva; Nadolny, Stephan; Meyer, Gabriele

2016-02-09

Joint contractures are a common health problem in older persons with significant impact on activities of daily living. We aimed to retrieve outcome measures applied in studies on older persons with joint contractures and to identify and categorise the concepts contained in these outcome measures using the ICF (International Classification of Functioning, Disability and Health) as a reference. Electronic searches of Medline, EMBASE, CINAHL, Pedro and the Cochrane Library were conducted (1/2002-8/2012). We included studies in the geriatric rehabilitation and nursing home settings with participants aged ≥ 65 years and with acquired joint contractures. Two independent reviewers extracted the outcome measures and transferred them to concepts using predefined conceptual frameworks. Concepts were subsequently linked to the ICF categories. From the 1057 abstracts retrieved, 60 studies met the inclusion criteria. We identified 52 single outcome measures and 24 standardised assessment instruments. A total of 1353 concepts were revealed from the outcome measures; 96.2% could be linked to 50 ICF categories in the 2nd level; 3.8% were not categorised. Fourteen of the 50 categories (28%) belonged to the component Body Functions, 4 (8%) to the component Body Structures, 26 (52%) to the component Activities and Participation, and 6 (12%) to the component Environmental Factors. The ICF is a valuable reference for identifying and quantifying the concepts of outcome measures on joint contractures in older people. The revealed ICF categories remain to be validated in populations with joint contractures in terms of clinical relevance and personal impact.

Relationships Among Student, Staff, and Administrative Measures of School Climate and Student Health and Academic Outcomes.

PubMed

Gase, Lauren N; Gomez, Louis M; Kuo, Tony; Glenn, Beth A; Inkelas, Moira; Ponce, Ninez A

2017-05-01

School climate is an integral part of a comprehensive approach to improving the well-being of students; however, little is known about the relationships between its different domains and measures. We examined the relationships between student, staff, and administrative measures of school climate to understand the extent to which they were related to each other and student outcomes. The sample included 33,572 secondary school students from 121 schools in Los Angeles County during the 2014-2015 academic year. A multilevel regression model was constructed to examine the association between the domains and measures of school climate and 5 outcomes of student well-being: depressive symptoms or suicidal ideation, tobacco use, alcohol use, marijuana use, and grades. Student, staff, and administrative measures of school climate were weakly correlated. Strong associations were found between student outcomes and student reports of engagement and safety, while school staff reports and administrative measures of school climate showed limited associations with student outcomes. As schools seek to measure and implement interventions aimed at improving school climate, consideration should be given to grounding these efforts in a multidimensional conceptualization of climate that values student perspectives and includes elements of both engagement and safety. © 2017, American School Health Association.

Outcomes in Economic Evaluations of Public Health Interventions in Low‐ and Middle‐Income Countries: Health, Capabilities and Subjective Wellbeing

PubMed Central

Lorgelly, Paula; Yamabhai, Inthira

2016-01-01

Abstract Public health programmes tend to be complex and may combine social strategies with aspects of empowerment, capacity building and knowledge across sectors. The nature of the programmes means that some effects are likely to occur outside the healthcare sector; this breadth impacts on the choice of health and non‐health outcomes to measure and value in an economic evaluation. Employing conventional outcome measures in evaluations of public health has been questioned. There are concerns that such measures are too narrow, overlook important dimensions of programme effect and, thus, lead to such interventions being undervalued. This issue is of particular importance for low‐income and middle‐income countries, which face considerable budget constraints, yet deliver a large proportion of health activities within public health programmes. The need to develop outcome measures, which include broader measures of quality of life, has given impetus to the development of a variety of new, holistic approaches, including Sen's capability framework and measures of subjective wellbeing. Despite their promise, these approaches have not yet been widely applied, perhaps because they present significant methodological challenges. This paper outlines the methodological challenges for the identification and measurement of broader outcomes of public health interventions in economic evaluation in low‐income and middle‐income countries. PMID:26804360

Relationships between Student, Staff, and Administrative Measures of School Climate and Student Health and Academic Outcomes

PubMed Central

Gase, Lauren Nichol; Gomez, Louis M.; Kuo, Tony; Glenn, Beth A.; Inkelas, Moira; Ponce, Ninez A.

2018-01-01

BACKGROUND School climate is an integral part of a comprehensive approach to improving the wellbeing of students; however, little is known about the relationships between its different domains and measures. This study examined the relationships between student, staff, and administrative measures of school climate in order to understand the extent to which they were related to each other and student outcomes. METHODS The sample included 33,572 secondary school students from 121 schools in Los Angeles County during the 2014–2015 academic year. A multilevel regression model was constructed to examine the association between the domains and measures of school climate and five outcomes of student wellbeing: depressive symptoms or suicidal ideation, tobacco use, alcohol use, marijuana use, and grades. RESULTS Student, staff, and administrative measures of school climate were weakly correlated. Strong associations were found between student outcomes and student reports of engagement and safety, while school staff reports and administrative measures of school climate showed limited associations with student outcomes. CONCLUSIONS As schools seek to measure and implement interventions aimed at improving school climate, consideration should be given to grounding these efforts in a multi-dimensional conceptualization of climate that values student perspectives and includes elements of both engagement and safety. PMID:28382671

Can a future choice affect a past measurement’s outcome?

DOE Office of Scientific and Technical Information (OSTI.GOV)

Aharonov, Yakir; Schmid College of Science, Chapman University, Orange, CA 92866; Iyar, The Israeli Institute for Advanced Research, Rehovot

2015-04-15

An EPR experiment is studied where each particle within the entangled pair undergoes a few weak measurements (WMs) along some pre-set spin orientations, with the outcomes individually recorded. Then the particle undergoes one strong measurement along an orientation chosen at the last moment. Bell-inequality violation is expected between the two final measurements within each EPR pair. At the same time, statistical agreement is expected between these strong measurements and the earlier weak ones performed on that pair. A contradiction seemingly ensues: (i) Bell’s theorem forbids spin values to exist prior to the choice of the orientation measured; (ii) A weakmore » measurement is not supposed to determine the outcome of a successive strong one; and indeed (iii) Almost no disentanglement is inflicted by the WMs; and yet (iv) The outcomes of weak measurements statistically agree with those of the strong ones, suggesting the existence of pre-determined values, in contradiction with (i). Although the conflict can be solved by mere mitigation of the above restrictions, the most reasonable resolution seems to be that of the Two-State-Vector Formalism (TSVF), namely, that the choice of the experimenter has been encrypted within the weak measurement’s outcomes, even before the experimenters themselves know what their choice will be.« less

Advancing Measurement of Locomotor Rehabilitation Outcomes to Optimize Interventions and Differentiate between Recovery versus Compensation

PubMed Central

Bowden, Mark G.; Behrman, Andrea L.; Woodbury, Michelle; Gregory, Chris M.; Velozo, Craig A.; Kautz, Steven A.

2017-01-01

Progress in locomotor rehabilitation has created an increasing need to understand the factors that contribute to motor behavior, to determine whether these factors are modifiable, and if so, to determine how best to modify them in a way that promotes improved function. Currently available measures do not have the capacity to distinguish between neuromotor recovery and compensation for impaired underlying body structure/functions. The purpose of this Special Interest article is to examine the state of outcomes measurement in physical therapy in regards outcomes to locomotor rehabilitation, and to suggest approaches that may improve assessment of recovery and clinical decision-making capabilities. We examine historical approaches to measurement of locomotor rehabilitation outcomes including rating scales, timed movement tasks, and laboratory-based outcome measures, and we discuss the emerging use of portable technology to assess walking in a free living environment. The ability to accurately measure outcomes of rehabilitation, both in and away from the laboratory setting, allows assessment of skill acquisition, retention, and long-term carryover in a variety of environments. Accurate measurement allows behavioral changes to be observed and assessments to be made, not only regarding an individual's ability to adapt during interventions, but also their ability to incorporate new skills into a real-world behavior. The result of such an approach to assessment may be that interventions truly translate from laboratory to real-world environments. Future locomotor measurement tools must be based on a theoretical framework that can guide their use to accurately quantify treatment effects and provide a basis upon which to develop and refine therapeutic interventions. PMID:22333921

Single-joint outcome measures: preliminary validation of patient-reported outcomes and physical examination.

PubMed

Heald, Alison E; Fudman, Edward J; Anklesaria, Pervin; Mease, Philip J

2010-05-01

To assess the validity, responsiveness, and reliability of single-joint outcome measures for determining target joint (TJ) response in patients with inflammatory arthritis. Patient-reported outcomes (PRO), consisting of responses to single questions about TJ global status on a 100-mm visual analog scale (VAS; TJ global score), function on a 100-mm VAS (TJ function score), and pain on a 5-point Likert scale (TJ pain score) were piloted in 66 inflammatory arthritis subjects in a phase 1/2 clinical study of an intraarticular gene transfer agent and compared to physical examination measures (TJ swelling, TJ tenderness) and validated function questionnaires (Disabilities of the Arm, Shoulder and Hand scale, Rheumatoid Arthritis Outcome Score, and the Health Assessment Questionnaire). Construct validity was assessed by evaluating the correlation between the single-joint outcome measures and validated function questionnaires using Spearman's rank correlation. Responsiveness or sensitivity to change was assessed through calculating effect size and standardized response means (SRM). Reliability of physical examination measures was assessed by determining interobserver agreement. The single-joint PRO were highly correlated with each other and correlated well with validated functional measures. The TJ global score exhibited modest effect size and modest SRM that correlated well with the patient's assessment of response on a 100-mm VAS. Physical examination measures exhibited high interrater reliability, but correlated less well with validated functional measures and the patient's assessment of response. Single-joint PRO, particularly the TJ global score, are simple to administer and demonstrate construct validity and responsiveness in patients with inflammatory arthritis. (ClinicalTrials.gov identifier NCT00126724).

A systematic review of oral herpetic viral infections in cancer patients: commonly used outcome measures and interventions.

PubMed

Elad, Sharon; Ranna, Vinisha; Ariyawardana, Anura; Correa, Maria Elvira Pizzigatti; Tilly, Vanessa; Nair, Raj G; Rouleau, Tanya; Logan, Richard M; Pinto, Andres; Charette, Veronica; Saunders, Debbie P; Jensen, Siri Beier

2017-02-01

To review the literature for outcome measures for oral viral infections in cancer patients. A secondary aim was to update the Multinational Association of Supportive Care in Cancer/International Society of Oral Oncology (MASCC/ISOO) clinical practice guidelines for the management of oral viral infections in cancer patients. Databases were searched for articles published in the English language, 1981-2013. Studies that met the eligibility criteria were reviewed systematically. The data about the outcome measures were classified according to the aim of the study: prevention, treatment, or non-interventional. The results of interventional studies were compared to the 2010 MASCC/ISOO publication. Multiple clinical and laboratory tests were used to measure oral viral infections, with great variability between studies. Most of the studies were about Herpes Simplex Virus (HSV). The outcome measure that was most commonly used was the presence of HSV infection diagnosed based on a combination of suggestive clinical presentation with a positive laboratory result. HSV culture was the most commonly reported laboratory outcome measure. Acyclovir and valacyclovir were consistently reported to be efficacious in the management of oral herpetic infections. No new data on the quality of life and economic aspects was found. Considering the variability in outcome measures reported to assess oral herpetic infections the researcher should select carefully the appropriate measures based on the objective of the study. Acyclovir and valacyclovir are effective in the management of oral herpetic infections in patients receiving treatment for cancer. Studies on newer anti-viral drugs may be useful to address the issue of anti-viral resistance.

Family-centred service coordination in childhood health and disability services: the search for meaningful service outcome measures.

PubMed

Trute, B; Hiebert-Murphy, D; Wright, A

2008-05-01

Potential service outcome measures were tested for their utility in the assessment of the quality of 'family centred' service coordination in the provincial network of children's disability services in Manitoba, Canada. This study is based on in-home survey data provided by 103 mothers at 6 and 18 months following assignment of a 'dedicated' service coordinator. Service outcome indicators included measures of parent self-esteem, parenting stress, family functioning and the need for family support resources. Hierarchical regression analyses showed no relationship between level of quality of family-centred service coordination and standardized psychosocial measures of parent and family functioning. However, family centredness of service coordination was found to predict significant reduction in level of family need for psychosocial support resources after 18 months of contact with a service coordinator. Outcome measures that are focused on specific and tangible results of service coordination appear to be of higher utility in service quality assessment than are more global, standardized measures of parent and family functioning.

Patient-Reported Disease Activity and Adverse Pregnancy Outcomes in Systemic Lupus Erythematosus and Rheumatoid Arthritis.

PubMed

Harris, Nathaniel; Eudy, Amanda; Clowse, Megan

2018-06-15

While increased rheumatic disease activity during pregnancy has been associated with adverse pregnancy outcomes, this activity is typically assessed by the physician. Little is known, however, about the association between patient-reported measures of disease activity and pregnancy outcomes. Univariate and multivariable regression models were used to assess the relationship between patient and physician-reported measures of disease activity and adverse pregnancy outcomes in 225 patients with lupus or rheumatoid arthritis (RA) enrolled in a prospective registry at a single academic center from 2008-2016. In women with RA, patient-reported disease activity is associated with preterm birth (OR 5.9 (1.5-23.9)), and gestational age (beta -1.5 weeks (-2.6, -0.4 weeks)). The physician assessment of disease activity also predicted preterm (OR 2.1 (1.2-3.5)), small for gestational age births (OR 1.8 (1.03-3.1), and gestational age in weeks (beta -0.6 weeks (-0.9, -0.02 weeks)). On the other hand, SLE patient-reported disease activity measures, including the HAQ, pain or global health measures, are not associated with adverse pregnancy outcomes. However, physician measures of SLE disease activity are associated with preterm birth (OR 2.9 (1.-6.3)), cesarean delivery (OR 2.3 (1.0-5.3)), and preeclampsia (OR 2.8 (1.3-6.3)). The results do not appear to be driven by lupus nephritis or antiphospholipid syndrome. For women with RA, patient-reported measures of disease activity may be useful adjuncts to physician-reported measures in identifying pregnancies at greater risk. In contrast, in SLE, no patient-reported measures were associated with adverse outcomes while physician measures of disease activity helped predict several adverse pregnancy outcomes. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

The importance of functional impairment to mental health outcomes: A case for reassessing our goals in depression treatment research

PubMed Central

McKnight, Patrick E.; Kashdan, Todd B.

2009-01-01

Outcomes in depression treatment research include both changes in symptom severity and functional impairment. Symptom measures tend to be the standard outcome but we argue that there are benefits to considering functional outcomes. An exhaustive literature review shows that the relationship between symptoms and functioning remains unexpectedly weak and often bidirectional. Changes in functioning often lag symptom changes. As a result, functional outcomes might offer depression researchers more critical feedback and better guidance when studying depression treatment outcomes. The paper presents a case for the necessity of both functional and symptom outcomes in depression treatment research by addressing three aims–1) review the research relating symptoms and functioning, 2) provide a rationale for measuring both outcomes, and 3) discuss potential artifacts in measuring functional outcomes. The three aims are supported by an empirical review of the treatment outcome and epidemiological literatures. PMID:19269076

Developing a core outcome set for chronic rhinosinusitis: a systematic review of outcomes utilised in the current literature.

PubMed

Soni-Jaiswal, Archana; Lakhani, Raj; Hopkins, Claire

2017-07-11

A core outcome set (COS) is an agreed standardised collection of outcomes that should be measured and reported by all trials for a specific clinical area, in this case chronic rhinosinusitis. These are not restrictive and researchers may continue to explore other outcomes alongside these that they feel are relevant to their intervention. The aim of this systematic review was to identify the need for a COS for chronic rhinosinusitis. A sensitive search strategy was used to identify all published Cochrane systematic reviews and randomised control trials of intervention for adult patients with chronic rhinosinusitis. Two independent authors reviewed these to obtain a list of outcomes and outcome measures reported by each clinical trial. Sixty-nine randomised control trials and eight Cochrane systematic reviews were included in this study. They reported 68 individual outcomes and outcome measures, with an average of four to ten outcomes per clinical trial. These outcomes were mapped to 23 subcategories belonging to eight core categories. The key finding of this review was the heterogeneity of outcomes reported and measured by clinical trials of patients with chronic rhinosinusitis, precluding meaningful meta-analysis of data. This review supports the need for development of a COS, to be used in future trials on adult patients with chronic rhinosinusitis.

Validating Multidimensional Outcome Assessment Using the TBI Common Data Elements: An Analysis of the TRACK-TBI Pilot Sample.

PubMed

Nelson, Lindsay D; Ranson, Jana; Ferguson, Adam R; Giacino, Joseph; Okonkwo, David O; Valadka, Alex; Manley, Geoffrey; McCrea, Michael

2017-06-08

The Glasgow Outcome Scale-Extended (GOSE) is often the primary outcome measure in clinical trials for traumatic brain injury (TBI). Although the GOSE's capture of global function outcome has several strengths, concerns have been raised about its limited ability to identify mild disability and failure to capture the full scope of problems patients exhibit after TBI. This analysis examined the convergence of disability ratings across a multidimensional set of outcome domains in the Transforming Research and Clinical Knowledge in Traumatic Brain Injury (TRACK-TBI) Pilot study. The study collected measures recommended by the TBI Common Data Elements (CDE) Workgroup. Patients presenting to 3 emergency departments with a TBI of any severity enrolled in TRACK-TBI prospectively after injury; outcome measures were collected at 3 and six months postinjury. Analyses examined frequency of impairment and overlap between impairment status across the CDE outcome domains of Global Level of Functioning (GOSE), Neuropsychological (cognitive) Impairment, Psychological Status, TBI Symptoms, and Quality of Life. GOSE score correlated in the expected direction with other outcomes (M Spearman's rho = .21 and .49 with neurocognitive and self-report outcomes, respectively). The subsample in the Upper Good Recovery (GOSE 8) category appeared quite healthy across most other outcomes, although 19.0% had impaired executive functioning (Trail Making Test Part B). A significant minority of participants in the Lower Good Recovery subgroup (GOSE 7) met criteria for impairment across numerous other outcome measures. The findings highlight the multidimensional nature of TBI recovery and the limitations of applying only a single outcome measure.

Outcome Measures for Clinical Trials in Down Syndrome

PubMed Central

Esbensen, Anna J.; Hooper, Stephen R.; Fidler, Deborah; Hartley, Sigan; Edgin, Jamie; d’Ardhuy, Xavier Liogier; Capone, George; Conners, Frances; Mervis, Carolyn B.; Abbeduto, Leonard; Rafii, Michael; Krinsky-McHale, Sharon J.; Urv, Tiina

2017-01-01

Increasingly individuals with intellectual and developmental disabilities, including Down syndrome, are being targeted for clinical trials. However, a challenge exists in effectively evaluating the outcomes of these new pharmacological interventions. Few empirically evaluated, psychometrically sound outcome measures appropriate for use in clinical trials with individuals with Down syndrome have been identified. To address this challenge, the NIH assembled leading clinicians and scientists to review existing measures and identify those that currently are appropriate for trials; those that may be appropriate after expansion of age range addition of easier items, and/or downward extension of psychometric norms; and areas where new measures need to be developed. This paper focuses on measures in the areas of cognition and behavior. PMID:28452584

Multidimensional change in psychotherapy.

PubMed

Jones, E E

1980-04-01

Assessed psychotherapy outcome for 177 patients who were seen for an average of 31 therapy hours with the Rating Scales for Outcome of Therapy and a Therapist Questionnaire. Results of a components analysis did not support Storrow's rational groupings of the Rating Scales into five dimensions and suggested that two general areas of psychological adjustment underlie the 11 scales. A second components analysis that included both outcome measures supports only in part the contention that when results from diverse outcome measures are factor analyzed, the factors necessarily are associated with method of measurement rather than substantive dimensions of change.

A Review of Educational Outcomes in the Children's Mental Health Treatment Literature

ERIC Educational Resources Information Center

Becker, Kimberly D.; Brandt, Nicole Evangelista; Stephan, Sharon H.; Chorpita, Bruce F.

2014-01-01

We examined the measurement of educational outcomes related to children's mental health treatments. A total of 85 papers describing 88 randomized controlled trials that included at least one educational outcome and one mental health outcome were included in these analyses. Forty-five different measures were identified as the primary educational…

Transforming Course Evaluations into a Meaningful Measure of Student Outcomes Achievement

ERIC Educational Resources Information Center

McCullough, Christopher A.

2008-01-01

Over the past few years, the author had the good fortune to engage many faculty and administrators in conversations about student outcomes assessment. The author has discovered that many faculty and administrators associate course valuations with student outcomes assessment measures. He also found that no items about student learning outcomes are…

Patient-reported outcomes in borderline personality disorder

PubMed Central

Hasler, Gregor; Hopwood, Christopher J.; Jacob, Gitta A.; Brändle, Laura S.; Schulte-Vels, Thomas

2014-01-01

Patient-reported outcome (PRO) refers to measures that emphasize the subjective view of patients about their health-related conditions and behaviors. Typically, PROs include self-report questionnaires and clinical interviews. Defining PROs for borderline personality disorder (BPD) is particularly challenging given the disorder's high symptomatic heterogeneity, high comorbidity with other psychiatric conditions, highly fluctuating symptoms, weak correlations between symptoms and functional outcomes, and lack of valid and reliable experimental measures to complement self-report data. Here, we provide an overview of currently used BPD outcome measures and discuss them from clinical, psychometric, experimental, and patient perspectives. In addition, we review the most promising leads to improve BPD PROs, including the DSM-5 Section III, the Recovery Approach, Ecological Momentary Assessments, and novel experimental measures of social functioning that are associated with functional and social outcomes. PMID:25152662

Implementation of generalized quantum measurements for unambiguous discrimination of multiple non-orthogonal coherent states.

PubMed

Becerra, F E; Fan, J; Migdall, A

2013-01-01

Generalized quantum measurements implemented to allow for measurement outcomes termed inconclusive can perform perfect discrimination of non-orthogonal states, a task which is impossible using only measurements with definitive outcomes. Here we demonstrate such generalized quantum measurements for unambiguous discrimination of four non-orthogonal coherent states and obtain their quantum mechanical description, the positive-operator valued measure. For practical realizations of this positive-operator valued measure, where noise and realistic imperfections prevent perfect unambiguous discrimination, we show that our experimental implementation outperforms any ideal standard-quantum-limited measurement performing the same non-ideal unambiguous state discrimination task for coherent states with low mean photon numbers.

Measurement contextuality is implied by macroscopic realism

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chen Zeqian; Montina, A.; Perimeter Institute for Theoretical Physics, 31 Caroline Street North, Waterloo, Ontario, N2L 2Y5

2011-04-15

Ontological theories of quantum mechanics provide a realistic description of single systems by means of well-defined quantities conditioning the measurement outcomes. In order to be complete, they should also fulfill the minimal condition of macroscopic realism. Under the assumption of outcome determinism and for Hilbert space dimension greater than 2, they were all proved to be contextual for projective measurements. In recent years a generalized concept of noncontextuality was introduced that applies also to the case of outcome indeterminism and unsharp measurements. It was pointed out that the Beltrametti-Bugajski model is an example of measurement noncontextual indeterminist theory. Here wemore » provide a simple proof that this model is the only one with such a feature for projective measurements and Hilbert space dimension greater than 2. In other words, there is no extension of quantum theory providing more accurate predictions of outcomes and simultaneously preserving the minimal labeling of events through projective operators. As a corollary, noncontextuality for projective measurements implies noncontextuality for unsharp measurements. By noting that the condition of macroscopic realism requires an extension of quantum theory, unless a breaking of unitarity is invoked, we arrive at the conclusion that the only way to solve the measurement problem in the framework of an ontological theory is by relaxing the hypothesis of measurement noncontextuality in its generalized sense.« less

Evidence-Based Performance Measures: Quality Metrics for the Care of Patients Undergoing Breast Reconstruction.

PubMed

Manahan, Michele A; Wooden, William A; Becker, Stephen M; Cacioppo, Jason R; Edge, Stephen B; Grandinetti, Amanda C; Gray, Diedra D; Holley, Susan O; Karp, Nolan S; Kocak, Ergun; Rao, Roshni; Rosson, Gedge D; Schwartz, Jaime S; Sitzman, Thomas J; Soltanian, Hooman T; TerKonda, Sarvam P; Wallace, Anne M

2017-12-01

The American Society of Plastic Surgeons commissioned the Breast Reconstruction Performance Measure Development Work Group to identify and draft quality measures for the care of patients undergoing breast reconstruction surgery. Two outcome measures were identified. The first desired outcome was to reduce the number of returns to the operating room following reconstruction within 60 days of the initial reconstructive procedure. The second desired outcome was to reduce flap loss within 30 days of the initial reconstructive procedure. All measures in this report were approved by the American Society of Plastic Surgeons Breast Reconstruction Performance Measures Work Group and the American Society of Plastic Surgeons Executive Committee. The Work Group recommends the use of these measures for quality initiatives, Continuing Medical Education, Maintenance of Certification, American Society of Plastic Surgeons' Qualified Clinical Data Registry reporting, and national quality reporting programs.

More quality measures versus measuring what matters: a call for balance and parsimony

PubMed Central

Nelson, Eugene C; Pryor, David B; James, Brent; Swensen, Stephen J; Kaplan, Gary S; Weissberg, Jed I; Bisognano, Maureen; Yates, Gary R; Hunt, Gordon C

2012-01-01

External groups requiring measures now include public and private payers, regulators, accreditors and others that certify performance levels for consumers, patients and payers. Although benefits have accrued from the growth in quality measurement, the recent explosion in the number of measures threatens to shift resources from improving quality to cover a plethora of quality-performance metrics that may have a limited impact on the things that patients and payers want and need (ie, better outcomes, better care, and lower per capita costs). Here we propose a policy that quality measurement should be: balanced to meet the need of end users to judge quality and cost performance and the need of providers to continuously improve the quality, outcomes and costs of their services; and parsimonious to measure quality, outcomes and costs with appropriate metrics that are selected based on end-user needs. PMID:22893696

More quality measures versus measuring what matters: a call for balance and parsimony.

PubMed

Meyer, Gregg S; Nelson, Eugene C; Pryor, David B; James, Brent; Swensen, Stephen J; Kaplan, Gary S; Weissberg, Jed I; Bisognano, Maureen; Yates, Gary R; Hunt, Gordon C

2012-11-01

External groups requiring measures now include public and private payers, regulators, accreditors and others that certify performance levels for consumers, patients and payers. Although benefits have accrued from the growth in quality measurement, the recent explosion in the number of measures threatens to shift resources from improving quality to cover a plethora of quality-performance metrics that may have a limited impact on the things that patients and payers want and need (ie, better outcomes, better care, and lower per capita costs). Here we propose a policy that quality measurement should be: balanced to meet the need of end users to judge quality and cost performance and the need of providers to continuously improve the quality, outcomes and costs of their services; and parsimonious to measure quality, outcomes and costs with appropriate metrics that are selected based on end-user needs.

Observation of Stronger-than-Binary Correlations with Entangled Photonic Qutrits

NASA Astrophysics Data System (ADS)

Hu, Xiao-Min; Liu, Bi-Heng; Guo, Yu; Xiang, Guo-Yong; Huang, Yun-Feng; Li, Chuan-Feng; Guo, Guang-Can; Kleinmann, Matthias; Vértesi, Tamás; Cabello, Adán

2018-05-01

We present the first experimental confirmation of the quantum-mechanical prediction of stronger-than-binary correlations. These are correlations that cannot be explained under the assumption that the occurrence of a particular outcome of an n ≥3 -outcome measurement is due to a two-step process in which, in the first step, some classical mechanism precludes n -2 of the outcomes and, in the second step, a binary measurement generates the outcome. Our experiment uses pairs of photonic qutrits distributed between two laboratories, where randomly chosen three-outcome measurements are performed. We report a violation by 9.3 standard deviations of the optimal inequality for nonsignaling binary correlations.

Outcome measures in European patients with haemophilia: Survey of implementation in routine clinical practice, perception of relevance and recommendations by European treaters in the EHTSB.

PubMed

Hermans, C; Klamroth, R; Richards, M; de Moerloose, P; Garrido, R P

2017-03-01

This study was conducted to evaluate the current implementation of outcome measures in routine clinical haemophilia practice and to explore and appreciate the perception of the relevance of such measures by treaters. A survey was completed by 19 of the 26 physicians involved in the European Haemophilia Therapy Strategy Board (EHTSB). Employing an extensive inventory of outcome measures used in patients with haemophilia, information was collected about the frequency of data collection and the subjective appreciation of their importance during clinic review. The survey revealed that most treaters currently collect data that are mainly related to the haemostatic treatment (consumption of concentrates) and the bleeding symptoms (number and location of bleeds) in a non-uniform and non-standardized way. By contrast, functional, physical and quality of life scorings are rarely used and show considerable heterogeneity between treaters. Also, many disparities emerged between practice and perception, in particular quality of life data that are perceived as being important but for most of the time are not collected. This survey represents, in our view, the first attempt to evaluate the actual utilization of outcome measures in haemophilia care. While the value of outcome measures is appreciated, they are not assessed regularly. Therefore, there is a need to include appropriate performance indicators (outcome measures) of haemophilia care in routine clinical practice. Consensus recommendations to provide a framework for achieving this aim are provided. © 2016 John Wiley & Sons Ltd.

Choice of outcomes and measurement instruments in randomised trials on eLearning in medical education: a systematic mapping review protocol.

PubMed

Law, Gloria C; Apfelbacher, Christian; Posadzki, Pawel P; Kemp, Sandra; Tudor Car, Lorainne

2018-05-17

There will be a lack of 18 million healthcare workers by 2030. Multiplying the number of well-trained healthcare workers through innovative ways such as eLearning is highly recommended in solving this shortage. However, high heterogeneity of learning outcomes in eLearning systematic reviews reveals a lack of consistency and agreement on core learning outcomes in eLearning for medical education. In addition, there seems to be a lack of validity evidence for measurement instruments used in these trials. This undermines the credibility of these outcome measures and affects the ability to draw accurate and meaningful conclusions. The aim of this research is to address this issue by determining the choice of outcomes, measurement instruments and the prevalence of measurement instruments with validity evidence in randomised trials on eLearning for pre-registration medical education. We will conduct a systematic mapping and review to identify the types of outcomes, the kinds of measurement instruments and the prevalence of validity evidence among measurement instruments in eLearning randomised controlled trials (RCTs) in pre-registration medical education. The search period will be from January 1990 until August 2017. We will consider studies on eLearning for health professionals' education. Two reviewers will extract and manage data independently from the included studies. Data will be analysed and synthesised according to the aim of the review. Appropriate choice of outcomes and measurement tools is essential for ensuring high-quality research in the field of eLearning and eHealth. The results of this study could have positive implications for other eHealth interventions, including (1) improving quality and credibility of eLearning research, (2) enhancing the quality of digital medical education and (3) informing researchers, academics and curriculum developers about the types of outcomes and validity evidence for measurement instruments used in eLearning studies. The protocol aspires to assist in the advancement of the eLearning research field as well as in the development of high-quality healthcare professionals' digital education. PROSPERO CRD42017068427.

Validity of the AusTOM scales: A comparison of the AusTOMs and EuroQol-5D

PubMed Central

Unsworth, Carolyn A; Duckett, Stephen J; Duncombe, Dianne; Perry, Alison; Skeat, Jemma; Taylor, Nicholas

2004-01-01

Background Clinicians require brief outcome measures in their busy daily practice to document global client outcomes. Based on the UK Therapy Outcome Measure, the Australian Therapy Outcome Measures were designed to capture global therapy outcomes of occupational therapy, physiotherapy and speech pathology in the Australian clinical context. The aim of this study was to investigate the construct (convergent) validity of the Australian Therapy Outcome Measures (AusTOMs) by comparing it with the EuroQuol-5D (EQ-5D). Methods The research was a prospective, longitudinal cohort study, with data collected over a seven month time period. The study was conducted at a total of 13 metropolitan and rural health-care sites including acute, sub-acute and community facilities. Two-hundred and five clients were asked to score themselves on the EQ-5D, and the same clients were scored by approximately 115 therapists (physiotherapists, speech pathologists and occupational therapists) using the AusTOMs at admission and discharge. Clients were consecutive admissions who agreed to participate in the study. Clients of all diagnoses, aged 18 years and over (a criteria of the EQ-5D), and able to give informed consent were scored on the measures. Spearman rank order correlation coefficients were used to analyze the relationships between scores from the two tools. The clients were scored on the AusTOMs and EQ-5D. Results There were many health care areas where correlations were expected and found between scores on the AusTOMs and the EQ-5D. Conclusion In the quest to measure the effectiveness of therapy services, managers, health care founders and clinicians are urgently seeking to undertake the first step by identifying tools that can measure therapy outcome. AusTOMs is one tool that can measure global client outcomes following therapy. In this study, it was found that on the whole, the AusTOMs and the EQ-5D measure similar constructs. Hence, although the validity of a tool is never 'proven', this study offers preliminary support for the construct validity of AusTOMs. PMID:15541181

Comparative Effectiveness Research and Children With Cerebral Palsy: Identifying a Conceptual Framework and Specifying Measures.

PubMed

Gannotti, Mary E; Law, Mary; Bailes, Amy F; OʼNeil, Margaret E; Williams, Uzma; DiRezze, Briano

2016-01-01

A step toward advancing research about rehabilitation service associated with positive outcomes for children with cerebral palsy is consensus about a conceptual framework and measures. A Delphi process was used to establish consensus among clinicians and researchers in North America. Directors of large pediatric rehabilitation centers, clinicians from large hospitals, and researchers with expertise in outcomes participated (N = 18). Andersen's model of health care utilization framed outcomes: consumer satisfaction, activity, participation, quality of life, and pain. Measures agreed upon included Participation and Environment Measure for Children and Youth, Measure of Processes of Care, PEDI-CAT, KIDSCREEN-10, PROMIS Pediatric Pain Interference Scale, Visual Analog Scale for pain intensity, PROMIS Global Health Short Form, Family Environment Scale, Family Support Scale, and functional classification levels for gross motor, manual ability, and communication. Universal forms for documenting service use are needed. Findings inform clinicians and researchers concerned with outcome assessment.

Defining Outcome Measures for Psoriasis: The IDEOM Report from the GRAPPA 2016 Annual Meeting.

PubMed

Callis Duffin, Kristina; Gottlieb, Alice B; Merola, Joseph F; Latella, John; Garg, Amit; Armstrong, April W

2017-05-01

The International Dermatology Outcome Measures (IDEOM) psoriasis working group was established to develop core domains and measurements sets for psoriasis clinical trials and ultimately clinical practice. At the 2016 annual meeting of the Group for Research and Assessment of Psoriasis and Psoriatic Arthritis, the IDEOM psoriasis group presented an overview of its progress toward developing this psoriasis core domain set. First, it summarized the February 2016 meeting of all involved with the IDEOM, highlighting patient and payer perspectives on outcome measures. Second, the group presented an overview of the consensus process for developing the core domain set for psoriasis, including previous literature reviews, nominal group exercises, and meeting discussions. Future plans include the development of working groups to review candidate measures for at least 2 of the domains, including primary pathophysiologic manifestations and patient-reported outcomes, and Delphi surveys to gain consensus on the final psoriasis core domain set.

How to Measure Quality-of-Life Concerns in Patients with Neurogenic Lower Urinary Tract Dysfunction.

PubMed

Patel, Darshan P; Myers, Jeremy B; Lenherr, Sara M

2017-08-01

There is an evolving role for quality-of-life measures and patient-reported outcomes in the evaluation of neurogenic lower urinary tract dysfunction. We review available health-related quality-of-life instruments and patient-reported outcomes measures used in the assessment of patients with neurogenic bladder. We also discuss considerations for incorporation of these measures into clinical and patient-reported research. Emphasizing patient-reported outcomes in neurogenic bladder research will guide clinicians and other stakeholders to improve quality of life in this patient population. Copyright © 2017 Elsevier Inc. All rights reserved.

Improving the Rank Precision of Population Health Measures for Small Areas with Longitudinal and Joint Outcome Models

PubMed Central

Athens, Jessica K.; Remington, Patrick L.; Gangnon, Ronald E.

2015-01-01

Objectives The University of Wisconsin Population Health Institute has published the County Health Rankings since 2010. These rankings use population-based data to highlight health outcomes and the multiple determinants of these outcomes and to encourage in-depth health assessment for all United States counties. A significant methodological limitation, however, is the uncertainty of rank estimates, particularly for small counties. To address this challenge, we explore the use of longitudinal and pooled outcome data in hierarchical Bayesian models to generate county ranks with greater precision. Methods In our models we used pooled outcome data for three measure groups: (1) Poor physical and poor mental health days; (2) percent of births with low birth weight and fair or poor health prevalence; and (3) age-specific mortality rates for nine age groups. We used the fixed and random effects components of these models to generate posterior samples of rates for each measure. We also used time-series data in longitudinal random effects models for age-specific mortality. Based on the posterior samples from these models, we estimate ranks and rank quartiles for each measure, as well as the probability of a county ranking in its assigned quartile. Rank quartile probabilities for univariate, joint outcome, and/or longitudinal models were compared to assess improvements in rank precision. Results The joint outcome model for poor physical and poor mental health days resulted in improved rank precision, as did the longitudinal model for age-specific mortality rates. Rank precision for low birth weight births and fair/poor health prevalence based on the univariate and joint outcome models were equivalent. Conclusion Incorporating longitudinal or pooled outcome data may improve rank certainty, depending on characteristics of the measures selected. For measures with different determinants, joint modeling neither improved nor degraded rank precision. This approach suggests a simple way to use existing information to improve the precision of small-area measures of population health. PMID:26098858

Outcomes of Interorganizational Networks in Canada for Chronic Disease Prevention: Insights From a Concept Mapping Study, 2015.

PubMed

Willis, Cameron; Kernoghan, Alison; Riley, Barbara; Popp, Janice; Best, Allan; Milward, H Brinton

2015-11-19

We conducted a mixed methods study from June 2014 to March 2015 to assess the perspectives of stakeholders in networks that adopt a population approach for chronic disease prevention (CDP). The purpose of the study was to identify important and feasible outcome measures for monitoring network performance. Participants from CDP networks in Canada completed an online concept mapping exercise, which was followed by interviews with network stakeholders to further understand the findings. Nine concepts were considered important outcomes of CDP networks: enhanced learning, improved use of resources, enhanced or increased relationships, improved collaborative action, network cohesion, improved system outcomes, improved population health outcomes, improved practice and policy planning, and improved intersectoral engagement. Three themes emerged from participant interviews related to measurement of the identified concepts: the methodological difficulties in measuring network outcomes, the dynamic nature of network evolution and function and implications for outcome assessment, and the challenge of measuring multisectoral engagement in CDP networks. Results from this study provide initial insights into concepts that can be used to describe the outcomes of networks for CDP and may offer foundations for strengthening network outcome-monitoring strategies and methodologies.

Outcomes of Interorganizational Networks in Canada for Chronic Disease Prevention: Insights From a Concept Mapping Study, 2015

PubMed Central

Kernoghan, Alison; Riley, Barbara; Popp, Janice; Best, Allan; Milward, H. Brinton

2015-01-01

Introduction We conducted a mixed methods study from June 2014 to March 2015 to assess the perspectives of stakeholders in networks that adopt a population approach for chronic disease prevention (CDP). The purpose of the study was to identify important and feasible outcome measures for monitoring network performance. Methods Participants from CDP networks in Canada completed an online concept mapping exercise, which was followed by interviews with network stakeholders to further understand the findings. Results Nine concepts were considered important outcomes of CDP networks: enhanced learning, improved use of resources, enhanced or increased relationships, improved collaborative action, network cohesion, improved system outcomes, improved population health outcomes, improved practice and policy planning, and improved intersectoral engagement. Three themes emerged from participant interviews related to measurement of the identified concepts: the methodological difficulties in measuring network outcomes, the dynamic nature of network evolution and function and implications for outcome assessment, and the challenge of measuring multisectoral engagement in CDP networks. Conclusion Results from this study provide initial insights into concepts that can be used to describe the outcomes of networks for CDP and may offer foundations for strengthening network outcome-monitoring strategies and methodologies. PMID:26583571

Toddlers' Verb Lexicon Diversity and Grammatical Outcomes

ERIC Educational Resources Information Center

Hadley, Pamela A.; Rispoli, Matthew; Hsu, Ning

2016-01-01

Purpose: The goals of this study were to quantify longitudinal expectations for verb lexicon growth and to determine whether verb lexicon measures were better predictors of later grammatical outcomes than noun lexicon measures. Method: Longitudinal parent-report measures from the MacArthur-Bates Communicative Development Inventory (Fenson et al.,…

Further Evaluation of the Outcome Questionnaire-45.2

ERIC Educational Resources Information Center

Rice, Kenneth G.; Suh, Hanna; Ege, Engin

2014-01-01

Data from clinical and nonclinical samples ("Ns" = 2,096, 618) were used to evaluate and replicate the measurement structure of the Outcome Questionnaire-45.2. Different measurement models and invariance tests were evaluated and the best psychometric support was found for a shortened measure of two factors: overall maladjustment and…

Measuring Violence Risk and Outcomes among Mexican American Adolescent Females

ERIC Educational Resources Information Center

Cervantes, Richard C.; Duenas, Norma; Valdez, Avelardo; Kaplan, Charles

2006-01-01

Central to the development of culturally competent violence prevention programs for Hispanic youth is the development of psychometrically sound violence risk and outcome measures for this population. A study was conducted to determine the psychometric properties of two commonly used violence measures, in this case for Mexican American adolescent…

Recommendation for measuring clinical outcome in distal radius fractures: a core set of domains for standardized reporting in clinical practice and research.

PubMed

Goldhahn, Jörg; Beaton, Dorcas; Ladd, Amy; Macdermid, Joy; Hoang-Kim, Amy

2014-02-01

Lack of standardization of outcome measurement has hampered an evidence-based approach to clinical practice and research. We adopted a process of reviewing evidence on current use of measures and appropriate theoretical frameworks for health and disability to inform a consensus process that was focused on deriving the minimal set of core domains in distal radius fracture. We agreed on the following seven core recommendations: (1) pain and function were regarded as the primary domains, (2) very brief measures were needed for routine administration in clinical practice, (3) these brief measures could be augmented by additional measures that provide more detail or address additional domains for clinical research, (4) measurement of pain should include measures of both intensity and frequency as core attributes, (5) a numeric pain scale, e.g. visual analogue scale or visual numeric scale or the pain subscale of the patient-reported wrist evaluation (PRWE) questionnaires were identified as reliable, valid and feasible measures to measure these concepts, (6) for function, either the Quick Disability of the arm, shoulder and hand questionnaire or PRWE-function subscale was identified as reliable, valid and feasible measures, and (7) a measure of participation and treatment complications should be considered core outcomes for both clinical practice and research. We used a sound methodological approach to form a comprehensive foundation of content for outcomes in the area of distal radius fractures. We recommend the use of symptom and function as separate domains in the ICF core set in clinical research or practice for patients with wrist fracture. Further research is needed to provide more definitive measurement properties of measures across all domains.

Measurement error, time lag, unmeasured confounding: Considerations for longitudinal estimation of the effect of a mediator in randomised clinical trials.

PubMed

Goldsmith, K A; Chalder, T; White, P D; Sharpe, M; Pickles, A

2018-06-01

Clinical trials are expensive and time-consuming and so should also be used to study how treatments work, allowing for the evaluation of theoretical treatment models and refinement and improvement of treatments. These treatment processes can be studied using mediation analysis. Randomised treatment makes some of the assumptions of mediation models plausible, but the mediator-outcome relationship could remain subject to bias. In addition, mediation is assumed to be a temporally ordered longitudinal process, but estimation in most mediation studies to date has been cross-sectional and unable to explore this assumption. This study used longitudinal structural equation modelling of mediator and outcome measurements from the PACE trial of rehabilitative treatments for chronic fatigue syndrome (ISRCTN 54285094) to address these issues. In particular, autoregressive and simplex models were used to study measurement error in the mediator, different time lags in the mediator-outcome relationship, unmeasured confounding of the mediator and outcome, and the assumption of a constant mediator-outcome relationship over time. Results showed that allowing for measurement error and unmeasured confounding were important. Contemporaneous rather than lagged mediator-outcome effects were more consistent with the data, possibly due to the wide spacing of measurements. Assuming a constant mediator-outcome relationship over time increased precision.

Measurement error, time lag, unmeasured confounding: Considerations for longitudinal estimation of the effect of a mediator in randomised clinical trials

PubMed Central

Goldsmith, KA; Chalder, T; White, PD; Sharpe, M; Pickles, A

2016-01-01

Clinical trials are expensive and time-consuming and so should also be used to study how treatments work, allowing for the evaluation of theoretical treatment models and refinement and improvement of treatments. These treatment processes can be studied using mediation analysis. Randomised treatment makes some of the assumptions of mediation models plausible, but the mediator–outcome relationship could remain subject to bias. In addition, mediation is assumed to be a temporally ordered longitudinal process, but estimation in most mediation studies to date has been cross-sectional and unable to explore this assumption. This study used longitudinal structural equation modelling of mediator and outcome measurements from the PACE trial of rehabilitative treatments for chronic fatigue syndrome (ISRCTN 54285094) to address these issues. In particular, autoregressive and simplex models were used to study measurement error in the mediator, different time lags in the mediator–outcome relationship, unmeasured confounding of the mediator and outcome, and the assumption of a constant mediator–outcome relationship over time. Results showed that allowing for measurement error and unmeasured confounding were important. Contemporaneous rather than lagged mediator–outcome effects were more consistent with the data, possibly due to the wide spacing of measurements. Assuming a constant mediator–outcome relationship over time increased precision. PMID:27647810

Using the Patient Reported Outcomes Measurement Information System to Evaluate Psychosocial Functioning among Children with Craniofacial Anomalies.

PubMed

Shapiro, Danielle N; Waljee, Jennifer; Ranganathan, Kavitha; Buchman, Steven; Warschausky, Seth

2015-06-01

Children with craniofacial anomalies are at risk for social exclusion, bullying, and psychological symptoms, all of which are associated with poor developmental and health outcomes. The National Institutes of Health-developed Patient Reported Outcomes Measurement Information System instruments may be useful tools for monitoring psychosocial functioning in clinical settings and for integrating patient and parent perspectives. The current study included 74 children (50 percent male) with craniofacial anomalies recruited through a multidisciplinary clinic. The authors obtained child self-report and parent-proxy ratings of depression, anxiety, and peer relationship quality using National Institutes of Health Patient Reported Outcomes Measurement Information System instruments. The authors compared sample means to Patient Reported Outcomes Measurement Information System instruments norms and analyzed the reliability of parents' and children's reporting of psychosocial variables. All reliability statistics were satisfactory (α values ranging from 0.74 to 0.96) and sample standard deviations were similar to those obtained in a general population, suggesting that Patient Reported Outcomes Measurement Information System instruments are reliable among children with craniofacial anomalies. In general, children and parents did not report unusual levels of psychological distress; however, they did report poorer peer relationship quality relative to normed data, a trend that was particularly pronounced among boys. National Institutes of Health Patient Reported Outcomes Measurement Information System instruments are efficient and accurate tools for monitoring psychosocial adjustment among children with craniofacial anomalies. It may be especially important to monitor social functioning, particularly among boys.

Psychometric properties of carer-reported outcome measures in palliative care: A systematic review

PubMed Central

Michels, Charlotte TJ; Boulton, Mary; Adams, Astrid; Wee, Bee; Peters, Michele

2016-01-01

Background: Informal carers face many challenges in caring for patients with palliative care needs. Selecting suitable valid and reliable outcome measures to determine the impact of caring and carers’ outcomes is a common problem. Aim: To identify outcome measures used for informal carers looking after patients with palliative care needs, and to evaluate the measures’ psychometric properties. Design: A systematic review was conducted. The studies identified were evaluated by independent reviewers (C.T.J.M., M.B., M.P.). Data regarding study characteristics and psychometric properties of the measures were extracted and evaluated. Good psychometric properties indicate a high-quality measure. Data sources: The search was conducted, unrestricted to publication year, in the following electronic databases: Applied Social Sciences Index and Abstracts, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, EMBASE, PubMed, PsycINFO, Social Sciences Citation Index and Sociological Abstracts. Results: Our systematic search revealed 4505 potential relevant studies, of which 112 studies met the inclusion criteria using 38 carer measures for informal carers of patients with palliative care needs. Psychometric properties were reported in only 46% (n = 52) of the studies, in relation to 24 measures. Where psychometric data were reported, the focus was mainly on internal consistency (n = 45, 87%), construct validity (n = 27, 52%) and/or reliability (n = 14, 27%). Of these, 24 measures, only four (17%) had been formally validated in informal carers in palliative care. Conclusion: A broad range of outcome measures have been used for informal carers of patients with palliative care needs. Little formal psychometric testing has been undertaken. Furthermore, development and refinement of measures in this field is required. PMID:26407683

Development of the FOCUS (Focus on the Outcomes of Communication under Six), a Communication Outcome Measure for Preschool Children

ERIC Educational Resources Information Center

Thomas-Stonell, Nancy L.; Oddson, Bruce; Robertson, Bernadette; Rosenbaum, Peter L.

2010-01-01

Aim: Our aim was to develop an outcome measure, called Focus on the Outcomes of Communication Under Six (FOCUS), that captures real-world changes in preschool children's communication. Conceptually grounded in the World Health Organization International Classification of Functioning, Disability and Health framework, the FOCUS items were derived…

The impact of self-efficacy, expectations, and readiness on hearing aid outcomes.

PubMed

Ferguson, Melanie A; Woolley, Annie; Munro, Kevin J

2016-07-01

To examine the impact of self-efficacy and expectations for hearing aids, and readiness to improve hearing, on hearing aid outcome measures in first-time adult hearing aid users Design: A prospective, single centre design. Predictor variables measured at the hearing assessment included measures of self-efficacy, expectations and readiness to improve hearing. Outcome measures obtained at six-week follow-up were the Glasgow Hearing Aid Benefit Profile and Satisfaction with Amplification in Daily Life. A sample of 30 first-time adult hearing aid users were recruited through a public-sector funded audiology clinic. When measured prior to hearing aid fitting, self-efficacy for hearing aids predicted satisfaction with hearing aids but was not related to other hearing aid outcomes. Expectations of hearing aids, in particular positive expectations, and readiness to improve hearing predicted outcomes for hearing aid satisfaction and benefit, although not hearing aid use. Hearing sensitivity was not correlated with hearing aid outcomes. These results suggest that assessment of expectations of hearing aids, and readiness to improve hearing, may be useful to help identify individuals attending audiology clinics who would most likely benefit from hearing aid provision.

Computer-assisted cognitive remediation therapy: cognition, self-esteem and quality of life in schizophrenia.

PubMed

Garrido, Gemma; Barrios, Maite; Penadés, Rafael; Enríquez, Maria; Garolera, Maite; Aragay, Núria; Pajares, Marta; Vallès, Vicenç; Delgado, Luis; Alberni, Joan; Faixa, Carlota; Vendrell, Josep M

2013-11-01

Quality of life (QoL) is an important outcome in the treatment of schizophrenia. Cognitive deficits have an impact on functional outcomes. Cognitive remediation therapy is emerging as a psychological intervention that targets cognitive impairment, but the effect of computer-assisted cognitive remediation on neuropsychology and social functioning and wellbeing remains unclear. The aim of the current study is to investigate the neurocognitive outcomes of computer-assisted cognitive remediation (CACR) therapy in a sample of schizophrenia patients, and to measure the quality of life and self-esteem as secondary outcomes. Sixty-seven people with schizophrenia were randomly assigned to computer-assisted cognitive remediation or an active control condition. The main outcomes were neuropsychological measures and secondary outcomes (self-esteem and quality of life). Measurements were recorded at baseline and post-treatment. The CACR therapy group improved in speed of processing, working memory and reasoning and problem-solving cognitive domains. QoL and self-esteem measures also showed significant improvements over time in this group. Computer-assisted cognitive remediation therapy for people with schizophrenia achieved improvements in neuropsychological performance and in QoL and self-esteem measurements. © 2013 Elsevier B.V. All rights reserved.

The art and science of using routine outcome measurement in mental health benchmarking.

PubMed

McKay, Roderick; Coombs, Tim; Duerden, David

2014-02-01

To report and critique the application of routine outcome measurement data when benchmarking Australian mental health services. The experience of the authors as participants and facilitators of benchmarking activities is augmented by a review of the literature regarding mental health benchmarking in Australia. Although the published literature is limited, in practice, routine outcome measures, in particular the Health of the National Outcomes Scales (HoNOS) family of measures, are used in a variety of benchmarking activities. Use in exploring similarities and differences in consumers between services and the outcomes of care are illustrated. This requires the rigour of science in data management and interpretation, supplemented by the art that comes from clinical experience, a desire to reflect on clinical practice and the flexibility to use incomplete data to explore clinical practice. Routine outcome measurement data can be used in a variety of ways to support mental health benchmarking. With the increasing sophistication of information development in mental health, the opportunity to become involved in benchmarking will continue to increase. The techniques used during benchmarking and the insights gathered may prove useful to support reflection on practice by psychiatrists and other senior mental health clinicians.

Updating the OMERACT filter: core areas as a basis for defining core outcome sets.

PubMed

Kirwan, John R; Boers, Maarten; Hewlett, Sarah; Beaton, Dorcas; Bingham, Clifton O; Choy, Ernest; Conaghan, Philip G; D'Agostino, Maria-Antonietta; Dougados, Maxime; Furst, Daniel E; Guillemin, Francis; Gossec, Laure; van der Heijde, Désirée M; Kloppenburg, Margreet; Kvien, Tore K; Landewé, Robert B M; Mackie, Sarah L; Matteson, Eric L; Mease, Philip J; Merkel, Peter A; Ostergaard, Mikkel; Saketkoo, Lesley Ann; Simon, Lee; Singh, Jasvinder A; Strand, Vibeke; Tugwell, Peter

2014-05-01

The Outcome Measures in Rheumatology (OMERACT) Filter provides guidelines for the development and validation of outcome measures for use in clinical research. The "Truth" section of the OMERACT Filter presupposes an explicit framework for identifying the relevant core outcomes that are universal to all studies of the effects of intervention effects. There is no published outline for instrument choice or development that is aimed at measuring outcome, was derived from broad consensus over its underlying philosophy, or includes a structured and documented critique. Therefore, a new proposal for defining core areas of measurement ("Filter 2.0 Core Areas of Measurement") was presented at OMERACT 11 to explore areas of consensus and to consider whether already endorsed core outcome sets fit into this newly proposed framework. Discussion groups critically reviewed the extent to which case studies of current OMERACT Working Groups complied with or negated the proposed framework, whether these observations had a more general application, and what issues remained to be resolved. Although there was broad acceptance of the framework in general, several important areas of construction, presentation, and clarity of the framework were questioned. The discussion groups and subsequent feedback highlighted 20 such issues. These issues will require resolution to reach consensus on accepting the proposed Filter 2.0 framework of Core Areas as the basis for the selection of Core Outcome Domains and hence appropriate Core Outcome Sets for clinical trials.

Liaison psychiatry for older adults in the general hospital: service activity, development and outcomes.

PubMed

Mujic, Fedza; Cairns, Ruth; Mak, Vivienne; Squire, Clare; Wells, Andrew; Al-Harrasi, Ahmed; Prince, Martin

2018-02-01

Aims and method This study used data collected to describe the activity, case-load characteristics and outcome measures for all patients seen during a 6-year period. The service reviewed 2153 patients over 6 years with referral rates and case-load characteristics comparable to those described in a previous study period. The team saw 82% of patients on the day they were referred. Data and outcome measures collected showed significant complexity in the cases seen and statistically significant improvement in Health of the Nation Outcome Scales (HoNOS) scores following service input. Clinical implications The outcome measures used were limited, but the study supports the need for specialist liaison psychiatry for older adults (LPOA) services in the general hospital. The Framework of Outcome Measures - Liaison Psychiatry has now been introduced, but it remains unclear how valid this is in LPOA. It is of note that cost-effectiveness secondary to service input and training activities are not adequately monitored. Declaration of interest None.

Solutions for filling gaps in accountable care measure sets.

PubMed

Valuck, Tom; Dugan, Donna; Dubois, Robert W; Westrich, Kimberly; Penso, Jerry; McClellan, Mark

2015-10-01

A primary objective of accountable care is to support providers in reforming care to improve outcomes and lower costs. Gaps in accountable care measure sets may cause missed opportunities for improvement and missed signals of problems in care. Measures to balance financial incentives may be particularly important for high-cost conditions or specialty treatments. This study explored gaps in measure sets for specific conditions and offers strategies for more comprehensive measurement that do not necessarily require more measures. A descriptive analysis of measure gaps in accountable care programs and proposed solutions for filling the gaps. We analyzed gaps in 2 accountable care organization measure sets for 20 high-priority clinical conditions by comparing the measures in those sets with clinical guidelines and assessing the use of outcome measures. Where we identified gaps, we looked for existing measures to address the gaps. Gaps not addressed by existing measures were considered areas for measure development or measurement strategy refinement. We found measure gaps across all 20 conditions, including those conditions that are commonly addressed in current measure sets. In addition, we found many gaps that could not be filled by existing measures. Results across all 20 conditions informed recommendations for measure set improvement. Addressing all gaps in accountable care measure sets with more of the same types of measures and approaches to measurement would require an impractical number of measures and would miss the opportunity to use better measures and innovative approaches. Strategies for effectively filling measure gaps include using preferred measure types such as cross-cutting, outcome, and patient-reported measures. Program implementers should also apply new approaches to measurement, including layered and modular models.

Measure of functional independence dominates discharge outcome prediction after inpatient rehabilitation for stroke.

PubMed

Brown, Allen W; Therneau, Terry M; Schultz, Billie A; Niewczyk, Paulette M; Granger, Carl V

2015-04-01

Identifying clinical data acquired at inpatient rehabilitation admission for stroke that accurately predict key outcomes at discharge could inform the development of customized plans of care to achieve favorable outcomes. The purpose of this analysis was to use a large comprehensive national data set to consider a wide range of clinical elements known at admission to identify those that predict key outcomes at rehabilitation discharge. Sample data were obtained from the Uniform Data System for Medical Rehabilitation data set with the diagnosis of stroke for the years 2005 through 2007. This data set includes demographic, administrative, and medical variables collected at admission and discharge and uses the FIM (functional independence measure) instrument to assess functional independence. Primary outcomes of interest were functional independence measure gain, length of stay, and discharge to home. The sample included 148,367 people (75% white; mean age, 70.6±13.1 years; 97% with ischemic stroke) admitted to inpatient rehabilitation a mean of 8.2±12 days after symptom onset. The total functional independence measure score, the functional independence measure motor subscore, and the case-mix group were equally the strongest predictors for any of the primary outcomes. The most clinically relevant 3-variable model used the functional independence measure motor subscore, age, and walking distance at admission (r(2)=0.107). No important additional effect for any other variable was detected when added to this model. This analysis shows that a measure of functional independence in motor performance and age at rehabilitation hospital admission for stroke are predominant predictors of outcome at discharge in a uniquely large US national data set. © 2015 American Heart Association, Inc.

Measurement properties of performance-based outcome measures to assess physical function in young and middle-aged people known to be at high risk of hip and/or knee osteoarthritis: a systematic review.

PubMed

Kroman, S L; Roos, E M; Bennell, K L; Hinman, R S; Dobson, F

2014-01-01

To systematically appraise the evidence on measurement properties of performance-based outcome measures to assess physical function in young and middle-aged people known to be at high risk of hip and/or knee osteoarthritis (OA). Electronic searches were performed in MEDLINE, CINAHL, Scopus and SPORTDiscus in May 2013. Two reviewers independently rated the measurement properties using the 4-point COSMIN checklist. Best evidence synthesis was made using COSMIN quality, consistency and direction of findings and sample size. Twenty of 2736 papers were eligible for inclusion and 24 different performance-based outcome measures knee or obese populations were evaluated. No tests related to hip populations were included. Twenty-five measurement properties including reliability (nine studies), construct validity (hypothesis testing) (nine studies), measurement error (three studies), structural validity (two studies), interpretability (one study) and responsiveness (one study) were evaluated. A positive rating was given to 12.5% (30/240) of all possible measurement ratings. Tests were grouped into two categories based on the population characteristics. The one-legged hop for distance, followed by the 6-m timed hop and cross over hop for distance were the best-rated tests for the knee-injured population. Whereas the 6-min walk test was the only included test for the obese population. This review highlights the many gaps in knowledge about the measurement properties of performance-based outcome measures for young and middle-aged people known to be at high risk of hip and/or knee OA. There is a need for consensus on which outcome measures should be used and/or combined when assessing physical function in this population. Further good quality research is required. Copyright © 2013 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

Parameters and Measures in Assessment of Motor Learning in Neurorehabilitation; A Systematic Review of the Literature

PubMed Central

Shishov, Nataliya; Melzer, Itshak; Bar-Haim, Simona

2017-01-01

Upper limb function, essential for daily life, is often impaired in individuals after stroke and cerebral palsy (CP). For an improved upper limb function, learning should occur, and therefore training with motor learning principles is included in many rehabilitation interventions. Despite accurate measurement being an important aspect for examination and optimization of treatment outcomes, there are no standard algorithms for outcome measures selection. Moreover, the ability of the chosen measures to identify learning is not well established. We aimed to review and categorize the parameters and measures utilized for identification of motor learning in stroke and CP populations. PubMed, Pedro, and Web of Science databases were systematically searched between January 2000 and March 2016 for studies assessing a form of motor learning following upper extremity training using motor control measures. Thirty-two studies in persons after stroke and 10 studies in CP of any methodological quality were included. Identified outcome measures were sorted into two categories, “parameters,” defined as identifying a form of learning, and “measures,” as tools measuring the parameter. Review's results were organized as a narrative synthesis focusing on the outcome measures. The included studies were heterogeneous in their study designs, parameters and measures. Parameters included adaptation (n = 6), anticipatory control (n = 2), after-effects (n = 3), de-adaptation (n = 4), performance (n = 24), acquisition (n = 8), retention (n = 8), and transfer (n = 14). Despite motor learning theory's emphasis on long-lasting changes and generalization, the majority of studies did not assess the retention and transfer parameters. Underlying measures included kinematic analyses in terms of speed, geometry or both (n = 39), dynamic metrics, measures of accuracy, consistency, and coordination. There is no exclusivity of measures to a specific parameter. Many factors affect task performance and the ability to measure it—necessitating the use of several metrics to examine different features of movement and learning. Motor learning measures' applicability to clinical setting can benefit from a treatment-focused approach, currently lacking. The complexity of motor learning results in various metrics, utilized to assess its occurrence, making it difficult to synthesize findings across studies. Further research is desirable for development of an outcome measures selection algorithm, while considering the quality of such measurements. PMID:28286474

Barriers to the routine collection of health outcome data in an Australian community care organization.

PubMed

Nancarrow, Susan A

2013-01-01

For over a decade, organizations have attempted to include the measurement and reporting of health outcome data in contractual agreements between funders and health service providers, but few have succeeded. This research explores the utility of collecting health outcomes data that could be included in funding contracts for an Australian Community Care Organisation (CCO). An action-research methodology was used to trial the implementation of outcome measurement in six diverse projects within the CCO using a taxonomy of interventions based on the International Classification of Function. The findings from the six projects are presented as vignettes to illustrate the issues around the routine collection of health outcomes in each case. Data collection and analyses were structured around Donabedian's structure-process-outcome triad. Health outcomes are commonly defined as a change in health status that is attributable to an intervention. This definition assumes that a change in health status can be defined and measured objectively; the intervention can be defined; the change in health status is attributable to the intervention; and that the health outcomes data are accessible. This study found flaws with all of these assumptions that seriously undermine the ability of community-based organizations to introduce routine health outcome measurement. Challenges were identified across all stages of the Donabedian triad, including poor adherence to minimum dataset requirements; difficulties standardizing processes or defining interventions; low rates of use of outcome tools; lack of value of the tools to the service provider; difficulties defining or identifying the end point of an intervention; technical and ethical barriers to accessing data; a lack of standardized processes; and time lags for the collection of data. In no case was the use of outcome measures sustained by any of the teams, although some quality-assurance measures were introduced as a result of the project.

How to measure the outcomes of chronic disease management.

PubMed

Lewis, Al

2009-02-01

The fastest-growing methodology for disease management outcomes measurement is valid, transparent, easy to apply, and freely available in the public domain and this article. It measures the actual goal of disease management, which is to reduce the rate of adverse events associated with the disease(s) being managed. Changes in this rate can be translated into a return on investment using some explicit assumptions about comorbidities and episode costs. Outcomes measured in this way show that in the health plan community as a whole, disease management in the broadest sense is working, as measured by the relative stability in the rate of adverse medical events closely associated with common chronic disease during this decade of increasing prevalence of most of the common chronic conditions.

Outcome Measures for Clinical Trials in Down Syndrome.

PubMed

Esbensen, Anna J; Hooper, Stephen R; Fidler, Deborah; Hartley, Sigan L; Edgin, Jamie; d'Ardhuy, Xavier Liogier; Capone, George; Conners, Frances A; Mervis, Carolyn B; Abbeduto, Leonard; Rafii, Michael; Krinsky-McHale, Sharon J; Urv, Tiina

2017-05-01

Increasingly individuals with intellectual and developmental disabilities, including Down syndrome, are being targeted for clinical trials. However, a challenge exists in effectively evaluating the outcomes of these new pharmacological interventions. Few empirically evaluated, psychometrically sound outcome measures appropriate for use in clinical trials with individuals with Down syndrome have been identified. To address this challenge, the National Institutes of Health (NIH) assembled leading clinicians and scientists to review existing measures and identify those that currently are appropriate for trials; those that may be appropriate after expansion of age range addition of easier items, and/or downward extension of psychometric norms; and areas where new measures need to be developed. This article focuses on measures in the areas of cognition and behavior.

Evaluation of the measurement properties of symptom measurement instruments for atopic eczema: a systematic review.

PubMed

Gerbens, L A A; Prinsen, C A C; Chalmers, J R; Drucker, A M; von Kobyletzki, L B; Limpens, J; Nankervis, H; Svensson, Å; Terwee, C B; Zhang, J; Apfelbacher, C J; Spuls, P I

2017-01-01

Symptoms have been identified as a core outcome domain for atopic eczema (AE) trials. Various instruments exist to measure symptoms in AE, but they vary in quality and there is a lack of standardization between clinical trials. Our objective was to systematically evaluate the quality of the evidence on the measurement properties of AE symptom instruments, thereby informing consensus discussions within the Harmonising Outcome Measures for Eczema (HOME) initiative regarding the most appropriate instruments for the core outcome domain symptoms. Using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist and predefined criteria for good measurement properties on identified development and validation studies of AE symptom instruments, a best evidence synthesis was performed to draw an overall conclusion on quality of the instruments and to provide recommendations. Eighteen instruments were identified and evaluated. When the quality and results of the studies were considered, only five of these instruments had sufficient validation data to consider them for the core outcome set for the core outcome domain symptoms. These were the paediatric Itch Severity Scale (ISS), Patient-Oriented Eczema Measure (POEM), Patient-Oriented SCOring Atopic Dermatitis (PO-SCORAD), Self-Administered Eczema Area and Severity Index (SA-EASI) and adapted SA-EASI. ISS (paediatric version), POEM, PO-SCORAD, SA-EASI and adapted SA-EASI are currently the most appropriate instruments and therefore have the potential to be recommended as core symptom instrument in future clinical trials. These findings will be utilized for the development of a core outcome set for AE. © 2016 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

Power Calculations to Select Instruments for Clinical Trial Secondary Endpoints. A Case Study of Instrument Selection for Post-Traumatic Stress Symptoms in Subjects with Acute Respiratory Distress Syndrome

PubMed Central

Schoenfeld, David A.; Brown, Samuel M.; Hough, Catherine L.; Yealy, Donald M.; Moss, Marc; Angus, Derek C.; Iwashyna, Theodore J.

2017-01-01

Rationale: After the sample size of a randomized clinical trial (RCT) is set by the power requirement of its primary endpoint, investigators select secondary endpoints while unable to further adjust sample size. How the sensitivity and specificity of an instrument used to measure these outcomes, together with their expected underlying event rates, affect an RCT’s power to measure significant differences in these outcomes is poorly understood. Objectives: Motivated by the design of an RCT of neuromuscular blockade in acute respiratory distress syndrome, we examined how power to detect a difference in secondary endpoints varies with the sensitivity and specificity of the instrument used to measure such outcomes. Methods: We derived a general formula and Stata code for calculating an RCT’s power to detect differences in binary outcomes when such outcomes are measured with imperfect sensitivity and specificity. The formula informed the choice of instrument for measuring post-traumatic stress–like symptoms in the Reevaluation of Systemic Early Neuromuscular Blockade RCT (www.clinicaltrials.gov identifier NCT02509078). Measurements and Main Results: On the basis of published sensitivities and specificities, the Impact of Events Scale-Revised was predicted to measure a 36% symptom rate, whereas the Post-Traumatic Stress Symptoms instrument was predicted to measure a 23% rate, if the true underlying rate of post-traumatic stress symptoms were 25%. Despite its lower sensitivity, the briefer Post-Traumatic Stress Symptoms instrument provided superior power to detect a difference in rates between trial arms, owing to its higher specificity. Conclusions: Examining instruments’ power to detect differences in outcomes may guide their selection when multiple instruments exist, each with different sensitivities and specificities. PMID:27788018

Outcome measures in coeliac disease trials: the Tampere recommendations.

PubMed

Ludvigsson, Jonas F; Ciacci, Carolina; Green, Peter Hr; Kaukinen, Katri; Korponay-Szabo, Ilma R; Kurppa, Kalle; Murray, Joseph A; Lundin, Knut Erik Aslaksen; Maki, Markku J; Popp, Alina; Reilly, Norelle R; Rodriguez-Herrera, Alfonso; Sanders, David S; Schuppan, Detlef; Sleet, Sarah; Taavela, Juha; Voorhees, Kristin; Walker, Marjorie M; Leffler, Daniel A

2018-02-13

A gluten-free diet is the only treatment option of coeliac disease, but recently an increasing number of trials have begun to explore alternative treatment strategies. We aimed to review the literature on coeliac disease therapeutic trials and issue recommendations for outcome measures. Based on a literature review of 10 062 references, we (17 researchers and 2 patient representatives from 10 countries) reviewed the use and suitability of both clinical and non-clinical outcome measures. We then made expert-based recommendations for use of these outcomes in coeliac disease trials and identified areas where research is needed. We comment on the use of histology, serology, clinical outcome assessment (including patient-reported outcomes), quality of life and immunological tools including gluten immunogenic peptides for trials in coeliac disease. Careful evaluation and reporting of outcome measures will increase transparency and comparability of coeliac disease therapeutic trials, and will benefit patients, healthcare and the pharmaceutical industry. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Developing measures of community-relevant outcomes for violence prevention programs: a community-based participatory research approach to measurement.

PubMed

Hausman, Alice J; Baker, Courtney N; Komaroff, Eugene; Thomas, Nicole; Guerra, Terry; Hohl, Bernadette C; Leff, Stephen S

2013-12-01

Community-Based Participatory Research is a research paradigm that encourages community participation in designing and implementing evaluation research, though the actual outcome measures usually reflect the "external" academic researchers' view of program effect and the policy-makers' needs for decision-making. This paper describes a replicable process by which existing standardized psychometric scales commonly used in youth-related intervention programs were modified to measure indicators of program success defined by community partners. This study utilizes a secondary analysis of data gathered in the context of a community-based youth violence prevention program. Data were retooled into new measures developed using items from the Alabama Parenting Questionnaire, the Hare Area Specific Self-Esteem Scale, and the Youth Asset Survey. These measures evaluated two community-defined outcome indicators, "More Parental Involvement" and "Showing Kids Love." Results showed that existing scale items can be re-organized to create measures of community-defined outcomes that are psychometrically reliable and valid. Results also show that the community definitions of parent or parenting caregivers exemplified by the two indicators are similar to how these constructs have been defined in previous research, but they are not synonymous. There are nuanced differences that are important and worthy of better understanding, in part through better measurement.

Reference values for developing responsive functional outcome measures across the lifespan.

PubMed

McKay, Marnee J; Baldwin, Jennifer N; Ferreira, Paulo; Simic, Milena; Vanicek, Natalie; Burns, Joshua

2017-04-18

To generate a reference dataset of commonly performed functional outcome measures in 1,000 children and adults and investigate the influence of demographic, anthropometric, strength, and flexibility characteristics. Twelve functional outcome measures were collected from 1,000 healthy individuals aged 3-101 years: 6-minute walk test, 30-second chair stand test, timed stairs test, long jump, vertical jump, choice stepping reaction time, balance (Star Excursion Balance Test, tandem stance eyes open and closed, single-leg stance eyes closed), and dexterity (9-hole peg test, Functional Dexterity Test). Correlation and multiple regression analyses were performed to identify factors independently associated with each measure. Age- and sex-stratified reference values for functional outcome measures were generated. Functional performance increased through childhood and adolescence, plateaued during adulthood, and declined in older adulthood. While balance did not differ between the sexes, male participants generally performed better at gross motor tasks while female participants performed better at dexterous tasks. Height was the most consistent correlate of functional performance in children, while lower limb muscle strength was a major determinant in adolescents and adults. In older adults, age, lower limb strength, and joint flexibility explained up to 63% of the variance in functional measures. These normative reference values provide a framework to accurately track functional decline associated with neuromuscular disorders and assist development and validation of responsive outcome measures for therapeutic trials. © 2017 American Academy of Neurology.

The ICF Core Sets for hearing loss--researcher perspective. Part I: Systematic review of outcome measures identified in audiological research.

PubMed

Granberg, Sarah; Dahlström, Jennie; Möller, Claes; Kähäri, Kim; Danermark, Berth

2014-02-01

To review the literature in order to identify outcome measures used in research on adults with hearing loss (HL) as part of the ICF Core Sets development project, and to describe study and population characteristics of the reviewed studies. A systematic review methodology was applied using multiple databases. A comprehensive search was conducted and two search pools were created, pool I and pool II. The study population included adults (≥ 18 years of age) with HL and oral language as the primary mode of communication. 122 studies were included. Outcome measures were distinguished by 'instrument type', and 10 types were identified. In total, 246 (pool I) and 122 (pool II) different measures were identified, and only approximately 20% were extracted twice or more. Most measures were related to speech recognition. Fifty-one different questionnaires were identified. Many studies used small sample sizes, and the sex of participants was not revealed in several studies. The low prevalence of identified measures reflects a lack of consensus regarding the optimal outcome measures to use in audiology. Reflections and discussions are made in relation to small sample sizes and the lack of sex differentiation/descriptions within the included articles.

The reliability of eyetracking to assess attentional bias to threatening words in healthy individuals.

PubMed

Skinner, Ian W; Hübscher, Markus; Moseley, G Lorimer; Lee, Hopin; Wand, Benedict M; Traeger, Adrian C; Gustin, Sylvia M; McAuley, James H

2017-08-15

Eyetracking is commonly used to investigate attentional bias. Although some studies have investigated the internal consistency of eyetracking, data are scarce on the test-retest reliability and agreement of eyetracking to investigate attentional bias. This study reports the test-retest reliability, measurement error, and internal consistency of 12 commonly used outcome measures thought to reflect the different components of attentional bias: overall attention, early attention, and late attention. Healthy participants completed a preferential-looking eyetracking task that involved the presentation of threatening (sensory words, general threat words, and affective words) and nonthreatening words. We used intraclass correlation coefficients (ICCs) to measure test-retest reliability (ICC > .70 indicates adequate reliability). The ICCs(2, 1) ranged from -.31 to .71. Reliability varied according to the outcome measure and threat word category. Sensory words had a lower mean ICC (.08) than either affective words (.32) or general threat words (.29). A longer exposure time was associated with higher test-retest reliability. All of the outcome measures, except second-run dwell time, demonstrated low measurement error (<6%). Most of the outcome measures reported high internal consistency (α > .93). Recommendations are discussed for improving the reliability of eyetracking tasks in future research.

Review of Positive Psychology Outcome Measures for Chronic Illness, Traumatic Brain Injury and Older Adults: Adaptability in Dementia?

PubMed

Stoner, Charlotte R; Orrell, Martin; Spector, Aimee

2015-01-01

Despite positive psychology being increasingly recognised as an important agent in well-being, there is a lack of standardised outcome measures for psychosocial dementia research. This review assessed positive psychology outcome measures using standardised criterion in populations that were identified as having shared characteristics. It aimed to identify robust measures that were suitable for potential adaption or use within a dementia population. The review identified 16 positive psychology outcome measures (and 8 further psychometric assessments of these) within the constructs of resilience, self-efficacy, religiousness/spirituality, life valuation, sense of coherence, autonomy, resourcefulness and a combined measure (CASP-19). Scale development studies were subject to a quality assessment, and most were found to be lacking information on reproducibility and responsiveness. A wide range of measures within the constructs of positive psychology was identified as having potential utility for psychosocial research within a dementia population. Examples included the CD-RISC, GSWB, SWLS, MPAQ, RSOA and CASP-19. It is recommended that such scales are further adapted or validated for people with dementia. Underreporting of appropriate psychometric analyses hampered this review, and it is recommended that future authors endeavour to report such analyses. © 2015 S. Karger AG, Basel.

Patient-Oriented Eczema Measure (POEM), a core instrument to measure symptoms in clinical trials: a Harmonising Outcome Measures for Eczema (HOME) statement.

PubMed

Spuls, P I; Gerbens, L A A; Simpson, E; Apfelbacher, C J; Chalmers, J R; Thomas, K S; Prinsen, C A C; von Kobyletzki, L B; Singh, J A; Williams, H C; Schmitt, J

2017-04-01

The Harmonising Outcome Measures for Eczema (HOME) initiative has defined four core outcome domains for a core outcome set (COS) to be measured in all atopic eczema (AE) trials to ensure cross-trial comparison: clinical signs, symptoms, quality of life and long-term control. The aim of this paper is to report on the consensus process that was used to select the core instrument to consistently assess symptoms in all future AE trials. Following the HOME roadmap, two systematic reviews were performed which identified three instruments that had sufficient evidence of validity, reliability and feasibility to be considered for the final COS. At the fourth international HOME meeting, there was broad consensus among all stakeholders that the Patient-Oriented Eczema Measure (POEM) should be used as the core instrument (87·5% agreed, 9·4% unsure, 3·1% disagreed). All relevant stakeholders are encouraged to use POEM as the chosen instrument to measure the core domain of symptoms in all future AE clinical trials. Other instruments of interest can be used in addition to POEM. © 2016 British Association of Dermatologists.

Measuring Exposure Opportunities: Using Exogenous Measures in Assessing Effects of Media Exposure on Smoking Outcomes

PubMed Central

Liu, Jiaying; Hornik, Robert

2016-01-01

Measurement of exposure has long been one of the most central and fundamental issues in communication research. While self-reported measures remain dominant in the field, alternative approaches such as exogenous or hybrid measures have received increasing scholarly attention and been employed in various contexts for the estimation of media exposure; however, systematic scrutiny of such measures is thin. This study aims to address the gap by systematically reviewing the studies which utilized exogenous or hybrid exposure measures for examining the effects of media exposure on tobacco-related outcomes. We then proceed to discuss the strengths and weaknesses, current developments in this class of measurement, drawing some implications for the appropriate utilization of exogenous and hybrid measures. PMID:27746848

Characterizing smoking topography of cannabis in heavy users

PubMed Central

Stitzer, Maxine L.; Vandrey, Ryan

2013-01-01

Rationale Little is known about the smoking topography characteristics of heavy cannabis users. Such measures may be able to predict cannabis use-related outcomes and could be used to validate self-reported measures of cannabis use. Objectives The current study was conducted to measure cannabis smoking topography characteristics during periods of ad libitum use and to correlate topography assessments with measures of self-reported cannabis use, withdrawal and craving during abstinence, and cognitive task performance. Methods Participants (N=20) completed an inpatient study in which they alternated between periods of ad libitum cannabis use and abstinence. Measures of self-reported cannabis use, smoking topography, craving, withdrawal, and sleep measures were collected. Results Participants smoked with greater intensity (e.g., greater volume, longer duration) on initial cigarette puffs with a steady decline on subsequent puffs. Smoking characteristics were significantly correlated with severity of withdrawal, notably sleep quality and architecture, and craving during abstinence, suggesting dose-related effects of cannabis use on these outcomes. Smoking characteristics generally were not significantly associated with cognitive performance. Smoking topography measures were significantly correlated with self-reported measures of cannabis use, indicating validity of these assessments, but topography measures were more sensitive than self-report in predicting cannabis-related outcomes. Conclusions A dose–effect relationship between cannabis consumption and outcomes believed to be clinically important was observed. With additional research, smoking topography assessments may become a useful clinical tool. PMID:21922170

A Binomial Test of Group Differences with Correlated Outcome Measures

ERIC Educational Resources Information Center

Onwuegbuzie, Anthony J.; Levin, Joel R.; Ferron, John M.

2011-01-01

Building on previous arguments for why educational researchers should not provide effect-size estimates in the face of statistically nonsignificant outcomes (Robinson & Levin, 1997), Onwuegbuzie and Levin (2005) proposed a 3-step statistical approach for assessing group differences when multiple outcome measures are individually analyzed…

Early childhood growth and cognitive outcomes: Findings from the MAL-ED study.

PubMed

Scharf, Rebecca J; Rogawski, Elizabeth T; Murray-Kolb, Laura E; Maphula, Angelina; Svensen, Erling; Tofail, Fahmida; Rasheed, Muneera; Abreu, Claudia; Vasquez, Angel Orbe; Shrestha, Rita; Pendergast, Laura; Mduma, Estomih; Koshy, Beena; Conaway, Mark R; Platts-Mills, James A; Guerrant, Richard L; DeBoer, Mark D

2018-02-02

Although many studies around the world hope to measure or improve developmental progress in children to promote community flourishing and productivity, growth is sometimes used as a surrogate because cognitive skills are more difficult to measure. Our objective was to assess how childhood measures of anthropometry correlate with measures of child development in low-income settings with high prevalence of poor nutrition and enteric disease, to inform studies considering growth outcomes in the absence of direct child developmental skill assessment. Children from the MAL-ED study were followed from birth to 24 months of age in field sites in 8 low- and middle-income countries across 3 continents. Monthly weight, length, and head circumference measurements were performed. At 24 months, the Bayley Scales of Infant and Toddler Development was administered. We correlated cognitive measures at 24 months with anthropometric measurements from birth to 2 years comparing 3 constructs: absolute attained monthly measures, summative difference in measures from the mean growth curve, and rate of change in measures. Growth faltering at multiple time periods is related to Bayley cognitive outcomes at 24 months. Birthweight, overall growth by 18-24 months, and rate of growth in the 6- to 18-month period were most associated with 24-month developmental scores. In this study, head circumference measurements, compared with length, was more closely linked to cognitive scores at 24 months. Notably, all studies between growth and cognitive outcomes exhibited low r 2 values (0.001-0.049). Anthropometric measures, particularly head circumference, were related to cognitive development, although explaining a low percent of variance. When feasible, direct measures of child development may be more useful. © 2018 John Wiley & Sons Ltd.

Osteoarthritis year in review: rehabilitation and outcomes.

PubMed

Davis, A M

2012-03-01

This review highlights seminal publications of rehabilitation interventions and outcomes in osteoarthritis (OA) of the hip or knee. Medline, CINAHL, and Embase databases from September 2010 through August 2011 were searched using the key words 'osteoarthritis', rehabilitation, physical therapy, exercise, and outcome(s), limited to human and English. Rehabilitation intervention studies were included if they were randomized trials (RCT), systematic reviews or meta-analyses. Studies of surgical interventions were excluded unless they included evaluation of a rehabilitation intervention. Outcome studies were included if they contributed methodologically to advancing outcome measurement. Reviews of measurement properties of outcomes were excluded. Eight publications were selected and reviewed that relate to interventions evaluating manual therapy in hip or knee OA, tele-rehabilitation and performance and participation measures as outcomes. One systematic review of hip and knee OA, one meta-analysis of knee OA provide limited support for the benefit of manual therapy with exercise for improving pain and function to a lesser extent in the short-term (3 months). Study quality overall was low. One high quality RCT in knee replacement of usual outpatient physiotherapy vs internet-based tele-rehabilitation based on a non-inferiority analysis demonstrated comparable outcomes on Western Ontario McMaster Universities' Osteoarthritis questionnaire (WOMAC) pain and function and performance measures. Three studies demonstrated that observed performance measures such as timed walk tests and stair-climbing and timed-up-and-go measure concepts differ from self-report of difficulty with physical function. Additionally, two studies showed differential times of recovery following total knee replacement (TKR). Two studies evaluated participation. One demonstrated the conceptual distinction of activity limitations and participation and a second re-analyzed trial data from knee OA studies. In one study, there were larger effects in combined activity/participation than for activity alone for arthroscopic lavage compared to intraarticular steroid and, in a second study, the effect was larger for activity with an advanced pharmacy intervention whereas the physiotherapy intervention demonstrated a larger effect for activity/participation. Interventions of manual therapy for hip and knee OA provided limited evidence of effectiveness. These studies are of limited quality due to lack of blinding and disclosure of co-intervention. Tele-rehabilitation may be a viable option to improve access to rehabilitation post joint replacement for those in rural and remote areas. Data continue to support the need to include performance measures as well as patient-reported outcomes in evaluating outcomes in OA. Additionally, measures of participation should be considered as core outcomes. Copyright © 2012 Osteoarthritis Research Society International. Published by Elsevier Ltd. All rights reserved.

DEFINING THE RELEVANT OUTCOME MEASURES IN MEDICAL DEVICE ASSESSMENTS: AN ANALYSIS OF THE DEFINITION PROCESS IN HEALTH TECHNOLOGY ASSESSMENT.

PubMed

Jacobs, Esther; Antoine, Sunya-Lee; Prediger, Barbara; Neugebauer, Edmund; Eikermann, Michaela

2017-01-01

Defining relevant outcome measures for clinical trials on medical devices (MD) is complex, as there is a large variety of potentially relevant outcomes. The chosen outcomes vary widely across clinical trials making the assessment in evidence syntheses very challenging. The objective is to provide an overview on the current common procedures of health technology assessment (HTA) institutions in defining outcome measures in MD trials. In 2012-14, the Web pages of 126 institutions involved in HTA were searched for methodological manuals written in English or German that describe methods for the predefinition process of outcome measures. Additionally, the institutions were contacted by email. Relevant information was extracted. All process steps were performed independently by two reviewers. Twenty-four manuals and ten responses from the email request were included in the analysis. Overall, 88.5 percent of the institutions describe the type of outcomes that should be considered in detail and 84.6 percent agree that the main focus should be on patient relevant outcomes. Specifically related to MD, information could be obtained in 26 percent of the included manuals and email responses. Eleven percent of the institutions report a particular consideration of MD related outcomes. This detailed analysis on common procedures of HTA institutions in the context of defining relevant outcome measures for the assessment of MD shows that standardized procedures for MD from the perspective of HTA institutions are not widespread. This leads to the question if a homogenous approach should be implemented in the field of HTA on MD.

Alternatives to Traditional EMS Dispatch and Transport: A Scoping Review of Reported Outcomes.

PubMed

Jensen, Jan L; Carter, Alix J E; Rose, Jennifer; Visintini, Sarah; Bourdon, Emmanuelle; Brown, Ryan; McVey, Jennifer; Travers, Andrew H

2015-09-01

Emergency medical services (EMS) programs, which provide an alternative to traditional EMS dispatch or transport to the emergency department (ED), are becoming widely implemented. This scoping review identified and catalogued all outcomes used to measure such alternative EMS programs. Data Source Broad systematized bibliographic and grey literature searches were conducted. Study Selection Inclusion criteria were 911 callers/EMS patients, reported on alternatives to traditional EMS dispatch OR traditional EMS transport to the ED, and reported an outcome measure. Data Extraction The reports were categorized as either alternative to dispatch or to EMS transport, and outcome measures were categorized and described. Data Synthesis The bibliographic search retrieved 13,215 records, of which 34 articles met the inclusion criteria, with an additional 10 added from reference list hand-searching (n=44 included). In the grey literature search, 31 websites were identified, from which four met criteria and were retrieved (n=4 included). Fifteen reports (16 studies) described alternatives to EMS dispatch, and 33 reports described alternatives to EMS transport. The most common outcomes reported in the alternatives to EMS dispatch reports were service utilization and decision accuracy. Twenty-four different specific outcomes were reported. The most common outcomes reported in the alternatives to EMS transport reports were service utilization and safety, and 50 different specific outcomes were reported. Numerous outcome measures were identified in reports of alternative EMS programs, which were catalogued and described. Researchers and program leaders should achieve consensus on uniform outcome measures, to allow benchmarking and improve comparison across programs.

Measurement of health outcomes.

PubMed

Thavorncharoensap, Montarat

2014-05-01

Health outcomes are one of the most important components of health technology assessments (HTAs). All HTA outcomes should be measured from a relevant sample using a properly designed study and method. A number of recommendations on health outcome measurements are made in this second edition of Thailand's HTA guidelines. In particular the use of final outcomes, rather than surrogate outcomes, in HTAs is stressed. Where surrogate outcomes are used, strong justification and evidence must be provided. Effectiveness is preferred over efficacy. The relative treatment effect (the difference between health outcome that would be experienced by patients receiving the technology and that experienced by the same group were they to receive an alternative technology) should be derived from a systematic review of head-to-head RCTs. Mixed treatment comparison (MTC) should be used only to provide supplementary data that cannot be obtained from a head-to-head comparison. Where no direct comparison evidence exists, indirect comparison and observational study data can be used.

Outcome related to impact on daily living: preliminary validation of the ORIDL instrument.

PubMed

Reilly, David; Mercer, Stewart W; Bikker, Annemieke P; Harrison, Tansy

2007-09-02

The challenge of finding practical, patient-rated outcome measures is a key issue in the evaluation of health care systems and interventions. The ORIDL (Outcome in Relation to Impact on Daily Living) instrument (formerly referred to as the Glasgow Homoeopathic Hospital Outcomes Scale or GHHOS) has been developed to measure patient's views of the outcome of their care by asking about change, and relating this to impact on daily life. The aim of the present paper is to describe the background and potential uses of the ORIDL, and to report on its preliminary validation in a series of three studies in secondary and primary care. In the first study, 105 patients attending the Glasgow Homoeopathic Hospital (GHH) were followed-up at 12 months and changes in health status were measured by the EuroQol (EQOL) and the ORIDL. In the second study, 187 new patients at the GHH were followed-up at 3, 12, and 33 months, using the ORIDL, the Short Form 12 (SF-12), and the Measure Yourself Medical Outcome Profile (MYMOP). In study three, 323 patients in primary care were followed for 1 month post-consultation using the ORIDL and MYMOP. In all 3 studies the Patient Enablement Instrument (PEI) was also used as an outcome measure. Study 1 showed substantial improvements in main complaint and well-being over 12 months using the ORIDL, with two-thirds of patients reporting improvements in daily living. These improvements were not significantly correlated with changes in serial measures of the EQOL between baseline and 12 months, but were correlated with the EQOL transitions measure. Study 2 showed step-wise improvements in ORIDL scores between 3 and 33 months, which were only weakly associated with similar changes in SF-12 scores. However, MYMOP change scores correlated well with ORIDL scores at all time points. Study 3 showed similar high correlations between ORIDL scores and MYMOP scores. In all 3 studies, ORIDL scores were also significantly correlated with PEI-outcome scores. There is significant agreement between patient outcomes assessed by the ORIDL and the EQOL transition scale, the MYMOP, and the PEI-outcome instrument, suggesting that the ORIDL may be a valid and sensitive tool for measuring change in relation to impact on life.

The use of computer adaptive tests in outcome assessments following upper limb trauma.

PubMed

Jayakumar, P; Overbeek, C; Vranceanu, A-M; Williams, M; Lamb, S; Ring, D; Gwilym, S

2018-06-01

Aims Outcome measures quantifying aspects of health in a precise, efficient, and user-friendly manner are in demand. Computer adaptive tests (CATs) may overcome the limitations of established fixed scales and be more adept at measuring outcomes in trauma. The primary objective of this review was to gain a comprehensive understanding of the psychometric properties of CATs compared with fixed-length scales in the assessment of outcome in patients who have suffered trauma of the upper limb. Study designs, outcome measures and methodological quality are defined, along with trends in investigation. Materials and Methods A search of multiple electronic databases was undertaken on 1 January 2017 with terms related to "CATs", "orthopaedics", "trauma", and "anatomical regions". Studies involving adults suffering trauma to the upper limb, and undergoing any intervention, were eligible. Those involving the measurement of outcome with any CATs were included. Identification, screening, and eligibility were undertaken, followed by the extraction of data and quality assessment using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) criteria. The review is reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria and reg istered (PROSPERO: CRD42016053886). Results A total of 31 studies reported trauma conditions alone, or in combination with non-traumatic conditions using CATs. Most were cross-sectional with varying level of evidence, number of patients, type of study, range of conditions and methodological quality. CATs correlated well with fixed scales and had minimal or no floor-ceiling effects. They required significantly fewer questions and/or less time for completion. Patient-Reported Outcomes Measurement Information System (PROMIS) CATs were the most frequently used, and the use of CATs is increasing. Conclusion Early studies show valid and reliable outcome measurement with CATs performing as well as, if not better than, established fixed scales. Superior properties such as floor-ceiling effects and ease of use support their use in the assessment of outcome after trauma. As CATs are being increasingly used in patient outcomes research, further psychometric evaluation, especially involving longitudinal studies and groups of patients with specific injuries are required to inform clinical practice using these contemporary measures. Cite this article: Bone Joint J 2018;100-B:693-702.

Overview: Measuring Early Learning Quality and Outcomes (MELQO)

ERIC Educational Resources Information Center

Brookings Institution, 2017

2017-01-01

The Measuring Early Learning Quality and Outcomes (MELQO) initiative began in 2014 in anticipation of a new global emphasis on early childhood development (ECD). Led by UNESCO, the World Bank, the Center for Universal Education at the Brookings Institution, and UNICEF, the initiative aims to promote feasible, accurate and useful measurement of…

Capability Deprivation and Income Poverty in the United States, 1994 and 2004: Measurement Outcomes and Demographic Profiles

ERIC Educational Resources Information Center

Wagle, Udaya R.

2009-01-01

Shifting focus from income to capability signifies an important milestone toward accurately measuring poverty and deprivation. This paper operationalizes capability deprivation in the United States and compares measurement outcomes among various capability approaches and between capability and income spaces. Of the three capability approaches…

A Systematic Review of Measures of Activity Limitation for Children with Cerebral Palsy

ERIC Educational Resources Information Center

Harvey, Adrienne; Robin, Jonathan; Morris, Meg E.; Graham, H. Kerr; Baker, Richard

2008-01-01

This systematic review critically appraises the literature on the psychometric properties and clinical utility of evaluative activity limitation outcome measures used for children with cerebral palsy (CP). The search strategy yielded 29 articles for eight outcome measures that met the inclusion criteria for the review. The Gross Motor Function…

The Benchmarking Capacity of a General Outcome Measure of Academic Language in Science and Social Studies

ERIC Educational Resources Information Center

Mooney, Paul; Lastrapes, Renée E.

2016-01-01

The amount of research evaluating the technical merits of general outcome measures of science and social studies achievement is growing. This study targeted criterion validity for critical content monitoring. Questions addressed the concurrent criterion validity of alternate presentation formats of critical content monitoring and the measure's…

Elicited and Spontaneous Communicative Functions and Stability of Conversational Measures with Children Who Have Pragmatic Language Impairments

ERIC Educational Resources Information Center

Adams, Catherine; Lloyd, Julian

2005-01-01

Background: The preliminary phase of a project aimed at establishing appropriate outcome measures for intervention with children who have pragmatic language impairments (PLI) is reported. Assessment methods for children with PLI are considered in the context of developing outcome measures for intervention studies. Communicative function…

Outcome Measures for Early Childhood Intervention Services.

ERIC Educational Resources Information Center

Accreditation Council on Services for People with Disabilities, Landover, MD.

This collection of 21 suggested outcome measures for early childhood intervention services is intended to apply to all types of service and support program models for children (birth to age 5) with various developmental delays and/or disabilities. The measures are appropriate for either home-based or center-based service delivery models. Section 1…

The Softer Side of Learning: Measuring Students' Non-Cognitive Skills

ERIC Educational Resources Information Center

Egalite, Anna J.; Mills, Jonathan N.; Greene, Jay P.

2016-01-01

With an abundance of datasets of standardized test score data, researchers and education policymakers run the risk of focusing exclusively on the measurement of cognitive outcomes in key academic subjects such as math and reading at the expense of important non-cognitive outcomes. We use behavioral measures of conscientiousness, perseverance, and…

Examination of Attitude and Interest Measures for 4-H Science Evaluation

ERIC Educational Resources Information Center

Lewis, Kendra M.; Worker, Steven M.

2015-01-01

Science education research has demonstrated the influence of affect on learning. The National 4-H Science Logic Model outlines outcomes from youth participation in 4-H science programs, which includes attitude and interest outcomes. The associated measure, the National 4-H Science Common Measure, assesses these attitude constructs and not other…

Ethnic Composition and Heterogeneity in the Classroom: Their Measurement and Relationship with Student Outcomes

ERIC Educational Resources Information Center

Rjosk, Camilla; Richter, Dirk; Lüdtke, Oliver; Eccles, Jacquelynne Sue

2017-01-01

This study explores various measures of the ethnic makeup in a classroom and their relationship with student outcomes. We examine whether measures of ethnic diversity are related to achievement (mathematics, reading) and feeling of belonging with one's peers over and above commonly investigated composition characteristics. Multilevel analyses were…

The patient-specific functional scale: psychometrics, clinimetrics, and application as a clinical outcome measure.

PubMed

Horn, Katyana Kowalchuk; Jennings, Sophie; Richardson, Gillian; Vliet, Ditte Van; Hefford, Cheryl; Abbott, J Haxby

2012-01-01

Systematic review of the literature. To summarize peer-reviewed literature on the reliability, validity, and responsiveness of the Patient-Specific Functional Scale (PSFS), and to identify its use as an outcome measure. Searches were performed of several electronic databases from 1995 to May 2010. Studies included were published articles containing (1) primary research investigating the psychometric and clinimetrics of the PSFS or (2) the implementation of the PSFS as an outcome measure. We assessed the methodological quality of studies included in the first category. Two hundred forty-two articles published from 1994 to May 2010 were identified. Of these, 66 met the inclusion criteria for this review, with 13 reporting the measurement properties of the PSFS, 55 implementing the PSFS as an outcome measure, and 2 doing both of the above. The PSFS was reported to be valid, reliable, and responsive in populations with knee dysfunction, cervical radiculopathy, acute low back pain, mechanical low back pain, and neck dysfunction. The PSFS was found to be reliable and responsive in populations with chronic low back pain. The PSFS was also reported to be valid, reliable, or responsive in individuals with a limited number of acute, subacute, and chronic conditions. This review found that the PSFS is also being used as an outcome measure in many other conditions, despite a lack of published evidence supporting its validity in these conditions. Although the use of the PSFS as an outcome measure is increasing in physiotherapy practice, there are gaps in the research literature regarding its validity, reliability, and responsiveness in many health conditions.

Use of patient-reported outcome measures in foot and ankle research.

PubMed

Hunt, Kenneth J; Hurwit, Daniel

2013-08-21

In the orthopaedic literature, there is a wide range of clinical outcome measurement tools that have been used in evaluating foot and ankle procedures, disorders, and outcomes, with no broadly accepted consensus as to which tools are preferred. The purpose of this study was to determine the frequency and distribution of the various outcome instruments used in the foot and ankle literature, and to identify trends for use of these instruments over time. We conducted a systematic review of all original clinical articles reporting on foot and/or ankle topics in six orthopaedic journals over a ten-year period (2002 to 2011). All clinical patient-reported outcome rating instruments used in these articles were recorded, as were study date, study design, clinical topic, and level of evidence. A total of 878 clinical foot and ankle articles that used at least one patient-reported outcome measure were identified among 16,513 total articles published during the ten-year period. There were 139 unique clinical outcome scales used, and the five most popular scales (as a percentage of foot/ankle outcome articles) were the American Orthopaedic Foot & Ankle Society (AOFAS) scales (55.9%), visual analog scale (VAS) for pain (22.9%), Short Form-36 (SF-36) Health Survey (13.7%), Foot Function Index (FFI) (5.5%), and American Academy of Orthopaedic Surgeons (AAOS) outcomes instruments (3.3%). The majority of articles described Level-IV studies (70.1%); only 9.4% reported Level-I studies. A considerable variety of outcome measurement tools are used in the foot and ankle clinical literature, with a small proportion used consistently. The AOFAS scales continue to be used at a high rate relative to other scales that have been validated. Data from the present study underscore the need for a paradigm shift toward the use of consistent, valid, and reliable outcome measures for studies of foot and ankle procedures and disorders. It is not clear which existing validated outcome instruments will emerge as widely used and clinically meaningful. These data support the need for a paradigm shift toward the consistent use of valid and reliable outcome measures for foot and ankle clinical research.

Literature review of outcome parameters used in studies of Geriatric Fracture Centers.

PubMed

Liem, I S L; Kammerlander, C; Suhm, N; Kates, S L; Blauth, M

2014-02-01

A variety of multidisciplinary treatment models have been described to improve outcome after osteoporotic hip fractures. There is a tendency toward better outcomes after implementation of the most sophisticated model with a shared leadership for orthopedic surgeons and geriatricians; the Geriatric Fracture Center. The purpose of this review is to evaluate the use of outcome parameters in published literature on the Geriatric Fracture Center evaluation studies. A literature search was performed using Medline and the Cochrane Library to identify Geriatric Fracture Center evaluation studies. The outcome parameters used in the included studies were evaluated. A total of 16 outcome parameters were used in 11 studies to evaluate patient outcome in 8 different Geriatric Fracture Centers. Two of these outcome parameters are patient-reported outcome measures and 14 outcome parameters were objective measures. In-hospital mortality, length of stay, time to surgery, place of residence and complication rate are the most frequently used outcome parameters. The patient-reported outcomes included activities of daily living and mobility scores. There is a need for generally agreed upon outcome measures to facilitate comparison of different care models.

What quantum measurements measure

NASA Astrophysics Data System (ADS)

Griffiths, Robert B.

2017-09-01

A solution to the second measurement problem, determining what prior microscopic properties can be inferred from measurement outcomes ("pointer positions"), is worked out for projective and generalized (POVM) measurements, using consistent histories. The result supports the idea that equipment properly designed and calibrated reveals the properties it was designed to measure. Applications include Einstein's hemisphere and Wheeler's delayed choice paradoxes, and a method for analyzing weak measurements without recourse to weak values. Quantum measurements are noncontextual in the original sense employed by Bell and Mermin: if [A ,B ]=[A ,C ]=0 ,[B ,C ]≠0 , the outcome of an A measurement does not depend on whether it is measured with B or with C . An application to Bohm's model of the Einstein-Podolsky-Rosen situation suggests that a faulty understanding of quantum measurements is at the root of this paradox.

How to Measure Outcomes of Peripheral Nerve Surgery

PubMed Central

Wang, Yirong; Sunitha, Malay; Chung, Kevin C.

2013-01-01

Synopsis Evaluation of outcomes after peripheral nerve surgeries include a number of assessment methods that reflect different aspects of recovery, including reinnervation, tactile gnosis, integrated sensory and motor function, pain and discomfort, neurophysiological and patient- reported outcomes. This review makes a list of measurements addressing these aspects as well as advantage and disadvantage of each tool. Because of complexities of neurophysiology, assessment remains a difficult process, which requires researchers focus on measurements best relevant to specific conditions and research questions. PMID:23895715

How to measure outcomes of peripheral nerve surgery.

PubMed

Wang, Yirong; Sunitha, Malay; Chung, Kevin C

2013-08-01

Evaluation of outcomes after peripheral nerve surgeries include several assessment methods that reflect different aspects of recovery, including reinnervation, tactile gnosis, integrated sensory and motor function, pain and discomfort, and neurophysiologic and patient-reported outcomes. This review lists measurements addressing these aspects as well as the advantages and disadvantages of each tool. Because of complexities of neurophysiology, assessment remains a difficult process, which requires researchers to focus on measurements best relevant to specific conditions and research questions. Copyright © 2013 Elsevier Inc. All rights reserved.

Measuring Outcomes for Children Late Placed for Adoption.

ERIC Educational Resources Information Center

Rushton, Alan

1998-01-01

Describes the selection of outcome measures used by the Maudsley Family Research team to assess outcomes--across a broad range of developmental dimensions--of permanent placement for children and adolescents. Developed a package of instruments to examine child emotional, cognitive, social, and academic development; attachment; and self-esteem, for…

The Challenge Course Experience Questionnaire: A Facilitator's Assessment Tool

ERIC Educational Resources Information Center

Schary, David P.; Waldron, Alexis L.

2017-01-01

Challenge course programs influence a variety of psychological, social, and educational outcomes. Yet, many challenges exist when measuring challenge course outcomes like logistical constraints and a lack of specific assessment tools. This study piloted and tested an assessment tool designed for facilitators to measure participant outcomes in…

Methodological issues in the design and evaluation of supported communication for aphasia training: a cluster-controlled feasibility study

PubMed Central

Horton, Simon; Clark, Allan; Barton, Garry; Lane, Kathleen; Pomeroy, Valerie M

2016-01-01

Objective To assess the feasibility and acceptability of training stroke service staff to provide supported communication for people with moderate–severe aphasia in the acute phase; assess the suitability of outcome measures; collect data to inform sample size and Health Economic evaluation in a definitive trial. Design Phase II cluster-controlled, observer-blinded feasibility study. Settings In-patient stroke rehabilitation units in the UK matched for bed numbers and staffing were assigned to control and intervention conditions. Participants 70 stroke rehabilitation staff from all professional groups, excluding doctors, were recruited. 20 patients with moderate-severe aphasia were recruited. Intervention Supported communication for aphasia training, adapted to the stroke unit context versus usual care. Training was supplemented by a staff learning log, refresher sessions and provision of communication resources. Main outcome measures Feasibility of recruitment and acceptability of the intervention and of measures required to assess outcomes and Health Economic evaluation in a definitive trial. Staff outcomes: Measure of Support in Conversation; patient outcomes: Stroke and Aphasia Quality of Life Scale; Communicative Access Measure for Stroke; Therapy Outcome Measures for aphasia; EQ-5D-3L was used to assess health outcomes. Results Feasibility of staff recruitment was demonstrated. Training in the intervention was carried out with 28 staff and was found to be acceptable in qualitative reports. 20 patients consented to take part, 6 withdrew. 18 underwent all measures at baseline; 16 at discharge; and 14 at 6-month follow-up. Of 175 patients screened 71% were deemed to be ineligible, either lacking capacity or too unwell to participate. Poor completion rates impacted on assessment of patient outcomes. We were able to collect sufficient data at baseline, discharge and follow-up for economic evaluation. Conclusions The feasibility study informed components of the intervention and implementation in day-to-day practice. Modifications to the design are needed before a definitive cluster-randomised trial can be undertaken. Trial registration number ISRCTN37002304; Results. PMID:27091825

How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis

PubMed Central

Dalkin, Sonia; Gibbons, Elizabeth; Wright, Judy; Valderas, Jose Maria; Meads, David; Black, Nick

2017-01-01

Objectives Internationally, there has been considerable debate about the role of data in supporting quality improvement in health care. Our objective was to understand how, why and in what circumstances the feedback of aggregated patient-reported outcome measures data improved patient care. Methods We conducted a realist synthesis. We identified three main programme theories underlying the use of patient-reported outcome measures as a quality improvement strategy and expressed them as nine ‘if then’ propositions. We identified international evidence to test these propositions through searches of electronic databases and citation tracking, and supplemented our synthesis with evidence from similar forms of performance data. We synthesized this evidence through comparing the mechanisms and impact of patient-reported outcome measures and other performance data on quality improvement in different contexts. Results Three programme theories were identified: supporting patient choice, improving accountability and enabling providers to compare their performance with others. Relevant contextual factors were extent of public disclosure, use of financial incentives, perceived credibility of the data and the practicality of the results. Available evidence suggests that patients or their agents rarely use any published performance data when selecting a provider. The perceived motivation behind public reporting is an important determinant of how providers respond. When clinicians perceived that performance indicators were not credible but were incentivized to collect them, gaming or manipulation of data occurred. Outcome data do not provide information on the cause of poor care: providers needed to integrate and interpret patient-reported outcome measures and other outcome data in the context of other data. Lack of timeliness of performance data constrains their impact. Conclusions Although there is only limited research evidence to support some widely held theories of how aggregated patient-reported outcome measures data stimulate quality improvement, several lessons emerge from interventions sharing the same programme theories to help guide the increasing use of these measures. PMID:29260592

How is the sustainability of chronic disease health programmes empirically measured in hospital and related healthcare services?—a scoping review

PubMed Central

Francis, Linda; Dunt, David; Cadilhac, Dominique A

2016-01-01

Objectives Programmes to address chronic disease are a focus of governments worldwide. Despite growth in ‘implementation science’, there is a paucity of knowledge regarding the best means to measure sustainability. The aim of this review was to summarise current practice for measuring sustainability outcomes of chronic disease health programmes, providing guidance for programme planners and future directions for the academic field. Settings A scoping review of the literature spanning 1985–2015 was conducted using MEDLINE, CINAHL, PsychINFO and The Cochrane Library limited to English language and adults. Main search terms included chronic disease, acute care, sustainability, institutionalisation and health planning. A descriptive synthesis was required. Settings included primary care, hospitals, mental health centres and community health. Participants Programmes included preventing or managing chronic conditions including diabetes, heart disease, depression, respiratory disease, cancer, obesity, dental hygiene and multiple chronic diseases. Primary and secondary outcome measures Outcome measures included clarifying a sustainability definition, types of methodologies used, timelines for assessment, criteria levels to determine outcomes and how methodology varies between intervention types. Results Among 153 abstracts retrieved, 87 were retained for full article review and 42 included in the qualitative synthesis. Five definitions for sustainability outcome were identified with ‘maintenance of programme activities’ most frequent. Achieving sustainability was dependent on inter-relationships between various organisational and social contexts supporting a broad scale approach to evaluation. An increasing trend in use of mixed methods designs over multiple time points to determine sustainability outcomes was found. Conclusions Despite the importance and investment in chronic disease programmes, few studies are undertaken to measure sustainability. Methods to evaluate sustainability are diverse with some emerging patterns in measurement found. Use of mixed methods approaches over multiple time points may serve to better guide measurement of sustainability. Consensus on aspects of standardised measurement would promote the future possibility of meta-analytic syntheses. PMID:27246000

Elevated Patient Body Mass Index Does Not Negatively Affect Self-Reported Outcomes of Thoracolumbar Surgery: Results of a Comparative Observational Study with Minimum 1-Year Follow-Up

PubMed Central

Manson, Neil A.; Green, Alana J.; Abraham, Edward P.

2015-01-01

Study Design Retrospective study. Objective Quantify the effect of obesity on elective thoracolumbar spine surgery patients. Methods Five hundred consecutive adult patients undergoing thoracolumbar spine surgery to treat degenerative pathologies with minimum follow-up of at least 1 year were included. Primary outcome measures included Numerical Rating Scales for back and leg pain, the Short Form 36 Physical Component Summary and Mental Component Summary, the modified Oswestry Disability Index, and patient satisfaction scores collected preoperatively and at 3, 6, 12, and 24 months postoperatively. Secondary outcome measures included perioperative and postoperative adverse events, postoperative emergency department presentation, hospital readmission, and revision surgeries. Patients were grouped according to World Health Organization body mass index (BMI) guidelines to isolate the effect of obesity on primary and secondary outcome measures. Results Mean BMI was 30 kg/m2, reflecting a significantly overweight population. Each BMI group reported statistically significant improvement on all self-reported outcome measures. Contrary to our hypothesis, however, there was no association between BMI group and primary outcome measures. Patients with BMI of 35 to 39.99 visited the emergency department with complaints of pain significantly more often than the other groups. Otherwise, we did not detect any differences in the secondary outcome measures between BMI groups. Conclusions Patients of all levels of obesity experienced significant improvement following elective thoracolumbar spine surgery. These outcomes were achieved without increased risk of postoperative complications such as infection and reoperation. A risk–benefit algorithm to assist with surgical decision making for obese patients would be valuable to surgeons and patients alike. PMID:26933611

Structural equation modeling of motor impairment, gross motor function, and the functional outcome in children with cerebral palsy.

PubMed

Park, Eun-Young; Kim, Won-Ho

2013-05-01

Physical therapy intervention for children with cerebral palsy (CP) is focused on reducing neurological impairments, improving strength, and preventing the development of secondary impairments in order to improve functional outcomes. However, relationship between motor impairments and functional outcome has not been proved definitely. This study confirmed the construct of motor impairment and performed structural equation modeling (SEM) between motor impairment, gross motor function, and functional outcomes of regarding activities of daily living in children with CP. 98 children (59 boys, 39 girls) with CP participated in this cross-sectional study. Mean age was 11 y 5 mo (SD 1 y 9 mo). The Manual Muscle Test (MMT), the Modified Ashworth Scale (MAS), range of motion (ROM) measurement, and the selective motor control (SMC) scale were used to assess motor impairments. Gross motor function and functional outcomes were measured using the Gross Motor Function Measure (GMFM) and the Functional Skills domain of the Pediatric Evaluation of Disability Inventory (PEDI) respectively. Measurement of motor impairment was consisted of strength, spasticity, ROM, and SMC. The construct of motor impairment was confirmed though an examination of a measurement model. The proposed SEM model showed good fit indices. Motor impairment effected gross motor function (β=-.0869). Gross motor function and motor impairment affected functional outcomes directly (β=0.890) and indirectly (β=-0.773) respectively. We confirmed that the construct of motor impairment consist of strength, spasticity, ROM, and SMC and it was identified through measurement model analysis. Functional outcomes are best predicted by gross motor function and motor impairments have indirect effects on functional outcomes. Copyright © 2013 Elsevier Ltd. All rights reserved.

Usefulness of the abbreviated injury score and the injury severity score in comparison to the Glasgow Coma Scale in predicting outcome after traumatic brain injury.

PubMed

Foreman, Brandon P; Caesar, R Ruth; Parks, Jennifer; Madden, Christopher; Gentilello, Larry M; Shafi, Shahid; Carlile, Mary C; Harper, Caryn R; Diaz-Arrastia, Ramon R

2007-04-01

Assessment of injury severity is important in the management of patients with brain trauma. We aimed to analyze the usefulness of the head abbreviated injury score (AIS), the injury severity score (ISS), and the Glasgow Coma Scale (GCS) as measures of injury severity and predictors of outcome after traumatic brain injury (TBI). Data were prospectively collected from 410 patients with TBI. AIS, ISS, and GCS were recorded at admission. Subjects' outcomes after TBI were measured using the Glasgow Outcome Scale (GOS-E) at 12 months postinjury. Uni- and multivariate analyses were performed. Outcome information was obtained from 270 patients (66%). ISS was the best predictor of GOS-E (rs = -0.341, p < 0.001), followed by GCS score (rs = 0.227, p < 0.001), and head AIS (rs = -0.222, p < 0.001). When considered in combination, GCS score and ISS modestly improved the correlation with GOS-E (R = 0.335, p < 0.001). The combination of GCS score and head AIS had a similar effect (R = 0.275, p < 0.001). Correlations were stronger from patients 8). GCS score, AIS, and ISS are weakly correlated with 12-month outcome. However, anatomic measures modestly outperform GCS as predictors of GOS-E. The combination of GCS and AIS/ISS correlate with outcome better than do any of the three measures alone. Results support the addition of anatomic measures such as AIS and ISS in clinical studies of TBI. Additionally, most of the variance in outcome is not accounted for by currently available measures of injury severity.

Measurement properties of the Health of the Nation Outcome Scales (HoNOS) family of measures: protocol for a systematic review

PubMed Central

Harris, Meredith G; Sparti, Claudia; Scheurer, Roman; Coombs, Tim; Pirkis, Jane; Ruud, Torleif; Kisely, Steve; Hanssen-Bauer, Ketil; Siqveland, Johan; Burgess, Philip M

2018-01-01

Introduction The Health of the Nation Outcome Scales (HoNOS) for adults, and equivalent measures for children and adolescents and older people, are widely used in clinical practice and research contexts to measure mental health and functional outcomes. Additional HoNOS measures have been developed for special populations and applications. Stakeholders require synthesised information about the measurement properties of these measures to assess whether they are fit for use with intended service settings and populations and to establish performance benchmarks. This planned systematic review will critically appraise evidence on the measurement properties of the HoNOS family of measures. Methods and analysis Journal articles meeting inclusion criteria will be identified via a search of seven electronic databases: MEDLINE via EBSCOhost, PsycINFO via APA PsycNET, Embase via Elsevier, Cumulative Index to Nursing and Allied Health Literature via EBSCOhost, Web of Science via Thomson Reuters, Google Scholar and the Cochrane Library. Variants of ‘Health of the Nation Outcome Scales’ or ‘HoNOS’ will be searched as text words. No restrictions will be placed on setting or language of publication. Reference lists of relevant studies and reviews will be scanned for additional eligible studies. Appraisal of reliability, validity, responsiveness and interpretability will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Feasibility/utility will be appraised using definitions and criteria derived from previous reviews. For reliability studies, we will also apply the Guidelines for Reporting Reliability and Agreement Studies to assess quality of reporting. Results will be synthesised narratively, separately for each measure, and by subgroup (eg, treatment setting, rater profession/experience or training) where possible. Meta-analyses will be undertaken where data are adequate. Ethics and dissemination Ethics approval is not required as no primary data will be collected. Outcomes will be disseminated to stakeholders via reports, journal articles and presentations at meetings and conferences. PROSPERO registration number CRD42017057871. PMID:29678991

Development of a wheelchair mobility skills test for children and adolescents: combining evidence with clinical expertise.

PubMed

Sol, Marleen Elisabeth; Verschuren, Olaf; de Groot, Laura; de Groot, Janke Frederike

2017-02-13

Wheelchair mobility skills (WMS) training is regarded by children using a manual wheelchair and their parents as an important factor to improve participation and daily physical activity. Currently, there is no outcome measure available for the evaluation of WMS in children. Several wheelchair mobility outcome measures have been developed for adults, but none of these have been validated in children. Therefore the objective of this study is to develop a WMS outcome measure for children using the current knowledge from literature in combination with the clinical expertise of health care professionals, children and their parents. Mixed methods approach. Phase 1: Item identification of WMS items through a systematic review using the 'COnsensus-based Standards for the selection of health Measurement Instruments' (COSMIN) recommendations. Phase 2: Item selection and validation of relevant WMS items for children, using a focus group and interviews with children using a manual wheelchair, their parents and health care professionals. Phase 3: Feasibility of the newly developed Utrecht Pediatric Wheelchair Mobility Skills Test (UP-WMST) through pilot testing. Phase 1: Data analysis and synthesis of nine WMS related outcome measures showed there is no widely used outcome measure with levels of evidence across all measurement properties. However, four outcome measures showed some levels of evidence on reliability and validity for adults. Twenty-two WMS items with the best clinimetric properties were selected for further analysis in phase 2. Phase 2: Fifteen items were deemed as relevant for children, one item needed adaptation and six items were considered not relevant for assessing WMS in children. Phase 3: Two health care professionals administered the UP-WMST in eight children. The instructions of the UP-WMST were clear, but the scoring method of the height difference items needed adaptation. The outdoor items for rolling over soft surface and the side slope item were excluded in the final version of the UP-WMST due to logistic reasons. The newly developed 15 item UP-WMST is a validated outcome measure which is easy to administer in children using a manual wheelchair. More research regarding reliability, construct validity and responsiveness is warranted before the UP-WMST can be used in practice.

A systematic review of measurement properties of patient reported outcome measures in psoriatic arthritis: A GRAPPA-OMERACT initiative.

PubMed

Højgaard, Pil; Klokker, Louise; Orbai, Ana-Maria; Holmsted, Kim; Bartels, Else M; Leung, Ying Ying; Goel, Niti; de Wit, Maarten; Gladman, Dafna D; Mease, Philip; Dreyer, Lene; Kristensen, Lars E; FitzGerald, Oliver; Tillett, William; Gossec, Laure; Helliwell, Philip; Strand, Vibeke; Ogdie, Alexis; Terwee, Caroline B; Christensen, Robin

2018-04-01

An updated psoriatic arthritis (PsA) core outcome set (COS) for randomized controlled trials (RCTs) was endorsed at the Outcome Measures in Rheumatology (OMERACT) meeting in 2016. To synthesize the evidence on measurement properties of patient reported outcome measures (PROMs) for PsA and thereby contribute to development of a PsA core outcome measurement set (COMS) as described by the OMERACT Filter 2.0. A systematic literature search was performed in EMBASE, MEDLINE and PsycINFO on Jan 1, 2017 to identify full-text articles with an aim of assessing the measurement properties of PROMs in PsA. Two independent reviewers rated the quality of studies using the COnsensus based standards for the Selection of health Measurement INstruments (COSMIN) checklist, and performed a qualitative evidence synthesis. Fifty-five studies were included in the systematic review. Forty-four instruments and a total of 89 scales were analyzed. PROMs measuring COS domains with at least fair quality evidence for good validity and reliability (and no evidence for poor properties) included the Stockerau Activity Score for PsA (German), Psoriasis Symptom Inventory, visual analogue scale for Patient Global, 36 Item Short Form Health Survey Physical Function subscale, Health Assessment Questionnaire Disability Index, Bath Ankylosing Spondylitis Functional Index, PsA Impact of Disease questionnaire, PsA Quality of Life questionnaire, VITACORA-19, Functional Assessment of Chronic Illness Therapy Fatigue scale and Social Role Participation Questionnaire. At least one PROM with some evidence for aspects of validity and reliability was available for six of the eight mandatory domains of the PsA COS. Copyright © 2018 Elsevier Inc. All rights reserved.

A meta-analysis of brief alcohol interventions for adolescents and young adults: Variability in effects across alcohol measures

PubMed Central

Tanner-Smith, Emily E.; Risser, Mark D.

2016-01-01

Background Brief alcohol interventions are one approach for reducing drinking among youth, but may vary in effectiveness depending on the type of alcohol assessments used to measure effects. Objectives To conduct a meta-analysis that examined the effectiveness of brief alcohol interventions for adolescents and young adults, with particular emphasis on exploring variability in effects across outcome measurement characteristics. Method Eligible studies were those using an experimental or quasi-experimental design to examine the effects of a brief alcohol intervention on a post-intervention alcohol use measure for youth ages 11–30. A comprehensive literature review identified 190 unique samples that were included in the meta-analysis. Taking a Bayesian approach, we used random-effects multilevel models to estimate the average effect and model variability across outcome measurement types. Results Brief alcohol interventions led to significant reductions in self-reported alcohol use among adolescents ( g¯ = 0.25, 95% CrI [0.13, 0.37]) and young adults ( g¯ = 0.15, 95% CrI [0.12, 0.18]). These results were consistent across outcomes with varying reference periods, but varied across outcome construct type and assessment instruments. Among adolescents, effects were larger when measured using the Timeline Followback; among young adults, effects were smaller when measured using the Alcohol Use Disorders Identification Test. Conclusion The strength of the beneficial effects of brief alcohol interventions on youth’s alcohol use may vary depending upon the outcome measure utilized. Nevertheless, significant effects were observed across measures. Although effects were modest in size, they were clinically significant and show promise for interrupting problematic alcohol use trajectories among youth. PMID:26905387

Considerations for analysis of time-to-event outcomes measured with error: Bias and correction with SIMEX.

PubMed

Oh, Eric J; Shepherd, Bryan E; Lumley, Thomas; Shaw, Pamela A

2018-04-15

For time-to-event outcomes, a rich literature exists on the bias introduced by covariate measurement error in regression models, such as the Cox model, and methods of analysis to address this bias. By comparison, less attention has been given to understanding the impact or addressing errors in the failure time outcome. For many diseases, the timing of an event of interest (such as progression-free survival or time to AIDS progression) can be difficult to assess or reliant on self-report and therefore prone to measurement error. For linear models, it is well known that random errors in the outcome variable do not bias regression estimates. With nonlinear models, however, even random error or misclassification can introduce bias into estimated parameters. We compare the performance of 2 common regression models, the Cox and Weibull models, in the setting of measurement error in the failure time outcome. We introduce an extension of the SIMEX method to correct for bias in hazard ratio estimates from the Cox model and discuss other analysis options to address measurement error in the response. A formula to estimate the bias induced into the hazard ratio by classical measurement error in the event time for a log-linear survival model is presented. Detailed numerical studies are presented to examine the performance of the proposed SIMEX method under varying levels and parametric forms of the error in the outcome. We further illustrate the method with observational data on HIV outcomes from the Vanderbilt Comprehensive Care Clinic. Copyright © 2017 John Wiley & Sons, Ltd.

Development of a Core Set of Outcome Measures for Large-vessel Vasculitis: Report from OMERACT 2016.

PubMed

Sreih, Antoine G; Alibaz-Oner, Fatma; Kermani, Tanaz A; Aydin, Sibel Z; Cronholm, Peter F; Davis, Trocon; Easley, Ebony; Gul, Ahmet; Mahr, Alfred; McAlear, Carol A; Milman, Nataliya; Robson, Joanna C; Tomasson, Gunnar; Direskeneli, Haner; Merkel, Peter A

2017-12-01

Among the challenges in conducting clinical trials in large-vessel vasculitis (LVV), including both giant cell arteritis (GCA) and Takayasu arteritis (TA), is the lack of standardized and meaningful outcome measures. The Outcome Measures in Rheumatology (OMERACT) Vasculitis Working Group initiated an international effort to develop and validate data-driven outcome tools for clinical investigation in LVV. An international Delphi exercise was completed to gather opinions from clinical experts on LVV-related domains considered important to measure in trials. Patient interviews and focus groups were completed to identify outcomes of importance to patients. The results of these activities were presented and discussed in a "Virtual Special Interest Group" using telephone- and Internet-based conferences, discussions through electronic mail, and an in-person session at the 2016 OMERACT meeting. A preliminary core set of domains common for all forms of LVV with disease-specific elements was proposed. The majority of experts agree with using common outcome measures for GCA and TA, with the option of supplementation with disease-specific items. Following interviews and focus groups, pain, fatigue, and emotional effect emerged as health-related quality of life domains important to patients. Current disease assessment tools, including the Birmingham Vasculitis Activity Score, were found to be inadequate to assess disease activity in GCA and standardized assessment of imaging tests were felt crucial to study LVV, especially TA. Initial data from a clinician Delphi exercise and structured patient interviews have provided themes toward an OMERACT-endorsed core set of domains and outcome measures.

Variation of clinical outcomes used in glaucoma randomised controlled trials: a systematic review.

PubMed

Ismail, Rehab; Azuara-Blanco, Augusto; Ramsay, Craig R

2014-04-01

In randomised clinical trials (RCTs) the selection of appropriate outcomes is crucial to the assessment of whether one intervention is better than another. The purpose of this review is to identify different clinical outcomes reported in glaucoma trials. We conducted a systematic review of glaucoma RCTs. A sample or selection of glaucoma trials were included bounded by a time frame (between 2006 and March 2012). Only studies in English language were considered. All clinical measured and reported outcomes were included. The possible variations of clinical outcomes were defined prior to data analysis. Information on reported clinical outcomes was tabulated and analysed using descriptive statistics. Other data recorded included type of intervention and glaucoma, duration of the study, defined primary outcomes, and outcomes used for sample size calculation, if nominated. The search strategy identified 4323 potentially relevant abstracts. There were 315 publications retrieved, of which 233 RCTs were included. A total of 967 clinical measures were reported. There were large variations in the definitions used to describe different outcomes and their measures. Intraocular pressure was the most commonly reported outcome (used in 201 RCTs, 86%) with a total of 422 measures (44%). Safety outcomes were commonly reported in 145 RCTs (62%) whereas visual field outcomes were used in 38 RCTs (16%). There is a large variation in the reporting of clinical outcomes in glaucoma RCTs. This lack of standardisation may impair the ability to evaluate the evidence of glaucoma interventions.

Physical functional outcome assessment of patients with major burns admitted to a UK Burn Intensive Care Unit.

PubMed

Smailes, Sarah T; Engelsman, Kayleen; Dziewulski, Peter

2013-02-01

Determining the discharge outcome of burn patients can be challenging and therefore a validated objective measure of functional independence would assist with this process. We developed the Functional Assessment for Burns (FAB) score to measure burn patients' functional independence. FAB scores were taken on discharge from ICU (FAB 1) and on discharge from inpatient burn care (FAB 2) in 56 patients meeting the American Burn Association criteria for major burn. We retrospectively analysed prospectively collected data to measure the progress of patients' physical functional outcomes and to evaluate the predictive validity of the FAB score for discharge outcome. Mean age was 38.6 years and median burn size 35%. Significant improvements were made in the physical functional outcomes between FAB 1 and FAB 2 scores (p<0.0001). 48 patients were discharged home, 8 of these with social care. 8 patients were transferred to another hospital for further inpatient rehabilitation. FAB 1 score (≤ 9) is strongly associated with discharge outcome (p<0.006) and as such can be used to facilitate early discharge planning. FAB 2 score (≤ 26) independently predicts discharge outcome (p<0.0001) and therefore is a valid outcome measure to determine discharge outcome of burn patients. Copyright © 2012 Elsevier Ltd and ISBI. All rights reserved.

The CONSENSUS study: protocol for a mixed methods study to establish which outcomes should be included in a core outcome set for oropharyngeal cancer.

PubMed

Waters, Aoife Mi; Tudur Smith, Catrin; Young, Bridget; Jones, Terry M

2014-05-13

The incidence of oropharyngeal cancer is increasing in the developed world. This has led to a large rise in research activity and clinical trials in this area, yet there is no consensus on which outcomes should be measured. As a result, the outcomes measured often differ between trials of comparable interventions, making the combination or comparison of results between trials impossible. Outcomes may also be 'cherry-picked', such that favourable results are reported, and less favourable results withheld. The development of a minimum outcome reporting standard, known as a core outcome set, goes some way to addressing these problems. Core outcome sets are ideally developed using a patient-centred approach so that the outcomes measured are relevant to patients and clinical practice. Core outcome sets drive up the quality and relevance of research by ensuring that the right outcomes are consistently measured and reported in trials in specific areas of health or healthcare. This is a mixed methods study involving three phases to develop a core outcome set for oropharyngeal cancer clinical trials. Firstly, a systematic review will establish which outcomes are measured in published oropharyngeal cancer randomised controlled trials (RCTs). Secondly, qualitative interviews with patients and carers in the UK and the USA will aim to establish which outcomes are important to these stakeholders. Data from these first two stages will be used to develop a comprehensive list of outcomes to be considered for inclusion in the core outcome set. In the third stage, patients and clinicians will participate in an iterative consensus exercise known as a Delphi study to refine the contents of the core outcome set. This protocol lays out the methodology to be implemented in the CONSENSUS study. A core outcome set defines a minimum outcome reporting standard for clinical trials in a particular area of health or healthcare. Its consistent implementation in oropharyngeal cancer clinical trials will improve the quality and relevance of research. This study is registered at the National Institute for Health Research (NIHR) Clinical Research Network (CRN) portfolio, ID 13823 (17 January 2013).

The CONSENSUS study: protocol for a mixed methods study to establish which outcomes should be included in a core outcome set for oropharyngeal cancer

PubMed Central

2014-01-01

Background The incidence of oropharyngeal cancer is increasing in the developed world. This has led to a large rise in research activity and clinical trials in this area, yet there is no consensus on which outcomes should be measured. As a result, the outcomes measured often differ between trials of comparable interventions, making the combination or comparison of results between trials impossible. Outcomes may also be ‘cherry-picked’, such that favourable results are reported, and less favourable results withheld. The development of a minimum outcome reporting standard, known as a core outcome set, goes some way to addressing these problems. Core outcome sets are ideally developed using a patient-centred approach so that the outcomes measured are relevant to patients and clinical practice. Core outcome sets drive up the quality and relevance of research by ensuring that the right outcomes are consistently measured and reported in trials in specific areas of health or healthcare. Methods/Design This is a mixed methods study involving three phases to develop a core outcome set for oropharyngeal cancer clinical trials. Firstly, a systematic review will establish which outcomes are measured in published oropharyngeal cancer randomised controlled trials (RCTs). Secondly, qualitative interviews with patients and carers in the UK and the USA will aim to establish which outcomes are important to these stakeholders. Data from these first two stages will be used to develop a comprehensive list of outcomes to be considered for inclusion in the core outcome set. In the third stage, patients and clinicians will participate in an iterative consensus exercise known as a Delphi study to refine the contents of the core outcome set. This protocol lays out the methodology to be implemented in the CONSENSUS study. Discussion A core outcome set defines a minimum outcome reporting standard for clinical trials in a particular area of health or healthcare. Its consistent implementation in oropharyngeal cancer clinical trials will improve the quality and relevance of research. Trials and registration This study is registered at the National Institute for Health Research (NIHR) Clinical Research Network (CRN) portfolio, ID 13823 (17 January 2013). PMID:24885068

Can staff and patient perspectives on hospital safety predict harm-free care? An analysis of staff and patient survey data and routinely collected outcomes

PubMed Central

Lawton, Rebecca; O'Hara, Jane Kathryn; Sheard, Laura; Reynolds, Caroline; Cocks, Kim; Armitage, Gerry; Wright, John

2015-01-01

Background Patients have the potential to provide feedback on the safety of their care. Recently, tools have been developed that ask patients to provide feedback on those factors that are known to contribute to safety, therefore providing information that can be used proactively to manage safety in hospitals. The aim of this study was to investigate whether the safety information provided by patients is different from that provided by staff and whether it is related to safety outcomes. Method Data were collected from 33 hospital wards across 3 acute hospital Trusts in the UK. Staff on these wards were asked to complete the four outcome measures of the Hospital Survey of Patient Safety Culture, while patients were asked to complete the Patient Measure of Safety and the friends and family test. We also collated publicly reported safety outcome data for ‘harm-free care’ on each ward. This patient safety thermometer measure is used in the UK NHS to record the percentage of patients on a single day of each month on every ward who have received harm-free care (ie, no pressure ulcers, falls, urinary tract infections and hospital acquired new venous thromboembolisms). These data were used to address questions about the relationship between measures and the extent to which patient and staff perceptions of safety predict safety outcomes. Results The friends and family test, a single item measure of patient experience was associated with patients’ perceptions of safety, but was not associated with safety outcomes. Staff responses to the patient safety culture survey were not significantly correlated with patient responses to the patient measure of safety, but both independently predicted safety outcomes. The regression models showed that staff perceptions (adjusted r2=0.39) and patient perceptions (adjusted r2=0.30) of safety independently predicted safety outcomes. When entered together both measures accounted for 49% of the variance in safety outcomes (adjusted r2=0.49), suggesting that there is overlap but some unique variance is also explained by these two measures. Based on responses to the Patient Measure of Safety it was also possible to identify differences between the acute Hospital Trusts. Discussion The findings suggest that although the views of patients and staff predict some overlapping variance in patient safety outcomes, both also offer a unique perspective on patient safety, contributing independently to the prediction of safety outcomes. These findings suggest that feedback from patients about the safety of the care that they receive can be used, in addition to data from staff to drive safety improvements in healthcare. Trial registration number ISRCTN07689702. PMID:25862755

Fibromyalgia Syndrome Module at OMERACT 9

PubMed Central

Mease, Philip; Arnold, Lesley M; Choy, Ernest H; Clauw, Daniel J.; Crofford, Leslie; Glass, Jennifer M; Martin, Susan A; Morea, Jessica; Simon, Lee; Strand, Vibeke; Williams, David A

2012-01-01

Objectives (1) Establish a core domain set for fibromyalgia (FM) assessment in clinical trials and practice, (2) review outcome measures’ performance characteristics, (3) discuss development of a responder index for the assessment of FM in clinical trials, (4) review objective markers, (5) review the domain of cognitive dysfunction, (6) establish a research agenda for work regarding outcomes research. Methods (1) Results of univariate and multivariate analysis of 10 different FM clinical trials of four different drugs, mapping key domains identified in previously presented patient focus group: Delphi exercises and a clinician/researcher Delphi exercise, breakout discussions to vote on possible essential domains and reliable measures. (2) Updates presented regarding outcome measures’ status. (3) Presented update on objective markers to measure FM disease state. 4) The issue of cognitive dysfunction (dyscognition) in FM was reviewed. Results (1) Greater than 70% of OMERACT participants agreed that pain, tenderness, fatigue, patient global, multidimensional function and sleep disturbance domains should be measured in all FM clinical trials, dyscognition and depression in some trial, and domains of research interest include stiffness, anxiety, functional imaging, and cerebrospinal fluid biomarkers. (2) FM domains’ outcome measures have generally proven to be reliable, discriminative, and feasible. More sophisticated and comprehensive measures are in development, as is a responder index for FM. (3) Increasing number of objective markers are being developed for FM assessment. (4) Cognitive dysfunction assessment by self-assessed and applied outcome measures is being developed. Conclusions A multidimensional symptom core set is proposed for the evaluation of FM in clinical trials. There is ongoing research on improved measures of single domains and composite measures. PMID:19820221

Does the NRS Capture Changes in Communication during Inpatient Stroke Rehabilitation?

PubMed

Barr, Leigh G; Kubilius, Barbra; Ansley, Barb; Whiteman, Rhonda; Sahlas, Demetrios J

2017-10-01

In Ontario, the National Rehabilitation Reporting System (NRS) is mandated for use as a measurement of change for stroke patients after admission to and discharge from rehabilitation. The NRS includes the functional independence measure (FIM) and supplementary measurement items developed by the Canadian Institute for Health Information (CIHI). Uncertainty exists regarding the efficacy of the NRS as the sole measure of outcome for communication in stroke rehabilitation patients. The use of additional speech-language pathology outcome measurement tools for this population has therefore been suggested. This study sought to establish whether the FIM and CIHI communication items capture quantifiable gains during stroke rehabilitation and therefore whether additional measures are needed to assess outcomes. A retrospective analysis was completed of 1252 complete data records of stroke patients discharged from inpatient rehabilitation at Hamilton Health Sciences between 2006 and 2011. Statistically significant improvements were observed in all total matched FIM scores (M = 72.68 to M = 96.39, P < .001) and for each expression (M = 4.61 to M = 5.35, P < .001) and comprehension (M = 4.69 to M = 5.33, P < .001) subscale. The most severely affected group demonstrated the greatest gains. These findings were independent of stroke severity. Additional outcome measurement tools for communication are therefore not required to assess outcomes in rehabilitation of stroke patients, although additional research is necessary to evaluate the clinical significance of the improvements that are observed using existing measurements of change. Copyright © 2017 National Stroke Association. All rights reserved.

Association of Dental Care with Adherence to HEDIS Measures

PubMed Central

Mosen, David; Pihlstrom, Dan; Snyder, John; Smith, Ning; Shuster, Elizabeth; Rust, Kristal

2016-01-01

Context: The dental setting represents an unrealized opportunity to increase adherence to preventive services and improve health outcomes. Objective: To compare adherence to a subset of Healthcare Effectiveness Data and Information Set (HEDIS) measures among a population that received dental care with a population that did not receive dental care. Design: Using a retrospective cohort design, we identified 5216 adults who received regular dental care and 5216 persons who did not. The groups were matched on propensity scores, were followed for 3 years, and retained medical and dental benefits. Receipt of dental care was defined as 1 or more dental visits in each 12-month period. Main Outcome Measures: Outcome measures were assessed in a subpopulation that qualified for 1 of 5 HEDIS denominator groups (dental = 4184 patients; nondental = 3871 patients). They included 3 preventive measures (cervical, colorectal, and breast cancer screening), 4 chronic disease management services (hemoglobin A1c and low-density lipoprotein cholesterol testing, and nephropathy and retinopathy screening among the diabetes mellitus [DM] population), and 4 health outcome measures (poor glycemic control, low-density lipoprotein cholesterol control, blood pressure control in the DM population, and blood pressure control in the hypertensive population). Results: Dental care was associated with higher adherence to all three cancer screening measures, one of four disease management services (higher retinopathy screening), and three of four health outcomes (better glycemic control in the DM population and better blood pressure control in the DM and hypertensive populations). Conclusions: Dental care was associated with improved adherence to 7 of 11 HEDIS measures. PMID:26580145

Strategic Measures of Teacher Performance

ERIC Educational Resources Information Center

Milanowski, Anthony

2011-01-01

Managing the human capital in education requires measuring teacher performance. To measure performance, administrators need to combine measures of practice with measures of outcomes, such as value-added measures, and three measurement systems are needed: classroom observations, performance assessments or work samples, and classroom walkthroughs.…

Random measurement error: Why worry? An example of cardiovascular risk factors.

PubMed

Brakenhoff, Timo B; van Smeden, Maarten; Visseren, Frank L J; Groenwold, Rolf H H

2018-01-01

With the increased use of data not originally recorded for research, such as routine care data (or 'big data'), measurement error is bound to become an increasingly relevant problem in medical research. A common view among medical researchers on the influence of random measurement error (i.e. classical measurement error) is that its presence leads to some degree of systematic underestimation of studied exposure-outcome relations (i.e. attenuation of the effect estimate). For the common situation where the analysis involves at least one exposure and one confounder, we demonstrate that the direction of effect of random measurement error on the estimated exposure-outcome relations can be difficult to anticipate. Using three example studies on cardiovascular risk factors, we illustrate that random measurement error in the exposure and/or confounder can lead to underestimation as well as overestimation of exposure-outcome relations. We therefore advise medical researchers to refrain from making claims about the direction of effect of measurement error in their manuscripts, unless the appropriate inferential tools are used to study or alleviate the impact of measurement error from the analysis.

Measuring social communication behaviors as a treatment endpoint in individuals with autism spectrum disorder.

PubMed

Anagnostou, Evdokia; Jones, Nancy; Huerta, Marisela; Halladay, Alycia K; Wang, Paul; Scahill, Lawrence; Horrigan, Joseph P; Kasari, Connie; Lord, Cathy; Choi, Dennis; Sullivan, Katherine; Dawson, Geraldine

2015-07-01

Social communication impairments are a core deficit in autism spectrum disorder. Social communication deficit is also an early indicator of autism spectrum disorder and a factor in long-term outcomes. Thus, this symptom domain represents a critical treatment target. Identifying reliable and valid outcome measures for social communication across a range of treatment approaches is essential. Autism Speaks engaged a panel of experts to evaluate the readiness of available measures of social communication for use as outcome measures in clinical trials. The panel held monthly conference calls and two face-to-face meetings over 14 months. Key criteria used to evaluate measures included the relevance to the clinical target, coverage of the symptom domain, and psychometric properties (validity and reliability, as well as evidence of sensitivity to change). In all, 38 measures were evaluated and 6 measures were considered appropriate for use, with some limitations. This report discusses the relative strengths and weaknesses of existing social communication measures for use in clinical trials and identifies specific areas in need of further development. © The Author(s) 2014.

Meta-Analysis of Treatment Outcomes Measured by the Y-OQ and Y-OQ-SR Comparing Wilderness and Non-Wilderness Treatment Programs

ERIC Educational Resources Information Center

Gillis, Harold L.; Speelman, Elizabeth; Linville, Noelle; Bailey, Emily; Kalle, Ashley; Oglesbee, Nathan; Sandlin, James; Thompson, Lauren; Jensen, Jennifer

2016-01-01

Background: Monitoring youth treatments requires outcome instruments sensitive to change. The Y-OQ and the Y-OQ-SR measure behavioral change during psychological treatment. Objective: The focus of this study was to compare treatment progress of youth in studies using the Youth Outcome Questionnaire (YOQ) or the Youth Outcome Questionnaire Self…

Convergent Validity of the CORE Measures with Measures of Depression for Clients in Cognitive Therapy for Depression

ERIC Educational Resources Information Center

Cahill, Jane; Barkham, Michael; Stiles, William B.; Twigg, Elspeth; Hardy, Gillian E.; Rees, Anne; Evans, Chris

2006-01-01

Clients (N = 77) undergoing cognitive therapy for depression were assessed before treatment with the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM), which encompasses domains of subjective well-being, problems, functioning, and risk of harming self or others, along with the Beck Depression Inventory-II (BDIII), the Hamilton…

Los Angeles County Juvenile Justice Crime Prevention Act: Fiscal Year 2004-2005. Report Summary

ERIC Educational Resources Information Center

Turner, Susan; Fain, Terry; MacDonald, John; Sehgal, Amber

2007-01-01

This document summarizes a report focusing on California counties receiving funds from Juvenile Justice Crime Prevention Act (JJCPA) programs. These counties are required to report six outcome measures to the California State Legislature on an annual basis to measure the success of the program. These outcome measures are (1) successful completion…

Los Angeles County Juvenile Justice Crime Prevention Act: Fiscal Year 2005-2006. Report Summary

ERIC Educational Resources Information Center

Turner, Susan; Fain, Terry; Sehgal, Amber

2007-01-01

This document summarizes a study relating to California counties receiving state funds for Juvenile Justice Crime Prevention Act (JJCPA) programs. These counties are required to report six outcome measures to the California State Legislature on an annual basis to measure the success of the program. These outcome measures are (1) successful…

Los Angeles County Juvenile Justice Crime Prevention Act: Fiscal Year 2004-2005 Report

ERIC Educational Resources Information Center

Turner, Susan; Fain, Terry; MacDonald, John; Sehgal, Amber

2007-01-01

California counties receiving funds from Juvenile Justice Crime Prevention Act (JJCPA) programs are required to report six outcome measures to the California State Legislature on an annual basis to measure the success of the program. These outcome measures are (1) successful completion of probation, (2) arrests, (3) probation violations, (4)…

Voice-Related Patient-Reported Outcome Measures: A Systematic Review of Instrument Development and Validation

ERIC Educational Resources Information Center

Francis, David O.; Daniero, James J.; Hovis, Kristen L.; Sathe, Nila; Jacobson, Barbara; Penson, David F.; Feurer, Irene D.; McPheeters, Melissa L.

2017-01-01

Purpose: The purpose of this study was to perform a comprehensive systematic review of the literature on voice-related patient-reported outcome (PRO) measures in adults and to evaluate each instrument for the presence of important measurement properties. Method: MEDLINE, the Cumulative Index of Nursing and Allied Health Literature, and the Health…

The Search for an Early Intervention Outcome Measurement Tool in Autism

ERIC Educational Resources Information Center

Fletcher-Watson, S.; McConachie, H.

2017-01-01

Evidence is accumulating that early intervention can be effective in improving the skills of young children with autism spectrum disorder. However, the science is hampered by the lack of agreed "gold standard" tools for the measurement of progress and outcome. What is required is a reliable, valid, and sensitive measure of change in the…

Assessment of Aging Individuals with Down Syndrome in Clinical Trials: Results of Baseline Measures

ERIC Educational Resources Information Center

Sano, Mary; Aisen, Paul S.; Dalton, Arthur J.; Andrews, Howard F.; Tsai, Wei-Yann

2005-01-01

A major challenge to developing therapeutic interventions for cognitive loss and dementia in aging individuals with Down syndrome (DS) is the selection of appropriate outcome measures. This report describes the adaptation of the Brief Praxis Test (a nonverbal cognitive test) as a primary outcome measure, as well as the selection of secondary…

Action Research: Measuring Literacy Programme Participants' Learning Outcomes. Results of the Final Phase (2011-2014)

ERIC Educational Resources Information Center

Bolly, Madina; Jonas, Nicolas

2015-01-01

Action Research on Measuring Literacy Programme Participants' Learning Outcomes (RAMAA) aims to develop, implement and collaborate on the creation of a methodological approach to measure acquired learning and study the various factors that influence its development. This report examines how RAMAA I has been implemented over the past four years in…

School Gardens Enhance Academic Performance and Dietary Outcomes in Children.

PubMed

Berezowitz, Claire K; Bontrager Yoder, Andrea B; Schoeller, Dale A

2015-08-01

Schools face increasing demands to provide education on healthy living and improve core academic performance. Although these appear to be competing concerns, they may interact beneficially. This article focuses on school garden programs and their effects on students' academic and dietary outcomes. Database searches in CABI, Web of Science, Web of Knowledge, PubMed, Education Full Text, Education Resources Information Center (ERIC), and PsychINFO were conducted through May 2013 for peer-reviewed literature related to school-day garden interventions with measures of dietary and/or academic outcomes. Among 12 identified garden studies with dietary measures, all showed increases/improvements in predictors of fruit and vegetable (FV) consumption. Seven of these also included self-reported FV intake with 5 showing an increase and 2 showing no change. Four additional interventions that included a garden component measured academic outcomes; of these, 2 showed improvements in science achievement and 1 measured and showed improvements in math scores. This small set of studies offers evidence that garden-based learning does not negatively impact academic performance or FV consumption and may favorably impact both. Additional studies with more robust experimental designs and outcome measures are necessary to understand the effects of experiential garden-based learning on children's academic and dietary outcomes. © 2015, American School Health Association.

Consensus for tinnitus patient assessment and treatment outcome measurement: Tinnitus Research Initiative meeting, Regensburg, July 2006

PubMed Central

Langguth, B.; Goodey, R.; Azevedo, A.; Bjorne, A.; Cacace, A.; Crocetti, A.; Del Bo, L.; De Ridder, D.; Diges, I.; Elbert, T.; Flor, H.; Herraiz, C.; Sanchez, T. Ganz; Eichhammer, P.; Figueiredo, R.; Hajak, G.; Kleinjung, T.; Landgrebe, M.; Londero, A.; Lainez, M.J.A.; Mazzoli, M.; Meikle, M.B.; Melcher, J.; Rauschecker, J.P.; Sand, P.G.; Struve, M.; Van de Heyning, P.; Van Dijk, P.; Vergara, R.

2014-01-01

There is widespread recognition that consistency between research centres in the ways that patients with tinnitus are assessed and outcomes following interventions are measured would facilitate more effective co-operation and more meaningful evaluations and comparisons of outcomes. At the first Tinnitus Research Initiative meeting held in Regensburg in July 2006 an attempt was made through workshops to gain a consensus both for patient assessments and for outcome measurements. It is hoped that this will contribute towards better cooperation between research centres in finding and evaluating treatments for tinnitus by allowing better comparability between studies. PMID:17956816

Probabilistic metrology or how some measurement outcomes render ultra-precise estimates

NASA Astrophysics Data System (ADS)

Calsamiglia, J.; Gendra, B.; Muñoz-Tapia, R.; Bagan, E.

2016-10-01

We show on theoretical grounds that, even in the presence of noise, probabilistic measurement strategies (which have a certain probability of failure or abstention) can provide, upon a heralded successful outcome, estimates with a precision that exceeds the deterministic bounds for the average precision. This establishes a new ultimate bound on the phase estimation precision of particular measurement outcomes (or sequence of outcomes). For probe systems subject to local dephasing, we quantify such precision limit as a function of the probability of failure that can be tolerated. Our results show that the possibility of abstaining can set back the detrimental effects of noise.

Social Stories in mainstream schools for children with autism spectrum disorder: a feasibility randomised controlled trial.

PubMed

Marshall, David; Wright, Barry; Allgar, Victoria; Adamson, Joy; Williams, Christine; Ainsworth, Hannah; Cook, Liz; Varley, Danielle; Hackney, Lisa; Dempster, Paul; Ali, Shehzad; Trepel, Dominic; Collingridge Moore, Danielle; Littlewood, Elizabeth; McMillan, Dean

2016-08-11

To assess the feasibility of recruitment, retention, outcome measures and intervention training/delivery among teachers, parents and children. To calculate a sample size estimation for full trial. A single-centre, unblinded, cluster feasibility randomised controlled trial examining Social Stories delivered within a school environment compared with an attentional control. 37 primary schools in York, UK. 50 participants were recruited and a cluster randomisation approach by school was examined. Participants were randomised into the treatment group (n=23) or a waiting list control group (n=27). Acceptability and feasibility of the trial, intervention and of measurements required to assess outcomes in a definitive trial. An assessment of the questionnaire completion rates indicated teachers would be most appropriate to complete the primary outcome measure. 2 outcome measures: the Social Responsiveness Scale (SRS)-2 and a goal-based measure showed both the highest levels of completion rates (above 80%) at the primary follow-up point (6 weeks postintervention) and captured relevant social and behaviour outcomes. Power calculations were based on these 2 outcome measures leading to a total proposed sample size of 180 participant groups. Results suggest that a future trial would be feasible to conduct and could inform the policy and practice of using Social Stories in mainstream schools. ISRCTN96286707; Results. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

A protocol for developing, disseminating, and implementing a core outcome set for pre-eclampsia.

PubMed

Duffy, James M N; van 't Hooft, Janneke; Gale, Chris; Brown, Mark; Grobman, William; Fitzpatrick, Ray; Karumanchi, S Ananth; Lucas, Nuala; Magee, Laura; Mol, Ben; Stark, Michael; Thangaratinam, Shakila; Wilson, Mathew; von Dadelszen, Peter; Williamson, Paula; Khan, Khalid S; Ziebland, Sue; McManus, Richard J

2016-10-01

Pre-eclampsia is a serious complication of pregnancy and contributes to maternal and offspring mortality and morbidity. Randomised controlled trials evaluating therapeutic interventions for pre-eclampsia have reported many different outcomes and outcome measures. Such variation contributes to an inability to compare, contrast, and combine individual studies, limiting the usefulness of research to inform clinical practice. The development and use of a core outcome set would help to address these issues ensuring outcomes important to all stakeholders, including patients, will be collected and reported in a standardised fashion. An international steering group including healthcare professionals, researchers, and patients, has been formed to guide the development of this core outcome set. Potential outcomes will be identified through a comprehensive literature review and semi-structured interviews with patients. Potential core outcomes will be entered into an international, multi-perspective online Delphi survey. All key stakeholders, including healthcare professionals, researchers, and patients will be invited to participate. The modified Delphi method encourages whole and stakeholder group convergence towards consensus 'core' outcomes. Once core outcomes have been agreed upon it is important to determine how they should be measured. The truth, discrimination, and feasibility assessment framework will assess the quality of potential outcome measures. High quality outcome measures will be associated with core outcomes. Mechanisms exist to disseminate and implement the resulting core outcome set within an international context. Embedding the core outcome set within future clinical trials, systematic reviews, and clinical practice guidelines could make a profound contribution to advancing the usefulness of research to inform clinical practice, enhance patient care, and improve maternal and offspring outcomes. The infrastructure created by developing a core outcome set for pre-eclampsia could be leveraged in other settings, for example selecting research priorities and clinical practice guideline development. PROSPECTIVE REGISTRATION: [1] Core Outcome Measures in Effectiveness Trials (COMET) registration number: 588. [2] International Prospective Register of Systematic Reviews (PROSPERO) registration number: CRD42015015529. Copyright © 2016 International Society for the Study of Hypertension in Pregnancy. Published by Elsevier B.V. All rights reserved.

Understanding how pain education causes changes in pain and disability: protocol for a causal mediation analysis of the PREVENT trial.

PubMed

Lee, Hopin; Moseley, G Lorimer; Hübscher, Markus; Kamper, Steven J; Traeger, Adrian C; Skinner, Ian W; McAuley, James H

2015-07-01

Pain education is a complex intervention developed to help clinicians manage low back pain. Although complex interventions are usually evaluated by their effects on outcomes, such as pain or disability, most do not directly target these outcomes; instead, they target intermediate factors that are presumed to be associated with the outcomes. The mechanisms underlying treatment effects, or the effect of an intervention on an intermediate factor and its subsequent effect on outcome, are rarely investigated in clinical trials. This leaves a gap in the evidence for understanding how treatments exert their effects on outcomes. Mediation analysis provides a method for identifying and quantifying the mechanisms that underlie interventions. To determine whether the effect of pain education on pain and disability is mediated by changes in self-efficacy, catastrophisation and back pain beliefs. Causal mediation analysis of the PREVENT randomised controlled trial. Two hundred and two participants with acute low back pain from primary care clinics in the Sydney metropolitan area. Participants will be randomised to receive either 'pain education' (intervention group) or 'sham education' (control group). All outcome measures (including patient characteristics), primary outcome measures (pain and disability), and putative mediating variables (self-efficacy, catastrophisation and back pain beliefs) will be measured prior to randomisation. Putative mediators and primary outcome measures will be measured 1 week after the intervention, and primary outcome measures will be measured 3 months after the onset of low back pain. Causal mediation analysis under the potential outcomes framework will be used to test single and multiple mediator models. A sensitivity analysis will be conducted to evaluate the robustness of the estimated mediation effects on the influence of violating sequential ignorability--a critical assumption for causal inference. Mediation analysis of clinical trials can estimate how much the total effect of the treatment on the outcome is carried through an indirect path. Using mediation analysis to understand these mechanisms can generate evidence that can be used to tailor treatments and optimise treatment effects. In this study, the causal mediation effects of a pain education intervention for acute non-specific low back pain will be estimated. This knowledge is critical for further development and refinement of interventions for conditions such as low back pain. Copyright © 2015 Australian Physiotherapy Association. Published by Elsevier B.V. All rights reserved.

Patient safety climate and worker safety behaviours in acute hospitals in Scotland.

PubMed

Agnew, Cakil; Flin, Rhona; Mearns, Kathryn

2013-06-01

To obtain a measure of hospital safety climate from a sample of National Health Service (NHS) acute hospitals in Scotland and to test whether these scores were associated with worker safety behaviors, and patient and worker injuries. Data were from 1,866 NHS clinical staff in six Scottish acute hospitals. A Scottish Hospital Safety Questionnaire measured hospital safety climate (Hospital Survey on Patient Safety Culture), worker safety behaviors, and worker and patient injuries. The associations between the hospital safety climate scores and the outcome measures (safety behaviors, worker and patient injury rates) were examined. Hospital safety climate scores were significantly correlated with clinical workers' safety behavior and patient and worker injury measures, although the effect sizes were smaller for the latter. Regression analyses revealed that perceptions of staffing levels and managerial commitment were significant predictors for all the safety outcome measures. Both patient-specific and more generic safety climate items were found to have significant impacts on safety outcome measures. This study demonstrated the influences of different aspects of hospital safety climate on both patient and worker safety outcomes. Moreover, it has been shown that in a hospital setting, a safety climate supporting safer patient care would also help to ensure worker safety. The Scottish Hospital Safety Questionnaire has proved to be a usable method of measuring both hospital safety climate as well as patient and worker safety outcomes. Copyright © 2013 National Safety Council and Elsevier Ltd. Published by Elsevier Ltd. All rights reserved.

Excursions out-of-lane versus standard deviation of lateral position as outcome measure of the on-the-road driving test.

PubMed

Verster, Joris C; Roth, Thomas

2014-07-01

The traditional outcome measure of the Dutch on-the-road driving test is the standard deviation of lateral position (SDLP), the weaving of the car. This paper explores whether excursions out-of-lane are a suitable additional outcome measure to index driving impairment. A literature search was conducted to search for driving tests that used both SDLP and excursions out-of-lane as outcome measures. The analyses were limited to studies examining hypnotic drugs because several of these drugs have been shown to produce next-morning sedation. Standard deviation of lateral position was more sensitive in demonstrating driving impairment. In fact, solely relying on excursions out-of-lane as outcome measure incorrectly classifies approximately half of impaired drives as unimpaired. The frequency of excursions out-of-lane is determined by the mean lateral position within the right traffic lane. Defining driving impairment as having a ΔSDLP > 2.4 cm, half of the impaired driving tests (51.2%, 43/84) failed to produce excursions out-of-lane. Alternatively, 20.9% of driving tests with ΔSDLP < 2.4 cm (27/129) had at least one excursion out-of-lane. Excursions out-of-lane are neither a suitable measure to demonstrate driving impairment nor is this measure sufficiently sensitive to differentiate adequately between differences in magnitude of driving impairment. Copyright © 2014 John Wiley & Sons, Ltd.

The development of Music in Dementia Assessment Scales (MiDAS)

PubMed Central

McDermott, Orii; Orrell, Martin; Ridder, Hanne Mette

2015-01-01

There is a need to develop an outcome measure specific to music therapy in dementia that reflects a holistic picture of the therapy process and outcome. This study aimed to develop a clinically relevant and scientifically robust music therapy outcome measure incorporating the values and views of people with dementia. Focus groups and interviews were conducted to obtain qualitative data on what music meant to people with dementia and the observed effects of music. Expert and peer consultations were conducted at each stage of the measure development to maximise its content validity. The new measure was field-tested by clinicians in a care home. Feedback from the clinicians and music therapy experts were incorporated during the review and refinement process of the measure. A review of the existing literature, the experiential results and the consensus process enabled the development of the new outcome measure “Music in Dementia Assessment Scales (MiDAS)”. Analysis of the qualitative data identified five key areas of the impact of music on people with dementia and they were transformed as the five Visual Analogue Scale (VAS) items: levels of Interest, Response, Initiation, Involvement and Enjoyment. MiDAS comprises the five VAS items and a supplementary checklist of notable positive and negative reactions from the individual. This study demonstrates that it is possible to design and develop an easy to apply and rigorous quantitative outcome measure which has a high level of clinical relevance for people with dementia, care home staff and music therapists. PMID:26246670

Measuring motivation in schizophrenia: Is a general state of motivation necessary for task-specific motivation?

PubMed Central

Choi, Jimmy; Choi, Kee-Hong; Reddy, Felice; Fiszdon, Joanna M.

2014-01-01

Despite the important role of motivation in rehabilitation and functional outcomes in schizophrenia, to date, there has been little emphasis on how motivation is assessed. This is important, since different measures may tap potentially discrete motivational constructs, which in turn may have very different associations to important outcomes. In the current study, we used baseline data from 71 schizophrenia spectrum outpatients enrolled in a rehabilitation program to examine the relationship between task-specific motivation, as measured by the Intrinsic Motivation Inventory (IMI), and a more general state of volition/initiation, as measured by the three item Quality of Life (QLS) motivation index. We also examined the relationship of these motivation measures to demographic, clinical and functional variables relevant to rehabilitation outcomes. The two motivation measures were not correlated, and participants with low general state motivation exhibited a full range of task-specific motivation. Only the QLS motivation index correlated with variables relevant to rehabilitation outcomes. The lack of associations between QLS motivation index and IMI subscales suggests that constructs tapped by these measures may be divergent in schizophrenia, and specifically that task-specific intrinsic motivation is not contingent on a general state of motivation. That is, even in individuals with a general low motivational state (i.e. amotivation), interventions aimed at increasing task-specific motivation may still be effective. Moreover, the pattern of interrelationships between the QLS motivation index and variables relevant to psychosocial rehabilitation supports its use in treatment outcome studies. PMID:24529609

The development of Music in Dementia Assessment Scales (MiDAS).

PubMed

McDermott, Orii; Orrell, Martin; Ridder, Hanne Mette

2015-07-03

There is a need to develop an outcome measure specific to music therapy in dementia that reflects a holistic picture of the therapy process and outcome. This study aimed to develop a clinically relevant and scientifically robust music therapy outcome measure incorporating the values and views of people with dementia. Focus groups and interviews were conducted to obtain qualitative data on what music meant to people with dementia and the observed effects of music. Expert and peer consultations were conducted at each stage of the measure development to maximise its content validity. The new measure was field-tested by clinicians in a care home. Feedback from the clinicians and music therapy experts were incorporated during the review and refinement process of the measure. A review of the existing literature, the experiential results and the consensus process enabled the development of the new outcome measure "Music in Dementia Assessment Scales (MiDAS)". Analysis of the qualitative data identified five key areas of the impact of music on people with dementia and they were transformed as the five Visual Analogue Scale (VAS) items: levels of Interest, Response, Initiation, Involvement and Enjoyment. MiDAS comprises the five VAS items and a supplementary checklist of notable positive and negative reactions from the individual. This study demonstrates that it is possible to design and develop an easy to apply and rigorous quantitative outcome measure which has a high level of clinical relevance for people with dementia, care home staff and music therapists.

The strategic use of outcome information.

PubMed

Thompson, D I; Sirio, C; Holt, P

2000-10-01

Most health care executives see outcome measurement as a technical or tactical matter rather than as a strategic tool. Accordingly, provider investment in outcome measurement and management is relatively small. Nevertheless, outcome information can be key to achieving an organization's strategic objectives. Advances in risk adjustment and improvements in technology for data collection and analysis have made outcome measurement a practical tool for individual hospital use. Strategically integrated outcome measurement efforts can give providers a competitive advantage over organizations that only use outcomes tactically. One of the best examples of an acute care provider that has used outcome information for strategic advantage is Intermountain Health Care (IHC; Salt Lake City). In 1997 IHC made clinical quality and outcomes the primary focus of its five-year strategic plan. To support the new strategy IHC's board of trustees approved the development of an outcome information system that generated data along clinical processes of care and the creation of a new management structure to use these data to hold professionals accountable and to set and achieve clinical improvement goals. From 1996 to 1999, IHC's share of the commercial health care market in Utah increased from roughly 50% to about 62% of the market, with the result that it has stopped actively marketing its services. Health care executives will not willingly invest in outcomes until they believe that they have business value. Therefore, making the business case for outcomes can help improve the quality of health care and the lives of individuals.

Regional Brain Biometrics at Term-Equivalent Age and Developmental Outcome in Extremely Low-Birth-Weight Infants.

PubMed

Melbourne, Launice; Murnick, Jonathan; Chang, Taeun; Glass, Penny; Massaro, An N

2015-10-01

This study aims to evaluate individual regional brain biometrics and their association with developmental outcome in extremely low-birth-weight (ELBW) infants. This is a retrospective study evaluating term-equivalent magnetic resonance imaging (TE-MRI) from 27 ELBW infants with known developmental outcomes beyond 12 months corrected age. Regional biometric measurements were performed by a pediatric neuroradiologist blinded to outcome data. Measures included biparietal width, transcerebellar diameter (TCD), deep gray matter area (DGMA), ventricular dilatation, corpus callosum, and interhemispheric distance. The relationship between regional biometrics and Bayley-II developmental scores were evaluated with linear regression models. The study cohort had an average±standard deviation birth weight of 684±150 g, gestational age of 24.6±2 weeks and 48% males. DGMA was significantly associated with both cognitive and motor outcomes. Significant associations were also observed between TCD and corpus callosum splenium with cognitive and motor outcomes, respectively. Other biometric measures were not associated with outcome (p>0.05). DGMA<10.26 cm2 was highly specific for poor motor and cognitive outcome. TE-MRI biometrics reflecting impaired deep gray matter, callosal, and cerebellar size is associated with worse early childhood cognitive and motor outcomes. DGMA may be the most robust single biometric measure to predict adverse developmental outcome in preterm survivors. Thieme Medical Publishers 333 Seventh Avenue, New York, NY 10001, USA.

The 'Outcome Reporting in Brief Intervention Trials: Alcohol' (ORBITAL) framework: protocol to determine a core outcome set for efficacy and effectiveness trials of alcohol screening and brief intervention.

PubMed

Shorter, G W; Heather, N; Bray, Jeremy W; Giles, E L; Holloway, A; Barbosa, C; Berman, A H; O'Donnell, A J; Clarke, M; Stockdale, K J; Newbury-Birch, D

2017-12-22

The evidence base to assess the efficacy and effectiveness of alcohol brief interventions (ABI) is weakened by variation in the outcomes measured and by inconsistent reporting. The 'Outcome Reporting in Brief Intervention Trials: Alcohol' (ORBITAL) project aims to develop a core outcome set (COS) and reporting guidance for its use in future trials of ABI in a range of settings. An international Special Interest Group was convened through INEBRIA (International Network on Brief Interventions for Alcohol and Other Drugs) to inform the development of a COS for trials of ABI. ORBITAL will incorporate a systematic review to map outcomes used in efficacy and effectiveness trials of ABI and their measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) criteria. This will support a multi-round Delphi study to prioritise outcomes. Delphi panellists will be drawn from a range of settings and stakeholder groups, and the Delphi study will also be used to determine if a single COS is relevant for all settings. A consensus meeting with key stakeholder representation will determine the final COS and associated guidance for its use in trials of ABI. ORBITAL will develop a COS for alcohol screening and brief intervention trials, with outcomes stratified into domains and guidance on outcome measurement instruments. The standardisation of ABI outcomes and their measurement will support the ongoing development of ABI studies and a systematic synthesis of emerging research findings. We will track the extent to which the COS delivers on this promise through an exploration of the use of the guidance in the decade following COS publication.

Measuring Inclusive Education Outcomes in Alberta, Canada

ERIC Educational Resources Information Center

Loreman, Tim

2014-01-01

This study details the results of a review of the academic and public sector literature on measuring inclusive education in large systems. It highlights some outcomes drawn from the international literature on inclusion that might be indicative of the presence and quality of inclusive education in an effort to develop a set of outcomes for…

Relationship between Learning Outcomes and Online Accesses

ERIC Educational Resources Information Center

Suanpang, Pannee; Petocz, Peter; Reid, Anna

2004-01-01

This paper reports on a study carried out in Thailand investigating the relationship between students' use of an e-learning system and their learning outcomes in a course on Business Statistics. The results show a clear relationship between accesses to the e-learning system, as measured by number of "hits", and outcomes, as measured by…

The National Outcomes Measurement System for Pediatric Speech-Language Pathology

ERIC Educational Resources Information Center

Mullen, Robert; Schooling, Tracy

2010-01-01

Purpose: The American Speech-Language-Hearing Association's (ASHA's) National Outcomes Measurement System (NOMS) was developed in the late 1990s. The primary purpose was to serve as a source of data for speech-language pathologists (SLPs) who found themselves called on to provide empirical evidence of the functional outcomes associated with their…

Systematic review of mental health and well-being outcomes following community-based obesity prevention interventions among adolescents.

PubMed

Hoare, Erin; Fuller-Tyszkiewicz, Matthew; Skouteris, Helen; Millar, Lynne; Nichols, Melanie; Allender, Steven

2015-01-05

This paper aimed to systematically evaluate the mental health and well-being outcomes observed in previous community-based obesity prevention interventions in adolescent populations. Systematic review of literature from database inception to October 2014. Articles were sourced from CINAHL, Global Health, Health Source: Nursing and Academic Edition, MEDLINE, PsycARTICLES and PsycINFO, all of which were accessed through EBSCOhost. The Cochrane Database was also searched to identify all eligible articles. PRISMA guidelines were followed and search terms and search strategy ensured all possible studies were identified for review. Intervention studies were eligible for inclusion if they were: focused on overweight or obesity prevention, community-based, targeted adolescents (aged 10-19 years), reported a mental health or well-being measure, and included a comparison or control group. Studies that focused on specific adolescent groups or were treatment interventions were excluded from review. Quality of evidence was assessed using the Grading of Recommendations, Assessment, Development and Evaluation (GRADE) guidelines. Primary outcomes were measures of mental health and well-being, including diagnostic and symptomatic measures. Secondary outcomes included adiposity or weight-related measures. Seven studies met the inclusion criteria; one reported anxiety/depressive outcomes, two reported on self-perception well-being measures such as self-esteem and self-efficacy, and four studies reported outcomes of quality of life. Positive mental health outcomes demonstrated that following obesity prevention, interventions included a decrease in anxiety and improved health-related quality of life. Quality of evidence was graded as very low. Although positive outcomes for mental health and well-being do exist, controlled evaluations of community-based obesity prevention interventions have not often included mental health measures (n=7). It is recommended that future interventions incorporate mental health and well-being measures to identify any potential mechanisms influencing adolescent weight-related outcomes, and equally to ensure interventions are not causing harm to adolescent mental health. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

Patient-centered Medical Home Capability and Clinical Performance in HRSA-supported Health Centers

PubMed Central

Shi, Leiyu; Lock, Diana C.; Lee, De-Chih; Lebrun-Harris, Lydie A.; Chin, Marshall H.; Chidambaran, Preeta; Nocon, Robert S.; Zhu, Jinsheng; Sripipatana, Alek

2015-01-01

Objectives To evaluate the relationship between Patient-centered Medical Home (PCMH) model adoption in health centers (HCs) and clinical performance measures and to determine if adoption of PCMH characteristics is associated with better clinical performance. Research Design Data came from the Health Resources and Services Administration’s 2009 Uniform Data System and the 2009 Commonwealth Fund National Survey of Federally Qualified Health Centers. Clinical performance measures included 2 process measures (childhood immunization and cervical cancer screening) and 2 outcome measures (hypertension control and diabetes control). Total and subscale PCMH scores were regressed on the clinical performance measures, adjusting for patient, provider, financial, and institutional characteristics. Results The findings showed different directional relationships, with some PCMH domains (care management, test/referral tracking, quality improvement, and external coordination) showing little or no effect on outcome measures of interest, 1 domain (access/communication) associated with improved outcomes, and 1 domain (patient tracking/registry) associated with worse outcomes. Conclusions This study is among the first to examine the association between PCMH transformation and clinical performance in HCs, providing an understanding of the impact of PCMH adoption within safety-net settings. The mixed results highlight the importance of examining relationships between specific PCMH domains and specific clinical quality measures, in addition to analyzing overall PCMH scores which could yield distorted findings. PMID:25793267

Achieving Goal-Concordant Care: A Conceptual Model and Approach to Measuring Serious Illness Communication and Its Impact

PubMed Central

Curtis, J. Randall; Tulsky, James A.

2018-01-01

Abstract Background: High-quality care for seriously ill patients aligns treatment with their goals and values. Failure to achieve “goal-concordant” care is a medical error that can harm patients and families. Because communication between clinicians and patients enables goal concordance and also affects the illness experience in its own right, healthcare systems should endeavor to measure communication and its outcomes as a quality assessment. Yet, little consensus exists on what should be measured and by which methods. Objectives: To propose measurement priorities for serious illness communication and its anticipated outcomes, including goal-concordant care. Methods: We completed a narrative review of the literature to identify links between serious illness communication, goal-concordant care, and other outcomes. We used this review to identify gaps and opportunities for quality measurement in serious illness communication. Results: Our conceptual model describes the relationship between communication, goal-concordant care, and other relevant outcomes. Implementation-ready measures to assess the quality of serious illness communication and care include (1) the timing and setting of serious illness communication, (2) patient experience of communication and care, and (3) caregiver bereavement surveys that include assessment of perceived goal concordance of care. Future measurement priorities include direct assessment of communication quality, prospective patient or family assessment of care concordance with goals, and assessment of the bereaved caregiver experience. Conclusion: Improving serious illness care necessitates ensuring that high-quality communication has occurred and measuring its impact. Measuring patient experience and receipt of goal-concordant care should be our highest priority. We have the tools to measure both. PMID:29091522

Achieving Goal-Concordant Care: A Conceptual Model and Approach to Measuring Serious Illness Communication and Its Impact.

PubMed

Sanders, Justin J; Curtis, J Randall; Tulsky, James A

2018-03-01

High-quality care for seriously ill patients aligns treatment with their goals and values. Failure to achieve "goal-concordant" care is a medical error that can harm patients and families. Because communication between clinicians and patients enables goal concordance and also affects the illness experience in its own right, healthcare systems should endeavor to measure communication and its outcomes as a quality assessment. Yet, little consensus exists on what should be measured and by which methods. To propose measurement priorities for serious illness communication and its anticipated outcomes, including goal-concordant care. We completed a narrative review of the literature to identify links between serious illness communication, goal-concordant care, and other outcomes. We used this review to identify gaps and opportunities for quality measurement in serious illness communication. Our conceptual model describes the relationship between communication, goal-concordant care, and other relevant outcomes. Implementation-ready measures to assess the quality of serious illness communication and care include (1) the timing and setting of serious illness communication, (2) patient experience of communication and care, and (3) caregiver bereavement surveys that include assessment of perceived goal concordance of care. Future measurement priorities include direct assessment of communication quality, prospective patient or family assessment of care concordance with goals, and assessment of the bereaved caregiver experience. Improving serious illness care necessitates ensuring that high-quality communication has occurred and measuring its impact. Measuring patient experience and receipt of goal-concordant care should be our highest priority. We have the tools to measure both.

Functional Recovery Measures for Spinal Cord Injury: An Evidence-Based Review for Clinical Practice and Research

PubMed Central

Anderson, Kim; Aito, Sergio; Atkins, Michal; Biering-Sørensen, Fin; Charlifue, Susan; Curt, Armin; Ditunno, John; Glass, Clive; Marino, Ralph; Marshall, Ruth; Mulcahey, Mary Jane; Post, Marcel; Savic, Gordana; Scivoletto, Giorgio; Catz, Amiram

2008-01-01

Background/Objective: The end goal of clinical care and clinical research involving spinal cord injury (SCI) is to improve the overall ability of persons living with SCI to function on a daily basis. Neurologic recovery does not always translate into functional recovery. Thus, sensitive outcome measures designed to assess functional status relevant to SCI are important to develop. Method: Evaluation of currently available SCI functional outcome measures by a multinational work group. Results: The 4 measures that fit the prespecified inclusion criteria were the Modified Barthel Index (MBI), the Functional Independence Measure (FIM), the Quadriplegia Index of Function (QIF), and the Spinal Cord Independence Measure (SCIM). The MBI and the QIF were found to have minimal evidence for validity, whereas the FIM and the SCIM were found to be reliable and valid. The MBI has little clinical utility for use in the SCI population. Likewise, the FIM applies mainly when measuring burden of care, which is not necessarily a reflection of functional recovery. The QIF is useful for measuring functional recovery but only in a subpopulation of people with SCI, and substantial validity data are still required. The SCIM is the only functional recovery outcome measure designed specifically for SCI. Conclusions: The multinational work group recommends that the latest version of the SCIM (SCIM III) continue to be refined and validated and subsequently implemented worldwide as the primary functional recovery outcome measure for SCI. The QIF may continue to be developed and validated for use as a supplemental tool for the nonambulatory tetraplegic population. PMID:18581660

Minimal Clinically Important Difference: A Review of Outcome Measure Score Interpretation.

PubMed

Engel, Lisa; Beaton, Dorcas E; Touma, Zahi

2018-05-01

Clinicians, researchers, and outcome stakeholders have the crucial, albeit difficult, task of quantifying when a person or group experiences important change or difference on any given outcome measure, often in response to a specific intervention. The minimal clinically important difference (MCID) provides this quantified value of change/difference for a measure. There are many methods for MCID derivation, which can result in multiple values for the same measure. Thus, it is important for potential users of MCID values to be aware of the nuances of MCID development and cautions for interpreting values. This review outlines MCID-related definitions, methods, and guidelines. Copyright © 2018 Elsevier Inc. All rights reserved.

A thick placenta: a predictor of adverse pregnancy outcomes.

PubMed

Miwa, Ichiro; Sase, Masakatsu; Torii, Mayumi; Sanai, Hiromi; Nakamura, Yasuhiko; Ueda, Kazuyuki

2014-01-01

The aim of this study is to evaluate the efficacy of an ultrasonographic measurement of placental thickness and the correlation of a thick placenta with adverse perinatal outcome. Placental thickness was measured in single gravidas, 16 to 40 weeks of gestation, between 2005 and 2009. Placentas were considered to be thick if their measured thickness were above the 95th percentile for gestational age. The incidence of thick placentas was 4.3% (138/3,183). Perinatal morbidity and neonatal conditions were worse in cases with thick placenta rather than without thick placenta. Ultrasonographic measurement of placental thickness is a simple method to estimate placental size. Thick placenta may be a useful predictor of adverse pregnancy outcomes.

Measuring performance improvement: total organizational commitment or clinical specialization.

PubMed

Caron, Aleece; Jones, Paul; Neuhauser, Duncan; Aron, David C

2004-01-01

Resources for hospitals are limited when they are faced with multiple publicly reported performance measures as tools to assess quality. The leadership in these organizations may choose to focus on 1 or 2 of these outcomes. An alternative approach is that the leadership may commit resources or create conditions that result in improved quality over a broad range of measures. We used aggregated data on mortality, length of stay, and obstetrical outcomes from Greater Cleveland Health Quality Choice data to test these theories. We used Pearson correlation analysis to determine of outcomes were correlated with one another. We used repeated-measures ANOVA to determine if an association existed between outcome and time and outcome and hospital. All of the outcomes across all hospitals demonstrate a trend of overall improvement. Both the Pearson and ANOVA result support the hypothesis for the organization-wide approach to quality improvement. Hospital that make improvements in one clinical area trend to make improvements in others. Hospitals that produce improvements in limited clinical or administrative areas may not have completely adopted CQI into their culture or may not have yet realized the benefits of their organizational commitments, but use some of the concepts to improve quality outcomes.

Implementing a statewide outcomes management system for consumers of public mental health services.

PubMed

Clardy, J A; Booth, B M; Smith, L G; Nordquist, C R; Smith, G R

1998-02-01

The authors describe the development and implementation of an outcomes management system designed to measure outcomes and processes of care for public mental health consumers in Arkansas. The public-academic project was implemented in 1995 and is based on the Shewhart-Deming model of continuous quality improvement. All 15 community mental health centers (CMHCs) in the state participate in the project, which prospectively measures longitudinal outcomes of care for the tracer conditions of major depression and schizophrenia. Multiperspective measurement tools are used to measure patients' psychiatric status and general health status at periodic intervals; information is gathered on functioning, symptoms, severity of illness, social factors, demographic characteristics, and quality of life. A problem encountered during implementation was the relatively low rate of referral of patients with the tracer conditions for monitoring. Voluntary rather than mandatory participation in the outcomes management system by the CMHCs as well as clinicians' misperceptions about the system's purpose and concerns about confidentiality may have partly accounted for the low rate.

Fidelity and outcomes in six integrated dual disorders treatment programs.

PubMed

Chandler, Daniel W

2011-02-01

Fidelity scores and outcomes were measured in six outpatient programs in California which implemented Integrated Dual Disorders Treatment (IDDT). Outcomes were measured for 1 year in four sites and 2 years in two sites; fidelity was assessed at 6 month intervals. Three of the six sites achieved high fidelity (at least a 4 on a 5 point fidelity scale) and three moderate fidelity (at least a 3). Retention in treatment, mental health functioning, stage of substance abuse treatment, abstinence, and psychiatric hospitalization were measured. Outcomes for individual programs were generally positive but not consistent within programs or across programs. Using pooled data in a longitudinal regression model with random effects at person level and adjustment of standard errors for clustering by site, change over time was not statistically significant for the primary outcomes. Fidelity scores had limited association with positive outcomes.

Associations of educational attainment, occupation, and community poverty with hip osteoarthritis.

PubMed

Cleveland, Rebecca J; Schwartz, Todd A; Prizer, Lindsay P; Randolph, Randy; Schoster, Britta; Renner, Jordan B; Jordan, Joanne M; Callahan, Leigh F

2013-06-01

To examine cross-sectional baseline data from the Johnston County Osteoarthritis Project for the association between individual and community socioeconomic status (SES) measures with hip osteoarthritis (OA) outcomes. We analyzed data on 3,087 individuals (68% white and 32% African American). Educational attainment and occupation were used as individual measures of SES. Census block group household poverty rate was used as a measure of community SES. Hip OA outcomes included radiographic OA and symptomatic OA in one or both hip joints. Multivariable logistic regression models were used to estimate odds ratios (ORs) and 95% confidence intervals (95% CIs) for the association of each hip OA outcome with each SES variable separately, and then with all SES measures simultaneously. Associations between hip OA outcomes and SES variables were evaluated for effect modification by race and sex. Living in a community of high household poverty rate showed independent associations with hip radiographic OA in one or both hips (OR 1.50, 95% CI 1.18-1.92) and bilateral (both hips) radiographic OA (OR 1.87, 95% CI 1.32-2.66). Similar independent associations were found between low educational attainment among those with symptomatic OA in one or both hips (OR 1.44, 95% CI 1.09-1.91) or bilateral symptomatic OA (OR 1.91, 95% CI 1.08-3.39), after adjusting for all SES measures simultaneously. No significant associations were observed between occupation and hip OA outcomes, nor did race or sex modify the associations. Our data provide evidence that hip OA outcomes are associated with both education and community SES measures, associations that remained after adjustment for covariates and all SES measures. Copyright © 2013 by the American College of Rheumatology.

Validating Measures of Real-World Outcome: The Results of the VALERO Expert Survey and RAND Panel

PubMed Central

Leifker, Feea R.; Patterson, Thomas L.; Heaton, Robert K.; Harvey, Philip D.

2011-01-01

Background: People with schizophrenia demonstrate considerable discrepancy between self-reported functioning and informant reports. It is not clear whether these discrepancies originate from the instruments used or from the perspectives of different informants. The goal of the Validation of Everyday Real-World Outcomes (VALERO) Study is to enhance the measurement of real-world (RW) outcomes in the social, residential, and vocational domains through selection of optimal scales and informants using a multistep process similar to the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative. Methods: Forty-eight experts provided their opinion regarding the best scales measuring RW outcomes. Fifty-nine measures were nominated. The investigators selected the 11 scales that were the most highly nominated, had the most published validity data, and best represented the domains of interest. Information was provided to other experts who served as RAND panelists. Panelists rated each measure for its suitability across multiple a priori domains. Discrepant ratings were discussed until consensus was reached. Results: Following the RAND Panel, the 2 scales that scored highest across the various criteria for each of the classes of scales (hybrid, social functioning, and everyday living skills) were selected for use in the first substudy of VALERO. The scales selected were the Quality-of-Life Scale, Specific Levels of Functioning Scale, Social Behavior Schedule, Social Functioning Scale, Independent Living Skills Schedule, and Life Skills Profile. Discussion: The results show that although there are significant limitations with current scales used for the assessment of RW outcome in schizophrenia, a consensus is possible. Further, several existing instruments were rated as useful for measuring social, residential, and vocational outcomes. PMID:19525354

Power Calculations to Select Instruments for Clinical Trial Secondary Endpoints. A Case Study of Instrument Selection for Post-Traumatic Stress Symptoms in Subjects with Acute Respiratory Distress Syndrome.

PubMed

Sjoding, Michael W; Schoenfeld, David A; Brown, Samuel M; Hough, Catherine L; Yealy, Donald M; Moss, Marc; Angus, Derek C; Iwashyna, Theodore J

2017-01-01

After the sample size of a randomized clinical trial (RCT) is set by the power requirement of its primary endpoint, investigators select secondary endpoints while unable to further adjust sample size. How the sensitivity and specificity of an instrument used to measure these outcomes, together with their expected underlying event rates, affect an RCT's power to measure significant differences in these outcomes is poorly understood. Motivated by the design of an RCT of neuromuscular blockade in acute respiratory distress syndrome, we examined how power to detect a difference in secondary endpoints varies with the sensitivity and specificity of the instrument used to measure such outcomes. We derived a general formula and Stata code for calculating an RCT's power to detect differences in binary outcomes when such outcomes are measured with imperfect sensitivity and specificity. The formula informed the choice of instrument for measuring post-traumatic stress-like symptoms in the Reevaluation of Systemic Early Neuromuscular Blockade RCT ( www.clinicaltrials.gov identifier NCT02509078). On the basis of published sensitivities and specificities, the Impact of Events Scale-Revised was predicted to measure a 36% symptom rate, whereas the Post-Traumatic Stress Symptoms instrument was predicted to measure a 23% rate, if the true underlying rate of post-traumatic stress symptoms were 25%. Despite its lower sensitivity, the briefer Post-Traumatic Stress Symptoms instrument provided superior power to detect a difference in rates between trial arms, owing to its higher specificity. Examining instruments' power to detect differences in outcomes may guide their selection when multiple instruments exist, each with different sensitivities and specificities.

Disappearance of enlarged nuchal translucency before 14 weeks' gestation: relationship with chromosomal abnormalities and pregnancy outcome.

PubMed

Müller, M A; Pajkrt, E; Bleker, O P; Bonsel, G J; Bilardo, C M

2004-08-01

The aim of this study was to investigate the natural course of enlarged nuchal translucency (NT) and to determine if its disappearance before 14 weeks' gestation is a favorable prognostic sign in relation to fetal karyotype and pregnancy outcome. A total of 147 women with increased NT (> 95th centile) at first measurement were included in this study. A second measurement was performed in all cases, at an interval of at least 2 days. Both measurements were taken between 10 + 3 and 14 + 0 weeks. All women underwent chorionic villus sampling or amniocentesis for subsequent karyotyping. In those women with a normal karyotype, a fetal anomaly scan was performed at 20 weeks' gestation. Pregnancy outcome was recorded in all cases. The finding of persistent or disappearing NT enlargement was analyzed in relation to fetal karyotype and pregnancy outcome. Of the 147 paired measurements, NT remained enlarged at the second measurement in 121 (82%) cases. An abnormal karyotype was found in 35% of these cases. In 26 (18%) fetuses the NT measurement was found to be below the 95th percentile at the second measurement and in only two of them an abnormal karyotype was found (8%). In the 103 chromosomally normal fetuses an adverse outcome (i.e. fetal loss or structural defects) was recorded in 22 fetuses with persistent enlargement (28%) and in four fetuses with disappearing enlargement (17%). Disappearance of an enlarged NT before 14 weeks' gestation is not a rare phenomenon and seems to be a favorable prognostic sign with respect to fetal karyotype. Overall, no significant difference in pregnancy outcome was found between chromosomally normal fetuses with persisting or disappearing NT enlargement. Copyright 2004 ISUOG

Implementing patient-reported outcome measures in palliative care clinical practice: a systematic review of facilitators and barriers.

PubMed

Antunes, Bárbara; Harding, Richard; Higginson, Irene J

2014-02-01

Many patient-reported outcome measures have been developed in the past two decades, playing an increasingly important role in palliative care. However, their routine use in practice has been slow and difficult to implement. To systematically identify facilitators and barriers to the implementation of patient-reported outcome measures in different palliative care settings for routine practice, and to generate evidence-based recommendations, to inform the implementation process in clinical practice. Systematic literature review and narrative synthesis. Medline, PsycInfo, Cumulative Index to Nursing and Allied Health Literature, Embase and British Nursing Index were systematically searched from 1985. Hand searching of reference lists for all included articles and relevant review articles was performed. A total of 3863 articles were screened. Of these, 31 articles met the inclusion criteria. First, data were integrated in the main themes: facilitators, barriers and lessons learned. Second, each main theme was grouped into either five or six categories. Finally, recommendations for implementation on outcome measures at management, health-care professional and patient levels were generated for three different points in time: preparation, implementation and assessment/improvement. Successful implementation of patient-reported outcome measures should be tailored by identifying and addressing potential barriers according to setting. Having a coordinator throughout the implementation process seems to be key. Ongoing cognitive and emotional processes of each individual should be taken into consideration during changes. The educational component prior to the implementation is crucial. This could promote ownership and correct use of the measure by clinicians, potentially improving practice and the quality of care provided through patient-reported outcome measure data use in clinical decision-making.

Outcomes of total knee arthroplasty in relation to preoperative patient-reported and radiographic measures: data from the osteoarthritis initiative.

PubMed

Kahn, Timothy L; Soheili, Aydin; Schwarzkopf, Ran

2013-12-01

Total knee arthroplasty (TKA) is the preferred surgical treatment for end-stage osteoarthritis. However, substantial numbers of patients still experience poor outcomes. Consequently, it is important to identify which patient characteristics are predictive of outcomes in order to guide clinical decisions. Our hypothesis is that preoperative patient-reported outcome measures and radiographic measures may help to predict TKA outcomes. Using cohort data from the Osteoarthritis Initiative, we studied 172 patients who underwent TKA. For each patient, we compiled pre- and postoperative Western Ontario and McMaster University Arthritis Index (WOMAC) scores. Radiographs were measured for knee joint angles, femorotibial angles, anatomical lateral distal femoral angles, and anatomical medial proximal tibial angles; Kellgren and Lawrence (KL) grades were assigned to each compartment of the knee. All studied measurements were compared to WOMAC outcomes. Preoperative WOMAC disability, pain, and total scores were positively associated with postoperative WOMAC total scores (P = .010, P = .010, and P = .009, respectively) and were associated with improvement in WOMAC total scores (P < .001, P < .001, and P < .001, respectively). For radiographic measurements, preoperative joint angles were positively associated with improvements in postoperative WOMAC total scores (P = .044). Combined KL grades (medial and lateral compartments) were negatively correlated with postoperative WOMAC disability and pain scores (P = .045 and P = .044) and were positively correlated with improvements in WOMAC total scores (P = .001). All preoperative WOMAC scores demonstrated positive associations with postoperative WOMAC scores, while among the preoperative radiographic measurements only combined KL grades and joint angles showed any correlation with postoperative WOMAC scores. Higher preoperative KL grades and joint angles were associated with better (lower) postoperative WOMAC scores, demonstrating an inverse correlation.

Comparing contents of outcome measures in cerebral palsy using the International Classification of Functioning (ICF-CY): a systematic review.

PubMed

Schiariti, Veronica; Klassen, Anne F; Cieza, Alarcos; Sauve, Karen; O'Donnell, Maureen; Armstrong, Robert; Mâsse, Louise C

2014-01-01

The International Classification of Functioning children and youth version (ICF-CY) provides a universal framework for defining and classifying functioning and disability in children worldwide. To facilitate the application of the ICF in practice, ICF based-tools like the "ICF Core Sets" are being developed. In the context of the development of the ICF-CY Core Sets for children with Cerebral Palsy (CP), the aims of this study were as follows: to identify and compare the content of outcome measures used in studies of children with CP using the ICF-CY coding system; and to describe the most frequently addressed areas of functioning in those studies. We searched multiple databases likely to capture studies involving children with CP from January 1998 to March 2012. We included all English language articles that studied children aged 2-18 years and described an interventional or observational study. Constructs of the outcome measures identified in studies were linked to the ICF-CY by two trained professionals. We found 231 articles that described 238 outcome measures. The outcome measures contained 2193 concepts that were linked to the ICF-CY and covered 161 independent ICF-CY categories. Out of the 161 categories, 53 (33.5%) were related to body functions, 75 (46%) were related to activities/participation, 26 (16.1%) were related to environmental factors, and 7 (4.3%) were related to body structures. This systematic review provides information about content of measures that may guide researchers and clinicians in their selection of an outcome measure for use in a study and/or clinical practice with children with CP. Copyright © 2013 European Paediatric Neurology Society. Published by Elsevier Ltd. All rights reserved.

Unmet reproductive health needs among women in some West African countries: a systematic review of outcome measures and determinants.

PubMed

Ayanore, Martin Amogre; Pavlova, Milena; Groot, Wim

2016-01-16

Identifying relevant measures of women's reproductive health needs is critical to improve women's chances of service utilization. The study aims to systematically review and analyze the adequacy of outcome measures and determinants applied in previous studies for assessing women reproductive health needs across West Africa. Evidence on outcomes and determinants of unmet reproductive health needs among women of childbearing age in diverse multicultural, religious, and ethnic settings in West African countries was systematically reviewed. The review included recent English language publications (from January 2009 - March 2014). Clinical studies particularly on obstetric care services and reproductive services in relation to HIV/AIDS were excluded. We acknowledge the possibility to have excluded non-English publications and yet-to-be-published articles related to the study aim and objectives. Outcomes and determinants were assessed and defined at three main levels; contraceptive use, obstetric care, and antenatal care utilization. Results show increasing unmet need for women's reproductive health needs. Socio-cultural norms and practices resulting in discontinuation of service use, economic constraints, travel distance to access services and low education levels of women were found to be key predictors of service utilization for contraception, antenatal and obstetric care services. Outcome measures were mainly assessed based on service utilization, satisfaction, cost, and quality of services available as core measures across the three levels assessed in this review. Evidence from this review indicates that currently applied measures of women's reproductive health needs might be inadequate in attaining best maternal outcomes since they appear rather broad. More support and research for developing and advancing context-related measures may help to improve women's maternal health.

SAGES quality initiative: an introduction.

PubMed

Lidor, Anne; Telem, Dana; Bower, Curtis; Sinha, Prashant; Orlando, Rocco; Romanelli, John

2017-08-01

The Medicare program has transitioned to paying healthcare providers based on the quality of care delivered, not on the quantity. In May 2015, SAGES held its first ever Quality Summit. The goal of this meeting was to provide us with the information necessary to put together a strategic plan for our Society over the next 3-5 years, and to participate actively on a national level to help develop valid measures of quality of surgery. The transition to value-based medicine requires that providers are now measured and reimbursed based on the quality of services they provide rather than the quantity of patients in their care. As of 2014, quality measures must cover 3 of the 6 available National Quality domains. Physician quality reporting system measures are created via a vigorous process which is initiated by the proposal of the quality measure and subsequent validation. Commercial, non-profit, and governmental agencies have now been engaged in the measurement of hospital performance through structural measures, process measures, and increasingly with outcomes measures. This more recent focus on outcomes measures have been linked to hospital payments through the Value-Based Purchasing program. Outcomes measures of quality drive CMS' new program, MACRA, using two formats: Merit-based incentive programs and alternative payment models. But, the quality of information now available is highly variable and difficult for the average consumer to use. Quality metrics serve to guide efforts to improve performance and for consumer education. Professional organizations such as SAGES play a central role in defining the agenda for improving quality, outcomes, and safety. The mission of SAGES is to improve the quality of patient care through education, research, innovation, and leadership, principally in gastrointestinal and endoscopic surgery.

The King's Outcome Scale for Childhood Head Injury and Injury Severity and Outcome Measures in Children with Traumatic Brain Injury

ERIC Educational Resources Information Center

Calvert, Sophie; Miller, Helen E.; Curran, Andrew; Hameed, Biju; McCarter, Renee; Edwards, Richard J.; Hunt, Linda; Sharples, Peta Mary

2008-01-01

The aim of this study was to relate discharge King's Outcome Scale for Childhood Head Injury (KOSCHI) category to injury severity and detailed outcome measures obtained in the first year post-traumatic brain injury (TBI). We used a prospective cohort study. Eighty-one children with TBI were studied: 29 had severe, 15 moderate, and 37 mild TBI. The…

American College of Rheumatology/European League against Rheumatism provisional definition of remission in rheumatoid arthritis for clinical trials.

PubMed

Felson, David T; Smolen, Josef S; Wells, George; Zhang, Bin; van Tuyl, Lilian H D; Funovits, Julia; Aletaha, Daniel; Allaart, Cornelia F; Bathon, Joan; Bombardieri, Stefano; Brooks, Peter; Brown, Andrew; Matucci-Cerinic, Marco; Choi, Hyon; Combe, Bernard; de Wit, Maarten; Dougados, Maxime; Emery, Paul; Furst, Daniel; Gomez-Reino, Juan; Hawker, Gillian; Keystone, Edward; Khanna, Dinesh; Kirwan, John; Kvien, Tore K; Landewé, Robert; Listing, Joachim; Michaud, Kaleb; Martin-Mola, Emilio; Montie, Pamela; Pincus, Theodore; Richards, Pamela; Siegel, Jeffrey N; Simon, Lee S; Sokka, Tuulikki; Strand, Vibeke; Tugwell, Peter; Tyndall, Alan; van der Heijde, Desirée; Verstappen, Suzan; White, Barbara; Wolfe, Frederick; Zink, Angela; Boers, Maarten

2011-03-01

Remission in rheumatoid arthritis (RA) is an increasingly attainable goal, but there is no widely used definition of remission that is stringent but achievable and could be applied uniformly as an outcome measure in clinical trials. This work was undertaken to develop such a definition. A committee consisting of members of the American College of Rheumatology, the European League Against Rheumatism, and the Outcome Measures in Rheumatology Initiative met to guide the process and review prespecified analyses from RA clinical trials. The committee requested a stringent definition (little, if any, active disease) and decided to use core set measures including, as a minimum, joint counts and levels of an acute-phase reactant to define remission. Members were surveyed to select the level of each core set measure that would be consistent with remission. Candidate definitions of remission were tested, including those that constituted a number of individual measures of remission (Boolean approach) as well as definitions using disease activity indexes. To select a definition of remission, trial data were analysed to examine the added contribution of patient-reported outcomes and the ability of candidate measures to predict later good radiographic and functional outcomes. Survey results for the definition of remission suggested indexes at published thresholds and a count of core set measures, with each measure scored as 1 or less (eg, tender and swollen joint counts, C reactive protein (CRP) level, and global assessments on a 0-10 scale). Analyses suggested the need to include a patient-reported measure. Examination of 2-year follow-up data suggested that many candidate definitions performed comparably in terms of predicting later good radiographic and functional outcomes, although 28-joint Disease Activity Score-based measures of remission did not predict good radiographic outcomes as well as the other candidate definitions did. Given these and other considerations, we propose that a patient's RA can be defined as being in remission based on one of two definitions: (1) when scores on the tender joint count, swollen joint count, CRP (in mg/dl), and patient global assessment (0-10 scale) are all ≤1, or (2) when the score on the Simplified Disease Activity Index is ≤3.3. We propose two new definitions of remission, both of which can be uniformly applied and widely used in RA clinical trials. The authors recommend that one of these be selected as an outcome measure in each trial and that the results on both be reported for each trial.

American College of Rheumatology/European League Against Rheumatism provisional definition of remission in rheumatoid arthritis for clinical trials.

PubMed

Felson, David T; Smolen, Josef S; Wells, George; Zhang, Bin; van Tuyl, Lilian H D; Funovits, Julia; Aletaha, Daniel; Allaart, Cornelia F; Bathon, Joan; Bombardieri, Stefano; Brooks, Peter; Brown, Andrew; Matucci-Cerinic, Marco; Choi, Hyon; Combe, Bernard; de Wit, Maarten; Dougados, Maxime; Emery, Paul; Furst, Daniel; Gomez-Reino, Juan; Hawker, Gillian; Keystone, Edward; Khanna, Dinesh; Kirwan, John; Kvien, Tore K; Landewé, Robert; Listing, Joachim; Michaud, Kaleb; Martin-Mola, Emilio; Montie, Pamela; Pincus, Theodore; Richards, Pamela; Siegel, Jeffrey N; Simon, Lee S; Sokka, Tuulikki; Strand, Vibeke; Tugwell, Peter; Tyndall, Alan; van der Heijde, Desirée; Verstappen, Suzan; White, Barbara; Wolfe, Frederick; Zink, Angela; Boers, Maarten

2011-03-01

Remission in rheumatoid arthritis (RA) is an increasingly attainable goal, but there is no widely used definition of remission that is stringent but achievable and could be applied uniformly as an outcome measure in clinical trials. This work was undertaken to develop such a definition. A committee consisting of members of the American College of Rheumatology, the European League Against Rheumatism, and the Outcome Measures in Rheumatology Initiative met to guide the process and review prespecified analyses from RA clinical trials. The committee requested a stringent definition (little, if any, active disease) and decided to use core set measures including, as a minimum, joint counts and levels of an acute-phase reactant to define remission. Members were surveyed to select the level of each core set measure that would be consistent with remission. Candidate definitions of remission were tested, including those that constituted a number of individual measures of remission (Boolean approach) as well as definitions using disease activity indexes. To select a definition of remission, trial data were analyzed to examine the added contribution of patient-reported outcomes and the ability of candidate measures to predict later good radiographic and functional outcomes. Survey results for the definition of remission suggested indexes at published thresholds and a count of core set measures, with each measure scored as 1 or less (e.g., tender and swollen joint counts, C-reactive protein [CRP] level, and global assessments on a 0-10 scale). Analyses suggested the need to include a patient-reported measure. Examination of 2-year followup data suggested that many candidate definitions performed comparably in terms of predicting later good radiographic and functional outcomes, although 28-joint Disease Activity Score-based measures of remission did not predict good radiographic outcomes as well as the other candidate definitions did. Given these and other considerations, we propose that a patient's RA can be defined as being in remission based on one of two definitions: (a) when scores on the tender joint count, swollen joint count, CRP (in mg/dl), and patient global assessment (0-10 scale) are all ≤ 1, or (b) when the score on the Simplified Disease Activity Index is ≤ 3.3. We propose two new definitions of remission, both of which can be uniformly applied and widely used in RA clinical trials. We recommend that one of these be selected as an outcome measure in each trial and that the results on both be reported for each trial. Copyright © 2011 by the American College of Rheumatology.

Parents Suggest Which Indicators of Progress and Outcomes Should Be Measured in Young Children with Autism Spectrum Disorder

ERIC Educational Resources Information Center

McConachie, Helen; Livingstone, Nuala; Morris, Christopher; Beresford, Bryony; Le Couteur, Ann; Gringras, Paul; Garland, Deborah; Jones, Glenys; Macdonald, Geraldine; Williams, Katrina; Parr, Jeremy R.

2018-01-01

Evaluation of interventions for children with autism spectrum disorder (ASD) is hampered by the multitude of outcomes measured and tools used. Measurement in research with young children tends to focus on core impairments in ASD. We conducted a systematic review of qualitative studies of what matters to parents. Parent advisory groups completed…

Item Banks for Measuring Emotional Distress from the Patient-Reported Outcomes Measurement Information System (PROMIS[R]): Depression, Anxiety, and Anger

ERIC Educational Resources Information Center

Pilkonis, Paul A.; Choi, Seung W.; Reise, Steven P.; Stover, Angela M.; Riley, William T.; Cella, David

2011-01-01

The authors report on the development and calibration of item banks for depression, anxiety, and anger as part of the Patient-Reported Outcomes Measurement Information System (PROMIS[R]). Comprehensive literature searches yielded an initial bank of 1,404 items from 305 instruments. After qualitative item analysis (including focus groups and…

Deconstructing Therapy Outcome Measurement with Rasch Analysis of a Measure of General Clinical Distress: The Symptom Checklist-90-Revised

ERIC Educational Resources Information Center

Elliott, Robert; Fox, Christine M.; Beltyukova, Svetlana A.; Stone, Gregory E.; Gunderson, Jennifer; Zhang, Xi

2006-01-01

Rasch analysis was used to illustrate the usefulness of item-level analyses for evaluating a common therapy outcome measure of general clinical distress, the Symptom Checklist-90-Revised (SCL-90-R; Derogatis, 1994). Using complementary therapy research samples, the instrument's 5-point rating scale was found to exceed clients' ability to make…

Measuring Critical Education Processes and Outcomes: Illustration from a Cluster Randomized Trial in the Democratic Republic of the Congo

ERIC Educational Resources Information Center

Halpin, Peter F.; Torrente, Catalina

2014-01-01

Using reliable and valid measures of students' outcomes which are sensitive to change is critical for obtaining interpretable and therefore useful results from evaluations of school-based interventions. While measurement development for use in experimental evaluations receives a great deal of attention in the U.S., it lags behind in low-income…

Outcomes Measurement in Voice Disorders: Application of an Acoustic Index of Dysphonia Severity

ERIC Educational Resources Information Center

Awan, Shaheen N.; Roy, Nelson

2009-01-01

Purpose: The purpose of this experiment was to assess the ability of an acoustic model composed of both time-based and spectral-based measures to track change following voice disorder treatment and to serve as a possible treatment outcomes measure. Method: A weighted, four-factor acoustic algorithm consisting of shimmer, pitch sigma, the ratio of…

Occurrences and sources of Differential Item Functioning (DIF) in patient-reported outcome measures: Description of DIF methods, and review of measures of depression, quality of life and general health

PubMed Central

Teresi, Jeanne A.; Ramirez, Mildred; Lai, Jin-Shei; Silver, Stephanie

2009-01-01

Examination of the equivalence of measures involves several levels, including conceptual equivalence of meaning, as well as quantitative tests of differential item functioning (DIF). The purpose of this review is to examine DIF in patient-reported outcomes. Reviewed were measures of self-reported depression, quality of life (QoL) and general health. Most measures of depression contained large amounts of DIF, and the impact of DIF at the scale level was typically sizeable. The studies of QoL and health measures identified a moderate amount of DIF; however, many of these studies examined only one type of DIF (uniform). Relative to DIF analyses of depression measures, less analysis of the impact of DIF on QoL and health measures was performed, and the authors of these analyses generally did not recommend remedial action, with one notable exception. While these studies represent good beginning efforts to examine measurement equivalence in patient-reported outcome measures, more cross-validation work is required using other (often larger) samples of different ethnic and language groups, as well as other methods that permit more extensive analyses of the type of DIF, together with magnitude and impact. PMID:20165561

Multidimensional assessment of self-regulated learning with middle school math students.

PubMed

Callan, Gregory L; Cleary, Timothy J

2018-03-01

This study examined the convergent and predictive validity of self-regulated learning (SRL) measures situated in mathematics. The sample included 100 eighth graders from a diverse, urban school district. Four measurement formats were examined including, 2 broad-based (i.e., self-report questionnaire and teacher ratings) and 2 task-specific measures (i.e., SRL microanalysis and behavioral traces). Convergent validity was examined across task-difficulty, and the predictive validity was examined across 3 mathematics outcomes: 2 measures of mathematical problem solving skill (i.e., practice session math problems, posttest math problems) and a global measure of mathematical skill (i.e., standardized math test). Correlation analyses were used to examine convergent validity and revealed medium correlations between measures within the same category (i.e., broad-based or task-specific). Relations between measurement classes were not statistically significant. Separate regressions examined the predictive validity of the SRL measures. While controlling all other predictors, a SRL microanalysis metacognitive-monitoring measure emerged as a significant predictor of all 3 outcomes and teacher ratings accounted for unique variance on 2 of the outcomes (i.e., posttest math problems and standardized math test). Results suggest that a multidimensional assessment approach should be considered by school psychologists interested in measuring SRL. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Strength, Multijoint Coordination, and Sensorimotor Processing Are Independent Contributors to Overall Balance Ability

PubMed Central

Lawrence, Emily L.; Cesar, Guilherme M.; Bromfield, Martha R.; Peterson, Richard; Valero-Cuevas, Francisco J.; Sigward, Susan M.

2015-01-01

For young adults, balance is essential for participation in physical activities but is often disrupted following lower extremity injury. Clinical outcome measures such as single limb balance (SLB), Y-balance (YBT), and the single limb hop and balance (SLHB) tests are commonly used to quantify balance ability following injury. Given the varying demands across tasks, it is likely that such outcome measures provide useful, although task-specific, information. But the extent to which they are independent and contribute to understanding the multiple contributors to balance is not clear. Therefore, the purpose of this study was to investigate the associations among these measures as they relate to the different contributors to balance. Thirty-seven recreationally active young adults completed measures including Vertical Jump, YBT, SLB, SLHB, and the new Lower Extremity Dexterity test. Principal components analysis revealed that these outcome measures could be thought of as quantifying the strength, multijoint coordination, and sensorimotor processing contributors to balance. Our results challenge the practice of using a single outcome measure to quantify the naturally multidimensional mechanisms for everyday functions such as balance. This multidimensional approach to, and interpretation of, multiple contributors to balance may lead to more effective, specialized training and rehabilitation regimens. PMID:26665007

Analysis of subarachnoid hemorrhage using the Nationwide Inpatient Sample: the NIS-SAH Severity Score and Outcome Measure.

PubMed

Washington, Chad W; Derdeyn, Colin P; Dacey, Ralph G; Dhar, Rajat; Zipfel, Gregory J

2014-08-01

Studies using the Nationwide Inpatient Sample (NIS), a large ICD-9-based (International Classification of Diseases, Ninth Revision) administrative database, to analyze aneurysmal subarachnoid hemorrhage (SAH) have been limited by an inability to control for SAH severity and the use of unverified outcome measures. To address these limitations, the authors developed and validated a surrogate marker for SAH severity, the NIS-SAH Severity Score (NIS-SSS; akin to Hunt and Hess [HH] grade), and a dichotomous measure of SAH outcome, the NIS-SAH Outcome Measure (NIS-SOM; akin to modified Rankin Scale [mRS] score). Three separate and distinct patient cohorts were used to define and then validate the NIS-SSS and NIS-SOM. A cohort (n = 148,958, the "model population") derived from the 1998-2009 NIS was used for developing the NIS-SSS and NIS-SOM models. Diagnoses most likely reflective of SAH severity were entered into a regression model predicting poor outcome; model coefficients of significant factors were used to generate the NIS-SSS. Nationwide Inpatient Sample codes most likely to reflect a poor outcome (for example, discharge disposition, tracheostomy) were used to create the NIS-SOM. Data from 716 patients with SAH (the "validation population") treated at the authors' institution were used to validate the NIS-SSS and NIS-SOM against HH grade and mRS score, respectively. Lastly, 147,395 patients (the "assessment population") from the 1998-2009 NIS, independent of the model population, were used to assess performance of the NIS-SSS in predicting outcome. The ability of the NIS-SSS to predict outcome was compared with other common measures of disease severity (All Patient Refined Diagnosis Related Group [APR-DRG], All Payer Severity-adjusted DRG [APS-DRG], and DRG). RESULTS The NIS-SSS significantly correlated with HH grade, and there was no statistical difference between the abilities of the NIS-SSS and HH grade to predict mRS-based outcomes. As compared with the APR-DRG, APSDRG, and DRG, the NIS-SSS was more accurate in predicting SAH outcome (area under the curve [AUC] = 0.69, 0.71, 0.71, and 0.79, respectively). A strong correlation between NIS-SOM and mRS was found, with an agreement and kappa statistic of 85% and 0.63, respectively, when poor outcome was defined by an mRS score > 2 and 95% and 0.84 when poor outcome was defined by an mRS score > 3. Data in this study indicate that in the analysis of NIS data sets, the NIS-SSS is a valid measure of SAH severity that outperforms previous measures of disease severity and that the NIS-SOM is a valid measure of SAH outcome. It is critically important that outcomes research in SAH using administrative data sets incorporate the NIS-SSS and NIS-SOM to adjust for neurology-specific disease severity.

Beyond total treatment effects in randomised controlled trials: Baseline measurement of intermediate outcomes needed to reduce confounding in mediation investigations.

PubMed

Landau, Sabine; Emsley, Richard; Dunn, Graham

2018-06-01

Random allocation avoids confounding bias when estimating the average treatment effect. For continuous outcomes measured at post-treatment as well as prior to randomisation (baseline), analyses based on (A) post-treatment outcome alone, (B) change scores over the treatment phase or (C) conditioning on baseline values (analysis of covariance) provide unbiased estimators of the average treatment effect. The decision to include baseline values of the clinical outcome in the analysis is based on precision arguments, with analysis of covariance known to be most precise. Investigators increasingly carry out explanatory analyses to decompose total treatment effects into components that are mediated by an intermediate continuous outcome and a non-mediated part. Traditional mediation analysis might be performed based on (A) post-treatment values of the intermediate and clinical outcomes alone, (B) respective change scores or (C) conditioning on baseline measures of both intermediate and clinical outcomes. Using causal diagrams and Monte Carlo simulation, we investigated the performance of the three competing mediation approaches. We considered a data generating model that included three possible confounding processes involving baseline variables: The first two processes modelled baseline measures of the clinical variable or the intermediate variable as common causes of post-treatment measures of these two variables. The third process allowed the two baseline variables themselves to be correlated due to past common causes. We compared the analysis models implied by the competing mediation approaches with this data generating model to hypothesise likely biases in estimators, and tested these in a simulation study. We applied the methods to a randomised trial of pragmatic rehabilitation in patients with chronic fatigue syndrome, which examined the role of limiting activities as a mediator. Estimates of causal mediation effects derived by approach (A) will be biased if one of the three processes involving baseline measures of intermediate or clinical outcomes is operating. Necessary assumptions for the change score approach (B) to provide unbiased estimates under either process include the independence of baseline measures and change scores of the intermediate variable. Finally, estimates provided by the analysis of covariance approach (C) were found to be unbiased under all the three processes considered here. When applied to the example, there was evidence of mediation under all methods but the estimate of the indirect effect depended on the approach used with the proportion mediated varying from 57% to 86%. Trialists planning mediation analyses should measure baseline values of putative mediators as well as of continuous clinical outcomes. An analysis of covariance approach is recommended to avoid potential biases due to confounding processes involving baseline measures of intermediate or clinical outcomes, and not simply for increased precision.

The Effects of an 8-Week Stabilization Exercise Program on Lumbar Multifidus Muscle Thickness and Activation as Measured With Ultrasound Imaging in Patients With Low Back Pain: An Exploratory Study.

PubMed

Larivière, Christian; Gagnon, Dany H; Henry, Sharon M; Preuss, Richard; Dumas, Jean-Pierre

2018-05-01

Lumbar stabilization exercise programs (LSEP) produce positive effects on clinical outcomes, but the underlying mechanisms remain relatively unexplored. Psychological and neuromuscular mechanisms can be involved, such as a better activation of the lumbar multifidus, which represents one possibility. To determine the following: (1) the effect of an LSEP on lumbar multifidus muscle thickness and activation, as measured with rehabilitative ultrasound imaging (RUSI), in patients with low back pain (LBP); (2) the correlation between RUSI measures and any change in clinical outcomes following the LSEP; and (3) the reliability of RUSI measures in control subjects over 8 weeks. One-arm clinical trial with healthy subjects as a control group; reliability study. LSEP delivered in a clinical setting; outcomes measured in a laboratory setting. A total of 34 patients with nonacute LBP and 28 healthy control subjects. Outcomes were measured before and after an 8-week LSEP in patients with LBP, and at the same time interval (without treatment, to assess reliability) in control subjects. Pain numeric rating scale, Oswestry Disability Index (function), as well as RUSI measures for the lumbar multifidus (LM) muscles at 3 vertebral levels (L5-S1, L4-5, and L3-4) during rest (static) and dynamic contractions (percent thickness change). Patients did not show systematic changes in RUSI measures relative to controls, even though RUSI impairments were observed at baseline (dynamic measure at L5-S1) and even though patients had significant improvements in pain and disability. Correlational analyses with these clinical outcomes suggested that patients had reduced muscle thickness at baseline that was associated with a greater reduction in disability following LSEP; however, LM activation measured at baseline showed the opposite. Static RUSI measures showed excellent reliability at the L4-5 and L3-4 levels, whereas dynamic measures were not reliable. Patients showed less muscle activation than controls at baseline (L5-S1 level), but the LSEP did not normalize this impairment. The links between RUSI measures and the change in clinical outcomes during LSEP should be further explored. This clinical trial has been recorded in the International Standard Registered Clinical/soCial sTudy Number (ISRCTN) registry (ID: ISRCTN94152969). II. Copyright © 2018 American Academy of Physical Medicine and Rehabilitation. Published by Elsevier Inc. All rights reserved.

Diabetes Health Literacy Among Somali Patients with Diabetes Mellitus in a US Primary Care Setting.

PubMed

Njeru, Jane W; Hagi-Salaad, Misbil F; Haji, Habibo; Cha, Stephen S; Wieland, Mark L

2016-06-01

The purpose of this study was to describe diabetes literacy among Somali immigrants with diabetes and its association with diabetes outcomes. Among Somali immigrants in North America, the prevalence of diabetes exceeds that of the general population, and their measures of diabetes control are suboptimal when compared with non-Somali patients. Diabetes literacy is an important mediator of diabetes outcomes in general populations that has not been previously described among Somali immigrants and refugees. Diabetes literacy was measured using a translated version of the spoken knowledge in low literacy in diabetes (SKILLD) scale among Somali immigrants and refugees with type 2 diabetes. Diabetes outcome measures, including hemoglobin A1C, low-density lipoprotein (LDL) cholesterol, and blood pressure, were obtained for each patient. Multivariate logistic regression was used to assess associations between diabetes literacy and diabetes outcomes. Among 50 Somali patients with diabetes who completed the survey, the mean SKILLD score was low (42.2 %). The diabetes outcome measures showed a mean hemoglobin A1C of 8 %, LDL cholesterol of 99.17 mg/dL (2.57 mmol/L), systolic blood pressure of 130.9 mmHg, and diastolic blood pressure of 70.2 mmHg. There was no association between diabetes literacy scores and diabetes outcome measures. Somali patients with diabetes mellitus had low diabetes literacy and suboptimal measures of diabetes disease control. However, we found no association between diabetes literacy and diabetes outcomes. Future work aimed at reduction of diabetes-related health disparities among Somali immigrants and refugees to high-income countries should go beyond traditional means of patient education for low-literacy populations.

Outcome assessment for spasticity management in the patient with traumatic brain injury: the state of the art.

PubMed

Elovic, Elie P; Simone, Lisa K; Zafonte, Ross

2004-01-01

The objective of this article was to (1) review the engineering and medical literature to structure the available information concerning the assessment of spasticity in the neurological population; (2) to discuss the strengths and weaknesses of the different methods currently in use in spasticity assessment; and (3) make recommendations for future efforts in spasticity outcome assessment. Spasticity textbooks, Web sites, and OVID, IEEE, and Medline searches from 1966 through 2003 of spasticity, quantitative measure, or outcome assessment in the rehabilitation population were used as data sources. Over 500 articles were reviewed. Articles that discussed outcome measures used to assess interventions and evaluation of spasticity were included. Authors reviewed the articles looking at inclusion criteria, data collection, methodology, assessment methods, and conclusions for validity and relevance to this article. Issues such as clinical relevance, real-world function and lack of objectivity, and time consumed during performance are important issues for spasticity assessment. Some measures such as the Ashworth Scale remain in common use secondary to ease of use despite their obvious functional limitations. More functional outcome goals are plagued by being more time consuming and a general inability to demonstrate changes after an intervention. This may be secondary to the other factors that combine with spasticity to cause dysfunction at that level. Quantitative metrics can provide more objective measurements but their clinical relevance is sometimes problematic. The assessment of spasticity outcome is still somewhat problematic. Further work is necessary to develop measures that have real-world functional significance to both the individuals being treated and the clinicians. A lack of objectivity is still a problem. In the future it is important for clinicians and the engineers to work together in the development of better outcome measures.

Populations and outcome measures used in ongoing research in sarcopenia.

PubMed

Peña Ordóñez, Gloria Gabriela; Bustamante Montes, Lilia Patricia; Ramírez Duran, Ninfa; Sánchez Castellano, Carmen; Cruz-Jentoft, Alfonso J

2017-08-01

Sarcopenia research may be hampered by the heterogeneity of populations and outcome measures used in clinical studies. The aim of this study was to describe the inclusion/exclusion criteria and outcome measures used in ongoing research in sarcopenia. All active intervention studies registered in the World Health Organization with the keyword sarcopenia were included. Study design, type of intervention, inclusion/exclusion criteria and outcome measures were registered and classified. In April 2014, 151 studies on sarcopenia were registered in the WHO database. One hundred twenty-three were intervention studies. Most trials (94.3 %) were single centre and randomized (93.5 %), 51.2 % were double blind. Nutritional interventions (36.6 %), physical exercise (12.2 %) or both (19.5 %) were the most common interventions tested. Only 54.4 % included subjects of both genders, and 46.3 % had an upper age limit. Definition of the target populations was heterogeneous, with 57.7 % including healthy subjects and none using recent definitions of sarcopenia. Lifestyle and the degree of physical activity of subjects were not described or considered in most cases (79.7 %). Subjects with cardiovascular, neuropsychiatric or metabolic disorders and those with physical disability were usually excluded. Muscle mass and muscle strength were the primary outcome variables in 28.5 and 29.5 % of studies and physical performance in 19.5 %, but only 4.1 % used the three variables used the three of them. An additional 26.8 % used biological outcome variables. Little information and agreement existed in the way muscle and physical performance parameters were measured. We found a large heterogeneity in trial design, definition of populations and outcome measures in present research.

Measures of Social Deprivation That Predict Health Care Access and Need within a Rational Area of Primary Care Service Delivery

PubMed Central

Butler, Danielle C; Petterson, Stephen; Phillips, Robert L; Bazemore, Andrew W

2013-01-01

Objective To develop a measure of social deprivation that is associated with health care access and health outcomes at a novel geographic level, primary care service area. Data Sources/Study Setting Secondary analysis of data from the Dartmouth Atlas, AMA Masterfile, National Provider Identifier data, Small Area Health Insurance Estimates, American Community Survey, Area Resource File, and Behavioural Risk Factor Surveillance System. Data were aggregated to primary care service areas (PCSAs). Study Design Social deprivation variables were selected from literature review and international examples. Factor analysis was used. Correlation and multivariate analyses were conducted between index, health outcomes, and measures of health care access. The derived index was compared with poverty as a predictor of health outcomes. Data Collection/Extraction Methods Variables not available at the PCSA level were estimated at block level, then aggregated to PCSA level. Principal Findings Our social deprivation index is positively associated with poor access and poor health outcomes. This pattern holds in multivariate analyses controlling for other measures of access. A multidimensional measure of deprivation is more strongly associated with health outcomes than a measure of poverty alone. Conclusions This geographic index has utility for identifying areas in need of assistance and is timely for revision of 35-year-old provider shortage and geographic underservice designation criteria used to allocate federal resources. PMID:22816561

PROMIS Physical Function Computer Adaptive Test Compared With Other Upper Extremity Outcome Measures in the Evaluation of Proximal Humerus Fractures in Patients Older Than 60 Years.

PubMed

Morgan, Jordan H; Kallen, Michael A; Okike, Kanu; Lee, Olivia C; Vrahas, Mark S

2015-06-01

To compare the PROMIS Physical Function Computer Adaptive Test (PROMIS PF CAT) to commonly used traditional PF measures for the evaluation of patients with proximal humerus fractures. Prospective. Two Level I trauma centers. Forty-seven patients older than 60 years with displaced proximal humerus fractures treated between 2006 and 2009. Evaluation included completion of the PROMIS PF CAT, the Constant Shoulder Score, the Disabilities of the Arm, Shoulder, and Hand (DASH) and the Short Musculoskeletal Functional Assessment (SMFA). Observed correlations among the administered PF outcome measures. On average, patients responded to 86 outcome-related items for this study: 4 for the PROMIS PF CAT (range: 4-8 items), 6 for the Constant Shoulder Score, 30 for the DASH, and 46 for the SMFA. Time to complete the PROMIS PF CAT (median completion time = 98 seconds) was significantly less than that for the DASH (median completion time = 336 seconds, P < 0.001) and for the SMFA (median completion time = 482 seconds, P < 0.001). PROMIS PF CAT scores correlated statistically significantly and were of moderate-to-high magnitude with all other PF outcome measure scores administered. This study suggests using the PROMIS PF CAT as a sole PF outcome measure can yield an assessment of upper extremity function similar to those provided by traditional PF measures, while substantially reducing patient assessment time.

The Assessment of Protective Behavioral Strategies: Comparing the Absolute Frequency and Contingent Frequency Response Scales

PubMed Central

Kite, Benjamin A.; Pearson, Matthew R.; Henson, James M.

2016-01-01

The purpose of the present studies was to examine the effects of response scale on the observed relationships between protective behavioral strategies (PBS) measures and alcohol-related outcomes. We reasoned that an ‘absolute frequency’ scale (stem: “how many times…”; response scale: 0 times to 11+ times) conflates the frequency of using PBS with the frequency of consuming alcohol; thus, we hypothesized that the use of an absolute frequency response scale would result in positive relationships between types of PBS and alcohol-related outcomes. Alternatively, a ‘contingent frequency’ scale (stem: “When drinking…how often…”; response scale: never to always) does not conflate frequency of alcohol use with use of PBS; therefore, we hypothesized that use of a contingent frequency scale would result in negative relationships between use of PBS and alcohol-related outcomes. Two published measures of PBS were used across studies: the Protective Behavioral Strategies Survey (PBSS) and the Strategy Questionnaire (SQ). Across three studies, we demonstrate that when measured using a contingent frequency response scale, PBS measures relate negatively to alcohol-related outcomes in a theoretically consistent manner; however, when PBS measures were measured on an absolute frequency response scale, they were non-significantly or positively related to alcohol-related outcomes. We discuss the implications of these findings for the assessment of PBS. PMID:23438243

Early Postoperative Measures Predict 1- and 2-Year Outcomes After Unilateral Total Knee Arthroplasty: Importance of Contralateral Limb Strength

PubMed Central

Snyder-Mackler, Lynn

2010-01-01

Background Total knee arthroplasty (TKA) has been shown to be an effective surgical intervention for people with end-stage knee osteoarthritis. However, recovery of function is variable, and not all people have successful outcomes. Objective The aim of this study was to discern which early postoperative functional measures could predict functional ability at 1 year and 2 years after surgery. Design and Methods One hundred fifty-five people who underwent unilateral TKA participated in the prospective longitudinal study. Functional evaluations were performed at the initial outpatient physical therapy appointment and at 1 and 2 years after surgery. Evaluations consisted of measurements of height, weight, quadriceps muscle strength (force-generating capacity), and knee range of motion; the Timed “Up & Go” Test (TUG); the stair-climbing task (SCT); and the Knee Outcome Survey (KOS) questionnaire. The ability to predict 1- and 2-year outcomes on the basis of early postoperative measures was analyzed with a hierarchical regression. Differences in functional scores were evaluated with a repeated-measures analysis of variance. Results The TUG, SCT, and KOS scores at 1 and 2 years showed significant improvements over the scores at the initial evaluation (P<.001). A weaker quadriceps muscle in the limb that did not undergo surgery (“nonoperated limb”) was related to poorer 1- and 2-year outcomes even after the influence of the other early postoperative measures was accounted for in the regression. Older participants with higher body masses also had poorer outcomes at 1 and 2 years. Postoperative measures were better predictors of TUG and SCT times than of KOS scores. Conclusions Rehabilitation regimens after TKA should include exercises to improve the strength of the nonoperated limb as well as to treat the deficits imposed by the surgery. Emphasis on treating age-related impairments and reducing body mass also might improve long-term outcomes. PMID:19959653

Getting something out of nothing in the measurement-device-independent quantum key distribution

NASA Astrophysics Data System (ADS)

Tan, Yong-Gang; Cai, Qing-Yu; Yang, Hai-Feng; Hu, Yao-Hua

2015-11-01

Because of the monogamy of entanglement, the measurement-device-independent quantum key distribution is immune to the side-information leaking of the measurement devices. When the correlated measurement outcomes are generated from the dark counts, no entanglement is actually obtained. However, secure key bits can still be proven to be generated from these measurement outcomes. Especially, we will give numerical studies on the contributions of dark counts to the key generation rate in practical decoy state MDI-QKD where a signal source, a weaker decoy source and a vacuum decoy source are used by either legitimate key distributer.

Workplace Outcomes in Work-Disability Prevention Research: A Review with Recommendations for Future Research.

PubMed

Young, Amanda E; Viikari-Juntura, Eira; Boot, Cécile R L; Chan, Chetwyn; de Porras, David Gimeno Ruiz; Linton, Steven J

2016-12-01

Introduction Outcome assessment is a central issue in work disability prevention research. The goal of this paper was to (1) ascertain the most salient workplace outcomes; (2) evaluate the congruence between business and science perspectives; (3) illustrate new perspectives on assessing longitudinal outcomes; and (4) provide recommendations for advancing outcome evaluation in this area of research. Methods The authors participated in a year-long collaboration that culminated in a sponsored 3-day conference, "Improving Research of Employer Practices to Prevent Disability", held October 14-16, 2015, in Hopkinton, MA, USA. The collaboration included a topical review of the literature, group conference calls to identify key areas and challenges, drafting of initial documents, review of industry publications, and a conference presentation that included feedback from peer researchers and a question/answer session with a special panel of knowledge experts with direct employer experience. Results Numerous workplace work-disability prevention outcome measures were identified. Analysis indicated that their applicability varied depending on the type of work disability the worker was experiencing. For those who were working, but with health-related work limitations (Type 1), predominant outcomes were measures of productivity, presenteeism, and work-related limitations. For those who were off work due to a health condition (Type 2), predominant outcomes were measures of time off work, supervisor/employee interactions, and return-to-work (RTW) preparation. For those who had returned to work (Type 3), predominant outcomes were measures of presenteeism, time until RTW, percentage of work resumption, employment characteristics, stigma, work engagement, co-worker interactions, and sustained or durable RTW. For those who had withdrawn from the labor force (Type 4), predominant outcomes were cost and vocational status. Discussion Currently available measures provide a good basis to use more consistent outcomes in disability prevention in the future. The research area would also benefit from more involvement of employers as stakeholders, and multilevel conceptualizations of disability outcomes.

A Cross-Sectional Review of Reporting Variation in Postoperative Bowel Dysfunction After Rectal Cancer Surgery.

PubMed

Chapman, Stephen J; Bolton, William S; Corrigan, Neil; Young, Neville; Jayne, David G

2017-02-01

Postoperative bowel dysfunction affects quality of life after sphincter-preserving rectal cancer surgery, but the extent of the problem is not clearly defined because of inconsistent outcome measures used to characterize the condition. The purpose of this study was to assess variation in the reporting of postoperative bowel dysfunction and to make recommendations for standardization in future studies. If possible, a quantitative synthesis of bowel dysfunction symptoms was planned. MEDLINE and EMBASE databases, as well as the Cochrane Library, were queried systematically between 2004 and 2015. The studies selected reported at least 1 component of bowel dysfunction after resection of rectal cancer. The main outcome measures were reporting, measurement, and definition of postoperative bowel dysfunction. Of 5428 studies identified, 234 met inclusion criteria. Widely reported components of bowel dysfunction were incontinence to stool (227/234 (97.0%)), frequency (168/234 (71.8%)), and incontinence to flatus (158/234 (67.5%)). Urgency and stool clustering were reported less commonly, with rates of 106 (45.3%) of 234 and 61 (26.1%) of 234. Bowel dysfunction measured as a primary outcome was associated with better reporting (OR = 3.49 (95% CI, 1.99-6.23); p < 0.001). Less than half of the outcomes were assessed using a dedicated research tool (337/720 (46.8%)), and the remaining descriptive measures were infrequently defined (56/383 (14.6%)). Heterogeneity in the reporting, measurement, and definition of postoperative bowel dysfunction precluded pooling of results and limited interpretation. Considerable variation exists in the reporting, measurement, and definition of postoperative bowel dysfunction. These inconsistencies preclude reliable estimates of incidence and meta-analysis. A broadly accepted outcome measure may address this deficit in future studies.

Including a range of outcome targets offers a broader view of fibromyalgia treatment outcome: results from a retrospective review of multidisciplinary treatment.

PubMed

Marcus, Dawn A; Bernstein, Cheryl D; Haq, Adeel; Breuer, Paula

2014-06-01

Fibromyalgia is associated with substantial functional disability. Current drug and non-drug treatments result in statistically significant but numerically small improvements in typical numeric measures of pain severity and fibromyalgia impact. The aim of the present study was to evaluate additional measures of pain severity and functional outcome that might be affected by fibromyalgia treatment. This retrospective review evaluated outcomes from 274 adults with fibromyalgia who participated in a six-week, multidisciplinary treatment programme. Pain and function were evaluated on the first and final treatment visit. Pain was evaluated using an 11-point numerical scale to determine clinically meaningful pain reduction (decrease ≥ 2 points) and from a pain drawing. Function was evaluated by measuring active range of motion (ROM), walking distance and speed, upper extremity exercise repetitions, and self-reports of daily activities. Numerical rating scores for pain decreased by 10-13% (p < 0.01) and Fibromyalgia Impact Questionnaire (FIQ) scores decreased by 20% (p < 0.001). More substantial improvements were noted when using alternative measures. Clinically meaningful pain relief was achieved by 37% of patients, and the body area affected by pain decreased by 31%. ROM showed significant improvements in straight leg raise and cervical motion, without improvements in lumbar ROM. Daily walking distance increased fourfold and arm exercise repetitions doubled. Despite modest albeit statistically significant improvements in standard measures of pain severity and the FIQ, more substantial pain improvement was noted when utilizing alternative measures of pain and functional improvement. Alternative symptom assessment measures might be important outcome measures to include in drug and non-drug studies to better understand fibromyalgia treatment effectiveness. © 2013 John Wiley & Sons, Ltd.

Interaction of participant characteristics and type of AAC with individuals with ASD: a meta-analysis.

PubMed

Ganz, Jennifer B; Mason, Rose A; Goodwyn, Fara D; Boles, Margot B; Heath, Amy K; Davis, John L

2014-11-01

Individuals with autism spectrum disorders (ASD) and complex communication needs often rely on augmentative and alternative communication (AAC) as a means of functional communication. This meta-analysis investigated how individual characteristics moderate effectiveness of three types of aided AAC: the Picture Exchange Communication System (PECS), speech-generating devices (SGDs), and other picture-based AAC. Effectiveness was measured via the Improvement Rate Difference. Results indicated that AAC has small to moderate effects on speech outcomes, and that SGDs appear to be most effective when considering any outcome measure with individuals with ASD without comorbid intellectual/developmental disorders (IDD). PECS appears to be most effective when considering any outcome measure with individuals with ASD and IDD. SGDs and PECS were the most effective type of AAC for preschoolers, when aggregating across outcome measures. No difference was found between systems for elementary-aged and older individuals.

The development of an outcome measure for liaison mental health services.

PubMed

Guthrie, Else; Harrison, Mathew; Brown, Richard; Sandhu, Rajdeep; Trigwell, Peter; Abraham, Seri; Nawaz, Shazada; Kelsall, Peter; Thomasson, Rachel

2018-06-01

Aims and methodTo develop and pilot a clinician-rated outcome scale to evaluate symptomatic outcomes in liaison psychiatry services. Three hundred and sixty patient contacts with 207 separate individuals were rated using six subscales (mood, psychosis, cognition, substance misuse, mind-body problems and behavioural disturbance) plus two additional items (side-effects of medication and capacity to consent for medical treatment). Each item was rated on a five-point scale from 0 to 5 (nil, mild, moderate, severe and very severe). The liaison outcome measure was acceptable and easy to use. All subscales showed acceptable interrater reliability, with the exception of the mind-body subscale. Overall, the measure appears to show stability and sensitivity to change.Clinical implicationsThe measure provides a useful and robust way to determine symptomatic change in a liaison mental health setting, although the mind-body subscale requires modification.Declaration of interestNone.

Measuring the Quality of VET Using the Student Outcomes Survey. Occasional Paper

ERIC Educational Resources Information Center

Lee, Wang-Sheng; Polidano, Cain

2010-01-01

The aim of this report is to examine the potential use of information from the Student Outcomes Survey, including the use of student course satisfaction information and post-study outcomes, as a means of determining markers of training quality. In an analysis of the student course satisfaction measures, the authors found there are very small…

Effects of Mobile Instant Messaging on Collaborative Learning Processes and Outcomes: The Case of South Korea

ERIC Educational Resources Information Center

Kim, Hyewon; Lee, MiYoung; Kim, Minjeong

2014-01-01

The purpose of this paper was to investigate the effects of mobile instant messaging on collaborative learning processes and outcomes. The collaborative processes were measured in terms of different types of interactions. We measured the outcomes of the collaborations through both the students' taskwork and their teamwork. The collaborative…

Multiple Measures of Outcome in Assessing a Prison-Based Drug Treatment Program

ERIC Educational Resources Information Center

Prendergast, Michael L.; Hall, Elizabeth A.; Wexler, Harry K.

2003-01-01

Evaluations of prison-based drug treatment programs typically focus on one or two dichotomous outcome variables related to recidivism. In contrast, this paper uses multiple measures of outcomes related to crime and drug use to examine the impact of prison treatment. Crime variables included self-report data of time to first illegal activity,…

Outcome Rating Scale and Session Rating Scale in Psychological Practice: Clinical Utility of Ultra-Brief Measures

ERIC Educational Resources Information Center

Campbell, Alistair; Hemsley, Samantha

2009-01-01

The validity and reliability of the Outcome Rating Scale (ORS) and the Session Rating Scale (SRS) were evaluated against existing longer measures, including the Outcome Questionnaire-45, Working Alliance Inventory, Depression Anxiety Stress Scale-21, Quality of Life Scale, Rosenberg Self-Esteem Scale and General Self-efficacy Scale. The measures…

An Evaluation of Auditory Verbal Therapy Using the Rate of Early Language Development as an Outcome Measure

ERIC Educational Resources Information Center

Hogan, Sarah; Stokes, Jacqueline; White, Catherine; Tyszkiewicz, Elizabeth; Woolgar, Alexandra

2008-01-01

Providing unbiased data concerning the outcomes of particular intervention methods is imperative if professionals and parents are to assimilate information which could contribute to an "informed choice". An evaluation of Auditory Verbal Therapy (AVT) was conducted using a formal assessment of spoken language as an outcome measure. Spoken…

Developing Common Measures in Evaluation Capacity Building: An Iterative Science and Practice Process

ERIC Educational Resources Information Center

Labin, Susan N.

2014-01-01

A fundamental reason for doing evaluation capacity building (ECB) is to improve program outcomes. Developing common measures of outcomes and the activities, processes, and factors that lead to these outcomes is an important step in moving the science and the practice of ECB forward. This article identifies a number of existing ECB measurement…

Quality Control/Assurance in Post Secondary Education: An Outcomes Approach. AIR 1988 Annual Forum Paper.

ERIC Educational Resources Information Center

Birch, Derek W.; Johnson, F. Craig

A study was conducted using quality control and quality assurance models to examine student outcomes. The purpose was to investigate current quality control and quality assurance practices in six colleges, to evaluate the relationship between quantitative effectiveness measures and qualitative outcomes measure and to assess the readiness of each…

Patient reported outcome measures (PROMs) for goalsetting and outcome measurement in primary care physiotherapy, an explorative field study.

PubMed

van Dulmen, Simone A; van der Wees, Philip J; Bart Staal, J; Braspenning, J C C; Nijhuis-van der Sanden, Maria W G

2017-03-01

Routine use of patient reported outcome measures (PROMs) may provide an effective way of monitoring patient valued outcomes. In this study we explored (1) the current use of PROMs; (2) to what extent the goals correspond with the selected PROMs; (3) the health outcomes based on PROMs. Observational clinical cohort study. Dutch primary care physiotherapy practices (n=43). Patients (n=299) with neck pain or low back pain. The number of PROMs used per patient were calculated. The International Classification of Functioning, Disability and Health was used to map the patients' goals and the percentages of PROMS selected that match the domains of the goals were calculated. Health outcomes were assessed using two approaches for estimating the minimal clinically important difference (MCID). Repeated measurements with the Visual Analogue Scale, the Patient Specific Complaints questionnaire, the Quebec Back Pain Disability Scale, or the Neck Disability Index were completed by more than 60% of the patients. The PROMs used matched in 46% of the cases with goals for pain improvement, and in 43% with goals set at activity/participation level. The mean differences between baseline and follow up scores for all PROMs were statistically significant. Improvements of patients based on MCID varied from 57% to 90%. PROMs were used in the majority of the patients, showed improved health outcomes and fitted moderately with goals. The results of this study can be used for future research assessing the routine use of outcome measurements with PROMs. Copyright © 2016 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Measure once, cut twice--adding patient-reported outcome measures to the electronic health record for comparative effectiveness research.

PubMed

Wu, Albert W; Kharrazi, Hadi; Boulware, L Ebony; Snyder, Claire F

2013-08-01

This article presents the current state of patient-reported outcome measures and explains new opportunities for leveraging the recent adoption of electronic health records to expand the application of patient-reported outcomes in both clinical care and comparative effectiveness research. Historic developments of patient-reported outcome, electronic health record, and comparative effectiveness research are analyzed in two dimensions: patient centeredness and digitization. We pose the question, "What needs to be standardized around the collection of patient-reported outcomes in electronic health records for comparative effectiveness research?" We identified three converging trends: the progression of patient-reported outcomes toward greater patient centeredness and electronic adaptation; the evolution of electronic health records into personalized and fully digitized solutions; and the shift toward patient-oriented comparative effectiveness research. Related to this convergence, we propose an architecture for patient-reported outcome standardization that could serve as a first step toward a more comprehensive integration of patient-reported outcomes with electronic health record for both practice and research. The science of patient-reported outcome measurement has matured sufficiently to be integrated routinely into electronic health records and other electronic health solutions to collect data on an ongoing basis for clinical care and comparative effectiveness research. Further efforts and ideally coordinated efforts from various stakeholders are needed to refine the details of the proposed framework for standardization. Copyright © 2013 Elsevier Inc. All rights reserved.

Use of a Pediatric Cardiovascular Nursing Consortium for Development and Evaluation of Quality Measures: The C4-MNP Experience.

PubMed

Connor, Jean A; Larson, Carol; Baird, Jennifer; Hickey, Patricia A

2016-01-01

The evidence linking nursing care and patient outcomes has been globally demonstrated. Thus, it is time for translation and application of this evidence to robust measurement that uniquely demonstrates the value of nursing care and the characteristics of the nursing workforce that contribute to optimal patient outcomes. The aim of this study was to identify and develop standardized measures representative of pediatric nursing care of the cardiovascular patient for benchmarking within freestanding children's hospitals. Using a consensus-based approach, the Consortium of Congenital Cardiac Care- Measurement of Nursing Practice (C4-MNP) members developed quality measures within working groups and then individually critiqued all drafted measures. Final draft measures were then independently reviewed and critiqued by an external nursing quality measurement committee. The final quality measures were also made available to a national parent support group for feedback. The development process used by C4-MNP resulted in 10 measures eligible for testing across freestanding children's hospitals. Employing a collaborative consensus-based method plus implementing the criteria of the National Quality Forum and external vetting period provided a strong framework for the development and evaluation of standardized measures. The Consortium will continue with implementation and testing of each measure in 9 of our 28 collaborating centers. This activity will support initial development of benchmarks and evaluation of the association of the measures with patient outcomes. Copyright © 2016 Elsevier Inc. All rights reserved.

A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery.

PubMed

Dodd, Susanna; Clarke, Mike; Becker, Lorne; Mavergames, Chris; Fish, Rebecca; Williamson, Paula R

2018-04-01

There is increasing recognition that insufficient attention has been paid to the choice of outcomes measured in clinical trials. The lack of a standardized outcome classification system results in inconsistencies due to ambiguity and variation in how outcomes are described across different studies. Being able to classify by outcome would increase efficiency in searching sources such as clinical trial registries, patient registries, the Cochrane Database of Systematic Reviews, and the Core Outcome Measures in Effectiveness Trials (COMET) database of core outcome sets (COS), thus aiding knowledge discovery. A literature review was carried out to determine existing outcome classification systems, none of which were sufficiently comprehensive or granular for classification of all potential outcomes from clinical trials. A new taxonomy for outcome classification was developed, and as proof of principle, outcomes extracted from all published COS in the COMET database, selected Cochrane reviews, and clinical trial registry entries were classified using this new system. Application of this new taxonomy to COS in the COMET database revealed that 274/299 (92%) COS include at least one physiological outcome, whereas only 177 (59%) include at least one measure of impact (global quality of life or some measure of functioning) and only 105 (35%) made reference to adverse events. This outcome taxonomy will be used to annotate outcomes included in COS within the COMET database and is currently being piloted for use in Cochrane Reviews within the Cochrane Linked Data Project. Wider implementation of this standard taxonomy in trial and systematic review databases and registries will further promote efficient searching, reporting, and classification of trial outcomes. Copyright © 2018 The Authors. Published by Elsevier Inc. All rights reserved.

Race, Income, and Disease Outcomes in Juvenile Dermatomyositis.

PubMed

Phillippi, Kathryn; Hoeltzel, Mark; Byun Robinson, Angela; Kim, Susan

2017-05-01

To determine the relationships among race, income, and disease outcomes in children with juvenile dermatomyositis (JDM). Data from 438 subjects with JDM enrolled in the Childhood Arthritis and Rheumatology Research Alliance (CARRA) Legacy Registry were analyzed. Demographic data included age, sex, race, annual family income, and insurance status. Clinical outcomes included muscle strength, presence of rash, calcinosis, weakness, physical function, and quality of life measures. Disease outcomes were compared based on race and income. Minority subjects were significantly more likely to have low annual family income and significantly worse scores on measures of physical function, disease activity, and quality of life measures. Subjects with lower annual family income had worse scores on measures of physical function, disease activity, and quality of life scores, as well as weakness. Black subjects were more likely to have calcinosis. Despite these differences in outcome measures, there were no significant differences among the racial groups in time to diagnosis or duration of disease. Using calcinosis as a marker of disease morbidity, black race, annual family income <$50 000 per year, negative antinuclear antibody, and delay in diagnosis >12 months were associated with calcinosis. Minority race and lower family income are associated with worse morbidity and outcomes in subjects with JDM. Calcinosis was more common in black subjects. Further studies are needed to examine these associations in more detail, to support efforts to address health disparities in subjects with JDM and improve disease outcomes. Copyright © 2017 Elsevier Inc. All rights reserved.

Predicting Well-being Longitudinally for Mothers Rearing Offspring with Intellectual and Developmental Disabilities

PubMed Central

Grein, Katherine A.; Glidden, Laraine Masters

2014-01-01

Background Well-being outcomes for parents of children with intellectual and developmental disabilities (IDD) may vary from positive to negative at different times and for different measures of well-being. Predicting and explaining this variability has been a major focus of family research for reasons that have both theoretical and applied implications. Methods The current study used data from a 23-year longitudinal investigation of adoptive and birth parents of children with IDD to determine which early child, mother, and family characteristics would predict the variance in maternal outcomes 20 years after their original measurement. Using hierarchical regression analyses, we tested the predictive power of variables measured when children were 7 years old on outcomes of maternal well-being when children were 26 years old. Outcome variables included maternal self-report measures of depression and well–being. Results Final models of well-being accounted for 20% to 34% of variance. For most outcomes, Family Accord and/or the personality variable of Neuroticism (emotional stability/instability) were significant predictors, but some variables demonstrated a different pattern. Conclusions These findings confirm that 1) Characteristics of the child, mother, and family during childhood can predict outcomes of maternal well-being 20 years later; and 2) Different predictor-outcome relationships can vary substantially, highlighting the importance of using multiple measures to gain a more comprehensive understanding of maternal well-being. These results have implications for refining prognoses for parents and for tailoring service delivery to individual child, parent, and family characteristics. PMID:25185956

Measurement properties of gait-related outcomes in youth with neuromuscular diagnoses: a systematic review.

PubMed

Ammann-Reiffer, Corinne; Bastiaenen, Caroline H G; de Bie, Rob A; van Hedel, Hubertus J A

2014-08-01

Sound measurement properties of outcome tools are essential when evaluating outcomes of an intervention, in clinical practice and in research. The purpose of this study was to review the evidence on reliability, measurement error, and responsiveness of measures of gait function in children with neuromuscular diagnoses. The MEDLINE, CINAHL, EMBASE, and PsycINFO databases were searched up to June 15, 2012. Studies evaluating reliability, measurement error, or responsiveness of measures of gait function in 1- to 18-year-old children and youth with neuromuscular diagnoses were included. Quality of the studies was independently rated by 2 raters using a modified COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. Studies with a fair quality rating or better were considered for best evidence synthesis. Regarding the methodological quality, 32 out of 35 reliability studies, all of the 13 measurement error studies, and 5 out of 10 responsiveness studies were of fair or good quality. Best evidence synthesis revealed moderate to strong evidence for reliability for several measures in children and youth with cerebral palsy (CP) but was limited or unknown in other diagnoses. The Functional Mobility Scale (FMS) and the Gross Motor Function Measure (GMFM) dimension E showed limited positive evidence for responsiveness in children with CP, but it was unknown or controversial in other diagnoses. No information was reported on the minimal important change; thus, evidence on measurement error remained undetermined. As studies on validity were not included in the review, a comprehensive appraisal of the best available gait-related outcome measure per diagnosis is not possible. There is moderate to strong evidence on reliability for several measures of gait function in children and youth with CP, whereas evidence on responsiveness exists only for the FMS and the GMFM dimension E. © 2014 American Physical Therapy Association.

INTRODUCTION TO PATIENT-REPORTED OUTCOME ITEM BANKS: ISSUES IN MINORITY AGING RESEARCH

PubMed Central

Templin, Thomas N; Hays, Ron D; Gershon, Richard C; Rothrock, Nan; Jones, Richard N; Teresi, Jeanne A; Stewart, Anita; Weech-Maldonado, Robert; Wallace, Steve

2014-01-01

In 2004 NIH awarded contracts to initiate the development of high quality psychological and neuropsychological outcome measures for improved assessment of health-related outcomes. The workshop introduced these measurement development initiatives, the measures created, and the NIH supported resource (Assessment Center) for internet or tablet-based test administration and scoring. Presentation covered: (a) item response theory (IRT) and assessment of test bias, (b) construction of item banks and computerized adaptive testing, and (c) the different ways in which qualitative analyses contribute to the definition of construct domains and the refinement of outcome constructs. The panel discussion included questions about representativeness of samples, and assessment of cultural bias. PMID:23570428

Prevalence and Consistency in Surgical Outcome Reporting for Femoroacetabular Impingement Syndrome: A Scoping Review.

PubMed

Reiman, Michael P; Peters, Scott; Sylvain, Jonathan; Hagymasi, Seth; Ayeni, Olufemi R

2018-04-01

The purposes of this review were (1) to collate and synthesize research studies reporting any outcome measure on both open and arthroscopic surgical treatment of femoroacetabular impingement (FAI) syndrome and (2) to report the prevalence and consistency of outcomes across the included studies. A computer-assisted literature search of the MEDLINE, CINAHL (Cumulative Index to Nursing and Allied Health Literature), and Embase databases was conducted using keywords related to FAI syndrome and both open and arthroscopic surgical outcomes, resulting in 2,614 studies, with 163 studies involving 14,824 subjects meeting the inclusion criteria. Two authors independently reviewed study inclusion and data extraction with independent verification. The prevalence of reported outcomes was calculated and verified by separate authors. Between 2004 and 2016, there has been a 2,600% increase in the publication of surgical outcome studies. Patients had a mean duration of symptoms of 27.7 ± 21.5 months before surgery. Arthroscopy was the surgical treatment used in 71% of studies. The mean final follow-up period after surgery was 32.2 ± 17.3 months. Follow-up time frames were reported in 78% of studies. Ten different patient-reported outcome measures were reported. The alpha angle was reported to be measured 42% less frequently as a surgical outcome than as a surgical indication. Surgical complications were addressed in only 53% of studies and failures in 69%. Labral pathology (91% of studies reporting) and chondral pathology (61%) were the primary coexisting pathologies reported. Clinical signs, as defined by the Warwick Agreement on FAI syndrome, were reported in fewer than 25% of studies. Most FAI syndrome patients have longstanding pain and potential coexisting pathology. Patient-reported outcome measures and diagnostic imaging are the most frequently reported outcomes. Measures of hip strength and range of motion are under-reported. It is unclear whether the inconsistency in reporting is because of lack of measurement or lack of reporting of specific outcomes in these studies. Current surgical outcomes are limited to mid-term surgical follow-up time frames and inconsistent outcome reporting. Level IV, systematic review of Level I through IV studies. Copyright © 2017 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.

Measuring outcomes in adult spinal deformity surgery: a systematic review to identify current strengths, weaknesses and gaps in patient-reported outcome measures.

PubMed

Faraj, Sayf S A; van Hooff, Miranda L; Holewijn, Roderick M; Polly, David W; Haanstra, Tsjitske M; de Kleuver, Marinus

2017-08-01

Adult spinal deformity (ASD) causes severe disability, reduces overall quality of life, and results in a substantial societal burden of disease. As healthcare is becoming more value based, and to facilitate global benchmarking, it is critical to identify and standardize patient-reported outcome measures (PROMs). This study aims to identify the current strengths, weaknesses, and gaps in PROMs used for ASD. Studies were included following a systematic search in multiple bibliographic databases between 2000 and 2015. PROMs were extracted and linked to the outcome domains of WHO's International Classification of Functioning and Health (ICF) framework. Subsequently, the clinimetric quality of identified PROMs was evaluated. The literature search identified 144 papers that met the inclusion criteria, and nine frequently used PROMs were identified. These covered 29 ICF outcome domains, which could be grouped into three of the four main ICF chapters: body function (n = 7), activity and participation (n = 19), environmental factors (n = 3), and body structure (n = 0). A low quantity (n = 3) of papers was identified that studied the clinimetric quality of PROMs. The Scoliosis Research Society (SRS)-22 has the highest level of clinimetric quality for ASD. Outcome domains related to mobility and pain were well represented. We identified a gap in current outcome measures regarding neurological and pulmonary function. In addition, no outcome domains were measured in the ICF chapter body structure. These results will serve as a foundation for the process of seeking international consensus on a standard set of outcome domains, accompanied PROMs and contributing factors to be used in future clinical trials and spine registries.

Observational attachment theory-based parenting measures predict children's attachment narratives independently from social learning theory-based measures.

PubMed

Matias, Carla; O'Connor, Thomas G; Futh, Annabel; Scott, Stephen

2014-01-01

Conceptually and methodologically distinct models exist for assessing quality of parent-child relationships, but few studies contrast competing models or assess their overlap in predicting developmental outcomes. Using observational methodology, the current study examined the distinctiveness of attachment theory-based and social learning theory-based measures of parenting in predicting two key measures of child adjustment: security of attachment narratives and social acceptance in peer nominations. A total of 113 5-6-year-old children from ethnically diverse families participated. Parent-child relationships were rated using standard paradigms. Measures derived from attachment theory included sensitive responding and mutuality; measures derived from social learning theory included positive attending, directives, and criticism. Child outcomes were independently-rated attachment narrative representations and peer nominations. Results indicated that Attachment theory-based and Social Learning theory-based measures were modestly correlated; nonetheless, parent-child mutuality predicted secure child attachment narratives independently of social learning theory-based measures; in contrast, criticism predicted peer-nominated fighting independently of attachment theory-based measures. In young children, there is some evidence that attachment theory-based measures may be particularly predictive of attachment narratives; however, no single model of measuring parent-child relationships is likely to best predict multiple developmental outcomes. Assessment in research and applied settings may benefit from integration of different theoretical and methodological paradigms.

Neighborhood community characteristics associated with HIV disease outcomes in a cohort of urban women living with HIV.

PubMed

Burke-Miller, Jane K; Weber, Kathleen; Cohn, Susan E; Hershow, Ronald C; Sha, Beverly E; French, Audrey L; Cohen, Mardge H

2016-10-01

Recent studies have found geographic variations in immune and viral human immunodeficiency virus (HIV) disease outcomes associated with census measures of neighborhood poverty and segregation. Although readily available, such aggregate census measures are not based on health behavior models and provide limited information regarding neighborhood effect pathways. In contrast, survey-based measures can capture specific aspects of neighborhood disadvantage that may better inform community-based interventions. Therefore, the aim of this study is to assess the measurement validity of multi-dimensional survey measures of neighborhood disorder compared with census measures as predictors of HIV outcomes in a cohort of 197 low-income women in a major metropolitan area. The multi-dimensional survey measures were related to each other and to census measures of concentrated poverty and racial segregation, but not so highly correlated as to be uniform. We found notable variation between community areas in women's CD4 levels but there was no corresponding geographic variance in viral load, and relationships between community area measures and viral load disappeared after adjustment for individual characteristics, including HIV treatment adherence. In multilevel models adjusting for individual characteristics including substance use, depression, and HIV treatment adherence, one survey measure of neighborhood disadvantage (poor-quality built environment) and one census measure (racial segregation) were significantly associated with greater likelihood of CD4 < 500 (p < .05).

Measuring conflict management, emotional self-efficacy, and problem solving confidence in an evaluation of outdoor programs for inner-city youth in Baltimore, Maryland.

PubMed

Caldas, Stephanie V; Broaddus, Elena T; Winch, Peter J

2016-08-01

Substantial evidence supports the value of outdoor education programs for promoting healthy adolescent development, yet measurement of program outcomes often lacks rigor. Accurately assessing the impacts of programs that seek to promote positive youth development is critical for determining whether youth are benefitting as intended, identifying best practices and areas for improvement, and informing decisions about which programs to invest in. We generated brief, customized instruments for measuring three outcomes among youth participants in Baltimore City Outward Bound programs: conflict management, emotional self-efficacy, and problem solving confidence. Measures were validated through exploratory and confirmatory factor analyses of pilot-testing data from two groups of program participants. We describe our process of identifying outcomes for measurement, developing and adapting measurement instruments, and validating these instruments. The finalized measures support evaluations of outdoor education programs serving urban adolescent youth. Such evaluations enhance accountability by determining if youth are benefiting from programs as intended, and strengthen the case for investment in programs with demonstrated success. Copyright © 2016 Elsevier Ltd. All rights reserved.

Noise and disturbance of qubit measurements: An information-theoretic characterization

NASA Astrophysics Data System (ADS)

Abbott, Alastair A.; Branciard, Cyril

2016-12-01

Information-theoretic definitions for the noise associated with a quantum measurement and the corresponding disturbance to the state of the system have recently been introduced [F. Buscemi et al., Phys. Rev. Lett. 112, 050401 (2014), 10.1103/PhysRevLett.112.050401]. These definitions are invariant under relabeling of measurement outcomes, and lend themselves readily to the formulation of state-independent uncertainty relations both for the joint estimate of observables (noise-noise relations) and the noise-disturbance tradeoff. Here we derive such relations for incompatible qubit observables, which we prove to be tight in the case of joint estimates, and present progress towards fully characterizing the noise-disturbance tradeoff. In doing so, we show that the set of obtainable noise-noise values for such observables is convex, whereas the conjectured form for the set of obtainable noise-disturbance values is not. Furthermore, projective measurements are not optimal with respect to the joint-measurement noise or noise-disturbance tradeoffs. Interestingly, it seems that four-outcome measurements are needed in the former case, whereas three-outcome measurements are optimal in the latter.

Governing Healthcare through Performance Measurement in Massachusetts and the Netherlands

PubMed Central

Van der Wees, Philip J.; der Sanden, Maria W.G. Nijhuis-van; van Ginneken, Ewout; Ayanian, John Z.; Schneider, Eric C.; Westert, Gert P.

2016-01-01

Massachusetts and the Netherlands have implemented comprehensive health reforms, which have heightened the importance of performance measurement. The performance measures addressing access to health care and patient experience are similar in the two jurisdictions, but measures of processes and outcomes of care differ considerably. In both jurisdictions, the use of health outcomes to compare the quality of health care organizations is limited, and specific information about costs is lacking. New legislation in both jurisdictions led to the establishment of institutes to monitor the quality of care, similar mandates to make the performance of health care providers transparent, and to establish a shared responsibility of providers, consumers and insurers to improve the quality of health care. In Massachusetts a statewide mandatory quality measure set was established to monitor the quality of care. The Netherlands is stimulating development of performance measures by providers based on a mandatory framework for developing such measures. Both jurisdictions are expanding the use of patient-reported outcomes to support patient care, quality improvement, and performance comparisons with the aim of explicitly linking performance to new payment incentives. PMID:24138729

Developing a Measure of Value in Health Care.

PubMed

Ken Lee, K H; Matthew Austin, J; Pronovost, Peter J

2016-06-01

There is broad support to pay for value, rather than volume, for health care in the United States. Despite the support, practical approaches for measuring value remain elusive. Value is commonly defined as quality divided by costs, where quality reflects patient outcomes and costs are the total costs for providing care, whether these be costs related to an episode, a diagnosis, or per capita. Academicians have proposed a conceptual approach to measure value, in which we measure outcomes important to patients and costs using time-driven activity-based costing. This approach is conceptually sound, but has significant practical challenges. In our commentary, we describe how health care can use existing quality measures and cost accounting data to measure value. Although not perfect, we believe this approach is practical, valid, and scalable and can establish the foundation for future work in this area. Copyright © 2016 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Worse self-reported outcomes but no limitations in performance-based measures in patients with long-standing hip and groin pain compared with healthy controls.

PubMed

Wörner, Tobias; Sigurðsson, Haraldur B; Pålsson, Anders; Kostogiannis, Ioannis; Ageberg, Eva

2017-01-01

This study aimed to evaluate patient-reported outcomes as well as lower extremity and trunk muscle function in patients with long-standing hip and groin pain, in comparison with matched, healthy controls. It was hypothesized that patients with long-standing hip and groin pain would report more deficiency on the Copenhagen Hip and Groin Outcome Score (HAGOS) and have worse outcomes on performance-based measures than healthy controls. Nineteen patients with long-standing hip and groin pain and 19 healthy, activity level-, age-, gender-, and weight-matched controls were assessed with the HAGOS for self-reported outcomes, and a parallel squat (w/kg), single-leg triple jump (cm), single-leg rise (n), barbell roll-out (% of height), and plank test (s) for performance-based measures. Independent sample t test was performed to assess between-group differences. The paired t test was used to analyse between-limb differences in unilateral performance tasks. The patients had worse scores than the controls in all HAGOS subscales (p ≤ 0.001), while no statistically significant differences were observed for any performance measure between groups or between symptomatic and non-symptomatic limbs. Despite significant self-reported functional limitations on the HAGOS, there were no significant differences between groups in performance-based strength or power measures. The results of this study highlight the need to identify performance-based measures, sensitive to functional deficiencies in patients with long-standing hip and groin pain in order to complement the clinical picture obtained by patient-reported outcomes such as the HAGOS. III.

Post-thrombotic syndrome in children: a systematic review of frequency of occurrence, validity of outcome measures, and prognostic factors

PubMed Central

Goldenberg, Neil A.; Donadini, Marco P.; Kahn, Susan R.; Crowther, Mark; Kenet, Gili; Nowak-Göttl, Ulrike; Manco-Johnson, Marilyn J.

2010-01-01

Background Post-thrombotic syndrome is a manifestation of chronic venous insufficiency following deep venous thrombosis. This systematic review was conducted to critically evaluate pediatric evidence on frequency of occurrence, validity of outcome measures, and prognostic indicators of post-thrombotic syndrome. Design and Methods A comprehensive literature search of original reports revealed 19 eligible studies, totaling 977 patients with upper/lower extremity deep venous thrombosis. Calculated weighted mean frequency of post-thrombotic syndrome was 26% (95% confidence interval: 23–28%) overall, and differed significantly by prospective/non-prospective analysis and use/non-use of a standardized outcome measure. Results Standardized post-thrombotic syndrome outcome measures included an adaptation of the Villalta scale, the Clinical-Etiologic-Anatomic-Pathologic classification, and the Manco-Johnson instrument. Data on validity were reported only for the Manco-Johnson instrument. No publications on post-thrombotic syndrome-related quality of life outcomes were identified. Candidate prognostic factors for post-thrombotic syndrome in prospective studies included use/non-use of thrombolysis and plasma levels of factor VIII activity and D-dimer. Conclusions Given that affected children must endure chronic sequelae for many decades, it is imperative that future collaborative pediatric prospective cohort studies and trials assess as key objectives and outcomes the incidence, severity, prognostic indicators, and health impact of post-thrombotic syndrome, using validated measures. PMID:20595095

Routine outcome measurement in mental health service consumers: who should provide support for the self-assessments?

PubMed

Gelkopf, Marc; Pagorek-Eshel, Shira; Trauer, Tom; Roe, David

2015-06-01

This study examined whether mental health community service users completed outcome self-reports differently when assessments were supervised by internal vs. external staff. The examination of potential differences between the two has useful implications for mental health systems that take upon themselves the challenge of Routine Outcome Measurement (ROM), as it might impact allocation of public resources and managed care program planning. 73 consumers completed the Manchester Short Assessment of Quality of Life (MANSA), a shortened version of the Recovery Assessment Scale (RAS), and a functioning questionnaire. Questionnaires were administered, once using support provided by internal staff and once using support provided by external professional staff, with a one-month time interval and in random order. A MANOVA Repeated Measures showed no differences in outcomes of quality of life and recovery between internal and external support. Functioning scores were higher for the internal support when the internal assessments were performed first. Overall, except for the differences in functioning assessment, outcome scores were not determined by the supporting agency. This might indicate that when measuring quality of life and recovery, different supporting methods can be used to gather outcome measures and internal staff might be a good default agency to do this. Differences found in functioning assessment are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

Computerised cognitive training in acquired brain injury: A systematic review of outcomes using the International Classification of Functioning (ICF).

PubMed

Sigmundsdottir, Linda; Longley, Wendy A; Tate, Robyn L

2016-10-01

Computerised cognitive training (CCT) is an increasingly popular intervention for people experiencing cognitive symptoms. This systematic review evaluated the evidence for CCT in adults with acquired brain injury (ABI), focusing on how outcome measures used reflect efficacy across components of the International Classification of Functioning, Disability and Health. Database searches were conducted of studies investigating CCT to treat cognitive symptoms in adult ABI. Scientific quality was rated using the PEDro-P and RoBiNT Scales. Ninety-six studies met the criteria. Most studies examined outcomes using measures of mental functions (93/96, 97%); fewer studies included measures of activities/participation (41/96, 43%) or body structures (8/96, 8%). Only 14 studies (15%) provided Level 1 evidence (randomised controlled trials with a PEDro-P score ≥ 6/10), with these studies suggesting strong evidence for CCT improving processing speed in multiple sclerosis (MS) and moderate evidence for improving memory in MS and brain tumour populations. There is a large body of research examining the efficacy of CCT, but relatively few Level 1 studies and evidence is largely limited to body function outcomes. The routine use of outcome measures of activities/participation would provide more meaningful evidence for the efficacy of CCT. The use of body structure outcome measures (e.g., neuroimaging) is a newly emerging area, with potential to increase understanding of mechanisms of action for CCT.

An Investigation of the Relationship Between the Alliance Negotiation Scale and Psychotherapy Process and Outcome.

PubMed

Doran, Jennifer M; Safran, Jeremy D; Muran, J Christopher

2017-04-01

This study examines the validity of the Alliance Negotiation Scale (ANS) in a psychotherapy research program. Analyses were designed to evaluate the relationship between the ANS and psychotherapy process and outcome variables. Data were collected in a metropolitan psychotherapy research program. Participants completed 30 sessions of therapy, postsession assessments, and a battery of measures at intake and termination. Relationships were found between the ANS and session outcome, working alliance, and the presence of ruptures and their resolution. Relationships emerged between the ANS and treatment outcome on measures of psychiatric distress and interpersonal problems. The ANS demonstrated relationships with several psychotherapy process and outcome variables. The ANS was the most differentiated from the working alliance on measures of interpersonal functioning and in discriminating personality disorder pathology. These results extend previous findings on the ANS' psychometric integrity, and offer new data on the relationship between negotiation and treatment outcome. © 2016 Wiley Periodicals, Inc.

Patient value: its nature, measurement, and role in real world evidence studies and outcomes-based reimbursement.

PubMed

McKenna, Stephen P; Wilburn, Jeanette

2018-05-01

The assessment of "patient value" is fundamental to clinical trials, real world evidence studies, and outcomes-based reimbursement schemes. Measures of health-related quality-of-life (HRQoL) are widely used in health research. Such measures are effective in determining the presence or absence of symptoms and functional ability. However, HRQoL measures were not intended, nor designed, to determine the value to patients of alternative health states. Functions have no intrinsic value-they are a means to fulfil human needs. However, needs can be met in a variety of ways, for example by adopting different functions or by the provision of social services. It is possible to analyze all functions in terms of the needs they satisfy. A needs model has been applied in health research since the 1990s. It is concerned with the extent to which human needs are fulfilled in the presence of disease and its treatment. It is argued that this is the major concern of the patient. Needs-based measures are patient-centric and produce a valid unidimensional index of outcome. Consequently, they provide a direct means of measuring patient value. This approach provides the possibility of evaluating health services in terms of the value they provide to consumers and payers. It also has a role to play in real-world evidence studies and outcomes-based reimbursement. It is recommended that greater attention is given in future to the development of patient-reported outcome measures that provide direct assessments of patient value.

"It's the skin you're in": African-American women talk about their experiences of racism. an exploratory study to develop measures of racism for birth outcome studies.

PubMed

Nuru-Jeter, Amani; Dominguez, Tyan Parker; Hammond, Wizdom Powell; Leu, Janxin; Skaff, Marilyn; Egerter, Susan; Jones, Camara P; Braveman, Paula

2009-01-01

Stress due to experiences of racism could contribute to African-American women's adverse birth outcomes, but systematic efforts to measure relevant experiences among childbearing women have been limited. We explored the racism experiences of childbearing African-American women to inform subsequent development of improved measures for birth outcomes research. Six focus groups were conducted with a total of 40 socioeconomically diverse African-American women of childbearing age in four northern California cities. Women reported experiencing racism (1) throughout the lifecourse, with childhood experiences seeming particularly salient and to have especially enduring effects (2) directly and vicariously, particularly in relation to their children; (3) in interpersonal, institutional, and internalized forms; (4) across different life domains; (5) with active and passive responses; and (6) with pervasive vigilance, anticipating threats to themselves and their children. This exploratory study's findings support the need for measures reflecting the complexity of childbearing African-American women's racism experiences. In addition to discrete, interpersonal experiences across multiple domains and active/passive responses, which have been measured, birth outcomes research should also measure women's childhood experiences and their potentially enduring impact, perceptions of institutionalized racism and internalized negative stereotypes, vicarious experiences related to their children, vigilance in anticipating future racism events, as well as the pervasiveness and chronicity of racism exposure, all of which could be sources of ongoing stress with potentially serious implications for birth outcomes. Measures of racism addressing these issues should be developed and formally tested.

Are the Insomnia Severity Index and Pittsburgh Sleep Quality Index valid outcome measures for Cognitive Behavioral Therapy for Insomnia? Inquiry from the perspective of response shifts and longitudinal measurement invariance in their Chinese versions.

PubMed

Chen, Po-Yi; Jan, Ya-Wen; Yang, Chien-Ming

2017-07-01

The purpose of this study was to examine whether the Insomnia Severity Index (ISI) and Pittsburgh Sleep Quality Index (PSQI) are valid outcome measures for Cognitive Behavioral Therapy for Insomnia (CBT-I). Specifically, we tested whether the factorial parameters of the ISI and the PSQI could remain invariant against CBT-I, which is a prerequisite to using their change scores as an unbiased measure of the treatment outcome of CBT-I. A clinical data set including scores on the Chinese versions of the ISI and the PSQI obtained from 114 insomnia patients prior to and after a 6-week CBT-I program in Taiwan was analyzed. A series of measurement invariance (MI) tests were conducted to compare the factorial parameters of the ISI and the PSQI before and after the CBT-I treatment program. Most factorial parameters of the ISI remained invariant after CBT-I. However, the factorial model of the PSQI changed after CBT-I treatment. An extra loading with three residual correlations was added into the factorial model after treatment. The partial strong invariance of the ISI supports that it is a valid outcome measure for CBT-I. In contrast, various changes in the factor model of the PSQI indicate that it may not be an appropriate outcome measure for CBT-I. Some possible causes for the changes of the constructs of the PSQI following CBT-I are discussed. Copyright © 2017 Elsevier B.V. All rights reserved.

Systematic literature review of patient-reported outcome measures used in assessment and measurement of sleep disorders in chronic obstructive pulmonary disease.

PubMed

Garrow, Adam P; Yorke, Janelle; Khan, Naimat; Vestbo, Jørgen; Singh, Dave; Tyson, Sarah

2015-01-01

Sleep problems are common in patients with chronic obstructive pulmonary disease (COPD), but the validity of patient-reported outcome measures (PROMs) that measure sleep dysfunction has not been evaluated. We have reviewed the literature to identify disease-specific and non-disease-specific sleep PROMs that have been validated for use in COPD patients. The review also examined the psychometric properties of identified sleep outcome measures and extracted point and variability estimates of sleep instruments used in COPD studies. The online EMBASE, MEDLINE, PsycINFO, and SCOPUS databases for all years to May 2014 were used to source articles for the review. The review was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Criteria from the Medical Outcomes Trust Scientific Advisory Committee guidelines were used to evaluate the psychometric properties of all sleep PROMs identified. One COPD-specific and six non-COPD-specific sleep outcome measures were identified and 44 papers met the review selection criteria. We only identified one instrument, the COPD and Asthma Sleep Impact Scale, which was developed specifically for use in COPD populations. Ninety percent of the identified studies used one of two non-disease-specific sleep scales, ie, the Pittsburgh Sleep Quality Index and/or the Epworth Sleep Scale, although neither has been tested for reliability or validity in people with COPD. The results highlight a need for existing non-disease-specific instruments to be validated in COPD populations and also a need for new disease-specific measures to assess the impact of sleep problems in COPD.

“It's The Skin You're In”: African-American Women Talk About Their Experiences of Racism. An Exploratory Study to Develop Measures of Racism for Birth Outcome Studies

PubMed Central

Nuru-Jeter, Amani; Dominguez, Tyan Parker; Hammond, Wizdom Powell; Leu, Janxin; Skaff, Marilyn; Egerter, Susan; Jones, Camara P.; Braveman, Paula

2011-01-01

Objectives Stress due to experiences of racism could contribute to African-American women's adverse birth outcomes, but systematic efforts to measure relevant experiences among childbearing women have been limited. We explored the racism experiences of childbearing African-American women to inform subsequent development of improved measures for birth outcomes research. Methods Six focus groups were conducted with a total of 40 socioeconomically diverse African-American women of childbearing age in four northern California cities. Results Women reported experiencing racism (1) throughout the lifecourse, with childhood experiences seeming particularly salient and to have especially enduring effects (2) directly and vicariously, particularly in relation to their children; (3) in interpersonal, institutional, and internalized forms; (4) across different life domains; (5) with active and passive responses; and (6) with pervasive vigilance, anticipating threats to themselves and their children. Conclusions This exploratory study's findings support the need for measures reflecting the complexity of childbearing African-American women's racism experiences. In addition to discrete, interpersonal experiences across multiple domains and active/passive responses, which have been measured, birth outcomes research should also measure women's childhood experiences and their potentially enduring impact, perceptions of institutionalized racism and internalized negative stereotypes, vicarious experiences related to their children, vigilance in anticipating future racism events, as well as the pervasiveness and chronicity of racism exposure, all of which could be sources of ongoing stress with potentially serious implications for birth outcomes. Measures of racism addressing these issues should be developed and formally tested. PMID:18463971

Heart Rate Variability as a Feeding Intervention Outcome Measure in the Preterm Infant.

PubMed

Pados, Britt F; Thoyre, Suzanne M; Knafl, George J; Nix, William Brant

2017-10-01

Feeding interventions for preterm infants aim to reduce the physiologic stress of feeding to promote growth. Heart rate variability (HRV) is a potential noninvasive measure of physiologic stress that may be useful for evaluating efficacy of feeding interventions. To evaluate whether HRV is a sensitive measure of physiologic stress compared with standard physiologic outcomes in the context of a feeding intervention study. This was a secondary analysis of a within-subjects, cross-over design study comparing usual care feeding with a gentle, coregulated (CoReg) feeding approach in 14 infants born less than 35 weeks' postmenstrual age. HRV indices were calculated from electrocardiogram data and compared with standard physiologic outcomes, including oxygen saturation (Spo2), respiratory rate (RR), apnea, heart rate (HR), and bradycardia. Data were analyzed using linear mixed modeling. Infants fed using the CoReg approach had fewer apneic events and higher RR, suggesting they were able to breathe more during feeding. No statistically significant differences were found in SpO2, HR, bradycardia, or high frequency power (the most commonly reported measure of HRV). Infants fed using the usual care approach had significantly higher SD12, a measure of HRV indicating randomness in the HR, which is a potential indicator of elevated stress. SD12 was more sensitive to stress than SpO2, HR, and bradycardia. The utility of HRV as a measure of feeding outcomes in clinical practice needs further exploration. Further exploration of HRV as an intervention outcome measure is needed, particularly evaluating nonlinear indices, such as SD12.

The impact of occupational therapy in Parkinson's disease: a randomized controlled feasibility study.

PubMed

Sturkenboom, Ingrid H; Graff, Maud J; Borm, George F; Veenhuizen, Yvonne; Bloem, Bastiaan R; Munneke, Marten; Nijhuis-van der Sanden, Maria W

2013-02-01

To evaluate the feasibility of a randomized controlled trial including process and potential impact of occupational therapy in Parkinson's disease. Process and outcome were quantitatively and qualitatively evaluated in an exploratory multicentre, two-armed randomized controlled trial at three months. Forty-three community-dwelling patients with Parkinson's disease and difficulties in daily activities, their primary caregivers and seven occupational therapists. Ten weeks of home-based occupational therapy according to the Dutch guidelines of occupational therapy in Parkinson's disease versus no occupational therapy in the control group. Process evaluation measured accrual, drop-out, intervention delivery and protocol adherence. Primary outcome measures of patients assessed daily functioning: Canadian Occupational Performance Measure (COPM) and Assessment of Motor and Process Skills. Primary outcome for caregivers was caregiver burden: Zarit Burden Inventory. Participants' perspectives of the intervention were explored using questionnaires and in-depth interviews. Inclusion was 23% (43/189), drop-out 7% (3/43) and unblinding of assessors 33% (13/40). Full intervention protocol adherence was 74% (20/27), but only 60% (71/119) of baseline Canadian Occupational Performance Measure priorities were addressed in the intervention. The outcome measures revealed negligible to small effects in favour of the intervention group. Almost all patients and caregivers of the intervention group were satisfied with the results. They perceived: 'more grip on the situation' and used 'practical advices that make life easier'. Therapists were satisfied, but wished for a longer intervention period. The positive perceived impact of occupational therapy warrants a large-scale trial. Adaptations in instructions and training are needed to use the Canadian Occupational Performance Measure as primary outcome measure.

Lack of knowledge and training are the major obstacles in application of the Spinal Cord Independence Measure (SCIM) in China.

PubMed

Liu, Nan; Xing, Huayi; Zhou, Mouwang; Biering-Sørensen, Fin

2018-03-29

Objective To investigate the use of functional outcome measurements after spinal cord injury (SCI) in current clinical practice and to explore the knowledge about the Spinal Cord Independence Measure (SCIM) among SCI physicians in China, and to find facilitators for a broader utilization of SCIM. Design A survey-based study. Setting SCI workshops at Peking University. Participants 125 Chinese SCI physicians attending annual workshops in two consecutive years. Interventions Not applicable. Outcome measures A questionnaire was administered. The following items were included: whether functional outcome measurement for SCI individuals was performed and with which assessment tool(s); what items should be included in the assessment; whether they knew about the SCIM, its latest version, the Chinese translation, and if so from what source; the possible reasons why SCIM was not implemented in clinical practice; and whether training before using the SCIM was needed, and the training method preferred. Results Among these physicians, 84.8% performed functional outcome measurement for individuals with SCI, but only 29.6% of attendees were aware of the SCIM and 20.8% had used it. Lack of training was the major reason why SCIM was not used in clinical practice. Furthermore, 74.4% of the physicians felt they needed formal training before using the SCIM. Conclusion The use of SCIM is limited in clinical practice in China, which is mainly attributed to lack of knowledge and training. Formal training on the use of the SCIM is essential for its dissemination and will improve functional SCI outcome measurement in China.

Assessment of physical function and participation in chronic pain clinical trials: IMMPACT/OMERACT recommendations.

PubMed

Taylor, Ann M; Phillips, Kristine; Patel, Kushang V; Turk, Dennis C; Dworkin, Robert H; Beaton, Dorcas; Clauw, Daniel J; Gignac, Monique A M; Markman, John D; Williams, David A; Bujanover, Shay; Burke, Laurie B; Carr, Daniel B; Choy, Ernest H; Conaghan, Philip G; Cowan, Penney; Farrar, John T; Freeman, Roy; Gewandter, Jennifer; Gilron, Ian; Goli, Veeraindar; Gover, Tony D; Haddox, J David; Kerns, Robert D; Kopecky, Ernest A; Lee, David A; Malamut, Richard; Mease, Philip; Rappaport, Bob A; Simon, Lee S; Singh, Jasvinder A; Smith, Shannon M; Strand, Vibeke; Tugwell, Peter; Vanhove, Gertrude F; Veasley, Christin; Walco, Gary A; Wasan, Ajay D; Witter, James

2016-09-01

Although pain reduction is commonly the primary outcome in chronic pain clinical trials, physical functioning is also important. A challenge in designing chronic pain trials to determine efficacy and effectiveness of therapies is obtaining appropriate information about the impact of an intervention on physical function. The Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) and Outcome Measures in Rheumatology (OMERACT) convened a meeting to consider assessment of physical functioning and participation in research on chronic pain. The primary purpose of this article is to synthesize evidence on the scope of physical functioning to inform work on refining physical function outcome measurement. We address issues in assessing this broad construct and provide examples of frequently used measures of relevant concepts. Investigators can assess physical functioning using patient-reported outcome (PRO), performance-based, and objective measures of activity. This article aims to provide support for the use of these measures, covering broad aspects of functioning, including work participation, social participation, and caregiver burden, which researchers should consider when designing chronic pain clinical trials. Investigators should consider the inclusion of both PROs and performance-based measures as they provide different but also important complementary information. The development and use of reliable and valid PROs and performance-based measures of physical functioning may expedite development of treatments, and standardization of these measures has the potential to facilitate comparison across studies. We provide recommendations regarding important domains to stimulate research to develop tools that are more robust, address consistency and standardization, and engage patients early in tool development.

Do postoperative radiographically verified technical success, improved cosmesis, and trunk shift corroborate with patient-reported outcomes in Lenke 1C adolescent idiopathic scoliosis?

PubMed

Sharma, Shallu; Bünger, Cody Eric; Andersen, Thomas; Sun, Haolin; Wu, Chunsen; Hansen, Ebbe Stender

2015-07-01

To examine correlation between postoperative radiographic and cosmetic improvements in Lenke 1C adolescent idiopathic scoliosis (AIS) with patients' self-rated outcomes of health and disability at follow-up as determined by the Scoliosis Research Society questionnaire (SRS-30), Oswestry Disability Index score (ODI) and measure of overall health quality Euroqol-5d (EQ-5D). 24 Lenke 1C scoliosis patients, mean age 16.5 (12.8-38.1) years, treated with posterior pedicle screw-only construct, were included. The coronal profile indices (radiographic and cosmetic) regarding magnitude of spinal deformity and truncal balance were measured preoperatively, postoperatively and at final follow-up. A comprehensive index of overall back symmetry was also measured by means of the Posterior Trunk Symmetry Index (POTSI). Pearson's correlation analysis determined the association between the radiographic-cosmetic indices and patient-rated outcomes. Mean follow-up for the cohort was 4.4 (±1.86) years. The thoracic apical vertebra-first thoracic vertebra horizontal distance (AV-TI) correction had significant correlation with function, self-image, and mental health SRS-30 scores (0.55, 0.54, 0.66). Similarly, thoracic apical vertebra horizontal translation from central sacral vertical line (AV-CSVL) correction at follow-up had significant correlation with self-image and management domains (0.57, 0.50). Follow-up POTSI correlated well with SRS-30 and EQ-5D scores (r = -0.64, -0.54). Postoperative leftward trunk shift/spinal imbalance did not influence overall cosmesis and outcomes; significant spinal realignment was evident in follow-up resulting in physiological balance and acceptable cosmesis and outcomes. Significant, but less than "perfect" correlations were observed between the radiographic, cosmetic measures and patient-rated outcomes. Thoracic AV-CSVL, AV-T1 correction and POTSI associated significantly with SRS-30 scores. Whereas, thoracic Cobb angle, Cobb correction, and coronal balance did not correlate with any patient-rated outcome measure. It is, therefore, inferred that the patients-rated subjective outcomes are only poorly reflected by the objectively measured radiographic and cosmetic measures of deformity correction.

Clinician-Reported Outcome Assessments of Treatment Benefit: Report of the ISPOR Clinical Outcome Assessment Emerging Good Practices Task Force.

PubMed

Powers, John H; Patrick, Donald L; Walton, Marc K; Marquis, Patrick; Cano, Stefan; Hobart, Jeremy; Isaac, Maria; Vamvakas, Spiros; Slagle, Ashley; Molsen, Elizabeth; Burke, Laurie B

2017-01-01

A clinician-reported outcome (ClinRO) assessment is a type of clinical outcome assessment (COA). ClinRO assessments, like all COAs (patient-reported, observer-reported, or performance outcome assessments), are used to 1) measure patients' health status and 2) define end points that can be interpreted as treatment benefits of medical interventions on how patients feel, function, or survive in clinical trials. Like other COAs, ClinRO assessments can be influenced by human choices, judgment, or motivation. A ClinRO assessment is conducted and reported by a trained health care professional and requires specialized professional training to evaluate the patient's health status. This is the second of two reports by the ISPOR Clinical Outcomes Assessment-Emerging Good Practices for Outcomes Research Task Force. The first report provided an overview of COAs including definitions important for an understanding of COA measurement practices. This report focuses specifically on issues related to ClinRO assessments. In this report, we define three types of ClinRO assessments (readings, ratings, and clinician global assessments) and describe emerging good measurement practices in their development and evaluation. The good measurement practices include 1) defining the context of use; 2) identifying the concept of interest measured; 3) defining the intended treatment benefit on how patients feel, function, or survive reflected by the ClinRO assessment and evaluating the relationship between that intended treatment benefit and the concept of interest; 4) documenting content validity; 5) evaluating other measurement properties once content validity is established (including intra- and inter-rater reliability); 6) defining study objectives and end point(s) objectives, and defining study end points and placing study end points within the hierarchy of end points; 7) establishing interpretability in trial results; and 8) evaluating operational considerations for the implementation of ClinRO assessments used as end points in clinical trials. Applying good measurement practices to ClinRO assessment development and evaluation will lead to more efficient and accurate measurement of treatment effects. This is important beyond regulatory approval in that it provides evidence for the uptake of new interventions into clinical practice and provides justification to payers for reimbursement on the basis of the clearly demonstrated added value of the new intervention. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

Modeling Deficits from Early Auditory Information Processing to Psychosocial Functioning in Schizophrenia

PubMed Central

Thomas, Michael L.; Green, Michael F.; Hellemann, Gerhard; Sugar, Catherine A.; Tarasenko, Melissa; Calkins, Monica E.; Greenwood, Tiffany A.; Gur, Raquel E.; Gur, Ruben C.; Lazzeroni, Laura C.; Nuechterlein, Keith H.; Radant, Allen D.; Seidman, Larry J.; Shiluk, Alexandra L.; Siever, Larry J.; Silverman, Jeremy M.; Sprock, Joyce; Stone, William S.; Swerdlow, Neal R.; Tsuang, Debby W.; Tsuang, Ming T.; Turetsky, Bruce I.; Braff, David L.; Light, Gregory A.

2017-01-01

Importance Neurophysiological measures of early auditory information processing (EAP) are used as endophenotypes in genomic studies and biomarkers in clinical intervention studies. Research in schizophrenia has established correlations among measures of EAP, cognition, clinical symptoms, and functional outcome. Clarifying these relationships by determining the pathways through which deficits in EAP affect functioning would suggest when and where to therapeutically intervene. Objective We sought to characterize the pathways from EAP to outcome and to estimate the extent to which enhancement of basic information processing might improve both cognition and psychosocial functioning in schizophrenia. Design Cross-sectional data were analyzed using structural equation modeling to examine the associations between EAP, cognition, negative symptoms, and functional outcome. Setting Participants were recruited from the community at five geographically distributed laboratories as part of the Consortium on the Genetics of Schizophrenia-2 (COGS-2). Participants This well-characterized cohort of schizophrenia patients (N = 1,415) underwent EAP and cognitive testing as well as thorough clinical and functional assessment. Main Outcome and Measures EAP was measured by mismatch negativity, P3a, and reorienting negativity. Cognition was measured by the Letter Number Span test and scales from the California Verbal Learning Test - Second Edition, the Wechsler Memory Scale Third Edition, and the Penn Computerized Neurocognitive Battery. Negative symptoms were measured by the Scale for the Assessment of Negative Symptoms. Functional outcome was measured by the Role Functioning Scale. Results EAP had a direct effect on cognition (β = 0.37, p < .001), cognition had a direct effect on negative symptoms (β = −0.16, p < .001), and both cognition (β = 0.26, p < .001) and experiential negative symptoms (β = −0.75, p < .001) had direct effects on functional outcome. Overall, EAP had a fully mediated effect on functional outcome, engaging general rather than modality-specific cognition, with separate pathways that either involved or bypassed negative symptoms. Conclusions and Relevance The data support a model where EAP deficits lead to poor functional outcome via impaired cognition and increased negative symptoms. Results can be used to help guide mechanistically informed, personalized treatments, and support the strategy of using EAP measures as surrogate endpoints in early stage pro-cognitive intervention studies. PMID:27926742

Comparison of rheumatoid arthritis clinical trial outcome measures: a simulation study.

PubMed

Anderson, Jennifer J; Bolognese, James A; Felson, David T

2003-11-01

Isolated studies have suggested that continuous measures of response may be better than predefined, dichotomous definitions (e.g., the American College of Rheumatology 20% improvement criteria [ACR20]) for discriminating between rheumatoid arthritis (RA) treatments. Our goal was to determine the statistical power of predefined dichotomous outcome measures (termed "a priori"), compared with that of continuous measures derived from trial data in which there was no predefined response threshold (termed "data driven"), and to evaluate the sensitivity to change of these measures in the context of different treatments and early versus later-stage disease. In order to generalize beyond results from a single trial, we performed simulation studies. We obtained summary data from trials comparing disease-modifying antirheumatic drugs (DMARDs) and from comparative coxib-placebo trials to test the power of 2 a priori outcomes, the ACR20 and improvement of the Disease Activity Score (DDAS), as well as 2 data-driven outcomes. We studied patients with early RA and those with later-stage RA (duration of <4 years and 4-9 years, respectively). We performed simulation studies, using the interrelationship of ACR core set measures in the trials to generate multiple trial data sets consistent with the original data. The data-driven outcomes had greater power than did the a priori measures. The DMARD comparison was more powerful in early disease than in later-stage disease (the sample sizes needed to achieve 80% power for the most powerful test were 64 for early disease versus 100 for later disease), but the coxib-versus-placebo comparison was less powerful in early disease than in later disease (the sample sizes needed to achieve 80% power were 200 and 100, respectively). When the effects of treatment on core set items were small and/or inconsistent, power was reduced, particularly for a less broadly based outcome (e.g., DDAS) compared with the ACR20. The simulation studies demonstrate that data-driven outcome definitions can provide better sensitivity to change than does the ACR20 or DDAS. Using such methods would improve power, but at the expense of trial standardization. The studies also show how patient population and treatment characteristics affect the power of specific outcome measures in RA clinical trials, and provide quantification of those effects.

Measuring social inclusion--a key outcome in global mental health.

PubMed

Baumgartner, Joy Noel; Burns, Jonathan K

2014-04-01

Social inclusion is increasingly recognized as a key outcome for evaluating global mental health programmes and interventions. Whereas social inclusion as an outcome is not a new concept in the field of mental health, its measurement has been hampered by varying definitions, concepts and instruments. To move the field forward, this paper reviews the currently available instruments which measure social inclusion and are reported in the literature, realizing that no single measure will be appropriate for all studies or contexts. A systematic literature search of English language peer-reviewed articles published through February 2013 was undertaken to identify scales specifically developed to measure social inclusion or social/community integration among populations with mental disorders. Five instruments were identified through the search criteria. The scales are discussed in terms of their theoretical underpinnings, domains and/or key items and their potential for use in global settings. Whereas numerous reviewed abstracts discussed mental health and social inclusion or social integration, very few were concerned with direct measurement of the construct. All identified scales were developed in high-income countries with limited attention paid to how the scale could be adapted for cross-cultural use. Social inclusion is increasingly highlighted as a key outcome for global mental health policies and programmes, yet its measurement is underdeveloped. There is need for a global cross-cultural measure that has been developed and tested in diverse settings. However, until that need is met, some of the scales presented here may be amenable to adaptation.

Weak Measurement and Quantum Smoothing of a Superconducting Qubit

NASA Astrophysics Data System (ADS)

Tan, Dian

In quantum mechanics, the measurement outcome of an observable in a quantum system is intrinsically random, yielding a probability distribution. The state of the quantum system can be described by a density matrix rho(t), which depends on the information accumulated until time t, and represents our knowledge about the system. The density matrix rho(t) gives probabilities for the outcomes of measurements at time t. Further probing of the quantum system allows us to refine our prediction in hindsight. In this thesis, we experimentally examine a quantum smoothing theory in a superconducting qubit by introducing an auxiliary matrix E(t) which is conditioned on information obtained from time t to a final time T. With the complete information before and after time t, the pair of matrices [rho(t), E(t)] can be used to make smoothed predictions for the measurement outcome at time t. We apply the quantum smoothing theory in the case of continuous weak measurement unveiling the retrodicted quantum trajectories and weak values. In the case of strong projective measurement, while the density matrix rho(t) with only diagonal elements in a given basis |n〉 may be treated as a classical mixture, we demonstrate a failure of this classical mixture description in determining the smoothed probabilities for the measurement outcome at time t with both diagonal rho(t) and diagonal E(t). We study the correlations between quantum states and weak measurement signals and examine aspects of the time symmetry of continuous quantum measurement. We also extend our study of quantum smoothing theory to the case of resonance fluorescence of a superconducting qubit with homodyne measurement and observe some interesting effects such as the modification of the excited state probabilities, weak values, and evolution of the predicted and retrodicted trajectories.

OMERACT Filter Evidence Supporting the Measurement of At-work Productivity Loss as an Outcome Measure in Rheumatology Research.

PubMed

Beaton, Dorcas E; Dyer, Sarah; Boonen, Annelies; Verstappen, Suzanne M M; Escorpizo, Reuben; Lacaille, Diane V; Bosworth, Ailsa; Gignac, Monique A M; Leong, Amye; Purcaru, Oana; Leggett, Sarah; Hofstetter, Cathy; Peterson, Ingemar F; Tang, Kenneth; Fautrel, Bruno; Bombardier, Claire; Tugwell, Peter S

2016-01-01

Indicators of work role functioning (being at work, and being productive while at work) are important outcomes for persons with arthritis. As the worker productivity working group at OMERACT (Outcome Measures in Rheumatology), we sought to provide an evidence base for consensus on standardized instruments to measure worker productivity [both absenteeism and at-work productivity (presenteeism) as well as critical contextual factors]. Literature reviews and primary studies were done and reported to the OMERACT 12 (2014) meeting to build the OMERACT Filter 2.0 evidence for worker productivity outcome measurement instruments. Contextual factor domains that could have an effect on scores on worker productivity instruments were identified by nominal group techniques, and strength of influence was further assessed by literature review. At OMERACT 9 (2008), we identified 6 candidate measures of absenteeism, which received 94% endorsement at the plenary vote. At OMERACT 11 (2012) we received over the required minimum vote of 70% for endorsement of 2 at-work productivity loss measures. During OMERACT 12 (2014), out of 4 measures of at-work productivity loss, 3 (1 global; 2 multiitem) received support as having passed the OMERACT Filter with over 70% of the plenary vote. In addition, 3 contextual factor domains received a 95% vote to explore their validity as core contextual factors: nature of work, work accommodation, and workplace support. Our current recommendations for at-work productivity loss measures are: WALS (Workplace Activity Limitations Scale), WLQ PDmod (Work Limitations Questionnaire with modified physical demands scale), WAI (Work Ability Index), WPS (Arthritis-specific Work Productivity Survey), and WPAI (Work Productivity and Activity Impairment Questionnaire). Our future research focus will shift to confirming core contextual factors to consider in the measurement of worker productivity.

Outcome measures for adult critical care: a systematic review.

PubMed

Hayes, J A; Black, N A; Jenkinson, C; Young, J D; Rowan, K M; Daly, K; Ridley, S

2000-01-01

1. To identify generic and disease specific measures of impairment, functional status and health-related quality of life that have been used in adult critical care (intensive and high-dependency care) survivors. 2. To review the validity, reliability and responsiveness of the measures in adult critical care survivors. 3. To consider the implications for future policy and to make recommendations for further methodological research. 4. To review what is currently known of the outcome of adult critical care. Searches of electronic databases (MEDLINE, EMBASE, CINAHL, PsycLIT, The Cochrane Library and SIGLE) from 1970 to August 1998. Manual searches of five journals (1985-98) not indexed in electronic databases and relevant conference proceedings (1993-98). Reference lists of six existing reviews, plus snowballing from reference lists of all relevant articles identified. Randomised trials, non-randomised trials (cohort studies) and case series that included data on outcomes after discharge from adult (16 years and over) critical care. If reported, the following data were extracted from each paper: patient characteristics (age, gender, severity of illness, diagnostic category) number of patients eligible for study, follow-up period, number of deaths before follow-up, number and proportion of survivors included in follow-up method of presentation of outcome data - proportion normal as defined by reference values, or aggregate value (e.g. mean or median), or aggregate values plus an indication of variance (e.g. standard deviation or inter-quartile range). Evidence for three measurement properties was sought for each outcome measure that had been used in at least two studies - their validity, reliability and responsiveness in adult critical care. If the authors did not report these aspects explicitly, an attempt was made to use the data provided to provide these measurement properties. For measures that were used in at least ten studies, information on actual reported outcomes were also extracted. MEASURES USED IN CRITICAL CARE: Measures of impairment were largely confined to the respiratory system so are almost certainly not appropriate for many critical care survivors. They can be categorised as respiratory volumes (e.g. vital capacity), gas flow within the respiratory system (e.g. forced expiratory volume in 1 second (FEV1)), pulmonary diffusing capacity (e.g. carbon monoxide diffusing capacity) and visualisation of the upper airway (e.g. bronchoscopy). Multiple tests are often performed. Eight measures of physical functional status were used, five generic and three disease-specific. The most frequently used generic measures were multi-item scales. Two single-item global measures attempted to capture a person's overall activity level or functional status. Five multi-item measures of mental functional status were used, four generic and one specific to trauma patients. The generic measures were either confined to assessing depressive symptoms or also encompassed a measure of anxiety. Measures of neuropsychological functioning relate to a person's cognition, attention, ability to process information and memory. Apart from one single-item measure, which focused on communication level, six multi-item measures were used with critical care survivors. Such measures are particularly appropriate for use with survivors of head injury or other neurological insult and, in that sense, they are disease-specific rather than generic measures. Single item measures of recovery were frequently used but researchers often invented their own, so there was little consistency in the wording. These measures had five principal foci - return to work, return to own home, degree of recovery, productivity and chronic health status. One multi-item scale was also used. (ABSTRACT TRUNCATED)

Clinical research in implant dentistry: study design, reporting and outcome measurements: consensus report of Working Group 2 of the VIII European Workshop on Periodontology.

PubMed

Tonetti, Maurizio; Palmer, Richard

2012-02-01

The objective of this working group was to assess and make specific recommendations to improve the quality of reporting of clinical research in implant dentistry and discuss ways to reach a consensus on choice of outcomes. Discussions were informed by three systematic reviews on quality of reporting of observational studies (case series, case-control and cohort) and experimental research (randomized clinical trials). An additional systematic review provided information on choice of outcomes and analytical methods. In addition, an open survey among all workshop participants was utilized to capture a consensus view on the limits of currently used survival and success-based outcomes as well as to identify domains that need to be captured by future outcome systems. The Workshop attempted to clarify the characteristics and the value in dental implant research of different study designs. In most areas, measurable quality improvements over time were identified. The Workshop recognized important aspects that require continued attention by clinical researchers, funding agencies and peer reviewers to decrease potential bias. With regard to choice of outcomes, the limitations of currently used systems were recognized. Three broad outcome domains that need to be captured by future research were identified: (i) patient reported outcome measures, (ii) peri-implant tissue health and (iii) performance of implant supported restorations. Peri-implant tissue health can be measured by marginal bone level changes and soft tissue inflammation and can be incorporated in time to event analyses. The Workshop recommended that collaboration between clinicians and epidemiologists/clinical trials specialists should be encouraged. Aspects of design aimed at limitation of potential bias should receive attention by clinical researchers, funding agencies and journal editors. Adherence to appropriate reporting guidelines such as STROBE and CONSORT are necessary standards. Research on outcome measure domains is an area of top priority and should urgently inform a proper process leading to a consensus on outcome measures in dental implant research. © 2012 John Wiley & Sons A/S.

Measurement properties of the Health of the Nation Outcome Scales (HoNOS) family of measures: protocol for a systematic review.

PubMed

Harris, Meredith G; Sparti, Claudia; Scheurer, Roman; Coombs, Tim; Pirkis, Jane; Ruud, Torleif; Kisely, Steve; Hanssen-Bauer, Ketil; Siqveland, Johan; Burgess, Philip M

2018-04-20

The Health of the Nation Outcome Scales (HoNOS) for adults, and equivalent measures for children and adolescents and older people, are widely used in clinical practice and research contexts to measure mental health and functional outcomes. Additional HoNOS measures have been developed for special populations and applications. Stakeholders require synthesised information about the measurement properties of these measures to assess whether they are fit for use with intended service settings and populations and to establish performance benchmarks. This planned systematic review will critically appraise evidence on the measurement properties of the HoNOS family of measures. Journal articles meeting inclusion criteria will be identified via a search of seven electronic databases: MEDLINE via EBSCOhost, PsycINFO via APA PsycNET, Embase via Elsevier, Cumulative Index to Nursing and Allied Health Literature via EBSCOhost, Web of Science via Thomson Reuters, Google Scholar and the Cochrane Library. Variants of 'Health of the Nation Outcome Scales' or 'HoNOS' will be searched as text words. No restrictions will be placed on setting or language of publication. Reference lists of relevant studies and reviews will be scanned for additional eligible studies. Appraisal of reliability, validity, responsiveness and interpretability will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Feasibility/utility will be appraised using definitions and criteria derived from previous reviews. For reliability studies, we will also apply the Guidelines for Reporting Reliability and Agreement Studies to assess quality of reporting. Results will be synthesised narratively, separately for each measure, and by subgroup (eg, treatment setting, rater profession/experience or training) where possible. Meta-analyses will be undertaken where data are adequate. Ethics approval is not required as no primary data will be collected. Outcomes will be disseminated to stakeholders via reports, journal articles and presentations at meetings and conferences. CRD42017057871. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Challenges in Measuring Outcomes Following Digital Replantation

PubMed Central

Sebastin, Sandeep J.; Chung, Kevin C.

2013-01-01

In the early period of replantation surgery, the emphasis was on digit survival. Subsequently, with better microsurgical techniques and instrumentation, the focus has shifted to function and in recent years to consideration of cost-effectiveness. Despite over 40 years of effort in refining digital replantation surgery, a rigorous evaluation of the outcomes of digital replantation has not been performed. This is because of the many confounding variables that influence outcome comparisons. These variables include the mechanism of injury (guillotine, crush, avulsion), the injury itself (total, near total, subtotal, partial amputation), and the surgical procedure (replantation, revascularization). In addition, the traditional outcome measures (two-point discrimination, range of motion, grip strength, or the ability to return to work) are reported inconsistently and vary widely among publications. All these factors make meaningful comparison of outcomes difficult. The recent emphasis on outcome research and cost-effectiveness necessitates a rethinking in the way we report outcomes of digital replantation. In this article, the authors summarize the challenges in assessing outcomes of digital replantation and explain the need to measure outcomes using rigorous clinical research designs that incorporate cost-effectiveness studies in the research protocol. PMID:24872766

Unique contributions of dynamic versus global measures of parent-child interaction quality in predicting school adjustment.

PubMed

Bardack, Sarah; Herbers, Janette E; Obradović, Jelena

2017-09-01

This study investigates the unique contribution of microsocial and global measures of parent-child positive coregulation (PCR) in predicting children's behavioral and social adjustment in school. Using a community sample of 102 children, ages 4-6, and their parents, we conducted nested path analytic models to identify the unique effects of 2 measures of PCR on school outcomes. Microsocial PCR independently predicted fewer externalizing and inattention/impulsive behaviors in school. Global PCR did not uniquely relate to children's behavioral and social adjustment outcomes. Household socioeconomic status was related to both microsocial and global measures of PCR, but not directly associated with school outcomes. Findings illustrate the importance of using dynamic measures of PCR based on microsocial coding to further understand how the quality of parent-child interaction is related to children's self-regulatory and social development during school transition. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

Choice of Outcome Measure in an Economic Evaluation: A Potential Role for the Capability Approach.

PubMed

Lorgelly, Paula K

2015-08-01

The last decade has seen a renewed interest in Sen's capability approach; health economists have been instrumental in leading much of this work. One particular stream of research is the application of the approach to outcome measurement. To date, there have been a dozen attempts (some combined) to operationalise the approach, and produce an outcome measure that offers a broader evaluative space than health-related quality-of-life measures. Applications have so far been confined to public health, physical, mental health and social care interventions, but the capability approach could be of benefit to evaluations of pharmacotherapies and other technologies. This paper provides an introduction to the capability approach, reviews the measures that are available for use in an economic evaluation, including their current applications, and then concludes with a discussion of a number of issues that require further consideration before the approach is adopted more widely to inform resource allocation decisions.

Physical activity measurements affected participants' behavior in a randomized controlled trial.

PubMed

van Sluijs, Esther M F; van Poppel, Mireille N M; Twisk, Jos W R; van Mechelen, Willem

2006-04-01

Assessing levels and determinants of physical activity as outcome measurements might have an independent effect on participant's physical activity behavior. The objective is to study this effect in a randomized controlled trial (RCT) promoting regular physical activity in Dutch general practice. Using a Solomon four-group design, participants were randomized twice. After randomization to a control or intervention-condition at general practice level (N = 29), participants were randomized to a group participating in measurements at baseline, 2 and 6 months (3M-group, N = 361), or a group only participating in measurements at 6 months (1M-group, N = 356). Outcome measures assessed at 6 months included: level of physical activity (self-reported and objectively measured with accelerometry), meeting ACSM/CDC guideline for regular physical activity, stage of change, and determinants of physical activity. Follow-up data on 635 participants (89%) was collected. Statistically significant measurement effects were found for meeting the ACSM/CDC guideline (self-reported), self-efficacy for resisting relapse, knowledge, and on awareness. Other outcome measures showed positive trends, except stages of change. Measurements of physical activity affect participant's physical activity behavior, possibly triggered by a raised awareness about their own physical activity level. Implications for future research are discussed, as well as methodologic limitations of the study design.

Quality Measures for the Care of Patients with Insomnia

PubMed Central

Edinger, Jack D.; Buysse, Daniel J.; Deriy, Ludmila; Germain, Anne; Lewin, Daniel S.; Ong, Jason C.; Morgenthaler, Timothy I.

2015-01-01

The American Academy of Sleep Medicine (AASM) commissioned five Workgroups to develop quality measures to optimize management and care for patients with common sleep disorders including insomnia. Following the AASM process for quality measure development, this document describes measurement methods for two desirable outcomes of therapy, improving sleep quality or satisfaction, and improving daytime function, and for four processes important to achieving these goals. To achieve the outcome of improving sleep quality or satisfaction, pre- and post-treatment assessment of sleep quality or satisfaction and providing an evidence-based treatment are recommended. To realize the outcome of improving daytime functioning, pre- and post-treatment assessment of daytime functioning, provision of an evidence-based treatment, and assessment of treatment-related side effects are recommended. All insomnia measures described in this report were developed by the Insomnia Quality Measures Workgroup and approved by the AASM Quality Measures Task Force and the AASM Board of Directors. The AASM recommends the use of these measures as part of quality improvement programs that will enhance the ability to improve care for patients with insomnia. Citation: Edinger JD, Buysse DJ, Deriy L, Germain A, Lewin DS, Ong JC, Morgenthaler TI. Quality measures for the care of patients with insomnia. J Clin Sleep Med 2015;11(3):311–334. PMID:25700881

Systematic influences of gamma-ray spectrometry data near the decision threshold for radioactivity measurements in the environment.

PubMed

Zorko, Benjamin; Korun, Matjaž; Mora Canadas, Juan Carlos; Nicoulaud-Gouin, Valerie; Chyly, Pavol; Blixt Buhr, Anna Maria; Lager, Charlotte; Aquilonius, Karin; Krajewski, Pawel

2016-07-01

Several methods for reporting outcomes of gamma-ray spectrometric measurements of environmental samples for dose calculations are presented and discussed. The measurement outcomes can be reported as primary measurement results, primary measurement results modified according to the quantification limit, best estimates obtained by the Bayesian posterior (ISO 11929), best estimates obtained by the probability density distribution resembling shifting, and the procedure recommended by the European Commission (EC). The annual dose is calculated from the arithmetic average using any of these five procedures. It was shown that the primary measurement results modified according to the quantification limit could lead to an underestimation of the annual dose. On the other hand the best estimates lead to an overestimation of the annual dose. The annual doses calculated from the measurement outcomes obtained according to the EC's recommended procedure, which does not cope with the uncertainties, fluctuate between an under- and overestimation, depending on the frequency of the measurement results that are larger than the limit of detection. In the extreme case, when no measurement results above the detection limit occur, the average over primary measurement results modified according to the quantification limit underestimates the average over primary measurement results for about 80%. The average over best estimates calculated according the procedure resembling shifting overestimates the average over primary measurement results for 35%, the average obtained by the Bayesian posterior for 85% and the treatment according to the EC recommendation for 89%. Copyright © 2016 Elsevier Ltd. All rights reserved.

Contextualized Measurement of Self-Efficacy and College Students' Perceived Sources of Self-Efficacy in Introductory Plant Science Courses

ERIC Educational Resources Information Center

Keefe, Lisa Madalon

2013-01-01

Institutions of higher learning are recently being held more accountable for the learning outcomes of their students. As such, universities have begun to actively measure and evaluate student learning and motivational outcomes in an effort to improve the successful outcomes of their students. To support this work, two studies were conducted to…

Association between executive function and outcome measure of treatment in therapeutic community among cocaine dependent individuals.

PubMed

Vergara-Moragues, Esperanza; Verdejo-García, Antonio; Lozano, Oscar M; Santiago-Ramajo, Sandra; González-Saiz, Francisco; Betanzos Espinosa, Patricia; Pérez García, Miguel

2017-07-01

The aim of this study was to examine the association between baseline executive functioning and outcome measure of treatment in 226 cocaine dependent individuals who initiated treatment in therapeutic communities TCs. The study was conducted across six TCs located in the region of Andalusia (southern Spain). Neuropsychological testing included tests of working memory, reasoning, inhibition, switching, attention interference and decision making. The outcome measures were type of discharge (treatment dropout vs. therapeutic discharge) and clinical impression of the TC outcome (clinically significant vs. non-significant changes). In the present study a prospective comparative design was used. We found significant performance differences on selective executive components which account for the type of discharge: treatment quitters had poorer attention response inhibition and attention switching than non-quitters, and the individuals who failed to achieve therapeutic objectives had poorer attention interference and inhibitory control than compliers. No significant differences were found between the outcome measure and the neuropsychological performance score on the other tasks. The results provide important information about the impact of executive components on in-treatment follow-up outcomes among dependence disorders in TC. Copyright © 2017 Elsevier Inc. All rights reserved.

Implementation of learning outcome attainment measurement system in aviation engineering higher education

NASA Astrophysics Data System (ADS)

Salleh, I. Mohd; Mat Rani, M.

2017-12-01

This paper aims to discuss the effectiveness of the Learning Outcome Attainment Measurement System in assisting Outcome Based Education (OBE) for Aviation Engineering Higher Education in Malaysia. Direct assessments are discussed to show the implementation processes that become a key role in the successful outcome measurement system. A case study presented in this paper involves investigation on the implementation of the system in Aircraft Structure course for Bachelor in Aircraft Engineering Technology program in UniKL-MIAT. The data has been collected for five semesters, starting from July 2014 until July 2016. The study instruments used include the report generated in Learning Outcomes Measurements System (LOAMS) that contains information on the course learning outcomes (CLO) individual and course average performance reports. The report derived from LOAMS is analyzed and the data analysis has revealed that there is a positive significant correlation between the individual performance and the average performance reports. The results for analysis of variance has further revealed that there is a significant difference in OBE grade score among the report. Independent samples F-test results, on the other hand, indicate that the variances of the two populations are unequal.

Causal inference with measurement error in outcomes: Bias analysis and estimation methods.

PubMed

Shu, Di; Yi, Grace Y

2017-01-01

Inverse probability weighting estimation has been popularly used to consistently estimate the average treatment effect. Its validity, however, is challenged by the presence of error-prone variables. In this paper, we explore the inverse probability weighting estimation with mismeasured outcome variables. We study the impact of measurement error for both continuous and discrete outcome variables and reveal interesting consequences of the naive analysis which ignores measurement error. When a continuous outcome variable is mismeasured under an additive measurement error model, the naive analysis may still yield a consistent estimator; when the outcome is binary, we derive the asymptotic bias in a closed-form. Furthermore, we develop consistent estimation procedures for practical scenarios where either validation data or replicates are available. With validation data, we propose an efficient method for estimation of average treatment effect; the efficiency gain is substantial relative to usual methods of using validation data. To provide protection against model misspecification, we further propose a doubly robust estimator which is consistent even when either the treatment model or the outcome model is misspecified. Simulation studies are reported to assess the performance of the proposed methods. An application to a smoking cessation dataset is presented.

Functional Plasticity in Childhood Brain Disorders: When, What, How, and Whom to Assess

PubMed Central

Dennis, Maureen; Spiegler, Brenda J.; Simic, Nevena; Sinopoli, Katia J.; Wilkinson, Amy; Yeates, Keith Owen; Taylor, H. Gerry; Bigler, Erin D.; Fletcher, Jack M.

2014-01-01

At every point in the lifespan, the brain balances malleable processes representing neural plasticity that promote change with homeostatic processes that promote stability. Whether a child develops typically or with brain injury, his or her neural and behavioral outcome is constructed through transactions between plastic and homeostatic processes and the environment. In clinical research with children in whom the developing brain has been malformed or injured, behavioral outcomes provide an index of the result of plasticity, homeostasis, and environmental transactions. When should we assess outcome in relation to age at brain insult, time since brain insult, and age of the child at testing? What should we measure? Functions involving reacting to the past and predicting the future, as well as social-affective skills, are important. How should we assess outcome? Information from performance variability, direct measures and informants, overt and covert measures, and laboratory and ecological measures should be considered. In whom are we assessing outcome? Assessment should be cognizant of individual differences in gene, socio-economic status (SES), parenting, nutrition, and interpersonal supports, which are moderators that interact with other factors influencing functional outcome. PMID:24821533

The Patient-Centered Medical Home (PCMH) Framing Typology for Understanding the Structure, Function, and Outcomes of PCMHs.

PubMed

Kieber-Emmons, Autumn M; Miller, William L

2017-01-01

Patient-centered medical homes (PCHMs) aspire to transform today's challenged primary care services. However, it is unclear which PCMH characteristics produce specific outcomes of interest for care delivery. This study tested a novel typology of PCMH practice transformation, the PCMH framing typology, and evaluated measurable outcomes by each type. Using the Patient-Centered Primary Care Collaborative 2012 to 2013 Annual Review, this secondary analysis of the published PCMH literature extracted data from publications of 59 PCMHs. Each of the 59 sites was categorized as 1 of 4 PCMH types: add-on, renovated, hybrid, or integrated. Six outcome measures (cost reductions, decreased emergency department/hospital utilization, improved quality, improved access, increased preventive services, and improved patient satisfaction) were independently coded for each site. Practices were combined based on type, and mean outcomes scores for each measure were displayed on radar graphs for comparison. While each type showed a characteristic pattern of success, only the integrated type improved in all 6 outcomes. No type achieved high success in all measures. There seem to be 4 types of PCMH, each of which shows a distinctive outcomes profile. Within the PCMH framing typology, direction is emerging for how best to transform primary care to achieve the greatest success. © Copyright 2017 by the American Board of Family Medicine.

Valuing empathy and emotional intelligence in health leadership: a study of empathy, leadership behaviour and outcome effectiveness.

PubMed

Skinner, C; Spurgeon, P

2005-02-01

This article examines the relationship between health managers' self-assessed empathy, their leadership behaviours as rated by their staff, and staff's personal ratings on a range of work satisfaction and related outcome measures. Empathy was conceived of as four distinct but related individual dispositions, namely empathic concern (EC), perspective taking (PT), personal distress (PD) and empathic matching (EM). Results showed three empathy scales (EC, PT and EM) were, as postulated, positively related to transformational behaviour (inspiring followers to achieve more than expected). The same three measures, also as expected, showed no relationship to transactional behaviour (motivating followers to achieve expected results) and were negatively associated with laissez-faire leadership (an absence of leadership style). Relationships between empathy scales and outcome measures were selective and moderate in size. Strongest empathy association was evident between the PT scale and most outcome measures. Conversely, the extra effort outcome appeared most sensitive to the range of empathy scales. Where significant relationships did exist between empathy and outcome, leadership behaviour was in all cases a perfect mediator. Whilst not denying the smaller dispositional effects on leadership outcomes, leadership behaviour itself, rather than individual traits such as empathy, appear to be major influencing factors in leadership effectiveness.

Early functional MRI activation predicts motor outcome after ischemic stroke: a longitudinal, multimodal study.

PubMed

Du, Juan; Yang, Fang; Zhang, Zhiqiang; Hu, Jingze; Xu, Qiang; Hu, Jianping; Zeng, Fanyong; Lu, Guangming; Liu, Xinfeng

2018-05-15

An accurate prediction of long term outcome after stroke is urgently required to provide early individualized neurorehabilitation. This study aimed to examine the added value of early neuroimaging measures and identify the best approaches for predicting motor outcome after stroke. This prospective study involved 34 first-ever ischemic stroke patients (time since stroke: 1-14 days) with upper limb impairment. All patients underwent baseline multimodal assessments that included clinical (age, motor impairment), neurophysiological (motor-evoked potentials, MEP) and neuroimaging (diffusion tensor imaging and motor task-based fMRI) measures, and also underwent reassessment 3 months after stroke. Bivariate analysis and multivariate linear regression models were used to predict the motor scores (Fugl-Meyer assessment, FMA) at 3 months post-stroke. With bivariate analysis, better motor outcome significantly correlated with (1) less initial motor impairment and disability, (2) less corticospinal tract injury, (3) the initial presence of MEPs, (4) stronger baseline motor fMRI activations. In multivariate analysis, incorporating neuroimaging data improved the predictive accuracy relative to only clinical and neurophysiological assessments. Baseline fMRI activation in SMA was an independent predictor of motor outcome after stroke. A multimodal model incorporating fMRI and clinical measures best predicted the motor outcome following stroke. fMRI measures obtained early after stroke provided independent prediction of long-term motor outcome.

Evidence for outcomes of motivational rehabilitation interventions for children and adolescents with cerebral palsy: an American Academy for Cerebral Palsy and Developmental Medicine systematic review.

PubMed

Tatla, Sandy K; Sauve, Karen; Virji-Babul, Naznin; Holsti, Liisa; Butler, Charlene; Van Der Loos, Hendrik F Machiel

2013-07-01

This study reviewed evidence regarding the effect of motivational rehabilitation interventions on outcomes in children with cerebral palsy. Six databases were searched for literature published up to May 2012. Included studies measured the purported motivating effects of motor-based rehabilitation interventions and the measured impact on outcomes. The American Academy for Cerebral Palsy and Developmental Medicine (AACPDM) systematic review methodology was used as a framework. Eight studies evaluated outcomes of studies using virtual reality interventions and one in a functional therapy context. Conflicting evidence from three (level II and level III) studies exists about the impact of these motivating interventions on motor outcomes measured in body functions. No statistical evidence regarding activity and participation outcomes exists. A single level II study found no significant difference in participants' motivation between motivational and conventional interventions. This review revealed a paucity of research on the effects of motivational interventions. Weaknesses include a lack of consistency in the examination of motivational interventions, limited use of definitions or theories to ground the concept of motivation, and reliance on non-validated methodological tools. This body of evidence would be strengthened by the use and development of robust outcome measures of motivation. © 2013 Mac Keith Press.

A comparison between the clinical significance and growth mixture modelling early change methods at predicting negative outcomes.

PubMed

Flood, Nicola; Page, Andrew; Hooke, Geoff

2018-05-03

Routine outcome monitoring benefits treatment by identifying potential no change and deterioration. The present study compared two methods of identifying early change and their ability to predict negative outcomes on self-report symptom and wellbeing measures. 1467 voluntary day patients participated in a 10-day group Cognitive Behaviour Therapy (CBT) program and completed the symptom and wellbeing measures daily. Early change, as defined by (a) the clinical significance method and (b) longitudinal modelling, was compared on each measure. Early change, as defined by the simpler clinical significance method, was superior at predicting negative outcomes than longitudinal modelling. The longitudinal modelling method failed to detect a group of deteriorated patients, and agreement between the early change methods and the final unchanged outcome was higher for the clinical significance method. Therapists could use the clinical significance early change method during treatment to alert them of patients at risk for negative outcomes, which in turn could allow therapists to prevent those negative outcomes from occurring.

Health-related quality of life, satisfaction, and economic outcome measures in studies of prostate cancer screening and treatment, 1990-2000.

PubMed

McNaughton-Collins, Mary; Walker-Corkery, Elizabeth; Barry, Michael J

2004-01-01

Prostate cancer outcomes research incorporates a broad spectrum of endpoints, from clinical or intermediate endpoints, such as tumor shrinkage or patient compliance, to final endpoints, such as survival or disease-free survival. Three types of nontraditional endpoints that are of growing interest-health-related quality of life (QOL), satisfaction with care, and economic cost impact-hold the promise of improving our ability to understand the full burden of prostate cancer screening and treatment. In this article we review the last decade's published literature regarding the health-related QOL, satisfaction, and economic outcomes of prostate cancer screening and treatment to determine the "state of the science" of outcomes measurement. The focus is the enumeration of the types of outcome measurement used in the studies not the determination of the results of the studies. Studies were identified by searching Medline (1990-2000). Articles were included if they presented original data on any patient-centered outcome (including costs or survival alone) for men screened and treated for prostate cancer. Review papers were excluded unless they were quantitative syntheses of the results of other primary studies. Economic and decision analytic papers were included if they presented information on outcomes of real or hypothetical patient cohorts. Each retrieved article was reviewed by one of the authors. Included papers were assigned one primary, mutually exclusive study design. For the "primary data" studies, information was abstracted on care setting, dates of the study, sample size, racial distribution, age, tumor differentiation, tumor stage, survival, statistical power, and types of outcomes measures (QOL-generic, QOL-cancer specific, QOL-prostate cancer specific, satisfaction, costs, utilities, and other). For the "economic and decision analytic" papers, information was abstracted on stage of disease, age range, outcomes, costs, and whether utilities were measured. Of the 198 included papers, there were 161 primary data papers categorized as follows: randomized trial (n = 28), nonrandomized trial (n = 13), prospective or retrospective cohort study (n = 55), case-control study (n = 0), cross-sectional study (n = 63), and meta-analysis (n = 2). The remaining 37 papers were economic and decision analytic papers. Among the 149 primary data papers that contained patient outcome data, there were 42 standard instruments used, accounting for 44% (179 of 410) of the measures overall. Almost three-quarters (71%) of papers included one, two, or three outcomes measures of all types (standard and nonstandard); three papers included seven outcomes measures, and one paper included nine. Over the 11-year time period, there was a nonstatistically significant trend toward more frequent use of standardized QOL instruments and a statistically significant trend toward increased reporting of race (P = .003). Standardization of measurement of health-related QOL, satisfaction with care, and economic cost effect among men screened and treated for prostate cancer is needed. A core set of similar questions, both generic and disease-specific, should ideally be asked in every study, although investigators should be encouraged to include additional question sets as appropriate to individual studies to get a more complete picture of how patients screened and treated for this condition are doing over time.

American College of Rheumatology/European League against Rheumatism Preliminary Definition of Remission in Rheumatoid Arthritis for Clinical Trials

PubMed Central

Felson, David T.; Smolen, Josef S.; Wells, George; Zhang, Bin; van Tuyl, Lilian H. D.; Funovits, Julia; Aletaha, Daniel; Allaart, Renée; Bathon, Joan; Bombardieri, Stefano; Brooks, Peter; Brown, Andrew; Matucci-Cerinic, Marco; Choi, Hyon; Combe, Bernard; de Wit, Maarten; Dougados, Maxime; Emery, Paul; Furst, Dan; Gomez-Reino, Juan; Hawker , Gillian; Keystone, Edward; Khanna, Dinesh; Kirwan, John; Kvien, Tore; Landewé, Robert; Listing, Joachim; Michaud, Kaleb; Mola, Emilio Martin; Montie, Pam; Pincus, Ted; Richards, Pam; Siegel, Jeff; Simon, Lee; Sokka, Tuulikki; Strand, Vibeke; Tugwell, Peter; Tyndall, Alan; van der Heijde, Desirée; Verstappen, Suzan; White, Barbara; Wolfe, Fred; Zink, Angela; Boers, Maarten

2010-01-01

Background With remission in rheumatoid arthritis (RA) an increasingly attainable goal, there is no widely used definition of remission that is stringent but achievable and could be applied uniformly as an outcome in clinical trials. Methods A committee consisting of members of the American College of Rheumatology, the European League Against Rheumatism and the Outcome Measures in Rheumatology Initiative (OMERACT) met to guide the process and review prespecified analyses from clinical trials of patients with RA. The committee requested a stringent definition (little, if any, active disease) and decided to use core set measures to define remission including at least joint counts and an acute phase reactant. Members were surveyed to select the level of each core set measure consistent with remission. Candidate definitions of remission were tested including those that constituted a number of individual measures in remission (Boolean approach) as well as definitions using disease activity indexes. To select a definition of remission, trial data were analyzed to examine the added contribution of patient reported outcomes and the ability of candidate measures to predict later good x-ray and functional outcomes. Results Survey results for the definition of remission pointed to indexes at published thresholds and to a count of core set measures with each measure scored as 1 or less (e.g. tender and swollen joint counts, CRP and global assessments on 0-10 scale). Analyses suggested the need to include a patient reported measure. Examination of 2 year follow-up data suggested that many candidate definitions performed comparably in terms of predicting later good x-ray and functional outcomes, although DAS28 based measures of remission did not predict good radiographic outcomes as well as did the other candidate definitions. Given these and other considerations, we propose that a patient be defined as in remission based on one of two definitions : 1: When their scores on the following measures are all <1: tender joint count, swollen joint count, CRP (in mg/dL) and patient global assessment (0-10 scale), OR 2: when their score on the SDAI is < 3.3. Conclusion We propose two new definitions of remission both of which can be uniformly applied and widely used in RA clinical trials. We recommend that one of these be selected in each trial as an outcome and that the results on both be reported in each trial. PMID:21294106

ENVIRONMENTAL HEALTH INDICATORS: STATE OF THE ENVIRONMENT REPORT

EPA Science Inventory

Background/Purpose: The U.S. Environmental Protection Agency (EPA) is moving in the direction of measuring and assessing human health and ecological outcomes. The new "outcome" measures complement the more traditional approaches by more closely reflecting the actual public health...

Health System Perspective: Variation, Costs, and Physician Behavior.

PubMed

Jevsevar, David S

2015-01-01

With the generalized rise in cost of US health care, renewed emphasis has been placed on defining the relationship between costs and outcome. The quality of health care delivery has been uneven, as measured by existing quality and performance measures, significant variation in the delivery of care, lack of standardization of care leading to avoidable error, lack of meaningful outcomes measurement, and apparent disconnect with cost. Orthopaedic surgeons are at the nexus of implementing change, as we are the primary decision makers regarding care of our patients. This summary will review efforts that address quality, cost, outcome, safety, and variation in care.

Attitudes of Austrian Psychotherapists Towards Process and Outcome Monitoring.

PubMed

Kaiser, Tim; Schmutzhart, Lisa; Laireiter, Anton-Rupert

2018-03-08

While monitoring systems in psychotherapy have become more common, little is known about the attitudes that mental health practitioners have towards these systems. In an online survey among 111 Austrian psychotherapists and trainees, attitudes towards therapy monitoring were measured. A well-validated questionnaire measuring attitudes towards outcome monitoring, the Outcome Measurement Questionnaire, was used. Clinicians' theoretical orientations as well as previous knowledge and experience with monitoring systems were associated with positive attitudes towards monitoring. Possible factors that may have led to these findings, like the views of different theoretical orientations or obstacles in Austrian public health care, are discussed.

Neurocognition and community outcome in schizophrenia: long-term predictive validity.

PubMed

Fujii, Daryl E; Wylie, A Michael

2003-02-01

The present study examined the predictive validity of neuropsychological measures to functional outcome in 26 schizophrenic patients 15-plus year post-testing. Outcome measures included score on the Resource Associated Functional Level Scale (RAFLS), number of state hospital admissions, and total duration of state hospital inpatient stay. Results of several stepwise multiple regressions revealed that verbal memory significantly predicted RAFLS score, accounting for nearly half of the variance. Trails B significantly predicted duration of state hospital inpatient status. Discussion focused on the utility of these measures for clinicians and system planners. Copyright 2002 Elsevier Science B.V.

Purchasing population health: aligning financial incentives to improve health outcomes.

PubMed

Kindig, D A

1999-01-01

To review the concept of population health, including its definition, measurement, and determinants, and to suggest an approach for aligning financial incentives toward this goal. DATA SOURCE, STUDY DESIGN, DATA EXTRACTION: Literature review, policy analysis The article presents the argument that a major reason for our slow progress toward health outcome improvement is that there is no operational definition of population health and that financial incentives are not aligned to this goal. Current attempts at process measures as indicators of quality or outcome are not adequate for the task. It is suggested that some measure of health-adjusted life expectancy be adopted for this purpose, and that integrated delivery systems and other agents responsible for nonmedical determinants be rewarded for improvement in this measure. This will require the development of an investment portfolio across the determinants of health based on relative marginal return to health, with horizontal integration strategies across sectoral boundaries. A 20-year three-phase development strategy is proposed, including components of research and acceptance, integrated health system implementation, and cross-sectoral integration. The U.S. health care system is a $1 trillion industry without a definition of its product. Until population outcome measures are developed and rewarded for, we will not solve the twenty-first century challenge of maximizing health outcome improvement for the resources available.

Purchasing population health: aligning financial incentives to improve health outcomes.

PubMed

Kindig, D A

1998-06-01

To review the concept of population health, including its definition, measurement, and determinants, and to suggest an approach for aligning financial incentives toward this goal. DATA SOURCE, STUDY DESIGN, DATA EXTRACTION. Literature review, policy analysis The article presents the argument that a major reason for our slow progress toward health outcome improvement is that there is no operational definition of population health and that financial incentives are not aligned to this goal. Current attempts at process measures as indicators of quality or outcome are not adequate for the task. It is suggested that some measure of health-adjusted life expectancy be adopted for this purpose, and that integrated delivery systems and other agents responsible for nonmedical determinants be rewarded for improvement in this measure. This will require the development of an investment portfolio across the determinants of health based on relative marginal return to health, with horizontal integration strategies across sectoral boundaries. A 20-year three-phase development strategy is proposed, including components of research and acceptance, integrated health system implementation, and cross-sectoral integration. The U.S. healthcare system is a $1 trillion industry without a definition of its product. Until population outcome measures are developed and rewarded for, we will not solve the twenty-first century challenge of maximizing health outcome improvement for the resources available.

The connection between strong social support and joint replacement outcomes.

PubMed

Theiss, Mark M; Ellison, Michael W; Tea, Christine G; Warner, Julia F; Silver, Renee M; Murphy, Valerie J

2011-05-18

A myriad of emotional, informational, and tangible needs can easily overwhelm patients as they seek to navigate a complicated surgical procedure. This article demonstrates that a dedicated family member or friend supporting their loved one before, during, and after joint replacement surgery measurably impacts quality and outcomes. The multidisciplinary, multihospital study team developed the following Opportunity Statement: "To define, measure, and implement a progressive family/friend support system across the continuum of care promoting optimal patient recovery after total joint arthroplasty." The team used the modified Groningen Orthopedic Social Support Scale to measure levels of social support and associated these levels with other patient outcomes.Analysis of 1722 observations across 4 hospitals found that patients with strong social support have shorter hospital stays, are more likely to be discharged home, to meet ambulation and transfer-out-of-bed targets, and to score hospital quality of care higher, and are more confident and ready to go home on discharge. Three presence intervals were also found to be significant predictors of key outcome measures: family/friend presence during the preoperative classes, in the preoperative holding area, and during the last physical therapy session. These intervals may serve as reasonable social support proxies for organizations desiring to measure social support to ultimately affect quality and outcomes. Copyright 2011, SLACK Incorporated.

Standardising the reporting of outcomes in gastric cancer surgery trials: protocol for the development of a core outcome set and accompanying outcome measurement instrument set (the GASTROS study).

PubMed

Alkhaffaf, Bilal; Glenny, Anne-Marie; Blazeby, Jane M; Williamson, Paula; Bruce, Iain A

2017-08-09

Gastric cancer is one of the leading causes of cancer-related deaths worldwide. Whilst surgery is the mainstay of curative treatment, it is associated with significant risks. Surgical strategies for treating gastric cancer should be based on evidence from systematic reviews of well-designed randomised controlled trials. However, inconsistencies in the reporting of outcomes from these trials makes evidence synthesis unreliable. We present a protocol for an international consensus study to develop a standardised set of outcomes and measurement tools - a 'core outcome set' (COS) - to be used by all future trials examining therapeutic surgical interventions for gastric cancer. The GASTROS study aims to standardise the reporting of outcomes in gastric cancer surgery trials through an international consensus process of key stakeholders including health care professionals and patients. The first of three stages in the study will identify a 'long-list' of potentially important outcomes to be prioritised. These will be extracted from a systematic review of relevant academic literature and patient interviews. Stage 2 will comprise an eDelphi survey which will consider the views of patients, nurse specialists and surgeons to prioritise the most important outcomes. A meeting of stakeholder representatives will ratify the COS. Stage 3 will focus on identifying appropriate instruments to measure the prioritised outcomes by means of quality assessment of available measurement instruments and stakeholder consultation. This study aims to standardise the reporting of outcomes in future trials examining therapeutic surgical interventions for gastric cancer. It is anticipated that standardisation of outcome reporting in these surgical effectiveness trials will enhance the evidence base for clinical practice. Highlighting outcomes of greatest importance to patients will ensure that their perspectives are central to research in this field.

The enduring effects of psychodynamic treatments vis-a-vis alternative treatments: A multilevel longitudinal meta-analysis

NASA Astrophysics Data System (ADS)

Kivlighan, D. Martin, III

Although evidence suggests that the benefits of psychodynamic treatments are sustained over time, presently it is unclear whether these sustained benefits are superior to non-psychodynamic treatments. Additionally, the extant literature comparing the sustained benefits of psychodynamic treatments compared to alternative treatments is limited with methodological shortcomings. The purpose of the current study was to conduct a rigorous test of the growth of the benefits of psychodynamic treatments relative to alternative treatments across distinct domains of change (i.e., all outcome measures, targeted outcome measures, non-targeted outcome measures, and personality outcome measures). To do so, the study employed strict inclusion criteria to identify randomized clinical trials that directly compared at least one bona fide psychodynamic treatment and one bona fide non-psychodynamic treatment. Hierarchical linear modeling (Raudenbush, Bryk, Cheong & Congdon, du Toit, 2011) was used to longitudinally model the impact of psychodynamic treatments compared to non-psychodynamic treatments at post-treatment and to compare the growth (i.e., slope) of effects beyond treatment completion. Findings from the present meta-analysis indicated that psychodynamic treatments and non-psychodynamic treatments were equally efficacious at post-treatment and at follow-up for combined outcomes ( k = 20), targeted outcomes (k =19), non-targeted outcomes (k =17), and personality outcomes (k =6). Clinical implications, directions for future research, and limitations are discussed.

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Challenges and Opportunities in Using Patient-Reported Outcomes in Quality Measurement in Rheumatology

PubMed Central

Wahl, Elizabeth; Yazdany, Jinoos

2016-01-01

Summary Use of Patient-reported outcome measures (PROs) in rheumatology research is widespread, but use of PRO data to evaluate the quality of rheumatologic care delivered is less well established. This article reviews the use of PROs in assessing healthcare quality, and highlights challenges and opportunities specific to their use in rheumatology quality measurement. We first explore other countries’ experiences collecting and evaluating national PRO data to assess quality of care. We describe the current use of PROs as quality measures in rheumatology, and frame an agenda for future work supporting development of meaningful quality measures based on PROs. PMID:27133495

Teacher, parent, and peer reports of early aggression as screening measures for long-term maladaptive outcomes: who provides the most useful information?

PubMed

Clemans, Katherine H; Musci, Rashelle J; Leoutsakos, Jeannie-Marie S; Ialongo, Nicholas S

2014-04-01

This study compared the ability of teacher, parent, and peer reports of aggressive behavior in early childhood to accurately classify cases of maladaptive outcomes in late adolescence and early adulthood. Weighted kappa analyses determined optimal cut points and relative classification accuracy among teacher, parent, and peer reports of aggression assessed for 691 students (54% male; 84% African American and 13% White) in the fall of first grade. Outcomes included antisocial personality, substance use, incarceration history, risky sexual behavior, and failure to graduate from high school on time. Peer reports were the most accurate classifier of all outcomes in the full sample. For most outcomes, the addition of teacher or parent reports did not improve overall classification accuracy once peer reports were accounted for. Additional gender-specific and adjusted kappa analyses supported the superior classification utility of the peer report measure. The results suggest that peer reports provided the most useful classification information of the 3 aggression measures. Implications for targeted intervention efforts in which screening measures are used to identify at-risk children are discussed.

Investigating the effect of independent, blinded digital image assessment on the STOP GAP trial.

PubMed

Patsko, Emily; Godolphin, Peter J; Thomas, Kim S; Hepburn, Trish; Mitchell, Eleanor J; Craig, Fiona E; Bath, Philip M; Montgomery, Alan A

2017-02-02

Blinding is the process of keeping treatment assignment hidden and is used to minimise the possibility of bias. Trials at high risk of bias have been shown to report larger treatment effects than low-risk studies. In dermatology, one popular method of blinding is to have independent outcome assessors who are unaware of treatment allocation assessing the endpoint using digital photographs. However, this can be complex, expensive and time-consuming. The objective of this study was to compare the effect of blinded and unblinded outcome assessment on the results of the STOP GAP trial. The STOP GAP trial compared prednisolone to ciclosporin in treating pyoderma gangrenosum. Participants' lesions were measured at baseline and at 6 weeks to calculate the primary outcome, speed of healing. Independent blinded assessors obtained measurements from digital photographs using specialist software. In addition, unblinded treating clinicians estimated lesion area by measuring length and width. The primary outcome was determined using blinded measurements where available, otherwise unblinded measurements were used (method referred to as trial measurements). In this study, agreement between the trial and unblinded measurements was determined using the intraclass correlation coefficient (ICC). The STOP GAP trial's primary analysis was repeated using unblinded measurements only. We introduced differential and nondifferential error in unblinded measurements and investigated the effect on the STOP GAP trial's primary analysis. Eighty-six (80%) of the 108 patients were assessed using digital images. Agreement between trial and unblinded measurements was excellent (ICC = 0.92 at baseline; 0.83 at 6 weeks). There was no evidence that the results of the trial primary analysis differed according to how the primary outcome was assessed (p value for homogeneity = 1.00). Blinded digital image assessment in the STOP GAP trial did not meaningfully alter trial conclusions compared with unblinded assessment. However, as the process brought added accuracy and credibility to the trial it was considered worthwhile. These findings question the usefulness of digital image assessment in a trial with an objective outcome and where bias is not expected to be excessive. Further research should investigate if there are alternative, less complex ways of incorporating blinding in clinical trials. Current Controlled Trials, www.isrctn.com ISRCTN35898459. Registered on 26 May 2009.

Imaging outcomes for trials of remyelination in multiple sclerosis

PubMed Central

Mallik, Shahrukh; Samson, Rebecca S; Wheeler-Kingshott, Claudia A M; Miller, David H

2014-01-01

Trials of potential neuroreparative agents are becoming more important in the spectrum of multiple sclerosis research. Appropriate imaging outcomes are required that are feasible from a time and practicality point of view, as well as being sensitive and specific to myelin, while also being reproducible and clinically meaningful. Conventional MRI sequences have limited specificity for myelination. We evaluate the imaging modalities which are potentially more specific to myelin content in vivo, such as magnetisation transfer ratio (MTR), restricted proton fraction f (from quantitative magnetisation transfer measurements), myelin water fraction and diffusion tensor imaging (DTI) metrics, in addition to positron emission tomography (PET) imaging. Although most imaging applications to date have focused on the brain, we also consider measures with the potential to detect remyelination in the spinal cord and in the optic nerve. At present, MTR and DTI measures probably offer the most realistic and feasible outcome measures for such trials, especially in the brain. However, no one measure currently demonstrates sufficiently high sensitivity or specificity to myelin, or correlation with clinical features, and it should be useful to employ more than one outcome to maximise understanding and interpretation of findings with these sequences. PET may be less feasible for current and near-future trials, but is a promising technique because of its specificity. In the optic nerve, visual evoked potentials can indicate demyelination and should be correlated with an imaging outcome (such as optic nerve MTR), as well as clinical measures. PMID:24769473

Working plan for the use of patient-reported outcome measures in adults with brain tumours: a Response Assessment in Neuro-Oncology (RANO) initiative.

PubMed

Dirven, Linda; Armstrong, Terri S; Blakeley, Jaishri O; Brown, Paul D; Grant, Robin; Jalali, Rakesh; Leeper, Heather; Mendoza, Tito; Nayak, Lakshmi; Reijneveld, Jaap C; Le Rhun, Emilie; Walbert, Tobias; Weller, Michael; Wen, Patrick Y; Taphoorn, Martin J B

2018-03-01

The Response Assessment in Neuro-Oncology-Patient-Reported Outcome (RANO-PRO) working group is an international multidisciplinary collaboration that provides guidance on the use of patient-reported outcome (PRO) measures in clinical trials and practice for adult patients with brain tumours. Findings from both PROs and traditional outcome measures, such as survival, and clinical or radiological response, are essential to inform the research community, policy makers, physicians, and patients in the treatment decision-making process. Previous initiatives in oncology have focused on guidelines concerning the collection, analysis, interpretation, and reporting of PRO data. However, we recommend the application of appropriate PRO instruments, with respect to its content and measurement properties (ie, research question, content validity, and other measurement properties), in brain tumour research. PROs should be well defined and reliable to generate high-quality evidence, and our recommendations on the use of specific PRO measures could help to improve the quality of PRO evidence derived from neuro-oncological studies, and might add a new dimension in how the value of therapeutics is assessed in patients with brain tumours. In this Policy Review, we present the RANO-PRO working plan for the use of PROs in adults with brain tumours. Copyright © 2018 Elsevier Ltd. All rights reserved.

The Mayo Portland Adaptability Inventory-4 outcome measure is superior to UK FIM+FAM in a British military population.

PubMed

McGilloway, Emer; Mitchell, James; Dharm-Datta, Shreshth; Roberts, Andrew; Tilley, Haydn; Etherington, John

2016-01-01

The aim of this study was to identify the most appropriate rehabilitation outcome measure for use in a young adult population with acquired brain injury. A 2-year prospective study of patients admitted to a UK military neuro-rehabilitation unit with acquired brain injury to compare the appropriateness of the Functional Independence Measure/Functional Assessment Measure (FIM+FAM) vs the Mayo-Portland Adaptability Inventory Version 4 (MPAI-4) in assessing outcomes. Patients were assessed at admission, discharge and at 4-month follow-up using FIM+FAM and MPAI-4. The FIM+FAM total motor score showed a marked ceiling affect, 42% of patients scored the maximum on admission rising to 80% at discharge. The MPAI-4 did not show significant ceiling effects. The other sub-scales of FIM+FAM and MPAI-4 were generally comparable, no more than 17% achieved ceiling at follow-up. This is the first comparative study of FIM+FAM and MPAI-4 in a young adult military population following acquired brain injury. All patients showed improvements in both outcome measures following intensive inpatient rehabilitation. However, the MPAI-4 did not show ceiling effects in motor scores. This measure was, therefore, found to be more appropriate in the cohort.

Measuring public health practice and outcomes in chronic disease: a call for coordination.

PubMed

Porterfield, Deborah S; Rogers, Todd; Glasgow, LaShawn M; Beitsch, Leslie M

2015-04-01

A strategic opportunity exists to coordinate public health systems and services researchers' efforts to develop local health department service delivery measures and the efforts of divisions within the Centers for Disease Control and Prevention's National Center for Chronic Disease Prevention and Health Promotion (NCCDPHP) to establish outcome indicators for public health practice in chronic disease. Several sets of outcome indicators developed by divisions within NCCDPHP and intended for use by state programs can be tailored to assess outcomes of interventions within smaller geographic areas or intervention settings. Coordination of measurement efforts could potentially allow information to flow from the local to the state to the federal level, enhancing program planning, accountability, and even subsequent funding for public health practice.

The Importance of Comprehensive Cam Correction: Radiographic Parameters Are Predictive of Patient-Reported Outcome Measures at 2 Years After Hip Arthroscopy.

PubMed

Lansdown, Drew A; Kunze, Kyle; Ukwuani, Gift; Waterman, Brian R; Nho, Shane J

2018-06-01

The specific influence of preoperative and postoperative radiographic measurements on patient-reported outcome measures after hip arthroscopy for femoroacetabular impingement (FAI) remains unclear. To investigate the relationship between radiographic measurements and 2-year outcomes after hip arthroscopy for the treatment of FAI. Case series; Level of evidence, 4. A clinical registry of patients undergoing primary hip arthroscopy for FAI between January 1, 2012, and December 31, 2014, was queried. Outcome measures included the Hip Outcome Score (HOS) Activities of Daily Living (ADL), HOS Sport-Specific Subscale (SSS), modified Harris Hip Score (mHHS), and visual analog scale (VAS) for pain and satisfaction. Preoperative and postoperative radiographic measurements were recorded. Univariate analysis was conducted to identify relationships between all radiographic and demographic variables and outcome scores. A multivariate regression analysis, controlling for demographic factors, was used to identify independent associations between radiographic measurements on plain radiographs and patient-reported outcomes. The authors identified 707 patients who underwent primary hip arthroscopic management for FAI who were included for analysis. Two-year outcome surveys were completed for 78% to 84% of patients. The mean age of the patients was 33.2 ± 12.3 years, and 64.4% of the patients (n = 456) were female. The mean anteroposterior (AP) alpha angle decreased by 34.3° ( P < .0001), false profile alpha angle by 25.2° ( P < .0001), Dunn lateral alpha angle by 28.9° ( P < .0001), lateral center edge angle by 2.6° ( P < .0001), and anterior center edge angle by 3.4° ( P < .0001). The HOS-ADL score increased from 65.7 ± 18.7 preoperatively to 85.9 ± 16.7 postoperatively ( P < .0001), HOS-SSS increased from 43.4 ± 23.1 to 72.6 ± 27.2 ( P < .0001), and mHHS increased from 57.7 ± 14.0 to 79.1 ± 17.2 ( P < .0001). With multivariate analysis, independent predictors of the postoperative HOS-ADL score included the preoperative false profile alpha angle (beta = -0.16, P = .028). Independent predictors of HOS-SSS score were preoperative AP alpha angle (beta = -0.33, P = .032) and preoperative false profile alpha angle (beta = -0.28, P = .041). For the postoperative mHHS score, independent predictors included preoperative AP alpha angle (beta = -0.18, P = .046), preoperative false profile alpha angle (beta = -0.20, P = .014), and postoperative false profile alpha angle (beta = -0.48, P = .035). The preoperative AP alpha angle (beta = 0.28, P = .024) was a significant predictor for the postoperative VAS pain score. The preoperative false profile alpha angle (beta = -0.34, P = .040) was a significant predictor for the postoperative VAS satisfaction score. The authors observed that radiographic measurements, specifically the preoperative false profile alpha angle, AP alpha angle, and postoperative false profile alpha angle, are independent predictors of 2-year clinical outcomes. The femoral-side measurements were the strongest independent predictors of outcomes, especially measurements of the anterior and lateral-based CAM lesion.

Comparative study of outcome measures and analysis methods for traumatic brain injury trials.

PubMed

Alali, Aziz S; Vavrek, Darcy; Barber, Jason; Dikmen, Sureyya; Nathens, Avery B; Temkin, Nancy R

2015-04-15

Batteries of functional and cognitive measures have been proposed as alternatives to the Extended Glasgow Outcome Scale (GOSE) as the primary outcome for traumatic brain injury (TBI) trials. We evaluated several approaches to analyzing GOSE and a battery of four functional and cognitive measures. Using data from a randomized trial, we created a "super" dataset of 16,550 subjects from patients with complete data (n=331) and then simulated multiple treatment effects across multiple outcome measures. Patients were sampled with replacement (bootstrapping) to generate 10,000 samples for each treatment effect (n=400 patients/group). The percentage of samples where the null hypothesis was rejected estimates the power. All analytic techniques had appropriate rates of type I error (≤5%). Accounting for baseline prognosis either by using sliding dichotomy for GOSE or using regression-based methods substantially increased the power over the corresponding analysis without accounting for prognosis. Analyzing GOSE using multivariate proportional odds regression or analyzing the four-outcome battery with regression-based adjustments had the highest power, assuming equal treatment effect across all components. Analyzing GOSE using a fixed dichotomy provided the lowest power for both unadjusted and regression-adjusted analyses. We assumed an equal treatment effect for all measures. This may not be true in an actual clinical trial. Accounting for baseline prognosis is critical to attaining high power in Phase III TBI trials. The choice of primary outcome for future trials should be guided by power, the domain of brain function that an intervention is likely to impact, and the feasibility of collecting outcome data.

Longitudinal Multicenter Analysis of Outcomes After Cessation of Control Measures for Vancomycin-Resistant Enterococci.

PubMed

Lemieux, Camille; Gardam, Michael; Evans, Gerald; John, Michael; Suh, Kathryn N; vanWalraven, Carl; Vicencio, Elisa; Coulby, Cameron; Roth, Virginia; Hota, Susy

2017-01-01

OBJECTIVE To assess clinically relevant outcomes after complete cessation of control measures for vancomycin-resistant enterococci (VRE). DESIGN Quasi-experimental ecological study over 3.5 years. METHODS All VRE screening and isolation practices at 4 large academic hospitals in Ontario, Canada, were stopped on July 1, 2012. In total, 618 anonymized abstracted charts of patients with VRE-positive clinical isolates identified between July 1, 2010, and December 31, 2013, were reviewed to determine whether the case was a true VRE infection, a VRE colonization or contaminant, or a true VRE bacteremia. All deaths within 30 days of the last VRE infection were also reviewed to determine whether the death was fully or partially attributable to VRE. All-cause mortality was evaluated over the study period. Generalized estimating equation methods were used to cluster outcome rates within hospitals, and negative binomial models were created for each outcome. RESULTS The incidence rate ratio (IRR) for VRE infections was 0.59 and the associated P value was .34. For VRE bacteremias, the IRR was 0.54 and P=.38; for all-cause mortality the IRR was 0.70 and P=.66; and for VRE attributable death, the IRR was 0.35 and P=.49. VRE control measures were not significantly associated with any of the outcomes. Rates of all outcomes appeared to increase during the 18-month period after cessation of VRE control measures, but none reached statistical significance. CONCLUSION Clinically significant VRE outcomes remain rare. Cessation of all control measures for VRE had no significant attributable adverse clinical impact. Infect Control Hosp Epidemiol 2016;1-7.

Predicting well-being longitudinally for mothers rearing offspring with intellectual and developmental disabilities.

PubMed

Grein, K A; Glidden, L M

2015-07-01

Well-being outcomes for parents of children with intellectual and developmental disabilities (IDD) may vary from positive to negative at different times and for different measures of well-being. Predicting and explaining this variability has been a major focus of family research for reasons that have both theoretical and applied implications. The current study used data from a 23-year longitudinal investigation of adoptive and birth parents of children with IDD to determine which early child, mother and family characteristics would predict the variance in maternal outcomes 20 years after their original measurement. Using hierarchical regression analyses, we tested the predictive power of variables measured when children were 7 years old on outcomes of maternal well-being when children were 26 years old. Outcome variables included maternal self-report measures of depression and well-being. Final models of well-being accounted for 20% to 34% of variance. For most outcomes, Family Accord and/or the personality variable of Neuroticism (emotional stability/instability) were significant predictors, but some variables demonstrated a different pattern. These findings confirm that (1) characteristics of the child, mother and family during childhood can predict outcomes of maternal well-being 20 years later; and (2) different predictor-outcome relationships can vary substantially, highlighting the importance of using multiple measures to gain a more comprehensive understanding of maternal well-being. These results have implications for refining prognoses for parents and for tailoring service delivery to individual child, parent and family characteristics. © 2014 MENCAP and International Association of the Scientific Study of Intellectual and Developmental Disabilities and John Wiley & Sons Ltd.

Comparative Study of Outcome Measures and Analysis Methods for Traumatic Brain Injury Trials

PubMed Central

Alali, Aziz S.; Vavrek, Darcy; Barber, Jason; Dikmen, Sureyya; Nathens, Avery B.

2015-01-01

Abstract Batteries of functional and cognitive measures have been proposed as alternatives to the Extended Glasgow Outcome Scale (GOSE) as the primary outcome for traumatic brain injury (TBI) trials. We evaluated several approaches to analyzing GOSE and a battery of four functional and cognitive measures. Using data from a randomized trial, we created a “super” dataset of 16,550 subjects from patients with complete data (n=331) and then simulated multiple treatment effects across multiple outcome measures. Patients were sampled with replacement (bootstrapping) to generate 10,000 samples for each treatment effect (n=400 patients/group). The percentage of samples where the null hypothesis was rejected estimates the power. All analytic techniques had appropriate rates of type I error (≤5%). Accounting for baseline prognosis either by using sliding dichotomy for GOSE or using regression-based methods substantially increased the power over the corresponding analysis without accounting for prognosis. Analyzing GOSE using multivariate proportional odds regression or analyzing the four-outcome battery with regression-based adjustments had the highest power, assuming equal treatment effect across all components. Analyzing GOSE using a fixed dichotomy provided the lowest power for both unadjusted and regression-adjusted analyses. We assumed an equal treatment effect for all measures. This may not be true in an actual clinical trial. Accounting for baseline prognosis is critical to attaining high power in Phase III TBI trials. The choice of primary outcome for future trials should be guided by power, the domain of brain function that an intervention is likely to impact, and the feasibility of collecting outcome data. PMID:25317951