Sample records for account outcome measurements

  1. Network meta-analysis of multiple outcome measures accounting for borrowing of information across outcomes

    PubMed Central

    2014-01-01

    Background Network meta-analysis (NMA) enables simultaneous comparison of multiple treatments while preserving randomisation. When summarising evidence to inform an economic evaluation, it is important that the analysis accurately reflects the dependency structure within the data, as correlations between outcomes may have implication for estimating the net benefit associated with treatment. A multivariate NMA offers a framework for evaluating multiple treatments across multiple outcome measures while accounting for the correlation structure between outcomes. Methods The standard NMA model is extended to multiple outcome settings in two stages. In the first stage, information is borrowed across outcomes as well across studies through modelling the within-study and between-study correlation structure. In the second stage, we make use of the additional assumption that intervention effects are exchangeable between outcomes to predict effect estimates for all outcomes, including effect estimates on outcomes where evidence is either sparse or the treatment had not been considered by any one of the studies included in the analysis. We apply the methods to binary outcome data from a systematic review evaluating the effectiveness of nine home safety interventions on uptake of three poisoning prevention practices (safe storage of medicines, safe storage of other household products, and possession of poison centre control telephone number) in households with children. Analyses are conducted in WinBUGS using Markov Chain Monte Carlo (MCMC) simulations. Results Univariate and the first stage multivariate models produced broadly similar point estimates of intervention effects but the uncertainty around the multivariate estimates varied depending on the prior distribution specified for the between-study covariance structure. The second stage multivariate analyses produced more precise effect estimates while enabling intervention effects to be predicted for all outcomes, including

  2. Network meta-analysis of multiple outcome measures accounting for borrowing of information across outcomes.

    PubMed

    Achana, Felix A; Cooper, Nicola J; Bujkiewicz, Sylwia; Hubbard, Stephanie J; Kendrick, Denise; Jones, David R; Sutton, Alex J

    2014-07-21

    Network meta-analysis (NMA) enables simultaneous comparison of multiple treatments while preserving randomisation. When summarising evidence to inform an economic evaluation, it is important that the analysis accurately reflects the dependency structure within the data, as correlations between outcomes may have implication for estimating the net benefit associated with treatment. A multivariate NMA offers a framework for evaluating multiple treatments across multiple outcome measures while accounting for the correlation structure between outcomes. The standard NMA model is extended to multiple outcome settings in two stages. In the first stage, information is borrowed across outcomes as well across studies through modelling the within-study and between-study correlation structure. In the second stage, we make use of the additional assumption that intervention effects are exchangeable between outcomes to predict effect estimates for all outcomes, including effect estimates on outcomes where evidence is either sparse or the treatment had not been considered by any one of the studies included in the analysis. We apply the methods to binary outcome data from a systematic review evaluating the effectiveness of nine home safety interventions on uptake of three poisoning prevention practices (safe storage of medicines, safe storage of other household products, and possession of poison centre control telephone number) in households with children. Analyses are conducted in WinBUGS using Markov Chain Monte Carlo (MCMC) simulations. Univariate and the first stage multivariate models produced broadly similar point estimates of intervention effects but the uncertainty around the multivariate estimates varied depending on the prior distribution specified for the between-study covariance structure. The second stage multivariate analyses produced more precise effect estimates while enabling intervention effects to be predicted for all outcomes, including intervention effects on

  3. Spatial cluster detection for repeatedly measured outcomes while accounting for residential history.

    PubMed

    Cook, Andrea J; Gold, Diane R; Li, Yi

    2009-10-01

    Spatial cluster detection has become an important methodology in quantifying the effect of hazardous exposures. Previous methods have focused on cross-sectional outcomes that are binary or continuous. There are virtually no spatial cluster detection methods proposed for longitudinal outcomes. This paper proposes a new spatial cluster detection method for repeated outcomes using cumulative geographic residuals. A major advantage of this method is its ability to readily incorporate information on study participants relocation, which most cluster detection statistics cannot. Application of these methods will be illustrated by the Home Allergens and Asthma prospective cohort study analyzing the relationship between environmental exposures and repeated measured outcome, occurrence of wheeze in the last 6 months, while taking into account mobile locations.

  4. Toward graduate medical education (GME) accountability: measuring the outcomes of GME institutions.

    PubMed

    Chen, Candice; Petterson, Stephen; Phillips, Robert L; Mullan, Fitzhugh; Bazemore, Andrew; O'Donnell, Sarah D

    2013-09-01

    Graduate medical education (GME) plays a key role in the U.S. health care workforce, defining its overall size and specialty distribution and influencing physician practice locations. Medicare provides nearly $10 billion annually to support GME and faces growing policy maker interest in creating accountability measures. The purpose of this study was to develop and test candidate GME outcome measures related to physician workforce. The authors performed a secondary analysis of data from the American Medical Association Physician Masterfile, National Provider Identifier file, Medicare claims, and National Health Service Corps, measuring the number and percentage of graduates from 2006 to 2008 practicing in high-need specialties and underserved areas aggregated by their U.S. GME program. Average overall primary care production rate was 25.2% for the study period, although this is an overestimate because hospitalists could not be excluded. Of 759 sponsoring institutions, 158 produced no primary care graduates, and 184 produced more than 80%. An average of 37.9% of internal medicine residents were retained in primary care, including hospitalists. Mean general surgery retention was 38.4%. Overall, 4.8% of graduates practiced in rural areas; 198 institutions produced no rural physicians, and 283 institutions produced no Federally Qualified Health Center or Rural Health Clinic physicians. GME outcomes are measurable for most institutions and training sites. Specialty and geographic locations vary significantly. These findings can inform educators and policy makers during a period of increased calls to align the GME system with national health needs.

  5. Solutions for filling gaps in accountable care measure sets.

    PubMed

    Valuck, Tom; Dugan, Donna; Dubois, Robert W; Westrich, Kimberly; Penso, Jerry; McClellan, Mark

    2015-10-01

    A primary objective of accountable care is to support providers in reforming care to improve outcomes and lower costs. Gaps in accountable care measure sets may cause missed opportunities for improvement and missed signals of problems in care. Measures to balance financial incentives may be particularly important for high-cost conditions or specialty treatments. This study explored gaps in measure sets for specific conditions and offers strategies for more comprehensive measurement that do not necessarily require more measures. A descriptive analysis of measure gaps in accountable care programs and proposed solutions for filling the gaps. We analyzed gaps in 2 accountable care organization measure sets for 20 high-priority clinical conditions by comparing the measures in those sets with clinical guidelines and assessing the use of outcome measures. Where we identified gaps, we looked for existing measures to address the gaps. Gaps not addressed by existing measures were considered areas for measure development or measurement strategy refinement. We found measure gaps across all 20 conditions, including those conditions that are commonly addressed in current measure sets. In addition, we found many gaps that could not be filled by existing measures. Results across all 20 conditions informed recommendations for measure set improvement. Addressing all gaps in accountable care measure sets with more of the same types of measures and approaches to measurement would require an impractical number of measures and would miss the opportunity to use better measures and innovative approaches. Strategies for effectively filling measure gaps include using preferred measure types such as cross-cutting, outcome, and patient-reported measures. Program implementers should also apply new approaches to measurement, including layered and modular models.

  6. The Relationship of Rurality and Education Accountability Outcomes.

    ERIC Educational Resources Information Center

    Peevely, Gary; Ray, John R.

    This paper examines accountability outcomes of Tennessee school districts, comparing rural versus urban districts and litigant versus nonlitigant districts from a 1993 fiscal equity lawsuit. School districts were assigned a measure of rurality using the Cleland Rurality Index, and comparisons were made among the 29 low-rurality districts, 66…

  7. Could Learning Outcomes of the First Course in Accounting Predict Overall Academic Performance?

    ERIC Educational Resources Information Center

    Alanzi, Khalid A.; Alfraih, Mishari M.

    2017-01-01

    Purpose: This study aims to question whether learning outcomes of the first course in accounting could predict the overall academic performance of accounting students as measured by their graduating grade point average (GPA). Design/methodology/approach The sample of the present study was drawn from accounting students who were graduated during…

  8. Effects of Process and Outcome Accountability on Idea Generation.

    PubMed

    Häusser, Jan Alexander; Frisch, Johanna Ute; Wanzel, Stella; Schulz-Hardt, Stefan

    2017-07-01

    Previous research on the effects of outcome and process accountability on decision making has neglected the preceding phase of idea generation. We conducted a 2 (outcome accountability: yes vs. no) × 2 (process accountability: yes vs. no) experiment (N = 147) to test the effects of accountability on quantity and quality of generated ideas in a product design task. Furthermore, we examined potential negative side effects of accountability (i.e., stress and lengthened decision making). We found that (a) outcome accountability had a negative effect on quantity of ideas and (b) process accountability extended the idea generation process. Furthermore, any type of accountability (c) had a negative effect on uniqueness of ideas, (d) did not affect the quality of the idea that was selected, and (e) increased stress. Moreover, the negative effect of accountability on uniqueness of ideas was mediated by stress.

  9. Using an Accountability Tool to Improve the Quality of Outcomes on Individual Family Service Plans

    ERIC Educational Resources Information Center

    Votava, Kristen M.; Johnson, Carol; Chiasson, Kari

    2011-01-01

    This study investigated using a state's Part C early intervention accountability tool to increase the number of outcomes meeting compliance within IFSPs. The Case Review Tool (CRT) was used to examine differences from year one to year three on three measures of quality outcomes. There was no evidence of change in two of the measures, but there was…

  10. Distance Education in a Cost Accounting Course: Instruction, Interaction, and Multiple Measures of Learning Outcomes

    ERIC Educational Resources Information Center

    Chen, Clement C.; Jones, Keith T.; Moreland, Keith

    2010-01-01

    Students in online and traditional classroom sections of an intermediate-level cost accounting course responded to a survey about their experiences in the course. Specifically, several items related to the instruction and learning outcomes were addressed. Additionally, student examination performance in the two types of sections was compared. The…

  11. Prevention validation and accounting platform: a framework for establishing accountability and performance measures of substance abuse prevention programs.

    PubMed

    Kim, S; McLeod, J H; Williams, C; Hepler, N

    2000-01-01

    The field of substance abuse prevention has neither an overarching conceptual framework nor a set of shared terminologies for establishing the accountability and performance outcome measures of substance abuse prevention services rendered. Hence, there is a wide gap between what we currently have as data on one hand and information that are required to meet the performance goals and accountability measures set by the Government Performance and Results Act of 1993 on the other. The task before us is: How can we establish the accountability and performance measures of substance abuse prevention programs and transform the field of prevention into prevention science? The intent of this volume is to serve that purpose and accelerate the processes of this transformation by identifying the requisite components of the transformation (i.e., theory, methodology, convention on terms, and data) and by introducing an open forum called, Prevention Validation and Accounting (PREVA) Platform. The entire PREVA Platform (for short, the Platform) is designed as an analytic framework, which is formulated by a collectivity of common concepts, terminologies, accounting units, protocols for counting the units, data elements, and operationalizations of various constructs, and other summary measures intended to bring about an efficient and effective measurement of process input, program capacity, process output, performance outcome, and societal impact of substance abuse prevention programs. The measurement units and summary data elements are designed to be measured across time and across jurisdictions, i.e., from local to regional to state to national levels. In the Platform, the process input is captured by two dimensions of time and capital. Time is conceptualized in terms of service delivery time and time spent for research and development. Capital is measured by the monies expended for the delivery of program activities during a fiscal or reporting period. Program capacity is captured

  12. Accounting for therapist variability in couple therapy outcomes: what really matters?

    PubMed

    Owen, Jesse; Duncan, Barry; Reese, Robert Jeff; Anker, Morten; Sparks, Jacqueline

    2014-01-01

    This study examined whether therapist gender, professional discipline, experience conducting couple therapy, and average second-session alliance score would account for the variance in outcomes attributed to the therapist. The authors investigated therapist variability in couple therapy with 158 couples randomly assigned to and treated by 18 therapists in a naturalistic setting. Consistent with previous studies in individual therapy, in this study therapists accounted for 8.0% of the variance in client outcomes and 10% of the variance in client alliance scores. Therapist average alliance score and experience conducting couple therapy were salient predictors of client outcomes attributed to therapist. In contrast, therapist gender and discipline did not significantly account for the variance in client outcomes attributed to therapists. Tests of incremental validity demonstrated that therapist average alliance score and therapist experience uniquely accounted for the variance in outcomes attributed to the therapist. Emphasis on improving therapist alliance quality and specificity of therapist experience in couple therapy are discussed.

  13. Implementing Outcomes Based Accountability in Children's Services. Case Studies

    ERIC Educational Resources Information Center

    Bergeron, Caroline; Chamberlain, Tamsin; George, Nalia; Golden, Sarah; Mundy, Ellie; Southcott, Clare; Walker, Fiona

    2010-01-01

    Outcomes Based Accountability (OBA) is an approach that Children's Trusts and Children's Services can use to assist with planning services and assessing their performance. The OBA approach focuses on outcomes that are desired and monitoring and evidencing progress towards those desired outcomes. OBA makes a distinction between two types of…

  14. Evaluation of accountability measurements

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Cacic, C.G.

    The New Brunswick Laboratory (NBL) is programmatically responsible to the U.S. Department of Energy (DOE) Office of Safeguards and Security (OSS) for providing independent review and evaluation of accountability measurement technology in DOE nuclear facilities. This function is addressed in part through the NBL Safegaurds Measurement Evaluation (SME) Program. The SME Program utilizes both on-site review of measurement methods along with material-specific measurement evaluation studies to provide information concerning the adequacy of subject accountability measurements. This paper reviews SME Program activities for the 1986-87 time period, with emphasis on noted improvements in measurement capabilities. Continued evolution of the SME Programmore » to respond to changing safeguards concerns is discussed.« less

  15. Why Measure Outcomes?

    PubMed

    Kuhn, John E

    2016-01-01

    The concept of measuring the outcomes of treatment in health care was promoted by Ernest Amory Codman in the early 1900s, but, until recently, his ideas were generally ignored. The forces that have advanced outcome measurement to the forefront of health care include the shift in payers for health care from the patient to large insurance companies or government agencies, the movement toward assessing the care of populations not individuals, and the effort to find value (or cost-effective treatments) amid rising healthcare costs. No ideal method exists to measure outcomes, and the information gathered depends on the reason the outcome information is required. Outcome measures used in research are best able to answer research questions. The methods for assessing physician and hospital performance include process measures, patient-experience measures, structure measures, and measures used to assess the outcomes of treatment. The methods used to assess performance should be validated, be reliable, and reflect a patient's perception of the treatment results. The healthcare industry must measure outcomes to identify which treatments are most effective and provide the most benefit to patients.

  16. Measuring Student Learning Outcomes Using the SALG Instrument

    ERIC Educational Resources Information Center

    Scholl, Kathleen; Olsen, Heather M.

    2014-01-01

    U.S. higher education institutions are being called to question their central nature, priorities, and functions, with prominent and unprecedented attention being given to accountability and the measurement of student learning outcomes. As higher education evolves in how it assesses student learning and leisure studies and recreation departments…

  17. Adjusting for outcome misclassification: the importance of accounting for case-control sampling and other forms of outcome-related selection.

    PubMed

    Jurek, Anne M; Maldonado, George; Greenland, Sander

    2013-03-01

    Special care must be taken when adjusting for outcome misclassification in case-control data. Basic adjustment formulas using either sensitivity and specificity or predictive values (as with external validation data) do not account for the fact that controls are sampled from a much larger pool of potential controls. A parallel problem arises in surveys and cohort studies in which participation or loss is outcome related. We review this problem and provide simple methods to adjust for outcome misclassification in case-control studies, and illustrate the methods in a case-control birth certificate study of cleft lip/palate and maternal cigarette smoking during pregnancy. Adjustment formulas for outcome misclassification that ignore case-control sampling can yield severely biased results. In the data we examined, the magnitude of error caused by not accounting for sampling is small when population sensitivity and specificity are high, but increases as (1) population sensitivity decreases, (2) population specificity decreases, and (3) the magnitude of the differentiality increases. Failing to account for case-control sampling can result in an odds ratio adjusted for outcome misclassification that is either too high or too low. One needs to account for outcome-related selection (such as case-control sampling) when adjusting for outcome misclassification using external information. Copyright © 2013 Elsevier Inc. All rights reserved.

  18. A Systematic Review of Palliative Care Intervention Outcomes and Outcome Measures in Low-Resource Countries.

    PubMed

    Potts, Maryellen; Cartmell, Kathleen B; Nemeth, Lynne; Bhattacharjee, Gautam; Qanungo, Suparna

    2018-05-01

    To meet the growing need for palliative care in low-resource countries, palliative care programs should be evidence based and contextually appropriate. This study was conducted to synthesize the current evidence to guide future programmatic and research efforts. This systematic review evaluated palliative care outcome measures, outcomes, and interventions in low-resource countries. After title searches, abstracts and full-text articles were screened for inclusion. Data were extracted to report on intervention models, outcome measures used, and intervention outcomes. Eighteen papers were reviewed, reporting on interventions conducted across nine low-resource countries. These interventions evaluated home-based palliative care models; a community-managed model; palliative care integrated with hospitals, hospices, or HIV clinics; and models focused on patients' self-management. Three studies were randomized controlled trials. Other studies used nonrandomized trials, cohort studies, mixed methods, pre-post test evaluation, cost-accounting evaluation, and cross-sectional surveys. Thirteen studies measured physical outcomes, 10 using multidimensional instruments. Nine studies measured psychological outcomes, eight using multidimensional instruments. Nine studies measured social outcomes, seven using multidimensional instruments. Nine studies measured outcomes across multiple domains. Across outcomes evaluated, results were reported in the direction of benefit associated with palliative care interventions. Many palliative care intervention models exist to serve patients in low-resource countries. Yet, limited high-quality evidence from low-resource countries is available to document intervention outcomes. Rigorous experimental studies and greater measurement of multidimensional aspects of palliative care are needed to advance the science of palliative care in low-resource settings. Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier

  19. Outcomes measurement in hospitals: can the system change the organization?

    PubMed

    Linder, J C

    1992-01-01

    The U.S. health care industry is in crisis--a crisis of accountability. Many believe that improved information, especially outcomes information, is at least part of the solution. If this assessment is accurate, outcomes measurement could offer a powerful opportunity to help mold our dysfunctional health care machinery into an effective infrastructure. This article explores whether implementing an outcomes measurement system in a hospital compels this kind of change. It examines the experiences of 31 hospitals that implemented a market-leading outcomes measurement system. Despite its potential, MedisGroups did not compel important improvements in hospitals' quality of care or their internal practices. Hospitals found it particularly difficult to maintain momentum throughout implementation and to structure the system as a supporting tool, rather than a driving influence, in their pursuit of operating improvements.

  20. Comparative study of outcome measures and analysis methods for traumatic brain injury trials.

    PubMed

    Alali, Aziz S; Vavrek, Darcy; Barber, Jason; Dikmen, Sureyya; Nathens, Avery B; Temkin, Nancy R

    2015-04-15

    Batteries of functional and cognitive measures have been proposed as alternatives to the Extended Glasgow Outcome Scale (GOSE) as the primary outcome for traumatic brain injury (TBI) trials. We evaluated several approaches to analyzing GOSE and a battery of four functional and cognitive measures. Using data from a randomized trial, we created a "super" dataset of 16,550 subjects from patients with complete data (n=331) and then simulated multiple treatment effects across multiple outcome measures. Patients were sampled with replacement (bootstrapping) to generate 10,000 samples for each treatment effect (n=400 patients/group). The percentage of samples where the null hypothesis was rejected estimates the power. All analytic techniques had appropriate rates of type I error (≤5%). Accounting for baseline prognosis either by using sliding dichotomy for GOSE or using regression-based methods substantially increased the power over the corresponding analysis without accounting for prognosis. Analyzing GOSE using multivariate proportional odds regression or analyzing the four-outcome battery with regression-based adjustments had the highest power, assuming equal treatment effect across all components. Analyzing GOSE using a fixed dichotomy provided the lowest power for both unadjusted and regression-adjusted analyses. We assumed an equal treatment effect for all measures. This may not be true in an actual clinical trial. Accounting for baseline prognosis is critical to attaining high power in Phase III TBI trials. The choice of primary outcome for future trials should be guided by power, the domain of brain function that an intervention is likely to impact, and the feasibility of collecting outcome data.

  1. Comparative Study of Outcome Measures and Analysis Methods for Traumatic Brain Injury Trials

    PubMed Central

    Alali, Aziz S.; Vavrek, Darcy; Barber, Jason; Dikmen, Sureyya; Nathens, Avery B.

    2015-01-01

    Abstract Batteries of functional and cognitive measures have been proposed as alternatives to the Extended Glasgow Outcome Scale (GOSE) as the primary outcome for traumatic brain injury (TBI) trials. We evaluated several approaches to analyzing GOSE and a battery of four functional and cognitive measures. Using data from a randomized trial, we created a “super” dataset of 16,550 subjects from patients with complete data (n=331) and then simulated multiple treatment effects across multiple outcome measures. Patients were sampled with replacement (bootstrapping) to generate 10,000 samples for each treatment effect (n=400 patients/group). The percentage of samples where the null hypothesis was rejected estimates the power. All analytic techniques had appropriate rates of type I error (≤5%). Accounting for baseline prognosis either by using sliding dichotomy for GOSE or using regression-based methods substantially increased the power over the corresponding analysis without accounting for prognosis. Analyzing GOSE using multivariate proportional odds regression or analyzing the four-outcome battery with regression-based adjustments had the highest power, assuming equal treatment effect across all components. Analyzing GOSE using a fixed dichotomy provided the lowest power for both unadjusted and regression-adjusted analyses. We assumed an equal treatment effect for all measures. This may not be true in an actual clinical trial. Accounting for baseline prognosis is critical to attaining high power in Phase III TBI trials. The choice of primary outcome for future trials should be guided by power, the domain of brain function that an intervention is likely to impact, and the feasibility of collecting outcome data. PMID:25317951

  2. Performance testing accountability measurements

    DOE Office of Scientific and Technical Information (OSTI.GOV)

    Oldham, R.D.; Mitchell, W.G.; Spaletto, M.I.

    The New Brunswick Laboratory (NBL) provides assessment support to the DOE Operations Offices in the area of Material Control and Accountability (MC and A). During surveys of facilities, the Operations Offices have begun to request from NBL either assistance in providing materials for performance testing of accountability measurements or both materials and personnel to do performance testing. To meet these needs, NBL has developed measurement and measurement control performance test procedures and materials. The present NBL repertoire of performance tests include the following: (1) mass measurement performance testing procedures using calibrated and traceable test weights, (2) uranium elemental concentration (assay)more » measurement performance tests which use ampulated solutions of normal uranyl nitrate containing approximately 7 milligrams of uranium per gram of solution, and (3) uranium isotopic measurement performance tests which use ampulated uranyl nitrate solutions with enrichments ranging from 4% to 90% U-235. The preparation, characterization, and packaging of the uranium isotopic and assay performance test materials were done in cooperation with the NBL Safeguards Measurements Evaluation Program since these materials can be used for both purposes.« less

  3. Measuring Outcomes in Children's Services.

    ERIC Educational Resources Information Center

    Christner, Anne Marshall, Ed.

    Outcomes evaluation can provide program managers and clinical directors in child welfare, juvenile justice, child mental health, and child protective services the necessary tools for program quality assurance and accountability. This guide describes the outcomes evaluation process and provides a summary of articles and reports detailing current…

  4. Factors influencing the use of outcome measures in physical therapy practice.

    PubMed

    Wedge, Frances M; Braswell-Christy, Jennifer; Brown, Cynthia J; Foley, Kathleen T; Graham, Cecilia; Shaw, Sharon

    2012-02-01

    Use of outcome measures in physical therapy practice is central to evaluating the effectiveness of treatment interventions, providing accountability and addressing quality of physical therapy programs. There is limited discussion on barriers and facilitators to using outcome measures in physical therapy practice. The purpose of this study was to identify factors that influence a physical therapist when deciding to use outcome measures in clinical practice. Participants were 21 physical therapists, seven each from skilled nursing facilities, outpatient clinics, and inpatient rehabilitation facilities. A grounded theory approach was used for interview and data collection. Common themes were determined from the data and a theory developed to explain the rationale behind physical therapists' decisions to use or not use outcome measures in clinical practice. Three overlapping themes related to (1) concepts of time, (2) knowledge, and (3) facility culture were indentified as factors influencing the use of outcome measures. A fourth encompassing theme, professionalism, identified the value placed on the use of outcome measures in practice. Data revealed that therapists require more information on the outcome measures available, and this information needs to be easily accessible within the workplace. Therapists value information generated by using outcome measures in the clinical setting, but need information on what measures are available and psychometric properties. Information must be easily accessible and measures easy to use. Newer graduates and recent learners have a foundation in the use of outcome measures, but more needs to be done in the clinic and through continuing education to promote increased use and understanding.

  5. Un-"Chartered" Waters: Balancing Montessori Curriculum and Accountability Measures in a Charter School

    ERIC Educational Resources Information Center

    Scott, Catherine M.

    2017-01-01

    More than 6,000 charter schools exist in the United States, and of these 120 are Montessori charter schools. When studying charter school practices, researchers often examine issues such as performance accountability measures and effectiveness of charter school curricula. In doing so, the outcomes often overlook the challenges for teachers as they…

  6. Accounting Education: A Comparative Study of Perception of Learning Outcomes in Traditional and Online Delivery Systems

    ERIC Educational Resources Information Center

    Connor, Chun-Mei Lee

    2009-01-01

    As of 2007, over 20% of all higher education students in the U.S took at least one online course (Allen & Seaman, 2008), and over 200 universities offered some measure of online accounting courses (National Center for Education Statistics, 2008).This study compared the student learning outcomes of traditional and online delivery styles in…

  7. Welfare Recipiency and Savings Outcomes in Individual Development Accounts

    ERIC Educational Resources Information Center

    Zhan, Min; Sherraden, Michael; Schreiner, Mark

    2004-01-01

    The authors examined how welfare recipiency is associated with savings outcomes in individual development accounts (IDAs), a structured savings program for low-income people. They investigated whether welfare recipients can save if they are provided with incentives. Data for this study ore from the American Dream Demonstration (ADD), the first…

  8. Measurement of Religiosity/Spirituality in Adolescent Health Outcomes Research: Trends and Recommendations

    PubMed Central

    McGrady, Meghan E.; Rosenthal, Susan L.

    2010-01-01

    The relationship between religious/spiritual (R/S) factors and adolescent health outcomes has been studied for decades; however, the R/S measurement tools used may not be developmentally relevant for adolescents. A systematic literature review was conducted to review and evaluate trends in measuring R/S in adolescent health outcomes research. In this review a total of 100 articles met criteria for inclusion. Relatively few (n = 15) included adolescent-specific R/S measures or items accounting for developmentally relevant issues such as parental religiosity or age-appropriate language. Future R/S and health research with adolescents would be strengthened by incorporating developmentally relevant R/S measurement tools, psychometrics, and multidimensional measures. PMID:20127172

  9. Development, reliability, and validity of the Alberta Perinatal Stroke Project Parental Outcome Measure.

    PubMed

    Bemister, Taryn B; Brooks, Brian L; Kirton, Adam

    2014-07-01

    Perinatal stroke is a leading cause of cerebral palsy and lifelong disability, although parent and family outcomes have not yet been studied in this specific population. The Alberta Perinatal Stroke Project Parental Outcome Measure was developed as a 26-item questionnaire on the impact of perinatal stroke on parents and families. The items were derived from expert opinion and scientific literature on issues salient to parents of children with perinatal stroke, including guilt and blame, which are not well captured in existing measures of family impact. Data were collected from 82 mothers and 28 fathers who completed the Parental Outcome Measure and related questionnaires (mean age, 39.5 years; mean child age, 7.4 years). Analyses examined the Parental Outcome Measure's internal consistency, test-retest reliability, validity, and factor structure. The Parental Outcome Measure demonstrated three unique theoretical constructs: Psychosocial Impact, Guilt, and Blame. The Parental Outcome Measure has excellent internal consistency (Cronbach α = 0.91) and very good test-retest reliability more than 2-5 weeks (r = 0.87). Regarding validity, the Parental Outcome Measure is sensitive to condition severity, accounts for additional variance in parent outcomes, and strongly correlates with measures of anxiety, depression, stress, quality of life, family functioning, and parent adjustment. The Parental Outcome Measure contributes to the literature as the first brief measure of family impact designed for parents of children with perinatal stroke. Copyright © 2014 Elsevier Inc. All rights reserved.

  10. Outcome-Based Education and Student Learning in Managerial Accounting in Hong Kong

    ERIC Educational Resources Information Center

    Lui, Gladie; Shum, Connie

    2012-01-01

    Although Outcome-based Education has not been successful in public education in several countries, it has been successful in the medical fields in higher education in the U.S. The author implemented OBE in her Managerial Accounting course in H.K. Intended learning outcomes were mapped again Bloom's Cognitive Domain. Teaching and learning…

  11. Outcomes Assessment of Computer-Assisted Behavioral Objectives for Accounting Graduates.

    ERIC Educational Resources Information Center

    Moore, John W.; Mitchem, Cheryl E.

    1997-01-01

    Presents behavioral objectives for accounting students and an outcomes assessment plan with five steps: (1) identification and definition of student competencies; (2) selection of valid instruments; (3) integration of assessment and instruction; (4) determination of levels of assessment; and (5) attribution of improvements to the program. (SK)

  12. Volunteers in Circles of Support and Accountability Job Demands, Job Resources, and Outcome.

    PubMed

    Höing, Mechtild; Bogaerts, Stefan; Vogelvang, Bas

    2017-09-01

    In Circles of Support and Accountability (CoSA), volunteers support a medium- to high-risk sex offender in his process toward desistance by developing a long-term empathic relationship. More knowledge is needed about the impact of this work on volunteers themselves. In a sample of 40 Dutch CoSA volunteers-at the time constituting 37% of the national population of 108 then active CoSA volunteers-we measured outcome in terms of volunteer satisfaction, determination to continue, compassion satisfaction, burnout and secondary stress, vicarious growth, civic capacities, and professional skills. We explored theoretically derived predictors of positive and negative outcome, and conceptualized them within the Job Demands-Resources model (JD-R). Volunteers reported mainly positive effects, especially high levels of volunteer satisfaction, compassion satisfaction, and determination to continue. Results indicated that job demands and most of the internal job resources were of minor importance. External job resources, especially social support and connectedness, were associated with positive outcome. Connectedness mediated the effect of social support on compassion satisfaction.

  13. Redesigning Systems of School Accountability: A Multiple Measures Approach to Accountability and Support

    ERIC Educational Resources Information Center

    Bae, Soung

    2018-01-01

    The challenges facing our children in the 21st century are rapidly changing. As a result, schools bear a greater responsibility to prepare students for college, career, and life and must be held accountable for more than just testing and reporting on a narrow set of outcomes aimed at minimum levels of competency. Thus, scholars, educators, and…

  14. Insights into Learning Profiles and Learning Outcomes within Introductory Accounting

    ERIC Educational Resources Information Center

    Teixeira, Cláudia; Gomes, Delfina

    2017-01-01

    This paper reports an empirical study aiming to explore aspects of learning and studying introductory accounting in Portuguese higher education. It specifically provides insight into patterns of learning and learning outcomes. To do so, it draws on qualitative data collected from students' answers to a semi-structured interview about their…

  15. Circles of Support and Accountability for Sex Offenders: A Systematic Review of Outcomes.

    PubMed

    Clarke, Martin; Brown, Susan; Völlm, Birgit

    2017-08-01

    We conducted a systematic review of studies reporting on the effectiveness of Circles of Support and Accountability (Circles). Circles use volunteers to provide support for sex offenders living in the community. We searched 10 databases up to the end of 2013 and identified 3 relevant outcome studies. An additional 12 papers or reports were identified by searching reference lists, Google, and contacting key authors and Circles providers to obtain unpublished data. These 15 studies comprised one randomized controlled trial, three retrospective cohorts with matched controls, and 11 case series. The majority reported measures of recidivism, particularly reconviction. The 4 studies with controls generally reported that participation in Circles was associated with lower recidivism although there were few statistically significant differences. Few studies examined changes in risk or psychosocial outcomes. A number of methodological issues are discussed. Longer term, prospective follow-up studies with control groups are required to address these issues.

  16. Accounting for the Process of Disablement and Longitudinal Outcomes Among the Near Elderly and Elderly.

    PubMed

    Rupp, Kalman; Dushi, Irena

    2017-01-01

    Using a new disability measure applicable to both the near elderly and elderly population, we track respondents aged 51-61 in 1992 from the Health and Retirement Study and account for their status over 20 years. We demonstrate that to screen in as disabled and to screen out as nondisabled require different analytic strategies and use multiple indicators to establish three groups: disabled, nondisabled, and a residual category with ambiguous status. We use work-disability and Supplemental Security Income/Disability Insurance (SSI/DI) receipt for testing distributional outcomes and assessing face validity of our disability measure. Selective attrition due to death and institutionalization is substantial over 20 years. Persistent disability is the dominant adverse outcome of initial disability shock. Overtime exits due to death become progressively more important; 44% disabled at baseline are dead by Wave 11 compared to 21% for nondisabled. Disability status at baseline is associated with financial insecurity persisting to Wave 11 among survivors.

  17. Measuring public health practice and outcomes in chronic disease: a call for coordination.

    PubMed

    Porterfield, Deborah S; Rogers, Todd; Glasgow, LaShawn M; Beitsch, Leslie M

    2015-04-01

    A strategic opportunity exists to coordinate public health systems and services researchers' efforts to develop local health department service delivery measures and the efforts of divisions within the Centers for Disease Control and Prevention's National Center for Chronic Disease Prevention and Health Promotion (NCCDPHP) to establish outcome indicators for public health practice in chronic disease. Several sets of outcome indicators developed by divisions within NCCDPHP and intended for use by state programs can be tailored to assess outcomes of interventions within smaller geographic areas or intervention settings. Coordination of measurement efforts could potentially allow information to flow from the local to the state to the federal level, enhancing program planning, accountability, and even subsequent funding for public health practice.

  18. Measurement of health outcomes.

    PubMed

    Thavorncharoensap, Montarat

    2014-05-01

    Health outcomes are one of the most important components of health technology assessments (HTAs). All HTA outcomes should be measured from a relevant sample using a properly designed study and method. A number of recommendations on health outcome measurements are made in this second edition of Thailand's HTA guidelines. In particular the use of final outcomes, rather than surrogate outcomes, in HTAs is stressed. Where surrogate outcomes are used, strong justification and evidence must be provided. Effectiveness is preferred over efficacy. The relative treatment effect (the difference between health outcome that would be experienced by patients receiving the technology and that experienced by the same group were they to receive an alternative technology) should be derived from a systematic review of head-to-head RCTs. Mixed treatment comparison (MTC) should be used only to provide supplementary data that cannot be obtained from a head-to-head comparison. Where no direct comparison evidence exists, indirect comparison and observational study data can be used.

  19. Variations in data collection can influence outcome measures of BMI measuring programmes.

    PubMed

    Townsend, Nick; Rutter, Harry; Foster, Charlie

    2011-10-01

    The World Health Organization (WHO) promotes the surveillance of obesity prevalence through standardized and harmonized surveillance systems. However, variations in data collection between countries, or between coordinating regions in countries can affect outcome measures. Multilevel analysis of 2007/08 National Child Measurement Programme (NCMP) data estimating the relationship between BMI z-score and data collection variations within coordinating regions whilst adjusting for individual-level and school-level variables. The 2007/08 NCMP collected height and weight measurements for 478,381 Reception year pupils (4-5-year-olds) and 496,297 year 6 pupils (10-11-year-olds) from 17,279 primary schools in 152 data collection coordinating regions in England. Data collection variables accounted for 29.7% of the regional variation in BMI z-score for Reception year pupils but only 5.3% for the older Year 6 pupils. Digit preference in the rounding of weight measurements had the greatest impact of all the data collection variables, explaining 26.4% of the regional variation in BMI z-score for Reception year pupils and 4.0% for Year 6 pupils. Although variations in data collection may have a small effect on individual measurements their impact can be magnified when scaled up to regional or national figures. All measurement programmes must regularly identify and minimize variations in data collection to improve accuracy of outcome measures. These factors include those identified within this study: participation and opt out rates, the time in the year the measurements are taken and the recording of measurements to the correct decimal place.

  20. Hospitals' Internal Accountability

    PubMed Central

    Kraetschmer, Nancy; Jass, Janak; Woodman, Cheryl; Koo, Irene; Kromm, Seija K.; Deber, Raisa B.

    2014-01-01

    This study aimed to enhance understanding of the dimensions of accountability captured and not captured in acute care hospitals in Ontario, Canada. Based on an Ontario-wide survey and follow-up interviews with three acute care hospitals in the Greater Toronto Area, we found that the two dominant dimensions of hospital accountability being reported are financial and quality performance. These two dimensions drove both internal and external reporting. Hospitals' internal reports typically included performance measures that were required or mandated in external reports. Although respondents saw reporting as a valuable mechanism for hospitals and the health system to monitor and track progress against desired outcomes, multiple challenges with current reporting requirements were communicated, including the following: 58% of survey respondents indicated that performance-reporting resources were insufficient; manual data capture and performance reporting were prevalent, with the majority of hospitals lacking sophisticated tools or technology to effectively capture, analyze and report performance data; hospitals tended to focus on those processes and outcomes with high measurability; and 53% of respondents indicated that valuable cross-system accountability, performance measures or both were not captured by current reporting requirements. PMID:25305387

  1. Accounting for measurement reliability to improve the quality of inference in dental microhardness research: a worked example.

    PubMed

    Sever, Ivan; Klaric, Eva; Tarle, Zrinka

    2016-07-01

    Dental microhardness experiments are influenced by unobserved factors related to the varying tooth characteristics that affect measurement reproducibility. This paper explores the appropriate analytical tools for modeling different sources of unobserved variability to reduce the biases encountered and increase the validity of microhardness studies. The enamel microhardness of human third molars was measured by Vickers diamond. The effects of five bleaching agents-10, 16, and 30 % carbamide peroxide, and 25 and 38 % hydrogen peroxide-were examined, as well as the effect of artificial saliva and amorphous calcium phosphate. To account for both between- and within-tooth heterogeneity in evaluating treatment effects, the statistical analysis was performed in the mixed-effects framework, which also included the appropriate weighting procedure to adjust for confounding. The results were compared to those of the standard ANOVA model usually applied. The weighted mixed-effects model produced the parameter estimates of different magnitude and significance than the standard ANOVA model. The results of the former model were more intuitive, with more precise estimates and better fit. Confounding could seriously bias the study outcomes, highlighting the need for more robust statistical procedures in dental research that account for the measurement reliability. The presented framework is more flexible and informative than existing analytical techniques and may improve the quality of inference in dental research. Reported results could be misleading if underlying heterogeneity of microhardness measurements is not taken into account. The confidence in treatment outcomes could be increased by applying the framework presented.

  2. Retail price as an outcome measure for the effectiveness of drug law enforcement.

    PubMed

    Bright, David A; Ritter, Alison

    2010-09-01

    One outcome measure of law enforcement effectiveness is the reduction in drug consumption which occurs as a result of law enforcement interventions. A theoretical relationship between drug consumption and retail price has promoted the use of retail price as a surrogate measure for consumption. In the current article, retail price is examined as a potential outcome measure for the effectiveness of law enforcement. The predictions regarding the relationship between law enforcement intensity and price are only partially supported by research. Explanations for the disconnect between the drug law enforcement activity and retail price include: rapid adaptation by market players, enforcement swamping, assumptions of rational actors, short-run versus long-run effects, structure of the illicit market, simultaneous changes that affect price in perverse ways, the role of violence in markets, and data limitations. Researchers who use retail price as an outcome measure need to take into account the complex relationship between drug law enforcement interventions and the retail price of illicit drugs. Viable outcome measures which can be used as complements to retail price are worth investigation. Copyright 2009 Elsevier B.V. All rights reserved.

  3. Online versus Face-to-Face Accounting Education: A Comparison of CPA Exam Outcomes across Matched Institutions

    ERIC Educational Resources Information Center

    Morgan, John Daniel

    2015-01-01

    Programmatic-level comparisons are made between the certified public accountant (CPA) exam outcomes of two types of accounting programs: online or distance accounting programs and face-to-face or classroom accounting programs. After matching programs from each group on student selectivity at admission, the two types of programs are compared on CPA…

  4. How to select outcome measurement instruments for outcomes included in a "Core Outcome Set" - a practical guideline.

    PubMed

    Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; Boers, Maarten; Tugwell, Peter; Clarke, Mike; Williamson, Paula R; Terwee, Caroline B

    2016-09-13

    In cooperation with the Core Outcome Measures in Effectiveness Trials (COMET) initiative, the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) initiative aimed to develop a guideline on how to select outcome measurement instruments for outcomes (i.e., constructs or domains) included in a "Core Outcome Set" (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. Informed by a literature review to identify potentially relevant tasks on outcome measurement instrument selection, a Delphi study was performed among a panel of international experts, representing diverse stakeholders. In three consecutive rounds, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments, to justify their choices, and to add other relevant tasks. Consensus was defined as being achieved when 70 % or more of the panelists agreed and when fewer than 15 % of the panelists disagreed. Of the 481 invited experts, 120 agreed to participate of whom 95 (79 %) completed the first Delphi questionnaire. We reached consensus on four main steps in the selection of outcome measurement instruments for COS: Step 1, conceptual considerations; Step 2, finding existing outcome measurement instruments, by means of a systematic review and/or a literature search; Step 3, quality assessment of outcome measurement instruments, by means of the evaluation of the measurement properties and feasibility aspects of outcome measurement instruments; and Step 4, generic recommendations on the selection of outcome measurement instruments for outcomes included in a COS (consensus ranged from 70 to 99 %). This study resulted in a consensus-based guideline on the methods for selecting outcome measurement instruments for outcomes included in a COS. This guideline can be used by COS developers in defining how to measure core outcomes.

  5. Use of continuous glucose monitoring as an outcome measure in clinical trials.

    PubMed

    Beck, Roy W; Calhoun, Peter; Kollman, Craig

    2012-10-01

    Although developed to be a management tool for individuals with diabetes, continuous glucose monitoring (CGM) also has potential value for the assessment of outcomes in clinical studies. We evaluated using CGM as such an outcome measure. Data were analyzed from six previously completed inpatient studies in which both CGM (Freestyle Navigator™ [Abbott Diabetes Care, Alameda, CA] or Guardian(®) [Medtronic, Northridge, CA]) and reference glucose measurements were available. The analyses included 97 days of data from 93 participants with type 1 diabetes (age range, 5-57 years; mean, 18 ± 12 years). Mean glucose levels per day were similar for the CGM and reference measurements (median, 148 mg/dL vs. 143 mg/dL, respectively; P = 0.92), and the correlation of the two was high (r = 0.89). Similarly, most glycemia metrics showed no significant differences comparing CGM and reference values, except that the nadir glucose tended to be slightly lower and peak glucose slightly higher with reference measurements than CGM measurements (respective median, 59 mg/dL vs. 66 mg/dL [P = 0.05] and 262 mg/dL vs. 257 mg/dL [P = 0.003]) and glucose variability as measured with the coefficient of variation was slightly lower with CGM than reference measurements (respective median, 31% vs. 35%; P<0.001). A reasonably high degree of concordance exists when comparing outcomes based on CGM measurements with outcomes based on reference blood glucose measurements. CGM inaccuracy and underestimation of the extremes of hyperglycemia and hypoglycemia can be accounted for in a clinical trial's study design. Thus, in appropriate settings, CGM can be a very meaningful and feasible outcome measure for clinical trials.

  6. 50 CFR 648.143 - Black sea bass Accountability Measures.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 50 Wildlife and Fisheries 12 2014-10-01 2014-10-01 false Black sea bass Accountability Measures... Management Measures for the Black Sea Bass Fishery § 648.143 Black sea bass Accountability Measures. (a... based on dealer reports, state data, and other available information. All black sea bass landed for sale...

  7. 50 CFR 648.143 - Black sea bass Accountability Measures.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 50 Wildlife and Fisheries 12 2013-10-01 2013-10-01 false Black sea bass Accountability Measures... Management Measures for the Black Sea Bass Fishery § 648.143 Black sea bass Accountability Measures. (a... based on dealer reports, state data, and other available information. All black sea bass landed for sale...

  8. 50 CFR 648.143 - Black sea bass Accountability Measures.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 50 Wildlife and Fisheries 12 2012-10-01 2012-10-01 false Black sea bass Accountability Measures... Management Measures for the Black Sea Bass Fishery § 648.143 Black sea bass Accountability Measures. (a... based on dealer reports, state data, and other available information. All black sea bass landed for sale...

  9. The role of outputs and outcomes in purchaser accountability: reflecting on New Zealand experiences.

    PubMed

    Cumming, J; Scott, C D

    1998-10-01

    Recent reforms in a number of countries' health systems have led to the separation of funder, purchaser and provider roles and the strengthening of funders' and purchasers' positions relative to providers. One of the aims of such reforms is to improve accountability. This paper reports on experiences in New Zealand where, in addition to improving the accountability of providers, purchaser accountability has also been a key policy issue. Attempts have been made in New Zealand to develop a funder-purchaser accountability framework based on a mix of outcomes, outputs and inputs. This paper discusses the roles that each might play in contracts and accountability relationships between funders and purchasers. The paper concludes that holding purchasers accountable for outcomes is likely to prove difficult and controversial, because of problems of attribution and because New Zealand funders in recent years have played an important role in determining the priority outputs and inputs which must be purchased. The paper suggests that accountability is more appropriate at the output and process level, in addition to holding purchasers accountable for the ways in which they make decisions and undertake contracting roles. Holding purchasers accountable for purchasing outputs and processes, however, requires greater commitment on the part of the funder to setting priorities more clearly; specifying the range and level of outputs to be purchased and the terms of access to those services; and funding services to this level. The international attention currently being paid to the development of practice guidelines and priority criteria also suggests that holding purchasers accountable for a form of inputs may become an increasingly common practice in future. From 1 July 1998, New Zealand will introduce a priority criteria system for determining access to elective surgery; accountability is thus becoming focused on inputs in the form of patient characteristics. This approach will

  10. Use of Continuous Glucose Monitoring as an Outcome Measure in Clinical Trials

    PubMed Central

    Calhoun, Peter; Kollman, Craig

    2012-01-01

    Abstract Objective Although developed to be a management tool for individuals with diabetes, continuous glucose monitoring (CGM) also has potential value for the assessment of outcomes in clinical studies. We evaluated using CGM as such an outcome measure. Research Design and Methods Data were analyzed from six previously completed inpatient studies in which both CGM (Freestyle Navigator™ [Abbott Diabetes Care, Alameda, CA] or Guardian® [Medtronic, Northridge, CA]) and reference glucose measurements were available. The analyses included 97 days of data from 93 participants with type 1 diabetes (age range, 5–57 years; mean, 18±12 years). Results Mean glucose levels per day were similar for the CGM and reference measurements (median, 148 mg/dL vs. 143 mg/dL, respectively; P=0.92), and the correlation of the two was high (r=0.89). Similarly, most glycemia metrics showed no significant differences comparing CGM and reference values, except that the nadir glucose tended to be slightly lower and peak glucose slightly higher with reference measurements than CGM measurements (respective median, 59 mg/dL vs. 66 mg/dL [P=0.05] and 262 mg/dL vs. 257 mg/dL [P=0.003]) and glucose variability as measured with the coefficient of variation was slightly lower with CGM than reference measurements (respective median, 31% vs. 35%; P<0.001). Conclusions A reasonably high degree of concordance exists when comparing outcomes based on CGM measurements with outcomes based on reference blood glucose measurements. CGM inaccuracy and underestimation of the extremes of hyperglycemia and hypoglycemia can be accounted for in a clinical trial's study design. Thus, in appropriate settings, CGM can be a very meaningful and feasible outcome measure for clinical trials. PMID:23013201

  11. Sustaining Reliability on Accountability Measures at The Johns Hopkins Hospital.

    PubMed

    Pronovost, Peter J; Holzmueller, Christine G; Callender, Tiffany; Demski, Renee; Winner, Laura; Day, Richard; Austin, J Matthew; Berenholtz, Sean M; Miller, Marlene R

    2016-02-01

    In 2012 Johns Hopkins Medicine leaders challenged their health system to reliably deliver best practice care linked to nationally vetted core measures and achieve The Joint Commission Top Performer on Key Quality Measures ®program recognition and the Delmarva Foundation award. Thus, the Armstrong Institute for Patient Safety and Quality implemented an initiative to ensure that ≥96% of patients received care linked to measures. Nine low-performing process measures were targeted for improvement-eight Joint Commission accountability measures and one Delmarva Foundation core measure. In the initial evaluation at The Johns Hopkins Hospital, all accountability measures for the Top Performer program reached the required ≥95% performance, gaining them recognition by The Joint Commission in 2013. Efforts were made to sustain performance of accountability measures at The Johns Hopkins Hospital. Improvements were sustained through 2014 using the following conceptual framework: declare and communicate goals, create an enabling infrastructure, engage clinicians and connect them in peer learning communities, report transparently, and create accountability systems. One part of the accountability system was for teams to create a sustainability plan, which they presented to senior leaders. To support sustained improvements, Armstrong Institute leaders added a project management office for all externally reported quality measures and concurrent reviewers to audit performance on care processes for certain measure sets. The Johns Hopkins Hospital sustained performance on all accountability measures, and now more than 96% of patients receive recommended care consistent with nationally vetted quality measures. The initiative methods enabled the transition of quality improvement from an isolated project to a way of leading an organization.

  12. A view from health services research and outcomes measurement.

    PubMed

    Sales, Anne E

    2007-01-01

    Depicted in this presentation is the relationship of the aims of the original articles in this issue--using theory in a substantive way; introducing a strong focus on the organization as a contributor to patient, provider, and system outcomes; accounting for organizational level; and moving the field toward a view of research utilization as an intermediate, not terminal, outcome--to outcomes research in health services generally and in nursing health services research more specifically. The insights and innovations described in this set of articles contribute significantly to the literature on research use in healthcare, specifically including the need to account more fully for organizational structure and hierarchy than has been the case to date in health services outcomes research, as well as a strong intimation that research use is not only an important intervening variable in the causal chain producing outcomes at the patient, provider, and system levels but also a latent or unobservable variable.

  13. Outcome Based Budgeting: Connecting Budget Development, Allocation and Outcomes.

    ERIC Educational Resources Information Center

    Anderes, Thomas

    This plan for outcome-based budgeting (OBB) is the result of growing demands for increased fiscal accountability, measurable outcomes, strengthened assessment processes, and more meaningful performance indicators as mandated by many State and Federal legislators. OBB focuses on linking funding with outputs and outcomes. Higher education…

  14. 42 CFR 410.146 - Diabetes outcome measurements.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 42 Public Health 2 2011-10-01 2011-10-01 false Diabetes outcome measurements. 410.146 Section 410... MEDICARE PROGRAM SUPPLEMENTARY MEDICAL INSURANCE (SMI) BENEFITS Outpatient Diabetes Self-Management Training and Diabetes Outcome Measurements § 410.146 Diabetes outcome measurements. (a) Information...

  15. 42 CFR 410.146 - Diabetes outcome measurements.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 42 Public Health 2 2014-10-01 2014-10-01 false Diabetes outcome measurements. 410.146 Section 410... MEDICARE PROGRAM SUPPLEMENTARY MEDICAL INSURANCE (SMI) BENEFITS Outpatient Diabetes Self-Management Training and Diabetes Outcome Measurements § 410.146 Diabetes outcome measurements. (a) Information...

  16. 42 CFR 410.146 - Diabetes outcome measurements.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... 42 Public Health 2 2012-10-01 2012-10-01 false Diabetes outcome measurements. 410.146 Section 410... MEDICARE PROGRAM SUPPLEMENTARY MEDICAL INSURANCE (SMI) BENEFITS Outpatient Diabetes Self-Management Training and Diabetes Outcome Measurements § 410.146 Diabetes outcome measurements. (a) Information...

  17. 42 CFR 410.146 - Diabetes outcome measurements.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... 42 Public Health 2 2013-10-01 2013-10-01 false Diabetes outcome measurements. 410.146 Section 410... MEDICARE PROGRAM SUPPLEMENTARY MEDICAL INSURANCE (SMI) BENEFITS Outpatient Diabetes Self-Management Training and Diabetes Outcome Measurements § 410.146 Diabetes outcome measurements. (a) Information...

  18. 42 CFR 410.146 - Diabetes outcome measurements.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... 42 Public Health 2 2010-10-01 2010-10-01 false Diabetes outcome measurements. 410.146 Section 410... MEDICARE PROGRAM SUPPLEMENTARY MEDICAL INSURANCE (SMI) BENEFITS Outpatient Diabetes Self-Management Training and Diabetes Outcome Measurements § 410.146 Diabetes outcome measurements. (a) Information...

  19. Standardized Outcome Measurement for Patients With Coronary Artery Disease: Consensus From the International Consortium for Health Outcomes Measurement (ICHOM).

    PubMed

    McNamara, Robert L; Spatz, Erica S; Kelley, Thomas A; Stowell, Caleb J; Beltrame, John; Heidenreich, Paul; Tresserras, Ricard; Jernberg, Tomas; Chua, Terrance; Morgan, Louise; Panigrahi, Bishnu; Rosas Ruiz, Alba; Rumsfeld, John S; Sadwin, Lawrence; Schoeberl, Mark; Shahian, David; Weston, Clive; Yeh, Robert; Lewin, Jack

    2015-05-19

    Coronary artery disease (CAD) outcomes consistently improve when they are routinely measured and provided back to physicians and hospitals. However, few centers around the world systematically track outcomes, and no global standards exist. Furthermore, patient-centered outcomes and longitudinal outcomes are under-represented in current assessments. The nonprofit International Consortium for Health Outcomes Measurement (ICHOM) convened an international Working Group to define a consensus standard set of outcome measures and risk factors for tracking, comparing, and improving the outcomes of CAD care. Members were drawn from 4 continents and 6 countries. Using a modified Delphi method, the ICHOM Working Group defined who should be tracked, what should be measured, and when such measurements should be performed. The ICHOM CAD consensus measures were designed to be relevant for all patients diagnosed with CAD, including those with acute myocardial infarction, angina, and asymptomatic CAD. Thirteen specific outcomes were chosen, including acute complications occurring within 30 days of acute myocardial infarction, coronary artery bypass grafting surgery, or percutaneous coronary intervention; and longitudinal outcomes for up to 5 years for patient-reported health status (Seattle Angina Questionnaire [SAQ-7], elements of Rose Dyspnea Score, and Patient Health Questionnaire [PHQ-2]), cardiovascular hospital admissions, cardiovascular procedures, renal failure, and mortality. Baseline demographic, cardiovascular disease, and comorbidity information is included to improve the interpretability of comparisons. ICHOM recommends that this set of outcomes and other patient information be measured for all patients with CAD. © 2015 The Authors. Published on behalf of the American Heart Association, Inc., by Wiley Blackwell.

  20. Multiple Measures Accountability Systems: A Perspective from Vermont

    ERIC Educational Resources Information Center

    Fowler, Amy

    2018-01-01

    In response to Bae's (2018) "Redesigning systems of school accountability: A multiple measures approach to accountability and support," this commentary expands on some key considerations for states and school districts as they seek different ways to support school improvement while also addressing the competing demands of educators,…

  1. Outcome measurement in Australian rehabilitation environments.

    PubMed

    Douglas, Heather; Swanson, Cheryl; Gee, Travis; Bellamy, Nicholas

    2005-09-01

    To determine the frequency and pattern of methods of outcome assessment used in Australian physical rehabilitation environments. Postal survey. A questionnaire on service type, staffing, numbers of adults treated and outcome measures used for 7 conditions related to injury and road trauma as well as stroke and neuromuscular disorders was sent to 973 services providing adult physical rehabilitation treatment. Questionnaires were completed by 440 service providers for a response rate of 45%, similar to that reported in a recent European survey reported in this journal. A small number of measures were reported as in use by most respondents, while a large number of measures were used by a few respondents. Measures of physical changes were used more frequently than those of generic well-being or quality of life. Ease of use and reporting to other professionals were cited as the most important reasons in selection of outcome measures. This Australian-wide survey detected considerable heterogeneity in outcome measurement procedures used in rehabilitation environments. While the goal of measurement may vary between providers and differ between conditions, the results highlight opportunities for harmonization, bench-marking and measurement of health-related quality of life.

  2. 50 CFR 648.293 - Tilefish accountability measures.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... Measures for the Tilefish Fishery § 648.293 Tilefish accountability measures. (a) If the ACL is exceeded, the amount of the ACL overage that cannot be directly attributed to IFQ allocation holders having exceeded their IFQ allocation will be deducted from the ACL in the following fishing year. All overages...

  3. 50 CFR 648.293 - Tilefish accountability measures.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... Measures for the Tilefish Fishery § 648.293 Tilefish accountability measures. (a) If the ACL is exceeded, the amount of the ACL overage that cannot be directly attributed to IFQ allocation holders having exceeded their IFQ allocation will be deducted from the ACL in the following fishing year. All overages...

  4. 50 CFR 648.293 - Tilefish accountability measures.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... Measures for the Tilefish Fishery § 648.293 Tilefish accountability measures. (a) If the ACL is exceeded, the amount of the ACL overage that cannot be directly attributed to IFQ allocation holders having exceeded their IFQ allocation will be deducted from the ACL in the following fishing year. All overages...

  5. Measuring outcomes in children's rehabilitation: a decision protocol.

    PubMed

    Law, M; King, G; Russell, D; MacKinnon, E; Hurley, P; Murphy, C

    1999-06-01

    To develop and test the feasibility and clinical utility of a computerized self-directed software program designed to enable service providers in children's rehabilitation to make decisions about the most appropriate outcome measures to use in client and program evaluation. A before-and-after design was used to test the feasibility and initial impact of the decision-making outcome software in improving knowledge and use of clinical outcome measures. A children's rehabilitation center in a city of 50,000. All service providers in the children's rehabilitation center. Disciplines represented included early childhood education, occupational therapy, physical therapy, speech and language pathology, audiology, social work, and psychology. Using a conceptual framework based on the International Classification of Impairment, Disability, and Handicap (ICIDH), an outcome measurement decision-making protocol was developed. The decision-making protocol was computerized in an educational software program with an attached database of critically appraised measures. Participants learned about outcome measures through the program and selected outcome measures that met their specifications. The computer software was tested for feasibility in the children's rehabilitation center for 6 months. Knowledge and use of clinical outcome measures were determined before and after the feasibility testing using a survey of all service providers currently at the centre and audits of 30 randomly selected rehabilitation records (at pretest, posttest, and follow-up). Service providers indicated that the outcomes software was easy to follow and believed that the use of the ICIDH framework helped them in making decisions about selecting outcome measures. Results of the survey indicated that there were significant changes in the service providers' level of comfort with selecting measures and knowing what measures were available. Use of outcome measures as identified through the audit did not change

  6. Measuring outcomes of community aged care programs: challenges, opportunities and the Australian Community Outcomes Measurement ACCOM tool.

    PubMed

    Cardona, Beatriz

    2018-05-29

    Measuring health and wellbeing outcomes of community aged care programs is a complex task given the diverse settings in which care takes place and the intersection of numerous factors affecting an individual's quality of life outcomes. Knowledge of a strong causal relationship between services provided and the final outcome enables confidence in assuming the care provided was largely responsible for the outcome achieved (Courtney et al., Aust J Adv Nurs 26:49-57, 2009). The Department of Health has recently reported on the findings of The National Aged Care Quality Indicator Program - Home Care Pilot (KPMG, National Aged Care Quality Indicator Program - Home Care Pilot, 2017). The Program sought to test various tools to measure quality of life outcomes of their community aged care programs. Some of the key issues raised in the study reiterate the findings from The Australian Community Care Outcome Measurement (ACCOM) pilot study (Cardona et al., Australas J Ageing 36: 69-71, 2017), including the value of the ASCOT SCT4 tool (Adult Social care Outcomes Toolkit, http://www.pssru.ac.uk/ascot/downloads/questionnaires/sct4.pdf ) to measure social care related quality of life (SCRQoL) in community aged care programs in the Australian context, the collection of additional data to map the relationship of various variables such as functional ability, demographic characteristics and quality of life scores and the governance and administration of measurement tools for the purpose of quality reporting and consumer choice.

  7. Measurement properties of outcome measures for vitiligo. A systematic review.

    PubMed

    Vrijman, Charlotte; Linthorst Homan, May W; Limpens, Jacqueline; van der Veen, Wietze; Wolkerstorfer, Albert; Terwee, Caroline B; Spuls, Phyllis I

    2012-11-01

    OBJECTIVE To summarize and critically appraise the evidence on the measurement properties of clinician-, patient-, and observer-reported outcomes, measuring any construct of interest in patients with all types of vitiligo. DATA SOURCES Electronic databases including PubMed (1948 to July 2011), OVID EMBASE (1980 to July 2011), and CINAHL (EBSCOhost) (1982 to July 2011) were searched. STUDY SELECTION Two authors independently screened all records for eligibility. For inclusion, the study population had to include patients with vitiligo, for which outcome measures were developed or evaluated on their measurement properties. The initial search retrieved 1249 records, of which 14 articles met the inclusion criteria. DATA EXTRACTION Characteristics of the included instruments, study population, and results of the measurement properties were extracted. The Consensus-Based Standards for the Selection of Health Status Measurement Instruments (COSMIN) 4-point checklist, combined with quality criteria for measurement properties, was used to calculate the overall level of evidence per measurement property of each instrument. Independent extraction and assessment was performed by 2 authors. DATA SYNTHESIS Eleven different measurement instruments were identified. Strong evidence was found for a positive internal consistency of the Dermatology Life Quality Index. For other instruments, the evidence of measurement properties was limited or unknown. CONCLUSIONS Recommendations on the use of specific outcome measures for vitiligo should be formulated with caution because current evidence is insufficient owing to a low number of studies with poor methodological quality and unclear clinical relevance. To recommend outcome measures for vitiligo, further research on measurement properties of clinical relevant outcome measures for vitiligo according to COSMIN quality criteria is needed.

  8. Patient population management: taking the leap from variance analysis to outcomes measurement.

    PubMed

    Allen, K M

    1998-01-01

    Case managers today at BCHS have a somewhat different role than at the onset of the Collaborative Practice Model. They are seen throughout the organization as: Leaders/participants on cross-functional teams. Systems change agents. Integrating/merging with quality services and utilization management. Outcomes managers. One of the major cross-functional teams is in the process of designing a Care Coordinator role. These individuals will, as one of their functions, assume responsibility for daily patient care management activities. A variance tracking program has come into the Utilization Management (UM) department as part of a software package purchased to automate UM work activities. This variance program could potentially be used by the new care coordinators as the role develops. The case managers are beginning to use a Decision Support software, (Transition Systems Inc.) in the collection of data that is based on a cost accounting system and linked to clinical events. Other clinical outcomes data bases are now being used by the case manager to help with the collection and measurement of outcomes information. Hoshin planning will continue to be a framework for defining and setting the targets for clinical and financial improvements throughout the organization. Case managers will continue to be involved in many of these system-wide initiatives. In the words of Galileo, 1579, "You need to count what's countable, measure what's measurable, and what's not measurable, make measurable."

  9. Rethinking exploitation: a process-centered account.

    PubMed

    Jansen, Lynn A; Wall, Steven

    2013-12-01

    Exploitation has become an important topic in recent discussions of biomedical and research ethics. This is due in no small measure to the influence of Alan Wertheimer's path-breaking work on the subject. This paper presents some objections to Wertheimer's account of the concept. The objections attempt to show that his account places too much emphasis on outcome-based considerations and too little on process-based considerations. Building on these objections, the paper develops an alternative process-centered account of the concept. This alternative account of exploitation takes as its point of departure the broadly Kantian notion that it is wrong to use another as an instrument for the advancement of one's own ends. It sharpens this slippery notion and adds a number of refinements to it. The paper concludes by arguing that process-centered accounts of exploitation better illuminate the ethical challenges posed by research on human subjects than outcome-centered accounts.

  10. Accountability for the Quality of Care Provided to People with Serious Illness

    PubMed Central

    Hudson Scholle, Sarah; Briefer French, Jessica

    2018-01-01

    Abstract Background: Care for patients with serious illness is an emerging practice area that has gained attention as value-based purchasing has increased. While the number of programs is growing, their impact on care quality and outcomes is unknown. Objective: With support from the Gordon and Betty Moore Foundation, the National Committee for Quality Assurance (NCQA) is assessing the feasibility of creating an accountability program focused on serious illness care. Methods: This article describes the process of developing an accountability program, findings from our initial work, and our plans to develop measures for a serious illness care accountability program. We focused on three questions: 1. What patient populations should be targeted for measurement?2. What entities have accountability for ensuring high-quality care for serious illness?3. What structures, processes, and outcomes should be evaluated in an accountability program for serious illness care? Results: Our environmental scan showed that the evidence base for specific patient populations or care models is not sufficiently mature to justify traditional structure and process measures. In visits to serious illness care programs, we observed different staffing models, care models, care settings, and payment structures. We found a gap between recommended inclusion criteria and services when compared to inclusion criteria and services offered by existing programs. Conclusions: To address the challenges, NCQA intends to develop outcome measures driven by patient and family priorities. Structure and process measures will focus on building organizations' capacity to measure outcomes, including patient engagement and outcomes, linked to patient goals. PMID:29313755

  11. Early impact of Medicare accountable care organizations on cancer surgery outcomes.

    PubMed

    Herrel, Lindsey A; Norton, Edward C; Hawken, Scott R; Ye, Zaojun; Hollenbeck, Brent K; Miller, David C

    2016-09-01

    Accountable care organizations (ACOs) were established to improve care and outcomes for beneficiaries requiring highly coordinated, complex care. The objective of this study was to evaluate the association between hospital ACO participation and the outcomes of major surgical oncology procedures. This was a retrospective cohort study of Medicare beneficiaries older than 65 years who were undergoing a major surgical resection for colorectal, bladder, esophageal, kidney, liver, ovarian, pancreatic, lung, or prostate cancer from 2011 through 2013. A difference-in-differences analysis was implemented to compare the postimplementation period (January 2013 through December 2013) with the baseline period (January 2011 through December 2012) to assess the impact of hospital ACO participation on 30-day mortality, complications, readmissions, and length of stay (LOS). Among 384,519 patients undergoing major cancer surgery at 106 ACO hospitals and 2561 control hospitals, this study found a 30-day mortality rate of 3.4%, a readmission rate of 12.5%, a complication rate of 43.8%, and a prolonged LOS rate of 10.0% in control hospitals and similar rates in ACO hospitals. Secular trends were noted, with reductions in perioperative adverse events in control hospitals between the baseline and postimplementation periods: mortality (percentage-point reduction, 0.1%; P = .19), readmissions (percentage-point reduction, 0.4%; P = .001), complications (percentage-point reduction, 1.0%; P < .001), and prolonged LOS (percentage-point reduction, 1.1%; P < .001). After accounting for these secular trends, this study identified no significant effect of hospital participation in an ACO on the frequency of perioperative outcomes (difference-in-differences estimator P values, .24-.72). Early hospital participation in the Medicare Shared Savings Program ACO program was not associated with greater reductions in adverse perioperative outcomes for patients undergoing major cancer

  12. Modeling and Predicting Hearing Aid Outcome

    PubMed Central

    Humes, Larry E.

    2003-01-01

    Following a brief tutorial on the application of factor analysis to hearing aid outcome measures, three studies of hearing aid outcome measures in elderly adults are presented and analyzed. Two of the studies were completed at Indiana University (IU-1 and IU-2), and one was a collaborative multisite study by the Veterans Administration and the National Institute of Deafness and other Communication Disorders (NIDCD/VA). IU-1 measured hearing aid outcome in 173 elderly wearers of single-channel, linear, in-the-ear hearing aids with output-limiting compression, whereas IU-2 obtained the same extensive set of outcome measures from 53 elderly wearers of two-channel, wide-dynamic-range compression, in-the-canal hearing aids. In the NIDCD/VA study, 333 to 338 participants wore three single-channel circuits in succession, with each circuit housed within an in-the-ear shell. The three circuits included in that study and in this analysis were: (1) linear with peak clipping, (2) linear with output-limiting compression, and (3) single-channel, wide-dynamic-range compression. Evaluation of the many outcome measures completed in each study using principal components factor analysis revealed that from three (both IU studies) to five (NIDCD/VA study) principal components captured the individual differences in hearing aid outcome. This was independent of hearing aid type (in-the-ear or in-the-canal) and circuitry. Subsequent multiple regression analyses of individual differences in performance along each dimension of hearing aid outcome revealed that these individual differences could be accounted for reasonably well by various prefit variables for some dimensions of outcome, but not others. In general, measures of speech recognition performance were well accounted for by prefit measures, with the best predictors being hearing loss, cognitive performance, and age. Measures of hearing aid usage were less well accounted for by prefit measures, with the most accurate predictor of

  13. Do Activity Level Outcome Measures Commonly Used in Neurological Practice Assess Upper-Limb Movement Quality?

    PubMed

    Demers, Marika; Levin, Mindy F

    2017-07-01

    Movement is described in terms of task-related end point characteristics in external space and movement quality (joint rotations in body space). Assessment of upper-limb (UL) movement quality can assist therapists in designing effective treatment approaches for retraining lost motor elements and provide more detailed measurements of UL motor improvements over time. To determine the extent to which current activity level outcome measures used in neurological practice assess UL movement quality. Outcome measures assessing arm/hand function at the International Classification of Function activity level recommended by neurological clinical practice guidelines were reviewed. Measures assessing the UL as part of a general mobility assessment, those strictly evaluating body function/structure or participation, and paediatric measures were excluded. In all, 15 activity level outcome measures were identified; 9 measures assess how movement is performed by measuring either end point characteristics or movement quality. However, except for the Reaching Performance Scale for Stroke and the Motor Evaluation Scale for Upper Extremity in Stroke Patients, these measures only account for deficits indirectly by giving a partial score if movements are slower or if the person experiences difficulties. Six outcome measures neither assess any parameters related to movement quality, nor distinguish between improvements resulting from motor compensation or recovery of desired movement strategies. Current activity measures may not distinguish recovery from compensation and adequately track changes in movement quality over time. Movement quality may be incorporated into clinical assessment using observational kinematics with or without low-cost motion tracking technology.

  14. The International Dermatology Outcome Measures Group: formation of patient-centered outcome measures in dermatology.

    PubMed

    Gottlieb, Alice B; Levin, Adriane A; Armstrong, April W; Abernethy, April; Duffin, Kristina Callis; Bhushan, Reva; Garg, Amit; Merola, Joseph F; Maccarone, Mara; Christensen, Robin

    2015-02-01

    As quality standards are increasingly in demand throughout medicine, dermatology needs to establish outcome measures to quantify the effectiveness of treatments and providers. The International Dermatology Outcome Measures Group was established to address this need. Beginning with psoriasis, the group aims to create a tool considerate of patients and providers using the input of all relevant stakeholders in assessment of disease severity and response to treatment. Herein, we delineate the procedures through which consensus is being reached and the future directions of the project. Copyright © 2014 American Academy of Dermatology, Inc. Published by Elsevier Inc. All rights reserved.

  15. Systematic Review of Treatment Outcome Measures for Vulvodynia.

    PubMed

    Sadownik, Leslie A; Yong, Paul J; Smith, Kelly B

    2018-07-01

    To systematically evaluate the literature regarding vulvodynia treatment outcome measures. A systematic literature search on OVID, PubMed, and PsycINFO databases was conducted from inception until May 2016. Studies were included/excluded based on prespecified criteria. Reported outcome measures were organized into 6 core outcome domains recommended by the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT): pain; physical functioning, emotional functioning, participant ratings of global improvement and satisfaction with treatment, symptoms and adverse events, and participant disposition. Of the 206 articles identified for full-text screening, 33 met our criteria. One study adhered to all IMMPACT recommendations. The number of outcomes measured per study ranged from 1 to greater than 20. Patient-reported pain outcomes were found in the majority (27/33; 82%) of studies. Pain severity with intercourse was reported by 24 (73%) of 33 studies-9 different scales were used to measure this outcome. Clinician-reported outcomes were present in 14 (42%) of 33 studies. Methods of measuring vestibular sensitivity by "cotton swab" test were different in 8 of 10 studies. Other domains reported included; physical function (8/33 studies; 24%), sexual function (23/33 studies; 70%), and emotional function (13/33 studies; 39%). Symptoms and adverse events were reported by 15 (45%) of 33 studies. One study formally reported participant disposition using all the information recommended by CONSORT. Comparison of clinical trial results in vulvodynia is not possible because of a lack of standard treatment outcome measures. Vulvodynia researchers should apply the IMMPACT criteria to guide the development of a minimum core set of standard outcome measures that measure holistic health.

  16. Accounting for People: Can Business Measure Human Value?

    ERIC Educational Resources Information Center

    Workforce Economics, 1997

    1997-01-01

    Traditional business practice undervalues human capital, and most conventional accounting models reflect this inclination. The argument for more explicit measurements of human resources is simple: Improved measurement of human resources will lead to more rational and productive choices about managing human resources. The business community is…

  17. Comparing Dynamic Treatment Regimes Using Repeated-Measures Outcomes: Modeling Considerations in SMART Studies

    PubMed Central

    Lu, Xi; Nahum-Shani, Inbal; Kasari, Connie; Lynch, Kevin G.; Oslin, David W.; Pelham, William E.; Fabiano, Gregory; Almirall, Daniel

    2016-01-01

    A dynamic treatment regime (DTR) is a sequence of decision rules, each of which recommends a treatment based on a patient’s past and current health status. Sequential, multiple assignment, randomized trials (SMARTs) are multi-stage trial designs that yield data specifically for building effective DTRs. Modeling the marginal mean trajectories of a repeated-measures outcome arising from a SMART presents challenges, because traditional longitudinal models used for randomized clinical trials do not take into account the unique design features of SMART. We discuss modeling considerations for various forms of SMART designs, emphasizing the importance of considering the timing of repeated measures in relation to the treatment stages in a SMART. For illustration, we use data from three SMART case studies with increasing level of complexity, in autism, child attention deficit hyperactivity disorder (ADHD), and adult alcoholism. In all three SMARTs we illustrate how to accommodate the design features along with the timing of the repeated measures when comparing DTRs based on mean trajectories of the repeated-measures outcome. PMID:26638988

  18. Comparing dynamic treatment regimes using repeated-measures outcomes: modeling considerations in SMART studies.

    PubMed

    Lu, Xi; Nahum-Shani, Inbal; Kasari, Connie; Lynch, Kevin G; Oslin, David W; Pelham, William E; Fabiano, Gregory; Almirall, Daniel

    2016-05-10

    A dynamic treatment regime (DTR) is a sequence of decision rules, each of which recommends a treatment based on a patient's past and current health status. Sequential, multiple assignment, randomized trials (SMARTs) are multi-stage trial designs that yield data specifically for building effective DTRs. Modeling the marginal mean trajectories of a repeated-measures outcome arising from a SMART presents challenges, because traditional longitudinal models used for randomized clinical trials do not take into account the unique design features of SMART. We discuss modeling considerations for various forms of SMART designs, emphasizing the importance of considering the timing of repeated measures in relation to the treatment stages in a SMART. For illustration, we use data from three SMART case studies with increasing level of complexity, in autism, child attention deficit hyperactivity disorder, and adult alcoholism. In all three SMARTs, we illustrate how to accommodate the design features along with the timing of the repeated measures when comparing DTRs based on mean trajectories of the repeated-measures outcome. Copyright © 2015 John Wiley & Sons, Ltd.

  19. Physician outcome measurement: review and proposed model.

    PubMed

    Siha, S

    1998-01-01

    As health care moves from a free-for-service environment to a capitated arena, outcome measurements must change. ABC Children's Medical Center is challenged with developing comprehensive outcome measures for an employed physician group. An extensive literature review validates that physician outcomes must move beyond revenue production and measure all aspects of care delivery. The proposed measurement model for this physician group is a trilogy model. It includes measures of cost, quality, and service. While these measures can be examined separately, it is imperative to understand their integration in determining an organization's competitive advantage. The recommended measurements for the physician group must be consistent with the overall organizational goals. The long-term impact will be better utilization of resources. This will result in the most cost effective, quality care for the health care consumer.

  20. Association between executive function and outcome measure of treatment in therapeutic community among cocaine dependent individuals.

    PubMed

    Vergara-Moragues, Esperanza; Verdejo-García, Antonio; Lozano, Oscar M; Santiago-Ramajo, Sandra; González-Saiz, Francisco; Betanzos Espinosa, Patricia; Pérez García, Miguel

    2017-07-01

    The aim of this study was to examine the association between baseline executive functioning and outcome measure of treatment in 226 cocaine dependent individuals who initiated treatment in therapeutic communities TCs. The study was conducted across six TCs located in the region of Andalusia (southern Spain). Neuropsychological testing included tests of working memory, reasoning, inhibition, switching, attention interference and decision making. The outcome measures were type of discharge (treatment dropout vs. therapeutic discharge) and clinical impression of the TC outcome (clinically significant vs. non-significant changes). In the present study a prospective comparative design was used. We found significant performance differences on selective executive components which account for the type of discharge: treatment quitters had poorer attention response inhibition and attention switching than non-quitters, and the individuals who failed to achieve therapeutic objectives had poorer attention interference and inhibitory control than compliers. No significant differences were found between the outcome measure and the neuropsychological performance score on the other tasks. The results provide important information about the impact of executive components on in-treatment follow-up outcomes among dependence disorders in TC. Copyright © 2017 Elsevier Inc. All rights reserved.

  1. The Harmonizing Outcome Measures for Eczema (HOME) roadmap: a methodological framework to develop core sets of outcome measurements in dermatology.

    PubMed

    Schmitt, Jochen; Apfelbacher, Christian; Spuls, Phyllis I; Thomas, Kim S; Simpson, Eric L; Furue, Masutaka; Chalmers, Joanne; Williams, Hywel C

    2015-01-01

    Core outcome sets (COSs) are consensus-derived minimum sets of outcomes to be assessed in a specific situation. COSs are being increasingly developed to limit outcome-reporting bias, allow comparisons across trials, and strengthen clinical decision making. Despite the increasing interest in outcomes research, methods to develop COSs have not yet been standardized. The aim of this paper is to present the Harmonizing Outcomes Measures for Eczema (HOME) roadmap for the development and implementation of COSs, which was developed on the basis of our experience in the standardization of outcome measurements for atopic eczema. Following the establishment of a panel representing all relevant stakeholders and a research team experienced in outcomes research, the scope and setting of the core set should be defined. The next steps are the definition of a core set of outcome domains such as symptoms or quality of life, followed by the identification or development and validation of appropriate outcome measurement instruments to measure these core domains. Finally, the consented COS needs to be disseminated, implemented, and reviewed. We believe that the HOME roadmap is a useful methodological framework to develop COSs in dermatology, with the ultimate goal of better decision making and promoting patient-centered health care.

  2. Facility-level outcome performance measures for nursing homes.

    PubMed

    Porell, F; Caro, F G

    1998-12-01

    Risk-adjusted nursing home performance scores were developed for four health outcomes and five quality indicators from resident-level longitudinal case-mix reimbursement data for Medicaid residents of more than 500 nursing homes in Massachusetts. Facility performance was measured by comparing actual resident outcomes with expected outcomes derived from quarterly predictions of resident-level econometric models over a 3-year period (1991-1994). Performance measures were tightly distributed among facilities in the state. The intercorrelations among the nine outcome performance measures were relatively low and not uniformly positive. Performance measures were not highly associated with various structural facility attributes. For most outcomes, longitudinal analyses revealed only modest correlations between a facility's performance score from one time period to the next. Relatively few facilities exhibited consistent superior or inferior performance over time. The findings have implications toward the practical use of facility outcome performance measures for quality assurance and reimbursement purposes in the near future.

  3. Personal Accountability in Education: Measure Development and Validation

    ERIC Educational Resources Information Center

    Rosenblatt, Zehava

    2017-01-01

    Purpose: The purpose of this paper, three-study research project, is to establish and validate a two-dimensional scale to measure teachers' and school administrators' accountability disposition. Design/methodology/approach: The scale items were developed in focus groups, and the final measure was tested on various samples of Israeli teachers and…

  4. Generating Outcome Measurements: Economic and Societal. A Guide to Educational Outcomes Measurements and Their Uses. Seminar No. 4.

    ERIC Educational Resources Information Center

    Mushkin, Selma J.; Billings, Bradley B.

    This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministires, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with generating outcome measurements:…

  5. Outcomes measurement: compliance tool or strategic initiative?

    PubMed

    Linder, J C

    1991-01-01

    This article explores how hospitals are using outcomes measurement to deal with their changing environment. Based on interviews at thirty-one hospitals, the study reveals three very different management approaches and three different uses of the same outcomes measurement tool.

  6. Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome measurement instruments for outcomes included in a 'core outcome set'.

    PubMed

    Prinsen, Cecilia A C; Vohra, Sunita; Rose, Michael R; King-Jones, Susanne; Ishaque, Sana; Bhaloo, Zafira; Adams, Denise; Terwee, Caroline B

    2014-06-25

    The Core Outcome Measures in Effectiveness Trials (COMET) initiative aims to facilitate the development and application of 'core outcome sets' (COS). A COS is an agreed minimum set of outcomes that should be measured and reported in all clinical trials of a specific disease or trial population. The overall aim of the Core Outcome Measurement Instrument Selection (COMIS) project is to develop a guideline on how to select outcome measurement instruments for outcomes included in a COS. As part of this project, we describe our current efforts to achieve a consensus on the methods for selecting outcome measurement instruments for outcomes to be included in a COS. A Delphi study is being performed by a panel of international experts representing diverse stakeholders with the intention that this will result in a guideline for outcome measurement instrument selection. Informed by a literature review, a Delphi questionnaire was developed to identify potentially relevant tasks on instrument selection. The Delphi study takes place in a series of rounds. In the first round, panelists were asked to rate the importance of different tasks in the selection of outcome measurement instruments. They were encouraged to justify their choices and to add other relevant tasks. Consensus was reached if at least 70% of the panelists considered a task 'highly recommended' or 'desirable' and if no opposing arguments were provided. These tasks will be included in the guideline. Tasks that at least 50% of the panelists considered 'not relevant' will be excluded from the guideline. Tasks that were indeterminate will be taken to the second round. All responses of the first round are currently being aggregated and will be fed back to panelists in the second round. A third round will only be performed if the results of the second round require it. Since the Delphi method allows a large group of international experts to participate, we consider it to be the preferred consensus-based method for our

  7. The interdependence of behavioral and somatic health: implications for conceptualizing health and measuring treatment outcomes

    PubMed Central

    LaBrie, Richard A.; LaPlante, Debi A.; Peller, Allyson J.; Christensen, Donald E.; Greenwood, Kristina L.; Straus, John H.; Garmon, Michael S.; Browne, Cheryl; Shaffer, Howard J.

    2007-01-01

    Purpose The interdependence of behavioral and somatic aspects of various health conditions warrants greater emphasis on an integrated care approach. Theory We propose that integrated approaches to health and wellness require comprehensive and empirically-valid outcome measures to assess quality of care. Method We discuss the transition from independent to integrated treatment approaches and provide examples of new systems for integrated assessment of treatment outcome. Results Evidence suggests that support for an independent treatment approach is waning and momentum is building towards more integrated care. In addition, research evidence suggests integrated care improves health outcomes, and both physicians and patients have favorable impressions of integrated care. Conclusions As treatment goals in the integrated perspective expand to take into account the intimate relationships among mental illness, overall health, and quality of life, clinicians need to develop outcome measures that are similarly comprehensive. Discussion Increased recognition, by researchers, providers, and insurers, of the interdependence between behavioral and physical health holds great promise for innovative treatments that could significantly improve patients' lives. PMID:17627294

  8. Measuring voice outcomes: state of the science review.

    PubMed

    Carding, Pau N; Wilson, J A; MacKenzie, K; Deary, I J

    2009-08-01

    Researchers evaluating voice disorder interventions currently have a plethora of voice outcome measurement tools from which to choose. Faced with such a wide choice, it would be beneficial to establish a clear rationale to guide selection. This article reviews the published literature on the three main areas of voice outcome assessment: (1) perceptual rating of voice quality, (2) acoustic measurement of the speech signal and (3) patient self-reporting of voice problems. We analysed the published reliability, validity, sensitivity to change and utility of the common outcome measurement tools in each area. From the data, we suggest that routine voice outcome measurement should include (1) an expert rating of voice quality (using the Grade-Roughness-Breathiness-Asthenia-Strain rating scale) and (2) a short self-reporting tool (either the Vocal Performance Questionnaire or the Vocal Handicap Index 10). These measures have high validity, the best reported reliability to date, good sensitivity to change data and excellent utility ratings. However, their application and administration require attention to detail. Acoustic measurement has arguable validity and poor reliability data at the present time. Other areas of voice outcome measurement (e.g. stroboscopy and aerodynamic phonatory measurements) require similarly detailed research and analysis.

  9. Higher Education Counts: Accountability Measures for the New Millennium. 2005 Report

    ERIC Educational Resources Information Center

    Connecticut Department of Higher Education (NJ1), 2005

    2005-01-01

    "Higher Education Counts" is the annual accountability report on Connecticut's state system of higher education, as required under Connecticut General Statutes Section 10a-6a. The report contains accountability measures developed through the Performance Measures Task Force and approved by the Board of Governors for Higher Education. The…

  10. Accounting for measurement error: a critical but often overlooked process.

    PubMed

    Harris, Edward F; Smith, Richard N

    2009-12-01

    Due to instrument imprecision and human inconsistencies, measurements are not free of error. Technical error of measurement (TEM) is the variability encountered between dimensions when the same specimens are measured at multiple sessions. A goal of a data collection regimen is to minimise TEM. The few studies that actually quantify TEM, regardless of discipline, report that it is substantial and can affect results and inferences. This paper reviews some statistical approaches for identifying and controlling TEM. Statistically, TEM is part of the residual ('unexplained') variance in a statistical test, so accounting for TEM, which requires repeated measurements, enhances the chances of finding a statistically significant difference if one exists. The aim of this paper was to review and discuss common statistical designs relating to types of error and statistical approaches to error accountability. This paper addresses issues of landmark location, validity, technical and systematic error, analysis of variance, scaled measures and correlation coefficients in order to guide the reader towards correct identification of true experimental differences. Researchers commonly infer characteristics about populations from comparatively restricted study samples. Most inferences are statistical and, aside from concerns about adequate accounting for known sources of variation with the research design, an important source of variability is measurement error. Variability in locating landmarks that define variables is obvious in odontometrics, cephalometrics and anthropometry, but the same concerns about measurement accuracy and precision extend to all disciplines. With increasing accessibility to computer-assisted methods of data collection, the ease of incorporating repeated measures into statistical designs has improved. Accounting for this technical source of variation increases the chance of finding biologically true differences when they exist.

  11. Improving preventive health services training in chiropractic colleges part II: enhancing outcomes through improved training and accountability processes.

    PubMed

    Globe, Gary; Redwood, Daniel; Brantingham, James W; Hawk, Cheryl; Terre, Lisa; Globe, Denise; Mayer, Stephan

    2009-01-01

    Over the past decade, chiropractic colleges have introduced clinical prevention services (CPS) training. This has included an updated public health curriculum and procedures for student interns to determine the need for preventive services and to provide these services directly or through referral to other health professionals. The purpose of this study was to evaluate the effect of a program to train chiropractic interns to deliver CPS to patients. Program evaluation used retrospective chart review, comparing the proportion of patients receiving CPS recommendations before and after implementation of the program. The main outcome measures were the percentage of appropriate CPS recommendations based upon chart reviews. Chart reviews in 2006 indicated appropriate CPS recommendations in 47.4% of cases (295/623). Chart reviews in 2007, after an additional year of sustained implementation of procedures to ensure intern and faculty accountability, showed appropriate counseling recommendations in 87% of files (137/156). Requiring interns to attend didactic presentations on CPS had no measurable effect on their performance. Major improvements occurred after a series of clinically relevant training interventions; new forms and audit procedures were implemented to increase intern and clinical faculty accountability.

  12. Measurement of Outcomes in Vision-Related Rehabilitation.

    ERIC Educational Resources Information Center

    Head, Daniel

    1998-01-01

    Comments on an earlier article by Lorraine Lidoff on health insurance coverage of vision-related rehabilitation services. Urges a standard model of services involving selection of measurable outcomes that reflect treatment processes, selection of the most appropriate time to measure outcomes, and selection of the best method for collecting outcome…

  13. Staff perceptions of using outcome measures in stroke rehabilitation.

    PubMed

    Burton, Louisa-Jane; Tyson, Sarah; McGovern, Alison

    2013-05-01

    The use of standardised outcome measures is an integral part of stroke rehabilitation and is widely recommended as good practice. However, little is known about how measures are actually used or their impact. This study aimed to identify current clinical practice; how healthcare professionals working in stroke rehabilitation use outcome measures and their perceptions of the benefits and barriers to use. Eighty-four Health Care Professionals and 12 service managers and commissioners working in stroke services across a large UK county were surveyed by postal questionnaire. Ninety-six percent of clinical respondents used at least one measure, however, less than half used measures regularly during a patient's stay. The mean number of tools used was 3.2 (SD = 1.9). Eighty-one different tools were identified; 16 of which were unpublished and unvalidated. Perceived barriers in using outcome measures in day-to-day clinical practice included lack of resources (time and training) and lack of knowledge of appropriate measures. Benefits identified were to demonstrate the effectiveness of rehabilitation interventions and monitor patients' progress. Although the use of outcome measures is prevalent in clinical practice, there is little consistency in the tools utilised. The term "outcome measures" is used, but staff rarely used the measures at appropriate time points to formally assess and evaluate outcome. The term "measurement tool" more accurately reflects the purposes to which they were put and potential benefits. Further research to overcome the barriers in using standardised measurement tools and evaluate the impact of implementation on clinical practice is needed. • Health professionals working in stroke rehabilitation should work together to agree when and how outcome measures can be most effectively used in their service. • Efforts should be made to ensure that standardised tools are used to measure outcome at set time-points during rehabilitation, in order to

  14. Measurement tools and outcome measures used in transitional patient safety; a systematic review.

    PubMed

    van Melle, Marije A; van Stel, Henk F; Poldervaart, Judith M; de Wit, Niek J; Zwart, Dorien L M

    2018-01-01

    Patients are at risk for harm when treated simultaneously by healthcare providers from different healthcare organisations. To assess current practice and improvements of transitional patient safety, valid measurement tools are needed. To identify and appraise all measurement tools and outcomes that measure aspects of transitional patient safety, PubMed, Cinahl, Embase and Psychinfo were systematically searched. Two researchers performed the title and abstract and full-text selection. First, publications about validation of measurement tools were appraised for quality following COSMIN criteria. Second, we inventoried all measurement tools and outcome measures found in our search that assessed current transitional patient safety or the effect of interventions targeting transitional patient safety. The initial search yielded 8288 studies, of which 18 assessed validity of measurement tools of different aspects of transitional safety, and 191 assessed current transitional patient safety or effect of interventions. In the validated measurement tools, the overall quality of content and structural validity was acceptable; other COSMIN criteria, such as reliability, measurement error and responsiveness, were mostly poor or not reported. In our outcome inventory, the most frequently used validated outcome measure was the Care Transition Measure (n = 9). The most frequently used non-validated outcome measures were: medication discrepancies (n = 98), hospital readmissions (n = 55), adverse events (n = 34), emergency department visits (n = 33), (mental or physical) health status (n = 28), quality and timeliness of discharge summary, and patient satisfaction (n = 23). Although no validated measures exist that assess all aspects of transitional patient safety, we found validated measurement tools on specific aspects. Reporting of validity of transitional measurement tools was incomplete. Numerous outcome measures with unknown measurement properties are used in current studies on

  15. Toward defining and measuring social accountability in graduate medical education: a stakeholder study.

    PubMed

    Reddy, Anjani T; Lazreg, Sonia A; Phillips, Robert L; Bazemore, Andrew W; Lucan, Sean C

    2013-09-01

    Since 1965, Medicare has publically financed graduate medical education (GME) in the United States. Given public financing, various advisory groups have argued that GME should be more socially accountable. Several efforts are underway to develop accountability measures for GME that could be tied to Medicare payments, but it is not clear how to measure or even define social accountability. We explored how GME stakeholders perceive, define, and measure social accountability. Through purposive and snowball sampling, we completed semistructured interviews with 18 GME stakeholders from GME training sites, government agencies, and health care organizations. We analyzed interview field notes and audiorecordings using a flexible, iterative, qualitative group process to identify themes. THREE THEMES EMERGED IN REGARDS TO DEFINING SOCIAL ACCOUNTABILITY: (1) creating a diverse physician workforce to address regional needs and primary care and specialty shortages; (2) ensuring quality in training and care to best serve patients; and (3) providing service to surrounding communities and the general public. All but 1 stakeholder believed GME institutions have a responsibility to be socially accountable. Reported barriers to achieving social accountability included training time constraints, financial limitations, and institutional resistance. Suggestions for measuring social accountability included reviewing graduates' specialties and practice locations, evaluating curricular content, and reviewing program services to surrounding communities. Most stakeholders endorsed the concept of social accountability in GME, suggesting definitions and possible measures that could inform policy makers calls for increased accountability despite recognized barriers.

  16. The impact of retirement account distributions on measures of family income.

    PubMed

    Iams, Howard M; Purcell, Patrick J

    2013-01-01

    In recent decades, employers have increasingly replaced defined benefit (DB) pensions with defined contribution (DC) retirement accounts for their employees. DB plans provide annuities, or lifetime benefits paid at regular intervals. The timing and amounts of DC distributions, however, may vary widely. Most surveys that provide data on the family income of the aged either collect no data on nonannuity retirement account distributions, or exclude such distributions from their summary measures of family income. We use Survey of Income and Program Participation (SIPP) data for 2009 to estimate the impact of including retirement account distributions on total family income calculations. We find that about one-fifth of aged families received distributions from retirement accounts in 2009. Measured mean income for those families would be about 15 percent higher and median income would be 18 percent higher if those distributions were included in the SIPP summary measure of family income.

  17. 50 CFR 648.262 - Accountability measures for red crab limited access vessels.

    Code of Federal Regulations, 2011 CFR

    2011-10-01

    ... 50 Wildlife and Fisheries 10 2011-10-01 2011-10-01 false Accountability measures for red crab... UNITED STATES Management Measures for the Atlantic Deep-Sea Red Crab Fishery § 648.262 Accountability measures for red crab limited access vessels. (a) Closure authority. NMFS shall close the EEZ to fishing...

  18. Measuring spine fracture outcomes: common scales and checklists.

    PubMed

    Schoenfeld, Andrew J; Bono, Christopher M

    2011-03-01

    Although outcome instruments have been used extensively in spine surgical research, few studies at present specifically address their use in investigations regarding spine trauma. In this review we provide a summary of the outcome instruments used most frequently in spine trauma research, identify the unique challenges of studying outcomes of spine trauma patients, and propose an integrated approach that may be beneficial for future studies. We reviewed the use of outcome instruments applicable to spine trauma research, including generic health measures, inventories of back-specific function, pain scales, health related quality of life (HRQOL) instruments, and radiographic determinants of outcome. Several inventories have been utilised to measure clinical outcomes following spinal trauma. Excluding measures of neurological function (e.g. ASIA motor score), none have been specifically validated for use with spine fractures. The SF-36, RMDQ, and ODI are amongst the most commonly used instruments. Importantly, the use of validated functional outcome measures in spine trauma research is hampered by the fact that the pre-morbid state of patients who sustain spine trauma may not be accurately represented by normative values established for the general population. The VAS is used most frequently to assess degree of neck and back pain. Most studies have relied on non-validated measures to determine radiographic results of treatment, although more elegant radiographic metrics exist. Functional outcome measurement of traumatically injured spine patients is challenging because available generic and spine-specific instruments were not designed for or validated in this population. Furthermore, no single inventory is capable of capturing global data necessary to evaluate results following these injuries. Investigations seeking to quantify outcomes following spine trauma should consider the use of a combination of existing surveys in a complementary fashion that should include a

  19. Education Funding and Student Outcomes: A Conceptual Framework for Measurement of the Alignment of State Education Finance and Academic Accountability Policies

    ERIC Educational Resources Information Center

    Knoeppel, Robert C.; Della Sala, Matthew R.

    2015-01-01

    The conceptualization and measurement of education finance equity and adequacy has engaged researchers for more than three decades. At the same time, calls for increased academic accountability and higher student achievement in K-12 public education have reached new levels at both the national and state levels. Aligning these represents an…

  20. How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis

    PubMed Central

    Dalkin, Sonia; Gibbons, Elizabeth; Wright, Judy; Valderas, Jose Maria; Meads, David; Black, Nick

    2017-01-01

    Objectives Internationally, there has been considerable debate about the role of data in supporting quality improvement in health care. Our objective was to understand how, why and in what circumstances the feedback of aggregated patient-reported outcome measures data improved patient care. Methods We conducted a realist synthesis. We identified three main programme theories underlying the use of patient-reported outcome measures as a quality improvement strategy and expressed them as nine ‘if then’ propositions. We identified international evidence to test these propositions through searches of electronic databases and citation tracking, and supplemented our synthesis with evidence from similar forms of performance data. We synthesized this evidence through comparing the mechanisms and impact of patient-reported outcome measures and other performance data on quality improvement in different contexts. Results Three programme theories were identified: supporting patient choice, improving accountability and enabling providers to compare their performance with others. Relevant contextual factors were extent of public disclosure, use of financial incentives, perceived credibility of the data and the practicality of the results. Available evidence suggests that patients or their agents rarely use any published performance data when selecting a provider. The perceived motivation behind public reporting is an important determinant of how providers respond. When clinicians perceived that performance indicators were not credible but were incentivized to collect them, gaming or manipulation of data occurred. Outcome data do not provide information on the cause of poor care: providers needed to integrate and interpret patient-reported outcome measures and other outcome data in the context of other data. Lack of timeliness of performance data constrains their impact. Conclusions Although there is only limited research evidence to support some widely held theories of how

  1. Performance Measurement and Accountability in Higher Education: The Puzzle of Qualification Completions

    ERIC Educational Resources Information Center

    Alach, Zhivan

    2016-01-01

    This study explores difficulties in the conceptual positioning of the higher education performance indicator of qualification completion within a standard logic model taken from the public sector performance literature, involving inputs, processes, impacts and outcomes. Organisations are held to be more accountable for the delivery of outputs than…

  2. Challenges in Measuring Outcomes Following Digital Replantation

    PubMed Central

    Sebastin, Sandeep J.; Chung, Kevin C.

    2013-01-01

    In the early period of replantation surgery, the emphasis was on digit survival. Subsequently, with better microsurgical techniques and instrumentation, the focus has shifted to function and in recent years to consideration of cost-effectiveness. Despite over 40 years of effort in refining digital replantation surgery, a rigorous evaluation of the outcomes of digital replantation has not been performed. This is because of the many confounding variables that influence outcome comparisons. These variables include the mechanism of injury (guillotine, crush, avulsion), the injury itself (total, near total, subtotal, partial amputation), and the surgical procedure (replantation, revascularization). In addition, the traditional outcome measures (two-point discrimination, range of motion, grip strength, or the ability to return to work) are reported inconsistently and vary widely among publications. All these factors make meaningful comparison of outcomes difficult. The recent emphasis on outcome research and cost-effectiveness necessitates a rethinking in the way we report outcomes of digital replantation. In this article, the authors summarize the challenges in assessing outcomes of digital replantation and explain the need to measure outcomes using rigorous clinical research designs that incorporate cost-effectiveness studies in the research protocol. PMID:24872766

  3. Neighborhood Deprivation and Childhood Asthma Outcomes, Accounting for Insurance Coverage.

    PubMed

    Nkoy, Flory L; Stone, Bryan L; Knighton, Andrew J; Fassl, Bernhard A; Johnson, Joseph M; Maloney, Christopher G; Savitz, Lucy A

    2018-01-09

    Collecting social determinants data is challenging. We assigned patients a neighborhood-level social determinant measure, the area of deprivation index (ADI), by using census data. We then assessed the association between neighborhood deprivation and asthma hospitalization outcomes and tested the influence of insurance coverage. A retrospective cohort study of children 2 to 17 years old admitted for asthma at 8 hospitals. An administrative database was used to collect patient data, including hospitalization outcomes and neighborhood deprivation status (ADI scores), which were grouped into quintiles (ADI 1, the least deprived neighborhoods; ADI 5, the most deprived neighborhoods). We used multivariable models, adjusting for covariates, to assess the associations and added a neighborhood deprivation status and insurance coverage interaction term. A total of 2270 children (median age 5 years; 40.6% girls) were admitted for asthma. We noted that higher ADI quintiles were associated with greater length of stay, higher cost, and more asthma readmissions ( P < .05 for most quintiles). Having public insurance was independently associated with greater length of stay (β: 1.171; 95% confidence interval [CI]: 1.117-1.228; P < .001), higher cost (β: 1.147; 95% CI: 1.093-1.203; P < .001), and higher readmission odds (odds ratio: 1.81; 95% CI: 1.46-2.24; P < .001). There was a significant deprivation-insurance effect modification, with public insurance associated with worse outcomes and private insurance with better outcomes across ADI quintiles ( P < .05 for most combinations). Neighborhood-level ADI measure is associated with asthma hospitalization outcomes. However, insurance coverage modifies this relationship and needs to be considered when using the ADI to identify and address health care disparities. Copyright © 2018 by the American Academy of Pediatrics.

  4. Measuring the General Education Outcomes: Practical Strategies.

    ERIC Educational Resources Information Center

    Peterson, Anne; And Others

    Prepared in an effort to more clearly define and measure general education outcomes at Columbus State Community College, in Ohio, this handbook describes outcomes and associated student behaviors and provides suggestions for assessing the outcomes. Following introductory materials, a list is provided of the college's six general education…

  5. A method for developing outcome measures in the clinical laboratory.

    PubMed

    Jones, J

    1996-01-01

    Measuring and reporting outcomes in health care is becoming more important for quality assessment, utilization assessment, accreditation standards, and negotiating contracts in managed care. How does one develop an outcome measure for the laboratory to assess the value of the services? A method is described which outlines seven steps in developing outcome measures for a laboratory service or process. These steps include the following: 1. Identify the process or service to be monitored for performance and outcome assessment. 2. If necessary, form an multidisciplinary team of laboratory staff, other department staff, physicians, and pathologists. 3. State the purpose of the test or service including a review of published data for the clinical pathological correlation. 4. Prepare a process cause and effect diagram including steps critical to the outcome. 5. Identify key process variables that contribute to positive or negative outcomes. 6. Identify outcome measures that are not process measures. 7. Develop an operational definition, identify data sources, and collect data. Examples, including a process cause and effect diagram, process variables, and outcome measures, are given using the Therapeutic Drug Monitoring service (TDM). A summary of conclusions and precautions for outcome measurement is then provided.

  6. Benchmarking: measuring the outcomes of evidence-based practice.

    PubMed

    DeLise, D C; Leasure, A R

    2001-01-01

    Measurement of the outcomes associated with implementation of evidence-based practice changes is becoming increasingly emphasized by multiple health care disciplines. A final step to the process of implementing and sustaining evidence-supported practice changes is that of outcomes evaluation and monitoring. The comparison of outcomes to internal and external measures is known as benchmarking. This article discusses evidence-based practice, provides an overview of outcomes evaluation, and describes the process of benchmarking to improve practice. A case study is used to illustrate this concept.

  7. 50 CFR 660.509 - Accountability measures (season closures).

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... 50 Wildlife and Fisheries 13 2014-10-01 2014-10-01 false Accountability measures (season closures). 660.509 Section 660.509 Wildlife and Fisheries FISHERY CONSERVATION AND MANAGEMENT, NATIONAL OCEANIC AND ATMOSPHERIC ADMINISTRATION, DEPARTMENT OF COMMERCE (CONTINUED) FISHERIES OFF WEST COAST STATES...

  8. Patient reported outcome measures (PROMs) for goalsetting and outcome measurement in primary care physiotherapy, an explorative field study.

    PubMed

    van Dulmen, Simone A; van der Wees, Philip J; Bart Staal, J; Braspenning, J C C; Nijhuis-van der Sanden, Maria W G

    2017-03-01

    Routine use of patient reported outcome measures (PROMs) may provide an effective way of monitoring patient valued outcomes. In this study we explored (1) the current use of PROMs; (2) to what extent the goals correspond with the selected PROMs; (3) the health outcomes based on PROMs. Observational clinical cohort study. Dutch primary care physiotherapy practices (n=43). Patients (n=299) with neck pain or low back pain. The number of PROMs used per patient were calculated. The International Classification of Functioning, Disability and Health was used to map the patients' goals and the percentages of PROMS selected that match the domains of the goals were calculated. Health outcomes were assessed using two approaches for estimating the minimal clinically important difference (MCID). Repeated measurements with the Visual Analogue Scale, the Patient Specific Complaints questionnaire, the Quebec Back Pain Disability Scale, or the Neck Disability Index were completed by more than 60% of the patients. The PROMs used matched in 46% of the cases with goals for pain improvement, and in 43% with goals set at activity/participation level. The mean differences between baseline and follow up scores for all PROMs were statistically significant. Improvements of patients based on MCID varied from 57% to 90%. PROMs were used in the majority of the patients, showed improved health outcomes and fitted moderately with goals. The results of this study can be used for future research assessing the routine use of outcome measurements with PROMs. Copyright © 2016 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

  9. The Development of NOAA Education Common Outcome Performance Measures (Invited)

    NASA Astrophysics Data System (ADS)

    Baek, J.

    2013-12-01

    The National Oceanic and Atmospheric Administration (NOAA) Education Council has embarked on an ambitious Monitoring and Evaluation (M&E) project that will allow it to assess education program outcomes and impacts across the agency, line offices, and programs. The purpose of this internal effort is to link outcome measures to program efforts and to evaluate the success of the agency's education programs in meeting the strategic goals. Using an outcome-based evaluation approach, the NOAA Education Council is developing two sets of common outcome performance measures, environmental stewardship and professional development. This presentation will examine the benefits and tradeoffs of common outcome performance measures that collect program results across a portfolio of education programs focused on common outcomes. Common outcome performance measures have a few benefits to our agency and to the climate education field at large. The primary benefit is shared understanding, which comes from our process for writing common outcome performance measures. Without a shared and agreed upon set of definitions for the measure of an outcome, the reported results may not be measuring the same things and would incorrectly indicate levels of performance. Therefore, our writing process relies on a commitment to developing a shared set of definitions based on consensus. We hope that by taking the time to debate and coming to agreement across a diverse set of programs, the strength of our common measures can indicate real progress towards outcomes we care about. An additional benefit is that these common measures can be adopted and adapted by other agencies and organizations that share similar theories of change. The measures are not without their drawbacks, and we do make tradeoffs as part of our process in order to continue making progress. We know that any measure is necessarily a narrow slice of performance. A slice that may not best represent the unique and remarkable contribution

  10. Accountability Policy Outcomes Related to No Child Left Behind and Educational Equity for Big5 City Schools in New York State

    ERIC Educational Resources Information Center

    Shin, Hyejin

    2016-01-01

    The purpose of this study was to explore the association of NCLB/accountability with educational output and input for New York State, collectively. Focusing on ELA and Math achievement in 4th and 8th grades, this study demonstrated the association of accountability outcomes in three ways: "accountability design, school proficiency level, and…

  11. PERFORMANCE METRICS: AN OVERVIEW OF ECOLOGICAL "OUTCOME" MEASUREMENT AT EPA

    EPA Science Inventory

    The terms "Accountability" and "Outcome" are becoming ubiquitous in government agencies. The impetus for demonstrating results from government-sponsored research and regulation comes from Congress (e.g., statutes like the Government Performance Results Act of 1993 and reports fro...

  12. Patient-reported outcome measures versus inertial performance-based outcome measures: A prospective study in patients undergoing primary total knee arthroplasty.

    PubMed

    Bolink, S A A N; Grimm, B; Heyligers, I C

    2015-12-01

    Outcome assessment of total knee arthroplasty (TKA) by subjective patient reported outcome measures (PROMs) may not fully capture the functional (dis-)abilities of relevance. Objective performance-based outcome measures could provide distinct information. An ambulant inertial measurement unit (IMU) allows kinematic assessment of physical performance and could potentially be used for routine follow-up. To investigate the responsiveness of IMU measures in patients following TKA and compare outcomes with conventional PROMs. Patients with end stage knee OA (n=20, m/f=7/13; age=67.4 standard deviation 7.7 years) were measured preoperatively and one year postoperatively. IMU measures were derived during gait, sit-stand transfers and block step-up transfers. PROMs were assessed by using the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) and Knee Society Score (KSS). Responsiveness was calculated by the effect size, correlations were calculated with Spearman's rho correlation coefficient. One year after TKA, patients performed significantly better at gait, sit-to-stand transfers and block step-up transfers. Measures of time and kinematic IMU measures demonstrated significant improvements postoperatively for each performance-based test. The largest improvement was found in block step-up transfers (effect size=0.56-1.20). WOMAC function score and KSS function score demonstrated moderate correlations (Spearman's rho=0.45-0.74) with some of the physical performance-based measures pre- and postoperatively. To characterize the changes in physical function after TKA, PROMs could be supplemented by performance-based measures, assessing function during different activities and allowing kinematic characterization with an ambulant IMU. Copyright © 2015 Elsevier B.V. All rights reserved.

  13. Multiple imputation to account for measurement error in marginal structural models

    PubMed Central

    Edwards, Jessie K.; Cole, Stephen R.; Westreich, Daniel; Crane, Heidi; Eron, Joseph J.; Mathews, W. Christopher; Moore, Richard; Boswell, Stephen L.; Lesko, Catherine R.; Mugavero, Michael J.

    2015-01-01

    Background Marginal structural models are an important tool for observational studies. These models typically assume that variables are measured without error. We describe a method to account for differential and non-differential measurement error in a marginal structural model. Methods We illustrate the method estimating the joint effects of antiretroviral therapy initiation and current smoking on all-cause mortality in a United States cohort of 12,290 patients with HIV followed for up to 5 years between 1998 and 2011. Smoking status was likely measured with error, but a subset of 3686 patients who reported smoking status on separate questionnaires composed an internal validation subgroup. We compared a standard joint marginal structural model fit using inverse probability weights to a model that also accounted for misclassification of smoking status using multiple imputation. Results In the standard analysis, current smoking was not associated with increased risk of mortality. After accounting for misclassification, current smoking without therapy was associated with increased mortality [hazard ratio (HR): 1.2 (95% CI: 0.6, 2.3)]. The HR for current smoking and therapy (0.4 (95% CI: 0.2, 0.7)) was similar to the HR for no smoking and therapy (0.4; 95% CI: 0.2, 0.6). Conclusions Multiple imputation can be used to account for measurement error in concert with methods for causal inference to strengthen results from observational studies. PMID:26214338

  14. Inter-provider comparison of patient-reported outcomes: developing an adjustment to account for differences in patient case mix.

    PubMed

    Nuttall, David; Parkin, David; Devlin, Nancy

    2015-01-01

    This paper describes the development of a methodology for the case-mix adjustment of patient-reported outcome measures (PROMs) data permitting the comparison of outcomes between providers on a like-for-like basis. Statistical models that take account of provider-specific effects form the basis of the proposed case-mix adjustment methodology. Indirect standardisation provides a transparent means of case mix adjusting the PROMs data, which are updated on a monthly basis. Recently published PROMs data for patients undergoing unilateral knee replacement are used to estimate empirical models and to demonstrate the application of the proposed case-mix adjustment methodology in practice. The results are illustrative and are used to highlight a number of theoretical and empirical issues that warrant further exploration. For example, because of differences between PROMs instruments, case-mix adjustment methodologies may require instrument-specific approaches. A number of key assumptions are made in estimating the empirical models, which could be open to challenge. The covariates of post-operative health status could be expanded, and alternative econometric methods could be employed. © 2013 Crown copyright.

  15. Single-joint outcome measures: preliminary validation of patient-reported outcomes and physical examination.

    PubMed

    Heald, Alison E; Fudman, Edward J; Anklesaria, Pervin; Mease, Philip J

    2010-05-01

    To assess the validity, responsiveness, and reliability of single-joint outcome measures for determining target joint (TJ) response in patients with inflammatory arthritis. Patient-reported outcomes (PRO), consisting of responses to single questions about TJ global status on a 100-mm visual analog scale (VAS; TJ global score), function on a 100-mm VAS (TJ function score), and pain on a 5-point Likert scale (TJ pain score) were piloted in 66 inflammatory arthritis subjects in a phase 1/2 clinical study of an intraarticular gene transfer agent and compared to physical examination measures (TJ swelling, TJ tenderness) and validated function questionnaires (Disabilities of the Arm, Shoulder and Hand scale, Rheumatoid Arthritis Outcome Score, and the Health Assessment Questionnaire). Construct validity was assessed by evaluating the correlation between the single-joint outcome measures and validated function questionnaires using Spearman's rank correlation. Responsiveness or sensitivity to change was assessed through calculating effect size and standardized response means (SRM). Reliability of physical examination measures was assessed by determining interobserver agreement. The single-joint PRO were highly correlated with each other and correlated well with validated functional measures. The TJ global score exhibited modest effect size and modest SRM that correlated well with the patient's assessment of response on a 100-mm VAS. Physical examination measures exhibited high interrater reliability, but correlated less well with validated functional measures and the patient's assessment of response. Single-joint PRO, particularly the TJ global score, are simple to administer and demonstrate construct validity and responsiveness in patients with inflammatory arthritis. (ClinicalTrials.gov identifier NCT00126724).

  16. Using an evidence-based approach to measure outcomes in clinical practice.

    PubMed

    MacDermid, Joy C; Grewal, Ruby; MacIntyre, Norma J

    2009-02-01

    Evaluation of the outcome of evidence-based practice decisions in individual patients or patient groups is step five in the evidence-based practice approach. Outcome measures are any measures that reflect patient status. Status or outcome measures can be used to detect change over time (eg, treatment effects), to discriminate among clinical groups, or to predict future outcomes (eg, return to work). A variety of reliable and valid physical impairment and disability measures are available to assess treatment outcomes in hand surgery and therapy. Evidence from research studies that includes normative data, standard error of measurement, or comparative scores for important clinical subgroups can be used to set treatment goals, monitor recovery, and compare individual patient outcomes to those reported in the literature. Clinicians tend to rely on impairment measures, such as radiographic measures, grip strength, and range of motion, although self-report measures are known to be equally reliable and more related to global effects, such as return-to-work. The process of selecting and implementing outcome measures is crucial. This process works best when team members are involved and willing to trial new measures. In this way, the team can develop customized outcome assessment procedures that meet their needs for assessing individual patients and providing data for program evaluation.

  17. Patient-reported outcome measures in reconstructive breast surgery: is there a role for generic measures?

    PubMed

    Korus, Lisa J; Cypel, Tatiana; Zhong, Toni; Wu, Albert W

    2015-03-01

    Patient-reported outcomes provide an invaluable tool in the assessment of outcomes in plastic surgery. Traditionally, patient-reported outcomes have consisted of either generic or ad hoc measures; however, more recently, there has been interest in formally constructed and validated questionnaires that are specifically designed for a particular patient population. The purpose of this systematic review was to determine whether generic measures still have a role in the evaluation of breast reconstruction outcomes, given the recent popularity and push for use of specific measures. A systematic review was performed to identify all articles using patient-reported outcomes in the assessment of postmastectomy breast reconstruction. Frequency of use was tabulated and the most frequently used tools were assessed for success of use, using criteria described previously by the Medical Outcomes Trust. To date, the most frequently used measures are still generic measures. The 36-Item Short-Form Health Survey was the most frequently used and most successfully applied showing evidence of responsiveness in multiple settings. Other measures such as the Hospital Anxiety and Depression Scale, the Hopwood Body Image Scale, and the Rosenberg Self-Esteem Scale were able to show responsiveness in certain settings but lacked evidence as universal tools for the assessment of outcomes in reconstructive breast surgery. Despite the recent advent of measures designed specifically to assess patient-reported outcomes in the breast reconstruction population, there still appears to be a role for the use of generic instruments. Many of these tools would benefit from undergoing formal validation in the breast reconstruction population.

  18. Made to Measure: College Leaders Come Together to Strengthen Institutional Accountability

    ERIC Educational Resources Information Center

    Boerner, Heather

    2015-01-01

    Since the American Association of Community Colleges (AACC) launched the Voluntary Framework of Accountability (VFA) in 2011, accountability measures have sprung up in just about every corner of higher education. There is the Integrated Postsecondary Education Data System (IPEDS), the National Governors Association's Complete to Compete program,…

  19. Standards for definitions and use of outcome measures for clinical effectiveness research in perioperative medicine: European Perioperative Clinical Outcome (EPCO) definitions: a statement from the ESA-ESICM joint taskforce on perioperative outcome measures.

    PubMed

    Jammer, Ib; Wickboldt, Nadine; Sander, Michael; Smith, Andrew; Schultz, Marcus J; Pelosi, Paolo; Leva, Brigitte; Rhodes, Andrew; Hoeft, Andreas; Walder, Bernhard; Chew, Michelle S; Pearse, Rupert M

    2015-02-01

    There is a need for large trials that test the clinical effectiveness of interventions in the field of perioperative medicine. Clinical outcome measures used in such trials must be robust, clearly defined and patient-relevant. Our objective was to develop standards for the use of clinical outcome measures to strengthen the methodological quality of perioperative medicine research. A literature search was conducted using PubMed and opinion leaders worldwide were invited to nominate papers that they believed the group should consider. The full texts of relevant articles were reviewed by the taskforce members and then discussed to reach a consensus on the required standards. The report was then circulated to opinion leaders for comment and review. This report describes definitions for 22 individual adverse events with a system of severity grading for each. In addition, four composite outcome measures were identified, which were designed to evaluate postoperative outcomes. The group also agreed on standards for four outcome measures for the evaluation of healthcare resource use and quality of life. Guidance for use of these outcome measures is provided, with particular emphasis on appropriate duration of follow-up. This report provides clearly defined and patient-relevant outcome measures for large clinical trials in perioperative medicine. These outcome measures may also be of use in clinical audit. This report is intended to complement and not replace other related work to improve assessment of clinical outcomes following specific surgical procedures.

  20. Does public reporting measure up? Federalism, accountability and child-care policy in Canada.

    PubMed

    Anderson, Lynell; Findlay, Tammy

    2010-01-01

    Governments in Canada have recently been exploring new accountability measures within intergovernmental relations. Public reporting has become the preferred mechanism in a range of policy areas, including early learning and child-care, and the authors assess its effectiveness as an accountability measure. The article is based on their experience with a community capacity-building project that considers the relationship between the public policy, funding and accountability mechanisms under the federal/provincial/territorial agreements related to child-care. The authors argue that in its current form, public reporting has not lived up to its promise of accountability to citizens. This evaluation is based on the standards that governments have set for themselves under the federal/provincial/territorial agreements, as well as guidelines set by the Public Sector Accounting Board, an independent body that develops accounting standards over time through consultation with governments.

  1. The Popularity of Outcome Measures for Hip and Knee Arthroplasties.

    PubMed

    Lovelock, Thomas M; Broughton, Nigel S; Williams, Cylie M

    2018-01-01

    The optimal methods of determining outcomes following hip and knee arthroplasty remain controversial. The objectives of this study were to determine the most frequently used outcome measures in randomized controlled trials (RCT) and study protocols registered with clinical trials registries (CTR) on hip and knee arthroplasty. A systematic search strategy was undertaken to identify the outcome measures used in RCT and CTR following joint arthroplasty. Databases searched included Embase, Ovid MEDLINE (including In-Process), Cochrane Central Register of Controlled Trials, CINAHL Plus, clinicaltrials.gov, ISRCTN registry, and ANZCTR. Differences in the use of outcome measures between RCT and CTR were assessed using logistic regression. There were 291 RCT and 113 CTR on hip arthroplasty and 452 RCT and 184 CTR on knee arthroplasty that met the inclusion criteria. The most popular outcome measures were the Harris Hip Score and the Knee Society Score. Multiple outcome measures were used in greater than 50% of the included studies. The Oxford Hip Score, Oxford Knee Score, EuroQol-5D, and Knee Injury and Osteoarthritis Outcome Score (all P < .001) were used in significantly more CTR than RCT. There is a clear preference for the use of the Harris Hip Score and Knee Society Score, contrary to existing international guidelines and reviews on the topic. Both measures require clinician input, which potentially influences their validity and increases their overall administration cost. Some patient-reported outcome measures, such as the Oxford Hip and Knee Scores, EuroQol-5D, and KOOS, appear to be increasing in popularity. Copyright © 2017 Elsevier Inc. All rights reserved.

  2. Clinical outcome measurement: Models, theory, psychometrics and practice.

    PubMed

    McClimans, Leah; Browne, John; Cano, Stefan

    In the last decade much has been made of the role that models play in the epistemology of measurement. Specifically, philosophers have been interested in the role of models in producing measurement outcomes. This discussion has proceeded largely within the context of the physical sciences, with notable exceptions considering measurement in economics. However, models also play a central role in the methods used to develop instruments that purport to quantify psychological phenomena. These methods fall under the umbrella term 'psychometrics'. In this paper, we focus on Clinical Outcome Assessments (COAs) and discuss two measurement theories and their associated models: Classical Test Theory (CTT) and Rasch Measurement Theory. We argue that models have an important role to play in coordinating theoretical terms with empirical content, but to do so they must serve: 1) as a representation of the measurement interaction; and 2) in conjunction with a theory of the attribute in which we are interested. We conclude that Rasch Measurement Theory is a more promising approach than CTT in these regards despite the latter's popularity with health outcomes researchers. Copyright © 2017. Published by Elsevier Ltd.

  3. Measuring Inclusive Education Outcomes in Alberta, Canada

    ERIC Educational Resources Information Center

    Loreman, Tim

    2014-01-01

    This study details the results of a review of the academic and public sector literature on measuring inclusive education in large systems. It highlights some outcomes drawn from the international literature on inclusion that might be indicative of the presence and quality of inclusive education in an effort to develop a set of outcomes for…

  4. Applying Outcome Measurements: A Guide to Educational Outcome Measurements and Their Uses. Seminar No. 5.

    ERIC Educational Resources Information Center

    Glaser, Ezra

    This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with the application of outcome…

  5. Questionnaires for Measuring Refractive Surgery Outcomes.

    PubMed

    Kandel, Himal; Khadka, Jyoti; Lundström, Mats; Goggin, Michael; Pesudovs, Konrad

    2017-06-01

    To identify the questionnaires used to assess refractive surgery outcomes, assess the available questionnaires in regard to their psychometric properties, validity, and reliability, and evaluate the performance of the available questionnaires in measuring refractive surgery outcomes. An extensive literature search was done on PubMed, MEDLINE, Scopus, CINAHL, Cochrane, and Web of Science databases to identify articles that described or used at least one questionnaire to assess refractive surgery outcomes. The information on content quality, validity, reliability, responsiveness, and psychometric properties was extracted and analyzed based on an extensive set of quality criteria. Eighty-one articles describing 27 questionnaires (12 refractive error-specific, including 4 refractive surgery-specific, 7 vision-but-non-refractive, and 8 generic) were included in the review. Most articles (56, 69.1%) described refractive error-specific questionnaires. The Quality of Life Impact of Refractive Correction (QIRC), the Quality of Vision (QoV), and the Near Activity Visual Questionnaire (NAVQ) were originally constructed using Rasch analysis; others were developed using the Classical Test Theory. The National Eye Institute Refractive Quality of Life questionnaire was the most frequently used questionnaire, but it does not provide a valid measurement. The QoV, QIRC, and NAVQ are the three best existing questionnaires to assess visual symptoms, quality of life, and activity limitations, respectively. This review identified three superior quality questionnaires for measuring different aspects of quality of life in refractive surgery. Clinicians and researchers should choose a questionnaire based on the concept being measured with superior psychometric properties. [J Refract Surg. 2017;33(6):416-424.]. Copyright 2017, SLACK Incorporated.

  6. Transparency & Accountability: An Evaluation of the VSA College Portrait Pilot. A Special Report from the National Institute for Learning Outcomes Assessment for the Voluntary System of Accountability

    ERIC Educational Resources Information Center

    Jankowski, Natasha A.; Ikenberry, Stanley O.; Kinzie, Jillian; Kuh, George D.; Shenoy, Gloria F.; Baker, Gianina R.

    2012-01-01

    The Voluntary System of Accountability (VSA) is a vehicle for public four-year universities to report comparable information about the undergraduate student experience via the College Portrait, a common web reporting template. The National Institute for Learning Outcomes Assessment (NILOA) was asked by the VSA to evaluate the effectiveness of the…

  7. Education Outcomes, School Governance and Parents' Demand for Accountability: Evidence from Albania. Policy Research Working Paper 5643

    ERIC Educational Resources Information Center

    Serra, Danila; Barr, Abigail; Packard, Truman

    2011-01-01

    The extent to which teachers and school directors are held to account may play a central role in determining education outcomes, particularly in developing and transition countries where institutional deficiencies can distort incentives. This paper investigates the relationship between an expanded set of school inputs, including proxies for the…

  8. 48 CFR 9904.412 - Cost accounting standard for composition and measurement of pension cost.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... accounting standard for composition and measurement of pension cost. ... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Cost accounting standard for composition and measurement of pension cost. 9904.412 Section 9904.412 Federal Acquisition...

  9. Measuring Patient-Reported Outcomes: Key Metrics in Reconstructive Surgery.

    PubMed

    Voineskos, Sophocles H; Nelson, Jonas A; Klassen, Anne F; Pusic, Andrea L

    2018-01-29

    Satisfaction and improved quality of life are among the most important outcomes for patients undergoing plastic and reconstructive surgery for a variety of diseases and conditions. Patient-reported outcome measures (PROMs) are essential tools for evaluating the benefits of newly developed surgical techniques. Modern PROMs are being developed with new psychometric approaches, such as Rasch Measurement Theory, and their measurement properties (validity, reliability, responsiveness) are rigorously tested. These advances have resulted in the availability of PROMs that provide clinically meaningful data and effectively measure functional as well as psychosocial outcomes. This article guides the reader through the steps of creating a PROM and highlights the potential research and clinical uses of such instruments. Limitations of PROMs and anticipated future directions in this field are discussed.

  10. Toward a Measure of Accountability in Nursing: A Three-Stage Validation Study.

    PubMed

    Drach-Zahavy, Anat; Leonenko, Marina; Srulovici, Einav

    2018-06-04

    To develop and psychometrically evaluate a three-dimensional questionnaire suitable for evaluating personal and organizational accountability in nurses. Accountability is defined as a three-dimensional value, directing professionals to take responsibility for their decisions and actions, to be willing to explain them (transparency) and to be judged according to society's accepted values (answerability). Despite the relatively clear definition, measurement of accountability lags well behind. Existing self-report questionnaires do not fully capture the complexity of the concept; nor do they capture the different sources of accountability (e.g., personal accountability, organizational accountability). A three-stage measure development. Data were collected during 2015-2016. In Phase 1, an initial database of items (N = 74) was developed, based on literature review and qualitative study, establishing face and content validity. In Phase 2, the face, content, construct and criterion-related validity of the initial questionnaires (19 items for personal and organizational accountability questionnaire) was established with a sample of 229 nurses. In Phase 3, the final questionnaires (19 items each) were validated with a new sample of 329 nurses and established construct validity. The final version of the instruments comprised 19 items, suitable for assessing personal and organizational accountability. The questionnaire referred to the dimensions of responsibility, transparency and answerability. The findings established the instrument's content, construct and criterion-related validity, as well as good internal reliability. The questionnaire portrays accountability in nursing, by capturing nurses' subjective perceptions of accountability dimensions (responsibility, transparency, answerability), as demonstrated by personal and organizational values. This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

  11. Outcome measures in coeliac disease trials: the Tampere recommendations.

    PubMed

    Ludvigsson, Jonas F; Ciacci, Carolina; Green, Peter Hr; Kaukinen, Katri; Korponay-Szabo, Ilma R; Kurppa, Kalle; Murray, Joseph A; Lundin, Knut Erik Aslaksen; Maki, Markku J; Popp, Alina; Reilly, Norelle R; Rodriguez-Herrera, Alfonso; Sanders, David S; Schuppan, Detlef; Sleet, Sarah; Taavela, Juha; Voorhees, Kristin; Walker, Marjorie M; Leffler, Daniel A

    2018-02-13

    A gluten-free diet is the only treatment option of coeliac disease, but recently an increasing number of trials have begun to explore alternative treatment strategies. We aimed to review the literature on coeliac disease therapeutic trials and issue recommendations for outcome measures. Based on a literature review of 10 062 references, we (17 researchers and 2 patient representatives from 10 countries) reviewed the use and suitability of both clinical and non-clinical outcome measures. We then made expert-based recommendations for use of these outcomes in coeliac disease trials and identified areas where research is needed. We comment on the use of histology, serology, clinical outcome assessment (including patient-reported outcomes), quality of life and immunological tools including gluten immunogenic peptides for trials in coeliac disease. Careful evaluation and reporting of outcome measures will increase transparency and comparability of coeliac disease therapeutic trials, and will benefit patients, healthcare and the pharmaceutical industry. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

  12. Learning Outcomes across Disciplines and Professions: Measurement and Interpretation

    ERIC Educational Resources Information Center

    Caspersen, Joakim; Frølich, Nicoline; Karlsen, Hilde; Aamodt, Per Olaf

    2014-01-01

    Learning outcomes of higher education are a quality tool in a changing higher education landscape but cannot be seen as neutral measures across professions and disciplines. Survey results from graduates and recent graduates indicate that prevailing measures of learning outcomes yield the same result within and across disciplinary and professional…

  13. Recommendations for Self-Report Outcome Measures in Vulvodynia Clinical Trials.

    PubMed

    Pukall, Caroline F; Bergeron, Sophie; Brown, Candace; Bachmann, Gloria; Wesselmann, Ursula

    2017-08-01

    Vulvodynia (idiopathic chronic vulvar pain) is a prevalent condition associated with significant and negative impacts in many areas of function. Despite the increased research interest in vulvodynia in recent years, recommendations for outcome measures for use in clinical trials are missing. The purpose of this paper, therefore, was to provide recommendations for outcome measures for vulvodynia clinical trials so that consistent measures are used across trials to facilitate between-study comparisons and the conduct of large multicenter trials, and to improve measurement of the multiple dimensions of vulvodynia. Given that provoked vestibulodynia (PVD)-characterized by provoked pain localized to the vaginal opening-is the most common subtype of vulvodynia and the current main focus of clinical trials, this paper focused on recommended outcome measures in PVD clinical trials. The framework used to guide the selection of outcome measures was based on the one proposed by the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT). The IMMPACT framework provided a well-suited guideline for outcome measure recommendations in PVD clinical trials. However, given the provoked presentation of PVD and the significant impact it has on sexuality, modifications to some of the IMMPACT recommendations were made and specific additional measures were suggested. Measures that are specific to vulvovaginal pain are ideal for adoption in PVD clinical trials, and many such measures currently exist that allow the relevant IMMPACT domains to be captured.

  14. Outcomes assessment in rotator cuff pathology: what are we measuring?

    PubMed

    Makhni, Eric C; Steinhaus, Michael E; Morrow, Zachary S; Jobin, Charles M; Verma, Nikhil N; Cole, Brian J; Bach, Bernard R

    2015-12-01

    Assessments used to measure outcomes associated with rotator cuff pathology and after repair are varied. This lack of standardization leads to difficulty drawing comparisons across studies. We hypothesize that this variability in patient-reported outcome measures and objective metrics used in rotator cuff studies persists even in high-impact, peer reviewed journals. All studies assessing rotator cuff tear and repair outcomes in 6 orthopedic journals with a high impact factor from January 2010 to December 2014 were reviewed. Cadaveric and animal studies and those without outcomes were excluded. Outcome measures included range of motion (forward elevation, abduction, external rotation, and internal rotation), strength (in the same 4 planes), tendon integrity imaging, patient satisfaction, and functional assessment scores. Of the 156 included studies, 63% documented range of motion measurements, with 18% reporting range of motion in all 4 planes. Only 38% of studies reported quantitative strength measurements. In 65% of studies, tendon integrity was documented with imaging (38% magnetic resonance imaging/magnetic resonance anrhrogram, 31% ultrasound, and 8% computed tomography arthrogram). Finally, functional score reporting varied significantly, with the 5 most frequently reported scores ranging from 16% to 61% in studies, and 15 of the least reported outcomes were each reported in ≤6% of studies. Significant variability exists in outcomes reporting after rotator cuff tear and repair, making comparisons between clinical studies difficult. Creating a uniformly accepted, validated outcomes tool that assesses pain, function, patient satisfaction, and anatomic integrity would enable consistent outcomes assessment after operative and nonoperative management and allow comparisons across the literature. Copyright © 2015 Journal of Shoulder and Elbow Surgery Board of Trustees. Published by Elsevier Inc. All rights reserved.

  15. Comparison of Nurse Staffing Measurements in Staffing-Outcomes Research.

    PubMed

    Park, Shin Hye; Blegen, Mary A; Spetz, Joanne; Chapman, Susan A; De Groot, Holly A

    2015-01-01

    Investigators have used a variety of operational definitions of nursing hours of care in measuring nurse staffing for health services research. However, little is known about which approach is best for nurse staffing measurement. To examine whether various nursing hours measures yield different model estimations when predicting patient outcomes and to determine the best method to measure nurse staffing based on the model estimations. We analyzed data from the University HealthSystem Consortium for 2005. The sample comprised 208 hospital-quarter observations from 54 hospitals, representing information on 971 adult-care units and about 1 million inpatient discharges. We compared regression models using different combinations of staffing measures based on productive/nonproductive and direct-care/indirect-care hours. Akaike Information Criterion and Bayesian Information Criterion were used in the assessment of staffing measure performance. The models that included the staffing measure calculated from productive hours by direct-care providers were best, in general. However, the Akaike Information Criterion and Bayesian Information Criterion differences between models were small, indicating that distinguishing nonproductive and indirect-care hours from productive direct-care hours does not substantially affect the approximation of the relationship between nurse staffing and patient outcomes. This study is the first to explicitly evaluate various measures of nurse staffing. Productive hours by direct-care providers are the strongest measure related to patient outcomes and thus should be preferred in research on nurse staffing and patient outcomes.

  16. Outcome Measures for Clinical Trials in Down Syndrome

    PubMed Central

    Esbensen, Anna J.; Hooper, Stephen R.; Fidler, Deborah; Hartley, Sigan; Edgin, Jamie; d’Ardhuy, Xavier Liogier; Capone, George; Conners, Frances; Mervis, Carolyn B.; Abbeduto, Leonard; Rafii, Michael; Krinsky-McHale, Sharon J.; Urv, Tiina

    2017-01-01

    Increasingly individuals with intellectual and developmental disabilities, including Down syndrome, are being targeted for clinical trials. However, a challenge exists in effectively evaluating the outcomes of these new pharmacological interventions. Few empirically evaluated, psychometrically sound outcome measures appropriate for use in clinical trials with individuals with Down syndrome have been identified. To address this challenge, the NIH assembled leading clinicians and scientists to review existing measures and identify those that currently are appropriate for trials; those that may be appropriate after expansion of age range addition of easier items, and/or downward extension of psychometric norms; and areas where new measures need to be developed. This paper focuses on measures in the areas of cognition and behavior. PMID:28452584

  17. Measuring Quality and Outcomes in Sports Medicine.

    PubMed

    Ruzbarsky, Joseph J; Marom, Niv; Marx, Robert G

    2018-07-01

    Patient-reported outcome measures (PROMs) are objective metrics critical to evaluating outcomes throughout orthopedic surgery. New instruments continue to emerge, increasing the breadth of information required for those intending to use these measures for research or clinical care. Although earlier metrics were developed using the principles of classic test theory, newer instruments constructed using item response theory are amenable to computer-adaptive testing and may change the way these instruments are administered. This article aims to define the psychometric properties that are important to understand when using all PROMs and to review the most widely used instruments in sports medicine. Copyright © 2018 Elsevier Inc. All rights reserved.

  18. Measuring the Alignment between States' Finance and Accountability Policies: The Opportunity Gap

    ERIC Educational Resources Information Center

    Della Sala, Matthew R.; Knoeppel, Robert C.

    2015-01-01

    The research described in this paper expands on attempts to conceptualize, measure, and evaluate the degree to which states have aligned their finance systems with their respective accountability policies. State education finance and accountability policies serve as levers to provide equal educational opportunities for all students--scholars have…

  19. Early Postoperative Measures Predict 1- and 2-Year Outcomes After Unilateral Total Knee Arthroplasty: Importance of Contralateral Limb Strength

    PubMed Central

    Snyder-Mackler, Lynn

    2010-01-01

    Background Total knee arthroplasty (TKA) has been shown to be an effective surgical intervention for people with end-stage knee osteoarthritis. However, recovery of function is variable, and not all people have successful outcomes. Objective The aim of this study was to discern which early postoperative functional measures could predict functional ability at 1 year and 2 years after surgery. Design and Methods One hundred fifty-five people who underwent unilateral TKA participated in the prospective longitudinal study. Functional evaluations were performed at the initial outpatient physical therapy appointment and at 1 and 2 years after surgery. Evaluations consisted of measurements of height, weight, quadriceps muscle strength (force-generating capacity), and knee range of motion; the Timed “Up & Go” Test (TUG); the stair-climbing task (SCT); and the Knee Outcome Survey (KOS) questionnaire. The ability to predict 1- and 2-year outcomes on the basis of early postoperative measures was analyzed with a hierarchical regression. Differences in functional scores were evaluated with a repeated-measures analysis of variance. Results The TUG, SCT, and KOS scores at 1 and 2 years showed significant improvements over the scores at the initial evaluation (P<.001). A weaker quadriceps muscle in the limb that did not undergo surgery (“nonoperated limb”) was related to poorer 1- and 2-year outcomes even after the influence of the other early postoperative measures was accounted for in the regression. Older participants with higher body masses also had poorer outcomes at 1 and 2 years. Postoperative measures were better predictors of TUG and SCT times than of KOS scores. Conclusions Rehabilitation regimens after TKA should include exercises to improve the strength of the nonoperated limb as well as to treat the deficits imposed by the surgery. Emphasis on treating age-related impairments and reducing body mass also might improve long-term outcomes. PMID:19959653

  20. How to Measure Outcomes of Peripheral Nerve Surgery

    PubMed Central

    Wang, Yirong; Sunitha, Malay; Chung, Kevin C.

    2013-01-01

    Synopsis Evaluation of outcomes after peripheral nerve surgeries include a number of assessment methods that reflect different aspects of recovery, including reinnervation, tactile gnosis, integrated sensory and motor function, pain and discomfort, neurophysiological and patient- reported outcomes. This review makes a list of measurements addressing these aspects as well as advantage and disadvantage of each tool. Because of complexities of neurophysiology, assessment remains a difficult process, which requires researchers focus on measurements best relevant to specific conditions and research questions. PMID:23895715

  1. 76 FR 81295 - Cost Accounting Standards: Cost Accounting Standards 412 and 413-Cost Accounting Standards...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2011-12-27

    ... accounting standards governing measurement, assignment, and allocation of costs to contracts with the United... contracting parties; Measurement of pension costs must be objectively verifiable; Accounting rules must keep... cost accounting that preclude their use for the appropriate measurement, assignment and allocation of...

  2. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument.

    PubMed

    Mokkink, Lidwine B; Prinsen, Cecilia A C; Bouter, Lex M; Vet, Henrica C W de; Terwee, Caroline B

    2016-01-19

    COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) is an initiative of an international multidisciplinary team of researchers who aim to improve the selection of outcome measurement instruments both in research and in clinical practice by developing tools for selecting the most appropriate available instrument. In this paper these tools are described, i.e. the COSMIN taxonomy and definition of measurement properties; the COSMIN checklist to evaluate the methodological quality of studies on measurement properties; a search filter for finding studies on measurement properties; a protocol for systematic reviews of outcome measurement instruments; a database of systematic reviews of outcome measurement instruments; and a guideline for selecting outcome measurement instruments for Core Outcome Sets in clinical trials. Currently, we are updating the COSMIN checklist, particularly the standards for content validity studies. Also new standards for studies using Item Response Theory methods will be developed. Additionally, in the future we want to develop standards for studies on the quality of non-patient reported outcome measures, such as clinician-reported outcomes and performance-based outcomes. In summary, we plea for more standardization in the use of outcome measurement instruments, for conducting high quality systematic reviews on measurement instruments in which the best available outcome measurement instrument is recommended, and for stopping the use of poor outcome measurement instruments.

  3. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) and how to select an outcome measurement instrument

    PubMed Central

    Mokkink, Lidwine B.; Prinsen, Cecilia A. C.; Bouter, Lex M.; de Vet, Henrica C. W.; Terwee, Caroline B.

    2016-01-01

    Background: COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) is an initiative of an international multidisciplinary team of researchers who aim to improve the selection of outcome measurement instruments both in research and in clinical practice by developing tools for selecting the most appropriate available instrument. Method: In this paper these tools are described, i.e. the COSMIN taxonomy and definition of measurement properties; the COSMIN checklist to evaluate the methodological quality of studies on measurement properties; a search filter for finding studies on measurement properties; a protocol for systematic reviews of outcome measurement instruments; a database of systematic reviews of outcome measurement instruments; and a guideline for selecting outcome measurement instruments for Core Outcome Sets in clinical trials. Currently, we are updating the COSMIN checklist, particularly the standards for content validity studies. Also new standards for studies using Item Response Theory methods will be developed. Additionally, in the future we want to develop standards for studies on the quality of non-patient reported outcome measures, such as clinician-reported outcomes and performance-based outcomes. Conclusions: In summary, we plea for more standardization in the use of outcome measurement instruments, for conducting high quality systematic reviews on measurement instruments in which the best available outcome measurement instrument is recommended, and for stopping the use of poor outcome measurement instruments. PMID:26786084

  4. Adapting Accountability Systems to the Limitations of Educational Measurement

    ERIC Educational Resources Information Center

    Kane, Michael

    2015-01-01

    Michael Kane writes in this article that he is in more or less complete agreement with Professor Koretz's characterization of the problem outlined in the paper published in this issue of "Measurement." Kane agrees that current testing practices are not adequate for test-based accountability (TBA) systems, but he writes that he is far…

  5. Outcome Measures for Clinical Trials in Down Syndrome.

    PubMed

    Esbensen, Anna J; Hooper, Stephen R; Fidler, Deborah; Hartley, Sigan L; Edgin, Jamie; d'Ardhuy, Xavier Liogier; Capone, George; Conners, Frances A; Mervis, Carolyn B; Abbeduto, Leonard; Rafii, Michael; Krinsky-McHale, Sharon J; Urv, Tiina

    2017-05-01

    Increasingly individuals with intellectual and developmental disabilities, including Down syndrome, are being targeted for clinical trials. However, a challenge exists in effectively evaluating the outcomes of these new pharmacological interventions. Few empirically evaluated, psychometrically sound outcome measures appropriate for use in clinical trials with individuals with Down syndrome have been identified. To address this challenge, the National Institutes of Health (NIH) assembled leading clinicians and scientists to review existing measures and identify those that currently are appropriate for trials; those that may be appropriate after expansion of age range addition of easier items, and/or downward extension of psychometric norms; and areas where new measures need to be developed. This article focuses on measures in the areas of cognition and behavior.

  6. Measuring Outcomes for Children Late Placed for Adoption.

    ERIC Educational Resources Information Center

    Rushton, Alan

    1998-01-01

    Describes the selection of outcome measures used by the Maudsley Family Research team to assess outcomes--across a broad range of developmental dimensions--of permanent placement for children and adolescents. Developed a package of instruments to examine child emotional, cognitive, social, and academic development; attachment; and self-esteem, for…

  7. How to measure outcomes of peripheral nerve surgery.

    PubMed

    Wang, Yirong; Sunitha, Malay; Chung, Kevin C

    2013-08-01

    Evaluation of outcomes after peripheral nerve surgeries include several assessment methods that reflect different aspects of recovery, including reinnervation, tactile gnosis, integrated sensory and motor function, pain and discomfort, and neurophysiologic and patient-reported outcomes. This review lists measurements addressing these aspects as well as the advantages and disadvantages of each tool. Because of complexities of neurophysiology, assessment remains a difficult process, which requires researchers to focus on measurements best relevant to specific conditions and research questions. Copyright © 2013 Elsevier Inc. All rights reserved.

  8. Development of a core set of outcome measures for OAB treatment.

    PubMed

    Foust-Wright, Caroline; Wissig, Stephanie; Stowell, Caleb; Olson, Elizabeth; Anderson, Anita; Anger, Jennifer; Cardozo, Linda; Cotterill, Nikki; Gormley, Elizabeth Ann; Toozs-Hobson, Philip; Heesakkers, John; Herbison, Peter; Moore, Kate; McKinney, Jessica; Morse, Abraham; Pulliam, Samantha; Szonyi, George; Wagg, Adrian; Milsom, Ian

    2017-12-01

    Standardized measures enable the comparison of outcomes across providers and treatments giving valuable information for improving care quality and efficacy. The aim of this project was to define a minimum standard set of outcome measures and case-mix factors for evaluating the care of patients with overactive bladder (OAB). The International Consortium for Health Outcomes Measurement (ICHOM) convened an international working group (WG) of leading clinicians and patients to engage in a structured method for developing a core outcome set. Consensus was determined by a modified Delphi process, and discussions were supported by both literature review and patient input. The standard set measures outcomes of care for adults seeking treatment for OAB, excluding residents of long-term care facilities. The WG focused on treatment outcomes identified as most important key outcome domains to patients: symptom burden and bother, physical functioning, emotional health, impact of symptoms and treatment on quality of life, and success of treatment. Demographic information and case-mix factors that may affect these outcomes were also included. The standardized outcome set for evaluating clinical care is appropriate for use by all health providers caring for patients with OAB, regardless of specialty or geographic location, and provides key data for quality improvement activities and research.

  9. Safety outcomes in the United States: trends and challenges in measurement.

    PubMed

    Greenberg, Michael D; Haviland, Amelia M; Yu, Hao; Farley, Donna O

    2009-04-01

    To prepare Agency for Healthcare Research and Quality (AHRQ) for monitoring the impact of its own patient safety initiative, by exploring available outcomes data, assessing usability of measures, and estimating national trends in patient outcomes. Annual summary data on incidence of Joint Commission Sentinel Events, MEDMARX medication error events, and MDS measures of falls and pressure ulcers in nursing home residents. HCUP National Inpatient Sample (NIS) administrative claims data. Description and assessment of published summary data on selected safety measures. Analysis of selected Patient Safety Indicators (PSIs) and Utah–Missouri adverse event measures using HCUP NIS claims data (1994–2003). Interpretation of safety outcome trends requires close attention to the characteristics of underlying data sources and measures. Encounter-based measures have been affected by changes in definitions and ICD-9 coding, as well as by changes in the structure of administrative datasets like HCUP NIS. Historical trends are mixed for the safety outcome measures reviewed, with some measures showing improvement, others deterioration, and still others remaining fairly stable. Constructing national trends of safety outcomes is difficult because of limitations in available data sources and measures. Tracking growth in the adoption of safe practices could offer an important strategy for complementing existing safety measurement capabilities.

  10. Teacher, parent, and peer reports of early aggression as screening measures for long-term maladaptive outcomes: Who provides the most useful information?

    PubMed Central

    Clemans, Katherine H.; Musci, Rashelle J.; Leoutsakos, Jeannie-Marie S.; Ialongo, Nicholas S.

    2014-01-01

    Objective This study compared the ability of teacher, parent, and peer reports of aggressive behavior in early childhood to accurately classify cases of maladaptive outcomes in late adolescence and early adulthood. Method Weighted kappa analyses determined optimal cut points and relative classification accuracy among teacher, parent, and peer reports of aggression assessed for 691 students (54% male; 84% African American, 13% White) in the fall of first grade. Outcomes included antisocial personality, substance use, incarceration history, risky sexual behavior, and failure to graduate from high school on time. Results Peer reports were the most accurate classifier of all outcomes in the full sample. For most outcomes, the addition of teacher or parent reports did not improve overall classification accuracy once peer reports were accounted for. Additional gender-specific and adjusted kappa analyses supported the superior classification utility of the peer report measure. Conclusion The results suggest that peer reports provided the most useful classification information of the three aggression measures. Implications for targeted intervention efforts which use screening measures to identify at-risk children are discussed. PMID:24512126

  11. Teacher, parent, and peer reports of early aggression as screening measures for long-term maladaptive outcomes: who provides the most useful information?

    PubMed

    Clemans, Katherine H; Musci, Rashelle J; Leoutsakos, Jeannie-Marie S; Ialongo, Nicholas S

    2014-04-01

    This study compared the ability of teacher, parent, and peer reports of aggressive behavior in early childhood to accurately classify cases of maladaptive outcomes in late adolescence and early adulthood. Weighted kappa analyses determined optimal cut points and relative classification accuracy among teacher, parent, and peer reports of aggression assessed for 691 students (54% male; 84% African American and 13% White) in the fall of first grade. Outcomes included antisocial personality, substance use, incarceration history, risky sexual behavior, and failure to graduate from high school on time. Peer reports were the most accurate classifier of all outcomes in the full sample. For most outcomes, the addition of teacher or parent reports did not improve overall classification accuracy once peer reports were accounted for. Additional gender-specific and adjusted kappa analyses supported the superior classification utility of the peer report measure. The results suggest that peer reports provided the most useful classification information of the 3 aggression measures. Implications for targeted intervention efforts in which screening measures are used to identify at-risk children are discussed.

  12. Identifying an outcome measure to assess the impact of Mobility Dogs.

    PubMed

    Mudge, Suzie; Rewi, Dallas; Channon, Alexis

    2017-01-01

    Mobility Dogs® trains dogs to work with people with physical disabilities to increase independence, confidence, self-esteem and participation. Mobility Dogs® seeks to critically evaluate and improve its services as it grows. This study aimed to identify and implement a standardised outcome measure into practice at Mobility Dogs®. Based on the Consolidated Framework for Implementation Research and guided by a steering group of key stakeholders, a three-phase approach was developed to identify and assess an outcome measure. The steering group highlighted the organisation's specific needs, selected participation as the assessment domain and identified core utility requirements of the measure. A comprehensive review of evidence was undertaken to identify and rank potential measures according to the specified needs. Of the seven participation outcome measures that met inclusion criteria, the three highest ranked measures were critically evaluated by the steering group to determine suitability against the organisation's needs. The Impact on Participation and Autonomy (IPA) was selected for implementation into practice at Mobility Dogs®. Use of the IPA is an important first step for Mobility Dogs® to test the benefits of trained service dogs. This process could be replicated by other service dog organisations to identify outcome measures to assess their own services. Implications for Rehabilitation Service dogs (such as Mobility Dogs® in New Zealand) assist people living with physical impairments by performing tasks, however there is limited evidence on outcomes. The process for selecting an appropriate outcome measure for Mobility Dogs® involving partnership between Mobility Dogs® personnel and academics was an effective way to steer the project by determining important properties of the measure, before a search of the literature was undertaken. While the IPA was selected as the most appropriate outcome measure for use at Mobility Dogs®, it was the process that

  13. A Consensus Set of Outcomes for Parkinson’s Disease from the International Consortium for Health Outcomes Measurement

    PubMed Central

    de Roos, Paul; Bloem, Bastiaan R.; Kelley, Thomas A.; Antonini, Angelo; Dodel, Richard; Hagell, Peter; Marras, Connie; Martinez-Martin, Pablo; Mehta, Shyamal H.; Odin, Per; Chaudhuri, Kallol Ray; Weintraub, Daniel; Wilson, Bil; Uitti, Ryan J.

    2017-01-01

    Background Parkinson’s disease (PD) is a progressive neurodegenerative condition that is expected to double in prevalence due to demographic shifts. Value-based healthcare is a proposed strategy to improve outcomes and decrease costs. To move towards an actual value-based health care system, condition-specific outcomes that are meaningful to patients are essential. Objective Propose a global consensus standard set of outcome measures for PD. Methods Established methods for outcome measure development were applied, as outlined and used previously by the International Consortium for Health Outcomes Measurement (ICHOM). An international group, representing both patients and experts from the fields of neurology, psychiatry, nursing, and existing outcome measurement efforts, was convened. The group participated in six teleconferences over a six-month period, reviewed existing data and practices, and ultimately proposed a standard set of measures by which patients should be tracked, and how often data should be collected. Results The standard set applies to all cases of idiopathic PD, and includes assessments of motor and non-motor symptoms, ability to work, PD-related health status, and hospital admissions. Baseline demographic and clinical variables are included to enable case mix adjustment. Conclusions The Standard Set is now ready for use and pilot testing in the clinical setting. Ultimately, we believe that using the set of outcomes proposed here will allow clinicians and scientists across the world to document, report, and compare PD-related outcomes in a standardized fashion. Such international benchmarks will improve our understanding of the disease course and allow for identification of ‘best practices’, ultimately leading to better informed treatment decisions. PMID:28671140

  14. Perspectives on differing health outcomes by city: accounting for Glasgow's excess mortality.

    PubMed

    Fraser, Simon Ds; George, Steve

    2015-01-01

    Several health outcomes (including mortality) and health-related behaviors are known to be worse in Scotland than in comparable areas of Europe and the United Kingdom. Within Scotland, Greater Glasgow (in West Central Scotland) experiences disproportionately poorer outcomes independent of measurable variation in socioeconomic status and other important determinants. Many reasons for this have been proposed, particularly related to deprivation, inequalities, and variation in health behaviors. The use of models (such as the application of Bradford Hill's viewpoints on causality to the different hypotheses) has provided useful insights on potentially causal mechanisms, with health behaviors and inequalities likely to represent the strongest individual candidates. This review describes the evolution of our understanding of Glasgow's excess mortality, summarizes some of the key work in this area, and provides some suggestions for future areas of exploration. In the context of demographic change, the experience in Glasgow is an important example of the complexity that frequently lies behind observed variations in health outcomes within and between populations. A comprehensive explanation of Glasgow's excess mortality may continue to remain elusive, but is likely to lie in a complex and difficult-to-measure interplay of health determinants acting at different levels in society throughout the life course. Lessons learned from the detailed examination of different potentially causative determinants in Scotland may provide useful methodological insights that may be applied in other settings. Ongoing efforts to unravel the causal mechanisms are needed to inform public health efforts to reduce health inequalities and improve outcomes in Scotland.

  15. Developing a Set of Uniform Outcome Measures for Adult Day Services.

    PubMed

    Anderson, Keith A; Geboy, Lyn; Jarrott, Shannon E; Missaelides, Lydia; Ogletree, Aaron M; Peters-Beumer, Lisa; Zarit, Steven H

    2018-06-01

    Adult day services (ADS) provide care to adults with physical, functional, and/or cognitive limitations in nonresidential, congregate, community-based settings. ADS programs have emerged as a growing and affordable approach within the home and community-based services sector. Although promising, the growth of ADS has been hampered by a lack of uniform outcome measures and data collection protocols. In this article, the authors detail a recent effort by leading researchers and practitioners in ADS to develop a set of uniform outcome measures. Based upon three recent efforts to develop outcome measures, selection criteria were established and an iterative process was conducted to debate the merits of outcome measures across three domains-participant well-being, caregiver well-being, and health care utilization. The authors conclude by proposing a uniform set of outcome measures to (a) standardize data collection, (b) aid in the development of programming, and (c) facilitate the leveraging of additional funding for ADS.

  16. Measurement and the Professions: Lessons from Accounting, Law, and Medicine.

    ERIC Educational Resources Information Center

    Nowakowski, Jeri; And Others

    1983-01-01

    This detailed analysis of the role of measurement across the three professions of law, medicine, and accounting offers insights into entry-level and performance barriers in occupations that rely on certification, licensing, and regulation to influence performance, ethics, and training. (Author/PN)

  17. Measuring outcomes in adult spinal deformity surgery: a systematic review to identify current strengths, weaknesses and gaps in patient-reported outcome measures.

    PubMed

    Faraj, Sayf S A; van Hooff, Miranda L; Holewijn, Roderick M; Polly, David W; Haanstra, Tsjitske M; de Kleuver, Marinus

    2017-08-01

    Adult spinal deformity (ASD) causes severe disability, reduces overall quality of life, and results in a substantial societal burden of disease. As healthcare is becoming more value based, and to facilitate global benchmarking, it is critical to identify and standardize patient-reported outcome measures (PROMs). This study aims to identify the current strengths, weaknesses, and gaps in PROMs used for ASD. Studies were included following a systematic search in multiple bibliographic databases between 2000 and 2015. PROMs were extracted and linked to the outcome domains of WHO's International Classification of Functioning and Health (ICF) framework. Subsequently, the clinimetric quality of identified PROMs was evaluated. The literature search identified 144 papers that met the inclusion criteria, and nine frequently used PROMs were identified. These covered 29 ICF outcome domains, which could be grouped into three of the four main ICF chapters: body function (n = 7), activity and participation (n = 19), environmental factors (n = 3), and body structure (n = 0). A low quantity (n = 3) of papers was identified that studied the clinimetric quality of PROMs. The Scoliosis Research Society (SRS)-22 has the highest level of clinimetric quality for ASD. Outcome domains related to mobility and pain were well represented. We identified a gap in current outcome measures regarding neurological and pulmonary function. In addition, no outcome domains were measured in the ICF chapter body structure. These results will serve as a foundation for the process of seeking international consensus on a standard set of outcome domains, accompanied PROMs and contributing factors to be used in future clinical trials and spine registries.

  18. Outcome Measures for Early Childhood Intervention Services.

    ERIC Educational Resources Information Center

    Accreditation Council on Services for People with Disabilities, Landover, MD.

    This collection of 21 suggested outcome measures for early childhood intervention services is intended to apply to all types of service and support program models for children (birth to age 5) with various developmental delays and/or disabilities. The measures are appropriate for either home-based or center-based service delivery models. Section 1…

  19. Responsiveness of outcome measures for upper limb prosthetic rehabilitation.

    PubMed

    Resnik, Linda; Borgia, Matthew

    2016-02-01

    There is limited research on responsiveness of prosthetic rehabilitation outcome measures. To examine responsiveness of the Box and Block test, Jebsen-Taylor Hand Function tests, Upper Extremity Functional Scale, University of New Brunswick skill and spontaneity tests, Activity Measure for Upper Limb Amputation, and the Patient-Specific Functional Scale. This was a quasi-experimental study with repeated measurements in a convenience sample of upper limb amputees. Measures were collected before, during, and after training with the DEKA Arm. Largest effect sizes were observed for Patient-Specific Functional Scale (effect size: 1.59, confidence interval: 1.00, 2.14), Activity Measure for Upper Limb Amputation (effect size: 1.33, confidence interval: 0.73, 1.90), and University of New Brunswick skill test (effect size: 1.18, confidence interval: 0.61, 1.73). Other measures that were responsive to change were Box and Block test, Jebsen-Taylor Hand Function light and heavy can tests, and University of New Brunswick spontaneity test. Responsiveness and pattern of responsiveness varied by prosthetic level. The Box and Block test, Jebsen-Taylor Hand Function light and heavy can tests, University of New Brunswick skill and spontaneity tests, Activities Measure for Upper Limb Amputation, and the Patient-Specific Functional Scale were responsive to change during prosthetic training. These findings have implications for choice of measures for research and practice and inform clinicians about the amount of training necessary to maximize outcomes with the DEKA Arm. Findings on responsiveness of outcome measures have implications for the choice of measures for clinical trials and practice. Findings regarding the responsiveness to change over the course of training can inform clinicians about the amount of training that may be necessary to maximize specific outcomes with the DEKA Arm. © The International Society for Prosthetics and Orthotics 2014.

  20. Integration of technology-based outcome measures in clinical trials of Parkinson and other neurodegenerative diseases.

    PubMed

    Artusi, Carlo Alberto; Mishra, Murli; Latimer, Patricia; Vizcarra, Joaquin A; Lopiano, Leonardo; Maetzler, Walter; Merola, Aristide; Espay, Alberto J

    2018-01-01

    We sought to review the landscape of past, present, and future use of technology-based outcome measures (TOMs) in clinical trials of neurodegenerative disorders. We systematically reviewed PubMed and ClinicalTrials.gov for published and ongoing clinical trials in neurodegenerative disorders employing TOMs. In addition, medical directors of selected pharmaceutical companies were surveyed on their companies' ongoing efforts and future plans to integrate TOMs in clinical trials as primary, secondary, or exploratory endpoints. We identified 164 published clinical trials indexed in PubMed that used TOMs as outcome measures in Parkinson disease (n = 132) or other neurodegenerative disorders (n = 32). The ClinicalTrials.gov search yielded 42 clinical trials using TOMs, representing 2.7% of ongoing trials. Sensor-based technology accounted for over 75% of TOMs applied. Gait and physical activity were the most common targeted domains. Within the next 5 years, 83% of surveyed pharmaceutical companies engaged in neurodegenerative disorders plan to deploy TOMs in clinical trials. Although promising, TOMs are underutilized in clinical trials of neurodegenerative disorders. Validating relevant endpoints, standardizing measures and procedures, establishing a single platform for integration of data and algorithms from different devices, and facilitating regulatory approvals should advance TOMs integration into clinical trials. Copyright © 2017 Elsevier Ltd. All rights reserved.

  1. Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures.

    PubMed

    Barkham, M; Margison, F; Leach, C; Lucock, M; Mellor-Clark, J; Evans, C; Benson, L; Connell, J; Audin, K; McGrath, G

    2001-04-01

    To complement the evidence-based practice paradigm, the authors argued for a core outcome measure to provide practice-based evidence for the psychological therapies. Utility requires instruments that are acceptable scientifically, as well as to service users, and a coordinated implementation of the measure at a national level. The development of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is summarized. Data are presented across 39 secondary-care services (n = 2,710) and within an intensively evaluated single service (n = 1,455). Results suggest that the CORE-OM is a valid and reliable measure for multiple settings and is acceptable to users and clinicians as well as policy makers. Baseline data levels of patient presenting problem severity, including risk, are reported in addition to outcome benchmarks that use the concept of reliable and clinically significant change. Basic quality improvement in outcomes for a single service is considered.

  2. Measurement properties of patient-reported outcome measures (PROMS) in Patellofemoral Pain Syndrome: a systematic review.

    PubMed

    Green, Andrew; Liles, Clive; Rushton, Alison; Kyte, Derek G

    2014-12-01

    This systematic review investigated the measurement properties of disease-specific patient-reported outcome measures used in Patellofemoral Pain Syndrome. Two independent reviewers conducted a systematic search of key databases (MEDLINE, EMBASE, AMED, CINHAL+ and the Cochrane Library from inception to August 2013) to identify relevant studies. A third reviewer mediated in the event of disagreement. Methodological quality was evaluated using the validated COSMIN (Consensus-based Standards for the Selection of Health Measurement Instruments) tool. Data synthesis across studies determined the level of evidence for each patient-reported outcome measure. The search strategy returned 2177 citations. Following the eligibility review phase, seven studies, evaluating twelve different patient-reported outcome measures, met inclusion criteria. A 'moderate' level of evidence supported the structural validity of several measures: the Flandry Questionnaire, Anterior Knee Pain Scale, Functional Index Questionnaire, Eng and Pierrynowski Questionnaire and Visual Analogue Scales for 'usual' and 'worst' pain. In addition, there was a 'Limited' level of evidence supporting the test-retest reliability and validity (cross-cultural, hypothesis testing) of the Persian version of the Anterior Knee Pain Scale. Other measurement properties were evaluated with poor methodological quality, and many properties were not evaluated in any of the included papers. Current disease-specific outcome measures for Patellofemoral Pain Syndrome require further investigation. Future studies should evaluate all important measurement properties, utilising an appropriate framework such as COSMIN to guide study design, to facilitate optimal methodological quality. Copyright © 2014 Elsevier Ltd. All rights reserved.

  3. Future Performance Trend Indicators: A Current Value Approach to Human Resources Accounting. Report II: Internal Consistencies and Relationships to Performance in Organization VI. Technical Report.

    ERIC Educational Resources Information Center

    Pecorella, Patricia A.; Bowers, David G.

    Conventional accounting systems provide no indication as to what conditions and events lead to reported outcomes, since they traditionally do not include measurements of the human organization and its relationship to events at the outcome stage. Human resources accounting is used to measure these additional types of data. This research is…

  4. Variance in Broad Reading Accounted for by Measures of Reading Speed Embedded within Maze and Comprehension Rate Measures

    ERIC Educational Resources Information Center

    Hale, Andrea D.; Skinner, Christopher H.; Wilhoit, Brian; Ciancio, Dennis; Morrow, Jennifer A.

    2012-01-01

    Maze and reading comprehension rate measures are calculated by using measures of reading speed and measures of accuracy (i.e., correctly selected words or answers). In sixth- and seventh-grade samples, we found that the measures of reading speed embedded within our Maze measures accounted for 50% and 39% of broad reading score (BRS) variance,…

  5. Advances in Patient-Reported Outcomes: The NIH PROMIS® Measures

    PubMed Central

    Broderick, Joan E.; DeWitt, Esi Morgan; Rothrock, Nan; Crane, Paul K.; Forrest, Christopher B.

    2013-01-01

    Patient-reported outcomes (PRO) are questionnaire measures of patients’ symptoms, functioning, and health-related quality of life. They are designed to provide important clinical information that generally cannot be captured with objective medical testing. In 2004, the National Institutes of Health launched a research initiative to improve the clinical research enterprise by developing state-of-the-art PROs. The NIH Patient-Reported Outcomes Measurement System (PROMIS) and Assessment Center are the products of that initiative. Adult, pediatric, and parent-proxy item banks have been developed by using contemporary psychometric methods, yielding rapid, accurate measurements. PROMIS currently provides tools for assessing physical, mental, and social health using short-form and computer-adaptive testing methods. The PROMIS tools are being adopted for use in clinical trials and translational research. They are also being introduced in clinical medicine to assess a broad range of disease outcomes. Recent legislative developments in the United States support greater efforts to include patients’ reports of health experience in order to evaluate treatment outcomes, engage in shared decision-making, and prioritize the focus of treatment. PROs have garnered increased attention by the Food and Drug Administration (FDA) for evaluating drugs and medical devices. Recent calls for comparative effectiveness research favor inclusion of PROs. PROs could also potentially improve quality of care and disease outcomes, provide patient-centered assessment for comparative effectiveness research, and enable a common metric for tracking outcomes across providers and medical systems. PMID:25848562

  6. Participation in a national nursing outcomes database: monitoring outcomes over time.

    PubMed

    Loan, Lori A; Patrician, Patricia A; McCarthy, Mary

    2011-01-01

    The current and future climates in health care require increased accountability of health care organizations for the quality of the care they provide. Never before in the history of health care in America has this focus on quality been so critical. The imperative to measure nursing's impact without fully developed and tested monitoring systems is a critical issue for nurse executives and managers alike. This article describes a project to measure nursing structure, process, and outcomes in the military health system, the Military Nursing Outcomes Database project. Here we review the effectiveness of this project in monitoring changes over time, in satisfying expectations of nurse leaders in participating hospitals, and evaluate the potential budgetary impacts of such a system. We conclude that the Military Nursing Outcomes Database did meet the needs of a monitoring system that is sensitive to changes over time in outcomes, provides interpretable data for nurse leaders, and could result in cost benefits and patient care improvements in organizations.

  7. HUMAN HEALTH OUTCOMES AND ACCOUNTABILITY - RISK POLICY REPORT

    EPA Science Inventory

    EPA is identifying human health "outcomes" as part of a significant shift in how the Agency frames questions and assesses its impact on environmental quality. These outcomes, while complementing traditional process indicators such as decreases in emissions, discharges and pollut...

  8. Why the NHS should abandon the search for the universal outcome measure.

    PubMed

    Brown, R B; McCartney, S; Bell, L

    1995-08-01

    This paper considers the use of outcome measures in the British National Health Service (NHS). Measuring outcomes is a major conceptual and practical problem. Many different measures are currently available yet no consensus has been reached on which should be preferred over others, or about which should take priority when they conflict. Some currently used measures are described, the relationship between these measures and the measured activities are discussed, and fundamental problems with both the measures and their use are revealed. It is shown that however assiduous the search, the 'perfect' outcome measure will always remain elusive.

  9. Routine measurement of outcomes in Australia's public sector mental health services

    PubMed Central

    Pirkis, Jane; Burgess, Philip; Coombs, Tim; Clarke, Adam; Jones-Ellis, David; Dickson, Rosemary

    2005-01-01

    Objective This paper describes the Australian experience to date with a national 'roll out' of routine outcome measurement in public sector mental health services. Methods Consultations were held with 123 stakeholders representing a range of roles. Results Australia has made an impressive start to nationally implementing routine outcome measurement in mental health services, although it still has a long way to go. All States/Territories have established data collection systems, although some are more streamlined than others. Significant numbers of clinicians and managers have been trained in the use of routine outcome measures, and thought is now being given to ongoing training strategies. Outcome measurement is now occurring 'on the ground'; all States/Territories will be reporting data for 2003–04, and a number have been doing so for several years. Having said this, there is considerable variability regarding data coverage, completeness and compliance. Some States/Territories have gone to considerable lengths to 'embed' outcome measurement in day-to-day practice. To date, reporting of outcome data has largely been limited to reports profiling individual consumers and/or aggregate reports that focus on compliance and data quality issues, although a few States/Territories have begun to turn their attention to producing aggregate reports of consumers by clinician, team or service. Conclusion Routine outcome measurement is possible if it is supported by a co-ordinated, strategic approach and strong leadership, and there is commitment from clinicians and managers. The Australian experience can provide lessons for other countries. PMID:15840170

  10. Ancillary outcome measures for assessment of individuals with cervical spondylotic myelopathy.

    PubMed

    Kalsi-Ryan, Sukhvinder; Singh, Anoushka; Massicotte, Eric M; Arnold, Paul M; Brodke, Darrel S; Norvell, Daniel C; Hermsmeyer, Jeffrey T; Fehlings, Michael G

    2013-10-15

    Narrative review. To identify suitable outcome measures that can be used to quantify neurological and functional impairment in the management of cervical spondylotic myelopathy (CSM). CSM is the leading cause of acquired spinal cord disability, causing varying degrees of neurological impairment which impact on independence and quality of life. Because this impairment can have a heterogeneous presentation, a single outcome measure cannot define the broad range of deficits seen in this population. Therefore, it is necessary to define outcome measures that characterize the deficits with greater validity and sensitivity. This review was conducted in 3 stages. Stage I: To evaluate the current use of outcome measures in CSM, PubMed was searched using the name of the outcome measure and the common abbreviation combined with "CSM" or "myelopathy." Stage II: Having identified a lack of appropriate outcome measures, we constructed criteria by which measures appropriate for assessing the various aspects of CSM could be identified. Stage III: A second literature search was then conducted looking at specified outcomes that met these criteria. All literature was reviewed to determine specificity and psychometric properties of outcomes for CSM. Nurick grade, modified Japanese Orthopaedic Association Scale, visual analogue scale (VAS) for pain, Short Form (36) Health Survey (SF-36), and Neck Disability Index were the most commonly cited measures. The Short-Form 36 Health Survey and Myelopathy Disability Index have been validated in the CSM population with multiple studies, whereas the modified Japanese Orthopaedic Association Scale score, Nurick grade, and European Myelopathy Scale each had only one study assessing psychometric characteristics. No validity, reliability, or responsiveness studies were found for the VAS or Neck Disability Index in the CSM population. We recommend that the modified Japanese Orthopaedic Association Scale, Nurick grade, Myelopathy Disability Index

  11. 50 CFR 648.73 - Surfclam and ocean quahog Accountability Measures.

    Code of Federal Regulations, 2014 CFR

    2014-10-01

    ... Accountability Measures. (a) Commercial ITQ fishery. (1) If the ACL for surfclam or ocean quahog is exceeded, and... an ACL overage that cannot be otherwise attributed to an ITQ allocation holder will be deducted from the appropriate ACL in the following fishing year. (b) Maine mahogany quahog fishery. If the ocean...

  12. 50 CFR 648.73 - Surfclam and ocean quahog Accountability Measures.

    Code of Federal Regulations, 2013 CFR

    2013-10-01

    ... Accountability Measures. (a) Commercial ITQ fishery. (1) If the ACL for surfclam or ocean quahog is exceeded, and... an ACL overage that cannot be otherwise attributed to an ITQ allocation holder will be deducted from the appropriate ACL in the following fishing year. (b) Maine mahogany quahog fishery. If the ocean...

  13. 50 CFR 648.73 - Surfclam and ocean quahog Accountability Measures.

    Code of Federal Regulations, 2012 CFR

    2012-10-01

    ... Accountability Measures. (a) Commercial ITQ fishery. (1) If the ACL for surfclam or ocean quahog is exceeded, and... an ACL overage that cannot be otherwise attributed to an ITQ allocation holder will be deducted from the appropriate ACL in the following fishing year. (b) Maine mahogany quahog fishery. If the ocean...

  14. Measuring the Academic Self-Efficacy of First-Year Accounting Students

    ERIC Educational Resources Information Center

    Byrne, Marann; Flood, Barbara; Griffin, Julie

    2014-01-01

    This study measured the levels of academic self-efficacy of first-year accounting students. It also investigated whether there were any gender differences and the extent to which efficacy levels explained variation in academic performance. Overall the analysis revealed that many students lacked the confidence to participate fully in the academic…

  15. Effects of a social accountability approach, CARE's Community Score Card, on reproductive health-related outcomes in Malawi: A cluster-randomized controlled evaluation.

    PubMed

    Gullo, Sara; Galavotti, Christine; Sebert Kuhlmann, Anne; Msiska, Thumbiko; Hastings, Phil; Marti, C Nathan

    2017-01-01

    Social accountability approaches, which emphasize mutual responsibility and accountability by community members, health care workers, and local health officials for improving health outcomes in the community, are increasingly being employed in low-resource settings. We evaluated the effects of a social accountability approach, CARE's Community Score Card (CSC), on reproductive health outcomes in Ntcheu district, Malawi using a cluster-randomized control design. We matched 10 pairs of communities, randomly assigning one from each pair to intervention and control arms. We conducted two independent cross-sectional surveys of women who had given birth in the last 12 months, at baseline and at two years post-baseline. Using difference-in-difference (DiD) and local average treatment effect (LATE) estimates, we evaluated the effects on outcomes including modern contraceptive use, antenatal and postnatal care service utilization, and service satisfaction. We also evaluated changes in indicators developed by community members and service providers in the intervention areas. DiD analyses showed significantly greater improvements in the proportion of women receiving a home visit during pregnancy (B = 0.20, P < .01), receiving a postnatal visit (B = 0.06, P = .01), and overall service satisfaction (B = 0.16, P < .001) in intervention compared to control areas. LATE analyses estimated significant effects of the CSC intervention on home visits by health workers (114% higher in intervention compared to control) (B = 1.14, P < .001) and current use of modern contraceptives (57% higher) (B = 0.57, P < .01). All 13 community- and provider-developed indicators improved, with 6 of them showing significant improvements. By facilitating the relationship between community members, health service providers, and local government officials, the CSC contributed to important improvements in reproductive health-related outcomes. Further, the CSC builds mutual accountability, and ensures that

  16. Ranking Surgical Residency Programs: Reputation Survey or Outcomes Measures?

    PubMed

    Wilson, Adam B; Torbeck, Laura J; Dunnington, Gary L

    2015-01-01

    The release of general surgery residency program rankings by Doximity and U.S. News & World Report accentuates the need to define and establish measurable standards of program quality. This study evaluated the extent to which program rankings based solely on peer nominations correlated with familiar program outcomes measures. Publicly available data were collected for all 254 general surgery residency programs. To generate a rudimentary outcomes-based program ranking, surgery programs were rank-ordered according to an average percentile rank that was calculated using board pass rates and the prevalence of alumni publications. A Kendall τ-b rank correlation computed the linear association between program rankings based on reputation alone and those derived from outcomes measures to validate whether reputation was a reasonable surrogate for globally judging program quality. For the 218 programs with complete data eligible for analysis, the mean board pass rate was 72% with a standard deviation of 14%. A total of 60 programs were placed in the 75th percentile or above for the number of publications authored by program alumni. The correlational analysis reported a significant correlation of 0.428, indicating only a moderate association between programs ranked by outcomes measures and those ranked according to reputation. Seventeen programs that were ranked in the top 30 according to reputation were also ranked in the top 30 based on outcomes measures. This study suggests that reputation alone does not fully capture a representative snapshot of a program's quality. Rather, the use of multiple quantifiable indicators and attributes unique to programs ought to be given more consideration when assigning ranks to denote program quality. It is advised that the interpretation and subsequent use of program rankings be met with caution until further studies can rigorously demonstrate best practices for awarding program standings. Copyright © 2015 Association of Program

  17. The use of shoulder scoring systems and outcome measures in the UK

    PubMed Central

    Lamb, J; Rambani, R; Venkateswaran, B

    2014-01-01

    Introduction In future, outcomes following shoulder surgery may be subject to public survey. Many outcome measures exist but we do not know whether there is a consensus between shoulder surgeons in the UK. The aim of this study was to survey the preferred outcome measures used by National Health Service (NHS) shoulder surgeons operating in the UK. Methods A total of 350 shoulder surgeons working in NHS hospitals were asked to complete a short written questionnaire regarding their use of scoring systems and outcome measures. Questionnaires were sent and responses were received by post. Results Overall, 217 responses were received (62%). Of the respondents, 171 (79%) use an outcome measure in their shoulder practice while 46 (21%) do not. There were 118 surgeons (69%) who use more than one outcome measure. The Oxford shoulder score was most commonly used by 150 surgeons (69%), followed by the Constant score with 106 (49%), the Oxford shoulder instability score with 82 (38%), and the Disabilities of the Arm, Shoulder and Hand score with 54 (25%). The less commonly used outcome measures were the SF-36® and SF-12® health questionnaires with 19 (9%), the University of California at Los Angeles activity score with 8 (4%), the American Shoulder and Elbow Surgeons shoulder assessment form with 8 (4%) and the EQ-5D™ with 10 (3%). Conclusions Validated outcome measures should be adopted by all practising surgeons in all specialties. This will allow better assessment of treatments in addition to assessment of surgical performance in a transparent way. PMID:25350180

  18. The use of shoulder scoring systems and outcome measures in the UK.

    PubMed

    Varghese, M; Lamb, J; Rambani, R; Venkateswaran, B

    2014-11-01

    In future, outcomes following shoulder surgery may be subject to public survey. Many outcome measures exist but we do not know whether there is a consensus between shoulder surgeons in the UK. The aim of this study was to survey the preferred outcome measures used by National Health Service (NHS) shoulder surgeons operating in the UK. A total of 350 shoulder surgeons working in NHS hospitals were asked to complete a short written questionnaire regarding their use of scoring systems and outcome measures. Questionnaires were sent and responses were received by post. Overall, 217 responses were received (62%). Of the respondents, 171 (79%) use an outcome measure in their shoulder practice while 46 (21%) do not. There were 118 surgeons (69%) who use more than one outcome measure. The Oxford shoulder score was most commonly used by 150 surgeons (69%), followed by the Constant score with 106 (49%), the Oxford shoulder instability score with 82 (38%), and the Disabilities of the Arm, Shoulder and Hand score with 54 (25%). The less commonly used outcome measures were the SF-36® and SF-12® health questionnaires with 19 (9%), the University of California at Los Angeles activity score with 8 (4%), the American Shoulder and Elbow Surgeons shoulder assessment form with 8 (4%) and the EQ-5D™ with 10 (3%). Conclusions Validated outcome measures should be adopted by all practising surgeons in all specialties. This will allow better assessment of treatments in addition to assessment of surgical performance in a transparent way.

  19. Measuring outcomes in psychiatry: an inpatient model.

    PubMed

    Davis, D E; Fong, M L

    1996-02-01

    This article describes a system for measuring outcomes recently implemented in the department of psychiatry of Baptist Memorial Hospital, a 78-bed inpatient and day treatment unit that represents one service line of a large, urban teaching hospital in Memphis. In June 1993 Baptist Hospital began a 15-month pilot test of PsychSentinel, a measurement tool developed by researchers in the Department of Community Medicine at the University of Connecticut. The hospital identified the following four primary goals for this pilot project: provide data for internal hospital program evaluation, provide data for external marketing in a managed care environment, satisfy requirements of the Joint Commission on Accreditation of Health Care Organizations, and generate studies that add to the literature in psychiatry and psychology. PsychSentinel is based on the standardized diagnostic criteria in the Diagnostic and Statistical Manual of Mental Disorders, 4th edition (DSM-IV). The outcome measure assesses the change in the number of symptoms of psychopathology that occurs between admission and discharge from the hospital. Included in the nonproprietary system are risk adjustment factors, as well as access to a national reference database for comparative analysis purposes. Data collection can be done by trained ancillary staff members, with as much or as little direct physician involvement as desired. The system has proven to be both time effective and cost effective, and it provides important outcome information both at the program level and at the clinician level. After the pilot test, the staff at Baptist Memorial Hospital determined that the system met all initial objectives identified and recently adopted the system as an ongoing measure of quality patient care in the department of psychiatry.

  20. A repeated measures model for analysis of continuous outcomes in sequential parallel comparison design studies.

    PubMed

    Doros, Gheorghe; Pencina, Michael; Rybin, Denis; Meisner, Allison; Fava, Maurizio

    2013-07-20

    Previous authors have proposed the sequential parallel comparison design (SPCD) to address the issue of high placebo response rate in clinical trials. The original use of SPCD focused on binary outcomes, but recent use has since been extended to continuous outcomes that arise more naturally in many fields, including psychiatry. Analytic methods proposed to date for analysis of SPCD trial continuous data included methods based on seemingly unrelated regression and ordinary least squares. Here, we propose a repeated measures linear model that uses all outcome data collected in the trial and accounts for data that are missing at random. An appropriate contrast formulated after the model has been fit can be used to test the primary hypothesis of no difference in treatment effects between study arms. Our extensive simulations show that when compared with the other methods, our approach preserves the type I error even for small sample sizes and offers adequate power and the smallest mean squared error under a wide variety of assumptions. We recommend consideration of our approach for analysis of data coming from SPCD trials. Copyright © 2013 John Wiley & Sons, Ltd.

  1. Use of patient-reported outcome measures in foot and ankle research.

    PubMed

    Hunt, Kenneth J; Hurwit, Daniel

    2013-08-21

    In the orthopaedic literature, there is a wide range of clinical outcome measurement tools that have been used in evaluating foot and ankle procedures, disorders, and outcomes, with no broadly accepted consensus as to which tools are preferred. The purpose of this study was to determine the frequency and distribution of the various outcome instruments used in the foot and ankle literature, and to identify trends for use of these instruments over time. We conducted a systematic review of all original clinical articles reporting on foot and/or ankle topics in six orthopaedic journals over a ten-year period (2002 to 2011). All clinical patient-reported outcome rating instruments used in these articles were recorded, as were study date, study design, clinical topic, and level of evidence. A total of 878 clinical foot and ankle articles that used at least one patient-reported outcome measure were identified among 16,513 total articles published during the ten-year period. There were 139 unique clinical outcome scales used, and the five most popular scales (as a percentage of foot/ankle outcome articles) were the American Orthopaedic Foot & Ankle Society (AOFAS) scales (55.9%), visual analog scale (VAS) for pain (22.9%), Short Form-36 (SF-36) Health Survey (13.7%), Foot Function Index (FFI) (5.5%), and American Academy of Orthopaedic Surgeons (AAOS) outcomes instruments (3.3%). The majority of articles described Level-IV studies (70.1%); only 9.4% reported Level-I studies. A considerable variety of outcome measurement tools are used in the foot and ankle clinical literature, with a small proportion used consistently. The AOFAS scales continue to be used at a high rate relative to other scales that have been validated. Data from the present study underscore the need for a paradigm shift toward the use of consistent, valid, and reliable outcome measures for studies of foot and ankle procedures and disorders. It is not clear which existing validated outcome instruments will

  2. General Outcome Measures for Verbal Operants

    ERIC Educational Resources Information Center

    Kubina, Richard M., Jr.; Wolfe, Pamela; Kostewicz, Douglas E.

    2009-01-01

    A general outcome measure (GOM) can be used to show progress towards a long-term goal. GOMs should sample domains of behavior across ages, be sensitive to change over time, be inexpensive and easy to use, and facilitate decision making. Skinner's (1957) analysis of verbal behavior may benefit from the development of GOM. To develop GOM, we…

  3. How "accountable" are accountable care organizations?

    PubMed

    Addicott, Rachael; Shortell, Stephen M

    2014-01-01

    The establishment of accountable care organizations (ACOs) in the Affordable Care Act (ACA) was intended to support both cost savings and high-quality care. However, a key challenge will be to ensure that governance and accountability mechanisms are sufficient to support those twin ambitions. This exploratory study considers how recently developed ACOs have established governance structures and accountability mechanisms, particularly focusing on attempts at collaborative accountability and shared governance arrangements. Four case studies of ACOs across the United States were undertaken, with data collected throughout 2012. These involved 34 semistructured interviews with ACO administrative and clinical leaders, observation of nine meetings, and a review of documentary materials from each ACO. We identified very few examples of physicians being held to account as a collective and therefore only limited evidence of collaborative accountability impacting on behavior change. However, ACO leaders do have many mechanisms available to stimulate change across physicians. The challenge is to determine governance structure(s) and accountability mechanisms that facilitate the most effective combination of approaches, measures, incentives, and sanctions to achieve the goals of more accountable care. Accountability structures and processes will need to be tailored to local membership composition, historical evolution, and current stage of development. There are also some common lessons to be drawn. Shared goals and incentives should be reflected through performance criteria. It is important to align measures and thresholds across payers to ensure ACOs are not unnecessarily burdened or compromised by reporting on different and potentially disjointed measures. Finally, emphasis needs to be placed on the importance of credible, transparent data. This exploratory study provides early evidence regarding how ACOs are establishing their governance and accountability arrangements and

  4. Accounting for twin births in sample size calculations for randomised trials.

    PubMed

    Yelland, Lisa N; Sullivan, Thomas R; Collins, Carmel T; Price, David J; McPhee, Andrew J; Lee, Katherine J

    2018-05-04

    Including twins in randomised trials leads to non-independence or clustering in the data. Clustering has important implications for sample size calculations, yet few trials take this into account. Estimates of the intracluster correlation coefficient (ICC), or the correlation between outcomes of twins, are needed to assist with sample size planning. Our aims were to provide ICC estimates for infant outcomes, describe the information that must be specified in order to account for clustering due to twins in sample size calculations, and develop a simple tool for performing sample size calculations for trials including twins. ICCs were estimated for infant outcomes collected in four randomised trials that included twins. The information required to account for clustering due to twins in sample size calculations is described. A tool that calculates the sample size based on this information was developed in Microsoft Excel and in R as a Shiny web app. ICC estimates ranged between -0.12, indicating a weak negative relationship, and 0.98, indicating a strong positive relationship between outcomes of twins. Example calculations illustrate how the ICC estimates and sample size calculator can be used to determine the target sample size for trials including twins. Clustering among outcomes measured on twins should be taken into account in sample size calculations to obtain the desired power. Our ICC estimates and sample size calculator will be useful for designing future trials that include twins. Publication of additional ICCs is needed to further assist with sample size planning for future trials. © 2018 John Wiley & Sons Ltd.

  5. 77 FR 43542 - Cost Accounting Standards: Cost Accounting Standards 412 and 413-Cost Accounting Standards...

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-07-25

    ... rule that revised Cost Accounting Standard (CAS) 412, ``Composition and Measurement of Pension Cost... Accounting Standards: Cost Accounting Standards 412 and 413--Cost Accounting Standards Pension Harmonization Rule AGENCY: Cost Accounting Standards Board, Office of Federal Procurement Policy, Office of...

  6. How to measure the outcomes of chronic disease management.

    PubMed

    Lewis, Al

    2009-02-01

    The fastest-growing methodology for disease management outcomes measurement is valid, transparent, easy to apply, and freely available in the public domain and this article. It measures the actual goal of disease management, which is to reduce the rate of adverse events associated with the disease(s) being managed. Changes in this rate can be translated into a return on investment using some explicit assumptions about comorbidities and episode costs. Outcomes measured in this way show that in the health plan community as a whole, disease management in the broadest sense is working, as measured by the relative stability in the rate of adverse medical events closely associated with common chronic disease during this decade of increasing prevalence of most of the common chronic conditions.

  7. Wealth and the Accounting Period in the Measurement of Means. The Measure of Poverty, Technical Paper VI.

    ERIC Educational Resources Information Center

    Steuerle, Eugene; McClung, Nelson

    This technical study is concerned with both the statistical and policy effects of alternative definitions of poverty which result when the definition of means is altered by varying the time period (accounting period) over which income is measured or by including in the measure of means not only realized income, but also unrealized income and…

  8. Perspectives on differing health outcomes by city: accounting for Glasgow’s excess mortality

    PubMed Central

    Fraser, Simon DS; George, Steve

    2015-01-01

    Several health outcomes (including mortality) and health-related behaviors are known to be worse in Scotland than in comparable areas of Europe and the United Kingdom. Within Scotland, Greater Glasgow (in West Central Scotland) experiences disproportionately poorer outcomes independent of measurable variation in socioeconomic status and other important determinants. Many reasons for this have been proposed, particularly related to deprivation, inequalities, and variation in health behaviors. The use of models (such as the application of Bradford Hill’s viewpoints on causality to the different hypotheses) has provided useful insights on potentially causal mechanisms, with health behaviors and inequalities likely to represent the strongest individual candidates. This review describes the evolution of our understanding of Glasgow’s excess mortality, summarizes some of the key work in this area, and provides some suggestions for future areas of exploration. In the context of demographic change, the experience in Glasgow is an important example of the complexity that frequently lies behind observed variations in health outcomes within and between populations. A comprehensive explanation of Glasgow’s excess mortality may continue to remain elusive, but is likely to lie in a complex and difficult-to-measure interplay of health determinants acting at different levels in society throughout the life course. Lessons learned from the detailed examination of different potentially causative determinants in Scotland may provide useful methodological insights that may be applied in other settings. Ongoing efforts to unravel the causal mechanisms are needed to inform public health efforts to reduce health inequalities and improve outcomes in Scotland. PMID:26124684

  9. Outcome measurement of hand function following mirror therapy for stroke rehabilitation: A systematic review.

    PubMed

    Cantero-Téllez, Raquel; Naughton, Nancy; Algar, Lori; Valdes, Kristin

    2018-02-28

    Systematic review. Mirror therapy is a treatment used to address hand function following a stroke. Measurement of outcomes using appropriate assessment tools is crucial; however, many assessment options exist. The purpose of this study is to systematically review outcome measures that are used to assess hand function following mirror therapy after stroke and, in addition, to identify the psychometric and descriptive properties of the included measures and through the linking process determine if the outcome measures are representative of the International Classification of Functioning, Disability and Health (ICF). Following a comprehensive literature search, outcome measures used in the included studies were linked to the ICF and analyzed based on descriptive information and psychometric properties. Eleven studies met inclusion criteria and included 24 different assessment tools to measure hand or upper limb function. Most outcome measures used in the selected studies (63%) were rated by the evaluating therapist. Thirteen outcome measures (54%) linked to the ICF body function category and 10 measures (42%) linked to activities and participation. One outcome measure was linked to not defined, and all other ICF categories were not represented. A majority of outcome measures have been assessed for validity, reliability, and responsiveness, but responsiveness was the least investigated psychometric property. Current studies on mirror therapy after stroke are not consistent in the assessment tools used to determine hand function. Understanding of study outcomes requires analysis of the assessment tools. The outcome measures used in the included studies are not representative of personal and environmental factors, but tools linking to body functions and activities and participations provide important information on functional outcome. Integrating a combination of measures that are psychometrically sound and reflective of the ICF should be considered for assessment of

  10. From clinically relevant outcome measures to quality of life in epilepsy: A time trade-off study.

    PubMed

    de Kinderen, Reina J A; Wijnen, Ben F M; van Breukelen, Gerard; Postulart, Debby; Majoie, Marian H J M; Aldenkamp, Albert P; Evers, Silvia M A A

    2016-09-01

    A proposed method for bridging the gap between clinically relevant epilepsy outcome measures and quality-adjusted life years is to derive utility scores for epilepsy health states. The aim of this study is to develop such a utility-function and to investigate the impact of the epilepsy outcome measures on utility. Health states, based on clinically important epilepsy attributes (e.g. seizure frequency, seizure severity, side-effects), were valued by a sample of the Dutch population (N=525) based on the time trade-off method. In addition to standard demographics, every participant was asked to rate 10 or 11 different health state scenarios. A multilevel regression analysis was performed to account for the nested structure of the data. Results show that the best health state (no seizures and no side-effects) is estimated at 0.89 and the worst state (seizures type 5 twice a day plus severe side-effects) at 0.22 (scale: 0-1). An increase in seizure frequency, occurrence of side-effects, and seizure severity were all significantly associated with lower utility values. Furthermore, seizure severity has the largest impact on quality of life compared with seizure frequency and side-effects. This study provides a utility-function for transforming clinically relevant epilepsy outcome measures into utility estimates. We advise using our utility-function in economic evaluations, when quality of life is not directly measured in a study and hence, no health state utilities are available, or when there is convincing empirical evidence of the insensitivity of a generic quality-of-life-instrument within epilepsy. Copyright © 2016 Elsevier B.V. All rights reserved.

  11. Populations and outcome measures used in ongoing research in sarcopenia.

    PubMed

    Peña Ordóñez, Gloria Gabriela; Bustamante Montes, Lilia Patricia; Ramírez Duran, Ninfa; Sánchez Castellano, Carmen; Cruz-Jentoft, Alfonso J

    2017-08-01

    Sarcopenia research may be hampered by the heterogeneity of populations and outcome measures used in clinical studies. The aim of this study was to describe the inclusion/exclusion criteria and outcome measures used in ongoing research in sarcopenia. All active intervention studies registered in the World Health Organization with the keyword sarcopenia were included. Study design, type of intervention, inclusion/exclusion criteria and outcome measures were registered and classified. In April 2014, 151 studies on sarcopenia were registered in the WHO database. One hundred twenty-three were intervention studies. Most trials (94.3 %) were single centre and randomized (93.5 %), 51.2 % were double blind. Nutritional interventions (36.6 %), physical exercise (12.2 %) or both (19.5 %) were the most common interventions tested. Only 54.4 % included subjects of both genders, and 46.3 % had an upper age limit. Definition of the target populations was heterogeneous, with 57.7 % including healthy subjects and none using recent definitions of sarcopenia. Lifestyle and the degree of physical activity of subjects were not described or considered in most cases (79.7 %). Subjects with cardiovascular, neuropsychiatric or metabolic disorders and those with physical disability were usually excluded. Muscle mass and muscle strength were the primary outcome variables in 28.5 and 29.5 % of studies and physical performance in 19.5 %, but only 4.1 % used the three variables used the three of them. An additional 26.8 % used biological outcome variables. Little information and agreement existed in the way muscle and physical performance parameters were measured. We found a large heterogeneity in trial design, definition of populations and outcome measures in present research.

  12. Are More Stringent NCLB State Accountability Systems Associated with Better Student Outcomes? An Analysis of NAEP Results across States

    ERIC Educational Resources Information Center

    Wei, Xin

    2012-01-01

    This study developed a comprehensive measure of the stringency level of NCLB states' accountability systems, including the strength of their annual measurable objectives, confidence intervals, performance indexing, retesting, minimum subgroup size, and the difficulty levels of proficiency standards. This study related accountability stringency in…

  13. Development of a spanish version of the Schwartz Outcome Scale-10: a brief mental health outcome measure.

    PubMed

    Rivas-Vazquez, R A; Rivas-Vazquez, A; Blais, M A; Rey, G J; Rivas-Vasquez, F; Jacobo, M; Carrazana, E J

    2001-12-01

    The lack of culturally appropriate psychometric instruments for the assessment of cognitive and emotional functioning in minority populations has been a concern often discussed in the assessment literature. With the increased focus on the measurement of outcome in mental health treatment, the lack of appropriate instruments for minorities has become readily apparent in this venue as well. We report on the Spanish translation of a brief and reliable measure of psychological health and well-being that has been shown to be sensitive to treatment outcomes. The original and Spanish translated versions of this measure are highly correlated, providing clinicians and organizations with a instrument that can be used for assessment of psychological well-being and treatment outcomes with Hispanic patients.

  14. Generating Outcome Measurements: Achievement and Attitudes. A Guide to Educational Outcome Measurements and Their Uses. Seminar No. 3.

    ERIC Educational Resources Information Center

    Mushkin, Selma J.; Billings, Bradley B.

    This guide is essentially designed as a teaching aid for those who would inform planners, officials of educational ministries, school administrators, principals, and teachers about educational outcome measurements. In outline and graphic form, the guide presents topics for discussion in a seminar dealing with how to obtain information on…

  15. MEASUREMENT: ACCOUNTING FOR RELIABILITY IN PERFORMANCE ESTIMATES.

    PubMed

    Waterman, Brian; Sutter, Robert; Burroughs, Thomas; Dunagan, W Claiborne

    2014-01-01

    When evaluating physician performance measures, physician leaders are faced with the quandary of determining whether departures from expected physician performance measurements represent a true signal or random error. This uncertainty impedes the physician leader's ability and confidence to take appropriate performance improvement actions based on physician performance measurements. Incorporating reliability adjustment into physician performance measurement is a valuable way of reducing the impact of random error in the measurements, such as those caused by small sample sizes. Consequently, the physician executive has more confidence that the results represent true performance and is positioned to make better physician performance improvement decisions. Applying reliability adjustment to physician-level performance data is relatively new. As others have noted previously, it's important to keep in mind that reliability adjustment adds significant complexity to the production, interpretation and utilization of results. Furthermore, the methods explored in this case study only scratch the surface of the range of available Bayesian methods that can be used for reliability adjustment; further study is needed to test and compare these methods in practice and to examine important extensions for handling specialty-specific concerns (e.g., average case volumes, which have been shown to be important in cardiac surgery outcomes). Moreover, it's important to note that the provider group average as a basis for shrinkage is one of several possible choices that could be employed in practice and deserves further exploration in future research. With these caveats, our results demonstrate that incorporating reliability adjustment into physician performance measurements is feasible and can notably reduce the incidence of "real" signals relative to what one would expect to see using more traditional approaches. A physician leader who is interested in catalyzing performance improvement

  16. Patient-reported outcome measures in arthroplasty registries

    PubMed Central

    Eresian Chenok, Kate; Bohm, Eric; Lübbeke, Anne; Denissen, Geke; Dunn, Jennifer; Lyman, Stephen; Franklin, Patricia; Dunbar, Michael; Overgaard, Søren; Garellick, Göran; Dawson, Jill

    2016-01-01

    The International Society of Arthroplasty Registries (ISAR) Steering Committee established the Patient-Reported Outcome Measures (PROMs) Working Group to convene, evaluate, and advise on best practices in the selection, administration, and interpretation of PROMs and to support the adoption and use of PROMs for hip and knee arthroplasty in registries worldwide. The 2 main types of PROMs include generic (general health) PROMs, which provide a measure of general health for any health state, and specific PROMs, which focus on specific symptoms, diseases, organs, body regions, or body functions. The establishment of a PROM instrument requires the fulfillment of methodological standards and rigorous testing to ensure that it is valid, reliable, responsive, and acceptable to the intended population. A survey of the 41 ISAR member registries showed that 8 registries administered a PROMs program that covered all elective hip or knee arthroplasty patients and 6 registries collected PROMs for sample populations; 1 other registry had planned but had not started collection of PROMs. The most common generic instruments used were the EuroQol 5 dimension health outcome survey (EQ-5D) and the Short Form 12 health survey (SF-12) or the similar Veterans RAND 12-item health survey (VR-12). The most common specific PROMs were the Hip disability and Osteoarthritis Outcome Score (HOOS), the Knee injury and Osteoarthritis Outcome Score (KOOS), the Oxford Hip Score (OHS), the Oxford Knee Score (OKS), the Western Ontario and McMaster Universities Arthritis Index (WOMAC), and the University of California at Los Angeles Activity Score (UCLA). PMID:27168175

  17. Measuring treatment outcomes in gambling disorders: a systematic review.

    PubMed

    Pickering, Dylan; Keen, Brittany; Entwistle, Gavin; Blaszczynski, Alex

    2018-03-01

    Considerable variation of outcome variables used to measure recovery in the gambling treatment literature has precluded effective cross-study evaluations and hindered the development of best-practice treatment methodologies. The aim of this systematic review was to describe current diffuse concepts of recovery in the gambling field by mapping the range of outcomes and measurement strategies used to evaluate treatments, and to identify more commonly accepted indices of recovery. A systematic search of six academic databases for studies evaluating treatments (psychological and pharmacological) for gambling disorders with a minimum 6-month follow-up. Data from eligible studies were tabulated and analysis conducted using a narrative approach. Guidelines of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) were adhered to. Thirty-four studies were reviewed systematically (RCTs = 17, comparative designs = 17). Sixty-three different outcome measures were identified: 25 (39.7%) assessed gambling-specific constructs, 36 (57.1%) assessed non-gambling specific constructs, and two instruments were used across both categories (3.2%). Self-report instruments ranged from psychometrically validated to ad-hoc author-designed questionnaires. Units of measurement were inconsistent, particularly in the assessment of gambling behaviour. All studies assessed indices of gambling behaviour and/or symptoms of gambling disorder. Almost all studies (n = 30; 88.2%) included secondary measures relating to psychiatric comorbidities, psychological processes linked to treatment approach, or global functioning and wellbeing. In research on gambling disorders, the incorporation of broader outcome domains that extend beyond disorder-specific symptoms and behaviours suggests a multi-dimensional conceptualization of recovery. Development of a single comprehensive scale to measure all aspects of gambling recovery could help to facilitate uniform reporting practices

  18. Grades and Incentives: Assessing Competing Grade Point Average Measures and Postgraduate Outcomes

    ERIC Educational Resources Information Center

    Bailey, Michael A.; Rosenthal, Jeffrey S.; Yoon, Albert H.

    2016-01-01

    In many educational settings, students may have an incentive to take courses where high grades are easier to achieve, potentially corroding student learning, evaluation of student achievement, and the fairness and efficiency of post-graduation labor outcomes. A grading system that takes into account heterogeneity of teacher standards and student…

  19. Outcome measures for clinical rehabilitation trials: impairment, function, quality of life, or value?

    PubMed

    Wade, Derick T

    2003-10-01

    Choosing outcome measures in rehabilitation research depends on the standard research skills of clear thinking, attention to detail, and minimizing the amount of data collected. In rehabilitation, outcome is more difficult to measure because (1) usually several outcomes are relevant, (2) relevant outcomes are affected by multiple factors in addition to treatment, and (3) even good measures rarely reflect the specific interest of any individual patient or member of the rehabilitation team, leading to some dissent. Measurement of general quality of life is not possible because there is little agreement as to the nature of the construct; moreover, measurement of relevant aspects of quality of life would probably give similar results. Cost in terms of resources can be estimated, but there is no validated or even widely accepted method of relating this to benefit in a fair, open, and rational way. Outcome is best measured at the level of behavior (activities), with other measures being used to aid interpretation.

  20. Overview: Measuring Early Learning Quality and Outcomes (MELQO)

    ERIC Educational Resources Information Center

    Brookings Institution, 2017

    2017-01-01

    The Measuring Early Learning Quality and Outcomes (MELQO) initiative began in 2014 in anticipation of a new global emphasis on early childhood development (ECD). Led by UNESCO, the World Bank, the Center for Universal Education at the Brookings Institution, and UNICEF, the initiative aims to promote feasible, accurate and useful measurement of…

  1. Should English healthcare providers be penalised for failing to collect patient-reported outcome measures? A retrospective analysis

    PubMed Central

    Street, Andrew; Gomes, Manuel; Bojke, Chris

    2015-01-01

    Summary Objective The best practice tariff for hip and knee replacement in the English National Health Service (NHS) rewards providers based on improvements in patient-reported outcome measures (PROMs) collected before and after surgery. Providers only receive a bonus if at least 50% of their patients complete the preoperative questionnaire. We determined how many providers failed to meet this threshold prior to the policy introduction and assessed longitudinal stability of participation rates. Design Retrospective observational study using data from Hospital Episode Statistics and the national PROM programme from April 2009 to March 2012. We calculated participation rates based on either (a) all PROM records or (b) only those that could be linked to inpatient records; constructed confidence intervals around rates to account for sampling variation; applied precision weighting to allow for volume; and applied risk adjustment. Setting NHS hospitals and private providers in England. Participants NHS patients undergoing elective unilateral hip and knee replacement surgery. Main outcome measures Number of providers with participation rates statistically significantly below 50%. Results Crude rates identified many providers that failed to achieve the 50% threshold but there were substantially fewer after adjusting for uncertainty and precision. While important, risk adjustment required restricting the analysis to linked data. Year-on-year correlation between provider participation rates was moderate. Conclusions Participation rates have improved over time and only a small number of providers now fall below the threshold, but administering preoperative questionnaires remains problematic in some providers. We recommend that participation rates are based on linked data and take into account sampling variation. PMID:25827906

  2. Measuring and communicating meaningful outcomes in neonatology: A family perspective.

    PubMed

    Janvier, Annie; Farlow, Barbara; Baardsnes, Jason; Pearce, Rebecca; Barrington, Keith J

    2016-12-01

    Medium- and long-term outcomes have been collected and described among survivors of neonatal intensive care units for decades, for a number of purposes: (1) quality control within units, (2) comparisons of outcomes between NICUs, (3) clinical trials (whether an intervention improves outcomes), (4) end-of-life decision-making, (5) to better understand the effects of neonatal conditions and/or interventions on organs and/or long-term health, and finally (6) to better prepare parents for the future. However, the outcomes evaluated have been selected by investigators, based on feasibility, availability, cost, stability, and on what investigators consider to be important. Many of the routinely measured outcomes have major limitations: they may not correlate well with long-term difficulties, they may artificially divide continuous outcomes into dichotomous ones, and may have no clear relationship with quality of life and functioning of children and their families. Several investigations, such as routine term cerebral resonance imaging for preterm infants, have also not yet been shown to improve the outcome of children nor their families. In this article, the most common variables used in neonatology as well as some variables which are rarely measured but may be of equal importance for families are presented. The manner in which these outcomes are communicated to families will be examined, as well as recommendations to optimize communication with parents. Copyright © 2016 Elsevier Inc. All rights reserved.

  3. Reaching clinically relevant outcome measures for new pharmacotherapy and immunotherapy of atopic eczema.

    PubMed

    Chalmers, Joanne; Deckert, Stefanie; Schmitt, Jochen

    2015-06-01

    This article describes the core outcome set (COS) for atopic eczema trials. COS describe a minimum set of outcomes to be assessed in a defined situation. COS are required to overcome the current situation of different trials using different endpoints with unclear/insufficient measurement properties resulting in incomparable trials. The global multi-stakeholder Harmonising Outcomes Measures for Eczema initiative developed the Harmonising Outcomes Measures for Eczema roadmap as a generic framework for COS development. Following the establishment of a panel representing all stakeholders, a core set of outcome domains need to be selected based on systematic reviews and consensus methods. Outcome measurement instruments to assess these core domains need to be valid, reliable, and feasible. There is broad global consensus that clinical signs, quality of life, symptoms, and long-term control of flares form the COS for atopic eczema trials. The Eczema Area and Severity Index is recommended to assess clinical signs in atopic eczema trials. Systematic reviews to identify adequate outcome measurement instruments for the other core outcome domains are underway. Clinical signs should be assessed in all atopic eczema trials by at least the Eczema Area and Severity Index. Quality of life, symptoms, and flares should also be assessed in all atopic eczema trials by a valid, reliable, and feasible instrument.

  4. Upper Limb Outcome Measures Used in Stroke Rehabilitation Studies: A Systematic Literature Review

    PubMed Central

    Santisteban, Leire; Térémetz, Maxime; Bleton, Jean-Pierre; Baron, Jean-Claude; Maier, Marc A.; Lindberg, Påvel G.

    2016-01-01

    Background Establishing which upper limb outcome measures are most commonly used in stroke studies may help in improving consensus among scientists and clinicians. Objective In this study we aimed to identify the most commonly used upper limb outcome measures in intervention studies after stroke and to describe domains covered according to ICF, how measures are combined, and how their use varies geographically and over time. Methods Pubmed, CinHAL, and PeDRO databases were searched for upper limb intervention studies in stroke according to PRISMA guidelines and477 studies were included. Results In studies 48different outcome measures were found. Only 15 of these outcome measures were used in more than 5% of the studies. The Fugl-Meyer Test (FMT)was the most commonly used measure (in 36% of studies). Commonly used measures covered ICF domains of body function and activity to varying extents. Most studies (72%) combined multiple outcome measures: the FMT was often combined with the Motor Activity Log (MAL), the Wolf Motor Function Test and the Action Research Arm Test, but infrequently combined with the Motor Assessment Scale or the Nine Hole Peg Test. Key components of manual dexterity such as selective finger movements were rarely measured. Frequency of use increased over a twelve-year period for the FMT and for assessments of kinematics, whereas other measures, such as the MAL and the Jebsen Taylor Hand Test showed decreased use over time. Use varied largely between countries showing low international consensus. Conclusions The results showed a large diversity of outcome measures used across studies. However, a growing number of studies used the FMT, a neurological test with good psychometric properties. For thorough assessment the FMT needs to be combined with functional measures. These findings illustrate the need for strategies to build international consensus on appropriate outcome measures for upper limb function after stroke. PMID:27152853

  5. Alternative Methods of Accounting for Underreporting and Overreporting When Measuring Dietary Intake-Obesity Relations

    PubMed Central

    Mendez, Michelle A.; Popkin, Barry M.; Buckland, Genevieve; Schroder, Helmut; Amiano, Pilar; Barricarte, Aurelio; Huerta, José-María; Quirós, José R.; Sánchez, María-José; González, Carlos A

    2011-01-01

    Misreporting characterized by the reporting of implausible energy intakes may undermine the valid estimation of diet-disease relations, but the methods to best identify and account for misreporting are unknown. The present study compared how alternate approaches affected associations between selected dietary factors and body mass index (BMI) by using data from the European Prospective Investigation Into Cancer and Nutrition-Spain. A total of 24,332 women and 15,061 men 29–65 years of age recruited from 1992 to 1996 for whom measured height and weight and validated diet history data were available were included. Misreporters were identified on the basis of disparities between reported energy intakes and estimated requirements calculated using the original Goldberg method and 2 alternatives: one that substituted basal metabolic rate equations that are more valid at higher BMIs and another that used doubly labeled water-predicted total energy expenditure equations. Compared with results obtained using the original method, underreporting was considerably lower and overreporting higher with alternative methods, which were highly concordant. Accounting for misreporters with all methods yielded diet-BMI relations that were more consistent with expectations; alternative methods often strengthened associations. For example, among women, multivariable-adjusted differences in BMI for the highest versus lowest vegetable intake tertile (β = 0.37 (standard error, 0.07)) were neutral after adjusting with the original method (β = 0.01 (standard error, 07)) and negative using the predicted total energy expenditure method with stringent cutoffs (β = −0.15 (standard error, 0.07)). Alternative methods may yield more valid associations between diet and obesity-related outcomes. PMID:21242302

  6. Alternative methods of accounting for underreporting and overreporting when measuring dietary intake-obesity relations.

    PubMed

    Mendez, Michelle A; Popkin, Barry M; Buckland, Genevieve; Schroder, Helmut; Amiano, Pilar; Barricarte, Aurelio; Huerta, José-María; Quirós, José R; Sánchez, María-José; González, Carlos A

    2011-02-15

    Misreporting characterized by the reporting of implausible energy intakes may undermine the valid estimation of diet-disease relations, but the methods to best identify and account for misreporting are unknown. The present study compared how alternate approaches affected associations between selected dietary factors and body mass index (BMI) by using data from the European Prospective Investigation Into Cancer and Nutrition-Spain. A total of 24,332 women and 15,061 men 29-65 years of age recruited from 1992 to 1996 for whom measured height and weight and validated diet history data were available were included. Misreporters were identified on the basis of disparities between reported energy intakes and estimated requirements calculated using the original Goldberg method and 2 alternatives: one that substituted basal metabolic rate equations that are more valid at higher BMIs and another that used doubly labeled water-predicted total energy expenditure equations. Compared with results obtained using the original method, underreporting was considerably lower and overreporting higher with alternative methods, which were highly concordant. Accounting for misreporters with all methods yielded diet-BMI relations that were more consistent with expectations; alternative methods often strengthened associations. For example, among women, multivariable-adjusted differences in BMI for the highest versus lowest vegetable intake tertile (β = 0.37 (standard error, 0.07)) were neutral after adjusting with the original method (β = 0.01 (standard error, 07)) and negative using the predicted total energy expenditure method with stringent cutoffs (β = -0.15 (standard error, 0.07)). Alternative methods may yield more valid associations between diet and obesity-related outcomes.

  7. Accounting for natural resources and environmental sustainability: linking ecosystem services to human well-being.

    PubMed

    Jordan, Stephen J; Hayes, Sharon E; Yoskowitz, David; Smith, Lisa M; Summers, J Kevin; Russell, Marc; Benson, William H

    2010-03-01

    One of society's greatest challenges is to sustain natural resources while promoting economic growth and quality of life. In the face of this challenge, society must measure the effectiveness of programs established to safeguard the environment. The impetus for demonstrating positive results from government-sponsored research and regulation in the United States comes from Congress (General Accountability Office; GAO) and the Executive Branch (Office of Management and Budget; OMB). The message is: regulatory and research programs must demonstrate outcomes that justify their costs. Although the concept is simple, it is a complex problem to demonstrate that environmental research, policies, and regulations cause measurable changes in environmental quality. Even where changes in environmental quality can be tracked reliably, the connections between government actions and environmental outcomes seldom are direct or straightforward. In this article, we describe emerging efforts (with emphasis on the role of the U.S. Environmental Protection Agency; EPA) to frame and measure environmental outcomes in terms of ecosystem services and values-societally and ecologically meaningful metrics for gauging how well we manage environmental resources. As examples of accounting for outcomes and values, we present a novel, low-cost method for determining relative values of multiple ecosystem services, and describe emerging research on indicators of human well-being.

  8. Patient-Reported Outcomes (PROs) and Patient-Reported Outcome Measures (PROMs)

    PubMed Central

    Weldring, Theresa; Smith, Sheree M.S.

    2013-01-01

    In recent years, there has been an increased focus on placing patients at the center of health care research and evaluating clinical care in order to improve their experience and ensure that research is both robust and of maximum value for the use of medicinal products, therapy, or health services. This paper provides an overview of patients’ involvement in clinical research and service evaluation along with its benefits and limitations. We describe and discuss patient-reported outcomes (PROs) and patient-reported outcome measures (PROMs), including the trends in current research. Both the patient-reported experiences measures (PREMs) and patient and public involvement (PPI) initiative for including patients in the research processes are also outlined. PROs provide reports from patients about their own health, quality of life, or functional status associated with the health care or treatment they have received. PROMs are tools and/or instruments used to report PROs. Patient report experiences through the use of PREMs, such as satisfaction scales, providing insight into the patients’ experience with their care or a health service. There is increasing international attention regarding the use of PREMS as a quality indicator of patient care and safety. This reflects the ongoing health service commitment of involving patients and the public within the wider context of the development and evaluation of health care service delivery and quality improvement. PMID:25114561

  9. Outcome measures for adult critical care: a systematic review.

    PubMed

    Hayes, J A; Black, N A; Jenkinson, C; Young, J D; Rowan, K M; Daly, K; Ridley, S

    2000-01-01

    1. To identify generic and disease specific measures of impairment, functional status and health-related quality of life that have been used in adult critical care (intensive and high-dependency care) survivors. 2. To review the validity, reliability and responsiveness of the measures in adult critical care survivors. 3. To consider the implications for future policy and to make recommendations for further methodological research. 4. To review what is currently known of the outcome of adult critical care. Searches of electronic databases (MEDLINE, EMBASE, CINAHL, PsycLIT, The Cochrane Library and SIGLE) from 1970 to August 1998. Manual searches of five journals (1985-98) not indexed in electronic databases and relevant conference proceedings (1993-98). Reference lists of six existing reviews, plus snowballing from reference lists of all relevant articles identified. Randomised trials, non-randomised trials (cohort studies) and case series that included data on outcomes after discharge from adult (16 years and over) critical care. If reported, the following data were extracted from each paper: patient characteristics (age, gender, severity of illness, diagnostic category) number of patients eligible for study, follow-up period, number of deaths before follow-up, number and proportion of survivors included in follow-up method of presentation of outcome data - proportion normal as defined by reference values, or aggregate value (e.g. mean or median), or aggregate values plus an indication of variance (e.g. standard deviation or inter-quartile range). Evidence for three measurement properties was sought for each outcome measure that had been used in at least two studies - their validity, reliability and responsiveness in adult critical care. If the authors did not report these aspects explicitly, an attempt was made to use the data provided to provide these measurement properties. For measures that were used in at least ten studies, information on actual reported

  10. Testing Multiple Outcomes in Repeated Measures Designs

    ERIC Educational Resources Information Center

    Lix, Lisa M.; Sajobi, Tolulope

    2010-01-01

    This study investigates procedures for controlling the familywise error rate (FWR) when testing hypotheses about multiple, correlated outcome variables in repeated measures (RM) designs. A content analysis of RM research articles published in 4 psychology journals revealed that 3 quarters of studies tested hypotheses about 2 or more outcome…

  11. Selection and visualisation of outcome measures for complex post-acute acquired brain injury rehabilitation interventions

    PubMed Central

    Ford, Catherine Elaine Longworth; Malley, Donna; Bateman, Andrew; Clare, Isabel C.H.; Wagner, Adam P.; Gracey, Fergus

    2016-01-01

    Background Outcome measurement challenges rehabilitation services to select tools that promote stakeholder engagement in measuring complex interventions. Objectives To examine the suitability of outcome measures for complex post-acute acquired brain injury (ABI) rehabilitation interventions, report outcomes of a holistic, neuropsychological ABI rehabilitation program and propose a simple way of visualizing complex outcomes. Methods Patient/carer reported outcome measures (PROMS), experience measures (PREMS) and staff-rated measures were collected for consecutive admissions over 1 year to an 18-week holistic, neuropsychological rehabilitation programme at baseline, 18 weeks and 3- and 6-month follow-up. Results Engagement with outcome measurement was poorest for carers and at follow-up for all stakeholders. Dependence, abilities, adjustment, unmet needs, symptomatology including executive dysfunction, and self-reassurance showed improvements at 18 weeks. Adjustment, social participation, perceived health, symptomatology including dysexecutive difficulties, and anxiety were worse at baseline for those who did not complete rehabilitation, than those who did. A radar plot facilitated outcome visualization. Conclusions Engagement with outcome measurement was best when time and support were provided. Supplementing patient- with staff-rated and attendance measures may explain missing data and help quantify healthcare needs. The MPAI4, EBIQ and DEX-R appeared suitable measures to evaluate outcomes and distinguish those completing and not completing neuropsychological rehabilitation. PMID:27341362

  12. Understanding the outcomes measures used in Huntington disease pharmacologicaltrials: A systematic review

    PubMed Central

    Carlozzi, Noelle E; Miciura, Angela; Migliore, Nicholas; Dayalu, Praveen

    2014-01-01

    Background The identification of the gene mutation causing Huntington disease has raised hopes for new treatments to ease symptoms and slow functional decline. As such, there has been a push towards designing efficient pharmacological trials (i.e., drug trials), especially with regard to selecting outcomes measures that are both brief and sensitive to changes across the course of the disease, from subtle prodromal changes, to more severe end-stage changes. Objectives Recently, to aid in efficient development of new HD research studies, the National Institute of Neurological Disorders and Stroke (NINDS) published recommendations for measurement selection in HD. While these recommendations are helpful, many of the recommended measures have little published data in HD. As such, we conducted a systematic review of the literature to identify the most common outcomes measures used in HD clinical trials. Methods Major medical databases, including PubMed, Embase, CINAHL, and the Cochrane Central Register of Controlled Trials, were used to identify peer-reviewed journal articles in English from 2001 through April 2013; 151 pharmacological trials were identified. Results The majority of HD clinical trials employed clinician-reported outcomes measures (93%); patient reported outcome measures (11%) and observer reported outcome measures (3%) were used with much less frequency. Conclusions We provide a review of the most commonly used measures across these trials, compare these measures to the clinical recommendations made by the NINDS working groups, and provide recommendations for selecting measures for future clinical trials that meet the Food and Drug Administration standards. PMID:25300328

  13. Comparison of rheumatoid arthritis clinical trial outcome measures: a simulation study.

    PubMed

    Anderson, Jennifer J; Bolognese, James A; Felson, David T

    2003-11-01

    Isolated studies have suggested that continuous measures of response may be better than predefined, dichotomous definitions (e.g., the American College of Rheumatology 20% improvement criteria [ACR20]) for discriminating between rheumatoid arthritis (RA) treatments. Our goal was to determine the statistical power of predefined dichotomous outcome measures (termed "a priori"), compared with that of continuous measures derived from trial data in which there was no predefined response threshold (termed "data driven"), and to evaluate the sensitivity to change of these measures in the context of different treatments and early versus later-stage disease. In order to generalize beyond results from a single trial, we performed simulation studies. We obtained summary data from trials comparing disease-modifying antirheumatic drugs (DMARDs) and from comparative coxib-placebo trials to test the power of 2 a priori outcomes, the ACR20 and improvement of the Disease Activity Score (DDAS), as well as 2 data-driven outcomes. We studied patients with early RA and those with later-stage RA (duration of <4 years and 4-9 years, respectively). We performed simulation studies, using the interrelationship of ACR core set measures in the trials to generate multiple trial data sets consistent with the original data. The data-driven outcomes had greater power than did the a priori measures. The DMARD comparison was more powerful in early disease than in later-stage disease (the sample sizes needed to achieve 80% power for the most powerful test were 64 for early disease versus 100 for later disease), but the coxib-versus-placebo comparison was less powerful in early disease than in later disease (the sample sizes needed to achieve 80% power were 200 and 100, respectively). When the effects of treatment on core set items were small and/or inconsistent, power was reduced, particularly for a less broadly based outcome (e.g., DDAS) compared with the ACR20. The simulation studies demonstrate

  14. Determinants of 25(OH)D sufficiency in obese minority children: selecting outcome measures and analytic approaches.

    PubMed

    Zhou, Ping; Schechter, Clyde; Cai, Ziyong; Markowitz, Morri

    2011-06-01

    To highlight complexities in defining vitamin D sufficiency in children. Serum 25-(OH) vitamin D [25(OH)D] levels from 140 healthy obese children age 6 to 21 years living in the inner city were compared with multiple health outcome measures, including bone biomarkers and cardiovascular risk factors. Several statistical analytic approaches were used, including Pearson correlation, analysis of covariance (ANCOVA), and "hockey stick" regression modeling. Potential threshold levels for vitamin D sufficiency varied by outcome variable and analytic approach. Only systolic blood pressure (SBP) was significantly correlated with 25(OH)D (r = -0.261; P = .038). ANCOVA revealed that SBP and triglyceride levels were statistically significant in the test groups [25(OH)D <10, <15 and <20 ng/mL] compared with the reference group [25(OH)D >25 ng/mL]. ANCOVA also showed that only children with severe vitamin D deficiency [25(OH)D <10 ng/mL] had significantly higher parathyroid hormone levels (Δ = 15; P = .0334). Hockey stick model regression analyses found evidence of a threshold level in SBP, with a 25(OH)D breakpoint of 27 ng/mL, along with a 25(OH)D breakpoint of 18 ng/mL for triglycerides, but no relationship between 25(OH)D and parathyroid hormone. Defining vitamin D sufficiency should take into account different vitamin D-related health outcome measures and analytic methodologies. Copyright © 2011 Mosby, Inc. All rights reserved.

  15. Results from a prospective acute inpatient rehabilitation database: clinical characteristics and functional outcomes using the Functional Independence Measure.

    PubMed

    Ng, Yee Sien; Jung, Heeyoune; Tay, San San; Bok, Chek Wai; Chiong, Yi; Lim, Peter A C

    2007-01-01

    Rehabilitation improves functional outcomes, but there is little data on the profiles and outcomes of patients undergoing inpatient rehabilitation in Singapore. The aims of this paper were to document the clinical characteristics and functional outcomes, using the Functional Independence Measure (FIM), of all patients admitted to an inpatient rehabilitation unit in a tertiary teaching hospital, and to identify and analyse factors significantly associated with better discharge functional scores and higher functional gains. In this prospective cohort study over a 4-year period, clinical and functional data for 1502 patients admitted consecutively to the Singapore General Hospital inpatient rehabilitation unit were charted into a custom-designed rehabilitation database. The primary outcome measures were the discharge total FIM scores, FIM gain and FIM efficiency. Multiple linear regression analysis was used to identify independent variables associated with better discharge FIM scores and FIM gain. The mean age was 61.3 +/- 15.0 years and 57.2% of the patients were male. Stroke (57.9%) followed by spinal cord injury (9.7%) were the most common diagnoses. The average rehabilitation length of stay was 21.5 +/- 19.0 days. The mean admission total FIM score was 70.3 +/- 23.2 and the mean discharge total FIM score was 87.3 +/- 23.0, with this gain being highly significant (P <0.001). The mean FIM gain was 17.0 +/- 13.4 and FIM efficiency was 0.95 +/- 0.90 points/day. Factors associated with better functional outcomes were higher admission motor and cognitive FIM scores, male gender, a longer rehabilitation length of stay and the use of acupuncture. Factors associated with poorer functional outcomes were older age, clinical deconditioning, ischaemic heart disease, depression, pressure sores and the presence of a domestic worker as a caregiver. The FIM is an easy-to-use, standardised and robust general measure of functional disability. Multiple demographic, clinical and socio

  16. Need and greed in dermatology: disease and outcome measures in dermatological healthcare planning.

    PubMed

    Dalgard, Florence; Finlay, Andrew Y

    2006-01-01

    Assessing dermatological needs in the population and our ability to meet them is a challenge. The choice of outcome measures is central in dermatological healthcare planning. The concept of ill health and its relationship to dermatological outcome measures is described. Outcome measures used should provide information on these issues in order to gain insight into genuine needs and illness behavior in the population and to ensure quality of healthcare. Nevertheless, the dilemma of assigning priorities in healthcare planning remains; outcome measures in dermatology should be perceived as appropriate by patients as well as by caregivers and policy makers. It is important to stimulate research to develop and refine person-focused outcome measures. Their use is essential to assess dermatological health needs and to understand illness behavior. The information they can provide can enable provision and evaluation of healthcare quality and contribute to the challenge of making appropriate priority decisions in healthcare. Copyright (c) 2006 S. Karger AG, Basel.

  17. 78 FR 59626 - Main Hawaiian Islands Deep 7 Bottomfish Annual Catch Limits and Accountability Measures for 2013-14

    Federal Register 2010, 2011, 2012, 2013, 2014

    2013-09-27

    ... Accountability Measures for 2013-14 AGENCY: National Marine Fisheries Service (NMFS), National Oceanic and... associated accountability measure (AM) close the non-commercial and commercial fisheries for Deep 7...

  18. Outcome Measurement in Nursing: Imperatives, Ideals, History, and Challenges

    PubMed

    Jones, Terry L

    2016-05-31

    Nurses have a social responsibility to evaluate the effect of nursing practice on patient outcomes in the areas of health promotion; injury and illness prevention; and alleviation of suffering. Quality assessment initiatives are hindered by the paucity of available data related to nursing processes and patient outcomes across these three domains of practice. Direct care nurses are integral to self-regulation for the discipline as they are the best source of information about nursing practice and patient outcomes. Evidence supports the assumption that nurses do contribute to prevention of adverse events but there is insufficient evidence to explain how nurses contribute to these and/or other patient outcomes. The purposes of this article are to examine the imperatives, ideal conditions, history, and challenges related to effective outcome measurement in nursing. The article concludes with recommendations for action to move quality assessment forward, such as substantial investment to support adequate documentation of nursing practice and patient outcomes.

  19. A Binomial Test of Group Differences with Correlated Outcome Measures

    ERIC Educational Resources Information Center

    Onwuegbuzie, Anthony J.; Levin, Joel R.; Ferron, John M.

    2011-01-01

    Building on previous arguments for why educational researchers should not provide effect-size estimates in the face of statistically nonsignificant outcomes (Robinson & Levin, 1997), Onwuegbuzie and Levin (2005) proposed a 3-step statistical approach for assessing group differences when multiple outcome measures are individually analyzed…

  20. Response to "Redesigning Systems of School Accountability": Addressing Underlying Inequities

    ERIC Educational Resources Information Center

    Gil, Elizabeth; Kim, Taeyon

    2018-01-01

    As Bae (2018) suggests, one way to fill gaps between a holistic view of student learning and accountability policy implementation is to use multiple measures that reflect diverse perspectives of learning. The purpose of this commentary is to provide a discussion of issues, which need to be considered in order to achieve the desired outcomes of…

  1. Outcomes mapping study for childhood vaccination communication: too few concepts were measured in too many ways.

    PubMed

    Kaufman, Jessica; Ryan, Rebecca; Bosch-Capblanch, Xavier; Cartier, Yuri; Cliff, Julie; Glenton, Claire; Lewin, Simon; Rada, Gabriel; Ames, Heather; Muloliwa, Artur Manuel; Oku, Afiong; Oyo-Ita, Angela; Hill, Sophie

    2016-04-01

    The objectives of this article are to (1) comprehensively catalog outcomes measured in trials of childhood vaccination communication interventions and (2) analyze patterns and trends in outcome selection. To achieve these objectives, we developed a Trial Outcomes Map for vaccination communication. We searched the Cochrane Central Register of Controlled Trials for trials of childhood vaccination communication interventions, extracting verbatim all outcome information from included trials. Through thematic grouping, we categorized outcomes based on conceptual similarities, forming a Trial Outcomes Map. We identified 112 relevant trials containing 209 outcomes. Thematic analysis revealed three overarching Outcome Categories: consumer-, vaccination-, and health system-related outcomes. These categories contain 21 Outcome Types (eg, "knowledge," "cost"), measured using 66 different Outcome Variables. Vaccination outcomes were measured most frequently and health system-related outcomes least frequently. Consumer outcomes are increasingly measured in more recent trials. The number of measures used for the same outcomes complicates data synthesis and interpretation. Despite recent trends toward including consumer outcomes, intermediate outcome measurement is lacking, hampering understanding of how and why vaccination communication interventions do or do not work. This Map may improve outcome consistency in future trials and will contribute to a forthcoming core outcome set. Copyright © 2016 The Authors. Published by Elsevier Inc. All rights reserved.

  2. Outcome Measurement in the Treatment of Spasmodic Dysphonia: A Systematic Review of the Literature.

    PubMed

    Rumbach, Anna; Aiken, Patrick; Novakovic, Daniel

    2018-04-11

    The aim of this review was to systematically identify all available studies reporting outcomes measures to assess treatment outcomes for people with spasmodic dysphonia (SD). Full-text journal articles were identified through searches of PubMed, Embase, CINAHL, and Cochrane databases and hand searching of journals. A total of 4,714 articles were retrieved from searching databases; 1,165 were duplicates. Titles and abstracts of 3,549 were screened, with 171 being selected for full-text review. During full-text review, 101 articles were deemed suitable for inclusion. An additional 24 articles were identified as suitable for inclusion through a hand search of reference lists. Data were extracted from 125 studies. A total of 220 outcome measures were identified. Considered in reference to the World Health Organization International Classification of Functioning, Disability and Health (ICF), the majority of outcomes were measured at a Body Function level (n = 212, 96%). Outcomes that explored communication and participation in everyday life and attitudes toward communication (ie, activity and participation domains) were infrequent (n = 8; 4%). Quality of life, a construct not measured within the ICF, was also captured by four outcome measures. No instruments evaluating communication partners' perspectives or burden/disability were identified. The outcome measures used in SD treatment studies are many and varied. The outcome measures identified predominately measure constructs within the Body Functions component of the ICF. In order to facilitate data synthesis across trials, the development of a core outcome set is recommended. Crown Copyright © 2018. Published by Elsevier Inc. All rights reserved.

  3. Recommendations for the Use of Common Outcome Measures in Pediatric Traumatic Brain Injury Research

    PubMed Central

    Wilde, Elisabeth A.; Anderson, Vicki A.; Bedell, Gary; Beers, Sue R.; Campbell, Thomas F.; Chapman, Sandra B.; Ewing-Cobbs, Linda; Gerring, Joan P.; Gioia, Gerard A.; Levin, Harvey S.; Michaud, Linda J.; Prasad, Mary R.; Swaine, Bonnie R.; Turkstra, Lyn S.; Wade, Shari L.; Yeates, Keith O.

    2012-01-01

    Abstract This article addresses the need for age-relevant outcome measures for traumatic brain injury (TBI) research and summarizes the recommendations by the inter-agency Pediatric TBI Outcomes Workgroup. The Pediatric Workgroup's recommendations address primary clinical research objectives including characterizing course of recovery from TBI, prediction of later outcome, measurement of treatment effects, and comparison of outcomes across studies. Consistent with other Common Data Elements (CDE) Workgroups, the Pediatric TBI Outcomes Workgroup adopted the standard three-tier system in its selection of measures. In the first tier, core measures included valid, robust, and widely applicable outcome measures with proven utility in pediatric TBI from each identified domain including academics, adaptive and daily living skills, family and environment, global outcome, health-related quality of life, infant and toddler measures, language and communication, neuropsychological impairment, physical functioning, psychiatric and psychological functioning, recovery of consciousness, social role participation and social competence, social cognition, and TBI-related symptoms. In the second tier, supplemental measures were recommended for consideration in TBI research focusing on specific topics or populations. In the third tier, emerging measures included important instruments currently under development, in the process of validation, or nearing the point of published findings that have significant potential to be superior to measures in the core and supplemental lists and may eventually replace them as evidence for their utility emerges. PMID:21644810

  4. Transforming Course Evaluations into a Meaningful Measure of Student Outcomes Achievement

    ERIC Educational Resources Information Center

    McCullough, Christopher A.

    2008-01-01

    Over the past few years, the author had the good fortune to engage many faculty and administrators in conversations about student outcomes assessment. The author has discovered that many faculty and administrators associate course valuations with student outcomes assessment measures. He also found that no items about student learning outcomes are…

  5. Swallowing outcome measures in head and neck cancer--How do they compare?

    PubMed

    Pedersen, A; Wilson, Janet; McColl, Elaine; Carding, Paul; Patterson, Jo

    2016-01-01

    Dysphagia is a common and debilitating side effect of chemoradiotherapy. Assessment is difficult; swallowing is multifactorial and studies choose from a range of dysphagia assessments. This study intended to investigate the relationship between swallowing assessments of dysphagia in a cohort of patients and to evaluate whether clinical swallowing measures can predict patient reported swallowing outcomes. One hundred and seventy-three head and neck cancer patients from two teaching hospitals were recruited prospectively over 25 months. At three months follow-up patients were assessed using Rosenbeck's Penetration-Aspiration Scale (PAS), The 100 ml Water Swallow Test (WST), The Performance Status Scale: Normalcy of Diet and the MD Anderson Dysphagia Inventory (MDADI). The highest correlation was observed between the MDADI and Normalcy of Diet (rho 0.68) and the lowest between the MDADI and the PAS (rho 0.34). Using multiple regression the PAS and WST accounted for 44% of the variance in the MDADI scores (R2 = 0.44, F = 37.8, p < 0.001). On stepwise regression, the model only retained the Normalcy of Diet scores (R2 = 0.42, F=107.9, p < 0.001). Separating the PAS into subgroups, those with no penetration or aspiration on the PAS scored significantly higher on the MDADI (p = <0.001). Patient reported swallowing outcomes were strongly aligned with diet restrictions but poorly aligned with clinical assessment. The WST, however, was more correlated than the PAS score, representing a more functional assessment. Clinical dysphagia, associated with significant morbidity, and patient reported dysphagia related to quality of life are not interchangeable and must be measured separately. Copyright © 2015 Elsevier Ltd. All rights reserved.

  6. Developing core outcome measurement sets for clinical trials: OMERACT filter 2.0.

    PubMed

    Boers, Maarten; Kirwan, John R; Wells, George; Beaton, Dorcas; Gossec, Laure; d'Agostino, Maria-Antonietta; Conaghan, Philip G; Bingham, Clifton O; Brooks, Peter; Landewé, Robert; March, Lyn; Simon, Lee S; Singh, Jasvinder A; Strand, Vibeke; Tugwell, Peter

    2014-07-01

    Lack of standardization of outcome measures limits the usefulness of clinical trial evidence to inform health care decisions. This can be addressed by agreeing on a minimum core set of outcome measures per health condition, containing measures relevant to patients and decision makers. Since 1992, the Outcome Measures in Rheumatology (OMERACT) consensus initiative has successfully developed core sets for many rheumatologic conditions, actively involving patients since 2002. Its expanding scope required an explicit formulation of its underlying conceptual framework and process. Literature searches and iterative consensus process (surveys and group meetings) of stakeholders including patients, health professionals, and methodologists within and outside rheumatology. To comprehensively sample patient-centered and intervention-specific outcomes, a framework emerged that comprises three core "Areas," namely Death, Life Impact, and Pathophysiological Manifestations; and one strongly recommended Resource Use. Through literature review and consensus process, core set development for any specific health condition starts by identifying at least one core "Domain" within each of the Areas to formulate the "Core Domain Set." Next, at least one applicable measurement instrument for each core Domain is identified to formulate a "Core Outcome Measurement Set." Each instrument must prove to be truthful (valid), discriminative, and feasible. In 2012, 96% of the voting participants (n=125) at the OMERACT 11 consensus conference endorsed this model and process. The OMERACT Filter 2.0 explicitly describes a comprehensive conceptual framework and a recommended process to develop core outcome measurement sets for rheumatology likely to be useful as a template in other areas of health care. Copyright © 2014 The Authors. Published by Elsevier Inc. All rights reserved.

  7. Accounting for response misclassification and covariate measurement error improves power and reduces bias in epidemiologic studies.

    PubMed

    Cheng, Dunlei; Branscum, Adam J; Stamey, James D

    2010-07-01

    To quantify the impact of ignoring misclassification of a response variable and measurement error in a covariate on statistical power, and to develop software for sample size and power analysis that accounts for these flaws in epidemiologic data. A Monte Carlo simulation-based procedure is developed to illustrate the differences in design requirements and inferences between analytic methods that properly account for misclassification and measurement error to those that do not in regression models for cross-sectional and cohort data. We found that failure to account for these flaws in epidemiologic data can lead to a substantial reduction in statistical power, over 25% in some cases. The proposed method substantially reduced bias by up to a ten-fold margin compared to naive estimates obtained by ignoring misclassification and mismeasurement. We recommend as routine practice that researchers account for errors in measurement of both response and covariate data when determining sample size, performing power calculations, or analyzing data from epidemiological studies. 2010 Elsevier Inc. All rights reserved.

  8. Probabilistic metrology or how some measurement outcomes render ultra-precise estimates

    NASA Astrophysics Data System (ADS)

    Calsamiglia, J.; Gendra, B.; Muñoz-Tapia, R.; Bagan, E.

    2016-10-01

    We show on theoretical grounds that, even in the presence of noise, probabilistic measurement strategies (which have a certain probability of failure or abstention) can provide, upon a heralded successful outcome, estimates with a precision that exceeds the deterministic bounds for the average precision. This establishes a new ultimate bound on the phase estimation precision of particular measurement outcomes (or sequence of outcomes). For probe systems subject to local dephasing, we quantify such precision limit as a function of the probability of failure that can be tolerated. Our results show that the possibility of abstaining can set back the detrimental effects of noise.

  9. Measure against Measure: Responsibility versus Accountability in Education

    ERIC Educational Resources Information Center

    Senechal, Diana

    2013-01-01

    In education policy, practice, and discussion, we find ourselves caught between responsibility--fidelity to one's experience, conscience, and discernment--and a narrow kind of accountability. In order to preserve integrity, we (educators and leaders) must maintain independence of thought while skillfully articulating our work to the outside world.…

  10. The strategic use of outcome information.

    PubMed

    Thompson, D I; Sirio, C; Holt, P

    2000-10-01

    Most health care executives see outcome measurement as a technical or tactical matter rather than as a strategic tool. Accordingly, provider investment in outcome measurement and management is relatively small. Nevertheless, outcome information can be key to achieving an organization's strategic objectives. Advances in risk adjustment and improvements in technology for data collection and analysis have made outcome measurement a practical tool for individual hospital use. Strategically integrated outcome measurement efforts can give providers a competitive advantage over organizations that only use outcomes tactically. One of the best examples of an acute care provider that has used outcome information for strategic advantage is Intermountain Health Care (IHC; Salt Lake City). In 1997 IHC made clinical quality and outcomes the primary focus of its five-year strategic plan. To support the new strategy IHC's board of trustees approved the development of an outcome information system that generated data along clinical processes of care and the creation of a new management structure to use these data to hold professionals accountable and to set and achieve clinical improvement goals. From 1996 to 1999, IHC's share of the commercial health care market in Utah increased from roughly 50% to about 62% of the market, with the result that it has stopped actively marketing its services. Health care executives will not willingly invest in outcomes until they believe that they have business value. Therefore, making the business case for outcomes can help improve the quality of health care and the lives of individuals.

  11. Association of surgical care improvement project infection-related process measure compliance with risk-adjusted outcomes: implications for quality measurement.

    PubMed

    Ingraham, Angela M; Cohen, Mark E; Bilimoria, Karl Y; Dimick, Justin B; Richards, Karen E; Raval, Mehul V; Fleisher, Lee A; Hall, Bruce L; Ko, Clifford Y

    2010-12-01

    Facility-level process measure adherence is being publicly reported. However, the association between measure adherence and surgical outcomes is not well-established. Our objective was to determine the degree to which Surgical Care Improvement Project (SCIP) process measures are associated with American College of Surgeons National Surgical Quality Improvement Program (ACS NSQIP) risk-adjusted outcomes. This cross-sectional study included hospitals participating in the ACS NSQIP and SCIP (n = 200). ACS NSQIP outcomes (30-day overall morbidity, serious morbidity, surgical site infections [SSI], and mortality) and adherence to SCIP SSI-related process measures (from the Hospital Compare database) were collected from January 1, 2008, through December 31, 2008. Hospital-level correlation coefficients between compliance with 4 process measures (ie, antibiotic administration within 1 hour before incision [SCIP-1]; appropriate antibiotic prophylaxis [SCIP-2]; antibiotic discontinuation within 24 hours after surgery [SCIP-3]; and appropriate hair removal [SCIP 6]) and 4 risk-adjusted outcomes were calculated. Regression analyses estimated the contribution of process measure adherence to risk-adjusted outcomes. Of 211 ACS NSQIP hospitals, 95% had data reported by Hospital Compare. Depending on the measure, hospital-level compliance ranged from 60% to 100%. Of the 16 correlations, 15 demonstrated nonsignificant associations with risk-adjusted outcomes. The exception was the relationship between SCIP-2 and SSI (p = 0.004). SCIP-1 demonstrated an intriguing but nonsignificant relationship with SSI (p = 0.08) and overall morbidity (p = 0.08). Although adherence to SCIP-2 was a significant predictor of risk-adjusted SSI (p < 0.0001) and overall morbidity (p < 0.0001), inclusion of compliance for SCIP-1 and SCIP-2 caused only slight improvement in model quality. Better adherence to infection-related process measures over the observed range was not significantly associated with

  12. Surrogacy assessment using principal stratification when surrogate and outcome measures are multivariate normal.

    PubMed

    Conlon, Anna S C; Taylor, Jeremy M G; Elliott, Michael R

    2014-04-01

    In clinical trials, a surrogate outcome variable (S) can be measured before the outcome of interest (T) and may provide early information regarding the treatment (Z) effect on T. Using the principal surrogacy framework introduced by Frangakis and Rubin (2002. Principal stratification in causal inference. Biometrics 58, 21-29), we consider an approach that has a causal interpretation and develop a Bayesian estimation strategy for surrogate validation when the joint distribution of potential surrogate and outcome measures is multivariate normal. From the joint conditional distribution of the potential outcomes of T, given the potential outcomes of S, we propose surrogacy validation measures from this model. As the model is not fully identifiable from the data, we propose some reasonable prior distributions and assumptions that can be placed on weakly identified parameters to aid in estimation. We explore the relationship between our surrogacy measures and the surrogacy measures proposed by Prentice (1989. Surrogate endpoints in clinical trials: definition and operational criteria. Statistics in Medicine 8, 431-440). The method is applied to data from a macular degeneration study and an ovarian cancer study.

  13. Human Resource Accounting.

    DTIC Science & Technology

    1984-12-01

    costs . The goal of this thesis is to help the Portuguese Navy in formulating a formal and coherent approach to its human resource accounting , and in so...ABSTRACT Human Resource Accounting means accounting for people as an organizational asset. It is the measurement of the cost and value of people to the...29 II.HUMAN RESOURCE COSTS . . . . . . . . . . . 30 A. CONCEPTS OF COST AND MEASUREMENT METHODS . . . 30 1. Accounting Concepts of Costs

  14. Reference values for developing responsive functional outcome measures across the lifespan.

    PubMed

    McKay, Marnee J; Baldwin, Jennifer N; Ferreira, Paulo; Simic, Milena; Vanicek, Natalie; Burns, Joshua

    2017-04-18

    To generate a reference dataset of commonly performed functional outcome measures in 1,000 children and adults and investigate the influence of demographic, anthropometric, strength, and flexibility characteristics. Twelve functional outcome measures were collected from 1,000 healthy individuals aged 3-101 years: 6-minute walk test, 30-second chair stand test, timed stairs test, long jump, vertical jump, choice stepping reaction time, balance (Star Excursion Balance Test, tandem stance eyes open and closed, single-leg stance eyes closed), and dexterity (9-hole peg test, Functional Dexterity Test). Correlation and multiple regression analyses were performed to identify factors independently associated with each measure. Age- and sex-stratified reference values for functional outcome measures were generated. Functional performance increased through childhood and adolescence, plateaued during adulthood, and declined in older adulthood. While balance did not differ between the sexes, male participants generally performed better at gross motor tasks while female participants performed better at dexterous tasks. Height was the most consistent correlate of functional performance in children, while lower limb muscle strength was a major determinant in adolescents and adults. In older adults, age, lower limb strength, and joint flexibility explained up to 63% of the variance in functional measures. These normative reference values provide a framework to accurately track functional decline associated with neuromuscular disorders and assist development and validation of responsive outcome measures for therapeutic trials. © 2017 American Academy of Neurology.

  15. Physical outcome measures for conductive and mixed hearing loss treatment: A systematic review.

    PubMed

    Johansson, M L; Tysome, J R; Hill-Feltham, P; Hodgetts, W E; Ostevik, A; McKinnon, B J; Monksfield, P; Sockalingam, R; Wright, T

    2018-05-07

    The number of potential options for rehabilitation of patients with conductive or mixed hearing loss is continually expanding. To be able to inform patients and other stakeholders there is a need to identify and develop patient-centred outcomes for treatment of hearing loss. To identify outcome measures in the physical core area used when reporting the outcome after treatment of conductive and mixed hearing loss in adult patients. Systematic review. Systematic review of literature related to reported physical outcome measures after treatment of mixed or conductive hearing loss without restrictions regarding type of intervention, treatment or device. Any measure reporting the physical outcome after treatment or intervention of mixed or conductive hearing loss was sought and categorised. The physical outcomes measures that had been extracted were then grouped into domains. The literature search resulted in the identification of 1,434 studies, of which 153 were selected for inclusion in the review. The majority (57%) of papers reported results from middle ear surgery, with the remainder reporting results from either bone conduction hearing devices or middle ear implants. Outcomes related to complications were categorised into 17 domains, whereas outcomes related to treatment success was categorised in 22 domains. The importance of these domains to patients and other stakeholders needs to be further explored in order to establish which of these domains are most relevant to interventions for conductive or mixed hearing loss. This will allow us to then assess which outcomes measures are most suitable for inclusion in the core set This article is protected by copyright. All rights reserved. This article is protected by copyright. All rights reserved.

  16. Outcome Measures Used in Clinical Trials for Behçet Syndrome: A Systematic Review

    PubMed Central

    Hatemi, Gulen; Merkel, Peter A.; Hamuryudan, Vedat; Boers, Maarten; Direskeneli, Haner; Aydin, Sibel Z.; Yazici, Hasan

    2015-01-01

    Behçet syndrome (BS) is a multisystem vasculitis that is most active during young adulthood, causing serious disability and significant impairment in quality of life. Differences in the disease course, severity, and organ involvement between patients, depending on the age at presentation and sex, makes it impossible to determine a single management strategy. The diversity and variability in the outcome measures used in clinical trials in BS makes it difficult to compare the results or inform physicians about the best management strategy for individual patients. There is a large unmet need to determine or develop validated outcome measures for use in clinical trials in BS that are acceptable to researchers and regulatory agencies. We conducted a systematic review to describe the outcomes and outcome measures that have been used in clinical trials in BS. This review revealed the diversity and variability in the outcomes and outcome measures and the lack of standard definitions for most outcomes and rarity of validated outcome tools for disease assessment in BS. This systematic literature review will identify domains and candidate instruments for use in a Delphi exercise, the next step in the development of a core set of outcome measures that are properly validated and widely accepted by the collaboration of researchers from many different regions of the world and from different specialties, including rheumatology, ophthalmology, dermatology, gastroenterology, and neurology. PMID:24488418

  17. Outcome measures used in clinical trials for Behçet syndrome: a systematic review.

    PubMed

    Hatemi, Gulen; Merkel, Peter A; Hamuryudan, Vedat; Boers, Maarten; Direskeneli, Haner; Aydin, Sibel Z; Yazici, Hasan

    2014-03-01

    Behçet syndrome (BS) is a multisystem vasculitis that is most active during young adulthood, causing serious disability and significant impairment in quality of life. Differences in the disease course, severity, and organ involvement between patients, depending on the age at presentation and sex, makes it impossible to determine a single management strategy. The diversity and variability in the outcome measures used in clinical trials in BS makes it difficult to compare the results or inform physicians about the best management strategy for individual patients. There is a large unmet need to determine or develop validated outcome measures for use in clinical trials in BS that are acceptable to researchers and regulatory agencies. We conducted a systematic review to describe the outcomes and outcome measures that have been used in clinical trials in BS. This review revealed the diversity and variability in the outcomes and outcome measures and the lack of standard definitions for most outcomes and rarity of validated outcome tools for disease assessment in BS. This systematic literature review will identify domains and candidate instruments for use in a Delphi exercise, the next step in the development of a core set of outcome measures that are properly validated and widely accepted by the collaboration of researchers from many different regions of the world and from different specialties, including rheumatology, ophthalmology, dermatology, gastroenterology, and neurology.

  18. The Aphasia Communication Outcome Measure (ACOM): Dimensionality, Item Bank Calibration, and Initial Validation

    ERIC Educational Resources Information Center

    Hula, William D.; Doyle, Patrick J.; Stone, Clement A.; Hula, Shannon N. Austermann; Kellough, Stacey; Wambaugh, Julie L.; Ross, Katherine B.; Schumacher, James G.; St. Jacque, Ann

    2015-01-01

    Purpose: The purpose of this study is to investigate the structure and measurement properties of the Aphasia Communication Outcome Measure (ACOM), a patient-reported outcome measure of communicative functioning for persons with aphasia. Method: Three hundred twenty-nine participants with aphasia responded to 177 items asking about communicative…

  19. The National Outcomes Measurement System for Pediatric Speech-Language Pathology

    ERIC Educational Resources Information Center

    Mullen, Robert; Schooling, Tracy

    2010-01-01

    Purpose: The American Speech-Language-Hearing Association's (ASHA's) National Outcomes Measurement System (NOMS) was developed in the late 1990s. The primary purpose was to serve as a source of data for speech-language pathologists (SLPs) who found themselves called on to provide empirical evidence of the functional outcomes associated with their…

  20. Measuring Outcomes for Young Children and Their Families. Outcome Indicators for Everyday Kids, Everyday Lives: A Vision for Pennsylvania's Children

    ERIC Educational Resources Information Center

    Trivette, Carol M.; Dunst, Carl J.

    2011-01-01

    This monograph includes the final report for a project funded by the Pennsylvania Developmental Disabilities Council for "Measuring Outcomes for Children" (2008 RFP). The goal of the project was to "develop and demonstrate the effectiveness of an instrument designed to measure life outcomes of children with disabilities being…

  1. Measuring Outcome in the Treatment of Cocaine Dependence

    PubMed Central

    Crits-Christoph, Paul; Gallop, Robert; Gibbons, Mary Beth Connolly; Sadicario, Jaclyn S.; Woody, George

    2015-01-01

    Background Little in known about the extent to which outcome measures used in studies of the treatment of cocaine dependence are associated with longer-term use and with broader measures of clinical improvement. The current study examined reductions in use, and abstinence-oriented measures, in relation to functioning and longer-term clinical benefits in the treatment of cocaine dependence. Methods Overall drug use, cocaine use, and functioning in a number of addiction-related domains for 487 patients diagnosed with DSM-IV cocaine dependence and treated with one of four psychosocial interventions in the NIDA Cocaine Collaborative Treatment Study were assessed monthly during 6 months of treatment and at 9, 12, 15, and 18 month follow-up. Results Measures of during-treatment reduction in use were moderately correlated with drug and cocaine use measures 12 months, but showed non-significant or small correlations with measures of functioning at 12 months. Highest correlations were evident for abstinence measures (maximum consecutive days abstinence and completely abstinent) during treatment in relation to sustained (3 month) abstinence at 12 months. Latent class analysis of patterns of change over time revealed that most patients initially (months 1 to 4 of treatment) either became abstinent immediately or continued to use every month. Over the couse of follow-up, patients either maintained abstinence or used regularly – intermittent use was less common. Conclusions There were generally small associations between various measures of cocaine use and longer-term clinical benefits, other than abstinence was associated with continued abstinence. No one method of measuring outcome of treatment of cocaine dependence appears superior to others. PMID:26366427

  2. Connecting Stuttering Management and Measurement: I. Core Speech Measures of Clinical Process and Outcome

    ERIC Educational Resources Information Center

    Shenker, Rosalee C.

    2006-01-01

    Background: There will always be a place for stuttering treatments designed to eliminate or reduce stuttered speech. When those treatments are required, direct speech measures of treatment process and outcome are needed in clinical practice. Aims: Based on the contents of published clinical trials of such treatments, three "core" measures of…

  3. NCEO Framework for Educational Accountability.

    ERIC Educational Resources Information Center

    Ysseldyke, Jim; Krentz, Jane; Elliott, Judy; Thurlow, Martha; Erickson, Ronald; Moore, Michael

    This report describes how the National Center on Educational Outcomes (NCEO) Framework for Educational Accountability, which specifies outcomes and indicators for six developmental levels (ages three and six, grades four, eight, and twelve, and post-school), can be used to implement parts of the National Association of State Directors of Special…

  4. Outcome in pediatric hydrocephalus: a comparison between previously used outcome measures and the hydrocephalus outcome questionnaire.

    PubMed

    Platenkamp, Marc; Hanlo, Patrick W; Fischer, Kathelijn; Gooskens, Rob H J M

    2007-07-01

    The objectives of this study were to assess, in a cohort of children with recently treated hydrocephalus, the correlation between scores on the Hydrocephalus Outcome Questionnaire (HOQ) and the children's type of schooling and motor functioning, and to assess the overall outcome of the children. The health status of 142 pediatric patients (85 boys) with previous hydrocephalus, born between 1995 and 1999, was assessed. Outcomes were determined using the HOQ, type of schooling, and motor functioning. Data were obtained from parental interviews and patient medical records. RESULTS. Twelve patients died (8.5%). Responses to the HOQ were obtained from 107 patients (65 boys). The mean age of the patients was 7 years and 9 months +/- 1.42 years (range 6-10 years). The Physical Health score of the HOQ correlated well with the motor functioning score (r = 0.652) as did the Cognitive Health score with the type of schooling (r = 0.672). Fifty-nine percent of the patients were able to attend a school for students with normal intelligence. Disabling motor functioning was found in only 30% of patients. Epilepsy was present in 14%. The results show a good correlation between the type of schooling and the Cognitive HOQ score and between the Physical HOQ score and the motor functioning score. The HOQ is a simple and very useful measurement for determining outcome in pediatric hydrocephalus.

  5. Use of standardized outcome measures in physical therapist practice: perceptions and applications.

    PubMed

    Jette, Diane U; Halbert, James; Iverson, Courtney; Miceli, Erin; Shah, Palak

    2009-02-01

    Standardized instruments for measuring patients' activity limitations and participation restrictions have been advocated for use by rehabilitation professionals for many years. The available literature provides few recent reports of the use of these measures by physical therapists in the United States. The primary purpose of this study was to determine: (1) the extent of the use of standardized outcome measures and (2) perceptions regarding their benefits and barriers to their use. A secondary purpose was to examine factors associated with their use among physical therapists in clinical practice. The study used an observational design. A survey questionnaire comprising items regarding the use and perceived benefits and barriers of standardized outcome measures was sent to 1,000 randomly selected members of the American Physical Therapy Association (APTA). Forty-eight percent of participants used standardized outcome measures. The majority of participants (>90%) who used such measures believed that they enhanced communication with patients and helped direct the plan of care. The most frequently reported reasons for not using such measures included length of time for patients to complete them, length of time for clinicians to analyze the data, and difficulty for patients in completing them independently. Use of standardized outcome measures was related to specialty certification status, practice setting, and the age of the majority of patients treated. The limitations included an unvalidated survey for data collection and a sample limited to APTA members. Despite more than a decade of development and testing of standardized outcome measures appropriate for various conditions and practice settings, physical therapists have some distance to go in implementing their use routinely in most clinical settings. Based on the perceived barriers, alterations in practice management strategies and the instruments themselves may be necessary to increase their use.

  6. Associations between nine family dinner frequency measures and child weight, dietary and psychosocial outcomes

    PubMed Central

    Fulkerson, Jayne A.; Friend, Sarah E.; Neumark-Sztainer, Dianne

    2015-01-01

    Background Family meal frequency has been consistently and significantly associated with positive youth dietary and psychosocial outcomes but less consistently associated with weight outcomes. Family meal frequency measurement has varied widely and it is unclear how this variation may impact relationships with youth weight, dietary, and psychosocial outcomes. Objective This study assesses how five parent/caregiver-reported and four child-reported family dinner frequency measures correlate with each other and are associated with health-related outcomes. Design/Participants This secondary, cross-sectional analysis uses baseline, parent/caregiver (n=160) and 8–12 year old child (n=160) data from the Healthy Home Offerings via the Mealtime Environment (HOME) Plus trial (collected 2011–2012). Data were obtained from objective measurements, dietary recall interviews, and psychosocial surveys. Outcome measures Outcomes included child body mass index z-scores (BMIz), fruit, vegetable and sugar-sweetened beverage intake, dietary quality (Healthy Eating Index-2010 [HEI-2010]), family connectedness, and meal conversations. Statistical analyses performed Pearson correlations and general linear models were used to assess associations between family dinner frequency measures and outcomes. Results All family dinner frequency measures had comparable means and were correlated within and across parent/caregiver- and child-reporters (r=0.17–0.94, p<0.01). In unadjusted analyses, 78% of family dinner frequency measures were significantly associated with BMIz scores and 100% were significantly associated with fruit/vegetable intake and HEI-2010. In adjusted models, most significant associations with dietary and psychosocial outcomes remained but associations with child BMIz remained significant only for parent/caregiver- (β±SE= −0.07±0.03; p<0.05) and child-reported (β±SE= −0.06+0.02; p<0.01) family dinner frequency measures asking about ‘sitting and eating’ dinner

  7. Evaluating the results of stress urinary incontinence surgery with objective and subjective outcome measures.

    PubMed

    Diez-Itza, I; Espuña-Pons, M

    2014-09-01

    To assess the outcomes of stress urinary incontinence (SUI) surgery using objective and subjective measures in women with pure SUI and mixed urinary incontinence (MUI). The degree of correlation between the different outcome measures was also evaluated for both groups. A multicentre prospective cohort study of women who underwent surgery for SUI. A standardized cough stress test was used as the objective outcome measure, and specific items of the Epidemiology of Prolapse and Incontinence Questionnaire were used as the subjective outcome measure. The International Consultation on Incontinence Questionnaire-Urinary Incontinence Short Form (ICIQ-UI SF) and the Patient Global Impression of Improvement (PGI-I) questionnaires were used for global assessment. Kappa test was used to measure the degree of correlation between the outcome measures. The participants were categorized into two groups before surgery: pure SUI (n=116) and MUI (n=161). Six months after surgery, the cure rate of the SUI component was high in both groups according to the objective and subjective outcome measures. Global assessment showed lower cure rates. The degree of agreement between objective and subjective outcome measures was moderate (kappa 0.541, p<0.001) for women with pure SUI, and fair (kappa 0.377, p<0.001) for women with MUI. Correlation between the change in ICIQ-UI SF score (pre to post surgery) and the degree of satisfaction (PGI-I) was significant (p<0.01) for both the pure SUI group (0.43) and the MUI group (0.48). Both objective and subjective cure rates are high for women with pure SUI and MUI following SUI surgery in Spain. The degree of agreement between different outcome measures varies. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

  8. Failing Tests: Commentary on "Adapting Educational Measurement to the Demands of Test-Based Accountability"

    ERIC Educational Resources Information Center

    Thissen, David

    2015-01-01

    In "Adapting Educational Measurement to the Demands of Test-Based Accountability" Koretz takes the time-honored engineering approach to educational measurement, identifying specific problems with current practice and proposing minimal modifications of the system to alleviate those problems. In response to that article, David Thissen…

  9. Measuring and accounting for the intensity of nursing care: is it worthwhile?

    PubMed

    Finkler, Steven A

    2008-05-01

    In June 2007, the Robert Wood Johnson Foundation sponsored a conference titled "The Economics of Nursing: Paying for Quality Nursing Care." The second topic at the conference was "the appropriateness and feasibility of measuring and accounting for the intensity of nursing care." Drs. Welton and Sermeus presented papers on that topic. This response to those papers focuses on why the hospital industry has not always accounted for and measured nursing intensity. Then it asks, "Why do we want more accurate information about nursing resources used by different patients?" It is not sufficient to say the data regarding nursing costs are not accurate. Nor is it sufficient to say that we now can improve the accuracy of the data. To move forward in this area, we need to develop compelling evidence and arguments that indicate that nursing-cost data of greater accuracy have a benefit that will exceed the costs of that data collection.

  10. Transportation Satellite Accounts : A New Way of Measuring Transportation Services in America : [2011

    DOT National Transportation Integrated Search

    2011-01-01

    Transportation Satellite Accounts (TSA), produced by the Bureau of Economic Analysis and the Bureau of Transportation Statistics, provides measures of national transportation output. TSA includes both in-house and for-hire transportation services. Fo...

  11. Surrogacy assessment using principal stratification when surrogate and outcome measures are multivariate normal

    PubMed Central

    Conlon, Anna S. C.; Taylor, Jeremy M. G.; Elliott, Michael R.

    2014-01-01

    In clinical trials, a surrogate outcome variable (S) can be measured before the outcome of interest (T) and may provide early information regarding the treatment (Z) effect on T. Using the principal surrogacy framework introduced by Frangakis and Rubin (2002. Principal stratification in causal inference. Biometrics 58, 21–29), we consider an approach that has a causal interpretation and develop a Bayesian estimation strategy for surrogate validation when the joint distribution of potential surrogate and outcome measures is multivariate normal. From the joint conditional distribution of the potential outcomes of T, given the potential outcomes of S, we propose surrogacy validation measures from this model. As the model is not fully identifiable from the data, we propose some reasonable prior distributions and assumptions that can be placed on weakly identified parameters to aid in estimation. We explore the relationship between our surrogacy measures and the surrogacy measures proposed by Prentice (1989. Surrogate endpoints in clinical trials: definition and operational criteria. Statistics in Medicine 8, 431–440). The method is applied to data from a macular degeneration study and an ovarian cancer study. PMID:24285772

  12. Measuring social inclusion--a key outcome in global mental health.

    PubMed

    Baumgartner, Joy Noel; Burns, Jonathan K

    2014-04-01

    Social inclusion is increasingly recognized as a key outcome for evaluating global mental health programmes and interventions. Whereas social inclusion as an outcome is not a new concept in the field of mental health, its measurement has been hampered by varying definitions, concepts and instruments. To move the field forward, this paper reviews the currently available instruments which measure social inclusion and are reported in the literature, realizing that no single measure will be appropriate for all studies or contexts. A systematic literature search of English language peer-reviewed articles published through February 2013 was undertaken to identify scales specifically developed to measure social inclusion or social/community integration among populations with mental disorders. Five instruments were identified through the search criteria. The scales are discussed in terms of their theoretical underpinnings, domains and/or key items and their potential for use in global settings. Whereas numerous reviewed abstracts discussed mental health and social inclusion or social integration, very few were concerned with direct measurement of the construct. All identified scales were developed in high-income countries with limited attention paid to how the scale could be adapted for cross-cultural use. Social inclusion is increasingly highlighted as a key outcome for global mental health policies and programmes, yet its measurement is underdeveloped. There is need for a global cross-cultural measure that has been developed and tested in diverse settings. However, until that need is met, some of the scales presented here may be amenable to adaptation.

  13. 45 CFR 287.145 - What measures will be used to determine NEW Program outcomes?

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ... Program outcomes? 287.145 Section 287.145 Public Welfare Regulations Relating to Public Welfare OFFICE OF... What measures will be used to determine NEW Program outcomes? Each grantee must develop its own... must identify planned program outcomes and the measures the Tribe will use to determine them. ACF will...

  14. Clinical outcome assessment in malignant glioma trials: measuring signs, symptoms, and functional limitations.

    PubMed

    Blakeley, Jaishri O; Coons, Stephen Joel; Corboy, John R; Kline Leidy, Nancy; Mendoza, Tito R; Wefel, Jeffrey S

    2016-03-01

    The shared goal of all parties developing therapeutics against malignant gliomas is to positively impact the lives of people affected by these cancers. Clinical outcome assessment (COA) tools, including measures of patient-reported outcome, performance outcome, clinician-reported outcome, and observer-reported outcome, allow patient-focused assessments to complement traditional efficacy measures such as overall survival and radiographic endpoints. This review examines the properties of various COA measures used in malignant glioma clinical trials to date and cross references their content to the priority signs, symptoms, and functional limitations defined through a community survey conducted by the National Brain Tumor Society. The overarching goal of this initiative is to identify COA measures that are feasible and have appropriate psychometric properties for use in this patient population as well as highlight where further development is needed. Published by Oxford University Press on behalf of the Society for Neuro-Oncology 2016. This work is written by (a) US Government employee(s) and is in the public domain in the US.

  15. Accounting for the measurement error of spectroscopically inferred soil carbon data for improved precision of spatial predictions.

    PubMed

    Somarathna, P D S N; Minasny, Budiman; Malone, Brendan P; Stockmann, Uta; McBratney, Alex B

    2018-08-01

    Spatial modelling of environmental data commonly only considers spatial variability as the single source of uncertainty. In reality however, the measurement errors should also be accounted for. In recent years, infrared spectroscopy has been shown to offer low cost, yet invaluable information needed for digital soil mapping at meaningful spatial scales for land management. However, spectrally inferred soil carbon data are known to be less accurate compared to laboratory analysed measurements. This study establishes a methodology to filter out the measurement error variability by incorporating the measurement error variance in the spatial covariance structure of the model. The study was carried out in the Lower Hunter Valley, New South Wales, Australia where a combination of laboratory measured, and vis-NIR and MIR inferred topsoil and subsoil soil carbon data are available. We investigated the applicability of residual maximum likelihood (REML) and Markov Chain Monte Carlo (MCMC) simulation methods to generate parameters of the Matérn covariance function directly from the data in the presence of measurement error. The results revealed that the measurement error can be effectively filtered-out through the proposed technique. When the measurement error was filtered from the data, the prediction variance almost halved, which ultimately yielded a greater certainty in spatial predictions of soil carbon. Further, the MCMC technique was successfully used to define the posterior distribution of measurement error. This is an important outcome, as the MCMC technique can be used to estimate the measurement error if it is not explicitly quantified. Although this study dealt with soil carbon data, this method is amenable for filtering the measurement error of any kind of continuous spatial environmental data. Copyright © 2018 Elsevier B.V. All rights reserved.

  16. The accountability of clinical education: its definition and assessment.

    PubMed

    Murray, E; Gruppen, L; Catton, P; Hays, R; Woolliscroft, J O

    2000-10-01

    Medical education is not exempt from increasing societal expectations of accountability. Competition for financial resources requires medical educators to demonstrate cost-effective educational practice; health care practitioners, the products of medical education programmes, must meet increasing standards of professionalism; the culture of evidence-based medicine demands an evaluation of the effect educational programmes have on health care and service delivery. Educators cannot demonstrate that graduates possess the required attributes, or that their programmes have the desired impact on health care without appropriate assessment tools and measures of outcome. To determine to what extent currently available assessment approaches can measure potentially relevant medical education outcomes addressing practitioner performance, health care delivery and population health, in order to highlight areas in need of research and development. Illustrative publications about desirable professional behaviour were synthesized to obtain examples of required competencies and health outcomes. A MEDLINE search for available assessment tools and measures of health outcome was performed. There are extensive tools for assessing clinical skills and knowledge. Some work has been done on the use of professional judgement for assessing professional behaviours; scholarship; and multiprofessional team working; but much more is needed. Very little literature exists on assessing group attributes of professionals, such as clinical governance, evidence-based practice and workforce allocation, and even less on examining individual patient or population health indices. The challenge facing medical educators is to develop new tools, many of which will rely on professional judgement, for assessing these broader competencies and outcomes.

  17. CONSIDER - Core Outcome Set in IAD Research: study protocol for establishing a core set of outcomes and measurements in incontinence-associated dermatitis research.

    PubMed

    Van den Bussche, Karen; De Meyer, Dorien; Van Damme, Nele; Kottner, Jan; Beeckman, Dimitri

    2017-10-01

    This study protocol describes the methodology for the development of a core set of outcomes and a core set of measurements for incontinence-associated dermatitis. Incontinence is a widespread disorder with an important impact on quality of life. One of the most common complications is incontinence-associated dermatitis, resulting from chemical and physical irritation of the skin barrier, triggering inflammation and skin damage. Managing incontinence-associated dermatitis is an important challenge for nurses. Several interventions have been assessed in clinical trials, but heterogeneity in study outcomes complicates the comparability and standardization. To overcome this challenge, the development of a core outcome set, a minimum set of outcomes and measurements to be assessed in clinical research, is needed. A project team, International Steering Committee and panelists will be involved to guide the development of the core outcome set. The framework of the Harmonizing Outcomes Measures for Eczema roadmap endorsed by Cochrane Skin Group Core Outcomes Set Initiative, is used to inform the project design. A systematic literature review, interviews to integrate the patients' perspective and a consensus study with healthcare researchers and providers using the Delphi procedure will be performed. The project was approved by the Ethics review Committee (April 2016). This is the first project that will identify a core outcome set of outcomes and measurements for incontinence-associated dermatitis research. A core outcome set will reduce possible reporting bias, allow results comparisons and statistical pooling across trials and strengthen evidence-based practice and decision-making. This project has been registered in the Core Outcome Measures in Effectiveness Trials (COMET) database and is part of the Cochrane Skin Group Core Outcomes Set Initiative (CSG-COUSIN). © 2016 John Wiley & Sons Ltd.

  18. Are Performance-Based Accountability Systems Effective? Evidence from Five Sectors. Research Brief

    ERIC Educational Resources Information Center

    Leuschner, Kristin J.

    2010-01-01

    During the past two decades, performance-based accountability systems (PBASs), which link financial or other incentives to measured performance as a means of improving services, have gained popularity among policymakers. Although PBASs can vary widely across sectors, they share three main components: goals (i.e., one or more long-term outcomes to…

  19. The development of an outcome measure for liaison mental health services.

    PubMed

    Guthrie, Else; Harrison, Mathew; Brown, Richard; Sandhu, Rajdeep; Trigwell, Peter; Abraham, Seri; Nawaz, Shazada; Kelsall, Peter; Thomasson, Rachel

    2018-06-01

    Aims and methodTo develop and pilot a clinician-rated outcome scale to evaluate symptomatic outcomes in liaison psychiatry services. Three hundred and sixty patient contacts with 207 separate individuals were rated using six subscales (mood, psychosis, cognition, substance misuse, mind-body problems and behavioural disturbance) plus two additional items (side-effects of medication and capacity to consent for medical treatment). Each item was rated on a five-point scale from 0 to 5 (nil, mild, moderate, severe and very severe). The liaison outcome measure was acceptable and easy to use. All subscales showed acceptable interrater reliability, with the exception of the mind-body subscale. Overall, the measure appears to show stability and sensitivity to change.Clinical implicationsThe measure provides a useful and robust way to determine symptomatic change in a liaison mental health setting, although the mind-body subscale requires modification.Declaration of interestNone.

  20. Health-related quality of life, satisfaction, and economic outcome measures in studies of prostate cancer screening and treatment, 1990-2000.

    PubMed

    McNaughton-Collins, Mary; Walker-Corkery, Elizabeth; Barry, Michael J

    2004-01-01

    the 198 included papers, there were 161 primary data papers categorized as follows: randomized trial (n = 28), nonrandomized trial (n = 13), prospective or retrospective cohort study (n = 55), case-control study (n = 0), cross-sectional study (n = 63), and meta-analysis (n = 2). The remaining 37 papers were economic and decision analytic papers. Among the 149 primary data papers that contained patient outcome data, there were 42 standard instruments used, accounting for 44% (179 of 410) of the measures overall. Almost three-quarters (71%) of papers included one, two, or three outcomes measures of all types (standard and nonstandard); three papers included seven outcomes measures, and one paper included nine. Over the 11-year time period, there was a nonstatistically significant trend toward more frequent use of standardized QOL instruments and a statistically significant trend toward increased reporting of race (P = .003). Standardization of measurement of health-related QOL, satisfaction with care, and economic cost effect among men screened and treated for prostate cancer is needed. A core set of similar questions, both generic and disease-specific, should ideally be asked in every study, although investigators should be encouraged to include additional question sets as appropriate to individual studies to get a more complete picture of how patients screened and treated for this condition are doing over time.

  1. An International Standard Set of Patient-Centered Outcome Measures After Stroke.

    PubMed

    Salinas, Joel; Sprinkhuizen, Sara M; Ackerson, Teri; Bernhardt, Julie; Davie, Charlie; George, Mary G; Gething, Stephanie; Kelly, Adam G; Lindsay, Patrice; Liu, Liping; Martins, Sheila C O; Morgan, Louise; Norrving, Bo; Ribbers, Gerard M; Silver, Frank L; Smith, Eric E; Williams, Linda S; Schwamm, Lee H

    2016-01-01

    Value-based health care aims to bring together patients and health systems to maximize the ratio of quality over cost. To enable assessment of healthcare value in stroke management, an international standard set of patient-centered stroke outcome measures was defined for use in a variety of healthcare settings. A modified Delphi process was implemented with an international expert panel representing patients, advocates, and clinical specialists in stroke outcomes, stroke registers, global health, epidemiology, and rehabilitation to reach consensus on the preferred outcome measures, included populations, and baseline risk adjustment variables. Patients presenting to a hospital with ischemic stroke or intracerebral hemorrhage were selected as the target population for these recommendations, with the inclusion of transient ischemic attacks optional. Outcome categories recommended for assessment were survival and disease control, acute complications, and patient-reported outcomes. Patient-reported outcomes proposed for assessment at 90 days were pain, mood, feeding, selfcare, mobility, communication, cognitive functioning, social participation, ability to return to usual activities, and health-related quality of life, with mobility, feeding, selfcare, and communication also collected at discharge. One instrument was able to collect most patient-reported subdomains (9/16, 56%). Minimum data collection for risk adjustment included patient demographics, premorbid functioning, stroke type and severity, vascular and systemic risk factors, and specific treatment/care-related factors. A consensus stroke measure Standard Set was developed as a simple, pragmatic method to increase the value of stroke care. The set should be validated in practice when used for monitoring and comparisons across different care settings. © 2015 The Authors.

  2. Water Accounting Plus (WA+) - a water accounting procedure for complex river basins based on satellite measurements

    NASA Astrophysics Data System (ADS)

    Karimi, P.; Bastiaanssen, W. G. M.; Molden, D.

    2012-11-01

    Coping with the issue of water scarcity and growing competition for water among different sectors requires proper water management strategies and decision processes. A pre-requisite is a clear understanding of the basin hydrological processes, manageable and unmanageable water flows, the interaction with land use and opportunities to mitigate the negative effects and increase the benefits of water depletion on society. Currently, water professionals do not have a common framework that links hydrological flows to user groups of water and their benefits. The absence of a standard hydrological and water management summary is causing confusion and wrong decisions. The non-availability of water flow data is one of the underpinning reasons for not having operational water accounting systems for river basins in place. In this paper we introduce Water Accounting Plus (WA+), which is a new framework designed to provide explicit spatial information on water depletion and net withdrawal processes in complex river basins. The influence of land use on the water cycle is described explicitly by defining land use groups with common characteristics. Analogous to financial accounting, WA+ presents four sheets including (i) a resource base sheet, (ii) a consumption sheet, (iii) a productivity sheet, and (iv) a withdrawal sheet. Every sheet encompasses a set of indicators that summarize the overall water resources situation. The impact of external (e.g. climate change) and internal influences (e.g. infrastructure building) can be estimated by studying the changes in these WA+ indicators. Satellite measurements can be used for 3 out of the 4 sheets, but is not a precondition for implementing WA+ framework. Data from hydrological models and water allocation models can also be used as inputs to WA+.

  3. Responses of Schools to Accountability Systems Using Multiple Measures: The Case of New York City Elementary Schools

    ERIC Educational Resources Information Center

    Ehren, M. C. M.; Hatch, T.

    2013-01-01

    Many studies point to potential unintended consequences of accountability systems such as when schools narrow their teaching to fixate on tested subjects. As a result, some states and districts in the USA have complemented the federal test-based accountability system with additional measures of educational practices to hold schools accountable on…

  4. [Improving care for cleft lip and palate patients: uniform and patient-orientated outcome measures].

    PubMed

    Haj, M; de Gier, H H W; van Veen-van der Hoek, M; Versnel, S L; van Adrichem, L N; Wolvius, E B; Hazelzet, J A; Koudstaal, M J

    2018-02-01

    The quality of care for patients with cleft lip and palate is extremely variable across the world. Treatment protocols differ and methods of data registration are not uniform. Improving this care by means of comparative research is challenging. The best treatment programmes can be identified by uniformly registering patient-orientated outcomes and comparing the outcomes with those of other treatment centres. That knowledge can be used to improve one's own care. An international team consisting of specialists and cleft lip and palate patients has developed a set of outcome measures that are considered by patients to be most important. This team is coordinated by the International Consortium of Health Outcomes Measurement (ICHOM). The cleft lip and palate outcome set can be used by all centres worldwide in following up on cleft lip and palate patients. In the Erasmus Medical Centre in Rotterdam, the 'Zorgmonitor Schisis' (Care Monitor Cleft Lip and Palate) has been built, an application in which these outcome measures are collected at fixed times. Implementing this set of outcome measures in other cleft lip and palate treatment centres and using the outcomes as (inter)national benchmarks will result in transparency and the improvement of the treatment of cleft lip and palate worldwide.

  5. Core outcome measures for opioid abuse liability laboratory assessment studies in humans: IMMPACT recommendations

    PubMed Central

    Comer, Sandra D.; Zacny, James P.; Dworkin, Robert H.; Turk, Dennis C.; Bigelow, George E.; Foltin, Richard W.; Jasinski, Donald R.; Sellers, Edward M.; Adams, Edgar H.; Balster, Robert; Burke, Laurie B.; Cerny, Igor; Colucci, Robert D.; Cone, Edward; Cowan, Penney; Farrar, John T.; Haddox, J. David; Haythornthwaite, Jennifer A.; Hertz, Sharon; Jay, Gary W.; Johanson, Chris-Ellyn; Junor, Roderick; Katz, Nathaniel P.; Klein, Michael; Kopecky, Ernest A.; Leiderman, Deborah B.; McDermott, Michael P.; O’Brien, Charles; O’Connor, Alec B.; Palmer, Pamela P.; Raja, Srinivasa N.; Rappaport, Bob A.; Rauschkolb, Christine; Rowbotham, Michael C.; Sampaio, Cristina; Setnik, Beatrice; Sokolowska, Marta; Stauffer, Joseph W.; Walsh, Sharon L.

    2012-01-01

    A critical component in development of opioid analgesics is assessment of their abuse liability (AL). Standardization of approaches and measures used in assessing AL has the potential to facilitate comparisons across studies, research laboratories, and drugs. The goal of this report is to provide consensus recommendations regarding core outcome measures for assessing abuse potential of opioid medications in humans in a controlled laboratory setting. Although many of the recommended measures are appropriate for assessing the AL of medications from other drug classes, the focus here is on opioid medications because they present unique risks from both physiological (e.g., respiratory depression, physical dependence) and public health (e.g., individuals in pain) perspectives. A brief historical perspective on AL testing is provided and then those measures that can be considered primary and secondary outcomes and possible additional outcomes in AL assessment are discussed. These outcome measures include: (1) subjective effects (some of which comprise the primary outcome measures, including drug liking); (2) physiological responses; (3) drug self-administration behavior; and (4) cognitive and psychomotor performance. Prior to presenting recommendations for standardized approaches and measures to be used in AL assessments, the appropriateness of using these measures in clinical trials with patients in pain is discussed. PMID:22998781

  6. London Measure of Unplanned Pregnancy: guidance for its use as an outcome measure

    PubMed Central

    Hall, Jennifer A; Barrett, Geraldine; Copas, Andrew; Stephenson, Judith

    2017-01-01

    Background The London Measure of Unplanned Pregnancy (LMUP) is a psychometrically validated measure of the degree of intention of a current or recent pregnancy. The LMUP is increasingly being used worldwide, and can be used to evaluate family planning or preconception care programs. However, beyond recommending the use of the full LMUP scale, there is no published guidance on how to use the LMUP as an outcome measure. Ordinal logistic regression has been recommended informally, but studies published to date have all used binary logistic regression and dichotomized the scale at different cut points. There is thus a need for evidence-based guidance to provide a standardized methodology for multivariate analysis and to enable comparison of results. This paper makes recommendations for the regression method for analysis of the LMUP as an outcome measure. Materials and methods Data collected from 4,244 pregnant women in Malawi were used to compare five regression methods: linear, logistic with two cut points, and ordinal logistic with either the full or grouped LMUP score. The recommendations were then tested on the original UK LMUP data. Results There were small but no important differences in the findings across the regression models. Logistic regression resulted in the largest loss of information, and assumptions were violated for the linear and ordinal logistic regression. Consequently, robust standard errors were used for linear regression and a partial proportional odds ordinal logistic regression model attempted. The latter could only be fitted for grouped LMUP score. Conclusion We recommend the linear regression model with robust standard errors to make full use of the LMUP score when analyzed as an outcome measure. Ordinal logistic regression could be considered, but a partial proportional odds model with grouped LMUP score may be required. Logistic regression is the least-favored option, due to the loss of information. For logistic regression, the cut point

  7. Implementation of learning outcome attainment measurement system in aviation engineering higher education

    NASA Astrophysics Data System (ADS)

    Salleh, I. Mohd; Mat Rani, M.

    2017-12-01

    This paper aims to discuss the effectiveness of the Learning Outcome Attainment Measurement System in assisting Outcome Based Education (OBE) for Aviation Engineering Higher Education in Malaysia. Direct assessments are discussed to show the implementation processes that become a key role in the successful outcome measurement system. A case study presented in this paper involves investigation on the implementation of the system in Aircraft Structure course for Bachelor in Aircraft Engineering Technology program in UniKL-MIAT. The data has been collected for five semesters, starting from July 2014 until July 2016. The study instruments used include the report generated in Learning Outcomes Measurements System (LOAMS) that contains information on the course learning outcomes (CLO) individual and course average performance reports. The report derived from LOAMS is analyzed and the data analysis has revealed that there is a positive significant correlation between the individual performance and the average performance reports. The results for analysis of variance has further revealed that there is a significant difference in OBE grade score among the report. Independent samples F-test results, on the other hand, indicate that the variances of the two populations are unequal.

  8. Causal inference with measurement error in outcomes: Bias analysis and estimation methods.

    PubMed

    Shu, Di; Yi, Grace Y

    2017-01-01

    Inverse probability weighting estimation has been popularly used to consistently estimate the average treatment effect. Its validity, however, is challenged by the presence of error-prone variables. In this paper, we explore the inverse probability weighting estimation with mismeasured outcome variables. We study the impact of measurement error for both continuous and discrete outcome variables and reveal interesting consequences of the naive analysis which ignores measurement error. When a continuous outcome variable is mismeasured under an additive measurement error model, the naive analysis may still yield a consistent estimator; when the outcome is binary, we derive the asymptotic bias in a closed-form. Furthermore, we develop consistent estimation procedures for practical scenarios where either validation data or replicates are available. With validation data, we propose an efficient method for estimation of average treatment effect; the efficiency gain is substantial relative to usual methods of using validation data. To provide protection against model misspecification, we further propose a doubly robust estimator which is consistent even when either the treatment model or the outcome model is misspecified. Simulation studies are reported to assess the performance of the proposed methods. An application to a smoking cessation dataset is presented.

  9. Checklist to operationalize measurement characteristics of patient-reported outcome measures.

    PubMed

    Francis, David O; McPheeters, Melissa L; Noud, Meaghan; Penson, David F; Feurer, Irene D

    2016-08-02

    The purpose of this study was to advance a checklist of evaluative criteria designed to assess patient-reported outcome (PRO) measures' developmental measurement properties and applicability, which can be used by systematic reviewers, researchers, and clinicians with a varied range of expertise in psychometric measure development methodology. A directed literature search was performed to identify original studies, textbooks, consensus guidelines, and published reports that propose criteria for assessing the quality of PRO measures. Recommendations from these sources were iteratively distilled into a checklist of key attributes. Preliminary items underwent evaluation through 24 cognitive interviews with clinicians and quantitative researchers. Six measurement theory methodological novices independently applied the final checklist to assess six PRO measures encompassing a variety of methods, applications, and clinical constructs. Agreement between novice and expert scores was assessed. The distillation process yielded an 18-item checklist with six domains: (1) conceptual model, (2) content validity, (3) reliability, (4) construct validity, (5) scoring and interpretation, and (6) respondent burden and presentation. With minimal instruction, good agreement in checklist item ratings was achieved between quantitative researchers with expertise in measurement theory and less experienced clinicians (mean kappa 0.70; range 0.66-0.87). We present a simplified checklist that can help guide systematic reviewers, researchers, and clinicians with varied measurement theory expertise to evaluate the strengths and weakness of candidate PRO measures' developmental properties and the appropriateness for specific applications.

  10. Minimal Clinically Important Difference: A Review of Outcome Measure Score Interpretation.

    PubMed

    Engel, Lisa; Beaton, Dorcas E; Touma, Zahi

    2018-05-01

    Clinicians, researchers, and outcome stakeholders have the crucial, albeit difficult, task of quantifying when a person or group experiences important change or difference on any given outcome measure, often in response to a specific intervention. The minimal clinically important difference (MCID) provides this quantified value of change/difference for a measure. There are many methods for MCID derivation, which can result in multiple values for the same measure. Thus, it is important for potential users of MCID values to be aware of the nuances of MCID development and cautions for interpreting values. This review outlines MCID-related definitions, methods, and guidelines. Copyright © 2018 Elsevier Inc. All rights reserved.

  11. One State, Two State, Red State, Blue State: Education Funding Accounts for Outcome Differences

    ERIC Educational Resources Information Center

    Meece, Darrell

    2008-01-01

    Using publically available data, states coded as "blue" based upon results from the 2004 presidential election were significantly higher in education funding than were states coded as "red." Students in blue states scored significantly higher on outcome measures of math and reading in grades four and eight in 2004 and 2007 than did students in red…

  12. Accounting- versus economic-based rates of return: implications for profitability measures in the pharmaceutical industry.

    PubMed

    Skrepnek, Grant H

    2004-01-01

    Accounting-based profits have indicated that pharmaceutical firms have achieved greater returns relative to other sectors. However, partially due to the theoretically inappropriate reporting of research and development (R&D) expenditures according to generally accepted accounting principles, evidence suggests that a substantial and upward bias is present in accounting-based rates of return for corporations with high levels of intangible assets. Given the intensity of R&D in pharmaceutical firms, accounting-based profit metrics in the drug sector may be affected to a greater extent than other industries. The aim of this work was to address measurement issues associated with corporate performance and factors that contribute to the bias within accounting-based rates of return. Seminal and broadly cited works on the subject of accounting- versus economic-based rates of return were reviewed from the economic and finance literature, with an emphasis placed on issues and scientific evidence directly related to the drug development process and pharmaceutical industry. With international convergence and harmonization of accounting standards being imminent, stricter adherence to theoretically sound economic principles is advocated, particularly those based on discounted cash-flow methods. Researchers, financial analysts, and policy makers must be cognizant of the biases and limitations present within numerous corporate performance measures. Furthermore, the development of more robust and valid economic models of the pharmaceutical industry is required to capture the unique dimensions of risk and return of the drug development process. Empiric work has illustrated that estimates of economic-based rates of return range from approximately 2 to approximately 11 percentage points below various accounting-based rates of return for drug companies. Because differences in the nature of risk and uncertainty borne by drug manufacturers versus other sectors make comparative assessments

  13. The art and science of using routine outcome measurement in mental health benchmarking.

    PubMed

    McKay, Roderick; Coombs, Tim; Duerden, David

    2014-02-01

    To report and critique the application of routine outcome measurement data when benchmarking Australian mental health services. The experience of the authors as participants and facilitators of benchmarking activities is augmented by a review of the literature regarding mental health benchmarking in Australia. Although the published literature is limited, in practice, routine outcome measures, in particular the Health of the National Outcomes Scales (HoNOS) family of measures, are used in a variety of benchmarking activities. Use in exploring similarities and differences in consumers between services and the outcomes of care are illustrated. This requires the rigour of science in data management and interpretation, supplemented by the art that comes from clinical experience, a desire to reflect on clinical practice and the flexibility to use incomplete data to explore clinical practice. Routine outcome measurement data can be used in a variety of ways to support mental health benchmarking. With the increasing sophistication of information development in mental health, the opportunity to become involved in benchmarking will continue to increase. The techniques used during benchmarking and the insights gathered may prove useful to support reflection on practice by psychiatrists and other senior mental health clinicians.

  14. Prosthetists' perceptions and use of outcome measures in clinical practice: Long-term effects of focused continuing education.

    PubMed

    Hafner, Brian J; Spaulding, Susan E; Salem, Rana; Morgan, Sara J; Gaunaurd, Ignacio; Gailey, Robert

    2017-06-01

    Continuing education is intended to facilitate clinicians' skills and knowledge in areas of practice, such as administration and interpretation of outcome measures. To evaluate the long-term effect of continuing education on prosthetists' confidence in administering outcome measures and their perceptions of outcomes measurement in clinical practice. Pretest-posttest survey methods. A total of 66 prosthetists were surveyed before, immediately after, and 2 years after outcomes measurement education and training. Prosthetists were grouped as routine or non-routine outcome measures users, based on experience reported prior to training. On average, prosthetists were just as confident administering measures 1-2 years after continuing education as they were immediately after continuing education. In all, 20% of prosthetists, initially classified as non-routine users, were subsequently classified as routine users at follow-up. Routine and non-routine users' opinions differed on whether outcome measures contributed to efficient patient evaluations (79.3% and 32.4%, respectively). Both routine and non-routine users reported challenges integrating outcome measures into normal clinical routines (20.7% and 45.9%, respectively). Continuing education had a long-term impact on prosthetists' confidence in administering outcome measures and may influence their clinical practices. However, remaining barriers to using standardized measures need to be addressed to keep practitioners current with evolving practice expectations. Clinical relevance Continuing education (CE) had a significant long-term impact on prosthetists' confidence in administering outcome measures and influenced their clinical practices. In all, approximately 20% of prosthetists, who previously were non-routine outcome measure users, became routine users after CE. There remains a need to develop strategies to integrate outcome measurement into routine clinical practice.

  15. Better way to measure ageing in East Asia that takes life expectancy into account.

    PubMed

    Scherbov, Sergei; Sanderson, Warren C; Gietel-Basten, Stuart

    2016-06-01

    The aim of the study was to improve the measurement of ageing taking into account characteristics of populations and in particular changes in life expectancy. Using projected life tables, we calculated prospective old age dependency ratios (POADRs) to 2060, placing the boundary to old age at a moving point with a fixed remaining life expectancy (RLE) for all countries of East Asia. POADRs grow less rapidly than old age dependency ratios (OADRs). For example, in the Republic of Korea, the OADR is forecast to increase from around 0.1 in 1980 to around 0.8 in 2060, while the POADR is forecast to increase from around 0.1 to 0.4 over the same period. Policy makers may wish to take into account the fact that the increases in measures of ageing will be slower when those measures are adjusted for changes in life expectancy. © 2016 AJA Inc.

  16. Systematic review of tools to measure outcomes for young children with autism spectrum disorder.

    PubMed

    McConachie, Helen; Parr, Jeremy R; Glod, Magdalena; Hanratty, Jennifer; Livingstone, Nuala; Oono, Inalegwu P; Robalino, Shannon; Baird, Gillian; Beresford, Bryony; Charman, Tony; Garland, Deborah; Green, Jonathan; Gringras, Paul; Jones, Glenys; Law, James; Le Couteur, Ann S; Macdonald, Geraldine; McColl, Elaine M; Morris, Christopher; Rodgers, Jacqueline; Simonoff, Emily; Terwee, Caroline B; Williams, Katrina

    2015-06-01

    The needs of children with autism spectrum disorder (ASD) are complex and this is reflected in the number and diversity of outcomes assessed and measurement tools used to collect evidence about children's progress. Relevant outcomes include improvement in core ASD impairments, such as communication, social awareness, sensory sensitivities and repetitiveness; skills such as social functioning and play; participation outcomes such as social inclusion; and parent and family impact. To examine the measurement properties of tools used to measure progress and outcomes in children with ASD up to the age of 6 years. To identify outcome areas regarded as important by people with ASD and parents. The MeASURe (Measurement in Autism Spectrum disorder Under Review) research collaboration included ASD experts and review methodologists. We undertook systematic review of tools used in ASD early intervention and observational studies from 1992 to 2013; systematic review, using the COSMIN checklist (Consensus-based Standards for the selection of health Measurement Instruments) of papers addressing the measurement properties of identified tools in children with ASD; and synthesis of evidence and gaps. The review design and process was informed throughout by consultation with stakeholders including parents, young people with ASD, clinicians and researchers. The conceptual framework developed for the review was drawn from the International Classification of Functioning, Disability and Health, including the domains 'Impairments', 'Activity Level Indicators', 'Participation', and 'Family Measures'. In review 1, 10,154 papers were sifted - 3091 by full text - and data extracted from 184; in total, 131 tools were identified, excluding observational coding, study-specific measures and those not in English. In review 2, 2665 papers were sifted and data concerning measurement properties of 57 (43%) tools were extracted from 128 papers. Evidence for the measurement properties of the reviewed

  17. Measure of functional independence dominates discharge outcome prediction after inpatient rehabilitation for stroke.

    PubMed

    Brown, Allen W; Therneau, Terry M; Schultz, Billie A; Niewczyk, Paulette M; Granger, Carl V

    2015-04-01

    Identifying clinical data acquired at inpatient rehabilitation admission for stroke that accurately predict key outcomes at discharge could inform the development of customized plans of care to achieve favorable outcomes. The purpose of this analysis was to use a large comprehensive national data set to consider a wide range of clinical elements known at admission to identify those that predict key outcomes at rehabilitation discharge. Sample data were obtained from the Uniform Data System for Medical Rehabilitation data set with the diagnosis of stroke for the years 2005 through 2007. This data set includes demographic, administrative, and medical variables collected at admission and discharge and uses the FIM (functional independence measure) instrument to assess functional independence. Primary outcomes of interest were functional independence measure gain, length of stay, and discharge to home. The sample included 148,367 people (75% white; mean age, 70.6±13.1 years; 97% with ischemic stroke) admitted to inpatient rehabilitation a mean of 8.2±12 days after symptom onset. The total functional independence measure score, the functional independence measure motor subscore, and the case-mix group were equally the strongest predictors for any of the primary outcomes. The most clinically relevant 3-variable model used the functional independence measure motor subscore, age, and walking distance at admission (r(2)=0.107). No important additional effect for any other variable was detected when added to this model. This analysis shows that a measure of functional independence in motor performance and age at rehabilitation hospital admission for stroke are predominant predictors of outcome at discharge in a uniquely large US national data set. © 2015 American Heart Association, Inc.

  18. A systematic review finds limited data on measurement properties of instruments measuring outcomes in adult intensive care unit survivors.

    PubMed

    Robinson, Karen A; Davis, Wesley E; Dinglas, Victor D; Mendez-Tellez, Pedro A; Rabiee, Anahita; Sukrithan, Vineeth; Yalamanchilli, Ramakrishna; Turnbull, Alison E; Needham, Dale M

    2017-02-01

    There is a growing number of studies evaluating the physical, cognitive, mental health, and health-related quality of life (HRQOL) outcomes of adults surviving critical illness. However, there is little consensus on the most appropriate instruments to measure these outcomes. To inform the development of such consensus, we conducted a systematic review of the performance characteristics of instruments measuring physical, cognitive, mental health, and HRQOL outcomes in adult intensive care unit (ICU) survivors. We searched PubMed, Embase, PsycInfo, Cumulative Index of Nursing and Allied Health Literature, and The Cochrane Library in March 2015. We also conducted manual searches of reference lists of eligible studies and relevant review articles. Two people independently selected studies, completed data abstraction, and assessed the quality of eligible studies using the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) initiative checklist. We identified 20 studies which explicitly evaluated measurement properties for 21 different instruments assessing outcomes in ICU survivors. Eleven of the instruments assessed quality of life, with few instruments assessing other domains. Of the nine measurement properties evaluated on the COSMIN checklist, six were assessed in <10% of the evaluations. Overall quality of eligible studies was generally poor to fair based on the COSMIN checklist. Although an increasing number of studies measure physical, cognitive, mental health, and HRQOL outcomes in adult ICU survivors, data on the measurement properties of such instruments are sparse and generally of poor to fair quality. Empirical analyses evaluating the performance of instruments in adult ICU survivors are needed to advance research in this field. Copyright © 2016 Elsevier Inc. All rights reserved.

  19. Outcome selection and role of patient reported outcomes in contemporary cardiovascular trials: systematic review

    PubMed Central

    Malhotra, Aneil; Banning, Adrian P; Jenkinson, Crispin

    2010-01-01

    Objectives To systematically assess the type of outcomes selected and the prevalence of patient reported outcomes in contemporary cardiovascular trials and to quantify any misuse or underuse of patient reported outcomes using a specially developed tool that would allow estimation of the relevance of such outcomes to clinical decision making. Design Systematic review. Data sources Medline and Embase. Study selection Randomised controlled trials of the treatment for or prevention of cardiovascular disease published in 10 leading general medical and cardiology journals from January 2005 to December 2008. Results Primary outcomes were patient important (death, morbidity, or patient reported outcomes) in only 93 of 413 trials (23%, SE 2%), whereas another 92 (22%, SE 2%) combined these outcomes with other less important ones into a composite. Sixty five trials (16%; SE 2%) used at least one instrument to measure patient reported outcomes, mostly in trials where such information would have been important or crucial for clinical decision making (52 trials). Patient reported outcomes were judged to be of little incremental value to a large number of, mostly explanatory, cardiovascular trials (152 trials). However, many trials in which patient reported outcomes would have been important or crucial for clinical decision making did not report such outcomes (122 of 174 trials, 70%). These included several trials that primarily aimed to improve symptoms or functional status, trials that tested interventions with a considerable potential for causing harm (mainly bleeding) that were not meaningfully measured, and trials with composite outcomes that were dominated by outcomes of questionable importance to patients. Conclusions Despite a continued rise in the reporting of patient reported outcomes with no evidence for their misuse in more recent cardiovascular trials, they seem to be still underused once their relevance to clinical decision making has been taken into account. This

  20. Measuring what matters to rare disease patients - reflections on the work by the IRDiRC taskforce on patient-centered outcome measures.

    PubMed

    Morel, Thomas; Cano, Stefan J

    2017-11-02

    Our ability to evaluate outcomes which genuinely reflect patients' unmet needs, hopes and concerns is of pivotal importance. However, much current clinical research and practice falls short of this objective by selecting outcome measures which do not capture patient value to the fullest. In this Opinion, we discuss Patient-Centered Outcomes Measures (PCOMs), which have the potential to systematically incorporate patient perspectives to measure those outcomes that matter most to patients. We argue for greater multi-stakeholder collaboration to develop PCOMs, with rare disease patients and families at the center. Beyond advancing the science of patient input, PCOMs are powerful tools to translate care or observed treatment benefit into an 'interpretable' measure of patient benefit, and thereby help demonstrate clinical effectiveness. We propose mixed methods psychometric research as the best route to deliver fit-for-purpose PCOMs in rare diseases, as this methodology brings together qualitative and quantitative research methods in tandem with the explicit aim to efficiently utilise data from small samples. And, whether one opts to develop a brand-new PCOM or to select or adapt an existing outcome measure for use in a rare disease, the anchors remain the same: patients, their daily experience of the rare disease, their preferences, core concepts and values. Ultimately, existing value frameworks, registries, and outcomes-based contracts largely fall short of consistently measuring the full range of outcomes that matter to patients. We argue that greater use of PCOMs in rare diseases would enable a fast track to Patient-Centered Care.

  1. The Relationship between Market and Accounting Determined Risk Measures: Reviewing and Updating the Beaver, Kettler, Scholes (1970) Study

    ERIC Educational Resources Information Center

    Jarvela, Michael; Kozyra, James; Potter, Carla

    2009-01-01

    The association between market-determined risk measures and accounting-determined risk measures was originally explored in the 1970s by Beaver, Kettler, and Scholes (BKS). The results of the BKS (1970) study suggest that accounting information is usefulness in assessing firm specific risk. Since BKS, there have been few studies conducted to…

  2. Synthesis and review: delivering on conservation promises: the challenges of managing and measuring conservation outcomes

    NASA Astrophysics Data System (ADS)

    Adams, Vanessa M.; Game, Edward T.; Bode, Michael

    2014-08-01

    Growing threats and limited resources have always been the financial realities of biodiversity conservation. As the conservation sector has matured, however, the accountability of conservation investments has become an increasingly debated topic, with two key topics being driven to the forefront of the discourse: understanding how to manage the risks associated with our conservation investments and demonstrating that our investments are making a difference through evidence-based analyses. A better understanding of the uncertainties associated with conservation decisions is a central component of managing risks to investments that is often neglected. This focus issue presents both theoretical and applied approaches to quantifying and managing risks. Furthermore, transparent and replicable approaches to measuring impacts of conservation investments are noticeably absent in many conservation programs globally. This focus issue contains state of the art conservation program impact evaluations that both demonstrate how these methods can be used to measure outcomes as well as directing future investments. This focus issue thus brings together current thinking and case studies that can provide a valuable resource for directing future conservation investments.

  3. Social media and flu: Media Twitter accounts as agenda setters.

    PubMed

    Yun, Gi Woong; Morin, David; Park, Sanghee; Joa, Claire Youngnyo; Labbe, Brett; Lim, Jongsoo; Lee, Sooyoung; Hyun, Daewon

    2016-07-01

    This paper has two objectives. First, it categorizes the Twitter handles tweeted flu related information based on the amount of replies and mentions within the Twitter network. The collected Twitter accounts are categorized as media, health related individuals, organizations, government, individuals with no background with media or medical field, in order to test the relationship between centrality measures of the accounts and their categories. The second objective is to examine the relationship between the importance of the Twitter accounts in the network, centrality measures, and specific characteristics of each account, including the number of tweets and followers as well as the number of accounts followed and liked. Using Twitter search network API, tweets with "flu" keyword were collected and tabulated. Network centralities were calculated with network analysis tool, NodeXL. The collected Twitters accounts were content analyzed and categorized by multiple coders. When the media or organizational Twitter accounts were present in the list of important Twitter accounts, they were highly effective disseminating flu-related information. Also, they were more likely to stay active one year after the data collection period compared to other influential individual accounts. Health campaigns are recommended to focus on recruiting influential Twitter accounts and encouraging them to retweet or mention in order to produce better results in disseminating information. Although some individual social media users were valuable assets in terms of spreading information about flu, media and organization handles were more reliable information distributors. Thus, health information practitioners are advised to design health campaigns better utilizing media and organizations rather than individuals to achieve consistent and efficient campaign outcomes. Published by Elsevier Ireland Ltd.

  4. Measuring Violence Risk and Outcomes among Mexican American Adolescent Females

    ERIC Educational Resources Information Center

    Cervantes, Richard C.; Duenas, Norma; Valdez, Avelardo; Kaplan, Charles

    2006-01-01

    Central to the development of culturally competent violence prevention programs for Hispanic youth is the development of psychometrically sound violence risk and outcome measures for this population. A study was conducted to determine the psychometric properties of two commonly used violence measures, in this case for Mexican American adolescent…

  5. Population Health Measurement: Applying Performance Measurement Concepts in Population Health Settings

    PubMed Central

    Stoto, Michael A.

    2014-01-01

    Introduction: Whether the focus of population-health improvement efforts, the measurement of health outcomes, risk factors, and interventions to improve them are central to achieving collective impact in the population health perspective. And because of the importance of a shared measurement system, appropriate measures can help to ensure the accountability of and ultimately integrate the efforts of public health, the health care delivery sector, and other public and private entities in the community to improve population health. Yet despite its importance, population health measurement efforts in the United States are poorly developed and uncoordinated. Collaborative Measurement Development: To achieve the potential of the population health perspective, public health officials, health system leaders, and others must work together to develop sets of population health measures that are suitable for different purposes yet are harmonized so that together they can help to improve a community’s health. This begins with clearly defining the purpose of a set of measures, distinguishing between outcomes for which all share responsibility and actions to improve health for which the health care sector, public health agencies, and others should be held accountable. Framework for Population Health Measurement: Depending on the purpose of the analysis, then, measurement systems should clearly specify what to measure—in particular the population served (the denominator), what the critical health dimensions are in a measurement framework, and how the measures can be used to ensure accountability. Building on a clear understanding of the purpose and dimensions of population health that must be measured, developers can then choose specific measures using existing data or developing new data sources if necessary, with established validity, reliability, and other scientific characteristics. Rather than indiscriminately choosing among the proliferating data streams, this

  6. Establishing a Core Outcome Measure for Fatigue in Patients on Hemodialysis: A Standardized Outcomes in Nephrology-Hemodialysis (SONG-HD) Consensus Workshop Report.

    PubMed

    Ju, Angela; Unruh, Mark; Davison, Sara; Dapueto, Juan; Dew, Mary Amanda; Fluck, Richard; Germain, Michael; Jassal, Sarbjit V; Obrador, Gregorio; O'Donoghue, Donal; Josephson, Michelle A; Craig, Jonathan C; Viecelli, Andrea; O'Lone, Emma; Hanson, Camilla S; Manns, Braden; Sautenet, Benedicte; Howell, Martin; Reddy, Bharathi; Wilkie, Caroline; Rutherford, Claudia; Tong, Allison

    2018-03-15

    Fatigue is one of the most highly prioritized outcomes for patients and clinicians, but remains infrequently and inconsistently reported across trials in hemodialysis. We convened an international Standardized Outcomes in Nephrology-Hemodialysis (SONG-HD) consensus workshop with stakeholders to discuss the development and implementation of a core outcome measure for fatigue. 15 patients/caregivers and 42 health professionals (clinicians, researchers, policy makers, and industry representatives) from 9 countries participated in breakout discussions. Transcripts were analyzed thematically. 4 themes for a core outcome measure emerged. Drawing attention to a distinct and all-encompassing symptom was explicitly recognizing fatigue as a multifaceted symptom unique to hemodialysis. Emphasizing the pervasive impact of fatigue on life participation justified the focus on how fatigue severely impaired the patient's ability to do usual activities. Ensuring relevance and accuracy in measuring fatigue would facilitate shared decision making about treatment. Minimizing burden of administration meant avoiding the cognitive burden, additional time, and resources required to use the measure. A core outcome measure that is simple, is short, and includes a focus on the severity of the impact of fatigue on life participation may facilitate consistent and meaningful measurement of fatigue in all trials to inform decision making and care of patients receiving hemodialysis. Copyright © 2018 National Kidney Foundation, Inc. Published by Elsevier Inc. All rights reserved.

  7. Focused Evidence Review: Psychometric Properties of Patient-Reported Outcome Measures for Chronic Musculoskeletal Pain.

    PubMed

    Goldsmith, Elizabeth S; Taylor, Brent C; Greer, Nancy; Murdoch, Maureen; MacDonald, Roderick; McKenzie, Lauren; Rosebush, Christina E; Wilt, Timothy J

    2018-05-01

    Developing successful interventions for chronic musculoskeletal pain requires valid, responsive, and reliable outcome measures. The Minneapolis VA Evidence-based Synthesis Program completed a focused evidence review on key psychometric properties of 17 self-report measures of pain severity and pain-related functional impairment suitable for clinical research on chronic musculoskeletal pain. Pain experts of the VA Pain Measurement Outcomes Workgroup identified 17 pain measures to undergo systematic review. In addition to a MEDLINE search on these 17 measures (1/2000-1/2017), we hand-searched (without publication date limits) the reference lists of all included studies, prior systematic reviews, and-when available-Web sites dedicated to each measure (PROSPERO registration CRD42017056610). Our primary outcome was the measure's minimal important difference (MID). Secondary outcomes included responsiveness, validity, and test-retest reliability. Outcomes were synthesized through evidence mapping and qualitative comparison. Of 1635 abstracts identified, 331 articles underwent full-text review, and 43 met inclusion criteria. Five measures (Oswestry Disability Index (ODI), Roland-Morris Disability Questionnaire (RMDQ), SF-36 Bodily Pain Scale (SF-36 BPS), Numeric Rating Scale (NRS), and Visual Analog Scale (VAS)) had data reported on MID, responsiveness, validity, and test-retest reliability. Seven measures had data reported on three of the four psychometric outcomes. Eight measures had reported MIDs, though estimation methods differed substantially and often were not clinically anchored. In this focused evidence review, the most evidence on key psychometric properties in chronic musculoskeletal pain populations was found for the ODI, RMDQ, SF-36 BPS, NRS, and VAS. Key limitations in the field include substantial variation in methods of estimating psychometric properties, defining chronic musculoskeletal pain, and reporting patient demographics. Registered in the PROSPERO

  8. Measure once, cut twice--adding patient-reported outcome measures to the electronic health record for comparative effectiveness research.

    PubMed

    Wu, Albert W; Kharrazi, Hadi; Boulware, L Ebony; Snyder, Claire F

    2013-08-01

    This article presents the current state of patient-reported outcome measures and explains new opportunities for leveraging the recent adoption of electronic health records to expand the application of patient-reported outcomes in both clinical care and comparative effectiveness research. Historic developments of patient-reported outcome, electronic health record, and comparative effectiveness research are analyzed in two dimensions: patient centeredness and digitization. We pose the question, "What needs to be standardized around the collection of patient-reported outcomes in electronic health records for comparative effectiveness research?" We identified three converging trends: the progression of patient-reported outcomes toward greater patient centeredness and electronic adaptation; the evolution of electronic health records into personalized and fully digitized solutions; and the shift toward patient-oriented comparative effectiveness research. Related to this convergence, we propose an architecture for patient-reported outcome standardization that could serve as a first step toward a more comprehensive integration of patient-reported outcomes with electronic health record for both practice and research. The science of patient-reported outcome measurement has matured sufficiently to be integrated routinely into electronic health records and other electronic health solutions to collect data on an ongoing basis for clinical care and comparative effectiveness research. Further efforts and ideally coordinated efforts from various stakeholders are needed to refine the details of the proposed framework for standardization. Copyright © 2013 Elsevier Inc. All rights reserved.

  9. 77 FR 60945 - 2012-2013 Accountability Measure and Closure for Commercial Black Sea Bass in the South Atlantic

    Federal Register 2010, 2011, 2012, 2013, 2014

    2012-10-05

    .... 0907271173-0629-03] RIN 0648-XC152 2012-2013 Accountability Measure and Closure for Commercial Black Sea Bass... accountability measure (AM) for the commercial sector of black sea bass in the exclusive economic zone (EEZ) of... (ACL) (equal to the commercial quota) for black sea bass will have been reached by October 8, 2012...

  10. Patient-Oriented Eczema Measure (POEM), a core instrument to measure symptoms in clinical trials: a Harmonising Outcome Measures for Eczema (HOME) statement.

    PubMed

    Spuls, P I; Gerbens, L A A; Simpson, E; Apfelbacher, C J; Chalmers, J R; Thomas, K S; Prinsen, C A C; von Kobyletzki, L B; Singh, J A; Williams, H C; Schmitt, J

    2017-04-01

    The Harmonising Outcome Measures for Eczema (HOME) initiative has defined four core outcome domains for a core outcome set (COS) to be measured in all atopic eczema (AE) trials to ensure cross-trial comparison: clinical signs, symptoms, quality of life and long-term control. The aim of this paper is to report on the consensus process that was used to select the core instrument to consistently assess symptoms in all future AE trials. Following the HOME roadmap, two systematic reviews were performed which identified three instruments that had sufficient evidence of validity, reliability and feasibility to be considered for the final COS. At the fourth international HOME meeting, there was broad consensus among all stakeholders that the Patient-Oriented Eczema Measure (POEM) should be used as the core instrument (87·5% agreed, 9·4% unsure, 3·1% disagreed). All relevant stakeholders are encouraged to use POEM as the chosen instrument to measure the core domain of symptoms in all future AE clinical trials. Other instruments of interest can be used in addition to POEM. © 2016 British Association of Dermatologists.

  11. Accounting for center in the Early External Cephalic Version trials: an empirical comparison of statistical methods to adjust for center in a multicenter trial with binary outcomes.

    PubMed

    Reitsma, Angela; Chu, Rong; Thorpe, Julia; McDonald, Sarah; Thabane, Lehana; Hutton, Eileen

    2014-09-26

    Clustering of outcomes at centers involved in multicenter trials is a type of center effect. The Consolidated Standards of Reporting Trials Statement recommends that multicenter randomized controlled trials (RCTs) should account for center effects in their analysis, however most do not. The Early External Cephalic Version (EECV) trials published in 2003 and 2011 stratified by center at randomization, but did not account for center in the analyses, and due to the nature of the intervention and number of centers, may have been prone to center effects. Using data from the EECV trials, we undertook an empirical study to compare various statistical approaches to account for center effect while estimating the impact of external cephalic version timing (early or delayed) on the outcomes of cesarean section, preterm birth, and non-cephalic presentation at the time of birth. The data from the EECV pilot trial and the EECV2 trial were merged into one dataset. Fisher's exact method was used to test the overall effect of external cephalic version timing unadjusted for center effects. Seven statistical models that accounted for center effects were applied to the data. The models included: i) the Mantel-Haenszel test, ii) logistic regression with fixed center effect and fixed treatment effect, iii) center-size weighted and iv) un-weighted logistic regression with fixed center effect and fixed treatment-by-center interaction, iv) logistic regression with random center effect and fixed treatment effect, v) logistic regression with random center effect and random treatment-by-center interaction, and vi) generalized estimating equations. For each of the three outcomes of interest approaches to account for center effect did not alter the overall findings of the trial. The results were similar for the majority of the methods used to adjust for center, illustrating the robustness of the findings. Despite literature that suggests center effect can change the estimate of effect in

  12. Clinically Relevant Outcome Measures Following Limb Osseointegration; Systematic Review of the Literature.

    PubMed

    Al Muderis, Munjed M; Lu, William Y; Li, Jiao Jiao; Kaufman, Kenton; Orendurff, Michael; Highsmith, M Jason; Lunseth, Paul A; Kahle, Jason T

    2018-02-01

    The current standard of care for an amputee is a socket-based prostheses. An osseointegrated implant (OI) is an alternative for prosthetic attachment. Osseointegration addresses reported problems related to wearing a socket interface, such as skin issues, discomfort, diminished function, quality of life, prosthetic use, and abandonment. The purpose of this report is to systematically review current literature regarding OI to identify and categorize the reported clinically relevant outcome measures, rate the quality of available evidence, and synthesize the findings. A multidisciplinary team used PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methods. Search methodology was based on identifying clinically relevant articles. Three databases were searched: PubMed, CINAHL, and Web of Science. Clinical studies with aggregated data reporting at least 1 clinically relevant outcome measure were included. The Grading of Recommendations Assessment, Development, and Evaluation (GRADE) criterion was used for critical appraisal and recommendations. This review identified 21 clinically relevant observational studies. Outcome measures were categorized into the following 9 categories: vibratory stimulation, complications, biomechanics, economics, patient-reported outcome measures, electromyography, x-ray, physical functional performance, and energy consumption. This systematic review consisted of Level III and IV observational studies. Homogeneous outcome measures with strong psychometric properties across prospective studies do not exist to date. Higher-level, prospective, randomized, long-term, clinically relevant trials are needed to prove efficacy of OI compared with socket prosthetic attachment. Osseointegration was at least equivalent to sockets in most studies. In some cases, it was superior. Osseointegration represents a promising alternative to socket prosthetic attachments for extremity amputees. Therapeutic Level III. See Instructions for

  13. Patient reported outcome measures in septorhinoplasty surgery.

    PubMed

    Biggs, T C; Fraser, L R; Ward, M J; Sunkaraneni, V S; Harries, P G; Salib, R J

    2015-01-01

    Surgical procedures incorporating a cosmetic element such as septorhinoplasty and otoplasty are currently under threat in the National Health Service (NHS) as they are deemed to be procedures of 'limited clinical benefit' by many primary care providers. Patient reported outcome measures (PROMs), which assess the quality of care delivered from the patients' perspective, are becoming increasingly important in documenting the effectiveness of such procedures. The Rhinoplasty Outcomes Evaluation (ROE) questionnaire, a validated PROM tool, was used to assess patient satisfaction in 141 patients undergoing septorhinoplasty surgery over a 90-month period at the University Hospital Southampton NHS Foundation Trust. Overall, 100 patients with a mean follow-up period of 36 months completed the study. The mean ROE score was 73.3%. In addition, 75% of patients questioned were happy with the final result of their operation and 83% would undergo the procedure again if required. These benefits occurred irrespective of age, sex and primary versus revision surgery, and were maintained for up to 71 months following surgery. This study has shown that patients are generally satisfied with their functional and cosmetic outcomes following septorhinoplasty surgery. These results help support the case for septorhinoplasty surgery to continue being funded as an NHS procedure.

  14. Measuring quality of life in cleft lip and palate patients: currently available patient-reported outcomes measures.

    PubMed

    Eckstein, Donna A; Wu, Rebecca L; Akinbiyi, Takintope; Silver, Lester; Taub, Peter J

    2011-11-01

    Patient-reported outcomes in cleft lip and palate treatment are critical for patient care. Traditional surgical outcomes focused on objective measures, such as photographs, anatomic measurements, morbidity, and mortality. Although these remain important, they leave many questions unanswered. Surveys that include aesthetics, speech, functionality, self-image, and quality of life provide more thorough outcomes assessment. It is vital that reliable, valid, and comprehensive questionnaires are available to craniofacial surgeons. The authors performed a literature review to identify questionnaires validated in cleft lip and palate patients. Qualifying instruments were assessed for adherence to guidelines for development and validation by the scientific advisory committee and for content. The authors identified 44 measures used in cleft lip and palate studies. After 15 ad hoc questionnaires, eight generic instruments, 11 psychiatric instruments, and one non-English language questionnaire were excluded, nine measures remained. Of these, four were never validated in the cleft population. Analysis revealed one craniofacial-specific measure (Youth Quality of Life-Facial Differences), two voice-related measures (Patient Voice-Related Quality of Life and Cleft Audit Protocol for Speech-Augmented), and two oral health-related measures (Child Oral Health Impact Profile and Child Oral Health Quality of Life). The Youth Quality of Life-Facial Differences, Child Oral Health Impact Profile, and Child Oral Health Quality of Life questionnaires were sufficiently validated. None was created specifically for clefts, resulting in content limitations. There is a lack of comprehensive, valid, and reliable questionnaires for cleft lip and palate surgery. For thorough assessment of satisfaction, further research to develop and validate cleft lip and palate surgery-specific instruments is needed.

  15. Bursar Accounts, Payroll Deduction, and Debt Collection: A Three-Channel Approach to Lost Item Reimbursement

    ERIC Educational Resources Information Center

    Snowman, Ann MacKay

    2005-01-01

    In 2003, Penn State Libraries implemented payroll deduction and collection agency programs to gain better control of accounts receivable. The author reports on the implementation processes and first year outcomes of the programs. She recommends careful consideration of several questions before implementing such measures.

  16. A systematic review of measurement properties of patient reported outcome measures in psoriatic arthritis: A GRAPPA-OMERACT initiative.

    PubMed

    Højgaard, Pil; Klokker, Louise; Orbai, Ana-Maria; Holmsted, Kim; Bartels, Else M; Leung, Ying Ying; Goel, Niti; de Wit, Maarten; Gladman, Dafna D; Mease, Philip; Dreyer, Lene; Kristensen, Lars E; FitzGerald, Oliver; Tillett, William; Gossec, Laure; Helliwell, Philip; Strand, Vibeke; Ogdie, Alexis; Terwee, Caroline B; Christensen, Robin

    2018-04-01

    An updated psoriatic arthritis (PsA) core outcome set (COS) for randomized controlled trials (RCTs) was endorsed at the Outcome Measures in Rheumatology (OMERACT) meeting in 2016. To synthesize the evidence on measurement properties of patient reported outcome measures (PROMs) for PsA and thereby contribute to development of a PsA core outcome measurement set (COMS) as described by the OMERACT Filter 2.0. A systematic literature search was performed in EMBASE, MEDLINE and PsycINFO on Jan 1, 2017 to identify full-text articles with an aim of assessing the measurement properties of PROMs in PsA. Two independent reviewers rated the quality of studies using the COnsensus based standards for the Selection of health Measurement INstruments (COSMIN) checklist, and performed a qualitative evidence synthesis. Fifty-five studies were included in the systematic review. Forty-four instruments and a total of 89 scales were analyzed. PROMs measuring COS domains with at least fair quality evidence for good validity and reliability (and no evidence for poor properties) included the Stockerau Activity Score for PsA (German), Psoriasis Symptom Inventory, visual analogue scale for Patient Global, 36 Item Short Form Health Survey Physical Function subscale, Health Assessment Questionnaire Disability Index, Bath Ankylosing Spondylitis Functional Index, PsA Impact of Disease questionnaire, PsA Quality of Life questionnaire, VITACORA-19, Functional Assessment of Chronic Illness Therapy Fatigue scale and Social Role Participation Questionnaire. At least one PROM with some evidence for aspects of validity and reliability was available for six of the eight mandatory domains of the PsA COS. Copyright © 2018 Elsevier Inc. All rights reserved.

  17. Developing a General Outcome Measure of Growth in Social Skills for Infants and Toddlers

    ERIC Educational Resources Information Center

    Carta, Judith; Greenwood, Charles; Luze, Gayle; Cline, Gabriel; Kuntz, Susan

    2004-01-01

    Proficiency in social interaction with adults and peers is an important outcome in early childhood. The development of an experimental measure for assessing growth in social skills in children birth to 3 years is described. Based on the general outcome measurement (GOM) approach (e.g., Deno, 1997), the measure is intended for use by early…

  18. Developing a General Outcome Measure Off Growth in Social Skills for Infants and Toddlers

    ERIC Educational Resources Information Center

    Carta, Judith; Greenwood, Charles; Luze, Gayle; Cline, Gabriel; Kuntz, Susan

    2004-01-01

    Proficiency in social interaction with adults and peers is an important outcome in early childhood. The development of an experimental measure for assessing growth in social skills in children birth to 3 years is described. Based on the general outcome measurement (GOM) approach (e.g., Deno, 1997), the measure is intended for use by early…

  19. Neurocognition and community outcome in schizophrenia: long-term predictive validity.

    PubMed

    Fujii, Daryl E; Wylie, A Michael

    2003-02-01

    The present study examined the predictive validity of neuropsychological measures to functional outcome in 26 schizophrenic patients 15-plus year post-testing. Outcome measures included score on the Resource Associated Functional Level Scale (RAFLS), number of state hospital admissions, and total duration of state hospital inpatient stay. Results of several stepwise multiple regressions revealed that verbal memory significantly predicted RAFLS score, accounting for nearly half of the variance. Trails B significantly predicted duration of state hospital inpatient status. Discussion focused on the utility of these measures for clinicians and system planners. Copyright 2002 Elsevier Science B.V.

  20. Development of the FOCUS (Focus on the Outcomes of Communication under Six), a Communication Outcome Measure for Preschool Children

    ERIC Educational Resources Information Center

    Thomas-Stonell, Nancy L.; Oddson, Bruce; Robertson, Bernadette; Rosenbaum, Peter L.

    2010-01-01

    Aim: Our aim was to develop an outcome measure, called Focus on the Outcomes of Communication Under Six (FOCUS), that captures real-world changes in preschool children's communication. Conceptually grounded in the World Health Organization International Classification of Functioning, Disability and Health framework, the FOCUS items were derived…

  1. Using Cross-Cultural Dimensions Exercises to Improve and Measure Learning Outcomes in International Business Courses

    ERIC Educational Resources Information Center

    Zainuba, Mohamed; Rahal, Ahmad

    2012-01-01

    This article proposes an approach for using cross-cultural dimensions exercises to improve and measure learning outcomes in international business courses. The following key issues are highlighted: (a) what are the targeted learning outcomes to be assessed, (b) how to measure the accomplishment of these learning outcomes, (c) the input measures…

  2. Goal setting as an outcome measure: A systematic review.

    PubMed

    Hurn, Jane; Kneebone, Ian; Cropley, Mark

    2006-09-01

    Goal achievement has been considered to be an important measure of outcome by clinicians working with patients in physical and neurological rehabilitation settings. This systematic review was undertaken to examine the reliability, validity and sensitivity of goal setting and goal attainment scaling approaches when used with working age and older people. To review the reliability, validity and sensitivity of both goal setting and goal attainment scaling when employed as an outcome measure within a physical and neurological working age and older person rehabilitation environment, by examining the research literature covering the 36 years since goal-setting theory was proposed. Data sources included a computer-aided literature search of published studies examining the reliability, validity and sensitivity of goal setting/goal attainment scaling, with further references sourced from articles obtained through this process. There is strong evidence for the reliability, validity and sensitivity of goal attainment scaling. Empirical support was found for the validity of goal setting but research demonstrating its reliability and sensitivity is limited. Goal attainment scaling appears to be a sound measure for use in physical rehabilitation settings with working age and older people. Further work needs to be carried out with goal setting to establish its reliability and sensitivity as a measurement tool.

  3. The Florida Community College Accountability Plan: An Analysis of Institutional Characteristics and Success at Meeting State Defined Performance Measures.

    ERIC Educational Resources Information Center

    Windham, Patricia W.; Hackett, E. Raymond

    In response to the increasing use of state-based performance indicators for postsecondary education, a study was undertaken to review the reliability and validity of state-level indicators in the Florida Community College System (FCCS). Data were collected from literature reviews and the 1996 FCCS Accountability Report, detailing outcomes for 17…

  4. Validation of the Italian version of the Clinical Outcomes in Routine Evaluation Outcome Measure (CORE-OM).

    PubMed

    Palmieri, Gaspare; Evans, Chris; Hansen, Vidje; Brancaleoni, Greta; Ferrari, Silvia; Porcelli, Piero; Reitano, Francesco; Rigatelli, Marco

    2009-01-01

    The Clinical Outcomes in Routine Evaluation--Outcome Measure (CORE-OM) was translated into Italian and tested in non-clinical (n = 263) and clinical (n = 647) samples. The translation showed good acceptability, internal consistency and convergent validity in both samples. There were large and statistically significant differences between clinical and non-clinical datasets on all scores. The reliable change criteria were similar to those for the UK referential data. Some of the clinically significant change criteria, particularly for the men, were moderately different from the UK cutting points. The Italian version of the CORE-OM showed respectable psychometric parameters. However, it seemed plausible that non-clinical and clinical distributions of self-report scores on psychopathology and functioning measures may differ by language and culture. *A good quality Italian translation of the CORE-OM, and hence the GP-CORE, CORE-10 and CORE-5 measures also, is now available for use by practitioners and anyone surveying or exploring general psychological state. The measures can be obtained from CORE-IMS or yourself and practitioners are encouraged to share anonymised data so that good clinical and non-clinical referential databases can be established for Italy.

  5. The uses of outcome measures within multidisciplinary early childhood intervention services: a systematic review.

    PubMed

    Calder, Samuel; Ward, Roslyn; Jones, Megan; Johnston, Jenelle; Claessen, Mary

    2017-07-18

    Purpose of the article: To review the use of outcome measures, across the domains of activity, participation, and environment, within multidisciplinary early childhood intervention services. A systematic literature search was undertaken that included four electronic databases: Medline, CINAHL, EMBASE, and the Cochrane Library and Cochrane Database of Systematic Review. Inclusion criteria were age 0-24 months, having or at risk of a developmental disability, in receipt of multidisciplinary early childhood intervention services, and included outcome measures across all domains of the International Classification of Functioning-Child & Youth (ICF-CY). Only peer-reviewed journal articles were considered. Eligible studies were coded using the Oxford Levels of Evidence. Methodological quality was assessed using the Physiotherapy Evidence Database (PEDro) Scale for randomised controlled trials and the QualSyst for non-randomised control trials. Of the total of 5764 records identified, 10 were considered to meet inclusion criteria. Fourteen outcome measures were identified, addressing the domains of activity, participation, and environment. Of these, eight have been recommended in the early intervention literature. While the methodological quality of the 10 studies varied, these papers make a contribution to the body of research that acknowledges the role of routine and enriched environments. Implications for Rehabilitation Core practice elements of multidisciplinary early childhood intervention services indicate it is necessary to select outcome measures framed within the International Classification of Functioning-Child & Youth to inform clinical decision-making for measuring intervention effectiveness across the domains of activity, participation and environment. Of the identified measures, three (Canadian Occupational Performance Measure, Pediatric Evaluation of Disability Inventory, and Goal Attainment Scaling) are well-established and identified in the literature as

  6. Current palliative chemotherapy trials in the elderly neglect patient-centred outcome measures.

    PubMed

    van Bekkum, Marlies L; van Munster, Barbara C; Thunnissen, Peter L M; Smorenburg, Carolien H; Hamaker, Marije E

    2015-01-01

    The elderly comprise the majority of patients newly diagnosed with cancer. Despite this, little evidence-based data are available on the care of the growing number of older patients with cancer. The objective of the current study was to evaluate the characteristics and outcome measures of current clinical trials on palliative chemotherapy in elderly patients. Fourteen international clinical trials registries were searched using the terms "cancer" and "elderly" to identify clinical palliative chemotherapy trials designed specifically for patients aged 70+ years. From the trial protocol, data were extracted on trial characteristics and outcome measures. Of 127 trials, 81% formulated one or more stringent criteria with respect to organ function; 32% excluded patients with WHO performance status (PS) 2 and 83% with PS3. Functional outcomes, health care utilisation, cognitive function after treatment, and quality of life were reported in 6%, 3%, 6%, and 31% of trials, respectively. In only 16% of trials on palliative cancer treatment, a geriatric assessment was performed at baseline. Although recent years have seen a growing evidence base regarding fit older patients, our study suggests a lack of representative cohorts of older patients and patient-centred outcome measures in current palliative treatment trials for the elderly. Research addressing alternative outcome measures, including quality of life and impact of therapy on general functioning, cognition, and preservation of independence, and incorporation of a geriatric assessment are needed to provide elderly patients with cancer and their treating physicians with realistic information about palliative chemotherapy. Copyright © 2014 Elsevier Inc. All rights reserved.

  7. Patient-Reported Outcome Measures for Hand and Wrist Trauma

    PubMed Central

    Dacombe, Peter Jonathan; Amirfeyz, Rouin; Davis, Tim

    2016-01-01

    Background: Patient-reported outcome measures (PROMs) are important tools for assessing outcomes following injuries to the hand and wrist. Many commonly used PROMs have no evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. This systematic review examines the PROMs used in the assessment of hand and wrist trauma patients, and the evidence for reliability, validity, and responsiveness of each measure in this population. Methods: A systematic review of Pubmed, Medline, and CINAHL searching for randomized controlled trials of patients with traumatic injuries to the hand and wrist was carried out to identify the PROMs. For each identified PROM, evidence of reliability, validity, and responsiveness was identified using a further systematic review of the Pubmed, Medline, CINAHL, and reverse citation trail audit procedure. Results: The PROM used most often was the Disabilities of the Arm, Shoulder and Hand (DASH) questionnaire; the Patient-Rated Wrist Evaluation (PRWE), Gartland and Werley score, Michigan Hand Outcomes score, Mayo Wrist Score, and Short Form 36 were also commonly used. Only the DASH and PRWE have evidence of reliability, validity, and responsiveness in patients with traumatic injuries to the hand and wrist; other measures either have incomplete evidence or evidence gathered in a nontraumatic population. Conclusions: The DASH and PRWE both have evidence of reliability, validity, and responsiveness in a hand and wrist trauma population. Other PROMs used to assess hand and wrist trauma patients do not. This should be considered when selecting a PROM for patients with traumatic hand and wrist pathology. PMID:27418884

  8. Standardising the reporting of outcomes in gastric cancer surgery trials: protocol for the development of a core outcome set and accompanying outcome measurement instrument set (the GASTROS study).

    PubMed

    Alkhaffaf, Bilal; Glenny, Anne-Marie; Blazeby, Jane M; Williamson, Paula; Bruce, Iain A

    2017-08-09

    Gastric cancer is one of the leading causes of cancer-related deaths worldwide. Whilst surgery is the mainstay of curative treatment, it is associated with significant risks. Surgical strategies for treating gastric cancer should be based on evidence from systematic reviews of well-designed randomised controlled trials. However, inconsistencies in the reporting of outcomes from these trials makes evidence synthesis unreliable. We present a protocol for an international consensus study to develop a standardised set of outcomes and measurement tools - a 'core outcome set' (COS) - to be used by all future trials examining therapeutic surgical interventions for gastric cancer. The GASTROS study aims to standardise the reporting of outcomes in gastric cancer surgery trials through an international consensus process of key stakeholders including health care professionals and patients. The first of three stages in the study will identify a 'long-list' of potentially important outcomes to be prioritised. These will be extracted from a systematic review of relevant academic literature and patient interviews. Stage 2 will comprise an eDelphi survey which will consider the views of patients, nurse specialists and surgeons to prioritise the most important outcomes. A meeting of stakeholder representatives will ratify the COS. Stage 3 will focus on identifying appropriate instruments to measure the prioritised outcomes by means of quality assessment of available measurement instruments and stakeholder consultation. This study aims to standardise the reporting of outcomes in future trials examining therapeutic surgical interventions for gastric cancer. It is anticipated that standardisation of outcome reporting in these surgical effectiveness trials will enhance the evidence base for clinical practice. Highlighting outcomes of greatest importance to patients will ensure that their perspectives are central to research in this field.

  9. Developing measures of community-relevant outcomes for violence prevention programs: a community-based participatory research approach to measurement.

    PubMed

    Hausman, Alice J; Baker, Courtney N; Komaroff, Eugene; Thomas, Nicole; Guerra, Terry; Hohl, Bernadette C; Leff, Stephen S

    2013-12-01

    Community-Based Participatory Research is a research paradigm that encourages community participation in designing and implementing evaluation research, though the actual outcome measures usually reflect the "external" academic researchers' view of program effect and the policy-makers' needs for decision-making. This paper describes a replicable process by which existing standardized psychometric scales commonly used in youth-related intervention programs were modified to measure indicators of program success defined by community partners. This study utilizes a secondary analysis of data gathered in the context of a community-based youth violence prevention program. Data were retooled into new measures developed using items from the Alabama Parenting Questionnaire, the Hare Area Specific Self-Esteem Scale, and the Youth Asset Survey. These measures evaluated two community-defined outcome indicators, "More Parental Involvement" and "Showing Kids Love." Results showed that existing scale items can be re-organized to create measures of community-defined outcomes that are psychometrically reliable and valid. Results also show that the community definitions of parent or parenting caregivers exemplified by the two indicators are similar to how these constructs have been defined in previous research, but they are not synonymous. There are nuanced differences that are important and worthy of better understanding, in part through better measurement.

  10. Towards global consensus on outcome measures for atopic eczema research: results of the HOME II meeting.

    PubMed

    Schmitt, Jochen; Spuls, Phyllis; Boers, Maarten; Thomas, Kim; Chalmers, Joanne; Roekevisch, Evelien; Schram, Mandy; Allsopp, Richard; Aoki, Valeria; Apfelbacher, Christian; Bruijnzeel-Koomen, Carla; Bruin-Weller, Marjolein; Charman, Carolyn; Cohen, Arnon; Dohil, Magdalene; Flohr, Carsten; Furue, Masutaka; Gieler, Uwe; Hooft, Lotty; Humphreys, Rosemary; Ishii, Henrique Akira; Katayama, Ichiro; Kouwenhoven, Willem; Langan, Sinéad; Lewis-Jones, Sue; Merhand, Stephanie; Murota, Hiroyuki; Murrell, Dedee F; Nankervis, Helen; Ohya, Yukihiro; Oranje, Arnold; Otsuka, Hiromi; Paul, Carle; Rosenbluth, Yael; Saeki, Hidehisa; Schuttelaar, Marie-Louise; Stalder, Jean-Francois; Svensson, Ake; Takaoka, Roberto; Wahlgren, Carl-Fredrik; Weidinger, Stephan; Wollenberg, Andreas; Williams, Hywel

    2012-09-01

    The use of nonstandardized and inadequately validated outcome measures in atopic eczema trials is a major obstacle to practising evidence-based dermatology. The Harmonising Outcome Measures for Eczema (HOME) initiative is an international multiprofessional group dedicated to atopic eczema outcomes research. In June 2011, the HOME initiative conducted a consensus study involving 43 individuals from 10 countries, representing different stakeholders (patients, clinicians, methodologists, pharmaceutical industry) to determine core outcome domains for atopic eczema trials, to define quality criteria for atopic eczema outcome measures and to prioritize topics for atopic eczema outcomes research. Delegates were given evidence-based information, followed by structured group discussion and anonymous consensus voting. Consensus was achieved to include clinical signs, symptoms, long-term control of flares and quality of life into the core set of outcome domains for atopic eczema trials. The HOME initiative strongly recommends including and reporting these core outcome domains as primary or secondary endpoints in all future atopic eczema trials. Measures of these core outcome domains need to be valid, sensitive to change and feasible. Prioritized topics of the HOME initiative are the identification/development of the most appropriate instruments for the four core outcome domains. HOME is open to anyone with an interest in atopic eczema outcomes research. © 2012 John Wiley & Sons A/S.

  11. Exploring Outcome Measures for Exercise Intervention in People with Parkinson's Disease

    PubMed Central

    King, L. A.; Salarian, A.; Mancini, M.; Priest, K. C.; Nutt, J.; Serdar, A.; Wilhelm, J.; Schlimgen, J.; Smith, M.; Horak, F. B.

    2013-01-01

    Background. It is widely believed that exercise improves mobility in people with Parkinson's disease (PD). However, it is difficult to determine whether a specific type of exercise is the most effective. The purpose of this study was to determine which outcome measures were sensitive to exercise intervention and to explore the effects of two different exercise programs for improving mobility in patients with PD. Methods. Participants were randomized into either the Agility Boot Camp (ABC) or treadmill training; 4x/week for 4 weeks. Outcome measures were grouped by the International Classification of Function/Disability (ICF). To determine the responsiveness to exercise, we calculated the standardized response means. t-tests were used to compare the relative benefits of each exercise program. Results. Four of five variables at the structure/function level changed after exercise: turn duration (P = 0.03), stride velocity (P = 0.001), peak arm speed (P = 0.001), and horizontal trunk ROM during gait (P = 0.02). Most measures improved similarly for both interventions. The only variable that detected a difference between groups was postural sway in ABC group (F = 4.95; P = 0.03). Conclusion. Outcome measures at ICF body structure/function level were most effective at detecting change after exercise and revealing differences in improvement between interventions. PMID:23738230

  12. Evaluating Performance Measurement Systems in Nonprofit Agencies: The Program Accountability Quality Scale (PAQS).

    ERIC Educational Resources Information Center

    Poole, Dennis L.; Nelson, Joan; Carnahan, Sharon; Chepenik, Nancy G.; Tubiak, Christine

    2000-01-01

    Developed and field tested the Performance Accountability Quality Scale (PAQS) on 191 program performance measurement systems developed by nonprofit agencies in central Florida. Preliminary findings indicate that the PAQS provides a structure for obtaining expert opinions based on a theory-driven model about the quality of proposed measurement…

  13. How does accounting for worker productivity affect the measured cost-effectiveness of lumbar discectomy?

    PubMed

    Koenig, Lane; Dall, Timothy M; Gu, Qian; Saavoss, Josh; Schafer, Michael F

    2014-04-01

    Back pain attributable to lumbar disc herniation is a substantial cause of reduced workplace productivity. Disc herniation surgery is effective in reducing pain and improving function. However, few studies have examined the effects of surgery on worker productivity. We wished to determine the effect of disc herniation surgery on workers' earnings and missed workdays and how accounting for this effect influences the cost-effectiveness of surgery? Regression models were estimated using data from the National Health Interview Survey to assess the effects of lower back pain caused by disc herniation on earnings and missed workdays. The results were incorporated into Markov models to compare societal costs associated with surgical and nonsurgical treatments for privately insured, working patients. Clinical outcomes and utilities were based on results from the Spine Patient Outcomes Research Trial and additional clinical literature. We estimate average annual earnings of $47,619 with surgery and $45,694 with nonsurgical treatment. The increased earnings for patients receiving surgery as compared with nonsurgical treatment is equal to $1925 (95% CI, $1121-$2728). After surgery, we also estimate that workers receiving surgery miss, on average, 3 fewer days per year than if workers had received nonsurgical treatment (95% CI, 2.4-3.7 days). However, these fewer missed work days only partially offset the assumed 20 workdays missed to recover from surgery. More fully accounting for the effects of disc herniation surgery on productivity reduced the cost of surgery per quality-adjusted life year (QALY) from $52,416 to $35,146 using a 4-year time horizon and from $27,359 to $4186 using an 8-year time horizon. According to a sensitivity analysis, the 4-year cost per QALY varies between $27,921 and $49,787 depending on model assumptions. Increased worker earnings resulting from disc herniation surgery may offset the increased direct medical costs associated with surgery. After

  14. The impact of stroke unit care on outcome in a Scottish stroke population, taking into account case mix and selection bias.

    PubMed

    Turner, Melanie; Barber, Mark; Dodds, Hazel; Dennis, Martin; Langhorne, Peter; Macleod, Mary Joan

    2015-03-01

    Randomised trials indicate that stroke unit care reduces morbidity and mortality after stroke. Similar results have been seen in observational studies but many have not corrected for selection bias or independent predictors of outcome. We evaluated the effect of stroke unit compared with general ward care on outcomes after stroke in Scotland, adjusting for case mix by incorporating the six simple variables (SSV) model, also taking into account selection bias and stroke subtype. We used routine data from National Scottish datasets for acute stroke patients admitted between 2005 and 2011. Patients who died within 3 days of admission were excluded from analysis. The main outcome measures were survival and discharge home. Multivariable logistic regression was used to estimate the OR for survival, and adjustment was made for the effect of the SSV model and for early mortality. Cox proportional hazards model was used to estimate the hazard of death within 365 days. There were 41 692 index stroke events; 79% were admitted to a stroke unit at some point during their hospital stay and 21% were cared for in a general ward. Using the SSV model, we obtained a receiver operated curve of 0.82 (SE 0.002) for mortality at 6 months. The adjusted OR for survival at 7 days was 3.11 (95% CI 2.71 to 3.56) and at 1 year 1.43 (95% CI 1.34 to 1.54) while the adjusted OR for being discharged home was 1.19 (95% CI 1.11 to 1.28) for stroke unit care. In routine practice, stroke unit admission is associated with a greater likelihood of discharge home and with lower mortality up to 1 year, after correcting for known independent predictors of outcome, and excluding early non-modifiable mortality. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.

  15. CHoice of Outcome In Cbt for psychosEs (CHOICE): The Development of a New Service User–Led Outcome Measure of CBT for Psychosis

    PubMed Central

    Greenwood, Kathryn E.; Sweeney, Angela; Williams, Sally; Garety, Philippa; Kuipers, Elizabeth; Scott, Jan; Peters, Emmanuelle

    2010-01-01

    Outcome measures for cognitive behavior therapy for psychosis (CBTp) have been derived from pharmacological studies, focusing on symptom change rather than outcomes such as distress or fulfilment. This study presents the development and psychometric properties of a new outcome measure (CHoice of Outcome In Cbt for psychosEs [CHOICE]), which reflects more strongly the aims of CBTp and the priorities of service users. Service users who had received CBTp participated in focus groups to discuss their outcome priorities, using a topic guide generated by a panel of experts in CBTp. A qualitative thematic analysis was undertaken to reach consensus on themes and generate items. Response scales were constructed for 3 dimensions: severity, satisfaction, and importance. The resulting questionnaire was piloted with service users who had not received CBTp, stratified by service type, ethnicity, and first language to ensure that it was user friendly and applicable prior to CBTp. The psychometric properties of the measure were then examined in a sample of 152 service users. Twenty-four items, and 2 of the dimensions (severity and satisfaction), were retained in the final measure. A factor analysis revealed a single psychological recovery factor interspersed throughout with both CBTp and recovery items. Test-retest reliability, construct validity, and sensitivity to change following CBTp were confirmed. The CHOICE measure is unique in being the first psychometrically adequate service user–led outcome measure of CBTp. It provides the opportunity to examine the evidence base for CBTp with an assessment approach that prioritizes service user definitions of recovery and CBT aims. PMID:19880823

  16. Ultrasound cervical length measurement in prediction of labor induction outcome.

    PubMed

    Kehila, M; Abouda, H S; Sahbi, K; Cheour, H; Chanoufi, M Badis

    2016-05-17

    Induction of labor is one of the most common procedures in modern obstetrics, with an incidence of approximately 20% of all deliveries. Not all of these inductions result in vaginal delivery; some lead to cesarean sections, either for emergency reasons or for failed induction. That's why, It seems necessary to outline strategies for the improvement of the success rate of induced deliveries. Traditionally, the identification of women in whom labor induction is more likely to be successful is based on the Bishop score. However, several studies have shown it to be subjective, with high variation and a poor predictor of the outcome of labor induction. Transvaginal sonography for cervical measurement can be a more objective criterion in assessing the success of labor induction. Many studies have been done recently to compare cervical measurement and Bishop Score in labor induction.This paper reviewed the literature that evaluated sonographic cervical length measurement to predict induction of labor outcome.

  17. Psychometrics of the Personal Questionnaire: A client-generated outcome measure.

    PubMed

    Elliott, Robert; Wagner, John; Sales, Célia M D; Rodgers, Brian; Alves, Paula; Café, Maria J

    2016-03-01

    We present a range of evidence for the reliability and validity of data generated by the Personal Questionnaire (PQ), a client-generated individualized outcome measure, using 5 data sets from 3 countries. Overall pretherapy mean internal consistency (alpha) across clients was .80, and within-client alphas averaged .77; clients typically had 1 or 2 items that did not vary with the other items. Analyses of temporal structure indicated high levels of between-clients variance (58%), moderate pretherapy test-retest correlation (r = .57), and high session-to-session Lag-1 autocorrelation (.82). Scores on the PQ provided clear evidence of convergence with a range of outcome measures (within-client r = .41). Mean pre-post effects were large (d = 1.25). The results support a revised caseness cutoff of 3.25 and a reliable change index interval of 1.67. We conclude that PQ data meet criteria for evidence-based, norm-referenced measurement of client psychological distress for supporting psychotherapy practice and research. (c) 2016 APA, all rights reserved).

  18. Comparison of reliability and responsiveness of patient-reported clinical outcome measures in knee osteoarthritis rehabilitation.

    PubMed

    Williams, Valerie J; Piva, Sara R; Irrgang, James J; Crossley, Chad; Fitzgerald, G Kelley

    2012-08-01

    Secondary analysis, pretreatment-posttreatment observational study. To compare the reliability and responsiveness of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), the Knee Outcome Survey activities of daily living subscale (KOS-ADL), and the Lower Extremity Functional Scale (LEFS) in individuals with knee osteoarthritis (OA). The WOMAC is the current standard in patient-reported measures of function in patients with knee OA. The KOS-ADL and LEFS were designed for potential use in patients with knee OA. If the KOS-ADL and LEFS are to be considered viable alternatives to the WOMAC for measuring patient-reported function in individuals with knee OA, they should have measurement properties comparable to the WOMAC. It would also be important to determine whether either of these instruments may be superior to the WOMAC in terms of reliability or responsiveness in this population. Data from 168 subjects with knee OA, who participated in a rehabilitation program, were used in the analyses. Reliability and responsiveness of each outcome measure were estimated at follow-ups of 2, 6, and 12 months. Reliability was estimated by calculating the intraclass correlation coefficient (ICC2,1) for subjects who were unchanged in status from baseline at each follow-up time, based on a global rating of change score. To examine responsiveness, the standard error of the measurement, minimal detectable change, minimal clinically important difference, and the Guyatt responsiveness index were calculated for each outcome measure at each follow-up time. All 3 outcome measures demonstrated reasonable reliability and responsiveness to change. Reliability and responsiveness tended to decrease somewhat with increasing follow-up time. There were no substantial differences between outcome measures for reliability or any of the 3 measures of responsiveness at any follow-up time. The results do not indicate that one outcome measure is more reliable or responsive than

  19. Accounting for measurement error in human life history trade-offs using structural equation modeling.

    PubMed

    Helle, Samuli

    2018-03-01

    Revealing causal effects from correlative data is very challenging and a contemporary problem in human life history research owing to the lack of experimental approach. Problems with causal inference arising from measurement error in independent variables, whether related either to inaccurate measurement technique or validity of measurements, seem not well-known in this field. The aim of this study is to show how structural equation modeling (SEM) with latent variables can be applied to account for measurement error in independent variables when the researcher has recorded several indicators of a hypothesized latent construct. As a simple example of this approach, measurement error in lifetime allocation of resources to reproduction in Finnish preindustrial women is modelled in the context of the survival cost of reproduction. In humans, lifetime energetic resources allocated in reproduction are almost impossible to quantify with precision and, thus, typically used measures of lifetime reproductive effort (e.g., lifetime reproductive success and parity) are likely to be plagued by measurement error. These results are contrasted with those obtained from a traditional regression approach where the single best proxy of lifetime reproductive effort available in the data is used for inference. As expected, the inability to account for measurement error in women's lifetime reproductive effort resulted in the underestimation of its underlying effect size on post-reproductive survival. This article emphasizes the advantages that the SEM framework can provide in handling measurement error via multiple-indicator latent variables in human life history studies. © 2017 Wiley Periodicals, Inc.

  20. Effect of choice of outcome measure on studies of the etiology of obesity in children.

    PubMed

    Basterfield, Laura; Pearce, Mark S; Adamson, Ashley J; Reilly, Jessica K; Parkinson, Kathryn N; Reilly, John J

    2012-12-01

    Epidemiologic studies of the etiology of childhood obesity often use proxies for adiposity as outcomes. This study aimed to compare the ability of a range of proxy measures to detect associations with sedentary behavior. Longitudinal study of children in the Gateshead Millennium Study who were 7 years at baseline and 9 years at follow-up. Associations between 2-year changes in objectively measured sedentary behavior and changes in proxies for adiposity (waist circumference, waist Z score, body mass index, body mass index Z score) and measurement of body composition (fat mass index from bioelectric impedance) were examined. Associations were tested with linear regression. Associations between 2-year increases in sedentary behavior and increases in adiposity were detectable by using the fat mass index as the outcome, but not the simple proxy measures of adiposity, as outcomes. Proxy measures are inferior to measures of body composition as outcomes in epidemiologic studies. Copyright © 2012 Elsevier Inc. All rights reserved.

  1. Positive psychology outcome measures for family caregivers of people living with dementia: a systematic review.

    PubMed

    Stansfeld, Jacki; Stoner, Charlotte R; Wenborn, Jennifer; Vernooij-Dassen, Myrra; Moniz-Cook, Esme; Orrell, Martin

    2017-08-01

    Family caregivers of people living with dementia can have both positive and negative experiences of caregiving. Despite this, existing outcome measures predominately focus on negative aspects of caregiving such as burden and depression. This review aimed to evaluate the development and psychometric properties of existing positive psychology measures for family caregivers of people living with dementia to determine their potential utility in research and practice. A systematic review of positive psychology outcome measures for family caregivers of people with dementia was conducted. The databases searched were as follows: PsychINFO, CINAHL, MEDLINE, EMBASE, and PubMed. Scale development papers were subject to a quality assessment to appraise psychometric properties. Twelve positive outcome measures and six validation papers of these scales were identified. The emerging constructs of self-efficacy, spirituality, resilience, rewards, gain, and meaning are in line with positive psychology theory. There are some robust positive measures in existence for family caregivers of people living with dementia. However, lack of reporting of the psychometric properties hindered the quality assessment of some outcome measures identified in this review. Future research should aim to include positive outcome measures in interventional research to facilitate a greater understanding of the positive aspects of caregiving and how these contribute to well-being.

  2. Clinical assessment and patient-reported outcome measures in low-back pain - a survey among primary health care physiotherapists.

    PubMed

    Östhols, Sara; Boström, Carina; Rasmussen-Barr, Eva

    2018-05-09

    We aimed to map the physiotherapy practice in Sweden of clinical tests and patient-reported outcome measures in low-back pain (LBP), and to study advantages and barriers in using patient-reported outcome measures. An online survey was mailed to 4934 physiotherapists in primary health care in Sweden. Multiple choice questions investigated the use of clinical tests and patient-reported outcome measures in assessing patients with LBP. Open questions investigating the advantages and barriers to the use of patient-reported outcome measures were analyzed with content analysis. The response rate was 25% (n = 1217). Clinical tests were used "always/often" by >60% of the participants, while most patient-reported outcome measures were used by <15%. Advantages in using patient-reported outcome measures were: the clinical reasoning process, to increase the quality of assessment, to get the patient's voice, education and motivation of patients, and communication with health professionals. Barriers were lack of time and knowledge, administrative aspects, the interaction between physiotherapist and patient and, the applicability and validity of the patient-reported outcome measures. Our findings show that physiotherapists working in primary health care use clinical testing in LBP to a great extent, while various patient-reported outcome measures are used to a low-to-very-low extent. Several barriers to the use of patient-reported outcome measures were reported such as time, knowledge, and administrative issues, while important findings on advantages were to enhance the clinical reasoning process and to educate and motivate the patient. Barriers might be changed through education or organizational change-work. To enhance the use of patient-reported outcome measures and thus person-centered care in low-back pain, recommendation, and education on various patient-reported outcome measures need to be advocated. Implications for rehabilitation To increase the effects of

  3. Measuring economic outcomes of alcohol treatment using the Economic Form 90.

    PubMed

    Bray, Jeremy W; Zarkin, Gary A; Miller, William R; Mitra, Debanjali; Kivlahan, Daniel R; Martin, Daniel J; Couper, David J; Cisler, Ron A

    2007-03-01

    This article assesses the ability of the economic outcome measures in the Economic Form 90 to detect differences across levels of alcohol dependence as measured by the Alcohol Dependence Scale. We used baseline data from the Combining Medications and Behavioral Interventions (COMBINE) Study, a large, multisite clinical trial, to assess the extent to which the economic items on the Economic Form 90 instrument can detect differences across levels of alcohol dependence. After adjusting for differences in demographic characteristics, the Economic Form 90 can detect significant differences across a range of dependence severity levels for the economic outcomes of inpatient medical care, emergency-department medical care, behavioral health care, being on parole or probation, and missed workdays, conditional on being employed. We did not detect significant differences across dependence severity for employment status, outpatient medical care, other criminal justice involvement, or motor vehicle accidents. The Economic Form 90 can identify differences in many economic outcomes associated with differing levels of alcohol dependence. This suggests that the Economic Form 90 may be useful in assessing changes in economic outcomes that result from changes in alcohol dependence.

  4. Measuring outcomes for neurosurgical procedures.

    PubMed

    Theodosopoulos, Philip V; Ringer, Andrew J

    2015-04-01

    Health care evolution has led to focused attention on clinical outcomes of care. Surgical disciplines are increasingly asked to provide evidence of treatment efficacy. As the technological advances push the surgical envelope further, it becomes imperative that postoperative outcomes are studied in a prospective fashion to assess the quality of care provided. The authors present their experience from a multiyear implementation of an outcomes initiative and share lessons learned, emphasizing the important structural elements of such an endeavor. Copyright © 2015 Elsevier Inc. All rights reserved.

  5. Measure Once, Cut Twice – Adding Patient-Reported Outcome Measures to the Electronic Health Record for Comparative Effectiveness Research

    PubMed Central

    Wu, Albert W.; Kharrazi, Hadi; Boulware, L. Ebony; Snyder, Claire F.

    2013-01-01

    Objective This paper presents the current state of patient-reported outcome measures, and explains new opportunities for leveraging the recent adoption of electronic health records to expand the application of patient-reported outcomes in both clinical care and comparative effectiveness research. Study Design and Setting Historic developments of patient-reported outcome, electronic health record, and comparative effectiveness research are analyzed in two dimensions: patient-centeredness and digitization. We pose the question: “What needs to be standardized around the collection of patient-reported outcomes in electronic health records for comparative effectiveness research?” Results We identified three converging trends: the progression of patient-reported outcomes toward greater patient centeredness and electronic adaptation; the evolution of electronic health records into personalized and fully digitized solutions; the shift toward patient-oriented comparative effectiveness research. Related to this convergence, we propose an architecture for patient-reported outcome standardization that could serve as a first step toward a more comprehensive integration of patient-reported outcomes with electronic health record for both practice and research. Conclusion The science of patient-reported outcome measurement has matured sufficiently to be integrated routinely into electronic health records and other e-health solutions to collect data on an ongoing basis for clinical care and comparative effectiveness research. Further efforts and ideally coordinated efforts from various stakeholders are needed to refine the details of the proposed framework for standardization. PMID:23849145

  6. The quality of systematic reviews of health-related outcome measurement instruments.

    PubMed

    Terwee, C B; Prinsen, C A C; Ricci Garotti, M G; Suman, A; de Vet, H C W; Mokkink, L B

    2016-04-01

    Systematic reviews of outcome measurement instruments are important tools for the selection of instruments for research and clinical practice. Our aim was to assess the quality of systematic reviews of health-related outcome measurement instruments and to determine whether the quality has improved since our previous study in 2007. A systematic literature search was performed in MEDLINE and EMBASE between July 1, 2013, and June 19, 2014. The quality of the reviews was rated using a study-specific checklist. A total of 102 reviews were included. In many reviews the search strategy was considered not comprehensive; in only 59 % of the reviews a search was performed in EMBASE and in about half of the reviews there was doubt about the comprehensiveness of the search terms used for type of measurement instruments and measurement properties. In 41 % of the reviews, compared to 30 % in our previous study, the methodological quality of the included studies was assessed. In 58 %, compared to 55 %, the quality of the included instruments was assessed. In 42 %, compared to 7 %, a data synthesis was performed in which the results from multiple studies on the same instrument were somehow combined. Despite a clear improvement in the quality of systematic reviews of outcome measurement instruments in comparison with our previous study in 2007, there is still room for improvement with regard to the search strategy, and especially the quality assessment of the included studies and the included instruments, and the data synthesis.

  7. Psychometric properties of carer-reported outcome measures in palliative care: A systematic review

    PubMed Central

    Michels, Charlotte TJ; Boulton, Mary; Adams, Astrid; Wee, Bee; Peters, Michele

    2016-01-01

    Background: Informal carers face many challenges in caring for patients with palliative care needs. Selecting suitable valid and reliable outcome measures to determine the impact of caring and carers’ outcomes is a common problem. Aim: To identify outcome measures used for informal carers looking after patients with palliative care needs, and to evaluate the measures’ psychometric properties. Design: A systematic review was conducted. The studies identified were evaluated by independent reviewers (C.T.J.M., M.B., M.P.). Data regarding study characteristics and psychometric properties of the measures were extracted and evaluated. Good psychometric properties indicate a high-quality measure. Data sources: The search was conducted, unrestricted to publication year, in the following electronic databases: Applied Social Sciences Index and Abstracts, Cumulative Index to Nursing and Allied Health Literature, The Cochrane Library, EMBASE, PubMed, PsycINFO, Social Sciences Citation Index and Sociological Abstracts. Results: Our systematic search revealed 4505 potential relevant studies, of which 112 studies met the inclusion criteria using 38 carer measures for informal carers of patients with palliative care needs. Psychometric properties were reported in only 46% (n = 52) of the studies, in relation to 24 measures. Where psychometric data were reported, the focus was mainly on internal consistency (n = 45, 87%), construct validity (n = 27, 52%) and/or reliability (n = 14, 27%). Of these, 24 measures, only four (17%) had been formally validated in informal carers in palliative care. Conclusion: A broad range of outcome measures have been used for informal carers of patients with palliative care needs. Little formal psychometric testing has been undertaken. Furthermore, development and refinement of measures in this field is required. PMID:26407683

  8. Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures.

    PubMed

    Deighton, Jessica; Croudace, Tim; Fonagy, Peter; Brown, Jeb; Patalay, Praveetha; Wolpert, Miranda

    2014-01-01

    There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures' psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against

  9. Measuring Exposure Opportunities: Using Exogenous Measures in Assessing Effects of Media Exposure on Smoking Outcomes

    PubMed Central

    Liu, Jiaying; Hornik, Robert

    2016-01-01

    Measurement of exposure has long been one of the most central and fundamental issues in communication research. While self-reported measures remain dominant in the field, alternative approaches such as exogenous or hybrid measures have received increasing scholarly attention and been employed in various contexts for the estimation of media exposure; however, systematic scrutiny of such measures is thin. This study aims to address the gap by systematically reviewing the studies which utilized exogenous or hybrid exposure measures for examining the effects of media exposure on tobacco-related outcomes. We then proceed to discuss the strengths and weaknesses, current developments in this class of measurement, drawing some implications for the appropriate utilization of exogenous and hybrid measures. PMID:27746848

  10. Medication Regimen Complexity Measured by MRCI: A Systematic Review to Identify Health Outcomes.

    PubMed

    Alves-Conceição, Vanessa; Rocha, Kérilin Stancine Santos; Silva, Fernanda Vilanova Nascimento; Silva, Rafaella Oliveira Santos; Silva, Daniel Tenório da; Lyra-Jr, Divaldo Pereira de

    2018-05-01

    To perform a systematic review to identify health outcomes related to medication regimen complexity as measured by the Medication Regimen Complexity Index (MRCI) instrument. Cochrane Library, LILACS, PubMed, Scopus, EMBASE, Open Thesis, and Web of Science were searched from January 1, 2004, until April 02, 2018, using the following search terms: outcome assessment, drug therapy, and Medication Regimen Complexity Index and their synonyms in different combinations. Studies that used the MRCI instrument to measure medication regimen complexity and related it to clinical, humanistic, and/or economic outcomes were evaluated. Two reviewers independently carried out the analysis of the titles, abstracts, and complete texts according to the eligibility criteria, performed data extraction, and evaluated study quality. A total of 23 studies met the inclusion criteria; 18 health outcomes related to medication regimen complexity were found. The health outcomes most influenced by medication regimen complexity were hospital readmission, medication adherence, hospitalization, adverse drug events, and emergency sector visit. Only one study related medication regimen complexity with humanistic outcomes, and no study related medication regimen complexity to economic outcomes. Most of the studies were of good methodological quality. Relevance to Patient Care and Clinical Practice: Health care professionals should pay attention to medication regimen complexity of the patients because this may influence health outcomes. This study identified some health outcomes that may be influenced by medication regimen complexity: hospitalization, hospital readmission, and medication adherence were more prevalent, showing a significant association between MRCI increase and these health outcomes.

  11. Engaging the hearts and minds of clinicians in outcome measurement - the UK Rehabilitation Outcomes Collaborative approach.

    PubMed

    Turner-Stokes, Lynne; Williams, Heather; Sephton, Keith; Rose, Hilary; Harris, Sarah; Thu, Aung

    2012-01-01

    This article explores the rationale for choosing the instruments included within the UK Rehabilitation Outcomes Collaborative (UKROC) data set. Using one specialist neuro-rehabilitation unit as an exemplar service, it describes an approach to engaging the hearts and minds of clinicians in recording the data. Measures included within a national data set for rehabilitation should be psychometrically robust and feasible to use in routine clinical practice; they should also support clinical decision-making so that clinicians actually want to use them. Learning from other international casemix models and benchmarking data sets, the UKROC team has developed a cluster of measures to inform the development of effective and cost-efficient rehabilitation services. These include measures of (1) "needs" for rehabilitation (complexity), (2) inputs provided to meet those needs (nursing and therapy intervention), and (3) outcome, including the attainment of personal goals as well as gains in functional independence. By integrating the use of the data set measures in everyday clinical practice, we have achieved a very high rate of compliance with data collection. However, staff training and ongoing commitment from senior staff and managers are critical to the maintenance of effort required to provide assurance of data quality in the longer term.

  12. Performance measurement for case management: principles and objectives for developing standard measures.

    PubMed

    Howe, Rufus

    2005-01-01

    Developing standardized performance measurements for case management (CM) has become the holy grail of the field. The Council for Case Management Accountability (CCMA), a leadership committee of the Case Management Society of America (CMSA), has been grappling with the concept since early 2003. This article lays out a theoretical framework for performance measurement and then outlines the progress on a specific initiative begun by CCMA to correlate CM practices with improved outcome measures.

  13. Assessment Measures Showing Institutional Effectiveness in Relation to External Stakeholder Expectations for Accountability

    ERIC Educational Resources Information Center

    Clites, Mona Lynn

    2013-01-01

    Community colleges face a growing demand from a wide range of stakeholders for more transparent accountability but struggle to select appropriate measures and to use them in effective ways. The multiple demands of various stakeholders, and the calls to respond to those demands in effective and appropriate ways, are leading to a confusing array of…

  14. Negative decision outcomes are more common among people with lower decision-making competence: an item-level analysis of the Decision Outcome Inventory (DOI).

    PubMed

    Parker, Andrew M; Bruine de Bruin, Wändi; Fischhoff, Baruch

    2015-01-01

    Most behavioral decision research takes place in carefully controlled laboratory settings, and examination of relationships between performance and specific real-world decision outcomes is rare. One prior study shows that people who perform better on hypothetical decision tasks, assessed using the Adult Decision-Making Competence (A-DMC) measure, also tend to experience better real-world decision outcomes, as reported on the Decision Outcomes Inventory (DOI). The DOI score reflects avoidance of outcomes that could result from poor decisions, ranging from serious (e.g., bankruptcy) to minor (e.g., blisters from sunburn). The present analyses go beyond the initial work, which focused on the overall DOI score, by analyzing the relationships between specific decision outcomes and A-DMC performance. Most outcomes are significantly more likely among people with lower A-DMC scores, even after taking into account two variables expected to produce worse real-world decision outcomes: younger age and lower socio-economic status. We discuss the usefulness of DOI as a measure of successful real-world decision-making.

  15. Whole School Inquiry That Promotes Equitable Student Outcomes.

    ERIC Educational Resources Information Center

    Johnson, Ruth S.

    The present era is one of accountability, high-stakes standardized testing, and standards-based reform. However, there is a relative absence of meaningful discussion of how to achieve equitable outcomes that do not unfairly penalize the most under-served students. This paper challenges the perpetuation of reform practices that do not measure their…

  16. Framework of outcome measures recommended for use in the evaluation of childhood obesity treatment interventions: the CoOR framework.

    PubMed

    Bryant, M; Ashton, L; Nixon, J; Jebb, S; Wright, J; Roberts, K; Brown, J

    2014-12-01

    Consensus is lacking in determining appropriate outcome measures for assessment of childhood obesity treatments. Inconsistency in the use and reporting of such measures impedes comparisons between treatments and limits consideration of effectiveness. This study aimed to produce a framework of recommended outcome measures: the Childhood obesity treatment evaluation Outcomes Review (CoOR) framework. A systematic review including two searches was conducted to identify (1) existing trial outcome measures and (2) manuscripts describing development/evaluation of outcome measures. Outcomes included anthropometry, diet, eating behaviours, physical activity, sedentary time/behaviour, fitness, physiology, environment, psychological well-being and health-related quality of life. Eligible measures were appraised by the internal team using a system developed from international guidelines, followed by appraisal from national external expert collaborators. A total of 25,486 papers were identified through both searches. Eligible search 1 trial papers cited 417 additional papers linked to outcome measures, of which 56 were eligible. A further 297 outcome development/evaluation papers met eligibility criteria from search 2. Combined, these described 191 outcome measures. After internal and external appraisal, 52 measures across 10 outcomes were recommended for inclusion in the CoOR framework. Application of the CoOR framework will ensure greater consistency in choosing robust outcome measures that are appropriate to population characteristics. © 2014 The Authors. Pediatric Obesity © 2014 International Association for the Study of Obesity.

  17. Goal specificity: a proxy measure for improvements in environmental outcomes in collaborative governance.

    PubMed

    Biddle, Jennifer C; Koontz, Tomas M

    2014-12-01

    Collaborative governance critics continually call for evidence to support its prevalent use. As is often the case in environmental policy, environmental outcomes occur at a rate incompatible with political agendas. In addition, a multitude of possibly confounding variables makes it difficult to correlate collaborative governance processes with environmental outcomes. The findings of this study offer empirical evidence that collaborative processes have a measurable, beneficial effect on environmental outcomes. Through the use of a unique paired-waterbody design, our dataset reduced the potential for confounding variables to impact our environmental outcome measurements. The results of a path analysis indicate that the output of setting specific pollutant reduction goals is significantly related to watershed partnerships' level of attainment of their environmental improvement goals. The action of setting specific goals (e.g. percentage of load reductions in pollutant levels) is fostered by sustained participation from partnership members throughout the lifecycle of the collaborative. In addition, this study demonstrates the utility of logic modeling for environmental planning and management, and suggests that the process of setting specific pollutant reduction goals is a useful proxy measure for reporting progress towards improvements in environmental outcomes when long-term environmental data are not available. Copyright © 2014 Elsevier Ltd. All rights reserved.

  18. How Measurement and Modeling of Attendance Matter to Assessing Dimensions of Inequality

    ERIC Educational Resources Information Center

    Dougherty, Shaun M.

    2018-01-01

    Each iteration of high stakes accountability has included requirements to include measures of attendance in their accountability programs, thereby increasing the salience of this measure. Researchers too have turned to attendance and chronic absence as important outcomes in evaluations and policy studies. Often, too little attention is paid to the…

  19. Conservation covenants on private land: issues with measuring and achieving biodiversity outcomes in Australia.

    PubMed

    Fitzsimons, James A; Carr, C Ben

    2014-09-01

    Conservation covenants and easements have become essential tools to secure biodiversity outcomes on private land, and to assist in meeting international protection targets. In Australia, the number and spatial area of conservation covenants has grown significantly in the past decade. Yet there has been little research or detailed policy analysis of conservation covenanting in Australia. We sought to determine how conservation covenanting agencies were measuring the biodiversity conservation outcomes achieved on covenanted properties, and factors inhibiting or contributing to measuring these outcomes. In addition, we also investigated the drivers and constraints associated with actually delivering the biodiversity outcomes, drawing on detailed input from covenanting programs. Although all conservation covenanting programs had the broad aim of maintaining or improving biodiversity in their covenants in the long term, the specific stated objectives of conservation covenanting programs varied. Programs undertook monitoring and evaluation in different ways and at different spatial and temporal scales. Thus, it was difficult to determine the extent Australian conservation covenanting agencies were measuring the biodiversity conservation outcomes achieved on covenanted properties on a national scale. Lack of time available to covenantors to undertake management was one of the biggest impediments to achieving biodiversity conservation outcomes. A lack of financial resources and human capital to monitor, knowing what to monitor, inconsistent monitoring methodologies, a lack of benchmark data, and length of time to achieve outcomes were all considered potential barriers to monitoring the biodiversity conservation outcomes of conservation covenants.

  20. Conservation Covenants on Private Land: Issues with Measuring and Achieving Biodiversity Outcomes in Australia

    NASA Astrophysics Data System (ADS)

    Fitzsimons, James A.; Carr, C. Ben

    2014-09-01

    Conservation covenants and easements have become essential tools to secure biodiversity outcomes on private land, and to assist in meeting international protection targets. In Australia, the number and spatial area of conservation covenants has grown significantly in the past decade. Yet there has been little research or detailed policy analysis of conservation covenanting in Australia. We sought to determine how conservation covenanting agencies were measuring the biodiversity conservation outcomes achieved on covenanted properties, and factors inhibiting or contributing to measuring these outcomes. In addition, we also investigated the drivers and constraints associated with actually delivering the biodiversity outcomes, drawing on detailed input from covenanting programs. Although all conservation covenanting programs had the broad aim of maintaining or improving biodiversity in their covenants in the long term, the specific stated objectives of conservation covenanting programs varied. Programs undertook monitoring and evaluation in different ways and at different spatial and temporal scales. Thus, it was difficult to determine the extent Australian conservation covenanting agencies were measuring the biodiversity conservation outcomes achieved on covenanted properties on a national scale. Lack of time available to covenantors to undertake management was one of the biggest impediments to achieving biodiversity conservation outcomes. A lack of financial resources and human capital to monitor, knowing what to monitor, inconsistent monitoring methodologies, a lack of benchmark data, and length of time to achieve outcomes were all considered potential barriers to monitoring the biodiversity conservation outcomes of conservation covenants.

  1. Measuring mental health and wellbeing outcomes for children and adolescents to inform practice and policy: a review of child self-report measures

    PubMed Central

    2014-01-01

    There is a growing appetite for mental health and wellbeing outcome measures that can inform clinical practice at individual and service levels, including use for local and national benchmarking. Despite a varied literature on child mental health and wellbeing outcome measures that focus on psychometric properties alone, no reviews exist that appraise the availability of psychometric evidence and suitability for use in routine practice in child and adolescent mental health services (CAMHS) including key implementation issues. This paper aimed to present the findings of the first review that evaluates existing broadband measures of mental health and wellbeing outcomes in terms of these criteria. The following steps were implemented in order to select measures suitable for use in routine practice: literature database searches, consultation with stakeholders, application of inclusion and exclusion criteria, secondary searches and filtering. Subsequently, detailed reviews of the retained measures’ psychometric properties and implementation features were carried out. 11 measures were identified as having potential for use in routine practice and meeting most of the key criteria: 1) Achenbach System of Empirically Based Assessment, 2) Beck Youth Inventories, 3) Behavior Assessment System for Children, 4) Behavioral and Emotional Rating Scale, 5) Child Health Questionnaire, 6) Child Symptom Inventories, 7) Health of the National Outcome Scale for Children and Adolescents, 8) Kidscreen, 9) Pediatric Symptom Checklist, 10) Strengths and Difficulties Questionnaire, 11) Youth Outcome Questionnaire. However, all existing measures identified had limitations as well as strengths. Furthermore, none had sufficient psychometric evidence available to demonstrate that they could reliably measure both severity and change over time in key groups. The review suggests a way of rigorously evaluating the growing number of broadband self-report mental health outcome measures against

  2. Outcome Measurement in Economic Evaluations of Public Health Interventions: a Role for the Capability Approach?

    PubMed Central

    Lorgelly, Paula K.; Lawson, Kenny D.; Fenwick, Elisabeth A.L.; Briggs, Andrew H.

    2010-01-01

    Public health interventions have received increased attention from policy makers, and there has been a corresponding increase in the number of economic evaluations within the domain of public health. However, methods to evaluate public health interventions are less well established than those for medical interventions. Focusing on health as an outcome measure is likely to underestimate the impact of many public health interventions. This paper provides a review of outcome measures in public health; and describes the benefits of using the capability approach as a means to developing an all encompassing outcome measure. PMID:20623024

  3. An Outcome-Based Assessment Process for Accrediting Computing Programmes

    ERIC Educational Resources Information Center

    Harmanani, Haidar M.

    2017-01-01

    The calls for accountability in higher education have made outcome-based assessment a key accreditation component. Accreditation remains a well-regarded seal of approval on college quality, and requires the programme to set clear, appropriate, and measurable goals and courses to attain them. Furthermore, programmes must demonstrate that…

  4. Measure for Measure: How Proficiency-Based Accountability Systems Affect Inequality in Academic Achievement

    ERIC Educational Resources Information Center

    Jennings, Jennifer; Sohn, Heeju

    2014-01-01

    How do proficiency-based accountability systems affect inequality in academic achievement? This article reconciles mixed findings in the literature by demonstrating that three factors jointly determine accountability's impact. First, by analyzing student-level data from a large urban school district, we find that when educators face accountability…

  5. An Electronic Patient-Reported Outcome Measures System in UK Chiropractic Practices: A Feasibility Study of Routine Collection of Outcomes and Costs.

    PubMed

    Newell, Dave; Diment, Emily; Bolton, Jenni E

    2016-01-01

    The purpose of this study was to test the feasibility of collecting valid and widely used health outcomes, including information concerning cost of care, using a Web-based patient-driven patient-reported outcome measure (PROM) collection process within a cohort of UK chiropractic practices. A Web-based PROM system (Care Response) was used. Patients with low back and neck pain were recruited from a group of chiropractic practices located in the United Kingdom. Information collected included demographic data, generic and condition-specific PROMs at the initial consultation and 90 days later, patient-reported experience measures, and additional health seeking to estimate costs of care. A group of 33 clinics provided information from a total of 1895 patients who completed baseline questionnaires with 844 (45%) completing the measures at 90-day follow-up. Subsequent outcomes suggest that more than 70% of patients improved over the course of treatment regardless of the outcome used. Using the baseline as a virtual counterfactual with respect to follow-up, we calculated quality-adjusted life years and the cost thereof resulting in a mean quality-adjusted life years gained of 0.8 with an average cost of £895 per quality-adjusted life year. Routine collection of PROMs, including information about cost, is feasible and can be achieved using an online system within a clinical practice environment. We describe a Web-based collection system and discuss the choice of measures leading to a comprehensive understanding of outcomes and costs in routine practice. Copyright © 2016 National University of Health Sciences. Published by Elsevier Inc. All rights reserved.

  6. When do patient-reported outcome measures inform readmission risk?

    PubMed

    Hinami, Keiki; Smith, Jennifer; Deamant, Catherine D; DuBeshter, Kayle; Trick, William E

    2015-05-01

    To characterize changes in patient-reported outcome measures from hospital discharge to assess when they best inform risk of utilization as defined by readmissions or emergency department use. Patients discharged from an urban safety-net hospital. Longitudinal cohort study. We serially administered the Memorial Symptom Assessment Scale (MSAS) and the PROMIS Global Health short form assessing General Self-Rated Health (GSRH), Global Physical (GPH), and Mental (GMH) Health at 0, 30, 90, and 180 days from hospital discharge. Time to first utilization from each survey was plotted by dichotomizing our sample on each patient-reported measure, and equivalence of the time-to-event curves was assessed using the log-rank test. Cox proportional hazard models were used to control for available covariates including prior utilization during the study, Charlson score, age, gender, and race/ethnicity. We assessed each measure's effect on the fit of the predictive models using the likelihood ratio test. We recruited 196 patients, of whom 100%, 98%, 90%, and 88% completed each respective survey wave. Participants' mean age was 52 years, 51% were women, 60% were non-Hispanic black, and 21% completed the questionnaires in Spanish. In-hospital assessments revealed high symptom burden and poor health status. In-hospital assessments of GMH and GSRH predicted 14-day reutilization, whereas posthospitalization assessments of MSAS and GPH predicted subsequent utilizations. Each measure selectively improved predictive model fit. Routine measurement of patient-reported outcomes can help identify patients at higher risk for utilizations. At different time points, MSAS, GPH, GMH, and GSRH all informed utilization risk. © 2015 Society of Hospital Medicine.

  7. The impact of outcomes measurement on the hospital-physician relationship.

    PubMed

    Longo, D R

    1994-01-01

    Hospitals and physicians have a mutually dependent relationship. Although both are responsible for patient care, conflicts arise as physicians attempt to maintain professional autonomy and hospitals attempt to maintain organizational stability. In recent years the outcomes measurement movement has influenced this relationship in a variety of ways. This review chapter traces the major sociological, historical, theoretical, and political influences that have contributed to these conflicts. Additionally, based on an analysis of these trends, speculation is offered on the future of the hospital-physician relationship as society increasingly holds both groups responsible for outcomes of care.

  8. Measuring the Effects of Self-Awareness: Construction of the Self-Awareness Outcomes Questionnaire

    PubMed Central

    Sutton, Anna

    2016-01-01

    Dispositional self-awareness is conceptualized in several different ways, including insight, reflection, rumination and mindfulness, with the latter in particular attracting extensive attention in recent research. While self-awareness is generally associated with positive psychological well-being, these different conceptualizations are also each associated with a range of unique outcomes. This two part, mixed methods study aimed to advance understanding of dispositional self-awareness by developing a questionnaire to measure its outcomes. In Study 1, expert focus groups categorized and extended an initial pool of potential items from previous research. In Study 2, these items were reduced to a 38 item self-report questionnaire with four factors representing three beneficial outcomes (reflective self-development, acceptance and proactivity) and one negative outcome (costs). Regression of these outcomes against self-awareness measures revealed that self-reflection and insight predicted beneficial outcomes, rumination predicted reduced benefits and increased costs, and mindfulness predicted both increased proactivity and costs. These studies help to refine the self-awareness concept by identifying the unique outcomes associated with the concepts of self-reflection, insight, reflection, rumination and mindfulness. It can be used in future studies to evaluate and develop awareness-raising techniques to maximize self-awareness benefits while minimizing related costs. PMID:27872672

  9. Comparison of clinician-predicted to measured low vision outcomes.

    PubMed

    Chan, Tiffany L; Goldstein, Judith E; Massof, Robert W

    2013-08-01

    To compare low-vision rehabilitation (LVR) clinicians' predictions of the probability of success of LVR with patients' self-reported outcomes after provision of usual outpatient LVR services and to determine if patients' traits influence clinician ratings. The Activity Inventory (AI), a self-report visual function questionnaire, was administered pre-and post-LVR to 316 low-vision patients served by 28 LVR centers that participated in a collaborative observational study. The physical component of the Short Form-36, Geriatric Depression Scale, and Telephone Interview for Cognitive Status were also administered pre-LVR to measure physical capability, depression, and cognitive status. After patient evaluation, 38 LVR clinicians estimated the probability of outcome success (POS) using their own criteria. The POS ratings and change in functional ability were used to assess the effects of patients' baseline traits on predicted outcomes. A regression analysis with a hierarchical random-effects model showed no relationship between LVR physician POS estimates and AI-based outcomes. In another analysis, kappa statistics were calculated to determine the probability of agreement between POS and AI-based outcomes for different outcome criteria. Across all comparisons, none of the kappa values were significantly different from 0, which indicates that the rate of agreement is equivalent to chance. In an exploratory analysis, hierarchical mixed-effects regression models show that POS ratings are associated with information about the patient's cognitive functioning and the combination of visual acuity and functional ability, as opposed to visual acuity or functional ability alone. Clinicians' predictions of LVR outcomes seem to be influenced by knowledge of patients' cognitive functioning and the combination of visual acuity and functional ability-information clinicians acquire from the patient's history and examination. However, clinicians' predictions do not agree with observed

  10. Comparison of Physician-Predicted to Measured Low Vision Outcomes

    PubMed Central

    Chan, Tiffany L.; Goldstein, Judith E.; Massof, Robert W.

    2013-01-01

    Purpose To compare low vision rehabilitation (LVR) physicians’ predictions of the probability of success of LVR to patients’ self-reported outcomes after provision of usual outpatient LVR services; and to determine if patients’ traits influence physician ratings. Methods The Activity Inventory (AI), a self-report visual function questionnaire, was administered pre and post-LVR to 316 low vision patients served by 28 LVR centers that participated in a collaborative observational study. The physical component of the Short Form-36, Geriatric Depression Scale, and Telephone Interview for Cognitive Status were also administered pre-LVR to measure physical capability, depression and cognitive status. Following patient evaluation, 38 LVR physicians estimated the probability of outcome success (POS), using their own criteria. The POS ratings and change in functional ability were used to assess the effects of patients’ baseline traits on predicted outcomes. Results A regression analysis with a hierarchical random effects model showed no relationship between LVR physician POS estimates and AI-based outcomes. In another analysis, Kappa statistics were calculated to determine the probability of agreement between POS and AI-based outcomes for different outcome criteria. Across all comparisons, none of the kappa values were significantly different from 0, which indicates the rate of agreement is equivalent to chance. In an exploratory analysis, hierarchical mixed effects regression models show that POS ratings are associated with information about the patient’s cognitive functioning and the combination of visual acuity and functional ability, as opposed to visual acuity or functional ability alone. Conclusions Physicians’ predictions of LVR outcomes appear to be influenced by knowledge of patients’ cognitive functioning and the combination of visual acuity and functional ability - information physicians acquire from the patient’s history and examination. However

  11. Comparing the responsiveness of functional outcome assessment measures for trauma registries.

    PubMed

    Williamson, Owen D; Gabbe, Belinda J; Sutherland, Ann M; Wolfe, Rory; Forbes, Andrew B; Cameron, Peter A

    2011-07-01

    Measuring long-term disability and functional outcomes after major trauma is not standardized across trauma registries. An ideal measure would be responsive to change but not have significant ceiling effects. The aim of this study was to compare the responsiveness of the Glasgow Outcome Scale (GOS), GOS-Extended (GOSE), Functional Independence Measure (FIM), and modified FIM in major trauma patients, with and without significant head injuries. Patients admitted to two adult Level I trauma centers in Victoria, Australia, who survived to discharge from hospital, were aged 15 years to 80 years with a blunt mechanism of injury, and had an estimated Injury Severity Score >15 on admission, were recruited for this prospective study. The instruments were administered at baseline (hospital discharge) and by telephone interview 6 months after injury. Measures of responsiveness, including effect sizes, were calculated. Bootstrapping techniques, and floor and ceiling effects, were used to compare the measures. Two hundred forty-three patients participated, of which 234 patients (96%) completed the study. The GOSE and GOS were the most responsive instruments in this major trauma population with effect sizes of 5.3 and 4.4, respectively. The GOSE had the lowest ceiling effect (17%). The GOSE was the instrument with greatest responsiveness and the lowest ceiling effect in a major trauma population with and without significant head injuries and is recommended for use by trauma registries for monitoring functional outcomes and benchmarking care. The results of this study do not support the use of the modified FIM for this purpose.

  12. Measures of outcome for stimulant trials: ACTTION recommendations and research agenda.

    PubMed

    Kiluk, Brian D; Carroll, Kathleen M; Duhig, Amy; Falk, Daniel E; Kampman, Kyle; Lai, Shengan; Litten, Raye Z; McCann, David J; Montoya, Ivan D; Preston, Kenzie L; Skolnick, Phil; Weisner, Constance; Woody, George; Chandler, Redonna; Detke, Michael J; Dunn, Kelly; Dworkin, Robert H; Fertig, Joanne; Gewandter, Jennifer; Moeller, F Gerard; Ramey, Tatiana; Ryan, Megan; Silverman, Kenneth; Strain, Eric C

    2016-01-01

    The development and approval of an efficacious pharmacotherapy for stimulant use disorders has been limited by the lack of a meaningful indicator of treatment success, other than sustained abstinence. In March, 2015, a meeting sponsored by Analgesic, Anesthetic, and Addiction Clinical Trial Translations, Innovations, Opportunities, and Networks (ACTTION) was convened to discuss the current state of the evidence regarding meaningful outcome measures in clinical trials for stimulant use disorders. Attendees included members of academia, funding and regulatory agencies, pharmaceutical companies, and healthcare organizations. The goal was to establish a research agenda for the development of a meaningful outcome measure that may be used as an endpoint in clinical trials for stimulant use disorders. Based on guidelines for the selection of clinical trial endpoints, the lessons learned from prior addiction clinical trials, and the process that led to identification of a meaningful indicator of treatment success for alcohol use disorders, several recommendations for future research were generated. These include a focus on the validation of patient reported outcome measures of functioning, the exploration of patterns of stimulant abstinence that may be associated with physical and/or psychosocial benefits, the role of urine testing for validating self-reported measures of stimulant abstinence, and the operational definitions for reduction-based measures in terms of frequency rather than quantity of stimulant use. These recommendations may be useful for secondary analyses of clinical trial data, and in the design of future clinical trials that may help establish a meaningful indicator of treatment success. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

  13. The patient-specific functional scale: psychometrics, clinimetrics, and application as a clinical outcome measure.

    PubMed

    Horn, Katyana Kowalchuk; Jennings, Sophie; Richardson, Gillian; Vliet, Ditte Van; Hefford, Cheryl; Abbott, J Haxby

    2012-01-01

    Systematic review of the literature. To summarize peer-reviewed literature on the reliability, validity, and responsiveness of the Patient-Specific Functional Scale (PSFS), and to identify its use as an outcome measure. Searches were performed of several electronic databases from 1995 to May 2010. Studies included were published articles containing (1) primary research investigating the psychometric and clinimetrics of the PSFS or (2) the implementation of the PSFS as an outcome measure. We assessed the methodological quality of studies included in the first category. Two hundred forty-two articles published from 1994 to May 2010 were identified. Of these, 66 met the inclusion criteria for this review, with 13 reporting the measurement properties of the PSFS, 55 implementing the PSFS as an outcome measure, and 2 doing both of the above. The PSFS was reported to be valid, reliable, and responsive in populations with knee dysfunction, cervical radiculopathy, acute low back pain, mechanical low back pain, and neck dysfunction. The PSFS was found to be reliable and responsive in populations with chronic low back pain. The PSFS was also reported to be valid, reliable, or responsive in individuals with a limited number of acute, subacute, and chronic conditions. This review found that the PSFS is also being used as an outcome measure in many other conditions, despite a lack of published evidence supporting its validity in these conditions. Although the use of the PSFS as an outcome measure is increasing in physiotherapy practice, there are gaps in the research literature regarding its validity, reliability, and responsiveness in many health conditions.

  14. Development of a core outcome set for use in determining the overall success of gastroschisis treatment.

    PubMed

    Allin, Benjamin; Ross, Andrew; Marven, Sean; J Hall, Nigel; Knight, Marian

    2016-07-27

    Gastroschisis research is limited in quality by the presence of significant heterogeneity in outcome measure reporting (PloS One 10(1):e0116908, 2015). Using core outcome sets in research is one proposed method for addressing this problem (Trials 13:103, 2012; Clin Rheumatol 33(9):1313-1322, 2014; Health Serv Res Policy 17(1):1-2, 2012). Ultimately, standardising outcome measure reporting will improve research quality and translate into improvements in patient care. Candidate outcome measures have been identified through systematic reviews. These outcome measures will form the starting point for an online, three-phase Delphi process that will be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel, panel 2 is a non-neonatal panel and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1-9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's gastroschisis treatment. In round 2, experts will be presented with the same list of outcome measures and with graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. The results of the Delphi process will be discussed, and outcomes re-scored. Outcome measures where > 70 % of the participants at the meeting scored them as 7-9 and < 15 % scored them as 1-3 will form the

  15. Measuring the Quality of VET Using the Student Outcomes Survey. Occasional Paper

    ERIC Educational Resources Information Center

    Lee, Wang-Sheng; Polidano, Cain

    2010-01-01

    The aim of this report is to examine the potential use of information from the Student Outcomes Survey, including the use of student course satisfaction information and post-study outcomes, as a means of determining markers of training quality. In an analysis of the student course satisfaction measures, the authors found there are very small…

  16. Multiple Measures of Outcome in Assessing a Prison-Based Drug Treatment Program

    ERIC Educational Resources Information Center

    Prendergast, Michael L.; Hall, Elizabeth A.; Wexler, Harry K.

    2003-01-01

    Evaluations of prison-based drug treatment programs typically focus on one or two dichotomous outcome variables related to recidivism. In contrast, this paper uses multiple measures of outcomes related to crime and drug use to examine the impact of prison treatment. Crime variables included self-report data of time to first illegal activity,…

  17. Heart Rate Variability as a Feeding Intervention Outcome Measure in the Preterm Infant.

    PubMed

    Pados, Britt F; Thoyre, Suzanne M; Knafl, George J; Nix, William Brant

    2017-10-01

    Feeding interventions for preterm infants aim to reduce the physiologic stress of feeding to promote growth. Heart rate variability (HRV) is a potential noninvasive measure of physiologic stress that may be useful for evaluating efficacy of feeding interventions. To evaluate whether HRV is a sensitive measure of physiologic stress compared with standard physiologic outcomes in the context of a feeding intervention study. This was a secondary analysis of a within-subjects, cross-over design study comparing usual care feeding with a gentle, coregulated (CoReg) feeding approach in 14 infants born less than 35 weeks' postmenstrual age. HRV indices were calculated from electrocardiogram data and compared with standard physiologic outcomes, including oxygen saturation (Spo2), respiratory rate (RR), apnea, heart rate (HR), and bradycardia. Data were analyzed using linear mixed modeling. Infants fed using the CoReg approach had fewer apneic events and higher RR, suggesting they were able to breathe more during feeding. No statistically significant differences were found in SpO2, HR, bradycardia, or high frequency power (the most commonly reported measure of HRV). Infants fed using the usual care approach had significantly higher SD12, a measure of HRV indicating randomness in the HR, which is a potential indicator of elevated stress. SD12 was more sensitive to stress than SpO2, HR, and bradycardia. The utility of HRV as a measure of feeding outcomes in clinical practice needs further exploration. Further exploration of HRV as an intervention outcome measure is needed, particularly evaluating nonlinear indices, such as SD12.

  18. Update on Outcome Measure Development for Large Vessel Vasculitis: Report from OMERACT 12

    PubMed Central

    Aydin, Sibel Zehra; Direskeneli, Haner; Sreih, Antoine; Alibaz-Oner, Fatma; Gul, Ahmet; Kamali, Sevil; Hatemi, Gulen; Kermani, Tanaz; Mackie, Sarah L.; Mahr, Alfred; Meara, Alexa; Milman, Nataliya; Nugent, Heidi; Robson, Joanna; Tomasson, Gunnar; Merkel, Peter A.

    2015-01-01

    Objective The rarity of large vessel vasculitis (LVV) is a major factor limiting randomized controlled trials in LVV, resulting in treatment choices in these diseases that are guided mainly by observational studies and expert opinion. Further complicating trials in LVV is the absence of validated and meaningful outcome measures. The Outcome Measures in Rheumatology (OMERACT) vasculitis working group initiated the Large Vessel Vasculitis task force in 2009 to develop data-driven, validated outcome tools for clinical investigation in LVV. This report summarizes the progress that has been made on a disease activity assessment tool and patient-reported outcomes in LVV as well as the group’s research agenda. Methods The OMERACT LVV task force brought an international group of investigators and patient research partners together to work collaboratively on developing outcome tools. The group initially focused on disease activity assessment tools in LVV. Following a systematic literature review, an international Delphi exercise was conducted to obtain expert opinion on principles and domains for disease assessment. The OMERACT vasculitis working group’s LVV task force is also conducting qualitative research with patients, including interviews, focus groups, and engaging patients as research partners, all to ensure that the approach to disease assessment includes measures of patients’ perspectives and that patients have input into the research agenda and process. Results The preliminary results of both the Delphi exercise and the qualitative interviews were discussed at the OMERACT 12 (2014) meeting and the completion of the analyses will produce an initial set of domains and instruments to form the basis of next steps in the research agenda. Conclusion The research agenda continues to evolve, with the ultimate goal of developing an OMERACT-endorsed core set of outcome measures for use in clinical trials of LVV. PMID:26077399

  19. Patient-reported outcome measures in burning mouth syndrome - a review of the literature.

    PubMed

    Ni Riordain, R; McCreary, C

    2013-04-01

    Oral Diseases (2013) 19, 230-235 This review aims to investigate the patient-reported outcomes currently used in the burning mouth syndrome literature and to explore whether any standardisation of such measures has taken place. Electronic databases were searched for all types of burning mouth syndrome studies using patient-reported outcome measures. Studies were selected by predefined inclusion criteria. Copies of the papers obtained were thoroughly reviewed. A study-specific data extraction form was used, allowing papers to be reviewed in a standardised manner. The initial literature search yielded a total of 173 citations, 43 of which were deemed suitable for inclusion in this study. Symptom severity and symptomatic relief were reported as a patient-reported outcome measure in 40 of the studies and quantified most commonly using a visual analogue scale. Quality of life was reported in 13 studies included in this review. Depression and/or anxiety was reported in 14 of the studies. As is evident from the variety of questionnaires and instruments used in the evaluation of the impact of burning mouth syndrome on patients' lives, no standardisation of patient outcomes has yet been achieved. © 2012 John Wiley & Sons A/S.

  20. Development of an outcome measurement system for service planning for children and youth with special needs

    PubMed Central

    Kertoy, M K; Russell, D J; Rosenbaum, P; Jaffer, S; Law, M; McCauley, D; Gorter, J W

    2013-01-01

    Aim This study described the process used in developing an outcome measurement framework for system planning to improve services for children and youth with special needs and their families in a Canadian province. The study reports the results of several parent-completed measures, which would be useful in service planning as well as the acceptability and utility of these measures for use by families and service centres. Methods/results Development of a theoretical framework, consultation with key stakeholders, testing the utility of selected outcome measures and initial dissemination of results were critical elements in the successful development of an outcome system. Consultation with stakeholders confirmed use of the International Classification of Functioning, Disability and Health and the child-within-family-within community model as theoretical frameworks while building valuable partnerships and identifying potential barriers to implementation. Pilot testing showed three outcome measures were feasible for families to complete and the measures provided information about services for children that was valuable to families as well as service providers. Gaps in service delivery were identified and the need for better communication between service providers and communities to facilitate integrated services was highlighted. Conclusion The findings from this study can be used to implement an outcome measurement system for children with special needs and may serve as a resource for international researchers who are working to develop valid tools as well as outcome systems that are useful for system planning. PMID:22845889

  1. The King's Outcome Scale for Childhood Head Injury and Injury Severity and Outcome Measures in Children with Traumatic Brain Injury

    ERIC Educational Resources Information Center

    Calvert, Sophie; Miller, Helen E.; Curran, Andrew; Hameed, Biju; McCarter, Renee; Edwards, Richard J.; Hunt, Linda; Sharples, Peta Mary

    2008-01-01

    The aim of this study was to relate discharge King's Outcome Scale for Childhood Head Injury (KOSCHI) category to injury severity and detailed outcome measures obtained in the first year post-traumatic brain injury (TBI). We used a prospective cohort study. Eighty-one children with TBI were studied: 29 had severe, 15 moderate, and 37 mild TBI. The…

  2. Establishing a Core Outcome Measure for Graft Health: a Standardized Outcomes in Nephrology - Kidney Transplantation (SONG-Tx) Consensus Workshop Report.

    PubMed

    Tong, Allison; Sautenet, Benedicte; Poggio, Emilio D; Lentine, Krista L; Oberbauer, Rainer; Mannon, Roslyn; Murphy, Barbara; Padilla, Benita; Chow, Kai Ming; Marson, Lorna; Chadban, Steve; Craig, Jonathan C; Ju, Angela; Manera, Karine E; Hanson, Camilla S; Josephson, Michelle A; Knoll, Greg

    2018-02-22

    Graft loss, a critically important outcome for transplant recipients, is variably defined and measured, and incompletely reported in trials. We convened a consensus workshop on establishing a core outcome measure for graft loss for all trials in kidney transplantation. Twenty-five kidney transplant recipients/caregivers and 33 health professionals from eight countries participated. Transcripts were analyzed thematically. Five themes were identified. "Graft loss as a continuum" conceptualizes graft loss as a process, but requiring an endpoint defined as a discrete event. In "defining an event with precision and accuracy," loss of graft function requiring chronic dialysis (minimum 90 days) provided an objective and practical definition; re-transplant would capture preemptive transplantation; relisting was readily measured but would overestimate graft loss; and allograft nephrectomy was redundant in being preceded by dialysis. However, the thresholds for renal replacement therapy varied. Conservative management was regarded as too ambiguous and complex to use routinely. "Distinguishing death-censored graft loss" would ensure clarity and meaningfulness in interpreting results. "Consistent reporting for decision-making" by specifying time points and metrics (ie time to event) was suggested. "Ease of ascertainment and data collection" of the outcome from registries could support use of registry data to efficiently extend follow-up of trial participants. A practical and meaningful core outcome measure for graft loss may be defined as chronic dialysis or re-transplant, and distinguished from loss due to death. Consistent reporting of graft loss using standardized metrics and time points may improve the contribution of trials to decision-making in kidney transplantation.

  3. The Search for an Early Intervention Outcome Measurement Tool in Autism

    ERIC Educational Resources Information Center

    Fletcher-Watson, S.; McConachie, H.

    2017-01-01

    Evidence is accumulating that early intervention can be effective in improving the skills of young children with autism spectrum disorder. However, the science is hampered by the lack of agreed "gold standard" tools for the measurement of progress and outcome. What is required is a reliable, valid, and sensitive measure of change in the…

  4. Dignity Impact as a Primary Outcome Measure for Dignity Therapy.

    PubMed

    Scarton, Lisa; Oh, Sungho; Sylvera, Ashley; Lamonge, Ralph; Yao, Yingwei; Chochinov, Harvey; Fitchett, George; Handzo, George; Emanuel, Linda; Wilkie, Diana

    2018-01-01

    Feasibility of dignity therapy (DT) is well established in palliative care. Evidence of its efficacy, however, has been inconsistent and may stem from DT's primary effects differing from the outcomes measured in previous studies. We proposed that DT effects were in the spiritual domain and created a new outcome measure, Dignity Impact Scale (DIS), from items previously used in a large randomized controlled trial (RCT). The purpose of this secondary analysis study was to examine properties of a new measure of dignity impact. Using the DIS, we conducted reanalysis of posttest data from a large 3-arm, multi-site RCT study. Participants were receiving hospice/palliative care (n = 326, 50.6% female, mean age = 65.1 years, 89.3% white, all with a terminal illness with 6 months or less life expectancy). They had been randomized to standard palliative care (n = 111), client-centered care (n = 107), or DT (n = 108). The 7-item DIS was derived from selected items in a posttest DT Patient Feedback Questionnaire. The DIS had strong internal consistency (α = 0.85). The DT group mean DIS score (21.4 ± 5.0) was significantly higher than the usual care group mean score (17.7 ± 5.5; t = 5.2, df = 216, P < .001) and a client-centered intervention group mean score (17.9 ± 4.9; t = 5.2, df = 213, P < .001). We found that, compared to both other groups, patients who received DT reported significantly higher DIS ratings, which is consistent with the DT focus on meaning-making, preparation for death, and life completion tasks. We propose that the DIS be used as the primary outcome measure in evaluating the effects of DT.

  5. K-12 Postsecondary Alignment and School Accountability: Investigating High School Responses to California's Early Assessment Program

    ERIC Educational Resources Information Center

    Jackson, Jacob; Kurlaender, Michal

    2016-01-01

    State K-12 assessments may soon include measures for college readiness, as California's already do. We seek to understand how California's Early Assessment Program (EAP, designed to assess high school juniors' college readiness in English and math) may have influenced overall school-level college readiness and state accountability outcomes. Using…

  6. Use of outcome measures in pulmonary hypertension clinical trials.

    PubMed

    Parikh, Kishan S; Rajagopal, Sudarshan; Arges, Kristine; Ahmad, Tariq; Sivak, Joseph; Kaul, Prashant; Shah, Svati H; Tapson, Victor; Velazquez, Eric J; Douglas, Pamela S; Samad, Zainab

    2015-09-01

    To evaluate the use of surrogate measures in pulmonary hypertension (PH) clinical trials and how it relates to clinical practice. Studies of pulmonary arterial hypertension (PAH) employ a variety of surrogate measures in addition to clinical events because of a small patient population, participant burden, and costs. The use of these measures in PH drug trials is poorly defined. We searched PubMed/MEDLINE/Embase for randomized or prospective cohort PAH clinical treatment trials from 1985 to 2013. Extracted data included intervention, trial duration, study design, patient characteristics, and primary and secondary outcome measures. To compare with clinical practice, we assessed the use of surrogate measures in a clinical sample of patients on PH medications at Duke University Medical Center between 2003 and 2014. Between 1985 and 2013, 126 PAH trials were identified and analyzed. Surrogate measures served as primary endpoints in 119 trials (94.0%). Inclusion of invasive hemodynamics decreased over time (78.6%, 75.0%, 52.2%; P for trend = .02), while functional testing (7.1%, 60.0%, 81.5%; P for trend < .0001) and functional status or quality of life (0%, 47.6%, 62.8%; P for trend < .0001) increased in PAH trials over the same time periods. Echocardiography data were reported as a primary or secondary outcome in 32 trials (25.4%) with increased use from 1985-1994 to 1995-2004 (7.1% vs 35.0%, P = .04), but the trend did not continue to 2005-2013 (25.0%). In comparison, among 450 patients on PAH therapies at our institution between 2003 and 2013, clinical assessments regularly incorporated serial echocardiography and 6-minute walk distance tests (92% and 95% of patients, respectively) and repeat measurement of invasive hemodynamics (46% of patients). The majority of PAH trials have utilized surrogate measures as primary endpoints. The use of these surrogate endpoints has evolved significantly over time with increasing use of patient-centered endpoints and decreasing or

  7. Outcome-driven thresholds for home blood pressure measurement: international database of home blood pressure in relation to cardiovascular outcome.

    PubMed

    Niiranen, Teemu J; Asayama, Kei; Thijs, Lutgarde; Johansson, Jouni K; Ohkubo, Takayoshi; Kikuya, Masahiro; Boggia, José; Hozawa, Atsushi; Sandoya, Edgardo; Stergiou, George S; Tsuji, Ichiro; Jula, Antti M; Imai, Yutaka; Staessen, Jan A

    2013-01-01

    The lack of outcome-driven operational thresholds limits the clinical application of home blood pressure (BP) measurement. Our objective was to determine an outcome-driven reference frame for home BP measurement. We measured home and clinic BP in 6470 participants (mean age, 59.3 years; 56.9% women; 22.4% on antihypertensive treatment) recruited in Ohasama, Japan (n=2520); Montevideo, Uruguay (n=399); Tsurugaya, Japan (n=811); Didima, Greece (n=665); and nationwide in Finland (n=2075). In multivariable-adjusted analyses of individual subject data, we determined home BP thresholds, which yielded 10-year cardiovascular risks similar to those associated with stages 1 (120/80 mm Hg) and 2 (130/85 mm Hg) prehypertension, and stages 1 (140/90 mm Hg) and 2 (160/100 mm Hg) hypertension on clinic measurement. During 8.3 years of follow-up (median), 716 cardiovascular end points, 294 cardiovascular deaths, 393 strokes, and 336 cardiac events occurred in the whole cohort; in untreated participants these numbers were 414, 158, 225, and 194, respectively. In the whole cohort, outcome-driven systolic/diastolic thresholds for the home BP corresponding with stages 1 and 2 prehypertension and stages 1 and 2 hypertension were 121.4/77.7, 127.4/79.9, 133.4/82.2, and 145.4/86.8 mm Hg; in 5018 untreated participants, these thresholds were 118.5/76.9, 125.2/79.7, 131.9/82.4, and 145.3/87.9 mm Hg, respectively. Rounded thresholds for stages 1 and 2 prehypertension and stages 1 and 2 hypertension amounted to 120/75, 125/80, 130/85, and 145/90 mm Hg, respectively. Population-based outcome-driven thresholds for home BP are slightly lower than those currently proposed in hypertension guidelines. Our current findings could inform guidelines and help clinicians in diagnosing and managing patients.

  8. Defining Outcome Measures for Psoriasis: The IDEOM Report from the GRAPPA 2016 Annual Meeting.

    PubMed

    Callis Duffin, Kristina; Gottlieb, Alice B; Merola, Joseph F; Latella, John; Garg, Amit; Armstrong, April W

    2017-05-01

    The International Dermatology Outcome Measures (IDEOM) psoriasis working group was established to develop core domains and measurements sets for psoriasis clinical trials and ultimately clinical practice. At the 2016 annual meeting of the Group for Research and Assessment of Psoriasis and Psoriatic Arthritis, the IDEOM psoriasis group presented an overview of its progress toward developing this psoriasis core domain set. First, it summarized the February 2016 meeting of all involved with the IDEOM, highlighting patient and payer perspectives on outcome measures. Second, the group presented an overview of the consensus process for developing the core domain set for psoriasis, including previous literature reviews, nominal group exercises, and meeting discussions. Future plans include the development of working groups to review candidate measures for at least 2 of the domains, including primary pathophysiologic manifestations and patient-reported outcomes, and Delphi surveys to gain consensus on the final psoriasis core domain set.

  9. Engaging the hearts and minds of clinicians in outcome measurement – the UK rehabilitation outcomes collaborative approach

    PubMed Central

    2012-01-01

    Purpose This article explores the rationale for choosing the instruments included within the UK Rehabilitation Outcomes Collaborative (UKROC) data set. Using one specialist neuro-rehabilitation unit as an exemplar service, it describes an approach to engaging the hearts and minds of clinicians in recording the data. Key messages and implications Measures included within a national data set for rehabilitation should be psychometrically robust and feasible to use in routine clinical practice; they should also support clinical decision-making so that clinicians actually want to use them. Learning from other international casemix models and benchmarking data sets, the UKROC team has developed a cluster of measures to inform the development of effective and cost-efficient rehabilitation services. These include measures of (1) “needs” for rehabilitation (complexity), (2) inputs provided to meet those needs (nursing and therapy intervention), and (3) outcome, including the attainment of personal goals as well as gains in functional independence. Conclusions By integrating the use of the data set measures in everyday clinical practice, we have achieved a very high rate of compliance with data collection. However, staff training and ongoing commitment from senior staff and managers are critical to the maintenance of effort required to provide assurance of data quality in the longer term. PMID:22506959

  10. Standardizing patient-reported outcomes assessment in cancer clinical trials: a patient-reported outcomes measurement information system initiative.

    PubMed

    Garcia, Sofia F; Cella, David; Clauser, Steven B; Flynn, Kathryn E; Lad, Thomas; Lai, Jin-Shei; Reeve, Bryce B; Smith, Ashley Wilder; Stone, Arthur A; Weinfurt, Kevin

    2007-11-10

    Patient-reported outcomes (PROs), such as symptom scales or more broad-based health-related quality-of-life measures, play an important role in oncology clinical trials. They frequently are used to help evaluate cancer treatments, as well as for supportive and palliative oncology care. To be most beneficial, these PROs must be relevant to patients and clinicians, valid, and easily understood and interpreted. The Patient-Reported Outcomes Measurement Information System (PROMIS) Network, part of the National Institutes of Health Roadmap Initiative, aims to improve appreciably how PROs are selected and assessed in clinical research, including clinical trials. PROMIS is establishing a publicly available resource of standardized, accurate, and efficient PRO measures of major self-reported health domains (eg, pain, fatigue, emotional distress, physical function, social function) that are relevant across chronic illnesses including cancer. PROMIS is also developing measures of self-reported health domains specifically targeted to cancer, such as sleep/wake function, sexual function, cognitive function, and the psychosocial impacts of the illness experience (ie, stress response and coping; shifts in self-concept, social interactions, and spirituality). We outline the qualitative and quantitative methods by which PROMIS measures are being developed and adapted for use in clinical oncology research. At the core of this activity is the formation and application of item banks using item response theory modeling. We also present our work in the fatigue domain, including a short-form measure, as a sample of PROMIS methodology and work to date. Plans for future validation and application of PROMIS measures are discussed.

  11. Advancing Measurement of Locomotor Rehabilitation Outcomes to Optimize Interventions and Differentiate between Recovery versus Compensation

    PubMed Central

    Bowden, Mark G.; Behrman, Andrea L.; Woodbury, Michelle; Gregory, Chris M.; Velozo, Craig A.; Kautz, Steven A.

    2017-01-01

    Progress in locomotor rehabilitation has created an increasing need to understand the factors that contribute to motor behavior, to determine whether these factors are modifiable, and if so, to determine how best to modify them in a way that promotes improved function. Currently available measures do not have the capacity to distinguish between neuromotor recovery and compensation for impaired underlying body structure/functions. The purpose of this Special Interest article is to examine the state of outcomes measurement in physical therapy in regards outcomes to locomotor rehabilitation, and to suggest approaches that may improve assessment of recovery and clinical decision-making capabilities. We examine historical approaches to measurement of locomotor rehabilitation outcomes including rating scales, timed movement tasks, and laboratory-based outcome measures, and we discuss the emerging use of portable technology to assess walking in a free living environment. The ability to accurately measure outcomes of rehabilitation, both in and away from the laboratory setting, allows assessment of skill acquisition, retention, and long-term carryover in a variety of environments. Accurate measurement allows behavioral changes to be observed and assessments to be made, not only regarding an individual's ability to adapt during interventions, but also their ability to incorporate new skills into a real-world behavior. The result of such an approach to assessment may be that interventions truly translate from laboratory to real-world environments. Future locomotor measurement tools must be based on a theoretical framework that can guide their use to accurately quantify treatment effects and provide a basis upon which to develop and refine therapeutic interventions. PMID:22333921

  12. Food away from home and body mass outcomes: taking heterogeneity into account enhances quality of results.

    PubMed

    Kim, Tae Hyun; Lee, Eui-Kyung; Han, Euna

    2014-09-01

    The aim of this study was to explore the heterogeneous association of consumption of food away from home (FAFH) with individual body mass outcomes including body mass index and waist circumference over the entire conditional distribution of each outcome. Information on 16,403 adults obtained from nationally representative data on nutrition and behavior in Korea was used. A quantile regression model captured the variability of the association of FAFH with body mass outcomes across the entire conditional distribution of each outcome measure. Heavy FAFH consumption was defined as obtaining ≥1400 kcal from FAFH on a single day. Heavy FAFH consumption, specifically at full-service restaurants, was significantly associated with higher body mass index (+0.46 kg/m2 at the 50th quantile, 0.55 at the 75th, 0.66 at the 90th, and 0.44 at the 95th) and waist circumference (+0.96 cm at the 25th quantile, 1.06 cm at the 50th, 1.35 cm at the 75th, and 0.96 cm at the 90th quantiles) with overall larger associations at higher quantiles. Findings of the study indicate that conventional regression methods may mask important heterogeneity in the association between heavy FAFH consumption and body mass outcomes. Further public health efforts are needed to improve the nutritional quality of affordable FAFH choices and nutrition education and to establish a healthy food consumption environment. Copyright © 2014 Elsevier Inc. All rights reserved.

  13. OMERACT Filter Evidence Supporting the Measurement of At-work Productivity Loss as an Outcome Measure in Rheumatology Research.

    PubMed

    Beaton, Dorcas E; Dyer, Sarah; Boonen, Annelies; Verstappen, Suzanne M M; Escorpizo, Reuben; Lacaille, Diane V; Bosworth, Ailsa; Gignac, Monique A M; Leong, Amye; Purcaru, Oana; Leggett, Sarah; Hofstetter, Cathy; Peterson, Ingemar F; Tang, Kenneth; Fautrel, Bruno; Bombardier, Claire; Tugwell, Peter S

    2016-01-01

    Indicators of work role functioning (being at work, and being productive while at work) are important outcomes for persons with arthritis. As the worker productivity working group at OMERACT (Outcome Measures in Rheumatology), we sought to provide an evidence base for consensus on standardized instruments to measure worker productivity [both absenteeism and at-work productivity (presenteeism) as well as critical contextual factors]. Literature reviews and primary studies were done and reported to the OMERACT 12 (2014) meeting to build the OMERACT Filter 2.0 evidence for worker productivity outcome measurement instruments. Contextual factor domains that could have an effect on scores on worker productivity instruments were identified by nominal group techniques, and strength of influence was further assessed by literature review. At OMERACT 9 (2008), we identified 6 candidate measures of absenteeism, which received 94% endorsement at the plenary vote. At OMERACT 11 (2012) we received over the required minimum vote of 70% for endorsement of 2 at-work productivity loss measures. During OMERACT 12 (2014), out of 4 measures of at-work productivity loss, 3 (1 global; 2 multiitem) received support as having passed the OMERACT Filter with over 70% of the plenary vote. In addition, 3 contextual factor domains received a 95% vote to explore their validity as core contextual factors: nature of work, work accommodation, and workplace support. Our current recommendations for at-work productivity loss measures are: WALS (Workplace Activity Limitations Scale), WLQ PDmod (Work Limitations Questionnaire with modified physical demands scale), WAI (Work Ability Index), WPS (Arthritis-specific Work Productivity Survey), and WPAI (Work Productivity and Activity Impairment Questionnaire). Our future research focus will shift to confirming core contextual factors to consider in the measurement of worker productivity.

  14. Diversity and Social Justice Implications for Outcome Approaches to Evaluation

    ERIC Educational Resources Information Center

    Arthur, Nancy; Lalande, Vivian

    2009-01-01

    It is important that counsellors provide evidence regarding the efficacy of their services. Although there has been an increased focus on generic outcome measurement of counselling programs and services, little attention has been paid to accountability issues for meeting the needs of diverse populations. This article highlights the increasing…

  15. Worker productivity outcome measures: OMERACT filter evidence and agenda for future research.

    PubMed

    Tang, Kenneth; Boonen, Annelies; Verstappen, Suzanne M M; Escorpizo, Reuben; Luime, Jolanda J; Lacaille, Diane; Fautrel, Bruno; Bosworth, Ailsa; Cifaldi, Mary; Gignac, Monique A M; Hofstetter, Cathy; Leong, Amye; Montie, Pam; Petersson, Ingemar F; Purcaru, Oana; Bombardier, Claire; Tugwell, Peter S; Beaton, Dorcas E

    2014-01-01

    The objective of the Outcome Measures in Rheumatology (OMERACT) Worker Productivity working group is to identify worker productivity outcome measures that meet the requirements of the OMERACT filter. At the OMERACT 11 Workshop, we focused on the at-work limitations/productivity component of worker productivity (i.e., presenteeism) - an area with diverse conceptualization and instrumentation approaches. Various approaches to quantify at-work limitations/productivity (e.g., single-item global and multi-item measures) were examined, and available evidence pertaining to OMERACT truth, discrimination, and feasibility were presented to conference participants. Four candidate global measures of presenteeism were put forth for a plenary vote to determine whether current evidence meets the OMERACT filter requirements. Presenteeism globals from the Work Productivity and Activity Impairment Questionnaire (72% support) and Rheumatoid Arthritis-specific Work Productivity Survey (71% support) were endorsed by conference participants; however, neither the presenteeism global item from the Health and Work Performance Questionnaire nor the Quantity and Quality method achieved the level of support required for endorsement at the present time. The plenary was also asked whether the central item from the Work Ability Index should also be considered as a candidate measure for potential endorsement in the future. Of participants at the plenary, 70% supported this presenteeism global measure. Progress was also made in other areas through discussions at individual breakout sessions. Topics examined include the merits of various multi-item measures of at-work limitations/productivity, methodological issues related to interpretability of outcome scores, and approaches to appraise and classify contextual factors of worker productivity. Feedback gathered from conference participants will inform the future research agenda of the working group.

  16. Discrimination in measures of knowledge monitoring accuracy

    PubMed Central

    Was, Christopher A.

    2014-01-01

    Knowledge monitoring predicts academic outcomes in many contexts. However, measures of knowledge monitoring accuracy are often incomplete. In the current study, a measure of students’ ability to discriminate known from unknown information as a component of knowledge monitoring was considered. Undergraduate students’ knowledge monitoring accuracy was assessed and used to predict final exam scores in a specific course. It was found that gamma, a measure commonly used as the measure of knowledge monitoring accuracy, accounted for a small, but significant amount of variance in academic performance whereas the discrimination and bias indexes combined to account for a greater amount of variance in academic performance. PMID:25339979

  17. Longitudinal Multicenter Analysis of Outcomes After Cessation of Control Measures for Vancomycin-Resistant Enterococci.

    PubMed

    Lemieux, Camille; Gardam, Michael; Evans, Gerald; John, Michael; Suh, Kathryn N; vanWalraven, Carl; Vicencio, Elisa; Coulby, Cameron; Roth, Virginia; Hota, Susy

    2017-01-01

    OBJECTIVE To assess clinically relevant outcomes after complete cessation of control measures for vancomycin-resistant enterococci (VRE). DESIGN Quasi-experimental ecological study over 3.5 years. METHODS All VRE screening and isolation practices at 4 large academic hospitals in Ontario, Canada, were stopped on July 1, 2012. In total, 618 anonymized abstracted charts of patients with VRE-positive clinical isolates identified between July 1, 2010, and December 31, 2013, were reviewed to determine whether the case was a true VRE infection, a VRE colonization or contaminant, or a true VRE bacteremia. All deaths within 30 days of the last VRE infection were also reviewed to determine whether the death was fully or partially attributable to VRE. All-cause mortality was evaluated over the study period. Generalized estimating equation methods were used to cluster outcome rates within hospitals, and negative binomial models were created for each outcome. RESULTS The incidence rate ratio (IRR) for VRE infections was 0.59 and the associated P value was .34. For VRE bacteremias, the IRR was 0.54 and P=.38; for all-cause mortality the IRR was 0.70 and P=.66; and for VRE attributable death, the IRR was 0.35 and P=.49. VRE control measures were not significantly associated with any of the outcomes. Rates of all outcomes appeared to increase during the 18-month period after cessation of VRE control measures, but none reached statistical significance. CONCLUSION Clinically significant VRE outcomes remain rare. Cessation of all control measures for VRE had no significant attributable adverse clinical impact. Infect Control Hosp Epidemiol 2016;1-7.

  18. Brief surgical procedure code lists for outcomes measurement and quality improvement in resource-limited settings.

    PubMed

    Liu, Charles; Kayima, Peter; Riesel, Johanna; Situma, Martin; Chang, David; Firth, Paul

    2017-11-01

    The lack of a classification system for surgical procedures in resource-limited settings hinders outcomes measurement and reporting. Existing procedure coding systems are prohibitively large and expensive to implement. We describe the creation and prospective validation of 3 brief procedure code lists applicable in low-resource settings, based on analysis of surgical procedures performed at Mbarara Regional Referral Hospital, Uganda's second largest public hospital. We reviewed operating room logbooks to identify all surgical operations performed at Mbarara Regional Referral Hospital during 2014. Based on the documented indication for surgery and procedure(s) performed, we assigned each operation up to 4 procedure codes from the International Classification of Diseases, 9th Revision, Clinical Modification. Coding of procedures was performed by 2 investigators, and a random 20% of procedures were coded by both investigators. These codes were aggregated to generate procedure code lists. During 2014, 6,464 surgical procedures were performed at Mbarara Regional Referral Hospital, to which we assigned 435 unique procedure codes. Substantial inter-rater reliability was achieved (κ = 0.7037). The 111 most common procedure codes accounted for 90% of all codes assigned, 180 accounted for 95%, and 278 accounted for 98%. We considered these sets of codes as 3 procedure code lists. In a prospective validation, we found that these lists described 83.2%, 89.2%, and 92.6% of surgical procedures performed at Mbarara Regional Referral Hospital during August to September of 2015, respectively. Empirically generated brief procedure code lists based on International Classification of Diseases, 9th Revision, Clinical Modification can be used to classify almost all surgical procedures performed at a Ugandan referral hospital. Such a standardized procedure coding system may enable better surgical data collection for administration, research, and quality improvement in resource

  19. The incremental value of self-reported mental health measures in predicting functional outcomes of veterans.

    PubMed

    Eisen, Susan V; Bottonari, Kathryn A; Glickman, Mark E; Spiro, Avron; Schultz, Mark R; Herz, Lawrence; Rosenheck, Robert; Rofman, Ethan S

    2011-04-01

    Research on patient-centered care supports use of patient/consumer self-report measures in monitoring health outcomes. This study examined the incremental value of self-report mental health measures relative to a clinician-rated measure in predicting functional outcomes among mental health service recipients. Participants (n = 446) completed the Behavior and Symptom Identification Scale, the Brief Symptom Inventory, and the Veterans/Rand Short Form-36 at enrollment in the study (T1) and 3 months later (T2). Global Assessment of Functioning (GAF) ratings, mental health service utilization, and psychiatric diagnoses were obtained from administrative data files. Controlling for demographic and clinical variables, results indicated that improvement based on the self-report measures significantly predicted one or more functional outcomes (i.e., decreased likelihood of post-enrollment psychiatric hospitalization and increased likelihood of paid employment), above and beyond the predictive value of the GAF. Inclusion of self-report measures may be a useful addition to performance measurement efforts.

  20. Definitions and Outcome Measures in Pediatric Functional Upper Gastrointestinal Tract Disorders: A Systematic Review.

    PubMed

    Nassar-Sheikh Rashid, Amara; Taminiau, Jan A; Benninga, Marc A; Saps, Miguel; Tabbers, Merit M

    2016-04-01

    Functional disorders of the upper gastrointestinal tract are frequently diagnosed in children. Four different clinical entities are addressed by the Rome III committee: functional dyspepsia (FD), cyclic vomiting syndrome (CVS), adolescent rumination syndrome (ARS), and aerophagia. Management of these disorders is often difficult leading to a wide variety in therapeutic interventions. We hypothesize that definitions and outcome measures in these studies are heterogeneous as well. Our aim is to systematically assess how these disorders and outcomes are defined in therapeutic randomized controlled trials (RCTs). CENTRAL, Embase, and MEDLINE/PubMed were searched from inception to February 25, 2015. Search terms were FD, CVS, ARS, and aerophagia. Therapeutic RCTs, or systematic reviews of RCTs, in English language including subjects ages 4 to 18 years (0-18 years for CVS) were evaluated. Quality was assessed using the Delphi list. A total of 1398 articles were found of which 8 articles were included. Seven concerned FD and 1 concerned CVS. In all of the studies, Rome criteria or similar definitions were used; all the studies however used different outcome measures. Seventy-five percent of the trials were of good methodological quality. Only 57% used validated pain scales. Different outcome measures are used in therapeutic trials on functional disorders of the upper gastrointestinal tract. There is a clear paucity of trials evaluating different treatment regimens regarding CVS, ARS, and aerophagia. Uniform definitions, outcome measures, and validated instruments are needed to make a comparison between intervention studies possible.

  1. No common denominator: a review of outcome measures in IVF RCTs.

    PubMed

    Wilkinson, Jack; Roberts, Stephen A; Showell, Marian; Brison, Daniel R; Vail, Andy

    2016-12-01

    Which outcome measures are reported in RCTs for IVF? Many combinations of numerator and denominator are in use, and are often employed in a manner that compromises the validity of the study. The choice of numerator and denominator governs the meaning, relevance and statistical integrity of a study's results. RCTs only provide reliable evidence when outcomes are assessed in the cohort of randomised participants, rather than in the subgroup of patients who completed treatment. Review of outcome measures reported in 142 IVF RCTs published in 2013 or 2014. Trials were identified by searching the Cochrane Gynaecology and Fertility Specialised Register. English-language publications of RCTs reporting clinical or preclinical outcomes in peer-reviewed journals in the period 1 January 2013 to 31 December 2014 were eligible. Reported numerators and denominators were extracted. Where they were reported, we checked to see if live birth rates were calculated correctly using the entire randomised cohort or a later denominator. Over 800 combinations of numerator and denominator were identified (613 in no more than one study). No single outcome measure appeared in the majority of trials. Only 22 (43%) studies reporting live birth presented a calculation including all randomised participants or only excluding protocol violators. A variety of definitions were used for key clinical numerators: for example, a consensus regarding what should constitute an ongoing pregnancy does not appear to exist at present. Several of the included articles may have been secondary publications. Our categorisation scheme was essentially arbitrary, so the frequencies we present should be interpreted with this in mind. The analysis of live birth denominators was post hoc. There is massive diversity in numerator and denominator selection in IVF trials due to its multistage nature, and this causes methodological frailty in the evidence base. The twin spectres of outcome reporting bias and analysis of non

  2. The STarT Back Screening Tool and Individual Psychological Measures: Evaluation of Prognostic Capabilities for Low Back Pain Clinical Outcomes in Outpatient Physical Therapy Settings

    PubMed Central

    Bishop, Mark D.; Fritz, Julie M.; Robinson, Michael E.; Asal, Nabih R.; Nisenzon, Anne N.

    2013-01-01

    disability at 6 months. Limitations Physical therapy treatment was not standardized or accounted for in the analysis. Conclusions Prediction of clinical outcomes by psychology-based measures was dependent upon the clinical outcome domain of interest. Similar to studies from the primary care setting, initial screening with the SBT provided additional prognostic information for 6-month disability and changes in SBT overall scores may provide important clinical decision-making information for treatment monitoring. PMID:23125279

  3. An Approach to Improving the Learning Experience for First Year Accounting Curriculum

    ERIC Educational Resources Information Center

    Kirkham, Ross

    2013-01-01

    The purpose of this paper is to present a theoretical model to address design and assessment of accounting practice sets that will enhance learning and provide clearer learning outcomes for first year accounting students. The paper explores extant literature in developing an action plan that can be followed to maximise learning outcomes for first…

  4. The Other Side of Accountability: Measuring Students' Use of Facilities and Opportunities. AIR Forum 1979 Paper.

    ERIC Educational Resources Information Center

    Pace, C. Robert

    A set of measures was developed to assess the quality of student effort in the utilization of the facilities and opportunities available in the college setting. The measures are based on the assumption that students are accountable for the amount, scope, and quality of effort they invest in using the available resources for their learning and…

  5. Patient-reported outcomes (PROs): the significance of using humanistic measures in clinical trial and clinical practice.

    PubMed

    Refolo, P; Minacori, R; Mele, V; Sacchini, D; Spagnolo, A G

    2012-10-01

    Patient-reported outcome (PRO) is an "umbrella term" that covers a whole range of potential types of measurement but it is used specifically to refer to all measures quantifying the state of health through the evaluation of outcomes reported by the patient himself/herself. PROs are increasingly seen as complementary to biomedical measures and they are being incorporated more frequently into clinical trials and clinical practice. After considering the cultural background of PROs - that is the well known patient-centered model of medicine -, their historical profile (since 1914, the year of the first outcome measure) and typologies, the paper aims at debating their methodological complexity and implementation into practice. Some clinical trials and therapeutic managements utilizing patient-centered measures will be also analyzed.

  6. Actigraphy scoring for sleep outcome measures in chronic obstructive pulmonary disease.

    PubMed

    Kapella, Mary C; Vispute, Sachin; Zhu, Bingqian; Herdegen, James J

    2017-09-01

    Actigraphy is commonly used to measure sleep outcomes so that sleep can be measured conveniently at home over multiple nights. Actigraphy has been validated in people with sleep disturbances; however, the validity of scoring settings in people with chronic medical illnesses such as chronic obstructive pulmonary disease remains unclear. The purpose of this secondary analysis was to compare actigraphy-customized scoring settings with polysomnography (PSG) for the measurement of sleep outcomes in people with chronic obstructive pulmonary disease who have insomnia. Participants underwent overnight sleep assessment simultaneously by PSG and actigraphy at the University of Illinois of Chicago Sleep Science Center. Fifty participants (35 men and 15 women) with mild-to-severe chronic obstructive pulmonary disease and co-existing insomnia were included in the analysis. Sleep onset latency, total sleep time (TST), wake after sleep onset (WASO), and sleep efficiency (SE) were calculated independently from data derived from PSG and actigraphy. Actigraphy sleep outcome scores obtained at the default setting and several customized actigraphy settings were compared to the scored PSG results. Although no single setting was optimal for all sleep outcomes, the combination of 10 consecutive immobile minutes for sleep onset or end and an activity threshold of 10 worked well. Actigraphy overestimated TST and SE and underestimated WASO, but there was no difference in variance between PSG and actigraphy in TST and SE when the 10 × 10 combination was used. As the average TST and SE increased, the agreement between PSG and actigraphy appeared to increase, and as the average WASO decreased, the agreement between PSG and actigraphy appeared to increase. Results support the conclusion that the default actigraphy settings may not be optimal for people with chronic obstructive pulmonary disease and co-existing insomnia. Copyright © 2017 The Author(s). Published by Elsevier B.V. All rights

  7. Measurement properties of the Health of the Nation Outcome Scales (HoNOS) family of measures: protocol for a systematic review.

    PubMed

    Harris, Meredith G; Sparti, Claudia; Scheurer, Roman; Coombs, Tim; Pirkis, Jane; Ruud, Torleif; Kisely, Steve; Hanssen-Bauer, Ketil; Siqveland, Johan; Burgess, Philip M

    2018-04-20

    The Health of the Nation Outcome Scales (HoNOS) for adults, and equivalent measures for children and adolescents and older people, are widely used in clinical practice and research contexts to measure mental health and functional outcomes. Additional HoNOS measures have been developed for special populations and applications. Stakeholders require synthesised information about the measurement properties of these measures to assess whether they are fit for use with intended service settings and populations and to establish performance benchmarks. This planned systematic review will critically appraise evidence on the measurement properties of the HoNOS family of measures. Journal articles meeting inclusion criteria will be identified via a search of seven electronic databases: MEDLINE via EBSCOhost, PsycINFO via APA PsycNET, Embase via Elsevier, Cumulative Index to Nursing and Allied Health Literature via EBSCOhost, Web of Science via Thomson Reuters, Google Scholar and the Cochrane Library. Variants of 'Health of the Nation Outcome Scales' or 'HoNOS' will be searched as text words. No restrictions will be placed on setting or language of publication. Reference lists of relevant studies and reviews will be scanned for additional eligible studies. Appraisal of reliability, validity, responsiveness and interpretability will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Feasibility/utility will be appraised using definitions and criteria derived from previous reviews. For reliability studies, we will also apply the Guidelines for Reporting Reliability and Agreement Studies to assess quality of reporting. Results will be synthesised narratively, separately for each measure, and by subgroup (eg, treatment setting, rater profession/experience or training) where possible. Meta-analyses will be undertaken where data are adequate. Ethics approval is not required as no primary data will be collected. Outcomes will be

  8. Measurement properties of the Health of the Nation Outcome Scales (HoNOS) family of measures: protocol for a systematic review

    PubMed Central

    Harris, Meredith G; Sparti, Claudia; Scheurer, Roman; Coombs, Tim; Pirkis, Jane; Ruud, Torleif; Kisely, Steve; Hanssen-Bauer, Ketil; Siqveland, Johan; Burgess, Philip M

    2018-01-01

    Introduction The Health of the Nation Outcome Scales (HoNOS) for adults, and equivalent measures for children and adolescents and older people, are widely used in clinical practice and research contexts to measure mental health and functional outcomes. Additional HoNOS measures have been developed for special populations and applications. Stakeholders require synthesised information about the measurement properties of these measures to assess whether they are fit for use with intended service settings and populations and to establish performance benchmarks. This planned systematic review will critically appraise evidence on the measurement properties of the HoNOS family of measures. Methods and analysis Journal articles meeting inclusion criteria will be identified via a search of seven electronic databases: MEDLINE via EBSCOhost, PsycINFO via APA PsycNET, Embase via Elsevier, Cumulative Index to Nursing and Allied Health Literature via EBSCOhost, Web of Science via Thomson Reuters, Google Scholar and the Cochrane Library. Variants of ‘Health of the Nation Outcome Scales’ or ‘HoNOS’ will be searched as text words. No restrictions will be placed on setting or language of publication. Reference lists of relevant studies and reviews will be scanned for additional eligible studies. Appraisal of reliability, validity, responsiveness and interpretability will be guided by the COnsensus-based Standards for the selection of health Measurement INstruments checklist. Feasibility/utility will be appraised using definitions and criteria derived from previous reviews. For reliability studies, we will also apply the Guidelines for Reporting Reliability and Agreement Studies to assess quality of reporting. Results will be synthesised narratively, separately for each measure, and by subgroup (eg, treatment setting, rater profession/experience or training) where possible. Meta-analyses will be undertaken where data are adequate. Ethics and dissemination Ethics approval is

  9. Investigating ESL Students' Performance on Outcomes Assessments in Higher Education

    ERIC Educational Resources Information Center

    Lakin, Joni M.; Elliott, Diane Cardenas; Liu, Ou Lydia

    2012-01-01

    Outcomes assessments are gaining great attention in higher education because of increased demand for accountability. These assessments are widely used by U.S. higher education institutions to measure students' college-level knowledge and skills, including students who speak English as a second language (ESL). For the past decade, the increasing…

  10. Alzheimer Disease Biomarkers as Outcome Measures for Clinical Trials in MCI.

    PubMed

    Caroli, Anna; Prestia, Annapaola; Wade, Sara; Chen, Kewei; Ayutyanont, Napatkamon; Landau, Susan M; Madison, Cindee M; Haense, Cathleen; Herholz, Karl; Reiman, Eric M; Jagust, William J; Frisoni, Giovanni B

    2015-01-01

    The aim of this study was to compare the performance and power of the best-established diagnostic biological markers as outcome measures for clinical trials in patients with mild cognitive impairment (MCI). Magnetic resonance imaging, F-18 fluorodeoxyglucose positron emission tomography markers, and Alzheimer's Disease Assessment Scale-cognitive subscale were compared in terms of effect size and statistical power over different follow-up periods in 2 MCI groups, selected from Alzheimer's Disease Neuroimaging Initiative data set based on cerebrospinal fluid (abnormal cerebrospinal fluid Aβ1-42 concentration-ABETA+) or magnetic resonance imaging evidence of Alzheimer disease (positivity to hippocampal atrophy-HIPPO+). Biomarkers progression was modeled through mixed effect models. Scaled slope was chosen as measure of effect size. Biomarkers power was estimated using simulation algorithms. Seventy-four ABETA+ and 51 HIPPO+ MCI patients were included in the study. Imaging biomarkers of neurodegeneration, especially MR measurements, showed highest performance. For all biomarkers and both MCI groups, power increased with increasing follow-up time, irrespective of biomarker assessment frequency. These findings provide information about biomarker enrichment and outcome measurements that could be employed to reduce MCI patient samples and treatment duration in future clinical trials.

  11. Recommendations for a first Core Outcome Measurement set for complex regional PAin syndrome Clinical sTudies (COMPACT)

    PubMed Central

    Grieve, Sharon; Perez, Roberto SGM; Birklein, Frank; Brunner, Florian; Bruehl, Stephen; Harden R, Norman; Packham, Tara; Gobeil, Francois; Haigh, Richard; Holly, Janet; Terkelsen, Astrid; Davies, Lindsay; Lewis, Jennifer; Thomassen, Ilona; Connett, Robyn; Worth, Tina; Vatine, Jean-Jacques; McCabe, Candida S

    2017-01-01

    Complex Regional Pain Syndrome (CRPS) is a persistent pain condition that remains incompletely understood and challenging to treat. Historically, a wide range of different outcome measures have been used to capture the multidimensional nature of CRPS. This has been a significant limiting factor in the advancement of our understanding of the mechanisms and management of CRPS. In 2013, an international consortium of patients, clinicians, researchers and industry representatives was established, to develop and agree on a minimum core set of standardised outcome measures for use in future CRPS clinical research, including but not limited to clinical trials within adult populations The development of a core measurement set was informed through workshops and supplementary work, using an iterative consensus process. ‘What is the clinical presentation and course of CRPS, and what factors influence it?’ was agreed as the most pertinent research question that our standardised set of patient-reported outcome measures should be selected to answer. The domains encompassing the key concepts necessary to answer the research question were agreed as: pain, disease severity, participation and physical function, emotional and psychological function, self efficacy, catastrophizing and patient's global impression of change. The final core measurement set included the optimum generic or condition-specific patient-reported questionnaire outcome measures, which captured the essence of each domain, and one clinician reported outcome measure to capture the degree of severity of CRPS. The next step is to test the feasibility and acceptability of collecting outcome measure data using the core measurement set in the CRPS population internationally. PMID:28178071

  12. Accounting for Posttraumatic Stress Disorder Symptom Severity With Pre- and Posttrauma Measures: A Longitudinal Study of Older Adults.

    PubMed

    Ogle, Christin M; Rubin, David C; Siegler, Ilene C

    2016-03-01

    Using data from a longitudinal study of community-dwelling older adults, we analyzed the most extensive set of known correlates of PTSD symptoms obtained from a single sample to examine the measures' independent and combined utility in accounting for PTSD symptom severity. Fifteen measures identified as PTSD risk factors in published meta-analyses and 12 theoretically and empirically supported individual difference and health-related measures were included. Individual difference measures assessed after the trauma, including insecure attachment and factors related to the current trauma memory, such as self-rated severity, event centrality, frequency of involuntary recall, and physical reactions to the memory, accounted for symptom severity better than measures of pre-trauma factors. In an analysis restricted to prospective measures assessed before the trauma, the total variance explained decreased from 56% to 16%. Results support a model of PTSD in which characteristics of the current trauma memory promote the development and maintenance of PTSD symptoms.

  13. Review of patient-reported outcome measures in chronic hepatitis C

    PubMed Central

    2012-01-01

    Background Chronic hepatitis C (CHC) and its treatment are associated with a variety of patient-reported symptoms and impacts. Some CHC symptoms and impacts may be difficult to evaluate through objective clinical testing, and more easily measured through patient self-report. This literature review identified concepts raised by CHC patients related to symptoms, impacts, and treatment effects, and evaluated integration of these concepts within patient-reported outcome (PRO) measures. The goal of this work was to provide recommendations for incorporation of PRO measurement of concepts that are relevant to the CHC experience into CHC clinical trial design. Methods A three-tiered literature search was conducted. This included searches on concepts of importance, PRO measures used in clinical trials, and existing PRO measures. The PRO Concept Search focused on reviewing issues raised by CHC patients about CHC symptoms, disease impact, and treatment effects. The CHC Trials with PRO Endpoints Search reviewed clinical trials with PRO endpoints to assess differences between treatments over time. The PRO Measure Search reviewed existing PRO measures associated with the concepts of interest. Results This multi-tiered approach identified five key concepts of interest: depression/anxiety, fatigue, flu-like symptoms, cognitive function, insomnia. Comparing these five concepts of interest to the PRO measures in published CHC clinical trials showed that, while treatment of CHC may decrease health-related quality of life in a number of mental and physical domains, the PRO measures that were utilized in published clinical trials inadequately covered the concepts of interest. Further review of 18 existing PRO measures of the concepts of interest showed only four of the 18 were validated in CHC populations. Conclusions This review identified several gaps in the literature regarding assessment of symptoms and outcomes reported as important by CHC patients. Further research is needed to

  14. Use of Outcome Measurement by Paediatric AHPs in Northern Ireland

    ERIC Educational Resources Information Center

    Harron, Anita; Titterington, Jill

    2016-01-01

    Background: Professional standards advocate routine use of outcome measurement (OM) in the practice of allied health professionals (AHPs). Historically, OM has focused on impairment and its immediate constraints on activity, while current policy encourages the development and addition of impact-based OM. There appears to be an assumption at this…

  15. Patient-reported outcomes in child and adolescent mental health services (CAMHS): use of idiographic and standardized measures.

    PubMed

    Wolpert, Miranda; Ford, Tamsin; Trustam, Emma; Law, Duncan; Deighton, Jessica; Flannery, Halina; Fugard, Andrew J B; Fugard, Rew J B

    2012-04-01

    There is increasing emphasis on use of patient-reported outcome measures (PROMs) in mental health but little research on the best approach, especially where there are multiple perspectives. To present emerging findings from both standardized and idiographic child-, parent- and clinician-rated outcomes in child and adolescent mental health services (CAMHS) and consider their correlations. Outcomes were collected in CAMHS across the UK. These comprised idiographic measures (goal-based outcomes) and standardized measures (practitioner-rated Children's Global Assessment Scale; child- and parent-rated Strengths and Difficulties Questionnaire). There was reliable positive change from the beginning of treatment to later follow-up according to all informants. Standardized clinician function report was correlated with standardized child difficulty report (r  =  - 0.26), standardized parent report (r  =  - 0.28) and idiographic joint client-determined goals (r  =  0.38) in the expected directions. These results suggest that routine outcome monitoring is feasible, and suggest the possibility of using jointly agreed idiographic measures alongside particular perspectives on outcome as part of a PROMs approach.

  16. Goal achievement as a patient‐generated outcome measure for stress urinary incontinence

    PubMed Central

    Milne, Jill L.; Robert, Magali; Tang, Selphee; Drummond, Neil; Ross, Sue

    2009-01-01

    Abstract Objectives  To explore women’s goals and goal attainment for the conservative and surgical treatment of stress urinary incontinence (SUI), and to examine the feasibility of Goal Attainment Scaling (GAS) as an outcome measure in this population. Background  Despite the range of treatments for SUI, little is known about the outcomes patients consider important. Current instruments measure the impact of SUI on the ability to live a ‘normal’ life without addressing what normal looks like for the patient. Patient‐generated measures that address what a patient aims to achieve may fill this gap. Design  A mixed‐methods exploratory design combined semi‐structured interviews with validated questionnaires and individualized rating of goal achievement. Setting and participants  Participants with SUI (n = 18) were interviewed in their homes prior to initiation of treatment and 3–6 months afterwards. Main variables  Participants reported individualized goals pre‐treatment and rated goal attainment after surgical and conservative therapy. Quality of life impact and change were measured using short forms of the Incontinence Impact Questionnaire and Urinary Distress Inventory. Results  Women expressed a median of four highly individualized treatment‐related goals but goal achievement following conservative treatment was poor. GAS was not feasible as an outcome measure; women readily identified personal goals but could not independently identify graded levels of attainment for each goal. Conclusions  Although further work is needed to examine the most feasible, valid, and reliable method of measuring goal achievement in research, asking patients with UI to identify pre‐treatment goals may provide useful information to guide treatment‐related decision making. PMID:19754692

  17. Evaluation of outcome measures for use in clinical practice for adults with musculoskeletal conditions of the knee: a systematic review.

    PubMed

    Howe, Tracey E; Dawson, Lesley J; Syme, Grant; Duncan, Louise; Reid, Judith

    2012-04-01

    This systematic review reported on the clinimetric properties of outcome measures for use in clinical practice for adults with musculoskeletal conditions of the knee. A systematic search was performed in Medline, EMBASE, Cinahl and AMED to identify studies examining the clinimetric properties of outcome measures for adults undergoing conservative treatment of ligament injuries, meniscal lesions, patellofemoral pain and osteoarthritis of the knee. Outcomes measures taking less than 20 min to administer and requiring minimal equipment and space were included. Pairs of authors used a checklist to record the characteristics of the outcome measures, their reported clinimetric properties and the demographics of the study populations. The OMERACT filters of 'truth' and 'discrimination' were applied to the data for each outcome measure by an expert panel. Forty-seven studies were included evaluating 37 outcome measures. Ten outcome measures had adequate supporting evidence for 'truth' and 'discrimination': AAOS, AKPS, goniometer measurement, IKDC, KOOS, LEFS, Lysholm, Tegner, WOMAC and WOMET. However none of the outcome measures had been comprehensively tested across all clinimetric properties. Despite the widespread use of some outcome measures in clinical practice and primary research, data on the clinimetric properties were available for only 37 and of these only 10 had adequate supporting evidence for use in this population. However, before a core set of outcome measures can be recommended use in clinical practice, for adults with musculoskeletal conditions of the knee, consensus should be obtained on 'feasibility' in terms of burden on the clinician and the participant. Copyright © 2011 Elsevier Ltd. All rights reserved.

  18. Are validated outcome measures used in distal radial fractures truly valid?

    PubMed Central

    Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

    2016-01-01

    Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the

  19. Implementing a statewide outcomes management system for consumers of public mental health services.

    PubMed

    Clardy, J A; Booth, B M; Smith, L G; Nordquist, C R; Smith, G R

    1998-02-01

    The authors describe the development and implementation of an outcomes management system designed to measure outcomes and processes of care for public mental health consumers in Arkansas. The public-academic project was implemented in 1995 and is based on the Shewhart-Deming model of continuous quality improvement. All 15 community mental health centers (CMHCs) in the state participate in the project, which prospectively measures longitudinal outcomes of care for the tracer conditions of major depression and schizophrenia. Multiperspective measurement tools are used to measure patients' psychiatric status and general health status at periodic intervals; information is gathered on functioning, symptoms, severity of illness, social factors, demographic characteristics, and quality of life. A problem encountered during implementation was the relatively low rate of referral of patients with the tracer conditions for monitoring. Voluntary rather than mandatory participation in the outcomes management system by the CMHCs as well as clinicians' misperceptions about the system's purpose and concerns about confidentiality may have partly accounted for the low rate.

  20. Accounting for quality: on the relationship between accounting and quality improvement in healthcare.

    PubMed

    Pflueger, Dane

    2015-04-23

    Accounting-that is, standardized measurement, public reporting, performance evaluation and managerial control-is commonly seen to provide the core infrastructure for quality improvement in healthcare. Yet, accounting successfully for quality has been a problematic endeavor, often producing dysfunctional effects. This has raised questions about the appropriate role for accounting in achieving quality improvement. This paper contributes to this debate by contrasting the specific way in which accounting is understood and operationalized for quality improvement in the UK National Health Service (NHS) with findings from the broadly defined 'social studies of accounting' literature and illustrative examples. This paper highlights three significant differences between the way that accounting is understood to operate in the dominant health policy discourse and recent healthcare reforms, and in the social studies of accounting literature. It shows that accounting does not just find things out, but makes them up. It shows that accounting is not simply a matter of substance, but of style. And it shows that accounting does not just facilitate, but displaces, control. The illumination of these differences in the way that accounting is conceptualized helps to diagnose why accounting interventions often fail to produce the quality improvements that were envisioned. This paper concludes that accounting is not necessarily incompatible with the ambition of quality improvement, but that it would need to be understood and operationalized in new ways in order to contribute to this end. Proposals for this new way of advancing accounting are discussed. They include the cultivation of overlapping and even conflicting measures of quality, the evaluation of accounting regimes in terms of what they do to practice, and the development of distinctively skeptical calculative cultures.

  1. The use of routine outcome measures in two child and adolescent mental health services: a completed audit cycle

    PubMed Central

    2013-01-01

    Background Routine outcome measurement (ROM) is important for assessing the clinical effectiveness of health services and for monitoring patient outcomes. Within Child and Adolescent Mental Health Services (CAMHS) in the UK the adoption of ROM in CAMHS has been supported by both national and local initiatives (such as government strategies, local commissioning policy, and research). Methods With the aim of assessing how these policies and initiatives may have influenced the uptake of ROM within two different CAMHS we report the findings of two case-note audits: a baseline audit conducted in January 2011 and a re-audit conducted two years later in December 2012-February 2013. Results The findings show an increase in both the single and repeated use of outcome measures from the time of the original audit, with repeated use (baseline and follow-up) of the Health of the Nation Outcome Scale for Children and Adolescents (HoNOSCA) scale increasing from 10% to 50% of cases. Re-audited case-notes contained more combined use of different outcome measures, with greater consensus on which measures to use. Outcome measures that were applicable across a wide range of clinical conditions were more likely to be used than symptom-specific measures, and measures that were completed by the clinician were found more often than measures completed by the service user. Conclusions The findings show a substantial improvement in the use of outcome measures within CAMHS. These increases in use were found across different service organisations which were subject to different types of local service priorities and drivers. PMID:24139139

  2. GASB's Basis of Accounting Project.

    ERIC Educational Resources Information Center

    Kovlak, Daniel L.

    1986-01-01

    In July 1984, the Governmental Accounting Standards Board began its "Measurement Focus/Basis of Accounting" project, which addresses measurement issues and revenue and expenditure recognition problems involving governmental funds. This article explains the project's background, alternatives discussed by the board, and tentative…

  3. Patient Reported Outcome Measure of Spiritual Care as Delivered by Chaplains.

    PubMed

    Snowden, Austyn; Telfer, Iain

    2017-01-01

    Chaplains are employed by health organizations around the world to support patients in recognizing and addressing their spiritual needs. There is currently no generalizable measure of the impact of these interventions and so the clinical and strategic worth of chaplaincy is difficult to articulate. This article introduces the Scottish PROM, an original five-item patient reported outcome measure constructed specifically to address this gap. It describes the validation process from its conceptual grounding in the spiritual care literature through face and content validity cycles. It shows that the Scottish PROM is internally consistent and unidimensional. Responses to the Scottish PROM show strong convergent validity with responses to the Warwick and Edinburgh Mental Well-Being Scale, a generic well-being scale often used as a proxy for spiritual well-being. In summary, the Scottish PROM is fit for purpose. It measures the outcomes of spiritual care as delivered by chaplains in this study. This novel project introduces an essential and original breakthrough; the possibility of generalizable international chaplaincy research.

  4. Peer pressure and public reporting within healthcare setting: improving accountability and health care quality in hospitals.

    PubMed

    Specchia, Maria Lucia; Veneziano, Maria Assunta; Cadeddu, Chiara; Ferriero, Anna Maria; Capizzi, Silvio; Ricciardi, Walter

    2012-01-01

    In the last few years, the need of public reporting of health outcomes has acquired a great importance. The public release of performance results could be a tool for improving health care quality and many attempts have been made in order to introduce public reporting programs within the health care context at different levels. It would be necessary to promote the introduction of a standardized set of outcome and performance measures in order to improve quality of health care services and to make health care providers aware of the importance of transparency and accountability.

  5. Patient-reported outcome measures in arthroplasty registries

    PubMed Central

    Bohm, Eric; Franklin, Patricia; Lyman, Stephen; Denissen, Geke; Dawson, Jill; Dunn, Jennifer; Eresian Chenok, Kate; Dunbar, Michael; Overgaard, Søren; Garellick, Göran; Lübbeke, Anne

    2016-01-01

    Abstract — The International Society of Arthroplasty Registries (ISAR) Patient-Reported Outcome Measures (PROMs) Working Group have evaluated and recommended best practices in the selection, administration, and interpretation of PROMs for hip and knee arthroplasty registries. The 2 generic PROMs in common use are the Short Form health surveys (SF-36 or SF-12) and EuroQol 5-dimension (EQ-5D). The Working Group recommends that registries should choose specific PROMs that have been appropriately developed with good measurement properties for arthroplasty patients. The Working Group recommend the use of a 1-item pain question (“During the past 4 weeks, how would you describe the pain you usually have in your [right/left] [hip/knee]?”; response: none, very mild, mild, moderate, or severe) and a single-item satisfaction outcome (“How satisfied are you with your [right/left] [hip/knee] replacement?”; response: very unsatisfied, dissatisfied, neutral, satisfied, or very satisfied). Survey logistics include patient instructions, paper- and electronic-based data collection, reminders for follow-up, centralized as opposed to hospital-based follow-up, sample size, patient- or joint-specific evaluation, collection intervals, frequency of response, missing values, and factors in establishing a PROMs registry program. The Working Group recommends including age, sex, diagnosis at joint, general health status preoperatively, and joint pain and function score in case-mix adjustment models. Interpretation and statistical analysis should consider the absolute level of pain, function, and general health status as well as improvement, missing data, approaches to analysis and case-mix adjustment, minimal clinically important difference, and minimal detectable change. The Working Group recommends data collection immediately before and 1 year after surgery, a threshold of 60% for acceptable frequency of response, documentation of non-responders, and documentation of incomplete or

  6. Presurgery resting-state local graph-theory measures predict neurocognitive outcomes after brain surgery in temporal lobe epilepsy.

    PubMed

    Doucet, Gaelle E; Rider, Robert; Taylor, Nathan; Skidmore, Christopher; Sharan, Ashwini; Sperling, Michael; Tracy, Joseph I

    2015-04-01

    This study determined the ability of resting-state functional connectivity (rsFC) graph-theory measures to predict neurocognitive status postsurgery in patients with temporal lobe epilepsy (TLE) who underwent anterior temporal lobectomy (ATL). A presurgical resting-state functional magnetic resonance imaging (fMRI) condition was collected in 16 left and 16 right TLE patients who underwent ATL. In addition, patients received neuropsychological testing pre- and postsurgery in verbal and nonverbal episodic memory, language, working memory, and attention domains. Regarding the functional data, we investigated three graph-theory properties (local efficiency, distance, and participation), measuring segregation, integration and centrality, respectively. These measures were only computed in regions of functional relevance to the ictal pathology, or the cognitive domain. Linear regression analyses were computed to predict the change in each neurocognitive domain. Our analyses revealed that cognitive outcome was successfully predicted with at least 68% of the variance explained in each model, for both TLE groups. The only model not significantly predictive involved nonverbal episodic memory outcome in right TLE. Measures involving the healthy hippocampus were the most common among the predictors, suggesting that enhanced integration of this structure with the rest of the brain may improve cognitive outcomes. Regardless of TLE group, left inferior frontal regions were the best predictors of language outcome. Working memory outcome was predicted mostly by right-sided regions, in both groups. Overall, the results indicated our integration measure was the most predictive of neurocognitive outcome. In contrast, our segregation measure was the least predictive. This study provides evidence that presurgery rsFC measures may help determine neurocognitive outcomes following ATL. The results have implications for refining our understanding of compensatory reorganization and predicting

  7. Absolute and proportional measures of potential markers of rehearsal, and their implications for accounts of its development

    PubMed Central

    Jarrold, Christopher; Danielsson, Henrik; Wang, Xiaoli

    2015-01-01

    Previous studies of the development of phonological similarity and word length effects in children have shown that these effects are small or absent in young children, particularly when measured using visual presentation of the memoranda. This has often been taken as support for the view that young children do not rehearse. The current paper builds on recent evidence that instead suggests that absent phonological similarity and word length effects in young children reflects the same proportional cost of these effects in children of all ages. Our aims are to explore the conditions under which this proportional scaling account can reproduce existing developmental data, and in turn suggest ways that future studies might measure and model phonological similarity and word length effects in children. To that end, we first fit a single mathematical function through previously reported data that simultaneously captures absent and negative proportional effects of phonological similarity in young children plus constant proportional similarity effects in older children. This developmental function therefore provides the benchmark that we seek to re-produce in a series of subsequent simulations that test the proportional scaling account. These simulations reproduce the developmental function well, provided that they take into account the influence of floor effects and of measurement error. Our simulations suggest that future empirical studies examining these effects in the context of the development of rehearsal need to take into account proportional scaling. They also provide a demonstration of how proportional costs can be explored, and of the possible developmental functions associated with such an analysis. PMID:25852615

  8. Initial constructs for patient-centered outcome measures to evaluate brain-computer interfaces.

    PubMed

    Andresen, Elena M; Fried-Oken, Melanie; Peters, Betts; Patrick, Donald L

    2016-10-01

    The authors describe preliminary work toward the creation of patient-centered outcome (PCO) measures to evaluate brain-computer interface (BCI) as an assistive technology (AT) for individuals with severe speech and physical impairments (SSPI). In Phase 1, 591 items from 15 existing measures were mapped to the International Classification of Functioning, Disability and Health (ICF). In Phase 2, qualitative interviews were conducted with eight people with SSPI and seven caregivers. Resulting text data were coded in an iterative analysis. Most items (79%) were mapped to the ICF environmental domain; over half (53%) were mapped to more than one domain. The ICF framework was well suited for mapping items related to body functions and structures, but less so for items in other areas, including personal factors. Two constructs emerged from qualitative data: quality of life (QOL) and AT. Component domains and themes were identified for each. Preliminary constructs, domains and themes were generated for future PCO measures relevant to BCI. Existing instruments are sufficient for initial items but do not adequately match the values of people with SSPI and their caregivers. Field methods for interviewing people with SSPI were successful, and support the inclusion of these individuals in PCO research. Implications for Rehabilitation Adapted interview methods allow people with severe speech and physical impairments to participate in patient-centered outcomes research. Patient-centered outcome measures are needed to evaluate the clinical implementation of brain-computer interface as an assistive technology.

  9. Faustmann and the forestry tradition of outcome-based performance measures

    Treesearch

    Peter J. Ince

    1999-01-01

    The concept of land expectation value developed by Martin Faustmann may serve as a paradigm for outcome-based performance measures in public forest management if the concept of forest equity value is broadened to include social and environmental benefits and costs, and sustainability. However, anticipation and accurate evaluation of all benefits and costs appears to...

  10. Handbook on Measurement, Assessment, and Evaluation in Higher Education

    ERIC Educational Resources Information Center

    Secolsky, Charles, Ed.; Denison, D. Brian, Ed.

    2011-01-01

    Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The "Handbook on Measurement, Assessment, and Evaluation in Higher Education" provides higher…

  11. Creating Measurement and Accountability Systems for 21st Century Schools: A Guide for State Policymakers

    ERIC Educational Resources Information Center

    Osborne, David

    2016-01-01

    Since Congress has passed the Every Student Succeeds Act (ESSA) states are revamping their federally required systems to measure school quality and hold schools accountable for performance. However, most are doing so using outdated assumptions, holdovers from the Industrial Era, when cookie-cutter public schools followed orders from central…

  12. The importance of patient-reported outcome measures in reconstructive urology.

    PubMed

    Jackson, Matthew J; N'Dow, James; Pickard, Rob

    2010-11-01

    Patient-reported outcome measures (PROMs) are now recognised as the most appropriate instruments to assess the effectiveness of healthcare interventions from the patient's perspective. The purpose of this review was to identify recent publications describing the use of PROMs following reconstructive urological surgery. A wide systematic search identified only three original articles published in the last 2 years that prospectively assessed effectiveness using a patient-completed condition-specific or generic health-related quality of life (HRQoL) instrument. These publications illustrate the need to administer PROMs at a postoperative interval relevant to the anticipated recovery phase of individual procedures. They also highlight the difference in responsiveness of generic HRQoL instruments to symptomatic improvement between straightforward conditions such as pelviureteric junction obstruction and complex multidimensional conditions such as meningomyelocele. PROMs uptake and awareness is increasing in reconstructive urology but more work is required to demonstrate the effectiveness of surgical procedures for patients and healthcare funders alike. Healthcare policy-makers now rely on these measures to determine whether specific treatments are worth financing and to compare outcomes between institutions.

  13. Developing a General Outcome Measure of Growth in Movement for Infants and Toddlers.

    ERIC Educational Resources Information Center

    Greenwood, Charles R.; Luze, Gayle J.; Cline, Gabriel; Kuntz, Susan; Leitschuh, Carol

    2002-01-01

    The development of an experimental measure for assessing growth in movement in children (ages birth-3) is described. Results from the use of the Movement General Outcome Measurement with 29 infants and toddlers demonstrated the feasibility of the measure. The 6-minute assessment was found reliable in terms of inter-observer agreement. (Contains…

  14. Accounting for Occurrences: A New View of the Use of Contingency Information in Causal Judgment

    ERIC Educational Resources Information Center

    White, Peter A.

    2008-01-01

    When people make causal judgments from contingency information, a principal aim is to account for occurrences of the outcome. When 2 causes are under consideration, the capacity of either to account for occurrences is judged from how likely the cause is to be present when the outcome occurs and from the rate at which the outcome occurs when that…

  15. Measuring the attitudes of dental students towards social accountability following dental education - Qualitative findings.

    PubMed

    Chen, Vivian; Foster Page, Lyndie; McMillan, John; Lyons, Karl; Gibson, Barry

    2016-06-01

    The term social accountability has gained increased interest in medical education, but is relatively unexplored in dentistry. The aim of this study is to explore dental students' attitudes towards social accountability. A qualitative study utilizing focus groups with University of Otago final year (5th year) Bachelor of Dental Surgery (BDS) students was carried out. A questionnaire designed to measure medical students' attitudes towards social responsibility was used as a guide. Following data collection, framework analysis was used to analyze each of the three focus groups, and repeating themes were noted. Analysis of the focus groups discovered recurring themes, such that participants believed that dentists should be accountable to society in a professional context and that they are responsible for patients who present at their clinic but that there is no professional obligation to help reduce oral health inequalities by working with populations facing inequalities. There was strong agreement that there needs to be change to the dental health care system from a structural and political level to address oral health inequalities, rather than individual dentists assuming greater responsibility. Our findings show that dental education may not be accountable to society in the sense that it is not producing graduates who believe that they have an obligation to address the priority oral health concerns of society.

  16. Current Status, Goals, and Research Agenda for Outcome Measures Development in Behçet Syndrome: Report from OMERACT 2014.

    PubMed

    Hatemi, Gulen; Ozguler, Yesim; Direskeneli, Haner; Mahr, Alfred; Gul, Ahmet; Levi, Virna; Aydin, Sibel Z; Mumcu, Gonca; Sertel-Berk, Ozlem; Stevens, Randall M; Yazici, Hasan; Merkel, Peter A

    2015-12-01

    There is an unmet need for reliable, validated, and widely accepted outcomes and outcome measures for use in clinical trials in Behçet syndrome (BS). Our report summarizes initial steps taken by the Outcome Measures in Rheumatology (OMERACT) vasculitis working group toward developing a core set of outcome measures for BS according to the OMERACT methodology, including the OMERACT Filter 2.0, and discussions during the first meeting of the BS working group held during OMERACT 12 (2014). During OMERACT 12, some of the important challenges in developing outcomes for BS were outlined and discussed, and a research agenda was drafted. Among topics discussed were the advantages and disadvantages of a composite measure for BS that evaluates several organs/organ systems; bringing patients and physicians together for discussions about how to assess disease activity; use of organ-specific measures developed for other diseases; and the inclusion of generic, disease-specific, or organ-specific measures. The importance of incorporating patients' perspectives, concerns, and ideas into outcome measure development was emphasized. The planned research agenda includes conducting a Delphi exercise among physicians from different specialties that are involved in the care of patients with BS and among patients with BS, with the aim of identifying candidate domains and subdomains to be assessed in randomized clinical trials of BS, and candidate items for a composite measure. The ultimate goal of the group is to develop a validated and widely accepted core set of outcomes and outcome measures for use in clinical trials in BS.

  17. Current Status, Goals, and Research Agenda for Outcome Measures Development in Behçet Syndrome: Report from OMERACT 2014

    PubMed Central

    Hatemi, Gulen; Ozguler, Yesim; Direskeneli, Haner; Mahr, Alfred; Gul, Ahmet; Levi, Virna; Aydin, Sibel Z.; Mumcu, Gonca; Sertel-Berk, Ozlem; Stevens, Randall M.; Yazici, Hasan; Merkel, Peter A.

    2016-01-01

    Objective There is an unmet need for reliable, validated, and widely accepted outcomes and outcome measures for use in clinical trials in Behçet syndrome (BS). Our report summarizes initial steps taken by the Outcome Measures in Rheumatology (OMERACT) vasculitis working group toward developing a core set of outcome measures for BS according to the OMERACT methodology, including the OMERACT Filter 2.0, and discussions during the first meeting of the BS working group held during OMERACT 12 (2014). Methods During OMERACT 12, some of the important challenges in developing outcomes for BS were outlined and discussed, and a research agenda was drafted. Results Among topics discussed were the advantages and disadvantages of a composite measure for BS that evaluates several organs/organ systems; bringing patients and physicians together for discussions about how to assess disease activity; use of organ-specific measures developed for other diseases; and the inclusion of generic, disease-specific, or organ-specific measures. The importance of incorporating patients’ perspectives, concerns, and ideas into outcome measure development was emphasized. Conclusion The planned research agenda includes conducting a Delphi exercise among physicians from different specialties that are involved in the care of patients with BS and among patients with BS, with the aim of identifying candidate domains and subdomains to be assessed in randomized clinical trials of BS, and candidate items for a composite measure. The ultimate goal of the group is to develop a validated and widely accepted core set of outcomes and outcome measures for use in clinical trials in BS. PMID:26373563

  18. Comparison of IKDC and SANE Outcome Measures Following Knee Injury in Active Female Patients

    PubMed Central

    Winterstein, Andrew P.; McGuine, Timothy A.; Carr, Kathleen E.; Hetzel, Scott J.

    2013-01-01

    Background: Knee injury among young, active female patients remains a public health issue. Clinicians are called upon to pay greater attention to patient-oriented outcomes to evaluate the impact of these injuries. Little agreement exists on which outcome measures are best, and clinicians cite several barriers to their use. Single Assessment Numerical Evaluation (SANE) may provide meaningful outcome information while lessening the time burden associated with other patient-oriented measures. Hypothesis: The SANE and International Knee Documentation Committee (IKDC) scores would be strongly correlated in a cohort of young active female patients with knee injuries from preinjury through 1-year follow-up and that a minimal clinically important difference (MCID) could be calculated for the SANE score. Study Design: Observational prospective cohort. Methods: Two hundred sixty-three subjects completed SANE and IKDC at preinjury by recall, time of injury, and 3, 6, and 12 months postinjury. Pearson correlation coefficients were used to assess the association between SANE and IKDC. Repeated-measures analysis of variance was used to determine differences in SANE and IKDC over time. MCID was calculated for SANE using IKDC MCID as an anchor. Results: Moderate to strong correlations were seen between SANE and IKDC (0.65-0.83). SANE, on average, was 2.7 (95% confidence interval, 1.5-3.9; P < 0.00) units greater than IKDC over all time points. MCID for the SANE was calculated as 7 for a 6-month follow-up and 19 for a 12-month follow-up. Conclusion: SANE scores were moderately to strongly correlated to IKDC scores across all time points. Reported MCID values for the SANE should be utilized to measure meaningful changes over time for young, active female patients with knee injuries. Clinical Relevance: Providing clinicians with patient-oriented outcome measures that can be obtained with little clinician and patient burden may allow for greater acceptance and use of outcome measures

  19. An International Collaborative Standardizing a Comprehensive Patient-Centered Outcomes Measurement Set for Colorectal Cancer.

    PubMed

    Zerillo, Jessica A; Schouwenburg, Maartje G; van Bommel, Annelotte C M; Stowell, Caleb; Lippa, Jacob; Bauer, Donna; Berger, Ann M; Boland, Gilles; Borras, Josep M; Buss, Mary K; Cima, Robert; Van Cutsem, Eric; van Duyn, Eino B; Finlayson, Samuel R G; Hung-Chun Cheng, Skye; Langelotz, Corinna; Lloyd, John; Lynch, Andrew C; Mamon, Harvey J; McAllister, Pamela K; Minsky, Bruce D; Ngeow, Joanne; Abu Hassan, Muhammad R; Ryan, Kim; Shankaran, Veena; Upton, Melissa P; Zalcberg, John; van de Velde, Cornelis J; Tollenaar, Rob

    2017-05-01

    Global health systems are shifting toward value-based care in an effort to drive better outcomes in the setting of rising health care costs. This shift requires a common definition of value, starting with the outcomes that matter most to patients. The International Consortium for Health Outcomes Measurement (ICHOM), a nonprofit initiative, was formed to define standard sets of outcomes by medical condition. In this article, we report the efforts of ICHOM's working group in colorectal cancer. The working group was composed of multidisciplinary oncology specialists in medicine, surgery, radiation therapy, palliative care, nursing, and pathology, along with patient representatives. Through a modified Delphi process during 8 months (July 8, 2015 to February 29, 2016), ICHOM led the working group to a consensus on a final recommended standard set. The process was supported by a systematic PubMed literature review (1042 randomized clinical trials and guidelines from June 3, 2005, to June 3, 2015), a patient focus group (11 patients with early and metastatic colorectal cancer convened during a teleconference in August 2015), and a patient validation survey (among 276 patients with and survivors of colorectal cancer between October 15, 2015, and November 4, 2015). After consolidating findings of the literature review and focus group meeting, a list of 40 outcomes was presented to the WG and underwent voting. The final recommendation includes outcomes in the following categories: survival and disease control, disutility of care, degree of health, and quality of death. Selected case-mix factors were recommended to be collected at baseline to facilitate comparison of results across treatments and health care professionals. A standardized set of patient-centered outcome measures to inform value-based health care in colorectal cancer was developed. Pilot efforts are under way to measure the standard set among members of the working group.

  20. A dynamic quality assessment tool for laparoscopic hysterectomy to measure surgical outcomes.

    PubMed

    Driessen, Sara R C; Van Zwet, Erik W; Haazebroek, Pascal; Sandberg, Evelien M; Blikkendaal, Mathijs D; Twijnstra, Andries R H; Jansen, Frank Willem

    2016-12-01

    The current health care system has an urgent need for tools to measure quality. A wide range of quality indicators have been developed in an attempt to differentiate between high-quality and low-quality health care processes. However, one of the main issues of currently used indicators is the lack of case-mix correction and improvement possibilities. Case-mix is defined as specific (patient) characteristics that are known to potentially affect (surgical) outcome. If these characteristics are not taken into consideration, comparisons of outcome among health care providers may not be valid. The objective of the study was to develop and test a quality assessment tool for laparoscopic hysterectomy, which can serve as a new outcome quality indicator. This is a prospective, international, multicenter implementation study. A web-based application was developed with 3 main goals: (1) to measure the surgeon's performance using 3 primary outcomes (blood loss, operative time, and complications); (2) to provide immediate individual feedback using cumulative observed-minus-expected graphs; and (3) to detect consistently suboptimal performance after correcting for case-mix characteristics. All gynecologists who perform laparoscopic hysterectomies were requested to register their procedures in the application. A patient safety risk factor checklist was used by the surgeon for reflection. Thereafter a prospective implementation study was performed, and the application was tested using a survey that included the System Usability Scale. A total of 2066 laparoscopic hysterectomies were registered by 81 gynecologists. Mean operative time was 100 ± 39 minutes, blood loss 127 ± 163 mL, and the complication rate 6.1%. The overall survey response rate was 75%, and the mean System Usability Scale was 76.5 ± 13.6, which indicates that the application was good to excellent. The majority of surgeons reported that the application made them more aware of their performance, the outcomes, and

  1. Development of indicators for measuring outcomes of water safety plans

    PubMed Central

    Lockhart, Gabriella; Oswald, William E.; Hubbard, Brian; Medlin, Elizabeth; Gelting, Richard J.

    2015-01-01

    Water safety plans (WSPs) are endorsed by the World Health Organization as the most effective method of protecting a water supply. With the increase in WSPs worldwide, several valuable resources have been developed to assist practitioners in the implementation of WSPs, yet there is still a need for a practical and standardized method of evaluating WSP effectiveness. In 2012, the Centers for Disease Control and Prevention (CDC) published a conceptual framework for the evaluation of WSPs, presenting four key outcomes of the WSP process: institutional, operational, financial and policy change. In this paper, we seek to operationalize this conceptual framework by providing a set of simple and practical indicators for assessing WSP outcomes. Using CDC’s WSP framework as a foundation and incorporating various existing performance monitoring indicators for water utilities, we developed a set of approximately 25 indicators of institutional, operational, financial and policy change within the WSP context. These outcome indicators hold great potential for the continued implementation and expansion of WSPs worldwide. Having a defined framework for evaluating a WSP’s effectiveness, along with a set of measurable indicators by which to carry out that evaluation, will help implementers assess key WSP outcomes internally, as well as benchmark their progress against other WSPs in their region and globally. PMID:26361540

  2. Measuring Stress Before and During Pregnancy: A Review of Population-Based Studies of Obstetric Outcomes

    PubMed Central

    Witt, Whitney; Litzelman, Kristin; Cheng, Erika R; Wakeel, Fathima; Barker, Emily S.

    2013-01-01

    Objectives Mounting evidence from clinic and convenience samples suggests that stress is an important predictor of adverse obstetric outcomes. Using a proposed theoretical framework, this review identified and synthesized the population-based literature on the measurement of stress prior to and during pregnancy in relation to obstetric outcomes. Methods Population-based, peer-reviewed empirical articles that examined stress prior to or during pregnancy in relation to obstetric outcomes were identified in the PubMed and PsycInfo databases. Articles were evaluated to determine the domain(s) of stress (environmental, psychological, and/or biological), period(s) of stress (preconception and/or pregnancy), and strength of the association between stress and obstetric outcomes. Results Thirteen studies were evaluated. The identified studies were all conducted in developed countries. The majority of studies examined stress only during pregnancy (n=10); three examined stress during both the preconception and pregnancy periods (n=3). Most studies examined the environmental domain (e.g., life events) only (n=9), two studies examined the psychological domain only, and two studies examined both. No study incorporated a biological measure of stress. Environmental stressors before and during pregnancy were associated with worse obstetric outcomes, although some conflicting findings exist. Conclusions Few population-based studies have examined stress before or during pregnancy in relation to obstetric outcomes. Although considerable variation exists in the measurement of stress across studies, environmental stress increased the risk for poor obstetric outcomes. Additional work using a lifecourse approach is needed to fill the existing gaps in the literature and to develop a more comprehensive understanding of the mechanisms by which stress impacts obstetric outcomes. PMID:23447085

  3. Considerations for analysis of time-to-event outcomes measured with error: Bias and correction with SIMEX.

    PubMed

    Oh, Eric J; Shepherd, Bryan E; Lumley, Thomas; Shaw, Pamela A

    2018-04-15

    For time-to-event outcomes, a rich literature exists on the bias introduced by covariate measurement error in regression models, such as the Cox model, and methods of analysis to address this bias. By comparison, less attention has been given to understanding the impact or addressing errors in the failure time outcome. For many diseases, the timing of an event of interest (such as progression-free survival or time to AIDS progression) can be difficult to assess or reliant on self-report and therefore prone to measurement error. For linear models, it is well known that random errors in the outcome variable do not bias regression estimates. With nonlinear models, however, even random error or misclassification can introduce bias into estimated parameters. We compare the performance of 2 common regression models, the Cox and Weibull models, in the setting of measurement error in the failure time outcome. We introduce an extension of the SIMEX method to correct for bias in hazard ratio estimates from the Cox model and discuss other analysis options to address measurement error in the response. A formula to estimate the bias induced into the hazard ratio by classical measurement error in the event time for a log-linear survival model is presented. Detailed numerical studies are presented to examine the performance of the proposed SIMEX method under varying levels and parametric forms of the error in the outcome. We further illustrate the method with observational data on HIV outcomes from the Vanderbilt Comprehensive Care Clinic. Copyright © 2017 John Wiley & Sons, Ltd.

  4. Development of a Core Set of Outcome Measures for Large-vessel Vasculitis: Report from OMERACT 2016.

    PubMed

    Sreih, Antoine G; Alibaz-Oner, Fatma; Kermani, Tanaz A; Aydin, Sibel Z; Cronholm, Peter F; Davis, Trocon; Easley, Ebony; Gul, Ahmet; Mahr, Alfred; McAlear, Carol A; Milman, Nataliya; Robson, Joanna C; Tomasson, Gunnar; Direskeneli, Haner; Merkel, Peter A

    2017-12-01

    Among the challenges in conducting clinical trials in large-vessel vasculitis (LVV), including both giant cell arteritis (GCA) and Takayasu arteritis (TA), is the lack of standardized and meaningful outcome measures. The Outcome Measures in Rheumatology (OMERACT) Vasculitis Working Group initiated an international effort to develop and validate data-driven outcome tools for clinical investigation in LVV. An international Delphi exercise was completed to gather opinions from clinical experts on LVV-related domains considered important to measure in trials. Patient interviews and focus groups were completed to identify outcomes of importance to patients. The results of these activities were presented and discussed in a "Virtual Special Interest Group" using telephone- and Internet-based conferences, discussions through electronic mail, and an in-person session at the 2016 OMERACT meeting. A preliminary core set of domains common for all forms of LVV with disease-specific elements was proposed. The majority of experts agree with using common outcome measures for GCA and TA, with the option of supplementation with disease-specific items. Following interviews and focus groups, pain, fatigue, and emotional effect emerged as health-related quality of life domains important to patients. Current disease assessment tools, including the Birmingham Vasculitis Activity Score, were found to be inadequate to assess disease activity in GCA and standardized assessment of imaging tests were felt crucial to study LVV, especially TA. Initial data from a clinician Delphi exercise and structured patient interviews have provided themes toward an OMERACT-endorsed core set of domains and outcome measures.

  5. A critical appraisal of instruments to measure outcomes of interprofessional education.

    PubMed

    Oates, Matthew; Davidson, Megan

    2015-04-01

    Interprofessional education (IPE) is believed to prepare health professional graduates for successful collaborative practice. A range of instruments have been developed to measure the outcomes of IPE. An understanding of the psychometric properties of these instruments is important if they are to be used to measure the effectiveness of IPE. This review set out to identify instruments available to measure outcomes of IPE and collaborative practice in pre-qualification health professional students and to critically appraise the psychometric properties of validity, responsiveness and reliability against contemporary standards for instrument design. Instruments were selected from a pool of extant instruments and subjected to critical appraisal to determine whether they satisfied inclusion criteria. The qualitative and psychometric attributes of the included instruments were appraised using a checklist developed for this review. Nine instruments were critically appraised, including the widely adopted Readiness for Interprofessional Learning Scale (RIPLS) and the Interdisciplinary Education Perception Scale (IEPS). Validity evidence for instruments was predominantly based on test content and internal structure. Ceiling effects and lack of scale width contribute to the inability of some instruments to detect change in variables of interest. Limited reliability data were reported for two instruments. Scale development and scoring protocols were generally reported by instrument developers, but the inconsistent application of scoring protocols for some instruments was apparent. A number of instruments have been developed to measure outcomes of IPE in pre-qualification health professional students. Based on reported validity evidence and reliability data, the psychometric integrity of these instruments is limited. The theoretical test construction paradigm on which instruments have been developed may be contributing to the failure of some instruments to detect change in

  6. Use of and confidence in administering outcome measures among clinical prosthetists: Results from a national survey and mixed-methods training program.

    PubMed

    Gaunaurd, Ignacio; Spaulding, Susan E; Amtmann, Dagmar; Salem, Rana; Gailey, Robert; Morgan, Sara J; Hafner, Brian J

    2015-08-01

    Outcome measures can be used in prosthetic practices to evaluate interventions, inform decision making, monitor progress, document outcomes, and justify services. Strategies to enhance prosthetists' ability to use outcome measures are needed to facilitate their adoption in routine practice. To assess prosthetists' use of outcome measures and evaluate the effects of training on their confidence in administering performance-based measures. Cross-sectional and single-group pretest-posttest survey. Seventy-nine certified prosthetists (mean of 16.0 years of clinical experience) were surveyed about their experiences with 20 standardized outcome measures. Prosthetists were formally trained by the investigators to administer the Timed Up and Go and Amputee Mobility Predictor. Prosthetists' confidence in administering the Timed Up and Go and Amputee Mobility Predictor was measured before and after training. The majority of prosthetists (62%) were classified as non-routine outcome measure users. Confidence administering the Timed Up and Go and Amputee Mobility Predictor prior to training was low-to-moderate across the study sample. Training significantly (p < 0.0001) improved prosthetists' confidence in administering both instruments. Prosthetists in this study reported limited use of and confidence with standardized outcome measures. Interactive training resulted in a statistically significant increase of prosthetists' confidence in administering the Timed Up and Go and Amputee Mobility Predictor and may facilitate use of outcome measures in clinical practice. Frequency of outcome measure use in the care of persons with limb loss has not been studied. Study results suggest that prosthetists may not regularly use standardized outcome measures and report limited confidence in administering them. Training enhances confidence and may encourage use of outcome measures in clinical practice. © The International Society for Prosthetics and Orthotics 2014.

  7. A Systematic Review and Meta-Analysis of a Measure of Staff/Child Interaction Quality (the Classroom Assessment Scoring System) in Early Childhood Education and Care Settings and Child Outcomes.

    PubMed

    Perlman, Michal; Falenchuk, Olesya; Fletcher, Brooke; McMullen, Evelyn; Beyene, Joseph; Shah, Prakesh S

    2016-01-01

    The quality of staff/child interactions as measured by the Classroom Assessment Scoring System (CLASS) in Early Childhood Education and Care (ECEC) programs is thought to be important for children's outcomes. The CLASS is made of three domains that assess Emotional Support, Classroom Organization and Instructional Support. It is a relatively new measure that is being used increasingly for research, quality monitoring/accountability and other applied purposes. Our objective was to evaluate the association between the CLASS and child outcomes. Searches of Medline, PsycINFO, ERIC, websites of large datasets and reference sections of all retrieved articles were conducted up to July 3, 2015. Studies that measured association between the CLASS and child outcomes for preschool-aged children who attended ECEC programs were included after screening by two independent reviewers. Searches and data extraction were conducted by two independent reviewers. Thirty-five studies were systematically reviewed of which 19 provided data for meta-analyses. Most studies had moderate to high risk of bias. Of the 14 meta-analyses we conducted, associations between Classroom Organization and Pencil Tapping and between Instructional Support and SSRS Social Skills were significant with pooled correlations of .06 and .09 respectively. All associations were in the expected direction. In the systematic review, significant correlations were reported mainly from one large dataset. Substantial heterogeneity in use of the CLASS, its dimensions, child outcomes and statistical measures was identified. Greater consistency in study methodology is urgently needed. Given the multitude of factors that impact child development it is encouraging that our analyses revealed some, although small, associations between the CLASS and children's outcomes.

  8. A Systematic Review and Meta-Analysis of a Measure of Staff/Child Interaction Quality (the Classroom Assessment Scoring System) in Early Childhood Education and Care Settings and Child Outcomes

    PubMed Central

    Perlman, Michal; Falenchuk, Olesya; Fletcher, Brooke; McMullen, Evelyn; Beyene, Joseph; Shah, Prakesh S.

    2016-01-01

    The quality of staff/child interactions as measured by the Classroom Assessment Scoring System (CLASS) in Early Childhood Education and Care (ECEC) programs is thought to be important for children’s outcomes. The CLASS is made of three domains that assess Emotional Support, Classroom Organization and Instructional Support. It is a relatively new measure that is being used increasingly for research, quality monitoring/accountability and other applied purposes. Our objective was to evaluate the association between the CLASS and child outcomes. Searches of Medline, PsycINFO, ERIC, websites of large datasets and reference sections of all retrieved articles were conducted up to July 3, 2015. Studies that measured association between the CLASS and child outcomes for preschool-aged children who attended ECEC programs were included after screening by two independent reviewers. Searches and data extraction were conducted by two independent reviewers. Thirty-five studies were systematically reviewed of which 19 provided data for meta-analyses. Most studies had moderate to high risk of bias. Of the 14 meta-analyses we conducted, associations between Classroom Organization and Pencil Tapping and between Instructional Support and SSRS Social Skills were significant with pooled correlations of .06 and .09 respectively. All associations were in the expected direction. In the systematic review, significant correlations were reported mainly from one large dataset. Substantial heterogeneity in use of the CLASS, its dimensions, child outcomes and statistical measures was identified. Greater consistency in study methodology is urgently needed. Given the multitude of factors that impact child development it is encouraging that our analyses revealed some, although small, associations between the CLASS and children’s outcomes. PMID:28036333

  9. Systematic literature review of patient-reported outcome measures used in assessment and measurement of sleep disorders in chronic obstructive pulmonary disease.

    PubMed

    Garrow, Adam P; Yorke, Janelle; Khan, Naimat; Vestbo, Jørgen; Singh, Dave; Tyson, Sarah

    2015-01-01

    Sleep problems are common in patients with chronic obstructive pulmonary disease (COPD), but the validity of patient-reported outcome measures (PROMs) that measure sleep dysfunction has not been evaluated. We have reviewed the literature to identify disease-specific and non-disease-specific sleep PROMs that have been validated for use in COPD patients. The review also examined the psychometric properties of identified sleep outcome measures and extracted point and variability estimates of sleep instruments used in COPD studies. The online EMBASE, MEDLINE, PsycINFO, and SCOPUS databases for all years to May 2014 were used to source articles for the review. The review was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Criteria from the Medical Outcomes Trust Scientific Advisory Committee guidelines were used to evaluate the psychometric properties of all sleep PROMs identified. One COPD-specific and six non-COPD-specific sleep outcome measures were identified and 44 papers met the review selection criteria. We only identified one instrument, the COPD and Asthma Sleep Impact Scale, which was developed specifically for use in COPD populations. Ninety percent of the identified studies used one of two non-disease-specific sleep scales, ie, the Pittsburgh Sleep Quality Index and/or the Epworth Sleep Scale, although neither has been tested for reliability or validity in people with COPD. The results highlight a need for existing non-disease-specific instruments to be validated in COPD populations and also a need for new disease-specific measures to assess the impact of sleep problems in COPD.

  10. Single-case synthesis tools II: Comparing quantitative outcome measures.

    PubMed

    Zimmerman, Kathleen N; Pustejovsky, James E; Ledford, Jennifer R; Barton, Erin E; Severini, Katherine E; Lloyd, Blair P

    2018-03-07

    Varying methods for evaluating the outcomes of single case research designs (SCD) are currently used in reviews and meta-analyses of interventions. Quantitative effect size measures are often presented alongside visual analysis conclusions. Six measures across two classes-overlap measures (percentage non-overlapping data, improvement rate difference, and Tau) and parametric within-case effect sizes (standardized mean difference and log response ratio [increasing and decreasing])-were compared to determine if choice of synthesis method within and across classes impacts conclusions regarding effectiveness. The effectiveness of sensory-based interventions (SBI), a commonly used class of treatments for young children, was evaluated. Separately from evaluations of rigor and quality, authors evaluated behavior change between baseline and SBI conditions. SBI were unlikely to result in positive behavior change across all measures except IRD. However, subgroup analyses resulted in variable conclusions, indicating that the choice of measures for SCD meta-analyses can impact conclusions. Suggestions for using the log response ratio in SCD meta-analyses and considerations for understanding variability in SCD meta-analysis conclusions are discussed. Copyright © 2018 Elsevier Ltd. All rights reserved.

  11. A model to account for the consequences of host nutrition on the outcome of gastrointestinal parasitism in sheep: model evaluation.

    PubMed

    Vagenas, D; Bishop, S C; Kyriazakis, I

    2007-08-01

    This paper describes sensitivity analyses and expectations obtained from a mathematical model developed to account for the effects of host nutrition on the consequences of gastrointestinal parasitism in sheep. The scenarios explored included different levels of parasitic challenge at different planes of nutrition, for hosts differing only in their characteristics for growth. The model was able to predict the consequences of host nutrition on the outcome of parasitism, in terms of worm burden, number of eggs excreted per gram faeces and animal performance. The model outputs predict that conclusions on the ability of hosts of different characteristics for growth to cope with parasitism (i.e. resistance) depend on the plane of nutrition. Furthermore, differences in the growth rate of sheep, on their own, are not sufficient to account for differences in the observed resistance of animals. The model forms the basis for evaluating the consequences of differing management strategies and environments, such as breeding for certain traits associated with resistance and nutritional strategies, on the consequences of gastrointestinal parasitism on sheep.

  12. Relationships Among Student, Staff, and Administrative Measures of School Climate and Student Health and Academic Outcomes.

    PubMed

    Gase, Lauren N; Gomez, Louis M; Kuo, Tony; Glenn, Beth A; Inkelas, Moira; Ponce, Ninez A

    2017-05-01

    School climate is an integral part of a comprehensive approach to improving the well-being of students; however, little is known about the relationships between its different domains and measures. We examined the relationships between student, staff, and administrative measures of school climate to understand the extent to which they were related to each other and student outcomes. The sample included 33,572 secondary school students from 121 schools in Los Angeles County during the 2014-2015 academic year. A multilevel regression model was constructed to examine the association between the domains and measures of school climate and 5 outcomes of student well-being: depressive symptoms or suicidal ideation, tobacco use, alcohol use, marijuana use, and grades. Student, staff, and administrative measures of school climate were weakly correlated. Strong associations were found between student outcomes and student reports of engagement and safety, while school staff reports and administrative measures of school climate showed limited associations with student outcomes. As schools seek to measure and implement interventions aimed at improving school climate, consideration should be given to grounding these efforts in a multidimensional conceptualization of climate that values student perspectives and includes elements of both engagement and safety. © 2017, American School Health Association.

  13. Relationships between Student, Staff, and Administrative Measures of School Climate and Student Health and Academic Outcomes

    PubMed Central

    Gase, Lauren Nichol; Gomez, Louis M.; Kuo, Tony; Glenn, Beth A.; Inkelas, Moira; Ponce, Ninez A.

    2018-01-01

    BACKGROUND School climate is an integral part of a comprehensive approach to improving the wellbeing of students; however, little is known about the relationships between its different domains and measures. This study examined the relationships between student, staff, and administrative measures of school climate in order to understand the extent to which they were related to each other and student outcomes. METHODS The sample included 33,572 secondary school students from 121 schools in Los Angeles County during the 2014–2015 academic year. A multilevel regression model was constructed to examine the association between the domains and measures of school climate and five outcomes of student wellbeing: depressive symptoms or suicidal ideation, tobacco use, alcohol use, marijuana use, and grades. RESULTS Student, staff, and administrative measures of school climate were weakly correlated. Strong associations were found between student outcomes and student reports of engagement and safety, while school staff reports and administrative measures of school climate showed limited associations with student outcomes. CONCLUSIONS As schools seek to measure and implement interventions aimed at improving school climate, consideration should be given to grounding these efforts in a multi-dimensional conceptualization of climate that values student perspectives and includes elements of both engagement and safety. PMID:28382671

  14. Analysis of subarachnoid hemorrhage using the Nationwide Inpatient Sample: the NIS-SAH Severity Score and Outcome Measure.

    PubMed

    Washington, Chad W; Derdeyn, Colin P; Dacey, Ralph G; Dhar, Rajat; Zipfel, Gregory J

    2014-08-01

    Studies using the Nationwide Inpatient Sample (NIS), a large ICD-9-based (International Classification of Diseases, Ninth Revision) administrative database, to analyze aneurysmal subarachnoid hemorrhage (SAH) have been limited by an inability to control for SAH severity and the use of unverified outcome measures. To address these limitations, the authors developed and validated a surrogate marker for SAH severity, the NIS-SAH Severity Score (NIS-SSS; akin to Hunt and Hess [HH] grade), and a dichotomous measure of SAH outcome, the NIS-SAH Outcome Measure (NIS-SOM; akin to modified Rankin Scale [mRS] score). Three separate and distinct patient cohorts were used to define and then validate the NIS-SSS and NIS-SOM. A cohort (n = 148,958, the "model population") derived from the 1998-2009 NIS was used for developing the NIS-SSS and NIS-SOM models. Diagnoses most likely reflective of SAH severity were entered into a regression model predicting poor outcome; model coefficients of significant factors were used to generate the NIS-SSS. Nationwide Inpatient Sample codes most likely to reflect a poor outcome (for example, discharge disposition, tracheostomy) were used to create the NIS-SOM. Data from 716 patients with SAH (the "validation population") treated at the authors' institution were used to validate the NIS-SSS and NIS-SOM against HH grade and mRS score, respectively. Lastly, 147,395 patients (the "assessment population") from the 1998-2009 NIS, independent of the model population, were used to assess performance of the NIS-SSS in predicting outcome. The ability of the NIS-SSS to predict outcome was compared with other common measures of disease severity (All Patient Refined Diagnosis Related Group [APR-DRG], All Payer Severity-adjusted DRG [APS-DRG], and DRG). RESULTS The NIS-SSS significantly correlated with HH grade, and there was no statistical difference between the abilities of the NIS-SSS and HH grade to predict mRS-based outcomes. As compared with the APR

  15. Treatment effects model for assessing disease management: measuring outcomes and strengthening program management.

    PubMed

    Wendel, Jeanne; Dumitras, Diana

    2005-06-01

    This paper describes an analytical methodology for obtaining statistically unbiased outcomes estimates for programs in which participation decisions may be correlated with variables that impact outcomes. This methodology is particularly useful for intraorganizational program evaluations conducted for business purposes. In this situation, data is likely to be available for a population of managed care members who are eligible to participate in a disease management (DM) program, with some electing to participate while others eschew the opportunity. The most pragmatic analytical strategy for in-house evaluation of such programs is likely to be the pre-intervention/post-intervention design in which the control group consists of people who were invited to participate in the DM program, but declined the invitation. Regression estimates of program impacts may be statistically biased if factors that impact participation decisions are correlated with outcomes measures. This paper describes an econometric procedure, the Treatment Effects model, developed to produce statistically unbiased estimates of program impacts in this type of situation. Two equations are estimated to (a) estimate the impacts of patient characteristics on decisions to participate in the program, and then (b) use this information to produce a statistically unbiased estimate of the impact of program participation on outcomes. This methodology is well-established in economics and econometrics, but has not been widely applied in the DM outcomes measurement literature; hence, this paper focuses on one illustrative application.

  16. Health economics research into supporting carers of people with dementia: A systematic review of outcome measures

    PubMed Central

    2012-01-01

    Advisory bodies, such as the National Institute for Health and Clinical Excellence (NICE) in the UK, advocate using preference based instruments to measure the quality of life (QoL) component of the quality-adjusted life year (QALY). Cost per QALY is used to determine cost-effectiveness, and hence funding, of interventions. QALYs allow policy makers to compare the effects of different interventions across different patient groups. Generic measures may not be sensitive enough to fully capture the QoL effects for certain populations, such as carers, so there is a need to consider additional outcome measures, which are preference based where possible to enable cost-effectiveness analysis to be undertaken. This paper reviews outcome measures commonly used in health services research and health economics research involving carers of people with dementia. An electronic database search was conducted in PubMed, Medline, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, the National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE) and Health Technology Assessment database. Studies were eligible for inclusion if they included an outcome measure for carers of people with dementia. 2262 articles were identified. 455 articles describing 361 studies remained after exclusion criteria were applied. 228 outcome measures were extracted from the studies. Measures were categorised into 44 burden measures, 43 mastery measures, 61 mood measures, 32 QoL measures, 27 social support and relationships measures and 21 staff competency and morale measures. The choice of instrument has implications on funding decisions; therefore, researchers need to choose appropriate instruments for the population being measured and the type of intervention undertaken. If an instrument is not sensitive enough to detect changes in certain populations, the effect of an intervention may be underestimated, and hence

  17. Health economics research into supporting carers of people with dementia: a systematic review of outcome measures.

    PubMed

    Jones, Carys; Edwards, Rhiannon Tudor; Hounsome, Barry

    2012-11-26

    Advisory bodies, such as the National Institute for Health and Clinical Excellence (NICE) in the UK, advocate using preference based instruments to measure the quality of life (QoL) component of the quality-adjusted life year (QALY). Cost per QALY is used to determine cost-effectiveness, and hence funding, of interventions. QALYs allow policy makers to compare the effects of different interventions across different patient groups. Generic measures may not be sensitive enough to fully capture the QoL effects for certain populations, such as carers, so there is a need to consider additional outcome measures, which are preference based where possible to enable cost-effectiveness analysis to be undertaken. This paper reviews outcome measures commonly used in health services research and health economics research involving carers of people with dementia. An electronic database search was conducted in PubMed, Medline, the Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, the National Health Service Economic Evaluation Database (NHS EED), Database of Abstracts of Reviews of Effects (DARE) and Health Technology Assessment database. Studies were eligible for inclusion if they included an outcome measure for carers of people with dementia. 2262 articles were identified. 455 articles describing 361 studies remained after exclusion criteria were applied. 228 outcome measures were extracted from the studies. Measures were categorised into 44 burden measures, 43 mastery measures, 61 mood measures, 32 QoL measures, 27 social support and relationships measures and 21 staff competency and morale measures. The choice of instrument has implications on funding decisions; therefore, researchers need to choose appropriate instruments for the population being measured and the type of intervention undertaken. If an instrument is not sensitive enough to detect changes in certain populations, the effect of an intervention may be underestimated, and hence

  18. Physician professionalism and accountability: the role of collaborative improvement networks.

    PubMed

    Miles, Paul V; Conway, Patrick H; Pawlson, L Gregory

    2013-06-01

    The medical profession is facing an imperative to deliver more patient-centered care, improve quality, and reduce unnecessary costs and waste. With significant unexplained variation in resource use and outcomes, even physicians and health care organizations with "the best" reputations cannot assume they always deliver the best care possible. Going forward, physicians will need to demonstrate professionalism and accountability in a different way: to their peers, to society in general, and to individual patients. The new accountability includes quality and clinical outcomes but also resource utilization, appropriateness and patient-centeredness of recommended care, and the responsibility to help improve systems of care. The pediatric collaborative improvement network model represents an important framework for helping transform health care. For individual physicians, participation in a multisite network offers the opportunity to demonstrate accountability by measuring and improving care as part of an approach that addresses the problems of small sample size, attribution, and unnecessary variation in care by pooling patients from individual practices and requiring standardization of care to participate. For patients and families, the model helps ensure that they are likely to receive the current best evidence-based recommendation. Finally, this model aligns with payers' goals of purchasing value-based care, rewarding quality and improvement, and reducing unnecessary variation around current best evidenced-based, effective, and efficient care. In addition, within the profession, the American Board of Pediatrics recognizes participation in a multisite quality improvement network as one of the most rigorous and meaningful approaches for a diplomate to meet practice performance maintenance of certification requirements.

  19. Report from the third international consensus meeting to harmonise core outcome measures for atopic eczema/dermatitis clinical trials (HOME)

    PubMed Central

    Chalmers, JR; Schmitt, J; Apfelbacher, C; Dohil, M; Eichenfield, LF; Simpson, EL; Singh, J; Spuls, P; Thomas, KS; Admani, S; Aoki, V; Ardeleanu, M; Barbarot, S; Berger, T; Bergman, JN; Block, J; Borok, N; Burton, T; Chamlin, SL; Deckert, S; DeKlotz, CC; Graff, LB; Hanifin, JM; Hebert, AA; Humphreys, R; Katoh, N; Kisa, RM; Margolis, DJ; Merhand, S; Minnillo, R; Mizutani, H; Nankervis, H; Ohya, Y; Rodgers, P; Schram, ME; Stalder, JF; Svensson, A; Takaoka, R; Teper, A; Tom, WL; von Kobyletzki, L; Weisshaar, E; Zelt, S; Williams, HC

    2014-01-01

    Summary This report provides a summary of the third meeting of the Harmonising Outcome Measures for Eczema (HOME) initiative held in San Diego, CA, U.S.A., 6–7 April 2013 (HOME III). The meeting addressed the four domains that had previously been agreed should be measured in every eczema clinical trial: clinical signs, patient-reported symptoms, long-term control and quality of life. Formal presentations and nominal group techniques were used at this working meeting, attended by 56 voting participants (31 of whom were dermatologists). Significant progress was made on the domain of clinical signs. Without reference to any named scales, it was agreed that the intensity and extent of erythema, excoriation, oedema/papulation and lichenification should be included in the core outcome measure for the scale to have content validity. The group then discussed a systematic review of all scales measuring the clinical signs of eczema and their measurement properties, followed by a consensus vote on which scale to recommend for inclusion in the core outcome set. Research into the remaining three domains was presented, followed by discussions. The symptoms group and quality of life groups need to systematically identify all available tools and rate the quality of the tools. A definition of long-term control is needed before progress can be made towards recommending a core outcome measure. What's already known about this topic? Many different scales have been used to measure eczema, making it difficult to compare trials in meta-analyses and hampering improvements in clinical practice. HOME core outcome measures must pass the OMERACT (Outcome Measures in Rheumatology) filter of truth (validity), discrimination (sensitivity to change and responsiveness) and feasibility (ease of use, costs, time to perform and interpret). It has been previously agreed as part of the consensus process that four domains should be measured by the core outcomes: clinical signs, patient

  20. The effect of measuring serum doxycycline concentrations on clinical outcomes during treatment of chronic Q fever.

    PubMed

    van Roeden, S E; Bleeker-Rovers, C P; Kampschreur, L M; de Regt, M J A; Vermeulen Windsant, A; Hoepelman, A I M; Wever, P C; Oosterheert, J J

    2018-04-01

    First choice treatment for chronic Q fever is doxycycline plus hydroxychloroquine. Serum doxycycline concentration (SDC) >5 μg/mL has been associated with a favourable serological response, but the effect on clinical outcomes is unknown. To assess the effect of measuring SDC during treatment of chronic Q fever on clinical outcomes. We performed a retrospective cohort study, to assess the effect of measuring SDC on clinical outcomes in patients treated with doxycycline and hydroxychloroquine for chronic Q fever. Primary outcome was the first disease-related event (new complication or chronic Q fever-related mortality); secondary outcomes were all-cause mortality and PCR-positivity. Multivariable analysis was performed with a Cox proportional hazards model, with shared-frailty terms for different hospitals included. We included 201 patients (mean age 68 years, 83% male): in 167 patients (83%) SDC was measured, 34 patients (17%) were treated without SDC measurement. First SDC was >5 μg/mL in 106 patients (63%), all with 200 mg doxycycline daily. In patients with SDC measured, dosage was adjusted in 41% (n = 68), concerning an increase in 64 patients. Mean SDC was 4.1 μg/mL before dosage increase, and 5.9 μg/mL afterwards. SDC measurement was associated with a lower risk for disease-related events (HR 0.51, 95% CI 0.26-0.97, P = 0.04), but not with all-cause mortality or PCR-positivity. SDC measurement decreases the risk for disease-related events, potentially through more optimal dosing or improved compliance. We recommend measurement of SDC and striving for SDC >5 μg/mL and <10 μg/mL during treatment of chronic Q fever.

  1. Measurement Error and Environmental Epidemiology: A Policy Perspective

    PubMed Central

    Edwards, Jessie K.; Keil, Alexander P.

    2017-01-01

    Purpose of review Measurement error threatens public health by producing bias in estimates of the population impact of environmental exposures. Quantitative methods to account for measurement bias can improve public health decision making. Recent findings We summarize traditional and emerging methods to improve inference under a standard perspective, in which the investigator estimates an exposure response function, and a policy perspective, in which the investigator directly estimates population impact of a proposed intervention. Summary Under a policy perspective, the analysis must be sensitive to errors in measurement of factors that modify the effect of exposure on outcome, must consider whether policies operate on the true or measured exposures, and may increasingly need to account for potentially dependent measurement error of two or more exposures affected by the same policy or intervention. Incorporating approaches to account for measurement error into such a policy perspective will increase the impact of environmental epidemiology. PMID:28138941

  2. Making Health System Performance Measurement Useful to Policy Makers: Aligning Strategies, Measurement and Local Health System Accountability in Ontario

    PubMed Central

    Veillard, Jeremy; Huynh, Tai; Ardal, Sten; Kadandale, Sowmya; Klazinga, Niek S.; Brown, Adalsteinn D.

    2010-01-01

    This study examined the experience of the Ontario Ministry of Health and Long-Term Care in enhancing its stewardship and performance management role by developing a health system strategy map and a strategy-based scorecard through a process of policy reviews and expert consultations, and linking them to accountability agreements. An evaluation of the implementation and of the effects of the policy intervention has been carried out through direct policy observation over three years, document analysis, interviews with decision-makers and systematic discussion of findings with other authors and external reviewers. Cascading strategies at health and local health system levels were identified, and a core set of health system and local health system performance indicators was selected and incorporated into accountability agreements with the Local Health Integration Networks. despite the persistence of such challenges as measurement limitations and lack of systematic linkage to decision-making processes, these activities helped to strengthen substantially the ministry's performance management function. PMID:21286268

  3. Historical perspective: The pros and cons of conventional outcome measures in Parkinson's disease.

    PubMed

    Lim, Shen-Yang; Tan, Ai Huey

    2018-01-01

    Conventional outcome measures (COMs) in Parkinson's disease (PD) refer to rating scales, questionnaires, patient diaries and clinically-based tests that do not require specialized equipment. It is timely at this juncture - as clinicians and researchers begin to grapple with the "invasion" of digital technologies - to review the strengths and weaknesses of these outcome measures. This paper discusses advances (including an enhanced understanding of PD itself, and the development of clinimetrics as a field) that have led to improvements in the COMs used in PD; their strengths and limitations; and factors to consider when selecting and using a measuring instrument. It is envisaged that in the future, a combination of COMs and technology-based objective measures will be utilized, with different methods having their own strengths and weaknesses. Judgement is required on the part of the clinician and researcher in terms of which instrument(s) are appropriate to use, depending on the particular clinical or research setting or question. Copyright © 2017 Elsevier Ltd. All rights reserved.

  4. Design of pilot studies to inform the construction of composite outcome measures.

    PubMed

    Edland, Steven D; Ard, M Colin; Li, Weiwei; Jiang, Lingjing

    2017-06-01

    Composite scales have recently been proposed as outcome measures for clinical trials. For example, the Prodromal Alzheimer's Cognitive Composite (PACC) is the sum of z-score normed component measures assessing episodic memory, timed executive function, and global cognition. Alternative methods of calculating composite total scores using the weighted sum of the component measures that maximize signal-to-noise of the resulting composite score have been proposed. Optimal weights can be estimated from pilot data, but it is an open question how large a pilot trial is required to calculate reliably optimal weights. In this manuscript, we describe the calculation of optimal weights, and use large-scale computer simulations to investigate the question of how large a pilot study sample is required to inform the calculation of optimal weights. The simulations are informed by the pattern of decline observed in cognitively normal subjects enrolled in the Alzheimer's Disease Cooperative Study (ADCS) Prevention Instrument cohort study, restricting to n=75 subjects age 75 and over with an ApoE E4 risk allele and therefore likely to have an underlying Alzheimer neurodegenerative process. In the context of secondary prevention trials in Alzheimer's disease, and using the components of the PACC, we found that pilot studies as small as 100 are sufficient to meaningfully inform weighting parameters. Regardless of the pilot study sample size used to inform weights, the optimally weighted PACC consistently outperformed the standard PACC in terms of statistical power to detect treatment effects in a clinical trial. Pilot studies of size 300 produced weights that achieved near-optimal statistical power, and reduced required sample size relative to the standard PACC by more than half. These simulations suggest that modestly sized pilot studies, comparable to that of a phase 2 clinical trial, are sufficient to inform the construction of composite outcome measures. Although these findings

  5. NETS1HD: study protocol for development of a core outcome set for use in determining the overall success of Hirschsprung's disease treatment.

    PubMed

    Allin, Benjamin; Bradnock, Timothy; Kenny, Simon; Walker, Gregor; Knight, Marian

    2016-12-07

    Use of core outcome sets in research has been proposed as a method for countering the problems caused by heterogeneity of outcome measure reporting. Heterogeneity of outcome measure reporting occurs in Hirschsprung's disease (HD) research and is limiting the development of a robust evidence base to support clinical practice. Candidate outcome measures have been identified through a systematic review. These outcome measures will form the starting point for a three-phase online Delphi process to be carried out in parallel by three panels of experts. Panel 1 is a neonatal panel; panel 2 is a non-neonatal panel; and panel 3 is a lay panel. In round 1, experts will be asked to score the previously identified outcome measures from 1 to 9 based on how important they think the measures are in determining the overall success of their/their child's/their patient's HD. In round 2, experts will be presented with the same list of outcome measures and graphical representations of how their panel scored that outcome in round 1. They will be asked to re-score the outcome measure, taking into account how important other members of their panel felt it to be. In round 3, experts will again be asked to re-score each outcome measure, but this time they will receive a graphical representation of the distribution of scores from all three panels, which they should take into account when re-scoring. Following round 3 of the Delphi process, 40 experts will be invited to attend a face-to-face consensus meeting. Participants will be invited in a purposive manner to obtain balance between the different panels. Results of the Delphi process will be discussed, and outcomes will be re-scored. Outcome measures where >70% of participants at the meeting scored it 7-9 and <15% scored it 1-3 will form the core outcome set. Development of a core outcome set will help to reduce heterogeneity of outcome measure reporting in HD. This will increase the quality of research taking place and ultimately

  6. Outcome Measures in Spinal Cord Injury

    PubMed Central

    Alexander, Marcalee S.; Anderson, Kim; Biering-Sorensen, Fin; Blight, Andrew R.; Brannon, Ruth; Bryce, Thomas; Creasey, Graham; Catz, Amiram; Curt, Armin; Donovan, William; Ditunno, John; Ellaway, Peter; Finnerup, Nanna B.; Graves, Daniel E.; Haynes, Beth Ann; Heinemann, Allen W.; Jackson, Amie B.; Johnston, Mark; Kalpakjian, Claire Z.; Kleitman, Naomi; Krassioukov, Andrei; Krogh, Klaus; Lammertse, Daniel; Magasi, Susan; Mulcahey, MJ; Schurch, Brigitte; Sherwood, Arthur; Steeves, John D.; Stiens, Steven; Tulsky, David S.; van Hedel, Hubertus J.A.; Whiteneck, Gale

    2009-01-01

    Study Design review by the Spinal Cord Outcomes Partnership Endeavor (SCOPE), which is a broad-based international consortium of scientists and clinical researchers representing academic institutions, industry, government agencies, not-for-profit organizations and foundations. Objectives assessment of current and evolving tools for evaluating human spinal cord injury (SCI) outcomes for both clinical diagnosis and clinical research studies. Methods a framework for the appraisal of evidence of metric properties was used to examine outcome tools or tests for accuracy, sensitivity, reliability and validity for human SCI. Results imaging, neurological, functional, autonomic, sexual health, bladder/bowel, pain, and psycho-social tools were evaluated. Several specific tools for human SCI studies have or are being developed to allow the more accurate determination for a clinically meaningful benefit (improvement in functional outcome or quality of life) being achieved as a result of a therapeutic intervention. Conclusion significant progress has been made, but further validation studies are required to identify the most appropriate tools for specific targets in a human SCI study or clinical trial. PMID:19381157

  7. Outcome measures for oral health based on clinical assessments and claims data: feasibility evaluation in practice.

    PubMed

    Hummel, Riët; Bruers, Josef; van der Galiën, Onno; van der Sanden, Wil; van der Heijden, Geert

    2017-10-05

    It is well known that treatment variation exists in oral healthcare, but the consequences for oral health are unknown as the development of outcome measures is still in its infancy. The aim of this study was to identify and develop outcome measures for oral health and explore their performance using health insurance claims records and clinical data from general dental practices. The Dutch healthcare insurance company Achmea collaborated with researchers, oral health experts, and general dental practitioners (GDPs) in a proof of practice study to test the feasibility of measures in general dental practices. A literature search identified previously described outcome measures for oral healthcare. Using a structured approach, identified measures were (i) prioritized, adjusted and added to after discussion and then (ii) tested for feasibility of data collection, their face validity and discriminative validity. Data sources were claims records from Achmea, clinical records from dental practices, and prospective, pre-determined clinical assessment data obtained during routine consultations. In total eight measures (four on dental caries, one on tooth wear, two on periodontal health, one on retreatment) were identified, prioritized and tested. The retreatment measure and three measures for dental caries were found promising as data collection was feasible, they had face validity and discriminative validity. Deployment of these measures demonstrated variation in clinical practices of GDPs. Feedback of this data to GDPs led to vivid discussions on best practices and quality of care. The measure 'tooth wear' was not considered sufficiently responsive; 'changes in periodontal health score' was considered a controversial measure. The available data for the measures 'percentage of 18-year-olds with no tooth decay' and 'improvement in gingival bleeding index at reassessment' was too limited to provide accurate estimates per dental practice. The evaluated measures 'time to first

  8. Experimental evaluation of nonclassical correlations between measurement outcomes and target observable in a quantum measurement

    NASA Astrophysics Data System (ADS)

    Iinuma, Masataka; Suzuki, Yutaro; Nii, Taiki; Kinoshita, Ryuji; Hofmann, Holger F.

    2016-03-01

    In general, it is difficult to evaluate measurement errors when the initial and final conditions of the measurement make it impossible to identify the correct value of the target observable. Ozawa proposed a solution based on the operator algebra of observables which has recently been used in experiments investigating the error-disturbance trade-off of quantum measurements. Importantly, this solution makes surprisingly detailed statements about the relations between measurement outcomes and the unknown target observable. In the present paper, we investigate this relation by performing a sequence of two measurements on the polarization of a photon, so that the first measurement commutes with the target observable and the second measurement is sensitive to a complementary observable. While the initial measurement can be evaluated using classical statistics, the second measurement introduces the effects of quantum correlations between the noncommuting physical properties. By varying the resolution of the initial measurement, we can change the relative contribution of the nonclassical correlations and identify their role in the evaluation of the quantum measurement. It is shown that the most striking deviation from classical expectations is obtained at the transition between weak and strong measurements, where the competition between different statistical effects results in measurement values well outside the range of possible eigenvalues.

  9. Measurement properties of gait-related outcomes in youth with neuromuscular diagnoses: a systematic review.

    PubMed

    Ammann-Reiffer, Corinne; Bastiaenen, Caroline H G; de Bie, Rob A; van Hedel, Hubertus J A

    2014-08-01

    Sound measurement properties of outcome tools are essential when evaluating outcomes of an intervention, in clinical practice and in research. The purpose of this study was to review the evidence on reliability, measurement error, and responsiveness of measures of gait function in children with neuromuscular diagnoses. The MEDLINE, CINAHL, EMBASE, and PsycINFO databases were searched up to June 15, 2012. Studies evaluating reliability, measurement error, or responsiveness of measures of gait function in 1- to 18-year-old children and youth with neuromuscular diagnoses were included. Quality of the studies was independently rated by 2 raters using a modified COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. Studies with a fair quality rating or better were considered for best evidence synthesis. Regarding the methodological quality, 32 out of 35 reliability studies, all of the 13 measurement error studies, and 5 out of 10 responsiveness studies were of fair or good quality. Best evidence synthesis revealed moderate to strong evidence for reliability for several measures in children and youth with cerebral palsy (CP) but was limited or unknown in other diagnoses. The Functional Mobility Scale (FMS) and the Gross Motor Function Measure (GMFM) dimension E showed limited positive evidence for responsiveness in children with CP, but it was unknown or controversial in other diagnoses. No information was reported on the minimal important change; thus, evidence on measurement error remained undetermined. As studies on validity were not included in the review, a comprehensive appraisal of the best available gait-related outcome measure per diagnosis is not possible. There is moderate to strong evidence on reliability for several measures of gait function in children and youth with CP, whereas evidence on responsiveness exists only for the FMS and the GMFM dimension E. © 2014 American Physical Therapy Association.

  10. Improving the Rank Precision of Population Health Measures for Small Areas with Longitudinal and Joint Outcome Models

    PubMed Central

    Athens, Jessica K.; Remington, Patrick L.; Gangnon, Ronald E.

    2015-01-01

    Objectives The University of Wisconsin Population Health Institute has published the County Health Rankings since 2010. These rankings use population-based data to highlight health outcomes and the multiple determinants of these outcomes and to encourage in-depth health assessment for all United States counties. A significant methodological limitation, however, is the uncertainty of rank estimates, particularly for small counties. To address this challenge, we explore the use of longitudinal and pooled outcome data in hierarchical Bayesian models to generate county ranks with greater precision. Methods In our models we used pooled outcome data for three measure groups: (1) Poor physical and poor mental health days; (2) percent of births with low birth weight and fair or poor health prevalence; and (3) age-specific mortality rates for nine age groups. We used the fixed and random effects components of these models to generate posterior samples of rates for each measure. We also used time-series data in longitudinal random effects models for age-specific mortality. Based on the posterior samples from these models, we estimate ranks and rank quartiles for each measure, as well as the probability of a county ranking in its assigned quartile. Rank quartile probabilities for univariate, joint outcome, and/or longitudinal models were compared to assess improvements in rank precision. Results The joint outcome model for poor physical and poor mental health days resulted in improved rank precision, as did the longitudinal model for age-specific mortality rates. Rank precision for low birth weight births and fair/poor health prevalence based on the univariate and joint outcome models were equivalent. Conclusion Incorporating longitudinal or pooled outcome data may improve rank certainty, depending on characteristics of the measures selected. For measures with different determinants, joint modeling neither improved nor degraded rank precision. This approach suggests a simple

  11. Using the Patient Reported Outcomes Measurement Information System to Evaluate Psychosocial Functioning among Children with Craniofacial Anomalies.

    PubMed

    Shapiro, Danielle N; Waljee, Jennifer; Ranganathan, Kavitha; Buchman, Steven; Warschausky, Seth

    2015-06-01

    Children with craniofacial anomalies are at risk for social exclusion, bullying, and psychological symptoms, all of which are associated with poor developmental and health outcomes. The National Institutes of Health-developed Patient Reported Outcomes Measurement Information System instruments may be useful tools for monitoring psychosocial functioning in clinical settings and for integrating patient and parent perspectives. The current study included 74 children (50 percent male) with craniofacial anomalies recruited through a multidisciplinary clinic. The authors obtained child self-report and parent-proxy ratings of depression, anxiety, and peer relationship quality using National Institutes of Health Patient Reported Outcomes Measurement Information System instruments. The authors compared sample means to Patient Reported Outcomes Measurement Information System instruments norms and analyzed the reliability of parents' and children's reporting of psychosocial variables. All reliability statistics were satisfactory (α values ranging from 0.74 to 0.96) and sample standard deviations were similar to those obtained in a general population, suggesting that Patient Reported Outcomes Measurement Information System instruments are reliable among children with craniofacial anomalies. In general, children and parents did not report unusual levels of psychological distress; however, they did report poorer peer relationship quality relative to normed data, a trend that was particularly pronounced among boys. National Institutes of Health Patient Reported Outcomes Measurement Information System instruments are efficient and accurate tools for monitoring psychosocial adjustment among children with craniofacial anomalies. It may be especially important to monitor social functioning, particularly among boys.

  12. Accounting for dropout bias using mixed-effects models.

    PubMed

    Mallinckrodt, C H; Clark, W S; David, S R

    2001-01-01

    Treatment effects are often evaluated by comparing change over time in outcome measures. However, valid analyses of longitudinal data can be problematic when subjects discontinue (dropout) prior to completing the study. This study assessed the merits of likelihood-based repeated measures analyses (MMRM) compared with fixed-effects analysis of variance where missing values were imputed using the last observation carried forward approach (LOCF) in accounting for dropout bias. Comparisons were made in simulated data and in data from a randomized clinical trial. Subject dropout was introduced in the simulated data to generate ignorable and nonignorable missingness. Estimates of treatment group differences in mean change from baseline to endpoint from MMRM were, on average, markedly closer to the true value than estimates from LOCF in every scenario simulated. Standard errors and confidence intervals from MMRM accurately reflected the uncertainty of the estimates, whereas standard errors and confidence intervals from LOCF underestimated uncertainty.

  13. Accounting Students Are Unable to Recognize the Various Types of Accounting Functions.

    ERIC Educational Resources Information Center

    Frank, Gary B.; And Others

    1989-01-01

    The authors discuss 258 undergraduate business majors' perceptions of the nature and uses of financial and managerial accounting. Perceptions were measured with Stapel Scales constructed on 11 descriptive statements. Findings indicated that students distinguish between financial and managerial accounting, but that they do not view the two as…

  14. Independent evaluation: insights from public accounting.

    PubMed

    Brown, Abigail B; Klerman, Jacob Alex

    2012-06-01

    Maintaining the independence of contract government program evaluation presents significant contracting challenges. The ideal outcome for an agency is often both the impression of an independent evaluation and a glowing report. In this, independent evaluation is like financial statement audits: firm management wants both a public accounting firm to attest to the fairness of its financial accounts and to be allowed to account for transactions as it sees fit. In both cases, the evaluation or audit is being conducted on behalf of outsiders--the public or shareholders--but is overseen by a party with significant interests at stake in the outcome-the agency being evaluated or executive management of the firm. We review the contracting strategies developed to maintain independence in auditing. We examine evidence on the effectiveness of professionalism, reputation, liability and owner oversight in constraining behavior in auditing. We then establish parallels with contracting for evaluations and apply these insights to changes that might maintain and improve evaluator independence. By analogy with the Sarbanes Oxley Act of 2002 reforms in auditing, we recommend exploring using a reformulated Technical Working Group to encourage more prompt release of more evaluation results and to help insulate evaluators from inappropriate pressure to change their results or analysis approach.

  15. Questioning the Use of Outcome Measures to Evaluate Principal Preparation Programs

    ERIC Educational Resources Information Center

    Fuller, Ed; Hollingworth, Liz

    2018-01-01

    Policymakers are proposing the use of outcome measures as indicators of effective principal preparation programs. The three most common metrics recommended are: (1) graduates' effectiveness in improving student achievement test scores, (2) graduate job placement rates, and (3) principal job retention once employed. This article explores the use of…

  16. Improving accountability in vaccine decision-making.

    PubMed

    Timmis, James Kenneth; Black, Steven; Rappuoli, Rino

    2017-11-01

    Healthcare decisions, in particular those affecting entire populations, should be evidence-based and taken by decision-makers sharing broad alignment with affected stakeholders. However, criteria, priorities and procedures for decision-making are sometimes non-transparent, frequently vary considerably across equivalent decision-bodies, do not always consider the broader benefits of new health-measures, and therefore do not necessarily adequately represent the relevant stakeholder-spectrum. Areas covered: To address these issues in the context of the evaluation of new vaccines, we have proposed a first baseline set of core evaluation criteria, primarily selected by members of the vaccine research community, and suggested their implementation in vaccine evaluation procedures. In this communication, we review the consequences and utility of stakeholder-centered core considerations to increase transparency in and accountability of decision-making procedures, in general, and of the benefits gained by their inclusion in Multi-Criteria-Decision-Analysis tools, exemplified by SMART Vaccines, specifically. Expert commentary: To increase effectiveness and comparability of health decision outcomes, decision procedures should be properly standardized across equivalent (national) decision bodies. To this end, including stakeholder-centered criteria in decision procedures would significantly increase their transparency and accountability, support international capacity building to improve health, and reduce societal costs and inequity resulting from suboptimal health decision-making.

  17. Optimal functional outcome measures for assessing treatment for Dupuytren’s disease: a systematic review and recommendations for future practice

    PubMed Central

    2013-01-01

    Background Dupuytren's disease of the hand is a common condition affecting the palmar fascia, resulting in progressive flexion deformities of the digits and hence limitation of hand function. The optimal treatment remains unclear as outcomes studies have used a variety of measures for assessment. Methods A literature search was performed for all publications describing surgical treatment, percutaneous needle aponeurotomy or collagenase injection for primary or recurrent Dupuytren’s disease where outcomes had been monitored using functional measures. Results Ninety-one studies met the inclusion criteria. Twenty-two studies reported outcomes using patient reported outcome measures (PROMs) ranging from validated questionnaires to self-reported measures for return to work and self-rated disability. The Disability of Arm, Shoulder and Hand (DASH) score was the most utilised patient-reported function measure (n=11). Patient satisfaction was reported by eighteen studies but no single method was used consistently. Range of movement was the most frequent physical measure and was reported in all 91 studies. However, the methods of measurement and reporting varied, with seventeen different techniques being used. Other physical measures included grip and pinch strength and sensibility, again with variations in measurement protocols. The mean follow-up time ranged from 2 weeks to 17 years. Conclusions There is little consistency in the reporting of outcomes for interventions in patients with Dupuytren’s disease, making it impossible to compare the efficacy of different treatment modalities. Although there are limitations to the existing generic patient reported outcomes measures, a combination of these together with a disease-specific questionnaire, and physical measures of active and passive individual joint Range of movement (ROM), grip and sensibility using standardised protocols should be used for future outcomes studies. As Dupuytren’s disease tends to recur

  18. PERSPECTIVES: Accountability for Mental Health: The Australian Experience.

    PubMed

    Rosenberg, Sebastian; Salvador-Carulla, Luis

    2017-03-01

    Australia was one of the first countries to develop a national policy for mental health. A persistent characteristic of all these policies has been their reference to the importance of accountability. What does this mean exactly and have we achieved it? Can Australia tell if anybody is getting better? To review accountability for mental health in Australia and question whether two decades of Australian rhetoric around accountability for mental health has been fulfilled. This paper first considers the concept of accountability and its application to mental health. We then draw on existing literature, reports, and empirical data from national and state governments to illustrate historical and current approaches to accountability for mental health. We provide a content analysis of the most current set of national indicators. The paper also briefly considers some relevant international processes to compare Australia's progress in establishing accountability for mental health. Australia's federated system of government permits competing approaches to accountability, with multiple and overlapping data sets. A clear national approach to accountability for mental health has failed to emerge. Existing data focuses on administrative and health service indicators, failing to reflect broader social factors which reveal quality of life. In spite of twenty years of investment and effort Australia has been described as outcome blind, unable to demonstrate the merit of USD 8bn spent on mental health annually. While it may be prolific, existing administrative data provide little outcomes information against which Australia can genuinely assess the health and welfare of people with a mental illness. International efforts are evolving slowly. Even in high income countries such as Australia, resources for mental health services are constrained. Countries cannot afford to continue to invest in services or programs that fail to demonstrate good outcomes for people with a mental illness

  19. Routine outcome measurement in mental health service consumers: who should provide support for the self-assessments?

    PubMed

    Gelkopf, Marc; Pagorek-Eshel, Shira; Trauer, Tom; Roe, David

    2015-06-01

    This study examined whether mental health community service users completed outcome self-reports differently when assessments were supervised by internal vs. external staff. The examination of potential differences between the two has useful implications for mental health systems that take upon themselves the challenge of Routine Outcome Measurement (ROM), as it might impact allocation of public resources and managed care program planning. 73 consumers completed the Manchester Short Assessment of Quality of Life (MANSA), a shortened version of the Recovery Assessment Scale (RAS), and a functioning questionnaire. Questionnaires were administered, once using support provided by internal staff and once using support provided by external professional staff, with a one-month time interval and in random order. A MANOVA Repeated Measures showed no differences in outcomes of quality of life and recovery between internal and external support. Functioning scores were higher for the internal support when the internal assessments were performed first. Overall, except for the differences in functioning assessment, outcome scores were not determined by the supporting agency. This might indicate that when measuring quality of life and recovery, different supporting methods can be used to gather outcome measures and internal staff might be a good default agency to do this. Differences found in functioning assessment are discussed. Copyright © 2015 Elsevier Ltd. All rights reserved.

  20. Post-injury personality in the prediction of outcome following severe acquired brain injury.

    PubMed

    Cattran, Charlotte Jane; Oddy, Michael; Wood, Rodger Llewellyn; Moir, Jane Frances

    2011-01-01

    The aim of the study was to examine the utility of five measures of non-cognitive neurobehavioural (NCNB) changes that often occur following acquired brain injury, in predicting outcome (measured in terms of participation and social adaptation) at 1-year follow-up. The study employed a longitudinal, correlational design. Multiple regression was employed to investigate the value of five new NCNB measures of social perception, emotional regulation, motivation, impulsivity and disinhibition in the prediction of outcome as measured by the Mayo-Portland Adaptability Inventory (MPAI). Two NCNB measures (motivation and emotional regulation) were found to significantly predict outcome at 1-year follow-up, accounting for 53% of the variance in MPAI total scores. These measures provide a method of quantifying the extent of NCNB changes following brain injury. The predictive value of the measures indicates that they may represent a useful tool which could aid clinicians in identifying early-on those whose symptoms are likely to persist and who may require ongoing intervention. This could facilitate the planning of rehabilitation programmes.

  1. Modifying the Clinical Outcomes in Routine Evaluation Measure for Use with People Who Have a Learning Disability

    ERIC Educational Resources Information Center

    Marshall, Keith; Willoughby-Booth, Simon

    2007-01-01

    There are few reliable self-report measures suitable for people with a learning disability in reporting psychological distress. This study examines the modification of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM), exploring its reliability, using two different presentation styles. One style included a sequencing task then…

  2. Validating Measures of Real-World Outcome: The Results of the VALERO Expert Survey and RAND Panel

    PubMed Central

    Leifker, Feea R.; Patterson, Thomas L.; Heaton, Robert K.; Harvey, Philip D.

    2011-01-01

    Background: People with schizophrenia demonstrate considerable discrepancy between self-reported functioning and informant reports. It is not clear whether these discrepancies originate from the instruments used or from the perspectives of different informants. The goal of the Validation of Everyday Real-World Outcomes (VALERO) Study is to enhance the measurement of real-world (RW) outcomes in the social, residential, and vocational domains through selection of optimal scales and informants using a multistep process similar to the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) initiative. Methods: Forty-eight experts provided their opinion regarding the best scales measuring RW outcomes. Fifty-nine measures were nominated. The investigators selected the 11 scales that were the most highly nominated, had the most published validity data, and best represented the domains of interest. Information was provided to other experts who served as RAND panelists. Panelists rated each measure for its suitability across multiple a priori domains. Discrepant ratings were discussed until consensus was reached. Results: Following the RAND Panel, the 2 scales that scored highest across the various criteria for each of the classes of scales (hybrid, social functioning, and everyday living skills) were selected for use in the first substudy of VALERO. The scales selected were the Quality-of-Life Scale, Specific Levels of Functioning Scale, Social Behavior Schedule, Social Functioning Scale, Independent Living Skills Schedule, and Life Skills Profile. Discussion: The results show that although there are significant limitations with current scales used for the assessment of RW outcome in schizophrenia, a consensus is possible. Further, several existing instruments were rated as useful for measuring social, residential, and vocational outcomes. PMID:19525354

  3. Core outcome measurement instruments for clinical trials in nonspecific low back pain

    PubMed Central

    Chiarotto, Alessandro; Boers, Maarten; Deyo, Richard A.; Buchbinder, Rachelle; Corbin, Terry P.; Costa, Leonardo O.P.; Foster, Nadine E.; Grotle, Margreth; Koes, Bart W.; Kovacs, Francisco M.; Lin, C.-W. Christine; Maher, Chris G.; Pearson, Adam M.; Peul, Wilco C.; Schoene, Mark L.; Turk, Dennis C.; van Tulder, Maurits W.; Terwee, Caroline B.; Ostelo, Raymond W.

    2018-01-01

    Abstract To standardize outcome reporting in clinical trials of patients with nonspecific low back pain, an international multidisciplinary panel recommended physical functioning, pain intensity, and health-related quality of life (HRQoL) as core outcome domains. Given the lack of a consensus on measurement instruments for these 3 domains in patients with low back pain, this study aimed to generate such consensus. The measurement properties of 17 patient-reported outcome measures for physical functioning, 3 for pain intensity, and 5 for HRQoL were appraised in 3 systematic reviews following the COSMIN methodology. Researchers, clinicians, and patients (n = 207) were invited in a 2-round Delphi survey to generate consensus (≥67% agreement among participants) on which instruments to endorse. Response rates were 44% and 41%, respectively. In round 1, consensus was achieved on the Oswestry Disability Index version 2.1a for physical functioning (78% agreement) and the Numeric Rating Scale (NRS) for pain intensity (75% agreement). No consensus was achieved on any HRQoL instrument, although the Short Form 12 (SF12) approached the consensus threshold (64% agreement). In round 2, a consensus was reached on an NRS version with a 1-week recall period (96% agreement). Various participants requested 1 free-to-use instrument per domain. Considering all issues together, recommendations on core instruments were formulated: Oswestry Disability Index version 2.1a or 24-item Roland-Morris Disability Questionnaire for physical functioning, NRS for pain intensity, and SF12 or 10-item PROMIS Global Health form for HRQoL. Further studies need to fill the evidence gaps on the measurement properties of these and other instruments. PMID:29194127

  4. Learning disability and epilepsy. 2, a review of available outcome measures and position statement on development priorities.

    PubMed

    Espie, C A; Kerr, M; Paul, A; O'Brien, G; Betts, T; Clark, J; Jacoby, A; Baker, G

    1997-10-01

    People with epilepsy plus learning disabilities pose a challenge in terms of clinical management and research investigation, and, to date, the measurement of outcomes in this population has been limited. There have been uncertainties concerning both the 'what' and the 'how' of assessment. This paper presents a comprehensive review of available outcome measures across nine domains, i.e. relating to seizures, drugs, cognitive function, behaviour, social functioning, carer functioning, attitudes, motivation and 'quality of life'. This last domain reflects more global measures designed to encompass several assessment strands. The uses and limitations of each scale is discussed and, where data are available, psychometric properties are also presented. The paper concludes with suggestions for the further development of outcome measures in this population.

  5. Getting to Outcomes: A Best Practice Process to Help Schools Achieve Desired Outcomes

    ERIC Educational Resources Information Center

    Maras, Melissa A.; Wandersman, Abe; Splett, Joni Williams; Flaspohler, Paul; Weist, Mark

    2012-01-01

    This article describes Getting to Outcomes (GTO), a 10-step framework for accountability designed to facilitate effective implementation of evidence-based programs and improvement of home-grown practices (Getting to Outcomes and GTO are trademarks registered by the University of South Carolina and RAND; Wandersman, Imm, Chinman, & Kaftarian,…

  6. 48 CFR 9903.302-1 - Cost accounting practice.

    Code of Federal Regulations, 2010 CFR

    2010-10-01

    ..., or measurement of cost. (a) Measurement of cost, as used in this part, encompasses accounting methods... practice. Examples of cost accounting practices which involve measurement of costs are— (1) The use of... 48 Federal Acquisition Regulations System 7 2010-10-01 2010-10-01 false Cost accounting practice...

  7. Learning Outcome Measurement in Nurse Participants After Disaster Training.

    PubMed

    Farra, Sharon L; Smith, Sherrill; Bashaw, Marie A

    2016-10-01

    The National Disaster Health Consortium is an interprofessional disaster training program. Using the Hierarchical Learning Framework of Competency Sets in Disaster Medicine and Public Health, this program educates nurses and other professionals to provide competent care and leadership within the interprofessional team. This study examined outcomes of this training. Training consisted of a combination of online and on-site training. Learning outcomes were measured by using the Emergency Preparedness Information Questionnaire (EPIQ) pre/post training and participant performance during live functional exercises with the use of rubrics based on Homeland Security Exercise and Evaluation principles. A total of 64 participants completed the EPIQ before and after training. The mean EPIQ pre-training score of 154 and mean post-training score of 81 (reverse-scored) was found to be statistically significant by paired t-test (P<0.001). Performance was evaluated in the areas of triage, re-triage, surge response, and sheltering. Greater than 90% of the exercise criteria were either met or partially met. Participants successfully achieved overall objectives in all scenarios. Disaster response requires nurses and other providers to function in interprofessional teams. Educational projects, like the National Disaster Health Consortium program, offer the potential to address the need for a standardized, interprofessional disaster training curriculum to promote positive outcomes. (Disaster Med Public Health Preparedness. 2016;page 1 of 6).

  8. Consensus for tinnitus patient assessment and treatment outcome measurement: Tinnitus Research Initiative meeting, Regensburg, July 2006

    PubMed Central

    Langguth, B.; Goodey, R.; Azevedo, A.; Bjorne, A.; Cacace, A.; Crocetti, A.; Del Bo, L.; De Ridder, D.; Diges, I.; Elbert, T.; Flor, H.; Herraiz, C.; Sanchez, T. Ganz; Eichhammer, P.; Figueiredo, R.; Hajak, G.; Kleinjung, T.; Landgrebe, M.; Londero, A.; Lainez, M.J.A.; Mazzoli, M.; Meikle, M.B.; Melcher, J.; Rauschecker, J.P.; Sand, P.G.; Struve, M.; Van de Heyning, P.; Van Dijk, P.; Vergara, R.

    2014-01-01

    There is widespread recognition that consistency between research centres in the ways that patients with tinnitus are assessed and outcomes following interventions are measured would facilitate more effective co-operation and more meaningful evaluations and comparisons of outcomes. At the first Tinnitus Research Initiative meeting held in Regensburg in July 2006 an attempt was made through workshops to gain a consensus both for patient assessments and for outcome measurements. It is hoped that this will contribute towards better cooperation between research centres in finding and evaluating treatments for tinnitus by allowing better comparability between studies. PMID:17956816

  9. A systematic review of oral herpetic viral infections in cancer patients: commonly used outcome measures and interventions.

    PubMed

    Elad, Sharon; Ranna, Vinisha; Ariyawardana, Anura; Correa, Maria Elvira Pizzigatti; Tilly, Vanessa; Nair, Raj G; Rouleau, Tanya; Logan, Richard M; Pinto, Andres; Charette, Veronica; Saunders, Debbie P; Jensen, Siri Beier

    2017-02-01

    To review the literature for outcome measures for oral viral infections in cancer patients. A secondary aim was to update the Multinational Association of Supportive Care in Cancer/International Society of Oral Oncology (MASCC/ISOO) clinical practice guidelines for the management of oral viral infections in cancer patients. Databases were searched for articles published in the English language, 1981-2013. Studies that met the eligibility criteria were reviewed systematically. The data about the outcome measures were classified according to the aim of the study: prevention, treatment, or non-interventional. The results of interventional studies were compared to the 2010 MASCC/ISOO publication. Multiple clinical and laboratory tests were used to measure oral viral infections, with great variability between studies. Most of the studies were about Herpes Simplex Virus (HSV). The outcome measure that was most commonly used was the presence of HSV infection diagnosed based on a combination of suggestive clinical presentation with a positive laboratory result. HSV culture was the most commonly reported laboratory outcome measure. Acyclovir and valacyclovir were consistently reported to be efficacious in the management of oral herpetic infections. No new data on the quality of life and economic aspects was found. Considering the variability in outcome measures reported to assess oral herpetic infections the researcher should select carefully the appropriate measures based on the objective of the study. Acyclovir and valacyclovir are effective in the management of oral herpetic infections in patients receiving treatment for cancer. Studies on newer anti-viral drugs may be useful to address the issue of anti-viral resistance.

  10. Measuring Longitudinal Student Performance on Student Learning Outcomes in Sustainability Education

    ERIC Educational Resources Information Center

    Jarchow, Meghann E.; Formisano, Paul; Nordyke, Shane; Sayre, Matthew

    2018-01-01

    Purpose: The purpose of this paper is to describe the student learning outcomes (SLOs) for a sustainability major, evaluate faculty incorporation of the SLOs into the courses in the sustainability major curriculum and measure student performance on the SLOs from entry into the major to the senior capstone course. Design/methodology/approach:…

  11. Data for Improvement, Data for Accountability

    ERIC Educational Resources Information Center

    Weiss, Janet A.

    2012-01-01

    This commentary on the special issue on data use highlights the distinctions between data systems intended to improve the performance of school staff and those intended to hold schools and districts accountable for outcomes. It advises researchers to be alert to the differences in the policy logics connected with each approach.

  12. The Cultural Adaptability of Intermediate Measures of Functional Outcome in Schizophrenia*

    PubMed Central

    Rubin, Maureen; Fredrick, Megan M.; Mintz, Jim; Nuechterlein, Keith H.; Schooler, Nina R.; Jaeger, Judith; Peters, Nancy M.; Buller, Raimund; Marder, Stephen R.; Dube, Sanjay

    2012-01-01

    The Measurement and Treatment Research to Improve Cognition in Schizophrenia initiative was designed to encourage the development of cognitive enhancing agents for schizophrenia. For a medication to receive this indication, regulatory agencies require evidence of improvement in both cognition and functional outcome. Because medication trials are conducted across multiple countries, we examined ratings of the cross-cultural adaptability of 4 intermediate measures of functional outcome (Independent Living Scales, UCSD Performance-based Skills Assessment, Test of Adaptive Behavior in Schizophrenia, Cognitive Assessment Interview [CAI]) made by experienced clinical researchers at 31 sites in 8 countries. English-speaking research staff familiar with conducting medication trials rated the extent to which each subscale of each intermediate measure could be applied to their culture and to subgroups within their culture based on gender, geographic region, ethnicity, and socioeconomic status on the Cultural Adaptation Rating Scale. Ratings suggested that the CAI would be easiest to adapt across cultures. However, in a recent study, the CAI was found to have weaker psychometric properties than some of the other measures. Problems were identified for specific subscales on all the performance-based assessments across multiple countries. India, China, and Mexico presented the greatest challenges in adaptation. For international clinical trials, it would be important to use the measures that are most adaptable, to adapt subscales that are problematic for specific countries or regions, or to develop a battery composed of the subscales from different instruments that may be most acceptable across multiple cultures with minimal adaptation. PMID:21134973

  13. Quantitative outcome measures for systemic sclerosis-related Microangiopathy - Reliability of image acquisition in Nailfold Capillaroscopy.

    PubMed

    Dinsdale, Graham; Moore, Tonia; O'Leary, Neil; Berks, Michael; Roberts, Christopher; Manning, Joanne; Allen, John; Anderson, Marina; Cutolo, Maurizio; Hesselstrand, Roger; Howell, Kevin; Pizzorni, Carmen; Smith, Vanessa; Sulli, Alberto; Wildt, Marie; Taylor, Christopher; Murray, Andrea; Herrick, Ariane L

    2017-09-01

    Nailfold capillaroscopic parameters hold increasing promise as outcome measures for clinical trials in systemic sclerosis (SSc). Their inclusion as outcomes would often naturally require capillaroscopy images to be captured at several time points during any one study. Our objective was to assess repeatability of image acquisition (which has been little studied), as well as of measurement. 41 patients (26 with SSc, 15 with primary Raynaud's phenomenon) and 10 healthy controls returned for repeat high-magnification (300×) videocapillaroscopy mosaic imaging of 10 digits one week after initial imaging (as part of a larger study of reliability). Images were assessed in a random order by an expert blinded observer and 4 outcome measures extracted: (1) overall image grade and then (where possible) distal vessel locations were marked, allowing (2) vessel density (across the whole nailfold) to be calculated (3) apex width measurement and (4) giant vessel count. Intra-rater, intra-visit and intra-rater inter-visit (baseline vs. 1week) reliability were examined in 475 and 392 images respectively. A linear, mixed-effects model was used to estimate variance components, from which intra-class correlation coefficients (ICCs) were determined. Intra-visit and inter-visit reliability estimates (ICCs) were (respectively): overall image grade, 0.97 and 0.90; vessel density, 0.92 and 0.65; mean vessel width, 0.91 and 0.79; presence of giant capillary, 0.68 and 0.56. These estimates were conditional on each parameter being measurable. Within-operator image analysis and acquisition are reproducible. Quantitative nailfold capillaroscopy, at least with a single observer, provides reliable outcome measures for clinical studies including randomised controlled trials. Copyright © 2017 Elsevier Inc. All rights reserved.

  14. Acute care hospitals' accountability to provincial funders.

    PubMed

    Kromm, Seija K; Ross Baker, G; Wodchis, Walter P; Deber, Raisa B

    2014-09-01

    Ontario's acute care hospitals are subject to a number of tools, including legislation and performance measurement for fiscal accountability and accountability for quality. Examination of accountability documents used in Ontario at the government, regional and acute care hospital levels reveals three trends: (a) the number of performance measures being used in the acute care hospital sector has increased significantly; (b) the focus of the health system has expanded from accountability for funding and service volumes to include accountability for quality and patient safety; and (c) the accountability requirements are misaligned at the different levels. These trends may affect the success of the accountability approach currently being used. Copyright © 2014 Longwoods Publishing.

  15. Validation of Patient-Reported Outcomes Measurement Information System Computerized Adaptive Tests Against the Foot and Ankle Outcome Score for 6 Common Foot and Ankle Pathologies.

    PubMed

    Koltsov, Jayme C B; Greenfield, Stephen T; Soukup, Dylan; Do, Huong T; Ellis, Scott J

    2017-08-01

    The field of foot and ankle surgery lacks a widely accepted gold-standard patient-reported outcome instrument. With the changing infrastructure of the medical profession, more efficient patient-reported outcome tools are needed to reduce respondent burden and increase participation while providing consistent and reliable measurement across multiple pathologies and disciplines. The primary purpose of the present study was to validate 3 Patient-Reported Outcomes Measurement Information System computer adaptive tests (CATs) most relevant to the foot and ankle discipline against the Foot and Ankle Outcome Score (FAOS) and the Short Form 12 general health status survey in patients with 6 common foot and ankle pathologies. Patients (n = 240) indicated for operative treatment for 1 of 6 common foot and ankle pathologies completed the CATs, FAOS, and Short Form 12 at their preoperative surgical visits, 1 week subsequently (before surgery), and at 6 months postoperatively. The psychometric properties of the instruments were assessed and compared. The Patient-Reported Outcomes Measurement Information System CATs each took less than 1 minute to complete, whereas the FAOS took 6.5 minutes, and the Short Form 12 took 3 minutes. CAT scores were more normally distributed and had fewer floor and ceiling effects than those on the FAOS, which reached as high as 24%. The CATs were more precise than the FAOS and had similar responsiveness and test-retest reliability. The physical function and mobility CATs correlated strongly with the activities subscale of the FAOS, and the pain interference CAT correlated strongly with the pain subscale of the FAOS. The CATs and FAOS were responsive to changes with operative treatment for 6 common foot and ankle pathologies. The CATs performed as well as or better than the FAOS in all aspects of psychometric validity. The Patient-Reported Outcomes Measurement Information System CATs show tremendous potential for improving the study of patient

  16. The Accountable School Counselor

    ERIC Educational Resources Information Center

    Loesch, Larry, C.; Ritchie, Martin, H.

    2005-01-01

    This text addresses the critical need for today's school counselors to be accountable. Straight to the point and practical, The Accountable School Counselor demonstrates understanding of the demands on school counselors. Designed for easy implementation, this book offers resources, specific measures, and a system useful for counselors who are…

  17. Outcomes Measurement in Voice Disorders: Application of an Acoustic Index of Dysphonia Severity

    ERIC Educational Resources Information Center

    Awan, Shaheen N.; Roy, Nelson

    2009-01-01

    Purpose: The purpose of this experiment was to assess the ability of an acoustic model composed of both time-based and spectral-based measures to track change following voice disorder treatment and to serve as a possible treatment outcomes measure. Method: A weighted, four-factor acoustic algorithm consisting of shimmer, pitch sigma, the ratio of…

  18. Developing a Measure of Value in Health Care.

    PubMed

    Ken Lee, K H; Matthew Austin, J; Pronovost, Peter J

    2016-06-01

    There is broad support to pay for value, rather than volume, for health care in the United States. Despite the support, practical approaches for measuring value remain elusive. Value is commonly defined as quality divided by costs, where quality reflects patient outcomes and costs are the total costs for providing care, whether these be costs related to an episode, a diagnosis, or per capita. Academicians have proposed a conceptual approach to measure value, in which we measure outcomes important to patients and costs using time-driven activity-based costing. This approach is conceptually sound, but has significant practical challenges. In our commentary, we describe how health care can use existing quality measures and cost accounting data to measure value. Although not perfect, we believe this approach is practical, valid, and scalable and can establish the foundation for future work in this area. Copyright © 2016 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

  19. A Scoping Review of Physical Performance Outcome Measures Used in Exercise Interventions for Older Adults With Alzheimer Disease and Related Dementias.

    PubMed

    McGough, Ellen L; Lin, Shih-Yin; Belza, Basia; Becofsky, Katie M; Jones, Dina L; Liu, Minhui; Wilcox, Sara; Logsdon, Rebecca G

    2017-11-28

    There is growing evidence that exercise interventions can mitigate functional decline and reduce fall risk in older adults with Alzheimer disease and related dementias (ADRD). Although physical performance outcome measures have been successfully used in older adults without cognitive impairment, additional research is needed regarding their use with individuals who have ADRD, and who may have difficulty following instructions regarding performance of these measures. The purpose of this scoping review was to identify commonly used physical performance outcome measures, for exercise interventions, that are responsive and reliable in older adults with ADRD. Ultimately, we aimed to provide recommendations regarding the use of outcome measures for individuals with ADRD across several domains of physical performance. A scoping review was conducted to broadly assess physical performance outcome measures used in exercise interventions for older adults with ADRD. Exercise intervention studies that included at least 1 measure of physical performance were included. All physical performance outcome measures were abstracted, coded, and categorized into 5 domains of physical performance: fitness, functional mobility, gait, balance, and strength. Criteria for recommendations were based on (1) the frequency of use, (2) responsiveness, and (3) reliability. Frequency was determined by the number of studies that used the outcome measure per physical performance domain. Responsiveness was assessed via calculated effect size of the outcome measures across studies within physical performance domains. Reliability was evaluated via published studies of psychometric properties. A total of 20 physical performance outcome measures were extracted from 48 articles that met study inclusion criteria. The most frequently used outcome measures were the 6-minute walk test, Timed Up and Go, repeated chair stand tests, short-distance gait speed, the Berg Balance Scale, and isometric strength measures

  20. Can we decide which outcomes should be measured in every clinical trial? A scoping review of the existing conceptual frameworks and processes to develop core outcome sets.

    PubMed

    Idzerda, Leanne; Rader, Tamara; Tugwell, Peter; Boers, Maarten

    2014-05-01

    The usefulness of randomized control trials to advance clinical care depends upon the outcomes reported, but disagreement on the choice of outcome measures has resulted in inconsistency and the potential for reporting bias. One solution to this problem is the development of a core outcome set: a minimum set of outcome measures deemed critical for clinical decision making. Within rheumatology the Outcome Measures in Rheumatology (OMERACT) initiative has pioneered the development of core outcome sets since 1992. As the number of diseases addressed by OMERACT has increased and its experience in formulating core sets has grown, clarification and update of the conceptual framework and formulation of a more explicit process of area/domain core set development has become necessary. As part of the update process of the OMERACT Filter criteria to version 2, a literature review was undertaken to compare and contrast the OMERACT conceptual framework with others within and outside rheumatology. A scoping search was undertaken to examine the extent, range, and nature of conceptual frameworks for core set outcome selection in health. We searched the following resources: Cochrane Library Methods Group Register; Medline; Embase; PsycInfo; Environmental Studies and Policy Collection; and ABI/INFORM Global. We also conducted a targeted Google search. Five conceptual frameworks were identified: the WHO tripartite definition of health; the 5 Ds (discomfort, disability, drug toxicity, dollar cost, and death); the International Classification of Functioning (ICF); PROMIS (Patient-Reported Outcomes Measurement System); and the Outcomes Hierarchy. Of these, only the 5 Ds and ICF frameworks have been systematically applied in core set development. Outside the area of rheumatology, several core sets were identified; these had been developed through a limited range of consensus-based methods with varying degrees of methodological rigor. None applied a framework to ensure content validity of

  1. Validation of the Focus on the Outcomes of Communication under Six outcome measure

    PubMed Central

    Thomas-Stonell, Nancy; Oddson, Bruce; Robertson, Bernadette; Rosenbaum, Peter

    2013-01-01

    Aim The aim of this study was to establish the construct validity of the Focus on the Outcomes of Communication Under Six (FOCUS©),a tool designed to measure changes in communication skills in preschool children. Method Participating families' children (n=97; 68 males, 29 females; mean age 2y 8mo; SD 1.04y, range 10mo–4y 11mo) were recruited through eight Canadian organizations. The children were on a waiting list for speech and language intervention. Parents completed the Ages and Stages Questionnaire – Social/Emotional (ASQ-SE) and the FOCUS three times: at assessment and at the start and end of treatment. A second sample (n=28; 16 males 12 females) was recruited from another organization to correlate the FOCUS scores with speech, intelligibility and language measures. Second sample participants ranged in age from 3 years 1 month to 4 years 9 months (mean 3y 11mo; SD 0.41y). At the start and end of treatment, children were videotaped to obtain speech and language samples. Parents and speech–language pathologists (SLPs) independently completed the FOCUS tool. SLPs who were blind to the pre/post order of the videotapes analysed the samples. Results The FOCUS measured significantly more change (p<0.01) during treatment than during the waiting list period. It demonstrated both convergent and discriminant validity against the ASQ-SE. The FOCUS change corresponded to change measured by a combination of clinical speech and language measures (κ=0.31, p<0.05). Conclusion The FOCUS shows strong construct validity as a change-detecting instrument. PMID:23461266

  2. Trainee-associated outcomes in laparoscopic colectomy for cancer: propensity score analysis accounting for operative time, procedure complexity and patient comorbidity.

    PubMed

    Kasten, Kevin R; Celio, Adam C; Trakimas, Lauren; Manwaring, Mark L; Spaniolas, Konstantinos

    2018-02-01

    Surgical trainee association with operative outcomes is controversial. Studies are conflicting, possibly due to insufficient control of confounding variables such as operative time, case complexity, and heterogeneous patient populations. As operative complications worsen long-term outcomes in oncologic patients, understanding effect of trainee involvement during laparoscopic colectomy for cancer is of utmost importance. Here, we hypothesized that resident involvement was associated with worsened 30-day mortality and 30-day overall morbidity in this patient population. Patients undergoing laparoscopic colectomy for oncologic diagnosis from 2005 to 2012 were assessed using the American College of Surgeons National Surgical Quality Improvement Program dataset. Propensity score matching accounted for demographics, comorbidities, case complexity, and operative time. Attending only cases were compared to junior, middle, chief resident, and fellow level cohorts to assess primary outcomes of 30-day mortality and 30-day overall morbidity. A total of 13,211 patients met inclusion criteria, with 4075 (30.8%) cases lacking trainee involvement and 9136 (69.2%) involving a trainee. Following propensity matching, junior (PGY 1-2) and middle level (PGY 3-4) resident involvement was not associated with worsened outcomes. Chief (PGY 5) resident involvement was associated with worsened 30-day overall morbidity (15.5 vs. 18.6%, p = 0.01). Fellow (PGY > 5) involvement was associated with worsened 30-day overall morbidity (16.0 vs. 21.0%, p < 0.001), serious morbidity (9.3 vs. 13.5%, p < 0.001), minor morbidity (9.8 vs. 13.1%, p = 0.002), and surgical site infection (7.9 vs. 10.5%, p = 0.006). No differences were seen in 30-day mortality for any resident level. Following propensity-matched analysis of cancer patients undergoing laparoscopic colectomy, chief residents, and fellows were associated with worsened operative outcomes compared to attending along cases, while junior

  3. The Role of Patient-Reported Outcome Measures in Value-Based Payment Reform.

    PubMed

    Squitieri, Lee; Bozic, Kevin J; Pusic, Andrea L

    2017-06-01

    The U.S. health care system is currently experiencing profound change. Pressure to improve the quality of patient care and control costs have caused a rapid shift from traditional volume-driven fee-for-service reimbursement to value-based payment models. Under the 2015 Medicare Access and Children's Health Insurance Program Reauthorization Act, providers will be evaluated on the basis of quality and cost efficiency and ultimately receive adjusted reimbursement as per their performance. Although current performance metrics do not incorporate patient-reported outcome measures (PROMs), many wonder whether and how PROMs will eventually fit into value-based payment reform. On November 17, 2016, the second annual Patient-Reported Outcomes in Healthcare Conference brought together international stakeholders across all health care disciplines to discuss the potential role of PROs in value-based health care reform. The purpose of this article was to summarize the findings from this conference in the context of recent literature and guidelines to inform implementation of PROs in value-based payment models. Recommendations for evaluating key perspectives and measurement goals are made to facilitate appropriate use of PROMs to best benefit and amplify the voice of our patients. Copyright © 2017 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

  4. Measurement and control of bias in patient reported outcomes using multidimensional item response theory.

    PubMed

    Dowling, N Maritza; Bolt, Daniel M; Deng, Sien; Li, Chenxi

    2016-05-26

    Patient-reported outcome (PRO) measures play a key role in the advancement of patient-centered care research. The accuracy of inferences, relevance of predictions, and the true nature of the associations made with PRO data depend on the validity of these measures. Errors inherent to self-report measures can seriously bias the estimation of constructs assessed by the scale. A well-documented disadvantage of self-report measures is their sensitivity to response style (RS) effects such as the respondent's tendency to select the extremes of a rating scale. Although the biasing effect of extreme responding on constructs measured by self-reported tools has been widely acknowledged and studied across disciplines, little attention has been given to the development and systematic application of methodologies to assess and control for this effect in PRO measures. We review the methodological approaches that have been proposed to study extreme RS effects (ERS). We applied a multidimensional item response theory model to simultaneously estimate and correct for the impact of ERS on trait estimation in a PRO instrument. Model estimates were used to study the biasing effects of ERS on sum scores for individuals with the same amount of the targeted trait but different levels of ERS. We evaluated the effect of joint estimation of multiple scales and ERS on trait estimates and demonstrated the biasing effects of ERS on these trait estimates when used as explanatory variables. A four-dimensional model accounting for ERS bias provided a better fit to the response data. Increasing levels of ERS showed bias in total scores as a function of trait estimates. The effect of ERS was greater when the pattern of extreme responding was the same across multiple scales modeled jointly. The estimated item category intercepts provided evidence of content independent category selection. Uncorrected trait estimates used as explanatory variables in prediction models showed downward bias. A

  5. New Summary Measures of Population Health and Well-Being for Implementation by Health Plans and Accountable Care Organizations

    PubMed Central

    Gallagher, Jason M.; Rauri, Sachin; Tillema, Juliana O.; Pronk, Nicolaas P.; Knudson, Susan M.

    2016-01-01

    Health plans and accountable care organizations measure many indicators of patient health, with standard metrics that track factors such as patient experience and cost. They lack, however, a summary measure of the third leg of the Triple Aim, population health. In response, HealthPartners has developed summary measures that align with the recommendations of the For the Public’s Health series of reports from the Institute of Medicine. (The series comprises the following 3 reports: For the Public’s Health: Investing in a Healthier Future, For the Public’s Health: Revitalizing Law and Policy to Meet New Challenges, and For the Public’s Health: The Role of Measurement in Action and Accountability.) The summary measures comprise 3 components: current health, sustainability of health, and well-being. The measure of current health is disability-adjusted life years (DALYs) calculated from health care claims and death records. The sustainability of health measure comprises member reporting of 6 behaviors associated with health plus a clinical preventive services index that indicates adherence to evidence-based preventive care guidelines. Life satisfaction represents the summary measure of subjective well-being. HealthPartners will use the summary measures to identify and address conditions and factors that have the greatest impact on the health and well-being of its patients, members, and community. The method could easily be implemented by other institutions and organizations in the United States, helping to address a persistent need in population health measurement for improvement. PMID:27390075

  6. New Summary Measures of Population Health and Well-Being for Implementation by Health Plans and Accountable Care Organizations.

    PubMed

    Kottke, Thomas E; Gallagher, Jason M; Rauri, Sachin; Tillema, Juliana O; Pronk, Nicolaas P; Knudson, Susan M

    2016-07-07

    Health plans and accountable care organizations measure many indicators of patient health, with standard metrics that track factors such as patient experience and cost. They lack, however, a summary measure of the third leg of the Triple Aim, population health. In response, HealthPartners has developed summary measures that align with the recommendations of the For the Public's Health series of reports from the Institute of Medicine. (The series comprises the following 3 reports: For the Public's Health: Investing in a Healthier Future, For the Public's Health: Revitalizing Law and Policy to Meet New Challenges, and For the Public's Health: The Role of Measurement in Action and Accountability.) The summary measures comprise 3 components: current health, sustainability of health, and well-being. The measure of current health is disability-adjusted life years (DALYs) calculated from health care claims and death records. The sustainability of health measure comprises member reporting of 6 behaviors associated with health plus a clinical preventive services index that indicates adherence to evidence-based preventive care guidelines. Life satisfaction represents the summary measure of subjective well-being. HealthPartners will use the summary measures to identify and address conditions and factors that have the greatest impact on the health and well-being of its patients, members, and community. The method could easily be implemented by other institutions and organizations in the United States, helping to address a persistent need in population health measurement for improvement.

  7. Approaches to Accountability in Long-Term Care

    PubMed Central

    Berta, Whitney; Laporte, Audrey; Wodchis, Walter P.

    2014-01-01

    This paper discusses the array of approaches to accountability in Ontario long-term care (LTC) homes. A focus group involving key informants from the LTC industry, including both for-profit and not-for-profit nursing home owners/operators, was used to identify stakeholders involved in formulating and implementing LTC accountability approaches and the relevant regulations, policies and initiatives relating to accountability in the LTC sector. These documents were then systematically reviewed. We found that the dominant mechanisms have been financial incentives and oversight, regulations and information; professionalism has played a minor role. More recently, measurement for accountability in LTC has grown to encompass an array of fiscal, clinical and public accountability measurement mechanisms. The goals of improved quality and accountability are likely more achievable using these historical regulatory approaches, but the recent rapid increase in data and measurability could also enable judicious application of market-based approaches. PMID:25305396

  8. Methodological Issues in Examining Measurement Equivalence in Patient Reported Outcomes Measures: Methods Overview to the Two-Part Series, "Measurement Equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Short Forms".

    PubMed

    Teresi, Jeanne A; Jones, Richard N

    2016-01-01

    The purpose of this article is to introduce the methods used and challenges confronted by the authors of this two-part series of articles describing the results of analyses of measurement equivalence of the short form scales from the Patient Reported Outcomes Measurement Information System ® (PROMIS ® ). Qualitative and quantitative approaches used to examine differential item functioning (DIF) are reviewed briefly. Qualitative methods focused on generation of DIF hypotheses. The basic quantitative approaches used all rely on a latent variable model, and examine parameters either derived directly from item response theory (IRT) or from structural equation models (SEM). A key methods focus of these articles is to describe state-of-the art approaches to examination of measurement equivalence in eight domains: physical health, pain, fatigue, sleep, depression, anxiety, cognition, and social function. These articles represent the first time that DIF has been examined systematically in the PROMIS short form measures, particularly among ethnically diverse groups. This is also the first set of analyses to examine the performance of PROMIS short forms in patients with cancer. Latent variable model state-of-the-art methods for examining measurement equivalence are introduced briefly in this paper to orient readers to the approaches adopted in this set of papers. Several methodological challenges underlying (DIF-free) anchor item selection and model assumption violations are presented as a backdrop for the articles in this two-part series on measurement equivalence of PROMIS measures.

  9. Regional associations between Medicare Advantage penetration and administrative claims-based measures of hospital outcome

    PubMed Central

    Kulkarni, Vivek T.; Shah, Sachin J.; Bernheim, Susannah M.; Wang, Yongfei; Normand, Sharon-Lise T.; Han, Lein F.; Rapp, Michael T.; Drye, Elizabeth E.; Krumholz, Harlan M.

    2017-01-01

    Structured Abstract Background Risk-standardized measures of hospital outcomes reported by the Centers for Medicare and Medicaid Services (CMS) include Medicare fee-for-service (FFS) patients and exclude Medicare Advantage (MA) patients due to data availability. MA penetration varies greatly nationwide and appears associated with increased FFS population risk. Whether variation in MA penetration affects the performance on the CMS measures is unknown. Objective To determine whether the MA penetration rate is associated with outcomes measures based on fee-for-service patients. Research Design In this retrospective study, 2008 MA penetration was estimated at the Hospital Referral Region (HRR) level. Risk-standardized mortality rates (RSMRs), and risk-standardized readmission rates (RSRRs) for heart failure, acute myocardial infarction, and pneumonia from 2006–2008 were estimated among HRRs, along with several markers of FFS population risk. Weighted linear regression was used to test the association between each of these variables and MA penetration among HRRs. Results Among 304 HRRs, MA penetration varied greatly (median: 17.0%, range: 2.1% – 56.6%). Although MA penetration was significantly (p<0.05) associated with 5 of the 6 markers of FFS population risk, MA penetration was insignificantly (p≥0.05) associated with 5 of 6 hospital outcome measures. Conclusion RSMRs and RSRRs for heart failure, acute myocardial infarction, and pneumonia do not seem to differ systematically with MA penetration, lending support to the widespread use of these measures even in areas of high MA penetration. PMID:22456113

  10. Creating a Novel Video Vignette Stroke Preparedness Outcome Measure Using a Community-Based Participatory Approach.

    PubMed

    Skolarus, Lesli E; Murphy, Jillian B; Dome, Mackenzie; Zimmerman, Marc A; Bailey, Sarah; Fowlkes, Sophronia; Morgenstern, Lewis B

    2015-07-01

    Evaluating the efficacy of behavioral interventions for rare outcomes is a challenge. One such topic is stroke preparedness, defined as inteventions to increase stroke symptom recognition and behavioral intent to call 911. Current stroke preparedness intermediate outcome measures are centered on written vignettes or open-ended questions and have been shown to poorly reflect actual behavior. Given that stroke identification and action requires aural and visual processing, video vignettes may improve on current measures. This article discusses an approach for creating a novel stroke preparedness video vignette intermediate outcome measure within a community-based participatory research partnership. A total of 20 video vignettes were filmed of which 13 were unambiguous (stroke or not stroke) as determined by stroke experts and had test discrimination among community participants. Acceptable reliability, high satisfaction, and cultural relevance were found among the 14 community respondents. A community-based participatory approach was effective in creating a video vignette intermediate outcome. Future projects should consider obtaining expert and community feedback prior to filming all the video vignettes to improve the proportion of vignettes that are usable. While content validity and preliminary reliability were established, future studies are needed to confirm the reliability and establish construct validity. © 2014 Society for Public Health Education.

  11. Creating a Novel Video Vignette Stroke Preparedness Outcome Measure using a Community Based Participatory Approach

    PubMed Central

    Skolarus, Lesli E.; Murphy, Jillian B.; Dome, Mackenzie; Zimmerman, Marc A.; Bailey, Sarah; Fowlkes, Sophronia; Morgenstern, Lewis B.

    2015-01-01

    Evaluating the efficacy of behavioral interventions for rare outcomes is a challenge. One such topic is stroke preparedness, defined as inteventions to increase stroke symptom recognition and behavioral intent to call 911. Current stroke preparedness intermediate outcome measures are centered on written vignettes or open ended questions and have been shown to poorly reflect actual behavior. Given that stroke identification and action requires aural and visual processing, video vignettes may improve upon current measures. This article discusses an approach for creating a novel stroke preparedness video vignette intermediate outcome measure within a community based participatory research partnership. A total of 20 video vignettes were filmed of which 13 were unambiguous (stroke or not stroke) as determined by stroke experts and had test discrimination among community participants. Acceptable reliability, high satisfaction and cultural relevance were found among the 14 community respondents. A community based participatory approach was effective in creating a video vignette intermediate outcome. Future projects should consider obtaining expert and community feedback prior to filming all the video vignettes to improve the proportion of vignettes that are usable. While content validity and preliminary reliability were established, future studies are needed to confirm the reliability and establish construct validity. PMID:25367896

  12. 10 CFR 75.22 - Accounting records.

    Code of Federal Regulations, 2010 CFR

    2010-01-01

    ... 10 Energy 2 2010-01-01 2010-01-01 false Accounting records. 75.22 Section 75.22 Energy NUCLEAR... Accounting and Control for Facilities § 75.22 Accounting records. (a) The accounting records required by § 75... determination of the book inventory at any time; (2) All measurement results that are used for determination of...

  13. Accountable care around the world: a framework to guide reform strategies.

    PubMed

    McClellan, Mark; Kent, James; Beales, Stephen J; Cohen, Samuel I A; Macdonnell, Michael; Thoumi, Andrea; Abdulmalik, Mariam; Darzi, Ara

    2014-09-01

    Accountable care--a way to align health care payments with patient-focused reform goals--is currently being pursued in the United States, but its principles are also being applied in many other countries. In this article we review experiences with such reforms to offer a globally applicable definition of an accountable care system and propose a conceptual framework for characterizing and assessing accountable care reforms. The framework consists of five components: population, outcomes, metrics and learning, payments and incentives, and coordinated delivery. We describe how the framework applies to accountable care reforms that are already being implemented in Spain and Singapore. We also describe how it can be used to map progress through increasingly sophisticated levels of reforms. We recommend that policy makers pursuing accountable care reforms emphasize the following steps: highlight population health and wellness instead of just treating illness; pay for outcomes instead of activities; create a more favorable environment for collaboration and coordinated care; and promote interoperable data systems. Project HOPE—The People-to-People Health Foundation, Inc.

  14. Association between changes on the Negative Symptom Assessment scale (NSA-16) and measures of functional outcome in schizophrenia.

    PubMed

    Velligan, Dawn I; Alphs, Larry; Lancaster, Scott; Morlock, Robert; Mintz, Jim

    2009-09-30

    We examined whether changes in negative symptoms, as measured by scores on the 16-item Negative Symptom Assessment scale (NSA-16), were associated with changes in functional outcome. A group of 125 stable outpatients with schizophrenia were assessed at baseline and at 6 months using the NSA-16, the Brief Psychiatric Rating Scale, and multiple measures of functional outcome. Baseline adjusted regression coefficients indicated moderate correlations between negative symptoms and functional outcomes when baseline values of both variables were controlled. Results were nearly identical when we controlled for positive symptoms. Cross-lag panel correlations and Structural Equation Modeling were used to examine whether changes in negative symptoms drove changes in functional outcomes over time. Results indicated that negative symptoms drove the changes in the Social and Occupational Functioning Scale (SOFAS) rather than the reverse. Measures of Quality of Life and measures of negative symptoms may be assessing overlapping constructs or changes in both may be driven by a third variable. Negative symptoms were unrelated over time to scores on a performance-based measure of functional capacity. This study indicates that the relationship between negative symptom change and the change in functional outcomes is complex, and points to potential issues in selection of assessments.

  15. Magnetic resonance imaging-based measures predictive of short-term surgical outcome in patients with Chiari malformation Type I: a pilot study.

    PubMed

    Alperin, Noam; Loftus, James Ryan; Bagci, Ahmet M; Lee, Sang H; Oliu, Carlos J; Shah, Ashish H; Green, Barth A

    2017-01-01

    OBJECTIVE This study identifies quantitative imaging-based measures in patients with Chiari malformation Type I (CM-I) that are associated with positive outcomes after suboccipital decompression with duraplasty. METHODS Fifteen patients in whom CM-I was newly diagnosed underwent MRI preoperatively and 3 months postoperatively. More than 20 previously described morphological and physiological parameters were derived to assess quantitatively the impact of surgery. Postsurgical clinical outcomes were assessed in 2 ways, based on resolution of the patient's chief complaint and using a modified Chicago Chiari Outcome Scale (CCOS). Statistical analyses were performed to identify measures that were different between the unfavorable- and favorable-outcome cohorts. Multivariate analysis was used to identify the strongest predictors of outcome. RESULTS The strongest physiological parameter predictive of outcome was the preoperative maximal cord displacement in the upper cervical region during the cardiac cycle, which was significantly larger in the favorable-outcome subcohorts for both outcome types (p < 0.05). Several hydrodynamic measures revealed significantly larger preoperative-to-postoperative changes in the favorable-outcome subcohort. Predictor sets for the chief-complaint classification included the cord displacement, percent venous drainage through the jugular veins, and normalized cerebral blood flow with 93.3% accuracy. Maximal cord displacement combined with intracranial volume change predicted outcome based on the modified CCOS classification with similar accuracy. CONCLUSIONS Tested physiological measures were stronger predictors of outcome than the morphological measures in patients with CM-I. Maximal cord displacement and intracranial volume change during the cardiac cycle together with a measure that reflects the cerebral venous drainage pathway emerged as likely predictors of decompression outcome in patients with CM-I.

  16. Measurement properties of patient reported outcome measures for spondyloarthritis: A systematic review.

    PubMed

    Png, Kelly; Kwan, Yu Heng; Leung, Ying Ying; Phang, Jie Kie; Lau, Jia Qi; Lim, Ka Keat; Chew, Eng Hui; Low, Lian Leng; Tan, Chuen Seng; Thumboo, Julian; Fong, Warren; Østbye, Truls

    2018-03-21

    This systematic review aimed to identify studies investigating measurement properties of patient reported outcome measures (PROMs) for spondyloarthritis (SpA), and to evaluate their methodological quality and level of evidence relating to the measurement properties of PROMs. This systematic review was guided by the preferred reporting items for systematic review and meta-analysis (PRISMA). Articles published before 30 June 2017 were retrieved from PubMed ® , Embase ® , and PsychINFO ® (Ovid). Methodological quality and level of evidence were evaluated according to recommendations from the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN). We identified 60 unique PROMs from 125 studies in 39 countries. Twenty-one PROMs were validated for two or more SpA subtypes. The literature examined hypothesis testing (82.4%) most frequently followed by reliability (60.0%). A percentage of 77.7% and 42.7% of studies that assessed PROMs for hypothesis testing and reliability, respectively had "fair" or better methodological quality. Among the PROMs identified, 41.7% were studied in ankylosing spondylitis (AS) only and 23.3% were studied in psoriatic arthritis (PsA) only. The more extensively assessed PROMs included the ankylosing spondylitis quality of life (ASQoL) and bath ankylosing spondylitis functional index (BASFI) for ankylosing spondylitis, and the psoriatic arthritis quality of life questionnaire (VITACORA-19) for psoriatic arthritis. This study identified 60 unique PROMs through a systematic review and synthesized evidence of the measurement properties of the PROMs. There is a lack of validation of PROMs for use across SpA subtypes. Future studies may consider validating PROMs for use across different SpA subtypes. Copyright © 2018 Elsevier Inc. All rights reserved.

  17. Improving School Accountability Measures. NBER Working Paper Series.

    ERIC Educational Resources Information Center

    Kane, Thomas J.; Staiger, Douglas O.

    A growing number of states are using annual school-level test scores as part of their school accountability systems. This paper highlights an under-appreciated weakness of that approach, the imprecision of school-level test score means, and proposes a method for discerning signal from noise in annual school report cards. Using methods developed in…

  18. PROMIS GH (Patient-Reported Outcomes Measurement Information System Global Health) Scale in Stroke: A Validation Study.

    PubMed

    Katzan, Irene L; Lapin, Brittany

    2018-01-01

    The International Consortium for Health Outcomes Measurement recently included the 10-item PROMIS GH (Patient-Reported Outcomes Measurement Information System Global Health) scale as part of their recommended Standard Set of Stroke Outcome Measures. Before collection of PROMIS GH is broadly implemented, it is necessary to assess its performance in the stroke population. The objective of this study was to evaluate the psychometric properties of PROMIS GH in patients with ischemic stroke and intracerebral hemorrhage. PROMIS GH and 6 PROMIS domain scales measuring same/similar constructs were electronically collected on 1102 patients with ischemic and hemorrhagic strokes at various stages of recovery from their stroke who were seen in a cerebrovascular clinic from October 12, 2015, through June 2, 2017. Confirmatory factor analysis was performed to evaluate the adequacy of 2-factor structure of component scores. Test-retest reliability and convergent validity of PROMIS GH items and component scores were assessed. Discriminant validity and responsiveness were compared between PROMIS GH and PROMIS domain scales measuring the same or related constructs. Analyses were repeated stratified by stroke subtype and modified Rankin Scale score <2 versus ≥2. There was moderate internal reliability (ordinal α, 0.82-0.88) and marginal model fit for the 2-factor solution for component scores (root mean square error of approximation, 0.11). Convergent validity was good with significant correlations between all PROMIS GH items and PROMIS domain scales ( P <0.001 for all). There was excellent discrimination for all PROMIS GH items and component scores across modified Rankin Scale levels. Good responsiveness (effect size, >0.5) was demonstrated for 8 of the 10 PROMIS GH items. Reliability and validity remained consistent across stroke subtype and disability level (modified Rankin Scale, <2 versus ≥2). PROMIS GH exhibits acceptable performance in patients with stroke. Our findings

  19. Theoretical framework and methodological development of common subjective health outcome measures in osteoarthritis: a critical review

    PubMed Central

    Pollard, Beth; Johnston, Marie; Dixon, Diane

    2007-01-01

    Subjective measures involving clinician ratings or patient self-assessments have become recognised as an important tool for the assessment of health outcome. The value of a health outcome measure is usually assessed by a psychometric evaluation of its reliability, validity and responsiveness. However, psychometric testing involves an accumulation of evidence and has recognised limitations. It has been suggested that an evaluation of how well a measure has been developed would be a useful additional criteria in assessing the value of a measure. This paper explored the theoretical background and methodological development of subjective health status measures commonly used in osteoarthritis research. Fourteen subjective health outcome measures commonly used in osteoarthritis research were examined. Each measure was explored on the basis of their i) theoretical framework (was there a definition of what was being assessed and was it part of a theoretical model?) and ii) methodological development (what was the scaling strategy, how were the items generated and reduced, what was the response format and what was the scoring method?). Only the AIMS, SF-36 and WHOQOL defined what they were assessing (i.e. the construct of interest) and no measure assessed was part of a theoretical model. None of the clinician report measures appeared to have implemented a scaling procedure or described the rationale for the items selected or scoring system. Of the patient self-report measures, the AIMS, MPQ, OXFORD, SF-36, WHOQOL and WOMAC appeared to follow a standard psychometric scaling method. The DRP and EuroQol used alternative scaling methods. The review highlighted the general lack of theoretical framework for both clinician report and patient self-report measures. This review also drew attention to the wide variation in the methodological development of commonly used measures in OA. While, in general the patient self-report measures had good methodological development, the

  20. Family-centred service coordination in childhood health and disability services: the search for meaningful service outcome measures.

    PubMed

    Trute, B; Hiebert-Murphy, D; Wright, A

    2008-05-01

    Potential service outcome measures were tested for their utility in the assessment of the quality of 'family centred' service coordination in the provincial network of children's disability services in Manitoba, Canada. This study is based on in-home survey data provided by 103 mothers at 6 and 18 months following assignment of a 'dedicated' service coordinator. Service outcome indicators included measures of parent self-esteem, parenting stress, family functioning and the need for family support resources. Hierarchical regression analyses showed no relationship between level of quality of family-centred service coordination and standardized psychosocial measures of parent and family functioning. However, family centredness of service coordination was found to predict significant reduction in level of family need for psychosocial support resources after 18 months of contact with a service coordinator. Outcome measures that are focused on specific and tangible results of service coordination appear to be of higher utility in service quality assessment than are more global, standardized measures of parent and family functioning.