Reliable and valid tools for measuring surgeons' teaching performance: residents' vs. self evaluation.

PubMed

Boerebach, Benjamin C M; Arah, Onyebuchi A; Busch, Olivier R C; Lombarts, Kiki M J M H

2012-01-01

In surgical education, there is a need for educational performance evaluation tools that yield reliable and valid data. This paper describes the development and validation of robust evaluation tools that provide surgeons with insight into their clinical teaching performance. We investigated (1) the reliability and validity of 2 tools for evaluating the teaching performance of attending surgeons in residency training programs, and (2) whether surgeons' self evaluation correlated with the residents' evaluation of those surgeons. We surveyed 343 surgeons and 320 residents as part of a multicenter prospective cohort study of faculty teaching performance in residency training programs. The reliability and validity of the SETQ (System for Evaluation Teaching Qualities) tools were studied using standard psychometric techniques. We then estimated the correlations between residents' and surgeons' evaluations. The response rate was 87% among surgeons and 84% among residents, yielding 2625 residents' evaluations and 302 self evaluations. The SETQ tools yielded reliable and valid data on 5 domains of surgical teaching performance, namely, learning climate, professional attitude towards residents, communication of goals, evaluation of residents, and feedback. The correlations between surgeons' self and residents' evaluations were low, with coefficients ranging from 0.03 for evaluation of residents to 0.18 for communication of goals. The SETQ tools for the evaluation of surgeons' teaching performance appear to yield reliable and valid data. The lack of strong correlations between surgeons' self and residents' evaluations suggest the need for using external feedback sources in informed self evaluation of surgeons. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

The web-buffet--development and validation of an online tool to measure food choice.

PubMed

Bucher, Tamara; Keller, Carmen

2015-08-01

To date, no data exist on the agreement of food choice measured using an online tool with subsequent actual consumption. This needs to be shown before food choice, measured by means of an online tool, is used as a dependent variable to examine intake in the general population. A 'web-buffet' was developed to assess food choice. Choice was measured as planned meal composition from photographic material; respondents chose preferred foods and proportions for a main meal (out of a possible 144 combinations) online and the validity was assessed by comparison of a meal composed from a web-buffet with actual food intake 24-48 h later. Furthermore, correlations of food preferences, energy needs and health interest with meals chosen from the web-buffet were analysed. Students: n 106 (Study I), n 32 (Study II). Meals chosen from the web-buffet (mean = 2998 kJ, SD = 471 kJ) agreed with actual consumption (rs = 0.63, P < 0.001) but were on average 367 kJ (10.5%) lower in energy than consumed meals (mean = 3480 kJ, SD = 755 kJ). Preferences were highly associated with chosen amounts and health interest was negatively correlated with the energy selected (rs = -0.40, P<0.001). Meal composition choice in the web-buffet agrees sufficiently well with actual intake to measure food choice as a dependent variable in online surveys. However, we found an average underestimation of subsequent consumption. High correlations of preferences with chosen amounts and an inverse association of health interest with total energy further indicate the validity of the tool. Applications in behavioural nutrition research are discussed.

Is a sphygmomanometer a valid and reliable tool to measure the isometric strength of hip muscles? A systematic review.

PubMed

Toohey, Liam Anthony; De Noronha, Marcos; Taylor, Carolyn; Thomas, James

2015-02-01

Muscle strength measurement is a key component of physiotherapists' assessment and is frequently used as an outcome measure. A sphygmomanometer is an instrument commonly used to measure blood pressure that can be potentially used as a tool to assess isometric muscle strength. To systematically review the evidence on the reliability and validity of a sphygmomanometer for measuring isometric strength of hip muscles. A literature search was conducted across four databases. Studies were eligible if they presented data on reliability and/or validity, used a sphygmomanometer to measure isometric muscle strength of the hip region, and were peer reviewed. The individual studies were evaluated for quality using a standardized critical appraisal tool. A total of 644 articles were screened for eligibility, with five articles chosen for inclusion. The use of a sphygmomanometer to objectively assess isometric muscle strength of the hip muscles appears to be reliable with intraclass correlation coefficient values ranging from 0.66 to 0.94 in elderly and young populations. No studies were identified that have assessed the validity of a sphygmomanometer. The sphygmomanometer appears to be reliable for assessment of isometric muscle strength around the hip joint, but further research is warranted to establish its validity.

Validity of a self-report survey tool measuring the nutrition and physical activity environment of primary schools.

PubMed

Nathan, Nicole; Wolfenden, Luke; Morgan, Philip J; Bell, Andrew C; Barker, Daniel; Wiggers, John

2013-06-13

Valid tools measuring characteristics of the school environment associated with the physical activity and dietary behaviours of children are needed to accurately evaluate the impact of initiatives to improve school environments. The aim of this study was to assess the validity of Principal self-report of primary school healthy eating and physical activity environments. Primary school Principals (n = 42) in New South Wales, Australia were invited to complete a telephone survey of the school environment; the School Environment Assessment Tool - SEAT. Equivalent observational data were collected by pre-service teachers located within the school. The SEAT, involved 65 items that assessed food availability via canteens, vending machines and fundraisers and the presence of physical activity facilities, equipment and organised physical activities. Kappa statistics were used to assess agreement between the two measures. Almost 70% of the survey demonstrated moderate to almost perfect agreement. Substantial agreement was found for 10 of 13 items assessing foods sold for fundraising, 3 of 6 items assessing physical activity facilities of the school, and both items assessing organised physical activities that occurred at recess and lunch and school sport. Limited agreement was found for items assessing foods sold through canteens and access to small screen recreation. The SEAT provides researchers and policy makers with a valid tool for assessing aspects of the school food and physical activity environment.

Validity of a quantitative clinical measurement tool of trunk posture in idiopathic scoliosis.

PubMed

Fortin, Carole; Feldman, Debbie E; Cheriet, Farida; Labelle, Hubert

2010-09-01

Concurrent validity between postural indices obtained from digital photographs (two-dimensional [2D]), surface topography imaging (three-dimensional [3D]), and radiographs. To assess the validity of a quantitative clinical postural assessment tool of the trunk based on photographs (2D) as compared to a surface topography system (3D) as well as indices calculated from radiographs. To monitor progression of scoliosis or change in posture over time in young persons with idiopathic scoliosis (IS), noninvasive and nonionizing methods are recommended. In a clinical setting, posture can be quite easily assessed by calculating key postural indices from photographs. Quantitative postural indices of 70 subjects aged 10 to 20 years old with IS (Cobb angle, 15 degrees -60 degrees) were measured from photographs and from 3D trunk surface images taken in the standing position. Shoulder, scapula, trunk list, pelvis, scoliosis, and waist angles indices were calculated with specially designed software. Frontal and sagittal Cobb angles and trunk list were also calculated on radiographs. The Pearson correlation coefficients (r) was used to estimate concurrent validity of the 2D clinical postural tool of the trunk with indices extracted from the 3D system and with those obtained from radiographs. The correlation between 2D and 3D indices was good to excellent for shoulder, pelvis, trunk list, and thoracic scoliosis (0.81>r<0.97; P<0.01) but fair to moderate for thoracic kyphosis, lumbar lordosis, and thoracolumbar or lumbar scoliosis (0.30>r<0.56; P<0.05). The correlation between 2D and radiograph spinal indices was fair to good (-0.33 to -0.80 with Cobb angles and 0.76 for trunk list; P<0.05). This tool will facilitate clinical practice by monitoring trunk posture among persons with IS. Further, it may contribute to a reduction in the use of radiographs to monitor scoliosis progression.

AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Hamel, Candyce; Wells, George A; Bouter, Lex M; Kristjansson, Elizabeth; Grimshaw, Jeremy; Henry, David A; Boers, Maarten

2009-10-01

Our purpose was to measure the agreement, reliability, construct validity, and feasibility of a measurement tool to assess systematic reviews (AMSTAR). We randomly selected 30 systematic reviews from a database. Each was assessed by two reviewers using: (1) the enhanced quality assessment questionnaire (Overview of Quality Assessment Questionnaire [OQAQ]); (2) Sacks' instrument; and (3) our newly developed measurement tool (AMSTAR). We report on reliability (interobserver kappas of the 11 AMSTAR items), intraclass correlation coefficients (ICCs) of the sum scores, construct validity (ICCs of the sum scores of AMSTAR compared with those of other instruments), and completion times. The interrater agreement of the individual items of AMSTAR was substantial with a mean kappa of 0.70 (95% confidence interval [CI]: 0.57, 0.83) (range: 0.38-1.0). Kappas recorded for the other instruments were 0.63 (95% CI: 0.38, 0.78) for enhanced OQAQ and 0.40 (95% CI: 0.29, 0.50) for the Sacks' instrument. The ICC of the total score for AMSTAR was 0.84 (95% CI: 0.65, 0.92) compared with 0.91 (95% CI: 0.82, 0.96) for OQAQ and 0.86 (95% CI: 0.71, 0.94) for the Sacks' instrument. AMSTAR proved easy to apply, each review taking about 15 minutes to complete. AMSTAR has good agreement, reliability, construct validity, and feasibility. These findings need confirmation by a broader range of assessors and a more diverse range of reviews.

Development of a Content-Valid Standardized Orthopedic Assessment Tool (SOAT)

ERIC Educational Resources Information Center

Lafave, Mark; Katz, Larry; Butterwick, Dale

2008-01-01

Content validation of an instrument that measures student performance in OSCE-type practical examinations is a critical step in a tool's overall validity and reliability [Hopkins (1998), "Educational and Psychological Measurement and Evaluation" (8th ed.). Toronto: Allyn & Bacon]. The purpose of the paper is to outline the process…

Developing and Validating a New Classroom Climate Observation Assessment Tool

PubMed Central

Leff, Stephen S.; Thomas, Duane E.; Shapiro, Edward S.; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F.

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children’s psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression. PMID:21643447

Developing and Validating a New Classroom Climate Observation Assessment Tool.

PubMed

Leff, Stephen S; Thomas, Duane E; Shapiro, Edward S; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children's psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression.

Inter-agency communication and operations capabilities during a hospital functional exercise: reliability and validity of a measurement tool.

PubMed

Savoia, Elena; Biddinger, Paul D; Burstein, Jon; Stoto, Michael A

2010-01-01

As proxies for actual emergencies, drills and exercises can raise awareness, stimulate improvements in planning and training, and provide an opportunity to examine how different components of the public health system would combine to respond to a challenge. Despite these benefits, there remains a substantial need for widely accepted and prospectively validated tools to evaluate agencies' and hospitals' performance during such events. Unfortunately, to date, few studies have focused on addressing this need. The purpose of this study was to assess the validity and reliability of a qualitative performance assessment tool designed to measure hospitals' communication and operational capabilities during a functional exercise. The study population included 154 hospital personnel representing nine hospitals that participated in a functional exercise in Massachusetts in June 2008. A 25-item questionnaire was developed to assess the following three hospital functional capabilities: (1) inter-agency communication; (2) communication with the public; and (3) disaster operations. Analyses were conducted to examine internal consistency, associations among scales, the empirical structure of the items, and inter-rater agreement. Twenty-two questions were retained in the final instrument, which demonstrated reliability with alpha coefficients of 0.83 or higher for all scales. A three-factor solution from the principal components analysis accounted for 57% of the total variance, and the factor structure was consistent with the original hypothesized domains. Inter-rater agreement between participants' self reported scores and external evaluators' scores ranged from moderate to good. The resulting 22-item performance measurement tool reliably measured hospital capabilities in a functional exercise setting, with preliminary evidence of concurrent and criterion-related validity.

Single-item measures for depression and anxiety: Validation of the Screening Tool for Psychological Distress in an inpatient cardiology setting.

PubMed

Young, Quincy-Robyn; Nguyen, Michelle; Roth, Susan; Broadberry, Ann; Mackay, Martha H

2015-12-01

Depression and anxiety are common among patients with cardiovascular disease (CVD) and confer significant cardiac risk, contributing to CVD morbidity and mortality. Unfortunately, due to the lack of screening tools that address the specific needs of hospitalized patients, few cardiac inpatient programs offer routine screening for these forms of psychological distress, despite recommendations to do so. The purpose of this study was to validate single-item measures for depression and anxiety among cardiac inpatients. Consecutive inpatients were recruited from the cardiology and cardiac surgery step-down units at a university-affiliated, quaternary-care hospital. Subjects completed a questionnaire that included: (a) demographics, (b) single-item-measures for depression and anxiety (from the Screening Tool for Psychological Distress (STOP-D)), and (c) Hospital Anxiety and Depression Scale (HADS). One hundred and five participants were recruited with a wide variety of cardiac diagnoses, having a mean age of 66 years, and 28% were women. Both STOP-D items were highly correlated with their corresponding validated measures and demonstrated robust receiver-operator characteristic curves. Severity scores on both items correlated well with established severity cut-off scores on the corresponding subscales of the HADS. The STOP-D is a self-administered, self-report measure using two independent items that provide severity scores for depression and anxiety. The tool performs very well compared with other previously validated measures. Requiring no additional scoring and being free, STOP-D offers a simple and valid method for identifying hospitalized cardiac patients who are experiencing psychological distress. This crucial first step triggers initiation of appropriate monitoring and intervention, thus reducing the likelihood of the adverse cardiac outcomes associated with psychological distress. © The European Society of Cardiology 2014.

Assessing the efficacy of the Measure of Understanding of Macroevolution as a valid tool for undergraduate non-science majors

NASA Astrophysics Data System (ADS)

Romine, William Lee; Walter, Emily Marie

2014-11-01

Efficacy of the Measure of Understanding of Macroevolution (MUM) as a measurement tool has been a point of contention among scholars needing a valid measure for knowledge of macroevolution. We explored the structure and construct validity of the MUM using Rasch methodologies in the context of a general education biology course designed with an emphasis on macroevolution content. The Rasch model was utilized to quantify item- and test-level characteristics, including dimensionality, reliability, and fit with the Rasch model. Contrary to previous work, we found that the MUM provides a valid, reliable, and unidimensional scale for measuring knowledge of macroevolution in introductory non-science majors, and that its psychometric behavior does not exhibit large changes across time. While we found that all items provide productive measurement information, several depart substantially from ideal behavior, warranting a collective effort to improve these items. Suggestions for improving the measurement characteristics of the MUM at the item and test levels are put forward and discussed.

Improving Escalation of Care: Development and Validation of the Quality of Information Transfer Tool.

PubMed

Johnston, Maximilian J; Arora, Sonal; Pucher, Philip H; Reissis, Yannis; Hull, Louise; Huddy, Jeremy R; King, Dominic; Darzi, Ara

2016-03-01

To develop and provide validity and feasibility evidence for the QUality of Information Transfer (QUIT) tool. Prompt escalation of care in the setting of patient deterioration can prevent further harm. Escalation and information transfer skills are not currently measured in surgery. This study comprised 3 phases: the development (phase 1), validation (phase 2), and feasibility analysis (phase 3) of the QUIT tool. Phase 1 involved identification of core skills needed for successful escalation of care through literature review and 33 semistructured interviews with stakeholders. Phase 2 involved the generation of validity evidence for the tool using a simulated setting. Thirty surgeons assessed a deteriorating postoperative patient in a simulated ward and escalated their care to a senior colleague. The face and content validity were assessed using a survey. Construct and concurrent validity of the tool were determined by comparing performance scores using the QUIT tool with those measured using the Situation-Background-Assessment-Recommendation (SBAR) tool. Phase 3 was conducted using direct observation of escalation scenarios on surgical wards in 2 hospitals. A 7-category assessment tool was developed from phase 1 consisting of 24 items. Twenty-one of 24 items had excellent content validity (content validity index >0.8). All 7 categories and 18 of 24 (P < 0.05) items demonstrated construct validity. The correlation between the QUIT and SBAR tools used was strong indicating concurrent validity (r = 0.694, P < 0.001). Real-time scoring of escalation referrals was feasible and indicated that doctors currently have better information transfer skills than nurses when faced with a deteriorating patient. A validated tool to assess information transfer for deteriorating surgical patients was developed and tested using simulation and real-time clinical scenarios. It may improve the quality and safety of patient care on the surgical ward.

Is the Job Satisfaction Survey a good tool to measure job satisfaction amongst health workers in Nepal? Results of a validation analysis.

PubMed

Batura, Neha; Skordis-Worrall, Jolene; Thapa, Rita; Basnyat, Regina; Morrison, Joanna

2016-07-27

Job satisfaction is an important predictor of an individual's intention to leave the workplace. It is increasingly being used to consider the retention of health workers in low-income countries. However, the determinants of job satisfaction vary in different contexts, and it is important to use measurement methods that are contextually appropriate. We identified a measurement tool developed by Paul Spector, and used mixed methods to assess its validity and reliability in measuring job satisfaction among maternal and newborn health workers (MNHWs) in government facilities in rural Nepal. We administered the tool to 137 MNHWs and collected qualitative data from 78 MNHWs, and district and central level stakeholders to explore definitions of job satisfaction and factors that affected it. We calculated a job satisfaction index for all MNHWs using quantitative data and tested for validity, reliability and sensitivity. We conducted qualitative content analysis and compared the job satisfaction indices with qualitative data. Results from the internal consistency tests offer encouraging evidence of the validity, reliability and sensitivity of the tool. Overall, the job satisfaction indices reflected the qualitative data. The tool was able to distinguish levels of job satisfaction among MNHWs. However, the work environment and promotion dimensions of the tool did not adequately reflect local conditions. Further, community fit was found to impact job satisfaction but was not captured by the tool. The relatively high incidence of missing responses may suggest that responding to some statements was perceived as risky. Our findings indicate that the adapted job satisfaction survey was able to measure job satisfaction in Nepal. However, it did not include key contextual factors affecting job satisfaction of MNHWs, and as such may have been less sensitive than a more inclusive measure. The findings suggest that this tool can be used in similar settings and populations, with the

Development and validation of the Vietnamese primary care assessment tool

PubMed Central

2018-01-01

Objective To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. Design A quantitative cross sectional study. Setting 56 communes in 3 representative provinces of central Vietnam. Participants Total of 3289 people who used health care services at health facility at least once over the past two years. Results The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach’s alpha above 0.70 except for the subscale of Family Centeredness. Conclusions The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops. PMID:29324851

Development and validation of the Vietnamese primary care assessment tool.

PubMed

Hoa, Nguyen Thi; Tam, Nguyen Minh; Peersman, Wim; Derese, Anselme; Markuns, Jeffrey F

2018-01-01

To adapt the consumer version of the Primary Care Assessment Tool (PCAT) for Vietnam and determine its internal consistency and validity. A quantitative cross sectional study. 56 communes in 3 representative provinces of central Vietnam. Total of 3289 people who used health care services at health facility at least once over the past two years. The Vietnamese adult expanded consumer version of the PCAT (VN PCAT-AE) is an instrument for evaluation of primary care in Vietnam with 70 items comprising six scales representing four core primary care domains, and three additional scales representing three derivative domains. Sixteen other items from the original tool were not included in the final instrument, due to problems with missing values, floor or ceiling effects, and item-total correlations. All the retained scales have a Cronbach's alpha above 0.70 except for the subscale of Family Centeredness. The VN PCAT-AE demonstrates adequate internal consistency and validity to be used as an effective tool for measuring the quality of primary care in Vietnam from the consumer perspective. Additional work in the future to optimize valid measurement in all domains consistent with the original version of the tool may be helpful as the primary care system in Vietnam further develops.

[Elaboration and validation of a tool to measure psychological well-being: WBMMS].

PubMed

Massé, R; Poulin, C; Dassa, C; Lambert, J; Bélair, S; Battaglini, M A

1998-01-01

Psychological well-being scales used in epidemiologic surveys usually show high construct validity. The content validation, however, is less convincing since these scales rest on lists of items that reflect the theoretical model of the authors. In this study we present results of the construct and criterion validation of a new Well-Being Manifestations Measure Scale (WBMMS) founded on an initial list of manifestations derived from an original content validation in a general population. It is concluded that national and public health epidemiologic surveys should include both measures of positive and negative mental health.

Evaluation of the Validity and Response Burden of Patient Self-Report Measures of the Pain Assessment Screening Tool and Outcomes Registry (PASTOR).

PubMed

Cook, Karon F; Kallen, Michael A; Buckenmaier, Chester; Flynn, Diane M; Hanling, Steven R; Collins, Teresa S; Joltes, Kristin; Kwon, Kyung; Medina-Torne, Sheila; Nahavandi, Parisa; Suen, Joshua; Gershon, Richard

2017-07-01

In 2009, the Army Pain Management Task Force was chartered. On the basis of their findings, the Department of Defense recommended a comprehensive pain management strategy that included development of a standardized pain assessment system that would collect patient-reported outcomes data to inform the patient-provider clinical encounter. The result was the Pain Assessment Screening Tool and Outcomes Registry (PASTOR). The purpose of this study was to assess the validity and response burden of the patient-reported outcome measures in PASTOR. Data for analyses were collected from 681 individuals who completed PASTOR at baseline and follow-up as part of their routine clinical care. The survey tool included self-report measures of pain severity and pain interference (measured using the National Institutes of Health Patient-Reported Outcome Measurement Information System [PROMIS] and the Defense and Veterans Pain Rating scale). PROMIS measures of pain correlates also were administered. Validation analyses included estimation of score associations among measures, comparison of scores of known groups, responsiveness, ceiling and floor effects, and response burden. Results of psychometric testing provided substantial evidence for the validity of PASTOR self-report measures in this population. Expected associations among scores largely supported the concurrent validity of the measures. Scores effectively distinguished among respondents on the basis of their self-reported impressions of general health. PROMIS measures were administered using computer adaptive testing and each, on average, required less than 1 minute to administer. Statistical and graphical analyses demonstrated the responsiveness of PASTOR measures over time. Reprint & Copyright © 2017 Association of Military Surgeons of the U.S.

Measuring attitudes towards the dying process: A systematic review of tools.

PubMed

Groebe, Bernadette; Strupp, Julia; Eisenmann, Yvonne; Schmidt, Holger; Schlomann, Anna; Rietz, Christian; Voltz, Raymond

2018-04-01

At the end of life, anxious attitudes concerning the dying process are common in patients in Palliative Care. Measurement tools can identify vulnerabilities, resources and the need for subsequent treatment to relieve suffering and support well-being. To systematically review available tools measuring attitudes towards dying, their operationalization, the method of measurement and the methodological quality including generalizability to different contexts. Systematic review according to the PRISMA Statement. Methodological quality of tools assessed by standardized review criteria. MEDLINE, PsycINFO, PsyndexTests and the Health and Psychosocial Instruments were searched from their inception to April 2017. A total of 94 identified studies reported the development and/or validation of 44 tools. Of these, 37 were questionnaires and 7 alternative measurement methods (e.g. projective measures). In 34 of 37 questionnaires, the emotional evaluation (e.g. anxiety) towards dying is measured. Dying is operationalized in general items ( n = 20), in several specific aspects of dying ( n = 34) and as dying of others ( n = 14). Methodological quality of tools was reported inconsistently. Nine tools reported good internal consistency. Of 37 tools, 4 were validated in a clinical sample (e.g. terminal cancer; Huntington disease), indicating questionable generalizability to clinical contexts for most tools. Many tools exist to measure attitudes towards the dying process using different endpoints. This overview can serve as decision framework on which tool to apply in which contexts. For clinical application, only few tools were available. Further validation of existing tools and potential alternative methods in various populations is needed.

Visual Impairment Screening Assessment (VISA) tool: pilot validation.

PubMed

Rowe, Fiona J; Hepworth, Lauren R; Hanna, Kerry L; Howard, Claire

2018-03-06

To report and evaluate a new Vision Impairment Screening Assessment (VISA) tool intended for use by the stroke team to improve identification of visual impairment in stroke survivors. Prospective case cohort comparative study. Stroke units at two secondary care hospitals and one tertiary centre. 116 stroke survivors were screened, 62 by naïve and 54 by non-naïve screeners. Both the VISA screening tool and the comprehensive specialist vision assessment measured case history, visual acuity, eye alignment, eye movements, visual field and visual inattention. Full completion of VISA tool and specialist vision assessment was achieved for 89 stroke survivors. Missing data for one or more sections typically related to patient's inability to complete the assessment. Sensitivity and specificity of the VISA screening tool were 90.24% and 85.29%, respectively; the positive and negative predictive values were 93.67% and 78.36%, respectively. Overall agreement was significant; k=0.736. Lowest agreement was found for screening of eye movement and visual inattention deficits. This early validation of the VISA screening tool shows promise in improving detection accuracy for clinicians involved in stroke care who are not specialists in vision problems and lack formal eye training, with potential to lead to more prompt referral with fewer false positives and negatives. Pilot validation indicates acceptability of the VISA tool for screening of visual impairment in stroke survivors. Sensitivity and specificity were high indicating the potential accuracy of the VISA tool for screening purposes. Results of this study have guided the revision of the VISA screening tool ahead of full clinical validation. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2018. All rights reserved. No commercial use is permitted unless otherwise expressly granted.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi.

PubMed

Ruark, Allison; Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women's and men's couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships.

Measuring couple relationship quality in a rural African population: Validation of a Couple Functionality Assessment Tool in Malawi

PubMed Central

Chase, Rachel; Hembling, John; Davis, Valerie Rhoe; Perrin, Paul Clayton; Brewster-Lee, Dorothy

2017-01-01

Available data suggest that individual and family well-being are linked to the quality of women’s and men’s couple relationships, but few tools exist to assess couple relationship functioning in low- and middle-income countries. In response to this gap, Catholic Relief Services has developed a Couple Functionality Assessment Tool (CFAT) to capture valid and reliable data on various domains of relationship quality. This tool is designed to be used by interventions which aim to improve couple and family well-being as a means of measuring the effectiveness of these interventions, particularly related to couple relationship quality. We carried out a validation study of the CFAT among 401 married and cohabiting adults (203 women and 198 men) in rural Chikhwawa District, Malawi. Using psychometric scales, the CFAT addressed six domains of couple relationship quality (intimacy, partner support, sexual satisfaction, gender roles, decision-making, and communication and conflict management), and included questions on intimate partner violence. We used exploratory factor analysis to assess scale performance of each domain and produce a shortened Relationship Quality Index (RQI) composed of items from five relationship quality domains. This article reports the performance of the RQI. Internal reliability and validity of the RQI were found to be good. Regression analyses examined the relationship of the RQI to outcomes important to health and development: intra-household cooperation, positive health behaviors, intimate partner violence, and gender-equitable norms. We found many significant correlations between RQI scores and these couple- and family-level development issues. There is a need to further validate the tool with use in other populations as well as to continue to explore whether the observed linkages between couple functionality and development outcomes are causal relationships. PMID:29190769

Methodological challenges of validating a clinical decision-making tool in the practice environment.

PubMed

Brennan, Caitlin W; Daly, Barbara J

2015-04-01

Validating a measurement tool intended for use in the practice environment poses challenges that may not be present when validating a tool intended solely for research purposes. The aim of this article is to describe the methodological challenges of validating a clinical decision-making tool, the Oncology Acuity Tool, which nurses use to make nurse assignment and staffing decisions prospectively each shift. Data were derived from a larger validation study, during which several methodological challenges arose. Revisions to the tool, including conducting iterative feedback cycles with end users, were necessary before the validation study was initiated. The "true" value of patient acuity is unknown, and thus, two approaches to inter-rater reliability assessment were used. Discordant perspectives existed between experts and end users. Balancing psychometric rigor with clinical relevance may be achieved through establishing research-practice partnerships, seeking active and continuous feedback with end users, and weighing traditional statistical rules of thumb with practical considerations. © The Author(s) 2014.

Validation of a measurement tool to assess awareness of breast cancer.

PubMed

Linsell, Louise; Forbes, Lindsay J L; Burgess, Caroline; Kapari, Marcia; Thurnham, Angela; Ramirez, Amanda J

2010-05-01

Until now, there has been no universally accepted and validated measure of breast cancer awareness. This study aimed to validate the new Breast Cancer Awareness Measure (BCAM) which assesses, using a self-complete questionnaire, knowledge of breast cancer symptoms and age-related risk, and frequency of breast checking. We measured the psychometric properties of the BCAM in 1035 women attending the NHS Breast Screening Programme: acceptability was assessed using a feedback questionnaire (n=292); sensitivity to change after an intervention promoting breast cancer awareness (n=576), and test-retest reliability (n=167). We also assessed readability, and construct validity using the 'known-groups' method. The readability of the BCAM was high. Over 90% of women found it acceptable. The BCAM was sensitive to change: there was an increase in the proportion of women obtaining the full score for breast cancer awareness one month after receiving the intervention promoting breast cancer awareness; this was greater among those who received a more intensive version (less intensive version (booklet): 9.3%, 95% confidence interval (CI): 4.5-14.1%; more intensive version (interaction with health professional plus booklet): 30%, 95% CI: 23.4-36.6%). Test-retest reliability of the BCAM was moderate to good for most items. Cancer experts had higher levels of cancer awareness than non-medical academics (50% versus 6%, p=0.001), indicating good construct validity. The BCAM is a valid and robust measure of breast cancer awareness suitable for use in surveys of breast cancer awareness in the general population and to evaluate the impact of awareness-raising interventions. Copyright (c) 2010 Elsevier Ltd. All rights reserved.

Validation of an Open-Source Tool for Measuring Carotid Lumen Diameter and Intima-Media Thickness.

PubMed

Manterola, Hugo Luis; Lo Vercio, Lucas; Díaz, Alejandro; Del Fresno, Mariana; Larrabide, Ignacio

2018-05-14

In low- and middle-income regions, a relatively large number of deaths occur from cardiovascular disease or stroke. Carotid intima-media thickness (cIMT) and carotid lumen diameter (cLD) are strong indicators of cardiovascular event risk and stenosis severity, respectively. The interactive open-source software described here, Cimtool, is based on active contours for measuring these indicators in clinical practice and thus helping in preventive diagnosis and treatment. Cimtool was validated using carotid phantoms and real images obtained using ultrasound. Expert users measured cIMT and cLD in regular practice and also with Cimtool. The results obtained with Cimtool were then compared with the results for the manual approach in terms of measurement agreement, time spent on the measurements and usability. Intra-observer variability when using Cimtool was also analyzed. Statistical analysis revealed strong agreement between the manual method and Cimtool (p > 0.01 for cIMT and cLD). The correlation coefficient for both cIMT and cLD measurements was r > 0.9. Moreover, this software allowed the users to spend considerably less time on each measurement (3.5 min per study versus 50 s with Cimtool on average). An open-source, interactive, validated tool for measuring cIMT and cLD clinically was thus developed. Compared with the manual approach, Cimtool's straightforward measurement flow allows the user to spend less time per measurement and has less standard deviation. The coefficients of variation for measurements and intra-observer variability were lower than those reported for recent automated approaches, even with low-quality images. Copyright © 2018 World Federation for Ultrasound in Medicine and Biology. Published by Elsevier Inc. All rights reserved.

Solar Tower Experiments for Radiometric Calibration and Validation of Infrared Imaging Assets and Analysis Tools for Entry Aero-Heating Measurements

NASA Technical Reports Server (NTRS)

Splinter, Scott C.; Daryabeigi, Kamran; Horvath, Thomas J.; Mercer, David C.; Ghanbari, Cheryl M.; Ross, Martin N.; Tietjen, Alan; Schwartz, Richard J.

2008-01-01

The NASA Engineering and Safety Center sponsored Hypersonic Thermodynamic Infrared Measurements assessment team has a task to perform radiometric calibration and validation of land-based and airborne infrared imaging assets and tools for remote thermographic imaging. The IR assets and tools will be used for thermographic imaging of the Space Shuttle Orbiter during entry aero-heating to provide flight boundary layer transition thermography data that could be utilized for calibration and validation of empirical and theoretical aero-heating tools. A series of tests at the Sandia National Laboratories National Solar Thermal Test Facility were designed for this task where reflected solar radiation from a field of heliostats was used to heat a 4 foot by 4 foot test panel consisting of LI 900 ceramic tiles located on top of the 200 foot tall Solar Tower. The test panel provided an Orbiter-like entry temperature for the purposes of radiometric calibration and validation. The Solar Tower provided an ideal test bed for this series of radiometric calibration and validation tests because it had the potential to rapidly heat the large test panel to spatially uniform and non-uniform elevated temperatures. Also, the unsheltered-open-air environment of the Solar Tower was conducive to obtaining unobstructed radiometric data by land-based and airborne IR imaging assets. Various thermocouples installed on the test panel and an infrared imager located in close proximity to the test panel were used to obtain surface temperature measurements for evaluation and calibration of the radiometric data from the infrared imaging assets. The overall test environment, test article, test approach, and typical test results are discussed.

Time Domain Tool Validation Using ARES I-X Flight Data

NASA Technical Reports Server (NTRS)

Hough, Steven; Compton, James; Hannan, Mike; Brandon, Jay

2011-01-01

The ARES I-X vehicle was launched from NASA's Kennedy Space Center (KSC) on October 28, 2009 at approximately 11:30 EDT. ARES I-X was the first test flight for NASA s ARES I launch vehicle, and it was the first non-Shuttle launch vehicle designed and flown by NASA since Saturn. The ARES I-X had a 4-segment solid rocket booster (SRB) first stage and a dummy upper stage (US) to emulate the properties of the ARES I US. During ARES I-X pre-flight modeling and analysis, six (6) independent time domain simulation tools were developed and cross validated. Each tool represents an independent implementation of a common set of models and parameters in a different simulation framework and architecture. Post flight data and reconstructed models provide the means to validate a subset of the simulations against actual flight data and to assess the accuracy of pre-flight dispersion analysis. Post flight data consists of telemetered Operational Flight Instrumentation (OFI) data primarily focused on flight computer outputs and sensor measurements as well as Best Estimated Trajectory (BET) data that estimates vehicle state information from all available measurement sources. While pre-flight models were found to provide a reasonable prediction of the vehicle flight, reconstructed models were generated to better represent and simulate the ARES I-X flight. Post flight reconstructed models include: SRB propulsion model, thrust vector bias models, mass properties, base aerodynamics, and Meteorological Estimated Trajectory (wind and atmospheric data). The result of the effort is a set of independently developed, high fidelity, time-domain simulation tools that have been cross validated and validated against flight data. This paper presents the process and results of high fidelity aerospace modeling, simulation, analysis and tool validation in the time domain.

Development and preliminary validation of the EASE: a tool to measure perceived singing voice function.

PubMed

Phyland, Debra J; Pallant, Julie F; Benninger, Michael S; Thibeault, Susan L; Greenwood, Ken M; Smith, Julian A; Vallance, Neil

2013-07-01

Most voice self-rating tools are disease-specific measures and are not suitable for use with healthy voice users. There is a need for a tool that is sensitive to the subtleties of a singer's voice and to perceived physical changes in the singing voice mechanism as a function of load. The aim of this study was to devise and validate a scale to assess singer's perceptions of the current status of their singing voice. Ninety-five vocal health descriptors were collected from focus group interviews of singers. These were reviewed by 25 currently performing music theater (MT) singers. Based on a consensus technique, the number of descriptors was decreased to 42 items. These were administered to a sample of 284 professional MT singers using an online survey to evaluate their perception of current singing voice status. Principal component analysis identified two subsets of items. Rasch analysis was used to evaluate and refine these sets of items to form two 10-item subscales. Both subscales demonstrated good overall fit to the Rasch model, no differential item functioning by sex or age, and good internal consistency reliability. The two subscales were strongly correlated and subsequent Rasch analysis supported their combination to form a single 20-item scale with good psychometric properties. The Evaluation of the Ability to Sing Easily (EASE) is a concise clinical tool to assess singer's perceptions of the current status of their singing voice with good measurement properties. EASE may prove a useful tool to measure changes in the singing voice as indicators of the effect of vocal load. Furthermore, it may offer a valuable means for the prediction or screening of singers "at risk" of developing voice disorders. Copyright © 2013 The Voice Foundation. All rights reserved.

Development of a tool to measure person-centered maternity care in developing settings: validation in a rural and urban Kenyan population.

PubMed

Afulani, Patience A; Diamond-Smith, Nadia; Golub, Ginger; Sudhinaraset, May

2017-09-22

Person-centered reproductive health care is recognized as critical to improving reproductive health outcomes. Yet, little research exists on how to operationalize it. We extend the literature in this area by developing and validating a tool to measure person-centered maternity care. We describe the process of developing the tool and present the results of psychometric analyses to assess its validity and reliability in a rural and urban setting in Kenya. We followed standard procedures for scale development. First, we reviewed the literature to define our construct and identify domains, and developed items to measure each domain. Next, we conducted expert reviews to assess content validity; and cognitive interviews with potential respondents to assess clarity, appropriateness, and relevance of the questions. The questions were then refined and administered in surveys; and survey results used to assess construct and criterion validity and reliability. The exploratory factor analysis yielded one dominant factor in both the rural and urban settings. Three factors with eigenvalues greater than one were identified for the rural sample and four factors identified for the urban sample. Thirty of the 38 items administered in the survey were retained based on the factors loadings and correlation between the items. Twenty-five items load very well onto a single factor in both the rural and urban sample, with five items loading well in either the rural or urban sample, but not in both samples. These 30 items also load on three sub-scales that we created to measure dignified and respectful care, communication and autonomy, and supportive care. The Chronbach alpha for the main scale is greater than 0.8 in both samples, and that for the sub-scales are between 0.6 and 0.8. The main scale and sub-scales are correlated with global measures of satisfaction with maternity services, suggesting criterion validity. We present a 30-item scale with three sub-scales to measure person

Validity and reliability of the abdominal test and evaluation systems tool (ABTEST) to accurately measure abdominal force.

PubMed

Glenn, Jordan M; Galey, Madeline; Edwards, Abigail; Rickert, Bradley; Washington, Tyrone A

2015-07-01

Ability to generate force from the core musculature is a critical factor for sports and general activities with insufficiencies predisposing individuals to injury. This study evaluated isometric force production as a valid and reliable method of assessing abdominal force using the abdominal test and evaluation systems tool (ABTEST). Secondary analysis estimated 1-repetition maximum on commercially available abdominal machine compared to maximum force and average power on ABTEST system. This study utilized test-retest reliability and comparative analysis for validity. Reliability was measured using test-retest design on ABTEST. Validity was measured via comparison to estimated 1-repetition maximum on a commercially available abdominal device. Participants applied isometric, abdominal force against a transducer and muscular activation was evaluated measuring normalized electromyographic activity at the rectus-abdominus, rectus-femoris, and erector-spinae. Test, re-test force production on ABTEST was significantly correlated (r=0.84; p<0.001). Mean electromyographic activity for the rectus-abdominus (72.93% and 75.66%), rectus-femoris (6.59% and 6.51%), and erector-spinae (6.82% and 5.48%) were observed for trial-1 and trial-2, respectively. Significant correlations for the estimated 1-repetition maximum were found for average power (r=0.70, p=0.002) and maximum force (r=0.72, p<0.001). Data indicate the ABTEST can accurately measure rectus-abdominus force isolated from hip-flexor involvement. Negligible activation of erector-spinae substantiates little subjective effort among participants in the lower back. Results suggest ABTEST is a valid and reliable method of evaluating abdominal force. Copyright © 2014 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

School-based behavioral assessment tools are reliable and valid for measurement of fruit and vegetable intake, physical activity, and television viewing in young children.

PubMed

Economos, Christina D; Sacheck, Jennifer M; Kwan Ho Chui, Kenneth; Irizarry, Laura; Irizzary, Laura; Guillemont, Juliette; Collins, Jessica J; Hyatt, Raymond R

2008-04-01

Interventions aiming to modify the dietary and physical activity behaviors of young children require precise and accurate measurement tools. As part of a larger community-based project, three school-based questionnaires were developed to assess (a) fruit and vegetable intake, (b) physical activity and television (TV) viewing, and (c) perceived parental support for diet and physical activity. Test-retest reliability was performed on all questionnaires and validity was measured for fruit and vegetable intake, physical activity, and TV viewing. Eighty-four school children (8.3+/-1.1 years) were studied. Test-retest reliability was performed by administering questionnaires twice, 1 to 2 hours apart. Validity of the fruit and vegetable questionnaire was measured by direct observation, while the physical activity and TV questionnaire was validated by a parent phone interview. All three questionnaires yielded excellent test-retest reliability (P<0.001). The majority of fruit and vegetable questions and the questions regarding specific physical activities and TV viewing were valid. Low validity scores were found for questions on watching TV during breakfast or dinner. These questionnaires are reliable and valid tools to assess fruit and vegetable intake, physical activity, and TV viewing behaviors in early elementary school-aged children. Methods for assessment of children's TV viewing during meals should be further investigated because of parent-child discrepancies.

Reliability and criterion validity of measurements using a smart phone-based measurement tool for the transverse rotation angle of the pelvis during single-leg lifting.

PubMed

Jung, Sung-Hoon; Kwon, Oh-Yun; Jeon, In-Cheol; Hwang, Ui-Jae; Weon, Jong-Hyuck

2018-01-01

The purposes of this study were to determine the intra-rater test-retest reliability of a smart phone-based measurement tool (SBMT) and a three-dimensional (3D) motion analysis system for measuring the transverse rotation angle of the pelvis during single-leg lifting (SLL) and the criterion validity of the transverse rotation angle of the pelvis measurement using SBMT compared with a 3D motion analysis system (3DMAS). Seventeen healthy volunteers performed SLL with their dominant leg without bending the knee until they reached a target placed 20 cm above the table. This study used a 3DMAS, considered the gold standard, to measure the transverse rotation angle of the pelvis to assess the criterion validity of the SBMT measurement. Intra-rater test-retest reliability was determined using the SBMT and 3DMAS using intra-class correlation coefficient (ICC) [3,1] values. The criterion validity of the SBMT was assessed with ICC [3,1] values. Both the 3DMAS (ICC = 0.77) and SBMT (ICC = 0.83) showed excellent intra-rater test-retest reliability in the measurement of the transverse rotation angle of the pelvis during SLL in a supine position. Moreover, the SBMT showed an excellent correlation with the 3DMAS (ICC = 0.99). Measurement of the transverse rotation angle of the pelvis using the SBMT showed excellent reliability and criterion validity compared with the 3DMAS.

Ovarian and cervical cancer awareness: development of two validated measurement tools.

PubMed

Simon, Alice E; Wardle, Jane; Grimmett, Chloe; Power, Emily; Corker, Elizabeth; Menon, Usha; Matheson, Lauren; Waller, Jo

2012-07-01

The aim of the study was to develop and validate measures of awareness of symptoms and risk factors for ovarian and cervical cancer (Ovarian and Cervical Cancer Awareness Measures). Potentially relevant items were extracted from the literature and generated by experts. Four validation studies were carried out to establish reliability and validity. Women aged 21-67 years (n=146) and ovarian and cervical cancer experts (n=32) were included in the studies. Internal reliability was assessed psychometrically. Test-retest reliability was assessed over a 1-week interval. To establish construct validity, Cancer Awareness Measure (CAM) scores of cancer experts were compared with equally well-educated comparison groups. Sensitivity to change was tested by randomly assigning participants to read either a leaflet giving information about ovarian/cervical cancer or a leaflet with control information, and then completing the ovarian/cervical CAM. Internal reliability (Cronbach's α=0.88 for the ovarian CAM and α=0.84 for the cervical CAM) and test-retest reliability (r=0.84 and r=0.77 for the ovarian and cervical CAMs, respectively) were both high. Validity was demonstrated with cancer experts achieving higher scores than controls [ovarian CAM: t(36)= -5.6, p<0.001; cervical CAM: t(38)= -3.7, p=0.001], and volunteers who were randomised to read a cancer leaflet scored higher than those who received a control leaflet [ovarian CAM: t(49)=7.5, p<0.001; cervical CAM: t(48)= -5.5, p<0.001]. This study demonstrates the psychometric properties of the ovarian and cervical CAMs and supports their utility in assessing ovarian and cervical cancer awareness in the general population.

A Tool for Measuring Active Learning in the Classroom

PubMed Central

Devlin, John W.; Kirwin, Jennifer L.; Qualters, Donna M.

2007-01-01

Objectives To develop a valid and reliable active-learning inventory tool for use in large classrooms and compare faculty perceptions of active-learning using the Active-Learning Inventory Tool. Methods The Active-Learning Inventory Tool was developed using published literature and validated by national experts in educational research. Reliability was established by trained faculty members who used the Active-Learning Inventory Tool to observe 9 pharmacy lectures. Instructors were then interviewed to elicit perceptions regarding active learning and asked to share their perceptions. Results Per lecture, 13 (range: 4-34) episodes of active learning encompassing 3 (range: 2-5) different types of active learning occurred over 2.2 minutes (0.6-16) per episode. Both interobserver (≥87%) and observer-instructor agreement (≥68%) were high for these outcomes. Conclusions The Active-Learning Inventory Tool is a valid and reliable tool to measure active learning in the classroom. Future studies are needed to determine the impact of the Active-Learning Inventory Tool on teaching and its usefulness in other disciplines. PMID:17998982

Development and Validity Testing of an Arthritis Self-Management Assessment Tool.

PubMed

Oh, HyunSoo; Han, SunYoung; Kim, SooHyun; Seo, WhaSook

Because of the chronic, progressive nature of arthritis and the substantial effects it has on quality of life, patients may benefit from self-management. However, no valid, reliable self-management assessment tool has been devised for patients with arthritis. This study was conducted to develop a comprehensive self-management assessment tool for patients with arthritis, that is, the Arthritis Self-Management Assessment Tool (ASMAT). To develop a list of qualified items corresponding to the conceptual definitions and attributes of arthritis self-management, a measurement model was established on the basis of theoretical and empirical foundations. Content validity testing was conducted to evaluate whether listed items were suitable for assessing arthritis self-management. Construct validity and reliability of the ASMAT were tested. Construct validity was examined using confirmatory factor analysis and nomological validity. The 32-item ASMAT was developed with a sample composed of patients in a clinic in South Korea. Content validity testing validated the 32 items, which comprised medical (10 items), behavioral (13 items), and psychoemotional (9 items) management subscales. Construct validity testing of the ASMAT showed that the 32 items properly corresponded with conceptual constructs of arthritis self-management, and were suitable for assessing self-management ability in patients with arthritis. Reliability was also well supported. The ASMAT devised in the present study may aid the evaluation of patient self-management ability and the effectiveness of self-management interventions. The authors believe the developed tool may also aid the identification of problems associated with the adoption of self-management practice, and thus improve symptom management, independence, and quality of life of patients with arthritis.

Ovarian and cervical cancer awareness: development of two validated measurement tools

PubMed Central

Simon, Alice E; Wardle, Jane; Grimmett, Chloe; Power, Emily; Corker, Elizabeth; Menon, Usha; Matheson, Lauren; Waller, Jo

2012-01-01

Background The aim of the study was to develop and validate measures of awareness of symptoms and risk factors for ovarian and cervical cancer (Ovarian and Cervical Cancer Awareness Measures). Methods Potentially relevant items were extracted from the literature and generated by experts. Four validation studies were carried out to establish reliability and validity. Women aged 21–67 years (n=146) and ovarian and cervical cancer experts (n=32) were included in the studies. Internal reliability was assessed psychometrically. Test-retest reliability was assessed over a 1-week interval. To establish construct validity, Cancer Awareness Measure (CAM) scores of cancer experts were compared with equally well-educated comparison groups. Sensitivity to change was tested by randomly assigning participants to read either a leaflet giving information about ovarian/cervical cancer or a leaflet with control information, and then completing the ovarian/cervical CAM. Results Internal reliability (Cronbach's α=0.88 for the ovarian CAM and α=0.84 for the cervical CAM) and test-retest reliability (r=0.84 and r=0.77 for the ovarian and cervical CAMs, respectively) were both high. Validity was demonstrated with cancer experts achieving higher scores than controls [ovarian CAM: t(36)= –5.6, p<0.001; cervical CAM: t(38)= –3.7, p=0.001], and volunteers who were randomised to read a cancer leaflet scored higher than those who received a control leaflet [ovarian CAM: t(49)=7.5, p<0.001; cervical CAM: t(48)= –5.5, p<0.001]. Conclusions This study demonstrates the psychometric properties of the ovarian and cervical CAMs and supports their utility in assessing ovarian and cervical cancer awareness in the general population. PMID:21933805

Measuring awareness of financial skills: reliability and validity of a new measure.

PubMed

Cramer, K; Tuokko, H A; Mateer, C A; Hultsch, D F

2004-03-01

This paper examines the psychometric properties of a three-part (participant, informant, and performance) Measure for assessing Awareness of Financial Skills (MAFS). The MAFS was administered to 10 seniors with dementia and 25 well-functioning seniors, and their informants. Measures of cognitive functioning, social desirability, neuroticism, and perceived control were administered to each participant to allow for an assessment of validity. Internal consistency estimates for the participant and informant questionnaires were found to be 0.92 and 0.97, respectively. Convergent validity analysis indicated that performance on this measure was related to level of cognitive functioning, with higher level of unawareness associated with decreased cognitive ability. Discriminant validity analysis showed that performance on this measure was not related to social desirability or neuroticism. This study provides evidence that the MAFS is a reliable and valid tool for assessing awareness of financial skills in older adults.

An observation tool for instructor and student behaviors to measure in-class learner engagement: a validation study

PubMed Central

Alimoglu, Mustafa K.; Sarac, Didar B.; Alparslan, Derya; Karakas, Ayse A.; Altintas, Levent

2014-01-01

Background Efforts are made to enhance in-class learner engagement because it stimulates and enhances learning. However, it is not easy to quantify learner engagement. This study aimed to develop and validate an observation tool for instructor and student behaviors to determine and compare in-class learner engagement levels in four different class types delivered by the same instructor. Methods Observer pairs observed instructor and student behaviors during lectures in large class (LLC, n=2) with third-year medical students, lectures in small class (LSC, n=6) and case-based teaching sessions (CBT, n=4) with fifth-year students, and problem-based learning (PBL) sessions (~7 hours) with second-year students. The observation tool was a revised form of STROBE, an instrument for recording behaviors of an instructor and four randomly selected students as snapshots for 5-min cycles. Instructor and student behaviors were scored 1–5 on this tool named ‘in-class engagement measure (IEM)’. The IEM scores were parallel to the degree of behavior's contribution to active student engagement, so higher scores were associated with more in-class learner engagement. Additionally, the number of questions asked by the instructor and students were recorded. A total of 203 5-min observations were performed (LLC 20, LSC 85, CBT 50, and PBL 48). Results Interobserver agreement on instructor and student behaviors was 93.7% (κ=0.87) and 80.6% (κ=0.71), respectively. Higher median IEM scores were found in student-centered and problem-oriented methods such as CBT and PBL. A moderate correlation was found between instructor and student behaviors (r=0.689). Conclusions This study provides some evidence for validity of the IEM scores as a measure of student engagement in different class types. PMID:25308966

[Factor Analysis: Principles to Evaluate Measurement Tools for Mental Health].

PubMed

Campo-Arias, Adalberto; Herazo, Edwin; Oviedo, Heidi Celina

2012-09-01

The validation of a measurement tool in mental health is a complex process that usually starts by estimating reliability, to later approach its validity. Factor analysis is a way to know the number of dimensions, domains or factors of a measuring tool, generally related to the construct validity of the scale. The analysis could be exploratory or confirmatory, and helps in the selection of the items with better performance. For an acceptable factor analysis, it is necessary to follow some steps and recommendations, conduct some statistical tests, and rely on a proper sample of participants. Copyright © 2012 Asociación Colombiana de Psiquiatría. Publicado por Elsevier España. All rights reserved.

Validation to Spanish of the Caring Assessment Tool (CAT-V)

PubMed Central

Ayuso, Rosa María Fernández; Velázquez, Juan Manuel Morillo; Ayuso, David Fernández; de la Torre-Montero, Julio César

2017-01-01

Resume Objective: to translate and validate to Spanish the Caring Assessment Scale tool, CAT-V, by Joanne Duffy, within the framework of Jean Watson; as a secondary objective, it is proposed to evaluate its psychometric properties. There are tools designed to measure the patient’s perception of provided cares, including CAT-V, the subject of our interest, in a way that it can be used in Spanish-speaking patients. Methods: to meet the objectives, it was performed sequential translation and retro-translation of the scale to be validated, through a standardized procedure. The final version of that scale was validated in a sample of 349 patients from four public and two private hospitals in Madrid, Spain. Results: The instrument was translated and validated with high internal consistency (Cronbach’s alpha .953). The subsequent factor analysis revealed a three-factor structure, not coincident with the data from the US population. Conclusion: it is considered that the translation of CAT-V is a suitable instrument to be used in the evaluation of patient care in Ibero-american health centers whose language is Spanish. PMID:29069268

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

Investigating the Validity of Two Widely Used Quantitative Text Tools

ERIC Educational Resources Information Center

Cunningham, James W.; Hiebert, Elfrieda H.; Mesmer, Heidi Anne

2018-01-01

In recent years, readability formulas have gained new prominence as a basis for selecting texts for learning and assessment. Variables that quantitative tools count (e.g., word frequency, sentence length) provide valid measures of text complexity insofar as they accurately predict representative and high-quality criteria. The longstanding…

Validation and Further Validation of a Measure of Creative Identity among USA and Finland Pre-Service Music Teachers

ERIC Educational Resources Information Center

Randles, Clint; Muhonen, Sari

2015-01-01

The purpose of this study was to validate a measure of creative identity with a population of pre-service teachers in the USA, to further validate the measure with a Finnish population, and to compare both populations regarding their perceptions of themselves as creative musicians. The researcher developed a tool, the "Creative Identity…

Evaluation of tools used to measure calcium and/or dairy consumption in adults.

PubMed

Magarey, Anthea; Baulderstone, Lauren; Yaxley, Alison; Markow, Kylie; Miller, Michelle

2015-05-01

To identify and critique tools for the assessment of Ca and/or dairy intake in adults, in order to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles reporting on originally developed tools or testing the reliability or validity of existing tools that measure Ca and/or dairy intake in adults were included. Author-defined criteria for reporting reliability and validity properties were applied. Studies conducted in Western countries. Adults. Thirty papers, utilising thirty-six tools assessing intake of dairy, Ca or both, were identified. Reliability testing was conducted on only two dairy and five Ca tools, with results indicating that only one dairy and two Ca tools were reliable. Validity testing was conducted for all but four Ca-only tools. There was high reliance in validity testing on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful differences. Results of the validity testing suggest one dairy and five Ca tools are valid. Thus one tool was considered both reliable and valid for the assessment of dairy intake and only two tools proved reliable and valid for the assessment of Ca intake. While several tools are reliable and valid, their application across adult populations is limited by the populations in which they were tested. These results indicate a need for tools that assess Ca and/or dairy intake in adults to be rigorously tested for reliability and validity.

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Systematic Review of the Measurement Properties of Tools Used to Measure Behaviour Problems in Young Children with Autism.

PubMed

Hanratty, Jennifer; Livingstone, Nuala; Robalino, Shannon; Terwee, Caroline B; Glod, Magdalena; Oono, Inalegwu P; Rodgers, Jacqui; Macdonald, Geraldine; McConachie, Helen

2015-01-01

Behaviour problems are common in young children with autism spectrum disorder (ASD). There are many different tools used to measure behavior problems but little is known about their validity for the population. To evaluate the measurement properties of behaviour problems tools used in evaluation of intervention or observational research studies with children with ASD up to the age of six years. Behaviour measurement tools were identified as part of a larger, two stage, systematic review. First, sixteen major electronic databases, as well as grey literature and research registers were searched, and tools used listed and categorized. Second, using methodological filters, we searched for articles examining the measurement properties of the tools in use with young children with ASD in ERIC, MEDLINE, EMBASE, CINAHL, and PsycINFO. The quality of these papers was then evaluated using the COSMIN checklist. We identified twelve tools which had been used to measure behaviour problems in young children with ASD, and fifteen studies which investigated the measurement properties of six of these tools. There was no evidence available for the remaining six tools. Two questionnaires were found to be the most robust in their measurement properties, the Child Behavior Checklist and the Home Situations Questionnaire-Pervasive Developmental Disorders version. We found patchy evidence on reliability and validity, for only a few of the tools used to measure behaviour problems in young children with ASD. More systematic research is required on measurement properties of tools for use in this population, in particular to establish responsiveness to change which is essential in measurement of outcomes of intervention. CRD42012002223.

Validity and reliability of food security measures.

PubMed

Cafiero, Carlo; Melgar-Quiñonez, Hugo R; Ballard, Terri J; Kepple, Anne W

2014-12-01

This paper reviews some of the existing food security indicators, discussing the validity of the underlying concept and the expected reliability of measures under reasonably feasible conditions. The main objective of the paper is to raise awareness on existing trade-offs between different qualities of possible food security measurement tools that must be taken into account when such tools are proposed for practical application, especially for use within an international monitoring framework. The hope is to provide a timely, useful contribution to the process leading to the definition of a food security goal and the associated monitoring framework within the post-2015 Development Agenda. © 2014 New York Academy of Sciences.

Embedded performance validity testing in neuropsychological assessment: Potential clinical tools.

PubMed

Rickards, Tyler A; Cranston, Christopher C; Touradji, Pegah; Bechtold, Kathleen T

2018-01-01

The article aims to suggest clinically-useful tools in neuropsychological assessment for efficient use of embedded measures of performance validity. To accomplish this, we integrated available validity-related and statistical research from the literature, consensus statements, and survey-based data from practicing neuropsychologists. We provide recommendations for use of 1) Cutoffs for embedded performance validity tests including Reliable Digit Span, California Verbal Learning Test (Second Edition) Forced Choice Recognition, Rey-Osterrieth Complex Figure Test Combination Score, Wisconsin Card Sorting Test Failure to Maintain Set, and the Finger Tapping Test; 2) Selecting number of performance validity measures to administer in an assessment; and 3) Hypothetical clinical decision-making models for use of performance validity testing in a neuropsychological assessment collectively considering behavior, patient reporting, and data indicating invalid or noncredible performance. Performance validity testing helps inform the clinician about an individual's general approach to tasks: response to failure, task engagement and persistence, compliance with task demands. Data-driven clinical suggestions provide a resource to clinicians and to instigate conversation within the field to make more uniform, testable decisions to further the discussion, and guide future research in this area.

Validating an Observation Protocol to Measure Special Education Teacher Effectiveness

ERIC Educational Resources Information Center

Johnson, Evelyn S.; Semmelroth, Carrie L.

2015-01-01

This study used Kane's (2013) Interpretation/Use Argument (IUA) to measure validity on the Recognizing Effective Special Education Teachers (RESET) observation tool. The RESET observation tool is designed to evaluate special education teacher effectiveness using evidence-based instructional practices as the basis for evaluation. In alignment with…

Translating and validating a Training Needs Assessment tool into Greek

PubMed Central

Markaki, Adelais; Antonakis, Nikos; Hicks, Carolyn M; Lionis, Christos

2007-01-01

Background The translation and cultural adaptation of widely accepted, psychometrically tested tools is regarded as an essential component of effective human resource management in the primary care arena. The Training Needs Assessment (TNA) is a widely used, valid instrument, designed to measure professional development needs of health care professionals, especially in primary health care. This study aims to describe the translation, adaptation and validation of the TNA questionnaire into Greek language and discuss possibilities of its use in primary care settings. Methods A modified version of the English self-administered questionnaire consisting of 30 items was used. Internationally recommended methodology, mandating forward translation, backward translation, reconciliation and pretesting steps, was followed. Tool validation included assessing item internal consistency, using the alpha coefficient of Cronbach. Reproducibility (test – retest reliability) was measured by the kappa correlation coefficient. Criterion validity was calculated for selected parts of the questionnaire by correlating respondents' research experience with relevant research item scores. An exploratory factor analysis highlighted how the items group together, using a Varimax (oblique) rotation and subsequent Cronbach's alpha assessment. Results The psychometric properties of the Greek version of the TNA questionnaire for nursing staff employed in primary care were good. Internal consistency of the instrument was very good, Cronbach's alpha was found to be 0.985 (p < 0.001) and Kappa coefficient for reproducibility was found to be 0.928 (p < 0.0001). Significant positive correlations were found between respondents' current performance levels on each of the research items and amount of research involvement, indicating good criterion validity in the areas tested. Factor analysis revealed seven factors with eigenvalues of > 1.0, KMO (Kaiser-Meyer-Olkin) measure of sampling adequacy = 0.680 and

Techniques for Down-Sampling a Measured Surface Height Map for Model Validation

NASA Technical Reports Server (NTRS)

Sidick, Erkin

2012-01-01

This software allows one to down-sample a measured surface map for model validation, not only without introducing any re-sampling errors, but also eliminating the existing measurement noise and measurement errors. The software tool of the current two new techniques can be used in all optical model validation processes involving large space optical surfaces

The PRECIS-2 tool has good interrater reliability and modest discriminant validity.

PubMed

Loudon, Kirsty; Zwarenstein, Merrick; Sullivan, Frank M; Donnan, Peter T; Gágyor, Ildikó; Hobbelen, Hans J S M; Althabe, Fernando; Krishnan, Jerry A; Treweek, Shaun

2017-08-01

PRagmatic Explanatory Continuum Indicator Summary (PRECIS)-2 is a tool that could improve design insight for trialists. Our aim was to validate the PRECIS-2 tool, unlike its predecessor, testing the discriminant validity and interrater reliability. Over 80 international trialists, methodologists, clinicians, and policymakers created PRECIS-2 helping to ensure face validity and content validity. The interrater reliability of PRECIS-2 was measured using 19 experienced trialists who used PRECIS-2 to score a diverse sample of 15 randomized controlled trial protocols. Discriminant validity was tested with two raters to independently determine if the trial protocols were more pragmatic or more explanatory, with scores from the 19 raters for the 15 trials as predictors of pragmatism. Interrater reliability was generally good, with seven of nine domains having an intraclass correlation coefficient over 0.65. Flexibility (adherence) and recruitment had wide confidence intervals, but raters found these difficult to rate and wanted more information. Each of the nine PRECIS-2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains. We have assessed the validity and reliability of PRECIS-2. An elaboration study and web site provide guidance to help future users of the tool which is continuing to be tested by trial teams, systematic reviewers, and funders. Copyright © 2017 Elsevier Inc. All rights reserved.

Systematic Review of the Measurement Properties of Tools Used to Measure Behaviour Problems in Young Children with Autism

PubMed Central

Hanratty, Jennifer; Livingstone, Nuala; Robalino, Shannon; Terwee, Caroline B.; Glod, Magdalena; Oono, Inalegwu P.; Rodgers, Jacqui; Macdonald, Geraldine; McConachie, Helen

2015-01-01

Background Behaviour problems are common in young children with autism spectrum disorder (ASD). There are many different tools used to measure behavior problems but little is known about their validity for the population. Objectives To evaluate the measurement properties of behaviour problems tools used in evaluation of intervention or observational research studies with children with ASD up to the age of six years. Methods Behaviour measurement tools were identified as part of a larger, two stage, systematic review. First, sixteen major electronic databases, as well as grey literature and research registers were searched, and tools used listed and categorized. Second, using methodological filters, we searched for articles examining the measurement properties of the tools in use with young children with ASD in ERIC, MEDLINE, EMBASE, CINAHL, and PsycINFO. The quality of these papers was then evaluated using the COSMIN checklist. Results We identified twelve tools which had been used to measure behaviour problems in young children with ASD, and fifteen studies which investigated the measurement properties of six of these tools. There was no evidence available for the remaining six tools. Two questionnaires were found to be the most robust in their measurement properties, the Child Behavior Checklist and the Home Situations Questionnaire—Pervasive Developmental Disorders version. Conclusions We found patchy evidence on reliability and validity, for only a few of the tools used to measure behaviour problems in young children with ASD. More systematic research is required on measurement properties of tools for use in this population, in particular to establish responsiveness to change which is essential in measurement of outcomes of intervention. PROSPERO Registration Number CRD42012002223 PMID:26659821

Positioning Tool Validation Report

DTIC Science & Technology

1999-11-01

U.S. Coast Guard Research and Development Center 1082 Shennecossett Road, Groton, CT 06340-6096 Report No. CG-D-06-00 Positioning Tool...standard, specification, or regulation. Marc B. Mandler, Ph.D. Technical Director United States Coast Guard Research & Development Center 1082 ...Validation Report 7. Author(s) Jay Spalding i. Performing Organization Name and Address U.S. Coast Guard Research and Development Center 1082

Measuring Psychobiosocial States in Sport: Initial Validation of a Trait Measure

PubMed Central

Bertollo, Maurizio; Ruiz, Montse C.; Bortoli, Laura

2016-01-01

We examined the item characteristics, the factor structure, and the concurrent validity of a trait measure of psychobiosocial states. In Study 1, Italian athletes (N = 342, 228 men, 114 women, Mage = 23.93, SD = 6.64) rated the intensity, the frequency, and the perceived impact dimensions of a psychobiosocial states scale, trait version (PBS-ST), which is composed of 20 items (10 functional and 10 dysfunctional) referring to how they usually felt before an important competition. In Study 2, the scale was cross validated in an independent sample (N = 251, 181 men, 70 women, Mage = 24.35, SD = 7.25). The concurrent validity of the PBS-ST scale scores were also examined in comparison with two sport-specific emotion-related measures and a general measure of affect. Exploratory structural equation modeling and confirmatory factor analysis of the data of Study 1 showed that a 2-factor, 15-item solution of the PBS-ST scale (8 functional items and 7 dysfunctional items) reached satisfactory fit indices for the three dimensions (i.e., intensity, frequency, and perceived impact). Results of Study 2 provided evidence of substantial measurement and structural invariance of all dimensions across samples. The low association of the PBS-ST scale with other measures suggests that the scale taps unique constructs. Findings of the two studies offer initial validity evidence for a sport-specific tool to measure psychobiosocial states. PMID:27907111

Development and Validation of the Student Tool for Technology Literacy (ST[superscript 2]L)

ERIC Educational Resources Information Center

Hohlfeld, Tina N.; Ritzhaupt, Albert D.; Barron, Ann E.

2010-01-01

This article provides an overview of the development and validation of the Student Tool for Technology Literacy (ST[superscript 2]L). Developing valid and reliable objective performance measures for monitoring technology literacy is important to all organizations charged with equipping students with the technology skills needed to successfully…

Validation of the one pass measure for motivational interviewing competence.

PubMed

McMaster, Fiona; Resnicow, Ken

2015-04-01

This paper examines the psychometric properties of the OnePass coding system: a new, user-friendly tool for evaluating practitioner competence in motivational interviewing (MI). We provide data on reliability and validity with the current gold-standard: Motivational Interviewing Treatment Integrity tool (MITI). We compared scores from 27 videotaped MI sessions performed by student counselors trained in MI and simulated patients using both OnePass and MITI, with three different raters for each tool. Reliability was estimated using intra-class coefficients (ICCs), and validity was assessed using Pearson's r. OnePass had high levels of inter-rater reliability with 19/23 items found from substantial to almost perfect agreement. Taking the pair of scores with the highest inter-rater reliability on the MITI, the concurrent validity between the two measures ranged from moderate to high. Validity was highest for evocation, autonomy, direction and empathy. OnePass appears to have good inter-rater reliability while capturing similar dimensions of MI as the MITI. Despite the moderate concurrent validity with the MITI, the OnePass shows promise in evaluating both traditional and novel interpretations of MI. OnePass may be a useful tool for developing and improving practitioner competence in MI where access to MITI coders is limited. Copyright © 2015. Published by Elsevier Ireland Ltd.

Traceability of On-Machine Tool Measurement: A Review.

PubMed

Mutilba, Unai; Gomez-Acedo, Eneko; Kortaberria, Gorka; Olarra, Aitor; Yagüe-Fabra, Jose A

2017-07-11

Nowadays, errors during the manufacturing process of high value components are not acceptable in driving industries such as energy and transportation. Sectors such as aerospace, automotive, shipbuilding, nuclear power, large science facilities or wind power need complex and accurate components that demand close measurements and fast feedback into their manufacturing processes. New measuring technologies are already available in machine tools, including integrated touch probes and fast interface capabilities. They provide the possibility to measure the workpiece in-machine during or after its manufacture, maintaining the original setup of the workpiece and avoiding the manufacturing process from being interrupted to transport the workpiece to a measuring position. However, the traceability of the measurement process on a machine tool is not ensured yet and measurement data is still not fully reliable enough for process control or product validation. The scientific objective is to determine the uncertainty on a machine tool measurement and, therefore, convert it into a machine integrated traceable measuring process. For that purpose, an error budget should consider error sources such as the machine tools, components under measurement and the interactions between both of them. This paper reviews all those uncertainty sources, being mainly focused on those related to the machine tool, either on the process of geometric error assessment of the machine or on the technology employed to probe the measurand.

Traceability of On-Machine Tool Measurement: A Review

PubMed Central

Gomez-Acedo, Eneko; Kortaberria, Gorka; Olarra, Aitor

2017-01-01

Nowadays, errors during the manufacturing process of high value components are not acceptable in driving industries such as energy and transportation. Sectors such as aerospace, automotive, shipbuilding, nuclear power, large science facilities or wind power need complex and accurate components that demand close measurements and fast feedback into their manufacturing processes. New measuring technologies are already available in machine tools, including integrated touch probes and fast interface capabilities. They provide the possibility to measure the workpiece in-machine during or after its manufacture, maintaining the original setup of the workpiece and avoiding the manufacturing process from being interrupted to transport the workpiece to a measuring position. However, the traceability of the measurement process on a machine tool is not ensured yet and measurement data is still not fully reliable enough for process control or product validation. The scientific objective is to determine the uncertainty on a machine tool measurement and, therefore, convert it into a machine integrated traceable measuring process. For that purpose, an error budget should consider error sources such as the machine tools, components under measurement and the interactions between both of them. This paper reviews all those uncertainty sources, being mainly focused on those related to the machine tool, either on the process of geometric error assessment of the machine or on the technology employed to probe the measurand. PMID:28696358

Development and validation of a cancer-specific swallowing assessment tool: MASA-C.

PubMed

Carnaby, Giselle D; Crary, Michael A

2014-03-01

We present data from a sample of patients receiving radiotherapy for head/neck cancer to define and measure the validity of a new clinical assessment measure for swallowing. Fifty-eight patients undergoing radiotherapy (±chemotherapy) for head/neck cancer (HNC) supported the development of a physiology-based assessment tool of swallowing (Mann Assessment of Swallowing Ability--Cancer: MASA-C) administered at two time points (baseline and following radiotherapy treatment). The new exam was evaluated for internal consistency of items using Cronbach's alpha. Reliability of measurement was evaluated with intraclass correlation (ICC) and the Kappa statistic between two independent raters. Concurrent validity was established through comparison with the original MASA examination and against the referent standard videofluoroscopic swallowing examination (VFE). Sensitivity, specificity, and likelihood ratios along with 95 % confidence intervals (CIs) were derived for comparison of the two evaluation forms (MASA vs. MASA-C). Accuracy of diagnostic precision was displayed using receiver operator characteristic curves. The new MASA-C tool demonstrated superior validity to the original MASA examination applied to a HNC population. In comparison to the VFE referent exam, the MASA-C revealed strong sensitivity and specificity (Se 83, Sp 96), predictive values (positive predictive value (PPV) 0.95, negative predictive value (NPV) 0.86), and likelihood ratios (21.6). In addition, it demonstrated good reliability (ICC = 0.96) between speech-language pathology raters. The MASA-C is a reliable and valid scale that is sensitive to differences in swallowing performance in HNC patients with and without dysphagia. Future longitudinal evaluation of this tool in larger samples is suggested. The development and refinement of this swallowing assessment tool for use in multidisciplinary HNC teams will facilitate earlier identification of patients with swallowing difficulties and enable

A Turkish Version of the Critical-Care Pain Observation Tool: Reliability and Validity Assessment.

PubMed

Aktaş, Yeşim Yaman; Karabulut, Neziha

2017-08-01

The study aim was to evaluate the validity and reliability of the Critical-Care Pain Observation Tool in critically ill patients. A repeated measures design was used for the study. A convenience sample of 66 patients who had undergone open-heart surgery in the cardiovascular surgery intensive care unit in Ordu, Turkey, was recruited for the study. The patients were evaluated by using the Critical-Care Pain Observation Tool at rest, during a nociceptive procedure (suctioning), and 20 minutes after the procedure while they were conscious and intubated after surgery. The Turkish version of the Critical-Care Pain Observation Tool has shown statistically acceptable levels of validity and reliability. Inter-rater reliability was supported by moderate-to-high-weighted κ coefficients (weighted κ coefficient = 0.55 to 1.00). For concurrent validity, significant associations were found between the scores on the Critical-Care Pain Observation Tool and the Behavioral Pain Scale scores. Discriminant validity was also supported by higher scores during suctioning (a nociceptive procedure) versus non-nociceptive procedures. The internal consistency of the Critical-Care Pain Observation Tool was 0.72 during a nociceptive procedure and 0.71 during a non-nociceptive procedure. The validity and reliability of the Turkish version of the Critical-Care Pain Observation Tool was determined to be acceptable for pain assessment in critical care, especially for patients who cannot communicate verbally. Copyright © 2016 American Society of PeriAnesthesia Nurses. Published by Elsevier Inc. All rights reserved.

Measuring maternal satisfaction with maternity care: A systematic integrative review: What is the most appropriate, reliable and valid tool that can be used to measure maternal satisfaction with continuity of maternity care?

PubMed

Perriman, Noelyn; Davis, Deborah

2016-06-01

The objective of this systematic integrative review is to identify, summarise and communicate the findings of research relating to tools that measure maternal satisfaction with continuity of maternity care models. In so doing the most appropriate, reliable and valid tool that can be used to measure maternal satisfaction with continuity of maternity care will be determined. A systematic integrative review of published and unpublished literature was undertaken using selected databases. Research papers were included if they measured maternal satisfaction in a continuity model of maternity care, were published in English after 1999 and if they included (or made available) the instrument used to measure satisfaction. Six hundred and thirty two unique papers were identified and after applying the selection criteria, four papers were included in the review. Three of these originated in Australia and one in Canada. The primary focus of all papers was not on the development of a tool to measure maternal satisfaction but on the comparison of outcomes in different models of care. The instruments developed varied in terms of the degree to which they were tested for validity and reliability. Women's satisfaction with maternity services is an important measure of quality. Most satisfaction surveys in maternity appear to reflect fragmented models of care though continuity of care models are increasing in line with the evidence demonstrating their effectiveness. It is important that robust tools are developed for this context and that there is some consistency in the way this is measured and reported for the purposes of benchmarking and quality improvement. Copyright © 2016 Australian College of Midwives. Published by Elsevier Ltd. All rights reserved.

Methods for assessing reliability and validity for a measurement tool: a case study and critique using the WHO haemoglobin colour scale.

PubMed

White, Sarah A; van den Broek, Nynke R

2004-05-30

Before introducing a new measurement tool it is necessary to evaluate its performance. Several statistical methods have been developed, or used, to evaluate the reliability and validity of a new assessment method in such circumstances. In this paper we review some commonly used methods. Data from a study that was conducted to evaluate the usefulness of a specific measurement tool (the WHO Colour Scale) is then used to illustrate the application of these methods. The WHO Colour Scale was developed under the auspices of the WHO to provide a simple portable and reliable method of detecting anaemia. This Colour Scale is a discrete interval scale, whereas the actual haemoglobin values it is used to estimate are on a continuous interval scale and can be measured accurately using electrical laboratory equipment. The methods we consider are: linear regression, correlation coefficients, paired t-tests plotting differences against mean values and deriving limits of agreement; kappa and weighted kappa statistics, sensitivity and specificity, an intraclass correlation coefficient and the repeatability coefficient. We note that although the definition and properties of each of these methods is well established inappropriate methods continue to be used in medical literature for assessing reliability and validity, as evidenced in the context of the evaluation of the WHO Colour Scale. Copyright 2004 John Wiley & Sons, Ltd.

Development and testing of a DVT risk assessment tool: providing evidence of validity and reliability.

PubMed

McCaffrey, Ruth; Bishop, Mary; Adonis-Rizzo, Marie; Williamson, Ellen; McPherson, Melanie; Cruikshank, Alice; Carrier, Vicki Jo; Sands, Simone; Pigano, Diane; Girard, Patricia; Lauzon, Cathy

2007-01-01

Hospital-acquired deep vein thrombosis (DVT) and pulmonary embolisms (PE) are preventable problems that can increase mortality. Early assessment and recognition of risk as well as initiating appropriate prevention measures can prevent DVT or PE. The purpose of this research project was to develop a DVT risk assessment tool and test the tool for validity and reliability. Three phases were undertaken in developing and testing the JFK Medical Center DVT risk assessment tool. Investigation and clarification of risk and predisposing factors for DVT were identified from the literature, expert nursing knowledge, and medical staff input. Second, item development and weighting were undertaken. Third, parametric testing for content validity measured the differences in mean assessment tool scores between a group of patients who developed DVT in the hospital and a demographically similar group who did not develop DVT. Interrater reliability was measured by having three different nurses score each patient and compare the differences in scores among the three. The DVT group had significantly higher scores on the JFK DVT assessment scale than did those who did not experience DVT. Interrater reliability showed a strong correlation among the scores of the three nurses (.98). Providing a valid and reliable tool for measuring the risk for DVT or PE in hospitalized patients will enable nurses to intervene early in patients at risk. Basing DVT risk assessment on the evidence provided in this study will assist nurses in becoming more confident in recognizing the necessity for interventions in hospitalized patients and decreasing risk. Nurses can now evaluate patients at risk for DVT or PE using the JFK Medial Center's risk assessment tool.

Foundation Heat Exchanger Final Report: Demonstration, Measured Performance, and Validated Model and Design Tool

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hughes, Patrick; Im, Piljae

2012-04-01

excavation, 50% of which was construction excavation. There are six pipes in all excavations (three parallel circuits - out and back), and the multiple instances of FHX and/or HGHX are all connected in series. The working fluid is 20% by weight propylene glycol in water. Model and design tool development was undertaken in parallel with constructing the houses, installing instrumentation, and monitoring performance for a year. Several detailed numerical models for FHX were developed as part of the project. Essentially the project team was searching for an energy performance model accurate enough to achieve project objectives while also having sufficient computational efficiency for practical use in EnergyPlus. A 3-dimensional, dual-coordinate-system, finite-volume model satisfied these criteria and was included in the October 2011 EnergyPlus Version 7 public release after being validated against measured data.« less

Overcoming redundancies in bedside nursing assessments by validating a parsimonious meta-tool: findings from a methodological exercise study.

PubMed

Palese, Alvisa; Marini, Eva; Guarnier, Annamaria; Barelli, Paolo; Zambiasi, Paola; Allegrini, Elisabetta; Bazoli, Letizia; Casson, Paola; Marin, Meri; Padovan, Marisa; Picogna, Michele; Taddia, Patrizia; Chiari, Paolo; Salmaso, Daniele; Marognolli, Oliva; Canzan, Federica; Ambrosi, Elisa; Saiani, Luisa; Grassetti, Luca

2016-10-01

There is growing interest in validating tools aimed at supporting the clinical decision-making process and research. However, an increased bureaucratization of clinical practice and redundancies in the measures collected have been reported by clinicians. Redundancies in clinical assessments affect negatively both patients and nurses. To validate a meta-tool measuring the risks/problems currently estimated by multiple tools used in daily practice. A secondary analysis of a database was performed, using a cross-validation and a longitudinal study designs. In total, 1464 patients admitted to 12 medical units in 2012 were assessed at admission with the Brass, Barthel, Conley and Braden tools. Pertinent outcomes such as the occurrence of post-discharge need for resources and functional decline at discharge, as well as falls and pressure sores, were measured. Explorative factor analysis of each tool, inter-tool correlations and a conceptual evaluation of the redundant/similar items across tools were performed. Therefore, the validation of the meta-tool was performed through explorative factor analysis, confirmatory factor analysis and the structural equation model to establish the ability of the meta-tool to predict the outcomes estimated by the original tools. High correlations between the tools have emerged (from r 0.428 to 0.867) with a common variance from 18.3% to 75.1%. Through a conceptual evaluation and explorative factor analysis, the items were reduced from 42 to 20, and the three factors that emerged were confirmed by confirmatory factor analysis. According to the structural equation model results, two out of three emerged factors predicted the outcomes. From the initial 42 items, the meta-tool is composed of 20 items capable of predicting the outcomes as with the original tools. © 2016 John Wiley & Sons, Ltd.

Relative validity of a tool to measure food acculturation in children of Mexican descent.

PubMed

Vera-Becerra, Luz Elvia; Lopez, Martha L; Kaiser, Lucia L

2016-02-01

The purpose of this study was to examine relative validity of a food frequency questionnaire (FFQ) to measure food acculturation in young Mexican-origin children. In 2006, Spanish-speaking staff interviewed mothers in a community-based sample of households from Ventura, California (US) (n = 95) and Guanajuato, Mexico (MX) (n = 200). Data included two 24-h dietary recalls (24-DR); a 30-item FFQ; and anthropometry of the children. To measure construct, convergent, and discriminant validity, data analyses included factor analysis, Spearman correlations, t-test, respectively. Factor analysis revealed two constructs: 1) a US food pattern including hamburgers, pizza, hot dogs, fried chicken, juice, cereal, pastries, lower fat milk, quesadillas, and American cheese and 2) a MX food pattern including tortillas, fried beans, rice/noodles, whole milk, and pan dulce (sweet bread). Out of 22 food items that could be compared across the FFQ and mean 24-DRs, 17 were significantly, though weakly, correlated (highest r = 0.62, for whole milk). The mean US food pattern score was significantly higher, and the MX food pattern score, lower in US children than in MX children (p < 0.0001). After adjusting for child's age and gender; mother's education; and household size, the US food pattern score was positively related to body mass index (BMI) z-scores (beta coefficient: +0.29, p = - 0.004), whereas the MX food pattern score was negatively related to BMI z-scores (beta coefficient: -0.28, p = 0.002). This tool may be useful to evaluate nutrition education interventions to prevent childhood obesity on both sides of the border. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews.

PubMed

Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M

2007-02-15

Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.

Reliability and criterion-related validity testing (construct) of the Endotracheal Suction Assessment Tool (ESAT©).

PubMed

Davies, Kylie; Bulsara, Max K; Ramelet, Anne-Sylvie; Monterosso, Leanne

2018-05-01

To establish criterion-related construct validity and test-retest reliability for the Endotracheal Suction Assessment Tool© (ESAT©). Endotracheal tube suction performed in children can significantly affect clinical stability. Previously identified clinical indicators for endotracheal tube suction were used as criteria when designing the ESAT©. Content validity was reported previously. The final stages of psychometric testing are presented. Observational testing was used to measure construct validity and determine whether the ESAT© could guide "inexperienced" paediatric intensive care nurses' decision-making regarding endotracheal tube suction. Test-retest reliability of the ESAT© was performed at two time points. The researchers and paediatric intensive care nurse "experts" developed 10 hypothetical clinical scenarios with predetermined endotracheal tube suction outcomes. "Experienced" (n = 12) and "inexperienced" (n = 14) paediatric intensive care nurses were presented with the scenarios and the ESAT© guiding decision-making about whether to perform endotracheal tube suction for each scenario. Outcomes were compared with those predetermined by the "experts" (n = 9). Test-retest reliability of the ESAT© was measured at two consecutive time points (4 weeks apart) with "experienced" and "inexperienced" paediatric intensive care nurses using the same scenarios and tool to guide decision-making. No differences were observed between endotracheal tube suction decisions made by "experts" (n = 9), "inexperienced" (n = 14) and "experienced" (n = 12) nurses confirming the tool's construct validity. No differences were observed between groups for endotracheal tube suction decisions at T1 and T2. Criterion-related construct validity and test-retest reliability of the ESAT© were demonstrated. Further testing is recommended to confirm reliability in the clinical setting with the "inexperienced" nurse to guide decision-making related to endotracheal tube

Competency measurements: testing convergent validity for two measures.

PubMed

Cowin, Leanne S; Hengstberger-Sims, Cecily; Eagar, Sandy C; Gregory, Linda; Andrew, Sharon; Rolley, John

2008-11-01

This paper is a report of a study to investigate whether the Australian National Competency Standards for Registered Nurses demonstrate correlations with the Finnish Nurse Competency Scale. Competency assessment has become popular as a key regulatory requirement and performance indicator. The term competency, however, does not have a globally accepted definition and this has the potential to create controversy, ambiguity and confusion. Variations in meaning and definitions adopted in workplaces and educational settings will affect the interpretation of research findings and have implications for the nursing profession. A non-experimental cross-sectional survey design was used with a convenience sample of 116 new graduate nurses in 2005. The second version of the Australian National Competency Standards and the Nurse Competency Scale was used to elicit responses to self-assessed competency in the transitional year (first year as a Registered Nurse). Correlational analysis of self-assessed levels of competence revealed a relationship between the Australian National Competency Standards (ANCI) and the Nurse Competency Scale (NCS). The correlational relation between ANCI domains and NCS factors suggests that these scales are indeed used to measure related dimensions. A statistically significant relationship (r = 0.75) was found between the two competency measures. Although the finding of convergent validity is insufficient to establish construct validity for competency as used in both measures in this study, it is an important step towards this goal. Future studies on relationships between competencies must take into account the validity and reliability of the tools.

Maternal morbidity measurement tool pilot: study protocol.

PubMed

Say, Lale; Barreix, Maria; Chou, Doris; Tunçalp, Özge; Cottler, Sara; McCaw-Binns, Affette; Gichuhi, Gathari Ndirangu; Taulo, Frank; Hindin, Michelle

2016-06-09

While it is estimated that for every maternal death, 20-30 women suffer morbidity, these estimates are not based on standardized methods and measures. Lack of an agreed-upon definition, identification criteria, standardized assessment tools, and indicators has limited valid, routine, and comparable measurements of maternal morbidity. The World Health Organization (WHO) convened the Maternal Morbidity Working Group (MMWG) to develop standardized methods to improve estimates of maternal morbidity. To date, the MMWG has developed a definition and provided input into the development of a set of measurement tools. This protocol outlines the pilot test for measuring maternal morbidity in antenatal and postnatal clinical populations using these new tools. In each setting, the tools will be piloted on approximately 250 women receiving antenatal care (ANC) (at least 28 weeks pregnant) and 250 women receiving postpartum care (PPC) (at least 6 weeks postpartum). The tools will be administered by trained health care workers. Each tool has three modules as follows: 1. personal history - socio-economic information, and risk-factors (such as violence and substance abuse) 2. patient symptoms - WHO Disability Assessment Schedule (WHODAS) 12-item, and mental health questionnaires, General Anxiety Disorder, 7-item (GAD-7) and Personal Health Questionnaire, 9-item (PHQ-9) 3. physical examination - signs, laboratory tests and results. This pilot (planned for Jamaica, Kenya and Malawi) will allow for comparing the types of morbidities women experience between and across settings, and determine the feasibility, acceptability and utility of using a modified, streamlined tool for routine measurement and summary estimates of morbidity to inform resource allocation and service provision. As part of the post-2015 Sustainable Development Goals (SDGs) estimating and measuring maternal morbidity will be essential to ensure appropriate resources are allocated to address its impact and improve

Development and Validation of a Family Meeting Assessment Tool (FMAT).

PubMed

Hagiwara, Yuya; Healy, Jennifer; Lee, Shuko; Ross, Jeanette; Fischer, Dixie; Sanchez-Reilly, Sandra

2018-01-01

A cornerstone procedure in Palliative Medicine is to perform family meetings. Learning how to lead a family meeting is an important skill for physicians and others who care for patients with serious illnesses and their families. There is limited evidence on how to assess best practice behaviors during end-of-life family meetings. Our aim was to develop and validate an observational tool to assess trainees' ability to lead a simulated end-of-life family meeting. Building on evidence from published studies and accrediting agency guidelines, an expert panel at our institution developed the Family Meeting Assessment Tool. All fourth-year medical students (MS4) and eight geriatric and palliative medicine fellows (GPFs) were invited to participate in a Family Meeting Objective Structured Clinical Examination, where each trainee assumed the physician role leading a complex family meeting. Two evaluators observed and rated randomly chosen students' performances using the Family Meeting Assessment Tool during the examination. Inter-rater reliability was measured using percent agreement. Internal consistency was measured using Cronbach α. A total of 141 trainees (MS4 = 133 and GPF = 8) and 26 interdisciplinary evaluators participated in the study. Internal reliability (Cronbach α) of the tool was 0.85. Number of trainees rated by two evaluators was 210 (MS4 = 202 and GPF = 8). Rater agreement was 84%. Composite scores, on average, were significantly higher for fellows than for medical students (P < 0.001). Expert-based content, high inter-rater reliability, good internal consistency, and ability to predict educational level provided initial evidence for construct validity for this novel assessment tool. Copyright © 2017 American Academy of Hospice and Palliative Medicine. All rights reserved.

Measuring preparedness for mammography in women with intellectual disabilities: a validation study of the Mammography Preparedness Measure.

PubMed

Wang, Claire Tienwey; Greenwood, Nechama; White, Laura F; Wilkinson, Joanne

2015-05-01

Women with intellectual disabilities have similar breast cancer rates as the general population, but lower rates of regular mammography and higher breast cancer mortality rates. Although prior qualitative work demonstrates that women with intellectual disabilities face unique, disability-specific barriers to mammography, the present authors lack standardized, validated instruments for measuring knowledge of breast cancer screening in this population. In addition, much research related to adults with intellectual disabilities focuses on family or carer perspectives, rather than involving women with intellectual disabilities, themselves. The present authors first pilot tested a general population instrument measuring breast cancer knowledge, and found that it did not perform adequately in women with intellectual disabilities. In response, the present authors developed the Mammography Preparedness Measure (MPM), a direct short interview tool to measure knowledge and preparedness in women with intellectual disabilities, themselves, rather than relying on caregiver or other reports, and using inclusive methodology. The present authors validated the MPM by assessing test-retest reliability. Average test-retest per cent agreement of 84%, ranging from 74 to 91% agreement per item, with an overall kappa of 0.59. The MPM appears to be a valid instrument appropriate for measuring mammography preparedness in women with intellectual disabilities. The success of this innovative tool suggests that direct, rather than informant-directed tools can be developed to measure health knowledge and cancer screening readiness in adults with intellectual disabilities, an important measure in studying and reducing disparities. © 2014 John Wiley & Sons Ltd.

Face and Content Validity of the MacArthur Competence Assessment Tool for the Treatment of Iranian Patients.

PubMed

Saber, Ali; Tabatabaei, Seyed Mahmoud; Akasheh, Godarz; Sehat, Mojtaba; Zanjani, Zahra; Larijani, Bagher

2017-01-01

There is not a valid Persian tool for measuring the decision-making competency of patients. The aim of this study is to evaluate the face and content validity of the MacArthur Competence Assessment Tool for the treatment of Iranian Persian-speaking patients. To assess the validity of the Persian version of the tool, a self-administrated questionnaire was designed. The Lawshe method was also used for assessing each item. Content validity ratio (CVR) and content validity index (CVI) were used to assess the content validity quantitatively. According to the experts' judgment, questions with a CVR ≥0.62 and CVR <0.62 were maintainable and unmaintainable, respectively. The questions were designed in a manner to achieve the desirable result (CVR ≥0.62). The CVI scale (S-CVI) and CVI (S-CVI/Ave) were 0.94 (higher than 0.79). Thus, the content validity was confirmed. Since capacity assessments are usually based on physician's subjective judgment, they are likely to bias and therefore, with this suitably validated tool, we can improve judgment of physicians and health-care providers in out- and in-patient cases.

Measurement and Research Tools. Symposium 37. [AHRD Conference, 2001].

ERIC Educational Resources Information Center

2001

This symposium on measurement and research tools consists of three presentations. "An Examination of the Multiple Intelligences Developmental Assessment Scales (MIDAS)" (Albert Wiswell et al.) explores MIDAS's psychometric saliency. Findings indicates this instrument represents an incomplete attempt to develop a valid assessment of…

Development, Construct Validity, and Reliability of the Questionnaire on Infant Feeding: A Tool for Measuring Contemporary Infant-Feeding Behaviors.

PubMed

O'Sullivan, Elizabeth J; Rasmussen, Kathleen M

2017-12-01

The breastfeeding surveillance tool in the United States, the National Immunization Survey, considers the maternal-infant dyad to be breastfeeding for as long as the infant consumes human milk (HM). However, many infants consume at least some HM from a bottle, which can lead to health outcomes different from those for at-the-breast feeding. Our aim was to develop a construct-valid questionnaire that categorizes infants by nutrition source, that is, own mother's HM, another mother's HM, infant formula, or other and feeding mode, that is, at the breast or from a bottle, and test the reliability of this questionnaire. The Questionnaire on Infant Feeding was developed through a literature review and modified based on qualitative research. Construct validity was assessed through cognitive interviews and a test-retest reliability study was conducted among mothers who completed the questionnaire twice, 1 month apart. Cognitive interviews were conducted with ten mothers from upstate New York between September and December 2014. A test-retest reliability study was conducted among 44 mothers from across the United States between March and May 2015. Equivalence of questions with continuous responses about the timing of starting and stopping various behaviors and the agreement between responses to questions with categorical responses on the two questionnaires completed 1 month apart. Reliability was assessed using paired-equivalence tests for questions about the timing of starting and stopping behaviors and weighted Cohen's κ for questions about the frequency and intensity of behaviors. Reliability of the Questionnaire on Infant Feeding was moderately high among mothers of infants aged 19 to 35 months, with most questions about the timing of starting and stopping behaviors equivalent to within 1 month. Weighted Cohen's κ for categorical questions indicated substantial agreement. The Questionnaire on Infant Feeding is a construct-valid tool to measure duration, intensity

Validation of an inertial measurement unit for the measurement of jump count and height.

PubMed

MacDonald, Kerry; Bahr, Roald; Baltich, Jennifer; Whittaker, Jackie L; Meeuwisse, Willem H

2017-05-01

To validate the use of an inertial measurement unit (IMU) for the collection of total jump count and assess the validity of an IMU for the measurement of jump height against 3-D motion analysis. Cross sectional validation study. 3D motion-capture laboratory and field based settings. Thirteen elite adolescent volleyball players. Participants performed structured drills, played a 4 set volleyball match and performed twelve counter movement jumps. Jump counts from structured drills and match play were validated against visual count from recorded video. Jump height during the counter movement jumps was validated against concurrent 3-D motion-capture data. The IMU device captured more total jumps (1032) than visual inspection (977) during match play. During structured practice, device jump count sensitivity was strong (96.8%) while specificity was perfect (100%). The IMU underestimated jump height compared to 3D motion-capture with mean differences for maximal and submaximal jumps of 2.5 cm (95%CI: 1.3 to 3.8) and 4.1 cm (3.1-5.1), respectively. The IMU offers a valid measuring tool for jump count. Although the IMU underestimates maximal and submaximal jump height, our findings demonstrate its practical utility for field-based measurement of jump load. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validity of a practitioner-administered observational tool to measure physical activity, nutrition, and screen time in school-age programs.

PubMed

Lee, Rebekka M; Emmons, Karen M; Okechukwu, Cassandra A; Barrett, Jessica L; Kenney, Erica L; Cradock, Angie L; Giles, Catherine M; deBlois, Madeleine E; Gortmaker, Steven L

2014-11-28

Nutrition and physical activity interventions have been effective in creating environmental changes in afterschool programs. However, accurate assessment can be time-consuming and expensive as initiatives are scaled up for optimal population impact. This study aims to determine the criterion validity of a simple, low-cost, practitioner-administered observational measure of afterschool physical activity, nutrition, and screen time practices and child behaviors. Directors from 35 programs in three cities completed the Out-of-School Nutrition and Physical Activity Observational Practice Assessment Tool (OSNAP-OPAT) on five days. Trained observers recorded snacks served and obtained accelerometer data each day during the same week. Observations of physical activity participation and snack consumption were conducted on two days. Correlations were calculated to validate weekly average estimates from OSNAP-OPAT compared to criterion measures. Weekly criterion averages are based on 175 meals served, snack consumption of 528 children, and physical activity levels of 356 children. OSNAP-OPAT validly assessed serving water (r = 0.73), fruits and vegetables (r = 0.84), juice >4oz (r = 0.56), and grains (r = 0.60) at snack; sugary drinks (r = 0.70) and foods (r = 0.68) from outside the program; and children's water consumption (r = 0.56) (all p <0.05). Reports of physical activity time offered were correlated with accelerometer estimates (minutes of moderate and vigorous physical activity r = 0.59, p = 0.02; vigorous physical activity r = 0.63, p = 0.01). The reported proportion of children participating in moderate and vigorous physical activity was correlated with observations (r = 0.48, p = 0.03), as were reports of computer (r = 0.85) and TV/movie (r = 0.68) time compared to direct observations (both p < 0.01). OSNAP-OPAT can assist researchers and practitioners in validly assessing nutrition and physical

The Universal Design for Play Tool: Establishing Validity and Reliability

ERIC Educational Resources Information Center

Ruffino, Amy Goetz; Mistrett, Susan G.; Tomita, Machiko; Hajare, Poonam

2006-01-01

The Universal Design for Play (UDP) Tool is an instrument designed to evaluate the presence of universal design (UD) features in toys. This study evaluated its psychometric properties, including content validity, construct validity, and test-retest reliability. The UDP tool was designed to assist in selecting toys most appropriate for children…

Building validation tools for knowledge-based systems

NASA Technical Reports Server (NTRS)

Stachowitz, R. A.; Chang, C. L.; Stock, T. S.; Combs, J. B.

1987-01-01

The Expert Systems Validation Associate (EVA), a validation system under development at the Lockheed Artificial Intelligence Center for more than a year, provides a wide range of validation tools to check the correctness, consistency and completeness of a knowledge-based system. A declarative meta-language (higher-order language), is used to create a generic version of EVA to validate applications written in arbitrary expert system shells. The architecture and functionality of EVA are presented. The functionality includes Structure Check, Logic Check, Extended Structure Check (using semantic information), Extended Logic Check, Semantic Check, Omission Check, Rule Refinement, Control Check, Test Case Generation, Error Localization, and Behavior Verification.

Challenges of NDE simulation tool validation, optimization, and utilization for composites

NASA Astrophysics Data System (ADS)

Leckey, Cara A. C.; Seebo, Jeffrey P.; Juarez, Peter

2016-02-01

Rapid, realistic nondestructive evaluation (NDE) simulation tools can aid in inspection optimization and prediction of inspectability for advanced aerospace materials and designs. NDE simulation tools may someday aid in the design and certification of aerospace components; potentially shortening the time from material development to implementation by industry and government. Furthermore, ultrasound modeling and simulation are expected to play a significant future role in validating the capabilities and limitations of guided wave based structural health monitoring (SHM) systems. The current state-of-the-art in ultrasonic NDE/SHM simulation is still far from the goal of rapidly simulating damage detection techniques for large scale, complex geometry composite components/vehicles containing realistic damage types. Ongoing work at NASA Langley Research Center is focused on advanced ultrasonic simulation tool development. This paper discusses challenges of simulation tool validation, optimization, and utilization for composites. Ongoing simulation tool development work is described along with examples of simulation validation and optimization challenges that are more broadly applicable to all NDE simulation tools. The paper will also discuss examples of simulation tool utilization at NASA to develop new damage characterization methods for composites, and associated challenges in experimentally validating those methods.

Reliability and Validity of the Alberta Context Tool (ACT) with Professional Nurses: Findings from a Multi-Study Analysis

PubMed Central

Squires, Janet E.; Hayduk, Leslie; Hutchinson, Alison M.; Mallick, Ranjeeta; Norton, Peter G.; Cummings, Greta G.; Estabrooks, Carole A.

2015-01-01

Although organizational context is central to evidence-based practice, underdeveloped measurement hindersitsassessment. The Alberta Context Tool, comprised of 59 items that tap10 modifiable contextual concepts, was developed to address this gap. The purpose of this study to examine the reliability and validity of scores obtained when the Alberta Context Tool is completed by professional nurses across different healthcare settings. Five separate studies (N = 2361 nurses across different care settings) comprised the study sample. Reliability and validity were assessed. Cronbach’s alpha exceeded 0.70 for9/10 Alberta Context Tool concepts. Item-total correlations exceeded acceptable standards for 56/59items. Confirmatory Factor Analysescoordinated acceptably with the Alberta Context Tool’s proposed latent structure. The mean values for each Alberta Context Tool concept increased from low to high levels of research utilization(as hypothesized) further supporting its validity. This study provides robust evidence forreliability and validity of scores obtained with the Alberta Context Tool when administered to professional nurses. PMID:26098857

Assessing the Validity of an Annual Survey for Measuring Principal Leadership Practice

ERIC Educational Resources Information Center

Camburn, Eric M.; Huff, Jason T.; Goldring, Ellen B.; May, Henry

2010-01-01

Because research has shown that principals' practices can significantly impact teaching and learning in their schools through multiple avenues, it is critical to understand the validity of tools that measure principal practice. While the field has relied heavily on self-report surveys, little is known about their validity. This study compares…

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

PubMed

Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

2016-07-01

To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

Measuring Nutrition Literacy in Spanish-Speaking Latinos: An Exploratory Validation Study.

PubMed

Gibbs, Heather D; Camargo, Juliana M T B; Owens, Sarah; Gajewski, Byron; Cupertino, Ana Paula

2017-11-21

Nutrition is important for preventing and treating chronic diseases highly prevalent among Latinos, yet no tool exists for measuring nutrition literacy among Spanish speakers. This study aimed to adapt the validated Nutrition Literacy Assessment Instrument for Spanish-speaking Latinos. This study was developed in two phases: adaptation and validity testing. Adaptation included translation, expert item content review, and interviews with Spanish speakers. For validity testing, 51 participants completed the Short Assessment of Health Literacy-Spanish (SAHL-S), the Nutrition Literacy Assessment Instrument in Spanish (NLit-S), and socio-demographic questionnaire. Validity and reliability statistics were analyzed. Content validity was confirmed with a Scale Content Validity Index of 0.96. Validity testing demonstrated NLit-S scores were strongly correlated with SAHL-S scores (r = 0.52, p < 0.001). Entire reliability was substantial at 0.994 (CI 0.992-0.996) and internal consistency was excellent (Cronbach's α = 0.92). The NLit-S demonstrates validity and reliability for measuring nutrition literacy among Spanish-speakers.

Reliability and Validity Study of a Tool to Measure Cancer Stigma: Patient Version.

PubMed

Yılmaz, Medine; Dişsiz, Gülçin; Demir, Filiz; Irız, Sibel; Alacacioglu, Ahmet

2017-01-01

The aim of this methodological study is to establish the validity and reliability of the Turkish version of "A Questionnaire for Measuring Attitudes toward Cancer (Cancer Stigma) - Patient version." The sample comprised oncology patients who had active cancer treatment. The construct validity was assessed using the confirmatory and exploratory factor analysis. The mean age of the participants was 54.9±12.3 years. In the confirmatory factor analysis, fit values were determined as comparative fit index = 0.93, goodness of fit index = 0.91, normed-fit index=0.91, and root mean square error of approximation RMSEA = 0.09 ( P <0.05) (Kaiser-Meyer-Olkin = 0.88, χ 2 = 1084.41, Df = 66, and Barletta's test P <0.000). The first factor was "impossibility of recovery and experience of social discrimination" and the second factor was "stereotypes of cancer patients." The two-factor structure accounted for 56.74% of the variance. The Cronbach's alpha value was determined as 0.88 for the two-factor scale. "A questionnaire for measuring attitudes toward cancer (cancer stigma) - Patient version" is a reliable and valid questionnaire to assess stigmatization of cancer in cancer patients.

Intrathoracic airway measurement: ex-vivo validation

NASA Astrophysics Data System (ADS)

Reinhardt, Joseph M.; Raab, Stephen A.; D'Souza, Neil D.; Hoffman, Eric A.

1997-05-01

High-resolution x-ray CT (HRCT) provides detailed images of the lungs and bronchial tree. HRCT-based imaging and quantitation of peripheral bronchial airway geometry provides a valuable tool for assessing regional airway physiology. Such measurements have been sued to address physiological questions related to the mechanics of airway collapse in sleep apnea, the measurement of airway response to broncho-constriction agents, and to evaluate and track the progression of disease affecting the airways, such as asthma and cystic fibrosis. Significant attention has been paid to the measurements of extra- and intra-thoracic airways in 2D sections from volumetric x-ray CT. A variety of manual and semi-automatic techniques have been proposed for airway geometry measurement, including the use of standardized display window and level settings for caliper measurements, methods based on manual or semi-automatic border tracing, and more objective, quantitative approaches such as the use of the 'half-max' criteria. A recently proposed measurements technique uses a model-based deconvolution to estimate the location of the inner and outer airway walls. Validation using a plexiglass phantom indicates that the model-based method is more accurate than the half-max approach for thin-walled structures. In vivo validation of these airway measurement techniques is difficult because of the problems in identifying a reliable measurement 'gold standard.' In this paper we report on ex vivo validation of the half-max and model-based methods using an excised pig lung. The lung is sliced into thin sections of tissue and scanned using an electron beam CT scanner. Airways of interest are measured from the CT images, and also measured with using a microscope and micrometer to obtain a measurement gold standard. The result show no significant difference between the model-based measurements and the gold standard; while the half-max estimates exhibited a measurement bias and were significantly

The development and validity of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To develop the construct, content, and criterion validity of the Salford Gait Tool (SF-GT) and to evaluate agreement between gait observations using the SF-GT and kinematic gait data. Tool development and comparative evaluation. University in the United Kingdom. For designing construct and content validity, convenience samples of 10 children with hemiplegic, diplegic, and quadriplegic cerebral palsy (CP) and 152 physical therapy students and 4 physical therapists were recruited. For developing criterion validity, kinematic gait data of 13 gait clusters containing 56 children with hemiplegic, diplegic, and quadriplegic CP and 11 neurologically intact children was used. For clinical evaluation, a convenience sample of 23 pediatric physical therapists participated. We developed a sagittal plane observational gait assessment tool through a series of design, test, and redesign iterations. The tool's grading system was calibrated using kinematic gait data of 13 gait clusters and was evaluated by comparing the agreement of gait observations using the SF-GT with kinematic gait data. Criterion standard kinematic gait data. There was 58% mean agreement based on grading categories and 80% mean agreement based on degree estimations evaluated with the least significant difference method. The new SF-GT has good concurrent criterion validity.

Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care.

PubMed

Hoben, Matthias; Bär, Marion; Mahler, Cornelia; Berger, Sarah; Squires, Janet E; Estabrooks, Carole A; Kruse, Andreas; Behrens, Johann

2014-01-31

To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks' Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity-an initial stage of validity, necessary before more advanced validity assessment. We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants' answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants. Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups. Cognitive debriefing is essential to detect and respond to problematic instrument items, particularly when translating

Patient-Reported Outcomes After Radiation Therapy in Men With Prostate Cancer: A Systematic Review of Prognostic Tool Accuracy and Validity

DOE Office of Scientific and Technical Information (OSTI.GOV)

O'Callaghan, Michael E., E-mail: elspeth.raymond@health.sa.gov.au; Freemasons Foundation Centre for Men's Health, University of Adelaide; Urology Unit, Repatriation General Hospital, SA Health, Flinders Centre for Innovation in Cancer

Purpose: To identify, through a systematic review, all validated tools used for the prediction of patient-reported outcome measures (PROMs) in patients being treated with radiation therapy for prostate cancer, and provide a comparative summary of accuracy and generalizability. Methods and Materials: PubMed and EMBASE were searched from July 2007. Title/abstract screening, full text review, and critical appraisal were undertaken by 2 reviewers, whereas data extraction was performed by a single reviewer. Eligible articles had to provide a summary measure of accuracy and undertake internal or external validation. Tools were recommended for clinical implementation if they had been externally validated and foundmore » to have accuracy ≥70%. Results: The search strategy identified 3839 potential studies, of which 236 progressed to full text review and 22 were included. From these studies, 50 tools predicted gastrointestinal/rectal symptoms, 29 tools predicted genitourinary symptoms, 4 tools predicted erectile dysfunction, and no tools predicted quality of life. For patients treated with external beam radiation therapy, 3 tools could be recommended for the prediction of rectal toxicity, gastrointestinal toxicity, and erectile dysfunction. For patients treated with brachytherapy, 2 tools could be recommended for the prediction of urinary retention and erectile dysfunction. Conclusions: A large number of tools for the prediction of PROMs in prostate cancer patients treated with radiation therapy have been developed. Only a small minority are accurate and have been shown to be generalizable through external validation. This review provides an accessible catalogue of tools that are ready for clinical implementation as well as which should be prioritized for validation.« less

Validating an Environmental Education Field Day Observation Tool

ERIC Educational Resources Information Center

Carlson, Stephan P.; Heimlich, Joe E.; Storksdieck, Martin

2011-01-01

Environmental Field Days (EFD) are held throughout the country and provide a unique opportunity to involve students in real world science. A study to assess the validity of an observation tool for EFD programs was conducted at the Metro Water Festival with fifth grade students. Items from the observation tool were mapped to students' evaluation…

Evaluation of tools used to measure calcium and/or dairy consumption in children and adolescents.

PubMed

Magarey, Anthea; Yaxley, Alison; Markow, Kylie; Baulderstone, Lauren; Miller, Michelle

2014-08-01

To identify and critique tools that assess Ca and/or dairy intake in children to ascertain the most accurate and reliable tools available. A systematic review of the literature was conducted using defined inclusion and exclusion criteria. Articles were included on the basis that they reported on a tool measuring Ca and/or dairy intake in children in Western countries and reported on originally developed tools or tested the validity or reliability of existing tools. Defined criteria for reporting reliability and validity properties were applied. Studies in Western countries. Children. Eighteen papers reporting on two tools that assessed dairy intake, ten that assessed Ca intake and five that assessed both dairy and Ca were identified. An examination of tool testing revealed high reliance on lower-order tests such as correlation and failure to differentiate between statistical and clinically meaningful significance. Only half of the tools were tested for reliability and results indicated that only one Ca tool and one dairy tool were reliable. Validation studies showed acceptable levels of agreement (<100 mg difference) and/or sensitivity (62-83 %) and specificity (55-77 %) in three Ca tools. With reference to the testing methodology and results, no tools were considered both valid and reliable for the assessment of dairy intake and only one tool proved valid and reliable for the assessment of Ca intake. These results clearly indicate the need for development and rigorous testing of tools to assess Ca and/or dairy intake in children and adolescents.

Quantitative measurement of hypertrophic scar: interrater reliability and concurrent validity.

PubMed

Nedelec, Bernadette; Correa, José A; Rachelska, Grazyna; Armour, Alexis; LaSalle, Léo

2008-01-01

Research into the pathophysiology and treatment of hypertrophic scar (HSc) remains limited by the heterogeneity of scar and the imprecision with which its severity is measured. The objective of this study was to test the interrater reliability and concurrent validity of the Cutometer measurement of elasticity, the Mexameter measurement of erythema and pigmentation, and total thickness measure of the DermaScan C relative to the modified Vancouver Scar Scale (mVSS) in patient-matched normal skin, normal scar, and HSc. Three independent investigators evaluated 128 sites (severe HSc, moderate or mild HSc, donor site, and normal skin) on 32 burn survivors using all of the above measurement tools. The intraclass correlation coefficient, which was used to measure interrater reliability, reflects the inherent amount of error in the measure and is considered acceptable when it is >0.75. Interrater reliability of the totals of the height, pliability, and vascularity subscales of the mVSS fell below the acceptable limit ( congruent with0.50). The individual subscales of the mVSS fell well below the acceptable level (< or =0.3). The Cutometer reading of elasticity provided acceptable reliability (>0.89) for each study site with the exception of severe scar. Mexameter and DermaScan C reliability measurements were acceptable for all sites (>0.82). Concurrent validity correlations with the mVSS were significant except for the comparison of the mVSS pliability subscale and the Cutometer maximum deformation measure comparison in severe scar. In conclusion, the Mexameter and DermaScan C measurements of scar color and thickness of all sites, as well as the Cutometer measurement of elasticity in all but the most severe scars shows high interrater reliability. Their significant concurrent validity with the mVSS confirms that these tools are measuring the same traits as the mVSS, and in a more objective way.

The Chelsea critical care physical assessment tool (CPAx): validation of an innovative new tool to measure physical morbidity in the general adult critical care population; an observational proof-of-concept pilot study.

PubMed

Corner, E J; Wood, H; Englebretsen, C; Thomas, A; Grant, R L; Nikoletou, D; Soni, N

2013-03-01

To develop a scoring system to measure physical morbidity in critical care - the Chelsea Critical Care Physical Assessment Tool (CPAx). The development process was iterative involving content validity indices (CVI), a focus group and an observational study of 33 patients to test construct validity against the Medical Research Council score for muscle strength, peak cough flow, Australian Therapy Outcome Measures score, Glasgow Coma Scale score, Bloomsbury sedation score, Sequential Organ Failure Assessment score, Short Form 36 (SF-36) score, days of mechanical ventilation and inter-rater reliability. Trauma and general critical care patients from two London teaching hospitals. Users of the CPAx felt that it possessed content validity, giving a final CVI of 1.00 (P<0.05). Construct validation data showed moderate to strong significant correlations between the CPAx score and all secondary measures, apart from the mental component of the SF-36 which demonstrated weak correlation with the CPAx score (r=0.024, P=0.720). Reliability testing showed internal consistency of α=0.798 and inter-rater reliability of κ=0.988 (95% confidence interval 0.791 to 1.000) between five raters. This pilot work supports proof of concept of the CPAx as a measure of physical morbidity in the critical care population, and is a cogent argument for further investigation of the scoring system. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Chinese cross-cultural adaptation and validation of the Foot Function Index as tool to measure patients with foot and ankle functional limitations.

PubMed

González-Sánchez, Manuel; Ruiz-Muñoz, Maria; Li, Guang Zhi; Cuesta-Vargas, Antonio I

2018-08-01

To perform a cross-cultural adaptation and validation of the Foot Function Index (FFI) questionnaire to develop the Chinese version. Three hundred and six patients with foot and ankle neuromusculoskeletal diseases participated in this observational study. Construct validity, internal consistency and criterion validity were calculated for the FFI Chinese version after the translation and transcultural adaptation process. Internal consistency ranged from 0.996 to 0.998. Test-retest analysis ranged from 0.985 to 0.994; minimal detectable change 90: 2.270; standard error of measurement: 0.973. Load distribution of the three factors had an eigenvalue greater than 1. Chi-square value was 9738.14 (p < 0.001). Correlations with the three factors were significant between Factor 1 and the other two: r = -0.634 (Factor 2) and r = -0.191 (Factor 1). Foot Function Index (Taiwan Version), Short-Form 12 (Version 2) and EuroQol-5D were used for criterion validity. Factors 1 and 2 showed significant correlation with 15/16 and 14/16 scales and subscales, respectively. Foot Function Index Chinese version psychometric characteristics were good to excellent. Chinese researchers and clinicians may use this tool for foot and ankle assessment and monitoring. Implications for rehabilitation A cross-cultural adaptation of the FFI has been done from original version to Chinese. Consistent results and satisfactory psychometric properties of the Foot Function Index Chinese version have been reported. For Chinese speaking researcher and clinician FFI-Ch could be used as a tool to assess patients with foot disease.

Reliability and Validity Study of a Tool to Measure Cancer Stigma: Patient Version

PubMed Central

Yılmaz, Medine; Dişsiz, Gülçin; Demir, Filiz; Irız, Sibel; Alacacioglu, Ahmet

2017-01-01

Objective: The aim of this methodological study is to establish the validity and reliability of the Turkish version of “A Questionnaire for Measuring Attitudes toward Cancer (Cancer Stigma) - Patient version.” Methods: The sample comprised oncology patients who had active cancer treatment. The construct validity was assessed using the confirmatory and exploratory factor analysis. Results: The mean age of the participants was 54.9±12.3 years. In the confirmatory factor analysis, fit values were determined as comparative fit index = 0.93, goodness of fit index = 0.91, normed-fit index=0.91, and root mean square error of approximation RMSEA = 0.09 (P <0.05) (Kaiser–Meyer–Olkin = 0.88, χ2 = 1084.41, Df = 66, and Barletta's test P <0.000). The first factor was “impossibility of recovery and experience of social discrimination” and the second factor was “stereotypes of cancer patients.” The two-factor structure accounted for 56.74% of the variance. The Cronbach's alpha value was determined as 0.88 for the two-factor scale. Conclusions: “A questionnaire for measuring attitudes toward cancer (cancer stigma) - Patient version” is a reliable and valid questionnaire to assess stigmatization of cancer in cancer patients. PMID:28503649

Measuring governance at health facility level: developing and validation of simple governance tool in Zambia.

PubMed

Mutale, Wilbroad; Mwanamwenge, Margaret Tembo; Balabanova, Dina; Spicer, Neil; Ayles, Helen

2013-08-09

successfully validated and applied the new tool for evaluating health system governance at health facility level. The results have shown that it is feasible to measure governance practices at health facility level and that the adapted tool is fairly reliable with the 95% one-sided confidence interval for Cronbach's alpha laying between 0.69 and 0.74 for the 16 items. Caution should be taken when interpreting overall scores as they tended to mask domain specific variations.

Validity of plant fiber length measurement : a review of fiber length measurement based on kenaf as a model

Treesearch

James S. Han; Theodore Mianowski; Yi-yu Lin

1999-01-01

The efficacy of fiber length measurement techniques such as digitizing, the Kajaani procedure, and NIH Image are compared in order to determine the optimal tool. Kenaf bast fibers, aspen, and red pine fibers were collected from different anatomical parts, and the fiber lengths were compared using various analytical tools. A statistical analysis on the validity of the...

Development of a golf-specific load monitoring tool: Content validity and feasibility.

PubMed

Williams, Scott B; Gastin, Paul B; Saw, Anna E; Robertson, Sam

2018-05-01

Athletes often record details of their training and competitions, supported by information such as environmental conditions, travel, as well as how they felt. However, it is not known how prevalent these practices are in golfers, or how valuable this process is perceived. The purpose of this study was to develop a golf-specific load monitoring tool (GLMT), and establish the content validity and feasibility of this tool amongst high-level golfers. In the first phase of development, 21 experts were surveyed to determine the suitability of items for inclusion in the GLMT. Of the 36 items, 21 received >78% agreement, a requirement to establish content validity and for inclusion in the GLMT. Total duration was the preferred metric for golf-specific activities, whilst rating of perceived exertion (RPE) was preferred for measuring physical training. In the second phase, feasibility of the tool was assessed by surveying 13 high-level male golfers following 28-days of daily GLMT use. All items included in the GLMT were deemed feasible to record, with all players participating in the feasibility study providing high to very high ratings. Golfers responded that they would consider using a load monitoring tool of this nature long term, provided it can be completed in less than five minutes per day.

Validation of the self-assessment teamwork tool (SATT) in a cohort of nursing and medical students.

PubMed

Roper, Lucinda; Shulruf, Boaz; Jorm, Christine; Currie, Jane; Gordon, Christopher J

2018-02-09

Poor teamwork has been implicated in medical error and teamwork training has been shown to improve patient care. Simulation is an effective educational method for teamwork training. Post-simulation reflection aims to promote learning and we have previously developed a self-assessment teamwork tool (SATT) for health students to measure teamwork performance. This study aimed to evaluate the psychometric properties of a revised self-assessment teamwork tool. The tool was tested in 257 medical and nursing students after their participation in one of several mass casualty simulations. Using exploratory and confirmatory factor analysis, the revised self-assessment teamwork tool was shown to have strong construct validity, high reliability, and the construct demonstrated invariance across groups (Medicine & Nursing). The modified SATT was shown to be a reliable and valid student self-assessment tool. The SATT is a quick and practical method of guiding students' reflection on important teamwork skills.

Using Content Maps to Measure Content Development in Physical Education: Validation and Application

ERIC Educational Resources Information Center

Ward, Phillip; Dervent, Fatih; Lee, Yun Soo; Ko, Bomna; Kim, Insook; Tao, Wang

2017-01-01

Purpose: This study reports on our efforts toward extending the conceptual understanding of content development in physical education by validating content maps as a measurement tool, examining new categories of instructional tasks to describe content development and validating formulae that can be used to evaluate depth of content development.…

The Search for an Early Intervention Outcome Measurement Tool in Autism

ERIC Educational Resources Information Center

Fletcher-Watson, S.; McConachie, H.

2017-01-01

Evidence is accumulating that early intervention can be effective in improving the skills of young children with autism spectrum disorder. However, the science is hampered by the lack of agreed "gold standard" tools for the measurement of progress and outcome. What is required is a reliable, valid, and sensitive measure of change in the…

Psychometric validation of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool for older Chinese inpatients.

PubMed

Zhang, Junhong; Wang, Min; Liu, Yu

2016-10-01

To culturally adapt and evaluate the reliability and validity of the Chinese version of the Johns Hopkins Fall Risk Assessment Tool among older inpatients in the mainland of China. Patient falls are an important safety consideration within hospitals among older inpatients. Nurses need specific risk assessment tools for older inpatients to reliably identify at-risk populations and guide interventions that highlight fixable risk factors for falls and consequent injuries. In China, a few tools have been developed to measure fall risk. However, they lack the solid psychometric development necessary to establish their validity and reliability, and they are not widely used for elderly inpatients. A cross-sectional study. A convenient sampling was used to recruit 201 older inpatients from two tertiary-level hospitals in Beijing and Xiamen, China. The Johns Hopkins Fall Risk Assessment Tool was translated using forward and backward translation procedures and was administered to these 201 older inpatients. Reliability of the tool was calculated by inter-rater reliability and Cronbach's alpha. Validity was analysed through content validity index and construct validity. The Inter-rater reliability of Chinese version of Johns Hopkins Fall Risk Assessment Tool was 97·14% agreement with Cohen's Kappa of 0·903. Cronbach's α was 0·703. Content of Validity Index was 0·833. Two factors represented intrinsic and extrinsic risk factors were explored that together explained 58·89% of the variance. This study provided evidence that Johns Hopkins Fall Risk Assessment Tool is an acceptable, valid and reliable tool to identify older inpatients at risk of falls and falls with injury. Further psychometric testing on criterion validity and evaluation of its advanced utility in geriatric clinical settings are warranted. The Chinese version of Johns Hopkins Fall Risk Assessment Tool may be useful for health care personnel to identify older Chinese inpatients at risk of falls and falls

Development and evaluation of a patient-centred measurement tool for surgeons' non-technical skills.

PubMed

Yule, J; Hill, K; Yule, S

2018-06-01

Non-technical skills are essential for safe and effective surgery. Several tools to assess surgeons' non-technical skills from the clinician's perspective have been developed. However, a reliable measurement tool using a patient-centred approach does not currently exist. The aim of this study was to translate the existing Non-Technical Skills for Surgeons (NOTSS) tool into a patient-centred evaluation tool. Data were gathered from four cohorts of patients using an iterative four-stage mixed-methods research design. Exploratory and confirmatory factor analyses were performed to establish the psychometric properties of the tool, focusing on validity, reliability, usability and parsimony. Some 534 patients were recruited to the study. A total of 24 patient-centred non-technical skill items were developed in stage 1, and reduced to nine items in stage 2 using exploratory factor analysis. In stage 3, confirmatory factor analysis demonstrated that these nine items each loaded on to one of three factors, with excellent internal consistency: decision-making, leadership, and communication and teamwork. In stage 4, validity testing established that the new tool was independent of physician empathy and predictive of surgical quality. Surgical leadership emerged as the most dominant skill that patients could recognize and evaluate. A novel nine-item assessment tool has been developed. The Patients' Evaluation of Non-Technical Skills (PENTS) tool allows valid and reliable measurement of surgeons' non-technical skills from the patient perspective. © 2018 BJS Society Ltd Published by John Wiley & Sons Ltd.

The risk of bias in systematic reviews tool showed fair reliability and good construct validity.

PubMed

Bühn, Stefanie; Mathes, Tim; Prengel, Peggy; Wegewitz, Uta; Ostermann, Thomas; Robens, Sibylle; Pieper, Dawid

2017-11-01

There is a movement from generic quality checklists toward a more domain-based approach in critical appraisal tools. This study aimed to report on a first experience with the newly developed risk of bias in systematic reviews (ROBIS) tool and compare it with A Measurement Tool to Assess Systematic Reviews (AMSTAR), that is, the most common used tool to assess methodological quality of systematic reviews while assessing validity, reliability, and applicability. Validation study with four reviewers based on 16 systematic reviews in the field of occupational health. Interrater reliability (IRR) of all four raters was highest for domain 2 (Fleiss' kappa κ = 0.56) and lowest for domain 4 (κ = 0.04). For ROBIS, median IRR was κ = 0.52 (range 0.13-0.88) for the experienced pair of raters compared to κ = 0.32 (range 0.12-0.76) for the less experienced pair of raters. The percentage of "yes" scores of each review of ROBIS ratings was strongly correlated with the AMSTAR ratings (r s  = 0.76; P = 0.01). ROBIS has fair reliability and good construct validity to assess the risk of bias in systematic reviews. More validation studies are needed to investigate reliability and applicability, in particular. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of a pregnancy planning measure for Arabic-speaking women.

PubMed

Almaghaslah, Eman; Rochat, Roger; Farhat, Ghada

2017-01-01

The prevalence of unplanned pregnancy in Saudi Arabia has not been thoroughly investigated. To conduct a psychometric evaluation study of the Arabic version of the London Measure of Unplanned Pregnancy (LMUP). To evaluate the psychometric properties of the LMUP, we conducted a self-administered online survey among 796 ever-married Saudi women aged 20-49 years, and a re-test survey among 24 women. The psychometric properties evaluated included content validity measured by content validity index (CVI), structural validity assessed by exploratory factor analysis (EFA), substantive validity assessed by hypothesis testing, contextual stability for the test-retest assessed by weighted Kappa, and internal consistency assessed by Cronbach's alpha. The psychometric analysis of the Arabic version of LMUP exhibited valid and reliable properties. The CVIs for individual items and at the scale level were >0.7. EFA confirmed a unidimensional extraction of the scale item. Hypothesis testing confirmed expected associations. The tool was stable with weighted kappa = 0.78 and Cronbach's alpha = 0.88. In this study, the validity and reliability of the Arabic version of the LMUP were confirmed according to well-known psychometric criteria. This LMUP version can be used in research studies among Arabic-speaking women to measure unplanned pregnancy and investigate correlates and outcomes related to unplanned pregnancy.

Assessing Households Preparedness for Earthquakes: An Exploratory Study in the Development of a Valid and Reliable Persian-version Tool.

PubMed

Ardalan, Ali; Sohrabizadeh, Sanaz

2016-02-25

Iran is placed among countries suffering from the highest number of earthquake casualties. Household preparedness, as one component of risk reduction efforts, is often supported in quake-prone areas. In Iran, lack of a valid and reliable household preparedness tool was reported by previous disaster studies. This study is aimed to fill this gap by developing a valid and reliable tool for assessing household preparedness in the event of an earthquake.  This survey was conducted through three phases including literature review and focus group discussions with the participation of eight key informants, validity measurements and reliability measurements. Field investigation was completed with the participation of 450 households within three provinces of Iran. Content validity, construct validity, the use of factor analysis; internal consistency using Cronbach's alpha coefficient, and test-retest reliability were carried out to develop the tool.  Based on the CVIs, ranging from 0.80 to 0.100, and exploratory factor analysis with factor loading of more than 0.5, all items were valid. The amount of Cronbach's alpha (0.7) and test-retest examination by Spearman correlations indicated that the scale was also reliable. The final instrument consisted of six categories and 18 questions including actions at the time of earthquakes, nonstructural safety, structural safety, hazard map, communications, drill, and safety skills.  Using a Persian-version tool that is adjusted to the socio-cultural determinants and native language may result in more trustful information on earthquake preparedness. It is suggested that disaster managers and researchers apply this tool in their future household preparedness projects. Further research is needed to make effective policies and plans for transforming preparedness knowledge into behavior.

Validation of a Low-Thrust Mission Design Tool Using Operational Navigation Software

NASA Technical Reports Server (NTRS)

Englander, Jacob A.; Knittel, Jeremy M.; Williams, Ken; Stanbridge, Dale; Ellison, Donald H.

2017-01-01

Design of flight trajectories for missions employing solar electric propulsion requires a suitably high-fidelity design tool. In this work, the Evolutionary Mission Trajectory Generator (EMTG) is presented as a medium-high fidelity design tool that is suitable for mission proposals. EMTG is validated against the high-heritage deep-space navigation tool MIRAGE, demonstrating both the accuracy of EMTG's model and an operational mission design and navigation procedure using both tools. The validation is performed using a benchmark mission to the Jupiter Trojans.

The development and validation of a meta-tool for quality appraisal of public health evidence: Meta Quality Appraisal Tool (MetaQAT).

PubMed

Rosella, L; Bowman, C; Pach, B; Morgan, S; Fitzpatrick, T; Goel, V

2016-07-01

Most quality appraisal tools were developed for clinical medicine and tend to be study-specific with a strong emphasis on risk of bias. In order to be more relevant to public health, an appropriate quality appraisal tool needs to be less reliant on the evidence hierarchy and consider practice applicability. Given the broad range of study designs used in public health, the objective of this study was to develop and validate a meta-tool that combines public health-focused principles of appraisal coupled with a set of design-specific companion tools. Several design methods were used to develop and validate the tool including literature review, synthesis, and validation with a reference standard. A search of critical appraisal tools relevant to public health was conducted; core concepts were collated. The resulting framework was piloted during three feedback sessions with public health practitioners. Following subsequent revisions, the final meta-tool, the Meta Quality Appraisal Tool (MetaQAT), was then validated through a content analysis of appraisals conducted by two groups of experienced public health researchers (MetaQAT vs generic appraisal form). The MetaQAT framework consists of four domains: relevancy, reliability, validity, and applicability. In addition, a companion tool was assembled from existing critical appraisal tools to provide study design-specific guidance on validity appraisal. Content analysis showed similar methodological and generalizability concerns were raised by both groups; however, the MetaQAT appraisers commented more extensively on applicability to public health practice. Critical appraisal tools designed for clinical medicine have limitations for use in the context of public health. The meta-tool structure of the MetaQAT allows for rigorous appraisal, while allowing users to simultaneously appraise the multitude of study designs relevant to public health research and assess non-standard domains, such as applicability. Copyright © 2015

TROPHI: development of a tool to measure complex, multi-factorial patient handling interventions.

PubMed

Fray, Mike; Hignett, Sue

2013-01-01

Patient handling interventions are complex and multi-factorial. It has been difficult to make comparisons across different strategies due to the lack of a comprehensive outcome measurement method. The Tool for Risk Outstanding in Patient Handling Interventions (TROPHI) was developed to address this gap by measuring outcomes and comparing performance across interventions. Focus groups were held with expert patient handling practitioners (n = 36) in four European countries (Finland, Italy, Portugal and the UK) to identify preferred outcomes to be measured for interventions. A systematic literature review identified 598 outcome measures; these were critically appraised and the most appropriate measurement tool was selected for each outcome. TROPHI was evaluated in the four EU countries (eight sites) and by an expert panel (n = 16) from the European Panel of Patient Handling Ergonomics for usability and practical application. This final stage added external validity to the research by exploring transferability potential and presenting the data and analysis to allow respondent (participant) validation. Patient handling interventions are complex and multi-factorial and it has been difficult to make comparisons due to the lack of a comprehensive outcome measurement method. The Tool for Risk Outstanding in Patient Handling Interventions (TROPHI) was developed to address this gap by measuring outcomes to compare performance across interventions.

Evaluation of Measurement Tools for Tobacco Product Displays: Is there an App for that?

PubMed Central

Combs, Todd B.; Moreland-Russell, Sarah; Roche, Jason

2015-01-01

Tobacco product displays are a pervasive presence in convenience stores, supermarkets, pharmacies, and other retailers nationwide. The influence that tobacco product displays have on purchases and tobacco product initiation, particularly on young people and other vulnerable populations, is well known. An objective measurement tool that is valid, reliable, and feasible to use is needed to assess product displays in the retail setting. This study reports on the relative accuracy of various tools that measure area and/or distance in photos and thus could be applied to product displays. We compare results of repeated trials using five tools. Three tools are smartphone apps that measure objects in photos taken on the device; these are narrowed down from a list of 284 candidate apps. Another tool uses photos taken with any device and calculates relative area via a built-in function in the Microsoft Office Suite. The fifth uses photos taken with the Narrative Clip, a “life-logging” wearable camera. To evaluate validity and reliability, we assess each instrument's measurements and calculate intra-class correlation coefficients. Mean differences between observed measurements (via tape measure) and those from the five tools range from just over one square foot to just over two square feet. Most instruments produce reliable estimates though some are sensitive to the size of the display. Results of this study indicate need for future research to test innovative measurement tools. This paper also solicits further discussion on how best to transform anecdotal knowledge of product displays as targeted and disproportionate marketing tactics into a scientific evidence base for public policy change. PMID:29188220

Development and validation of a premature ejaculation diagnostic tool.

PubMed

Symonds, Tara; Perelman, Michael A; Althof, Stanley; Giuliano, François; Martin, Mona; May, Kathryn; Abraham, Lucy; Crossland, Anna; Morris, Mark

2007-08-01

Diagnosis of premature ejaculation (PE) for clinical trial purposes has typically relied on intravaginal ejaculation latency time (IELT) for entry, but this parameter does not capture the multidimensional nature of PE. Therefore, the aim was to develop a brief, multidimensional, psychometrically validated instrument for diagnosing PE status. The questionnaire development involved three stages: (1) Five focus groups and six individual interviews were conducted to develop the content; (2) psychometric validation using three different groups of men; and (3) generation of a scoring system. For psychometric validation/scoring system development, data was collected from (1) men with PE based on clinician diagnosis, using DSM-IV-TR, who also had IELTs < or =2 min (n=292); (2) men self-reporting PE (n=309); and (3) men self-reporting no-PE (n=701). Standard psychometric analyses were conducted to produce the final questionnaire. Sensitivity/specificity analysis was used to determine an appropriate scoring system. The qualitative research identified 9 items to capture the essence of DSM-IV-TR PE classification. The psychometric validation resulted in a 5-item, unidimensional, measure, which captures the essence of DSM-IV-TR: control, frequency, minimal stimulation, distress, and interpersonal difficulty. Sensitivity/specificity analyses suggested a score of < or =8 indicated no-PE, 9 and 10 probable PE, and > or =11 PE. The development and validation of this new PE diagnostic tool has resulted in a new, user-friendly, and brief self-report questionnaire for use in clinical trials to diagnose PE.

Assessing behavioural changes in ALS: cross-validation of ALS-specific measures.

PubMed

Pinto-Grau, Marta; Costello, Emmet; O'Connor, Sarah; Elamin, Marwa; Burke, Tom; Heverin, Mark; Pender, Niall; Hardiman, Orla

2017-07-01

The Beaumont Behavioural Inventory (BBI) is a behavioural proxy report for the assessment of behavioural changes in ALS. This tool has been validated against the FrSBe, a non-ALS-specific behavioural assessment, and further comparison of the BBI against a disease-specific tool was considered. This study cross-validates the BBI against the ALS-FTD-Q. Sixty ALS patients, 8% also meeting criteria for FTD, were recruited. All patients were evaluated using the BBI and the ALS-FTD-Q, completed by a carer. Correlational analysis was performed to assess construct validity. Precision, sensitivity, specificity, and overall accuracy of the BBI when compared to the ALS-FTD-Q, were obtained. The mean score of the whole sample on the BBI was 11.45 ± 13.06. ALS-FTD patients scored significantly higher than non-demented ALS patients (31.6 ± 14.64, 9.62 ± 11.38; p < 0.0001). A significant large positive correlation between the BBI and the ALS-FTD-Q was observed (r = 0.807, p < 0.0001), and no significant correlations between the BBI and other clinical/demographic characteristics indicate good convergent and discriminant validity, respectively. 72% of overall concordance was observed. Precision, sensitivity, and specificity for the classification of severely impaired patients were adequate. However, lower concordance in the classification of mild behavioural changes was observed, with higher sensitivity using the BBI, most likely secondary to BBI items which endorsed behavioural aspects not measured by the ALS-FTD-Q. Good construct validity has been further confirmed when the BBI is compared to an ALS-specific tool. Furthermore, the BBI is a more comprehensive behavioural assessment for ALS, as it measures the whole behavioural spectrum in this condition.

Development and Validation of the Narrative Quality Assessment Tool.

PubMed

Kim, Wonsun Sunny; Shin, Cha-Nam; Kathryn Larkey, Linda; Roe, Denise J

2017-04-01

The use of storytelling in health promotion has grown over the past 2 decades, showing promise for moving people to initiate healthy behavior change. Given the increasingly prevalent role of storytelling in health promotion research and the need to more clearly identify what storytelling elements and mediators may better predict behavior change, there is a need to develop measures to specifically assess these factors in a cultural community context. The purpose of this study is to develop and preliminarily validate a narrative quality assessment tool for measuring elements of storytelling that are predicted to affect attitude and behavior change (i.e., narrative characteristics, identification, and transportation) within a cultural community setting using a culture-centric model. Reliability and validity of these scales were assessed with repeated administrations among 74 Latino men and women with a mean age of 39.6 years (SD = 11.47 years). The confirmatory factor analysis in addition to internal consistency tests revealed preliminary evidence for reliability and validity of the narrative characteristics, identification, and transportation scales. Cronbach's alpha ranged from .92 to .94. Items revealed adequate factor loadings (.85-.98) and good model fit. The new scales provide the first step in moving the assessment of narrative quality into a culturally relevant context for evaluation of story use in health promotion. The results present valuable information for nurse researchers to guide the development and testing of culturally grounded storytelling interventions' potential to predict attitude and behavior change for patients.

Development and validation of a Clinical Assessment Tool for Nursing Education (CAT-NE).

PubMed

Skúladóttir, Hafdís; Svavarsdóttir, Margrét Hrönn

2016-09-01

The aim of this study was to develop a valid assessment tool to guide clinical education and evaluate students' performance in clinical nursing education. The development of the Clinical Assessment Tool for Nursing Education (CAT-NE) was based on the theory of nursing as professional caring and the Bologna learning outcomes. Benson and Clark's four steps of instrument development and validation guided the development and assessment of the tool. A mixed-methods approach with individual structured cognitive interviewing and quantitative assessments was used to validate the tool. Supervisory teachers, a pedagogical consultant, clinical expert teachers, clinical teachers, and nursing students at the University of Akureyri in Iceland participated in the process. This assessment tool is valid to assess the clinical performance of nursing students; it consists of rubrics that list the criteria for the students' expected performance. According to the students and their clinical teachers, the assessment tool clarified learning objectives, enhanced the focus of the assessment process, and made evaluation more objective. Training clinical teachers on how to assess students' performances in clinical studies and use the tool enhanced the quality of clinical assessment in nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations

PubMed Central

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2016-01-01

Aim To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. Methods The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. Results A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90–0.97) in Brazil and 0.81 (95% confidence interval 0.66–0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. Conclusions These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective perfor mance measures. PMID:24666718

Validity and applicability of a video-based animated tool to assess mobility in elderly Latin American populations.

PubMed

Guerra, Ricardo Oliveira; Oliveira, Bruna Silva; Alvarado, Beatriz Eugenia; Curcio, Carmen Lucia; Rejeski, W Jack; Marsh, Anthony P; Ip, Edward H; Barnard, Ryan T; Guralnik, Jack M; Zunzunegui, Maria Victoria

2014-10-01

To assess the reliability and the validity of Portuguese- and Spanish-translated versions of the video-based short-form Mobility Assessment Tool in assessing self-reported mobility, and to provide evidence for the applicability of these videos in elderly Latin American populations as a complement to physical performance measures. The sample consisted of 300 elderly participants (150 from Brazil, 150 from Colombia) recruited at neighborhood social centers. Mobility was assessed with the Mobility Assessment Tool, and compared with the Short Physical Performance Battery score and self-reported functional limitations. Reliability was calculated using intraclass correlation coefficients. Multiple linear regression analyses were used to assess associations among mobility assessment tools and health, and sociodemographic variables. A significant gradient of increasing Mobility Assessment Tool score with better physical function was observed for both self-reported and objective measures, and in each city. Associations between self-reported mobility and health were strong, and significant. Mobility Assessment Tool scores were lower in women at both sites. Intraclass correlation coefficients of the Mobility Assessment Tool were 0.94 (95% confidence interval 0.90-0.97) in Brazil and 0.81 (95% confidence interval 0.66-0.91) in Colombia. Mobility Assessment Tool scores were lower in Manizales than in Natal after adjustment by Short Physical Performance Battery, self-rated health and sex. These results provide evidence for high reliability and good validity of the Mobility Assessment Tool in its Spanish and Portuguese versions used in Latin American populations. In addition, the Mobility Assessment Tool can detect mobility differences related to environmental features that cannot be captured by objective performance measures. © 2013 Japan Geriatrics Society.

The Development and Validation of a Rapid Assessment Tool of Primary Care in China

PubMed Central

Mei, Jie; Liang, Yuan; Shi, LeiYu; Zhao, JingGe; Wang, YuTan; Kuang, Li

2016-01-01

Introduction. With Chinese health care reform increasingly emphasizing the importance of primary care, the need for a tool to evaluate primary care performance and service delivery is clear. This study presents a methodology for a rapid assessment of primary care organizations and service delivery in China. Methods. The study translated and adapted the Primary Care Assessment Tool-Adult Edition (PCAT-AE) into a Chinese version to measure core dimensions of primary care, namely, first contact, continuity, comprehensiveness, and coordination. A cross-sectional survey was conducted to assess the validity and reliability of the Chinese Rapid Primary Care Assessment Tool (CR-PCAT). Eight community health centers in Guangdong province have been selected to participate in the survey. Results. A total of 1465 effective samples were included for data analysis. Eight items were eliminated following principal component analysis and reliability testing. The principal component analysis extracted five multiple-item scales (first contact utilization, first contact accessibility, ongoing care, comprehensiveness, and coordination). The tests of scaling assumptions were basically met. Conclusion. The standard psychometric evaluation indicates that the scales have achieved relatively good reliability and validity. The CR-PCAT provides a rapid and reliable measure of four core dimensions of primary care, which could be applied in various scenarios. PMID:26885509

Linguistic validation of the Alberta Context Tool and two measures of research use, for German residential long term care

PubMed Central

2014-01-01

Background To study the association between organizational context and research utilization in German residential long term care (LTC), we translated three Canadian assessment instruments: the Alberta Context Tool (ACT), Estabrooks’ Kinds of Research Utilization (RU) items and the Conceptual Research Utilization Scale. Target groups for the tools were health care aides (HCAs), registered nurses (RNs), allied health professionals (AHPs), clinical specialists and care managers. Through a cognitive debriefing process, we assessed response processes validity–an initial stage of validity, necessary before more advanced validity assessment. Methods We included 39 participants (16 HCAs, 5 RNs, 7 AHPs, 5 specialists and 6 managers) from five residential LTC facilities. We created lists of questionnaire items containing problematic items plus items randomly selected from the pool of remaining items. After participants completed the questionnaires, we conducted individual semi-structured cognitive interviews using verbal probing. We asked participants to reflect on their answers for list items in detail. Participants’ answers were compared to concept maps defining the instrument concepts in detail. If at least two participants gave answers not matching concept map definitions, items were revised and re-tested with new target group participants. Results Cognitive debriefings started with HCAs. Based on the first round, we modified 4 of 58 ACT items, 1 ACT item stem and all 8 items of the RU tools. All items were understood by participants after another two rounds. We included revised HCA ACT items in the questionnaires for the other provider groups. In the RU tools for the other provider groups, we used different wording than the HCA version, as was done in the original English instruments. Only one cognitive debriefing round was needed with each of the other provider groups. Conclusion Cognitive debriefing is essential to detect and respond to problematic instrument

Understanding Interrater Reliability and Validity of Risk Assessment Tools Used to Predict Adverse Clinical Events.

PubMed

Siedlecki, Sandra L; Albert, Nancy M

This article will describe how to assess interrater reliability and validity of risk assessment tools, using easy-to-follow formulas, and to provide calculations that demonstrate principles discussed. Clinical nurse specialists should be able to identify risk assessment tools that provide high-quality interrater reliability and the highest validity for predicting true events of importance to clinical settings. Making best practice recommendations for assessment tool use is critical to high-quality patient care and safe practices that impact patient outcomes and nursing resources. Optimal risk assessment tool selection requires knowledge about interrater reliability and tool validity. The clinical nurse specialist will understand the reliability and validity issues associated with risk assessment tools, and be able to evaluate tools using basic calculations. Risk assessment tools are developed to objectively predict quality and safety events and ultimately reduce the risk of event occurrence through preventive interventions. To ensure high-quality tool use, clinical nurse specialists must critically assess tool properties. The better the tool's ability to predict adverse events, the more likely that event risk is mediated. Interrater reliability and validity assessment is relatively an easy skill to master and will result in better decisions when selecting or making recommendations for risk assessment tool use.

Charlotte Attitudes towards Sleep (CATS) Scale: A Validated Measurement Tool for College Students

ERIC Educational Resources Information Center

Peach, Hannah; Gaultney, Jane F.

2017-01-01

Objective: Using a 4-phase study design, the present study developed and tested the Charlotte Attitudes Towards Sleep (CATS) Scale, a measurement tool for assessing sleep attitudes in college students. Participants: Participants were 706 undergraduate students recruited at a southeastern university and on a national recruitment Web site between…

Validation of Caregiver-Centered Delirium Detection Tools: A Systematic Review.

PubMed

Rosgen, Brianna; Krewulak, Karla; Demiantschuk, Danielle; Ely, E Wesley; Davidson, Judy E; Stelfox, Henry T; Fiest, Kirsten M

2018-04-18

To summarize the validity of caregiver-centered delirium detection tools in hospitalized adults and assess associated patient and caregiver outcomes. Systematic review. We searched MEDLINE, EMBASE, PsycINFO, CINAHL, and Scopus from inception to May 15, 2017. Hospitalized adults. Caregiver-centered delirium detection tools. We drafted a protocol from the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Two reviewers independently completed abstract and full-text review, data extraction, and quality assessment. We summarized findings using descriptive statistics including mean, median, standard deviation, range, frequencies (percentages), and Cohen's kappa. Studies that reported on the validity of caregiver-centered delirium detection tools or associated patient and caregiver outcomes and were cohort or cross-sectional in design were included. We reviewed 6,056 titles and abstracts, included 6 articles, and identified 6 caregiver-centered tools. All tools were designed to be administered in several minutes or less and had 11 items or fewer. Three tools were caregiver administered (completed independently by caregivers): Family Confusion Assessment Method (FAM-CAM), Informant Assessment of Geriatric Delirium (I-AGeD), and Sour Seven. Three tools were caregiver informed (administered by a healthcare professional using caregiver input): Single Question in Delirium (SQiD), Single Screening Question Delirium (SSQ-Delirium), and Stressful Caregiving Response to Experiences of Dying. Caregiver-administered tools had better psychometric properties (FAM-CAM sensitivity 75%, 95% confidence interval (CI)=35-95%, specificity 91%, 95% CI=74-97%; Sour Seven positive predictive value 89.5%, negative predictive value 90%) than caregiver-informed tools (SQiD: sensitivity 80%, 95% CI=28.4-99.5%; specificity 71%, 95% CI=41.9-91.6%; SSQ-Delirium sensitivity 79.6%, specificity 56.1%). Delirium detection is essential for appropriate delirium management

A Screening Tool to Measure Eye Contact Avoidance in Boys with Fragile X Syndrome

ERIC Educational Resources Information Center

Hall, Scott S.; Venema, Kaitlin M.

2017-01-01

We examined the reliability, validity and factor structure of the Eye Contact Avoidance Scale (ECAS), a new 15-item screening tool designed to measure eye contact avoidance in individuals with fragile X syndrome (FXS). Internal consistency of the scale was acceptable to excellent and convergent validity with the Social Responsiveness Scale, Second…

Validity of a New Patient Engagement Measure: The Altarum Consumer Engagement (ACE) Measure.

PubMed

Duke, Christopher C; Lynch, Wendy D; Smith, Brad; Winstanley, Julie

2015-12-01

The objective of this study was to report on the validation of new scales [called the Altarum Consumer Engagement (ACE) Measure] that are indicative of an individual's engagement in health and healthcare decisions. The instrument was created to broaden the scope of how engagement is measured and understood, and to update the concept of engagement to include modern information sources, such as online health resources and ratings of providers and patient health. Data were collected through an online survey with a US population of 2079 participants. A combination of Principal Component Analysis (PCA) and detailed Rasch analyses were conducted to identify specific subscales of engagement. Results were compared to another commonly used survey instrument, and outcomes were compared for construct validity. The PCA identified a four-factor structure composed of 21 items. The factors were named Commitment, Informed Choice, Navigation, and Ownership. Rasch analyses confirmed scale stability. Relevant outcomes were correlated in the expected direction, such as health status, lifestyle behaviors, medication adherence, and observed expected group differences. This study confirmed the validity of the new ACE Measure and its utility in screening for and finding group differences in activities related to patient engagement and health consumerism, such as using provider comparison tools and asking about medical costs.

Multicentre study for validation of the French addictovigilance network reports assessment tool

PubMed Central

Hardouin, Jean Benoit; Rousselet, Morgane; Gerardin, Marie; Guerlais, Marylène; Guillou, Morgane; Bronnec, Marie; Sébille, Véronique; Jolliet, Pascale

2016-01-01

Aims The French health authority (ANSM) is responsible for monitoring medicinal and other drug dependencies. To support these activities, the ANSM manages a network of 13 drug dependence evaluation and information centres (Centres d'Evaluation et d'Information sur la Pharmacodépendance ‐ Addictovigilance ‐ CEIP‐A) throughout France. In 2006, the Nantes CEIP‐A created a new tool called the EGAP (Echelle de GrAvité de la Pharmacodépendance‐ drug dependence severity scale) based on DSM IV criteria. This tool allows the creation of a substance use profile that enables the drug dependence severity to be homogeneously quantified by assigning a score to each substance indicated in the reports from health professionals. This article describes the validation and psychometric properties of the drug dependence severity score obtained from the scale ( Clinicaltrials.gov NCT01052675). Method The validity of the EGAP construct, the concurrent validity and the discriminative ability of the EGAP score, the consistency of answers to EGAP items, the internal consistency and inter rater reliability of the EGAP score were assessed using statistical methods that are generally used for psychometric tests. Results The total EGAP score was a reliable and precise measure for evaluating drug dependence (Cronbach alpha = 0.84; ASI correlation = 0.70; global ICC = 0.92). In addition to its good psychometric properties, the EGAP is a simple and efficient tool that can be easily specified on the official ANSM notification form. Conclusion The good psychometric properties of the total EGAP score justify its use for evaluating the severity of drug dependence. PMID:27302554

Validation of screening tools to assess appetite among geriatric patients.

PubMed

Hanisah, R; Suzana, S; Lee, F S

2012-07-01

Poor appetite is one of the main contributing factors of poor nutritional status among elderly individuals. Recognizing the importance of assessment of appetite, a cross sectional study was conducted to determine the validity of appetite screening tools namely, the Council on Nutrition Appetite questionnaire (CNAQ) and the simplified nutritional appetite questionnaire (SNAQ) against the appetite, hunger and sensory perception questionnaire (AHSPQ), measures of nutritional status and food intake among geriatric patients at the main general hospital in Malaysia. Nutritional status was assessed using the subjective global assessment (SGA) while food intake was measured using the dietary history questionnaire (DHQ). Anthropometric parameters included weight, height, body mass index (BMI), calf circumference (CC) and mid upper arm circumference (MUAC). A total of 145 subjects aged 60 to 86 years (68.3 ± 5.8 years) with 31.7% men and 68.3% women were recruited from outpatients (35 subjects) and inpatients (110 subjects) of Kuala Lumpur Hospital of Malaysia. As assessed by SGA, most subjects were classified as mild to moderately malnourished (50.4%), followed by normal (38.6%) and severely malnourished (11.0%). A total of 79.3% and 57.2% subjects were classified as having poor appetite according to CNAQ and SNAQ, respectively. CNAQ (80.9%) had a higher sensitivity than SNAQ (69.7%) when validated against nutritional status as assessed using SGA. However, the specificity of SNAQ (62.5%) was higher than CNAQ (23.2%). Positive predictive value for CNAQ and SNAQ were 62.6% and 74.7%, respectively. Cronbach's alpha for CNAQ and SNAQ were 0.546 and 0.578, respectively. History of weight loss over the past one year (Adjusted odds ratio 2.49) (p < 0.01) and thiamine intake less than the recommended nutrient intake (RNI) (Adjusted odds ratio 3.04) (p < 0.05) were risk factors for poor appetite among subjects. In conclusion, malnutrition and poor appetite were prevalent among the

Development and validation of a new assessment tool for suturing skills in medical students.

PubMed

Sundhagen, Henriette Pisani; Almeland, Stian Kreken; Hansson, Emma

2018-01-01

In recent years, emphasis has been put on that medical student should demonstrate pre-practice/pre-registration core procedural skills to ensure patient safety. Nonetheless, the formal teaching and training of basic suturing skills to medical students have received relatively little attention and there is no standard for what should be tested and how. The aim of this study was to develop and validate, using scientific methods, a tool for assessment of medical students' suturing skills, measuring both micro- and macrosurgical qualities. A tool was constructed and content, construct, concurrent validity, and inter-rater, inter-item, inter-test reliability were tested. Three groups were included: students with no training in suturing skills, students who have had training, plastic surgery. The results show promising reliability and validity when assessing novice medical students' suturing skills. Further studies are needed on implementation of the instrument. Moreover, how the instrument can be used to give formative feedback, evaluate if a required standard is met and for curriculum development needs further investigation.Level of Evidence: Not ratable.

The Development and Validation of the Algebra Curriculum Based Measure: A Measure of Preschool Children's Sorting and Classifying Skills

ERIC Educational Resources Information Center

Maherally, Mohammad Iqbal

2014-01-01

The purpose of this study was to develop and validate an assessment tool entitled the Algebra Curriculum Based Measure (ACBM) with the intent of measuring preschool children's sorting and classifying skills based on one attribute (color, shape, and size) and two attributes (color and shape) simultaneously; and their ability to explain their…

Development and Validation of a Tool for Measurement of Patient Satisfaction with Nursing Care at Oak Hill Hospital.

ERIC Educational Resources Information Center

Callow, Elizabeth K.

The Department of Nursing at Oak Hill Hospital, Spring Hill (Florida) did not have a measurement instrument for patient evaluation of hospital nursing services. An instrument to measure patient satisfaction with nursing was developed and validated. Criteria identified through a literature search were reviewed, modified, and validated by a…

Validating SPICES as a Screening Tool for Frailty Risks among Hospitalized Older Adults

PubMed Central

Aronow, Harriet Udin; Borenstein, Jeff; Haus, Flora; Braunstein, Glenn D.; Bolton, Linda Burnes

2014-01-01

Older patients are vulnerable to adverse hospital events related to frailty. SPICES, a common screening protocol to identify risk factors in older patients, alerts nurses to initiate care plans to reduce the probability of patient harm. However, there is little published validating the association between SPICES and measures of frailty and adverse outcomes. This paper used data from a prospective cohort study on frailty among 174 older adult inpatients to validate SPICES. Almost all patients met one or more SPICES criteria. The sum of SPICES was significantly correlated with age and other well-validated assessments for vulnerability, comorbid conditions, and depression. Individuals meeting two or more SPICES criteria had a risk of adverse hospital events three times greater than individuals with either no or one criterion. Results suggest that as a screening tool used within 24 hours of admission, SPICES is both valid and predictive of adverse events. PMID:24876954

Measuring Resilience in the Adolescent Population: A Succinct Tool for Outpatient Adolescent Health.

PubMed

Barger, Jordan; Vitale, Patty; Gaughan, John P; Feldman-Winter, Lori

2017-10-01

To create a valid tool to measure adolescent resilience, and to determine if this tool correlates with current participation in risk behaviors and prior adverse childhood events. One hundred adolescents were recruited from primary care clinics in New Jersey for this cross-sectional study. A "7Cs tool" was developed to measure resilience using the 7Cs model of resilience. All participants completed the 7Cs tool, the Adverse Childhood Events Survey, and the Health Survey for Adolescents to identify current risk behaviors. Demographic and background data were also collected. To assess the validity of the 7Cs tool, Cronbach alpha, principal factor analysis, Spearman coefficients, and sensitivity analyses were conducted. The χ 2 test and ORs were used to determine if any relationships exist between resilience and prior adverse childhood events and risk taking behaviors. Participants ranged from 13 to 21 years old (65% female). Internal consistency was established using Cronbach alpha (0.7). Lower resilience correlated with higher adverse childhood events (P = .008) and Health Survey for Adolescents scores (P < .001). Lower resilience was associated with increased problems in school (OR 2.6; P = .021), drug use (OR 4.0; P = .004), violent behavior (OR 3.7; P = .002), recent depression (OR 5.0; P < .001), and suicidality (OR 4.1; P = .009). Higher resilience was associated with participation in exercise (P = .001) and activities (P = .01). The 7Cs tool is an internally validated tool that may be used to screen adolescent resilience and guide pediatricians' counseling against risk behaviors. Further studies will evaluate resilience-building interventions based on results from this study. Copyright © 2017 Elsevier Inc. All rights reserved.

Knowing Every Child: Validation of the Holistic Student Assessment (HSA) as a Measure of Social-Emotional Development.

PubMed

Malti, Tina; Zuffianò, Antonio; Noam, Gil G

2018-04-01

Knowing every child's social-emotional development is important as it can support prevention and intervention approaches to meet the developmental needs and strengths of children. Here, we discuss the role of social-emotional assessment tools in planning, implementing, and evaluating preventative strategies to promote mental health in all children and adolescents. We, first, selectively review existing tools and identify current gaps in the measurement literature. Next, we introduce the Holistic Student Assessment (HSA), a tool that is based in our social-emotional developmental theory, The Clover Model, and designed to measure social-emotional development in children and adolescents. Using a sample of 5946 students (51% boys, M age  = 13.16 years), we provide evidence for the psychometric validity of the self-report version of the HSA. First, we document the theoretically expected 7-dimension factor structure in a calibration sub-sample (n = 984) and cross-validate its structure in a validation sub-sample (n = 4962). Next, we show measurement invariance across development, i.e., late childhood (9- to 11-year-olds), early adolescence (12- to 14-year-olds), and middle adolescence (15- to 18-year-olds), and evidence for the HSA's construct validity in each age group. The findings support the robustness of the factor structure and confirm its developmental sensitivity. Structural equation modeling validity analysis in a multiple-group framework indicates that the HSA is associated with mental health in expected directions across ages. Overall, these findings show the psychometric properties of the tool, and we discuss how social-emotional tools such as the HSA can guide future research and inform large-scale dissemination of preventive strategies.

Development and Validation of a Standardized Tool for Prioritization of Information Sources.

PubMed

Akwar, Holy; Kloeze, Harold; Mukhi, Shamir

2016-01-01

To validate the utility and effectiveness of a standardized tool for prioritization of information sources for early detection of diseases. The tool was developed with input from diverse public health experts garnered through survey. Ten raters used the tool to evaluate ten information sources and reliability among raters was computed. The Proc mixed procedure with random effect statement and SAS Macros were used to compute multiple raters' Fleiss Kappa agreement and Kendall's Coefficient of Concordance. Ten disparate information sources evaluated obtained the following composite scores: ProMed 91%; WAHID 90%; Eurosurv 87%; MediSys 85%; SciDaily 84%; EurekAl 83%; CSHB 78%; GermTrax 75%; Google 74%; and CBC 70%. A Fleiss Kappa agreement of 50.7% was obtained for ten information sources and 72.5% for a sub-set of five sources rated, which is substantial agreement validating the utility and effectiveness of the tool. This study validated the utility and effectiveness of a standardized criteria tool developed to prioritize information sources. The new tool was used to identify five information sources suited for use by the KIWI system in the CEZD-IIR project to improve surveillance of infectious diseases. The tool can be generalized to situations when prioritization of numerous information sources is necessary.

Validation of virtual reality as a tool to understand and prevent child pedestrian injury.

PubMed

Schwebel, David C; Gaines, Joanna; Severson, Joan

2008-07-01

In recent years, virtual reality has emerged as an innovative tool for health-related education and training. Among the many benefits of virtual reality is the opportunity for novice users to engage unsupervised in a safe environment when the real environment might be dangerous. Virtual environments are only useful for health-related research, however, if behavior in the virtual world validly matches behavior in the real world. This study was designed to test the validity of an immersive, interactive virtual pedestrian environment. A sample of 102 children and 74 adults was recruited to complete simulated road-crossings in both the virtual environment and the identical real environment. In both the child and adult samples, construct validity was demonstrated via significant correlations between behavior in the virtual and real worlds. Results also indicate construct validity through developmental differences in behavior; convergent validity by showing correlations between parent-reported child temperament and behavior in the virtual world; internal reliability of various measures of pedestrian safety in the virtual world; and face validity, as measured by users' self-reported perception of realism in the virtual world. We discuss issues of generalizability to other virtual environments, and the implications for application of virtual reality to understanding and preventing pediatric pedestrian injuries.

Facial expression drawings and the full cup test: valid tools for the measurement of swelling after dental surgery.

PubMed

Al-Samman, A A; Othman, H A

2017-01-01

Assessment of postoperative swelling is subjective and depends on the patient's opinion. The aim of this study was to evaluate the validity of facial expression drawings and the full cup test and to compare their performance with that of other scales in measuring postoperative swelling. Fifty patients who had one of several procedures were included. All patients were asked to fill in a form for six days postoperatively (including the day of operation) that contained four scales to rate the amount of swelling: facial expression drawings, the full cup test, the visual analogue scale (VAS), and the verbal rating scale (VRS). Seven patients did not know how to use some of the scales. However, all patients successfully used the facial expression drawings. There was a significant difference between the scale that patients found easiest to use and the others (p<0.008). Fourteen patients selected facial expression drawings and five the VRS. The results showed that the correlations between the scales were good (p<0.01). Facial expression drawings and the full cup test are valid tools and could be used to assess postoperative swelling interchangeably with other scales for rating swelling, and some patients found facial expression drawings were the easiest to use. Copyright © 2016 The British Association of Oral and Maxillofacial Surgeons. Published by Elsevier Ltd. All rights reserved.

Cross-cultural validation of Cancer Communication Assessment Tool in Korea.

PubMed

Shin, Dong Wook; Shin, Jooyeon; Kim, So Young; Park, Boram; Yang, Hyung-Kook; Cho, Juhee; Lee, Eun Sook; Kim, Jong Heun; Park, Jong-Hyock

2015-02-01

Communication between cancer patients and caregivers is often suboptimal. The Cancer Communication Assessment Tool for Patient and Families (CCAT-PF) is a unique tool developed to measure congruence in patient-family caregiver communication employing a dyadic approach. We aimed to examine the cross-cultural applicability of the CCAT in the Korean healthcare setting. Linguistic validation of the CCAT-PF was performed through a standard forward-backward translation process. Psychometric validation was performed with 990 patient-caregiver dyads recruited from 10 cancer centers. Mean scores of CCAT-P and CCAT-F were similar at 44.8 for both scales. Mean CCAT-PF score was 23.7 (8.66). Concordance of each items between patients and caregivers was low (weighted kappa values <0.20 for all items and Spearman's rho <0.18 for scale scores). Scale scores did not differ significantly across a variety of cancer types and stages. The CCAT-P or CCAT-F score was weakly associated with mental health and quality of life outcomes. The CCAT-PF was correlated weakly with both patient-perceived and caregiver-perceived family avoidance of cancer care scales. The CCAT-PF Korean version showed similar psychometric properties to the original English version in the assessment of communication congruence between cancer patient and family caregivers. Copyright © 2014 John Wiley & Sons, Ltd.

[Validation of measurement methods and estimation of uncertainty of measurement of chemical agents in the air at workstations].

PubMed

Dobecki, Marek

2012-01-01

This paper reviews the requirements for measurement methods of chemical agents in the air at workstations. European standards, which have a status of Polish standards, comprise some requirements and information on sampling strategy, measuring techniques, type of samplers, sampling pumps and methods of occupational exposure evaluation at a given technological process. Measurement methods, including air sampling and analytical procedure in a laboratory, should be appropriately validated before intended use. In the validation process, selected methods are tested and budget of uncertainty is set up. The validation procedure that should be implemented in the laboratory together with suitable statistical tools and major components of uncertainity to be taken into consideration, were presented in this paper. Methods of quality control, including sampling and laboratory analyses were discussed. Relative expanded uncertainty for each measurement expressed as a percentage, should not exceed the limit of values set depending on the type of occupational exposure (short-term or long-term) and the magnitude of exposure to chemical agents in the work environment.

Screening tool for oropharyngeal dysphagia in stroke - Part I: evidence of validity based on the content and response processes.

PubMed

Almeida, Tatiana Magalhães de; Cola, Paula Cristina; Pernambuco, Leandro de Araújo; Magalhães, Hipólito Virgílio; Magnoni, Carlos Daniel; Silva, Roberta Gonçalves da

2017-08-17

The aim of the present study was to identify the evidence of validity based on the content and response process of the Rastreamento de Disfagia Orofaríngea no Acidente Vascular Encefálico (RADAVE; "Screening Tool for Oropharyngeal Dysphagia in Stroke"). The criteria used to elaborate the questions were based on a literature review. A group of judges consisting of 19 different health professionals evaluated the relevance and representativeness of the questions, and the results were analyzed using the Content Validity Index. In order to evidence validity based on the response processes, 23 health professionals administered the screening tool and analyzed the questions using a structured scale and cognitive interview. The RADAVE structured to be applied in two stages. The first version consisted of 18 questions in stage I and 11 questions in stage II. Eight questions in stage I and four in stage II did not reach the minimum Content Validity Index, requiring reformulation by the authors. The cognitive interview demonstrated some misconceptions. New adjustments were made and the final version was produced with 12 questions in stage I and six questions in stage II. It was possible to develop a screening tool for dysphagia in stroke with adequate evidence of validity based on content and response processes. Both validity evidences obtained so far allowed to adjust the screening tool in relation to its construct. The next studies will analyze the other evidences of validity and the measures of accuracy.

An evaluation tool for Myofascial Adhesions in Patients after Breast Cancer (MAP-BC evaluation tool): Concurrent, face and content validity.

PubMed

De Groef, An; Van Kampen, Marijke; Moortgat, Peter; Anthonissen, Mieke; Van den Kerckhove, Eric; Christiaens, Marie-Rose; Neven, Patrick; Geraerts, Inge; Devoogdt, Nele

2018-01-01

To investigate the concurrent, face and content validity of an evaluation tool for Myofascial Adhesions in Patients after Breast Cancer (MAP-BC evaluation tool). 1) Concurrent validity of the MAP-BC evaluation tool was investigated by exploring correlations (Spearman's rank Correlation Coefficient) between the subjective scores (0 -no adhesions to 3 -very strong adhesions) of the skin level using the MAP-BC evaluation tool and objective elasticity parameters (maximal skin extension and gross elasticity) generated by the Cutometer Dual MPA 580. Nine different examination points on and around the mastectomy scar were evaluated. 2) Face and content validity were explored by questioning therapists experienced with myofascial therapy in breast cancer patients about the comprehensibility and comprehensiveness of the MAP-BC evaluation tool. 1) Only three meaningful correlations were found on the mastectomy scar. For the most lateral examination point on the mastectomy scar a moderate negative correlation (-0.44, p = 0.01) with the maximal skin extension and a moderate positive correlation with the resistance versus ability of returning or 'gross elasticity' (0.42, p = 0.02) were found. For the middle point on the mastectomy scar an almost moderate positive correlation with gross elasticity was found as well (0.38, p = 0.04) 2) Content and face validity have been found to be good. Eighty-nine percent of the respondent found the instructions understandable and 98% found the scoring system obvious. Thirty-seven percent of the therapists suggested to add the possibility to evaluate additional anatomical locations in case of reconstructive and/or bilateral surgery. The MAP-BC evaluation tool for myofascial adhesions in breast cancer patients has good face and content validity. Evidence for good concurrent validity of the skin level was found only on the mastectomy scar itself.

Development and Validation of an Instrument to Measure University Students' Biotechnology Attitude

NASA Astrophysics Data System (ADS)

Erdogan, Mehmet; Özel, Murat; Uşak, Muhammet; Prokop, Pavol

2009-06-01

The impact of biotechnologies on peoples' everyday lives continuously increases. Measuring young peoples' attitudes toward biotechnologies is therefore very important and its results are useful not only for science curriculum developers and policy makers, but also for producers and distributors of genetically modified products. Despite of substantial number of instruments which focused on measuring student attitudes toward biotechnology, a majority of them were not rigorously validated. This study deals with the development and validation of an attitude questionnaire toward biotechnology. Detailed information on development and validation process of the instrument is provided. Data gathered from 326 university students provided evidence for the validity and reliability of the new instrument which consists of 28 attitude items on a five point likert type scale. It is believed that the instrument will serve as a valuable tool for both instructors and researchers in science education to assess students' biotechnology attitudes.

[Validation of a nutritional screening tool for hospitalized pediatric patients].

PubMed

Lama More, R A; Moráis López, A; Herrero Álvarez, M; Caraballo Chicano, S; Galera Martínez, R; López Ruzafa, E; Rodríguez Martínez, G; de la Mano Hernández, A; Rivero de la Rosa, M C

2012-01-01

Malnutrition among hospitalized patients has clinical implications, and interest has arisen to find screening tools able to identify subjects under risk. At present, there is no consensus about the most suitable nutrition screening tool for pediatric patients. To validate STAMP (Screening Tool for the Assessment of Malnutrition in Pediatrics) pediatric screening tool in Spain. Descriptive cross-sectional study of patients admitted to a 3rd level children's hospital with both medical and surgical specialities. During the first 24 hours of admission, STAMP screening tool was applied. For its validation, results were compared with those obtained from a nutritional assessment performed by specialist staff, which included clinical, anthropometric and body composition data. A sample of 250 children was studied. Nutritional assessment identified 64 patients (25.6%) under risk, 40 of whom were malnourished (16%). STAMP classified 48.4% of the patients as being under nutritional risk. This tool showed 75% sensitivity and 60.8% specificity when identifying patients under risk according to nutritional assessment. It showed 90% sensitivity and 59.5% specificity when identifying malnourished patients. Malnutrition was less frequent than that reported in other European countries, although diagnosis technique was different. STAMP is a simple and useful tool for nutritional screening, avoiding the need to assess all patients on admission in order to identify those under nutritional risk.

Validation and Cultural Adaptation of the Arabic Version of the Eating Assessment Tool (EAT-10).

PubMed

Farahat, Mohamed; Mesallam, Tamer A

2015-01-01

The Eating Assessment Tool (EAT-10) is a 10-item self-administered questionnaire. It is a noninvasive tool to measure patients' perception of their swallowing problems. The purposes of the present study were to develop an Arabic version of the EAT-10 and to evaluate its validity, consistency, and reliability in the Arabic-speaking population with oropharyngeal dysphagia. This was a prospective study carried out at the Communication and Swallowing Disorders Unit, King Saud University, Riyadh, Saudi Arabia. The Arabic EAT-10 was administered to 138 patients with oropharyngeal dysphagia and 83 control subjects. Internal consistency and test-retest reliability were evaluated. Content and clinical validity were studied, and the EAT-10 results were compared across patients and control groups. The Arabic EAT-10 showed excellent internal consistency (Cronbach's α = 0.92). Also, good test-retest reliability was found for the total scores of the Arabic EAT-10 (intraclass correlation = 0.73). There was a significant difference in Arabic EAT-10 scores between the oropharyngeal dysphagia group and the control group (p < 0.001). This study demonstrated that the Arabic EAT-10 is a valid tool that can be used for screening of dysphagia-related problems in an Arabic-speaking population. © 2016 S. Karger AG, Basel.

Monitoring fugitive methane and natural gas emissions, validation of measurement techniques.

NASA Astrophysics Data System (ADS)

Robinson, Rod; Innocenti, Fabrizio; Gardiner, Tom; Helmore, Jon; Finlayson, Andrew; Connor, Andy

2017-04-01

The detection and quantification of fugitive and diffuse methane emissions has become an increasing priority in recent years. As the requirements for routine measurement to support industry initiatives increase there is a growing requirement to assess and validate the performance of fugitive emission measurement technologies. For reported emissions traceability and comparability of measurements is important. This talk will present recent work addressing these needs. Differential Absorption Lidar (DIAL) is a laser based remote sensing technology, able to map the concentration of gases in the atmosphere and determine emission fluxes for fugitive emissions. A description of the technique and its application for determining fugitive emissions of methane from oil and gas operations and waste management sites will be given. As DIAL has gained acceptance as a powerful tool for the measurement and quantification of fugitive emissions, and given the rich data it produces, it is being increasingly used to assess and validate other measurement approaches. In addition, to support the validation of technologies, we have developed a portable controlled release facility able to simulate the emissions from area sources. This has been used to assess and validate techniques which are used to monitor emissions. The development and capabilities of the controlled release facility will be described. This talk will report on recent studies using DIAL and the controlled release facility to validate fugitive emission measurement techniques. This includes side by side comparisons of two DIAL systems, the application of both the DIAL technique and the controlled release facility in a major study carried out in 2015 by South Coast Air Quality Management District (SCAQMD) in which a number of optical techniques were assessed and the development of a prototype method validation approach for techniques used to measure methane emissions from shale gas sites. In conclusion the talk will provide an

ExEP yield modeling tool and validation test results

NASA Astrophysics Data System (ADS)

Morgan, Rhonda; Turmon, Michael; Delacroix, Christian; Savransky, Dmitry; Garrett, Daniel; Lowrance, Patrick; Liu, Xiang Cate; Nunez, Paul

2017-09-01

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards Definition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end crossvalidation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Validation of a Tool Evaluating Educational Apps for Smart Education

ERIC Educational Resources Information Center

Lee, Jeong-Sook; Kim, Sung-Wan

2015-01-01

The purpose of this study is to develop and validate an evaluation tool of educational apps for smart education. Based on literature reviews, a potential model for evaluating educational apps was suggested. An evaluation tool consisting of 57 survey items was delivered to 156 students in middle and high schools. An exploratory factor analysis was…

Cross-cultural adaptation, reliability, and validity of the Persian version of the Cumberland Ankle Instability Tool.

PubMed

Hadadi, Mohammad; Ebrahimi Takamjani, Ismail; Ebrahim Mosavi, Mohammad; Aminian, Gholamreza; Fardipour, Shima; Abbasi, Faeze

2017-08-01

The purpose of the present study was to translate and to cross-culturally adapt the Cumberland Ankle Instability Tool (CAIT) into Persian language and to evaluate its psychometric properties. The International Quality of Life Assessment process was pursued to translate CAIT into Persian. Two groups of Persian-speaking individuals, 105 participants with a history of ankle sprain and 30 participants with no history of ankle sprain, were asked to fill out Persian version of CAIT (CAIT-P), Foot and Ankle Ability Measure (FAAM), and Visual Analog Scale (VAS). Data obtained from the first administration of CAIT were used to evaluate floor and ceiling effects, internal consistency, dimensionality, and criterion validity. To determine the test-retest reliability, 45 individuals re-filled CAIT 5-7 days after the first session. Cronbach's alpha was over the cutoff point of 0.70 for both ankles and in both groups. The intra-class correlation coefficient was high for right (0.95) and left (0.91) ankles. There was a strong correlation between each item and the total score of the CAIT-P. Although the CAIT-P had strong correlation with VAS, its correlation with both subscales of FAAM was moderate. The CAIT-P has good validity and reliability and it can be used by clinicians and researchers for identification and investigation of functional ankle instability. Implications for Rehabilitation Chronic ankle instability is one of the most common consequences of acute ankle sprain. Cumberland Ankle Instability Tool is an acceptable measure to determine functional ankle instability and its severity. The Persian version of Cumberland Ankle Instability Tool is a valid and reliable tool for clinical and research purpose in Persian-speaking individuals.

Development and validation of a collaborative behaviors objective assessment tool for end-of-life communication.

PubMed

Blackhall, Leslie J; Erickson, Jeanne; Brashers, Valentina; Owen, John; Thomas, Shannon

2014-01-01

Helping families make end-of-life decisions requires close collaboration between physicians and nurses. However, medical and nursing students have little formal training in how to collaborate in this task, and few instruments are available to measure collaborative behaviors. The objective of this project was to develop and validate observational assessment tools to measure specific interprofessional competencies in medical and nursing students related to end-of-life discussions. A literature search for evidence-based guidelines and competencies and focus groups with an expert panel of nurses and physicians were used to outline best collaborative practice behaviors for nurses and physicians in an end-of-life decision making simulation. The panel used these practice-behavior checklists to rate videotaped student scenarios and then refined the checklists for validity and clarity until the tools had acceptable inter-rater reliability. The setting was a workshop teaching end-of-life communication to third-year nursing and medical students. Inter-rater reliability was measured using percent agreement and kappa; internal consistency was measured using Cronbach's alpha. Collaborative behaviors objective assessment tools (CBOATs) for nursing and medical students were developed. For the medical CBOAT we found 85% agreement between raters, with an overall kappa of 0.744 and Cronbach's alpha of 0.806. For the nursing CBOAT there was 81% agreement, with a kappa of 0.686 and Cronbach's alpha of 0.845. Development of an end-of-life CBOAT clarified the important collaborative behaviors needed by physician and nurse. The resulting instruments provide a helpful guide for teaching interprofessional sessions related to the end of life and measuring student outcomes using an objective strategy.

Measuring the Quality of Early Childhood Programs--Guidelines for Effective Evaluation Tools.

ERIC Educational Resources Information Center

Epstein, Ann S.

2000-01-01

Summarizes what High/Scope discovered to be the critical characteristics of a comprehensive and valid measure of early childhood program quality. Provides suggestions for how the tool can be used, and highlights with examples. Asserts that the guidelines effectively assess efforts of child development, staff development, and soundness of…

Testing the validity, reliability and utility of the Self-Administration of Medication (SAM) tool in patients undergoing rehabilitation.

PubMed

Anderson, Jessica; Manias, Elizabeth; Kusljic, Snezana; Finch, Sue

2014-01-01

Determination of patients' ability to self-administer medications in the hospital has largely been determined using the subjective judgment of health professionals. To examine the validity, reliability and utility of the Self-Administration of Medication (SAM) tool as an objective means to determine patients' ability to self-administer in a rehabilitation unit of a public teaching hospital in Melbourne, Australia. To assess validity of the SAM tool, associations were examined between the total SAM tool score and of the patients' competence to self-administer from the perceptions of the tool administrator, patients and nurses. Validity also was determined from a principal component analysis. Pearson correlations were calculated for how SAM scores related to scores obtained from the Functional Independence Measure (FIM) and Barthel Score Index (BSI). To assess the SAM tool's reliability, a Cronbach's alpha coefficient was calculated. Utility of the SAM tool was evidenced by documenting its administration time. One hundred patients participated in this study. The SAM tool had a Cronbach's alpha coefficient of 0.75 and took a mean time of 5.36 min to complete. The capability to self-medicate section of the SAM tool had strong correlations with the FIM (r = 0.485) and BSI (r = 0.472) data, respectively, and the total SAM tool had moderate and strong correlations with the nurses' (r = 0.315) and tool administrator's (r = 0.632) perceptions of patients' ability to self-administer, respectively. Bland-Altman and ROC curve analyses showed poor agreement between the total SAM tool score and the nurses' perceptions. The SAM tool demonstrated acceptable overall internal consistency. It only requires a short time to be completed and is more objective than seeking out health professionals' perceptions. Additional research is needed to further validate this approach to determining patients' ability to self-medicate. Crown Copyright © 2014. Published by Elsevier Inc. All

Measuring pain in patients undergoing hemodialysis: a review of pain assessment tools

PubMed Central

Upadhyay, Chandani; Cameron, Karen; Murphy, Laura; Battistella, Marisa

2014-01-01

Background Patients undergoing hemodialysis frequently report pain with multifactorial causes, not limited to that experienced directly from hemodialysis treatment. Their pain may be nociceptive, neuropathic, somatic or visceral in nature. Despite this, pain in this population remains under-recognized and under-treated. Although several tools have been used to measure pain in patients undergoing hemodialysis as reported in the literature, none of them have been validated specifically in this population. The objective for this review was to compare and contrast these pain assessment tools and discuss their clinical utility in this patient population. Methods To identify pain assessment tools studied in patients undergoing hemodialysis, a literature search was performed in PubMed and Medline. An expert panel of dialysis and pain clinicians reviewed each tool. Each pain assessment tool was assessed on how it is administered and scored, its psychometric properties such as reliability, validity and responsiveness to change, and its clinical utility in a hemodialysis population. Brief Pain Inventory, McGill Pain Questionnaire, Pain Management Index, Edmonton Symptom Assessment System, Visual Analogue Scale and Faces Pain Scale were evaluated and compared. Results This assessment will help clinicians practicing in nephrology to determine which of these pain assessment tools is best suited for use in their individual clinical practice. PMID:25852910

Validating a work group climate assessment tool for improving the performance of public health organizations

PubMed Central

Perry, Cary; LeMay, Nancy; Rodway, Greg; Tracy, Allison; Galer, Joan

2005-01-01

Background This article describes the validation of an instrument to measure work group climate in public health organizations in developing countries. The instrument, the Work Group Climate Assessment Tool (WCA), was applied in Brazil, Mozambique, and Guinea to assess the intermediate outcomes of a program to develop leadership for performance improvement. Data were collected from 305 individuals in 42 work groups, who completed a self-administered questionnaire. Methods The WCA was initially validated using Cronbach's alpha reliability coefficient and exploratory factor analysis. This article presents the results of a second validation study to refine the initial analyses to account for nested data, to provide item-level psychometrics, and to establish construct validity. Analyses included eigenvalue decomposition analysis, confirmatory factor analysis, and validity and reliability analyses. Results This study confirmed the validity and reliability of the WCA across work groups with different demographic characteristics (gender, education, management level, and geographical location). The study showed that there is agreement between the theoretical construct of work climate and the items in the WCA tool across different populations. The WCA captures a single perception of climate rather than individual sub-scales of clarity, support, and challenge. Conclusion The WCA is useful for comparing the climates of different work groups, tracking the changes in climate in a single work group over time, or examining differences among individuals' perceptions of their work group climate. Application of the WCA before and after a leadership development process can help work groups hold a discussion about current climate and select a target for improvement. The WCA provides work groups with a tool to take ownership of their own group climate through a process that is simple and objective and that protects individual confidentiality. PMID:16223447

The validity of a professional competence tool for physiotherapy students in simulation-based clinical education: a Rasch analysis.

PubMed

Judd, Belinda K; Scanlan, Justin N; Alison, Jennifer A; Waters, Donna; Gordon, Christopher J

2016-08-05

Despite the recent widespread adoption of simulation in clinical education in physiotherapy, there is a lack of validated tools for assessment in this setting. The Assessment of Physiotherapy Practice (APP) is a comprehensive tool used in clinical placement settings in Australia to measure professional competence of physiotherapy students. The aim of the study was to evaluate the validity of the APP for student assessment in simulation settings. A total of 1260 APPs were collected, 971 from students in simulation and 289 from students in clinical placements. Rasch analysis was used to examine the construct validity of the APP tool in three different simulation assessment formats: longitudinal assessment over 1 week of simulation; longitudinal assessment over 2 weeks; and a short-form (25 min) assessment of a single simulation scenario. Comparison with APPs from 5 week clinical placements in hospital and clinic-based settings were also conducted. The APP demonstrated acceptable fit to the expectations of the Rasch model for the 1 and 2 week clinical simulations, exhibiting unidimensional properties that were able to distinguish different levels of student performance. For the short-form simulation, nine of the 20 items recorded greater than 25 % of scores as 'not-assessed' by clinical educators which impacted on the suitability of the APP tool in this simulation format. The APP was a valid assessment tool when used in longitudinal simulation formats. A revised APP may be required for assessment in short-form simulation scenarios.

A collaborative environment for developing and validating predictive tools for protein biophysical characteristics

NASA Astrophysics Data System (ADS)

Johnston, Michael A.; Farrell, Damien; Nielsen, Jens Erik

2012-04-01

The exchange of information between experimentalists and theoreticians is crucial to improving the predictive ability of theoretical methods and hence our understanding of the related biology. However many barriers exist which prevent the flow of information between the two disciplines. Enabling effective collaboration requires that experimentalists can easily apply computational tools to their data, share their data with theoreticians, and that both the experimental data and computational results are accessible to the wider community. We present a prototype collaborative environment for developing and validating predictive tools for protein biophysical characteristics. The environment is built on two central components; a new python-based integration module which allows theoreticians to provide and manage remote access to their programs; and PEATDB, a program for storing and sharing experimental data from protein biophysical characterisation studies. We demonstrate our approach by integrating PEATSA, a web-based service for predicting changes in protein biophysical characteristics, into PEATDB. Furthermore, we illustrate how the resulting environment aids method development using the Potapov dataset of experimentally measured ΔΔGfold values, previously employed to validate and train protein stability prediction algorithms.

Measurement properties of tools used to assess suicidality in autistic and general population adults: A systematic review.

PubMed

Cassidy, S A; Bradley, L; Bowen, E; Wigham, S; Rodgers, J

2018-05-05

Adults diagnosed with autism are at significantly increased risk of suicidal thoughts, suicidal behaviours and dying by suicide. However, it is unclear whether any validated tools are currently available to effectively assess suicidality in autistic adults in research and clinical practice. This is crucial for understanding and preventing premature death by suicide in this vulnerable group. This two stage systematic review therefore aimed to identify tools used to assess suicidality in autistic and general population adults, evaluate these tools for their appropriateness and measurement properties, and make recommendations for appropriate selection of suicidality assessment tools in research and clinical practice. Three databases were searched (PsycInfo, Medline and Web of Knowledge). Four frequently used suicidality assessment tools were identified, and subsequently rated for quality of the evidence in support of their measurement properties using the COSMIN checklist. Despite studies having explored suicidality in autistic adults, none had utilised a validated tool. Overall, there was lack of evidence in support of suicidality risk assessments successfully predicting future suicide attempts. We recommend adaptations to current suicidality assessment tools and priorities for future research, in order to better conceptualise suicidality and its measurement in autism. Copyright © 2018 The Authors. Published by Elsevier Ltd.. All rights reserved.

Development, Validation, and Performance of a Scale to Measure Community Mobilization

PubMed Central

Lippman, Sheri A.; Neilands, Torsten B.; Leslie, Hannah H.; Maman, Suzanne; MacPhail, Catherine; Twine, Rhian; Peacock, Dean; Kahn, Kathleen; Pettifor, Audrey

2016-01-01

Rationale Community mobilization approaches (CMAs) are increasingly becoming key components of health programming. However, CMAs have been ill defined and poorly evaluated, largely due to the lack of measurement tools to assess mobilization processes and impact. Objective We developed the Community Mobilization Measure (CMM), composed of a set of scales to measure mobilization domains hypothesized to operate at the community-level. The six domains include: shared concerns, critical consciousness, leadership, collective action, social cohesion, and organizations and networks. We also included the domain of social control to explore synergies with the related construct of collective efficacy. Method A survey instrument was developed and pilot tested, then revised and administered to 1,181 young people, aged 18-35, in a community-based survey in rural South Africa. Item response modeling and exploratory factor analyses were conducted to assess model fit, dimensionality, reliability, and validity. Results Results indicate the seven-dimensional model, with linked domains but no higher order construct, fit the data best. Internal consistency reliability of the factors was strong, with ρ values ranging from .81 to .93. Six of seven scales were sufficiently correlated to represent linked concepts that comprise community mobilization; social control was less related to the other components. At the village level, CMM sub-scales were correlated with other metrics of village social capital and integrity, providing initial evidence of higher-level validity, however additional evaluation of the measure at the community-level is needed. Conclusion This is the first effort to develop and validate a comprehensive measure for community mobilization. The CMM was designed as an evaluation tool for health programming and should facilitate a more nuanced understanding of mechanisms of change associated with CM, ultimately making mobilizing approaches more effective. PMID:27085071

Improvement of Simulation Method in Validation of Software of the Coordinate Measuring Systems

NASA Astrophysics Data System (ADS)

Nieciąg, Halina

2015-10-01

Software is used in order to accomplish various tasks at each stage of the functioning of modern measuring systems. Before metrological confirmation of measuring equipment, the system has to be validated. This paper discusses the method for conducting validation studies of a fragment of software to calculate the values of measurands. Due to the number and nature of the variables affecting the coordinate measurement results and the complex character and multi-dimensionality of measurands, the study used the Monte Carlo method of numerical simulation. The article presents an attempt of possible improvement of results obtained by classic Monte Carlo tools. The algorithm LHS (Latin Hypercube Sampling) was implemented as alternative to the simple sampling schema of classic algorithm.

Evaluation of the Gratitude Questionnaire in a Chinese Sample of Adults: Factorial Validity, Criterion-Related Validity, and Measurement Invariance Across Sex

PubMed Central

Kong, Feng; You, Xuqun; Zhao, Jingjing

2017-01-01

The Gratitude Questionnaire (GQ; McCullough et al., 2002) is one of the most widely used instruments to assess dispositional gratitude. The purpose of this study was to validate a Chinese version of the GQ by examining internal consistency, factor structure, convergent validity, and measurement invariance across sex. A total of 1151 Chinese adults were recruited to complete the GQ, Positive Affect and Negative Affect Scales, and Satisfaction with Life Scale. Confirmatory factor analysis indicated that the original unidimensional model fitted well, which is in accordance with the findings in Western populations. Furthermore, the GQ had satisfactory composite reliability and criterion-related validity with measures of life satisfaction and affective well-being. Evidence of configural, metric and scalar invariance across sex was obtained. Tests of the latent mean differences found females had higher latent mean scores than males. These findings suggest that the Chinese version of GQ is a reliable and valid tool for measuring dispositional gratitude and can generally be utilized across sex in the Chinese context. PMID:28919873

Evaluation of the Gratitude Questionnaire in a Chinese Sample of Adults: Factorial Validity, Criterion-Related Validity, and Measurement Invariance Across Sex.

PubMed

Kong, Feng; You, Xuqun; Zhao, Jingjing

2017-01-01

The Gratitude Questionnaire (GQ; McCullough et al., 2002) is one of the most widely used instruments to assess dispositional gratitude. The purpose of this study was to validate a Chinese version of the GQ by examining internal consistency, factor structure, convergent validity, and measurement invariance across sex. A total of 1151 Chinese adults were recruited to complete the GQ, Positive Affect and Negative Affect Scales, and Satisfaction with Life Scale. Confirmatory factor analysis indicated that the original unidimensional model fitted well, which is in accordance with the findings in Western populations. Furthermore, the GQ had satisfactory composite reliability and criterion-related validity with measures of life satisfaction and affective well-being. Evidence of configural, metric and scalar invariance across sex was obtained. Tests of the latent mean differences found females had higher latent mean scores than males. These findings suggest that the Chinese version of GQ is a reliable and valid tool for measuring dispositional gratitude and can generally be utilized across sex in the Chinese context.

Development and validation of the Surgical Outcome Risk Tool (SORT)

PubMed Central

Protopapa, K L; Simpson, J C; Smith, N C E; Moonesinghe, S R

2014-01-01

Background Existing risk stratification tools have limitations and clinical experience suggests they are not used routinely. The aim of this study was to develop and validate a preoperative risk stratification tool to predict 30-day mortality after non-cardiac surgery in adults by analysis of data from the observational National Confidential Enquiry into Patient Outcome and Death (NCEPOD) Knowing the Risk study. Methods The data set was split into derivation and validation cohorts. Logistic regression was used to construct a model in the derivation cohort to create the Surgical Outcome Risk Tool (SORT), which was tested in the validation cohort. Results Prospective data for 19 097 cases in 326 hospitals were obtained from the NCEPOD study. Following exclusion of 2309, details of 16 788 patients were analysed (derivation cohort 11 219, validation cohort 5569). A model of 45 risk factors was refined on repeated regression analyses to develop a model comprising six variables: American Society of Anesthesiologists Physical Status (ASA-PS) grade, urgency of surgery (expedited, urgent, immediate), high-risk surgical specialty (gastrointestinal, thoracic, vascular), surgical severity (from minor to complex major), cancer and age 65 years or over. In the validation cohort, the SORT was well calibrated and demonstrated better discrimination than the ASA-PS and Surgical Risk Scale; areas under the receiver operating characteristic (ROC) curve were 0·91 (95 per cent c.i. 0·88 to 0·94), 0·87 (0·84 to 0·91) and 0·88 (0·84 to 0·92) respectively (P < 0·001). Conclusion The SORT allows rapid and simple data entry of six preoperative variables, and provides a percentage mortality risk for individuals undergoing surgery. PMID:25388883

Developing a research and practice tool to measure walkability: a demonstration project.

PubMed

Giles-Corti, Billie; Macaulay, Gus; Middleton, Nick; Boruff, Bryan; Bull, Fiona; Butterworth, Iain; Badland, Hannah; Mavoa, Suzanne; Roberts, Rebecca; Christian, Hayley

2014-12-01

Growing evidence shows that higher-density, mixed-use, pedestrian-friendly neighbourhoods encourage active transport, including transport-related walking. Despite widespread recognition of the benefits of creating more walkable neighbourhoods, there remains a gap between the rhetoric of the need for walkability and the creation of walkable neighbourhoods. Moreover, there is little objective data to benchmark the walkability of neighbourhoods within and between Australian cities in order to monitor planning and design intervention progress and to assess built environment and urban policy interventions required to achieve increased walkability. This paper describes a demonstration project that aimed to develop, trial and validate a 'Walkability Index Tool' that could be used by policy makers and practitioners to assess the walkability of local areas; or by researchers to access geospatial data assessing walkability. The overall aim of the project was to develop an automated geospatial tool capable of creating walkability indices for neighbourhoods at user-specified scales. The tool is based on open-source software architecture, within the Australian Urban Research Infrastructure Network (AURIN) framework, and incorporates key sub-component spatial measures of walkability (street connectivity, density and land use mix). Using state-based data, we demonstrated it was possible to create an automated walkability index. However, due to the lack of availability of consistent of national data measuring land use mix, at this stage it has not been possible to create a national walkability measure. The next stage of the project is to increase useability of the tool within the AURIN portal and to explore options for alternative spatial data sources that will enable the development of a valid national walkability index. AURIN's open-source Walkability Index Tool is a first step in demonstrating the potential benefit of a tool that could measure walkability across Australia. It

Validation of an instrument to measure inter-organisational linkages in general practice.

PubMed

Amoroso, Cheryl; Proudfoot, Judith; Bubner, Tanya; Jayasinghe, Upali W; Holton, Christine; Winstanley, Julie; Beilby, Justin; Harris, Mark F

2007-12-03

Linkages between general medical practices and external services are important for high quality chronic disease care. The purpose of this research is to describe the development, evaluation and use of a brief tool that measures the comprehensiveness and quality of a general practice's linkages with external providers for the management of patients with chronic disease. In this study, clinical linkages are defined as the communication, support, and referral arrangements between services for the care and assistance of patients with chronic disease. An interview to measure surgery-level (rather than individual clinician-level) clinical linkages was developed, piloted, reviewed, and evaluated with 97 Australian general practices. Two validated survey instruments were posted to patients, and a survey of locally available services was developed and posted to participating Divisions of General Practice (support organisations). Hypotheses regarding internal validity, association with local services, and patient satisfaction were tested using factor analysis, logistic regression and multilevel regression models. The resulting General Practice Clinical Linkages Interview (GP-CLI) is a nine-item tool with three underlying factors: referral and advice linkages, shared care and care planning linkages, and community access and awareness linkages. Local availability of chronic disease services has no affect on the comprehensiveness of services with which practices link, however, comprehensiveness of clinical linkages has an association with patient assessment of access, receptionist services, and of continuity of care in their general practice. The GP-CLI may be useful to researchers examining comparable health care systems for measuring the comprehensiveness and quality of linkages at a general practice-level with related services, possessing both internal and external validity. The tool can be used with large samples exploring the impact, outcomes, and facilitators of high

Assessing teamwork performance in obstetrics: A systematic search and review of validated tools.

PubMed

Fransen, Annemarie F; de Boer, Liza; Kienhorst, Dieneke; Truijens, Sophie E; van Runnard Heimel, Pieter J; Oei, S Guid

2017-09-01

Teamwork performance is an essential component for the clinical efficiency of multi-professional teams in obstetric care. As patient safety is related to teamwork performance, it has become an important learning goal in simulation-based education. In order to improve teamwork performance, reliable assessment tools are required. These can be used to provide feedback during training courses, or to compare learning effects between different types of training courses. The aim of the current study is to (1) identify the available assessment tools to evaluate obstetric teamwork performance in a simulated environment, and (2) evaluate their psychometric properties in order to identify the most valuable tool(s) to use. We performed a systematic search in PubMed, MEDLINE, and EMBASE to identify articles describing assessment tools for the evaluation of obstetric teamwork performance in a simulated environment. In order to evaluate the quality of the identified assessment tools the standards and grading rules have been applied as recommended by the Accreditation Council for Graduate Medical Education (ACGME) Committee on Educational Outcomes. The included studies were also assessed according to the Oxford Centre for Evidence Based Medicine (OCEBM) levels of evidence. This search resulted in the inclusion of five articles describing the following six tools: Clinical Teamwork Scale, Human Factors Rating Scale, Global Rating Scale, Assessment of Obstetric Team Performance, Global Assessment of Obstetric Team Performance, and the Teamwork Measurement Tool. Based on the ACGME guidelines we assigned a Class 3, level C of evidence, to all tools. Regarding the OCEBM levels of evidence, a level 3b was assigned to two studies and a level 4 to four studies. The Clinical Teamwork Scale demonstrated the most comprehensive validation, and the Teamwork Measurement Tool demonstrated promising results, however it is recommended to further investigate its reliability. Copyright © 2017

A 10-minute measure of global cognition: Validation of the Brief Cognitive Assessment Tool for Schizophrenia (B-CATS).

PubMed

Hurford, Irene M; Ventura, Joseph; Marder, Stephen R; Reise, Steven P; Bilder, Robert M

2018-05-01

Schizophrenia is marked by a global cognitive impairment that contributes significantly to chronic disability and unemployment. As new treatments are developed for cognition in schizophrenia, clinicians require easily administered instruments to assess cognition. We previously developed a very brief cognitive battery (Bell et al., 2005). The Brief Cognitive Assessment Tool for Schizophrenia (B-CATS) was developed specifically to provide clinicians with a way to assess cognition in their patients with schizophrenia. Here, we report the results of a validity study comparing B-CATS to a larger neurocognitive battery, the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) battery. Outpatients with schizophrenia (N=91) were administered the B-CATS and the non-overlapping tests of the MATRICS battery at two time points separated by 1month. They were also administered the UCSD Performance-based Skills Assessment-Brief (UPSA-B), a measure of functional capacity. The B-CATS has an administration time of approximately 10min. It demonstrates good test-retest reliability and internal consistency. It correlates 0.76 (p<0.01) with the MATRICS battery. The shorter B-CATS and the MATRICS battery correlate with the UPSA-B at 0.50 and 0.58 respectively. A 10-minute version of the B-CATS correlates highly with the "gold standard" neurocognitive battery that has an administration time of over 60min. Both measures correlate moderately with a measure of functional capacity. This brief battery was designed to allow clinicians to monitor cognitive change and better inform treatment decisions. Copyright © 2017 Elsevier B.V. All rights reserved.

Validation of Alternative In Vitro Methods to Animal Testing: Concepts, Challenges, Processes and Tools.

PubMed

Griesinger, Claudius; Desprez, Bertrand; Coecke, Sandra; Casey, Warren; Zuang, Valérie

This chapter explores the concepts, processes, tools and challenges relating to the validation of alternative methods for toxicity and safety testing. In general terms, validation is the process of assessing the appropriateness and usefulness of a tool for its intended purpose. Validation is routinely used in various contexts in science, technology, the manufacturing and services sectors. It serves to assess the fitness-for-purpose of devices, systems, software up to entire methodologies. In the area of toxicity testing, validation plays an indispensable role: "alternative approaches" are increasingly replacing animal models as predictive tools and it needs to be demonstrated that these novel methods are fit for purpose. Alternative approaches include in vitro test methods, non-testing approaches such as predictive computer models up to entire testing and assessment strategies composed of method suites, data sources and decision-aiding tools. Data generated with alternative approaches are ultimately used for decision-making on public health and the protection of the environment. It is therefore essential that the underlying methods and methodologies are thoroughly characterised, assessed and transparently documented through validation studies involving impartial actors. Importantly, validation serves as a filter to ensure that only test methods able to produce data that help to address legislative requirements (e.g. EU's REACH legislation) are accepted as official testing tools and, owing to the globalisation of markets, recognised on international level (e.g. through inclusion in OECD test guidelines). Since validation creates a credible and transparent evidence base on test methods, it provides a quality stamp, supporting companies developing and marketing alternative methods and creating considerable business opportunities. Validation of alternative methods is conducted through scientific studies assessing two key hypotheses, reliability and relevance of the

The THINC-Integrated Tool (THINC-it) Screening Assessment for Cognitive Dysfunction: Validation in Patients With Major Depressive Disorder.

PubMed

McIntyre, Roger S; Best, Michael W; Bowie, Christopher R; Carmona, Nicole E; Cha, Danielle S; Lee, Yena; Subramaniapillai, Mehala; Mansur, Rodrigo B; Barry, Harry; Baune, Bernhard T; Culpepper, Larry; Fossati, Philippe; Greer, Tracy L; Harmer, Catherine; Klag, Esther; Lam, Raymond W; Wittchen, Hans-Ulrich; Harrison, John

2017-07-01

To validate the THINC-integrated tool (THINC-it)-a freely available, patient-administered, computerized screening tool integrating subjective and objective measures of cognitive function in adults with major depressive disorder (MDD). Subjects aged 18 to 65 years (n = 100) with recurrent MDD experiencing a major depressive episode of at least moderate severity were evaluated and compared to age-, sex-, and education-matched healthy controls (n = 100). Between January and June 2016, subjects completed the THINC-it, which includes variants of the Choice Reaction Time Identification Task (IDN), One-Back Test, Digit Symbol Substitution Test, Trail Making Test-Part B, and the Perceived Deficits Questionnaire for Depression-5-item (PDQ-5-D). The THINC-it required approximately 10 to 15 minutes for administration and was capable of detecting cognitive deficits in adults with MDD. A total of 44.4% of adults with MDD exhibited cognitive performance at ≥ 1.0 SD below that of healthy controls on standardized mean scores of the THINC-it. Concurrent validity of the overall tool, based on a calculated composite score, was acceptable (r = 0.539, P < .001). Concurrent validity of the component tests ranged from -0.083 (IDN) to 0.929 (PDQ-5-D). Qualitative survey results indicated that there was a high level of satisfaction and perceived value in administering the THINC-it regarding its impact on the appropriateness and quality of care being received. The THINC-it is a valid and sensitive tool for detecting cognitive dysfunction in adults with MDD that is free, easy to use, and rapidly administered. The THINC-it should be incorporated into the assessment and measurement of all patients with MDD, particularly among those with enduring functional impairment. ClinicalTrials.gov identifier: NCT02508493. © Copyright 2017 Physicians Postgraduate Press, Inc.

Validation of a Type 2 Diabetes Screening Tool in Rural Honduras

PubMed Central

Milton, Evan C.; Herman, William H.; Aiello, Allison E.; Danielson, Kris R.; Mendoza-Avelarez, Milton O.; Piette, John D.

2010-01-01

OBJECTIVE To validate a low-cost tool for identifying diabetic patients in rural areas of Latin America. RESEARCH DESIGN AND METHODS A regression equation incorporating postprandial time and a random plasma glucose was used to screen 800 adults in Honduras. Patients with a probability of diabetes of ≥20% were asked to return for a fasting plasma glucose (FPG). A random fifth of those with a screener-based probability of diabetes <20% were also asked to return for follow-up. The gold standard was an FPG ≥126 mg/dl. RESULTS The screener had very good test characteristics (area under the receiver operating characteristic curve = 0.89). Using the screening criterion of ≥0.42, the equation had a sensitivity of 74.1% and specificity of 97.2%. CONCLUSIONS This screener is a valid measure of diabetes risk in Honduras and could be used to identify diabetic patients in poor clinics in Latin America. PMID:19918008

SU-G-IeP2-04: Dosimetric Accuracy of a Monte Carlo-Based Tool for Cone-Beam CT Organ Dose Calculation: Validation Against OSL and XRQA2 Film Measurements

DOE Office of Scientific and Technical Information (OSTI.GOV)

Chesneau, H; Lazaro, D; Blideanu, V

Purpose: The intensive use of Cone-Beam Computed Tomography (CBCT) during radiotherapy treatments raise some questions about the dose to healthy tissues delivered during image acquisitions. We hence developed a Monte Carlo (MC)-based tool to predict doses to organs delivered by the Elekta XVI kV-CBCT. This work aims at assessing the dosimetric accuracy of the MC tool, in all tissue types. Methods: The kV-CBCT MC model was developed using the PENELOPE code. The beam properties were validated against measured lateral and depth dose profiles in water, and energy spectra measured with a CdTe detector. The CBCT simulator accuracy then required verificationmore » in clinical conditions. For this, we compared calculated and experimental dose values obtained with OSL nanoDots and XRQA2 films inserted in CIRS anthropomorphic phantoms (male, female, and 5-year old child). Measurements were performed at different locations, including bone and lung structures, and for several acquisition protocols: lung, head-and-neck, and pelvis. OSLs and film measurements were corrected when possible for energy dependence, by taking into account for spectral variations between calibration and measurement conditions. Results: Comparisons between measured and MC dose values are summarized in table 1. A mean difference of 8.6% was achieved for OSLs when the energy correction was applied, and 89.3% of the 84 dose points were within uncertainty intervals, including those in bones and lungs. Results with XRQA2 are not as good, because incomplete information about electronic equilibrium in film layers hampered the application of a simple energy correction procedure. Furthermore, measured and calculated doses (Fig.1) are in agreement with the literature. Conclusion: The MC-based tool developed was validated with an extensive set of measurements, and enables the organ dose calculation with accuracy. It can now be used to compute and report doses to organs for clinical cases, and also to drive

Method for Pre-Conditioning a Measured Surface Height Map for Model Validation

NASA Technical Reports Server (NTRS)

Sidick, Erkin

2012-01-01

This software allows one to up-sample or down-sample a measured surface map for model validation, not only without introducing any re-sampling errors, but also eliminating the existing measurement noise and measurement errors. Because the re-sampling of a surface map is accomplished based on the analytical expressions of Zernike-polynomials and a power spectral density model, such re-sampling does not introduce any aliasing and interpolation errors as is done by the conventional interpolation and FFT-based (fast-Fourier-transform-based) spatial-filtering method. Also, this new method automatically eliminates the measurement noise and other measurement errors such as artificial discontinuity. The developmental cycle of an optical system, such as a space telescope, includes, but is not limited to, the following two steps: (1) deriving requirements or specs on the optical quality of individual optics before they are fabricated through optical modeling and simulations, and (2) validating the optical model using the measured surface height maps after all optics are fabricated. There are a number of computational issues related to model validation, one of which is the "pre-conditioning" or pre-processing of the measured surface maps before using them in a model validation software tool. This software addresses the following issues: (1) up- or down-sampling a measured surface map to match it with the gridded data format of a model validation tool, and (2) eliminating the surface measurement noise or measurement errors such that the resulted surface height map is continuous or smoothly-varying. So far, the preferred method used for re-sampling a surface map is two-dimensional interpolation. The main problem of this method is that the same pixel can take different values when the method of interpolation is changed among the different methods such as the "nearest," "linear," "cubic," and "spline" fitting in Matlab. The conventional, FFT-based spatial filtering method used to

Spanish validation of the Person-centered Care Assessment Tool (P-CAT).

PubMed

Martínez, Teresa; Suárez-Álvarez, Javier; Yanguas, Javier; Muñiz, José

2016-01-01

Person-centered Care (PCC) is an innovative approach which seeks to improve the quality of care services given to the care-dependent elderly. At present there are no Spanish language instruments for the evaluation of PCC delivered by elderly care services. The aim of this work is the adaptation and validation of the Person-centered Care Assessment Tool (P-CAT) for a Spanish population. The P-CAT was translated and adapted into Spanish, then given to a sample of 1339 front-line care professionals from 56 residential elderly care homes. The reliability and validity of the P-CAT were analyzed, within the frameworks of Classical Test Theory and Item Response Theory models. The Spanish P-CAT demonstrated good reliability, with an alpha coefficient of .88 and a test-retest reliability coefficient of .79. The P-CAT information function indicates that the test measures with good precision for the majority of levels of the measured variables (θ values between -2 and +1). The factorial structure of the test is essentially one-dimensional and the item discrimination indices are high, with values between .26 and .61. In terms of predictive validity, the correlations which stand out are between the P-CAT and organizational climate (r = .689), and the burnout factors; personal accomplishment (r = .382), and emotional exhaustion (r = - .510). The Spanish version of the P-CAT demonstrates good psychometric properties for its use in the evaluation of elderly care homes both professionally and in research.

Development and validation of the Bullying and Cyberbullying Scale for Adolescents: A multi-dimensional measurement model.

PubMed

Thomas, Hannah J; Scott, James G; Coates, Jason M; Connor, Jason P

2018-05-03

Intervention on adolescent bullying is reliant on valid and reliable measurement of victimization and perpetration experiences across different behavioural expressions. This study developed and validated a survey tool that integrates measurement of both traditional and cyber bullying to test a theoretically driven multi-dimensional model. Adolescents from 10 mainstream secondary schools completed a baseline and follow-up survey (N = 1,217; M age  = 14 years; 66.2% male). The Bullying and cyberbullying Scale for Adolescents (BCS-A) developed for this study comprised parallel victimization and perpetration subscales, each with 20 items. Additional measures of bullying (Olweus Global Bullying and the Forms of Bullying Scale [FBS]), as well as measures of internalizing and externalizing problems, school connectedness, social support, and personality, were used to further assess validity. Factor structure was determined, and then, the suitability of items was assessed according to the following criteria: (1) factor interpretability, (2) item correlations, (3) model parsimony, and (4) measurement equivalence across victimization and perpetration experiences. The final models comprised four factors: physical, verbal, relational, and cyber. The final scale was revised to two 13-item subscales. The BCS-A demonstrated acceptable concurrent and convergent validity (internalizing and externalizing problems, school connectedness, social support, and personality), as well as predictive validity over 6 months. The BCS-A has sound psychometric properties. This tool establishes measurement equivalence across types of involvement and behavioural forms common among adolescents. An improved measurement method could add greater rigour to the evaluation of intervention programmes and also enable interventions to be tailored to subscale profiles. © 2018 The British Psychological Society.

Hand-Held Electronic Gap-Measuring Tools

NASA Technical Reports Server (NTRS)

Sugg, F. E.; Thompson, F. W.; Aragon, L. A.; Harrington, D. B.

1985-01-01

Repetitive measurements simplified by tool based on LVDT operation. With fingers in open position, Gap-measuring tool rests on digital readout instrument. With fingers inserted in gap, separation alters inductance of linear variable-differential transformer in plastic handle. Originally developed for measuring gaps between surface tiles of Space Shuttle orbiter, tool reduces measurement time from 20 minutes per tile to 2 minutes. Also reduces possibility of damage to tiles during measurement. Tool has potential applications in mass production; helps ensure proper gap dimensions in assembly of refrigerator and car doors and also used to measure dimensions of components and to verify positional accuracy of components during progressive assembly operations.

Measuring the food service environment: development and implementation of assessment tools.

PubMed

Minaker, Leia M; Raine, Kim D; Cash, Sean B

2009-01-01

The food environment is increasingly being implicated in the obesity epidemic, though few reported measures of it exist. In order to assess the impact of the food environment on food intake, valid measures must be developed and tested. The current study describes the development of a food service environment assessment tool and its implementation in a community setting. A descriptive study with mixed qualitative and quantitative methods at a large, North American university campus was undertaken. Measures were developed on the basis of a conceptual model of nutrition environments. Measures of community nutrition environment were the number, type and hours of operation of each food service outlet on campus. Measures of consumer nutrition environment were food availability, food affordability, food promotion and nutrition information availability. Seventy-five food service outlets within the geographic boundaries were assessed. Assessment tools could be implemented in a reasonable amount of time and showed good face and content validity. The food environments were described and measures were grouped so that food service outlet types could be compared in terms of purchasing convenience, cost/value, healthy food promotion and health. Food service outlet types that scored higher in purchasing convenience and cost/value tended to score lower in healthy food promotion and health. This study adds evidence that food service outlet types that are convenient to consumers and supply high value (in terms of calories per dollar) tend to be less health-promoting. Results from this study also suggest the possibility of characterizing the food environment according to the type of food service outlet observed.

Experimental validation of the RATE tool for inferring HLA restrictions of T cell epitopes.

PubMed

Paul, Sinu; Arlehamn, Cecilia S Lindestam; Schulten, Veronique; Westernberg, Luise; Sidney, John; Peters, Bjoern; Sette, Alessandro

2017-06-21

The RATE tool was recently developed to computationally infer the HLA restriction of given epitopes from immune response data of HLA typed subjects without additional cumbersome experimentation. Here, RATE was validated using experimentally defined restriction data from a set of 191 tuberculosis-derived epitopes and 63 healthy individuals with MTB infection from the Western Cape Region of South Africa. Using this experimental dataset, the parameters utilized by the RATE tool to infer restriction were optimized, which included relative frequency (RF) of the subjects responding to a given epitope and expressing a given allele as compared to the general test population and the associated p-value in a Fisher's exact test. We also examined the potential for further optimization based on the predicted binding affinity of epitopes to potential restricting HLA alleles, and the absolute number of individuals expressing a given allele and responding to the specific epitope. Different statistical measures, including Matthew's correlation coefficient, accuracy, sensitivity and specificity were used to evaluate performance of RATE as a function of these criteria. Based on our results we recommend selection of HLA restrictions with cutoffs of p-value < 0.01 and RF ≥ 1.3. The usefulness of the tool was demonstrated by inferring new HLA restrictions for epitope sets where restrictions could not be experimentally determined due to lack of necessary cell lines and for an additional data set related to recognition of pollen derived epitopes from allergic patients. Experimental data sets were used to validate RATE tool and the parameters used by the RATE tool to infer restriction were optimized. New HLA restrictions were identified using the optimized RATE tool.

Validation and verification of the laser range safety tool (LRST)

NASA Astrophysics Data System (ADS)

Kennedy, Paul K.; Keppler, Kenneth S.; Thomas, Robert J.; Polhamus, Garrett D.; Smith, Peter A.; Trevino, Javier O.; Seaman, Daniel V.; Gallaway, Robert A.; Crockett, Gregg A.

2003-06-01

The U.S. Dept. of Defense (DOD) is currently developing and testing a number of High Energy Laser (HEL) weapons systems. DOD range safety officers now face the challenge of designing safe methods of testing HEL's on DOD ranges. In particular, safety officers need to ensure that diffuse and specular reflections from HEL system targets, as well as direct beam paths, are contained within DOD boundaries. If both the laser source and the target are moving, as they are for the Airborne Laser (ABL), a complex series of calculations is required and manual calculations are impractical. Over the past 5 years, the Optical Radiation Branch of the Air Force Research Laboratory (AFRL/HEDO), the ABL System Program Office, Logicon-RDA, and Northrup-Grumman, have worked together to develop a computer model called teh Laser Range Safety Tool (LRST), specifically designed for HEL reflection hazard analyses. The code, which is still under development, is currently tailored to support the ABL program. AFRL/HEDO has led an LRST Validation and Verification (V&V) effort since 1998, in order to determine if code predictions are accurate. This paper summarizes LRST V&V efforts to date including: i) comparison of code results with laboratory measurements of reflected laser energy and with reflection measurements made during actual HEL field tests, and ii) validation of LRST's hazard zone computations.

The application of health literacy measurement tools (collective or individual domains) in assessing chronic disease management: a systematic review protocol.

PubMed

Shum, Jessica; Poureslami, Iraj; Doyle-Waters, Mary M; FitzGerald, J Mark

2016-06-07

The term "health literacy" (HL) was first coined in 1974, and its most common definition is currently defined as a person's ability to access, understand, evaluate, communicate, and use health information to make decisions for one's health. The previous systematic reviews assessing the effect of existing HL measurement tools on health outcomes have simply searched for the term "health literacy" only to identify measures instead of incorporating either one or more of the five domains in their search. Furthermore, as the domain "use" is fairly new, few studies have actually assessed this domain. In this protocol, we propose to identify and assess HL measures that applied the mentioned five domains either collectively or individually in assessing chronic disease management, in particular for asthma and chronic obstructive pulmonary disease (COPD). The ultimate goal is to provide recommendations towards the development and validation of a patient-centric HL measurement tool for the two diseases. A comprehensive, electronic search will be conducted to identify potential studies dating from 1974 to 2016 from databases such as Embase, MEDLINE, CINAHL, Cochrane Central Register of Controlled Trials, Web of Science, ERIC, PsycINFO, and HAPI. Database searches will be complemented with grey literature. Two independent reviewers will perform tool selection, study selection, data extraction, and quality assessment using pre-designed study forms. Any disagreement will be resolved through discussion or a third reviewer. Only studies that have developed or validated HL measurement tools (including one or more of the five domains mentioned above) among asthma and COPD patients will be included. Information collected from the studies will include instrument details such as versions, purpose, underlying constructs, administration, mapping of items onto the five domains, internal structure, scoring, response processes, standard error of measurement (SEM), correlation with other

Web based tools for data manipulation, visualisation and validation with interactive georeferenced graphs

NASA Astrophysics Data System (ADS)

Ivankovic, D.; Dadic, V.

2009-04-01

Some of oceanographic parameters have to be manually inserted into database; some (for example data from CTD probe) are inserted from various files. All this parameters requires visualization, validation and manipulation from research vessel or scientific institution, and also public presentation. For these purposes is developed web based system, containing dynamic sql procedures and java applets. Technology background is Oracle 10g relational database, and Oracle application server. Web interfaces are developed using PL/SQL stored database procedures (mod PL/SQL). Additional parts for data visualization include use of Java applets and JavaScript. Mapping tool is Google maps API (javascript) and as alternative java applet. Graph is realized as dynamically generated web page containing java applet. Mapping tool and graph are georeferenced. That means that click on some part of graph, automatically initiate zoom or marker onto location where parameter was measured. This feature is very useful for data validation. Code for data manipulation and visualization are partially realized with dynamic SQL and that allow as to separate data definition and code for data manipulation. Adding new parameter in system requires only data definition and description without programming interface for this kind of data.

Development and Validation of a Portable and Inexpensive Tool to Measure the Drop Vertical Jump Using the Microsoft Kinect V2.

PubMed

Gray, Aaron D; Willis, Brad W; Skubic, Marjorie; Huo, Zhiyu; Razu, Swithin; Sherman, Seth L; Guess, Trent M; Jahandar, Amirhossein; Gulbrandsen, Trevor R; Miller, Scott; Siesener, Nathan J

Noncontact anterior cruciate ligament (ACL) injury in adolescent female athletes is an increasing problem. The knee-ankle separation ratio (KASR), calculated at initial contact (IC) and peak flexion (PF) during the drop vertical jump (DVJ), is a measure of dynamic knee valgus. The Microsoft Kinect V2 has shown promise as a reliable and valid marker-less motion capture device. The Kinect V2 will demonstrate good to excellent correlation between KASR results at IC and PF during the DVJ, as compared with a "gold standard" Vicon motion analysis system. Descriptive laboratory study. Level 2. Thirty-eight healthy volunteer subjects (20 male, 18 female) performed 5 DVJ trials, simultaneously measured by a Vicon MX-T40S system, 2 AMTI force platforms, and a Kinect V2 with customized software. A total of 190 jumps were completed. The KASR was calculated at IC and PF during the DVJ. The intraclass correlation coefficient (ICC) assessed the degree of KASR agreement between the Kinect and Vicon systems. The ICCs of the Kinect V2 and Vicon KASR at IC and PF were 0.84 and 0.95, respectively, showing excellent agreement between the 2 measures. The Kinect V2 successfully identified the KASR at PF and IC frames in 182 of 190 trials, demonstrating 95.8% reliability. The Kinect V2 demonstrated excellent ICC of the KASR at IC and PF during the DVJ when compared with the Vicon system. A customized Kinect V2 software program demonstrated good reliability in identifying the KASR at IC and PF during the DVJ. Reliable, valid, inexpensive, and efficient screening tools may improve the accessibility of motion analysis assessment of adolescent female athletes.

Validation of a Dietary Screening Tool in a Middle-Aged Appalachian Population

PubMed Central

Ventura Marra, Melissa; Johnson, Elizabeth J.

2018-01-01

Proactive nutrition screening is an effective public health strategy for identifying and targeting individuals who could benefit from making dietary improvements for primary and secondary prevention of disease. The Dietary Screening Tool (DST) was developed and validated to assess nutritional risk among rural older adults. The purpose of this study was to evaluate the utility and validity of the DST to identify nutritional risk in middle-aged adults. This cross-sectional study in middle-aged adults (45–64 year olds, n = 87) who reside in Appalachia, examined nutritional status using an online health survey, biochemical measures, anthropometry, and three representative 24-h dietary recalls. The Healthy Eating Index (HEI) was calculated to describe overall diet quality. Adults identified by the DST with a nutrition risk had lower HEI scores (50 vs. 64, p < 0.001) and were much more likely to also be considered at dietary risk by the HEI (OR 11.6; 3.2–42.6) when compared to those not at risk. Those at risk had higher energy-adjusted total fat, saturated fat, and added sugar intakes and lower intakes of dietary fiber, and several micronutrients than those classified as not at risk by the DST. Similarly, the at-risk group had significantly lower serum levels of α-carotene, β-carotene, cryptoxanthin, lutein, and zeaxanthin but did not differ in retinol or methylmalonic acid compared with those not at risk. The DST is a valid tool to identify middle-aged adults with nutritional risk. PMID:29534543

Validation of measures from the smartphone sway balance application: a pilot study.

PubMed

Patterson, Jeremy A; Amick, Ryan Z; Thummar, Tarunkumar; Rogers, Michael E

2014-04-01

A number of different balance assessment techniques are currently available and widely used. These include both subjective and objective assessments. The ability to provide quantitative measures of balance and posture is the benefit of objective tools, however these instruments are not generally utilized outside of research laboratory settings due to cost, complexity of operation, size, duration of assessment, and general practicality. The purpose of this pilot study was to assess the value and validity of using software developed to access the iPod and iPhone accelerometers output and translate that to the measurement of human balance. Thirty healthy college-aged individuals (13 male, 17 female; age = 26.1 ± 8.5 years) volunteered. Participants performed a static Athlete's Single Leg Test protocol for 10 sec, on a Biodex Balance System SD while concurrently utilizing a mobile device with balance software. Anterior/posterior stability was recorded using both devices, described as the displacement in degrees from level, and was termed the "balance score." There were no significant differences between the two reported balance scores (p = 0.818. Mean balance score on the balance platform was 1.41 ± 0.90, as compared to 1.38 ± 0.72 using the mobile device. There is a need for a valid, convenient, and cost-effective tool to objectively measure balance. Results of this study are promising, as balance score derived from the Smartphone accelerometers were consistent with balance scores obtained from a previously validated balance system. However, further investigation is necessary as this version of the mobile software only assessed balance in the anterior/posterior direction. Additionally, further testing is necessary on a healthy populations and as well as those with impairment of the motor control system. Level 2b (Observational study of validity)(1.)

The HARM score for gastrointestinal surgery: Application and validation of a novel, reliable and simple tool to measure surgical quality and outcomes.

PubMed

Crawshaw, Benjamin P; Keller, Deborah S; Brady, Justin T; Augestad, Knut M; Schiltz, Nicholas K; Koroukian, Siran M; Navale, Suparna M; Steele, Scott R; Delaney, Conor P

2017-03-01

The HospitAl length of stay, Readmissions and Mortality (HARM) score is a simple, inexpensive quality tool, linked directly to patient outcomes. We assess the HARM score for measuring surgical quality across multiple surgical populations. Upper gastrointestinal, hepatobiliary, and colorectal surgery cases between 2005 and 2009 were identified from the Healthcare Cost and Utilization Project California State Inpatient Database. Composite and individual HARM scores were calculated from length of stay, 30-day readmission and mortality, correlated to complication rates for each hospital and stratified by operative type. 71,419 admissions were analyzed. Higher HARM scores correlated with higher complication rates for all cases after risk adjustment and stratification by operation type, elective or emergent status. The HARM score is a simple and valid quality measurement for upper gastrointestinal, hepatobiliary and colorectal surgery. The HARM score could facilitate benchmarking to improve patient outcomes and resource utilization, and may facilitate outcome improvement. Copyright © 2016 Elsevier Inc. All rights reserved.

Measuring Implicit European and Mediterranean Landscape Identity: A Tool Proposal.

PubMed

Fornara, Ferdinando; Dentale, Francesco; Troffa, Renato; Piras, Simona

2016-01-01

This study presents a tool - the Landscape Identity Implicit Association Test (LI-IAT) - devoted to measure the implicit identification with European and Mediterranean landscapes. To this aim, a series of prototypical landscapes was selected as stimulus, following an accurate multi-step procedure. Participants (N = 174), recruited in two Italian cities, performed two LI-IATs devoted to assess their identification with European vs. Not-European and Mediterranean vs. Not-Mediterranean prototypical landscapes. Psychometric properties and criterion validity of these measures were investigated. Two self-report measures, assessing, respectively, European and Mediterranean place identity and pleasantness of the target landscapes, were also administered. Results showed: (1) an adequate level of internal consistency for both LI-IATs; (2) a higher identification with European and Mediterranean landscapes than, respectively, with Not-European and Not-Mediterranean ones; and (3) a significant positive relationship between the European and Mediterranean LI-IATs and the corresponding place identity scores, also when pleasantness of landscapes was controlled for. Overall, these findings provide a first evidence supporting the reliability and criterion validity of the European and Mediterranean LI-IATs.

Measuring Implicit European and Mediterranean Landscape Identity: A Tool Proposal

PubMed Central

Fornara, Ferdinando; Dentale, Francesco; Troffa, Renato; Piras, Simona

2016-01-01

This study presents a tool – the Landscape Identity Implicit Association Test (LI-IAT) – devoted to measure the implicit identification with European and Mediterranean landscapes. To this aim, a series of prototypical landscapes was selected as stimulus, following an accurate multi-step procedure. Participants (N = 174), recruited in two Italian cities, performed two LI-IATs devoted to assess their identification with European vs. Not-European and Mediterranean vs. Not-Mediterranean prototypical landscapes. Psychometric properties and criterion validity of these measures were investigated. Two self-report measures, assessing, respectively, European and Mediterranean place identity and pleasantness of the target landscapes, were also administered. Results showed: (1) an adequate level of internal consistency for both LI-IATs; (2) a higher identification with European and Mediterranean landscapes than, respectively, with Not-European and Not-Mediterranean ones; and (3) a significant positive relationship between the European and Mediterranean LI-IATs and the corresponding place identity scores, also when pleasantness of landscapes was controlled for. Overall, these findings provide a first evidence supporting the reliability and criterion validity of the European and Mediterranean LI-IATs. PMID:27642284

Development, Validation, and Verification of a Self-Assessment Tool to Estimate Agnibala (Digestive Strength).

PubMed

Singh, Aparna; Singh, Girish; Patwardhan, Kishor; Gehlot, Sangeeta

2017-01-01

According to Ayurveda, the traditional system of healthcare of Indian origin, Agni is the factor responsible for digestion and metabolism. Four functional states (Agnibala) of Agni have been recognized: regular, irregular, intense, and weak. The objective of the present study was to develop and validate a self-assessment tool to estimate Agnibala The developed tool was evaluated for its reliability and validity by administering it to 300 healthy volunteers of either gender belonging to 18 to 40-year age group. Besides confirming the statistical validity and reliability, the practical utility of the newly developed tool was also evaluated by recording serum lipid parameters of all the volunteers. The results show that the lipid parameters vary significantly according to the status of Agni The tool, therefore, may be used to screen normal population to look for possible susceptibility to certain health conditions. © The Author(s) 2016.

The Queensland high risk foot form (QHRFF) – is it a reliable and valid clinical research tool for foot disease?

PubMed Central

2014-01-01

Background Foot disease complications, such as foot ulcers and infection, contribute to considerable morbidity and mortality. These complications are typically precipitated by “high-risk factors”, such as peripheral neuropathy and peripheral arterial disease. High-risk factors are more prevalent in specific “at risk” populations such as diabetes, kidney disease and cardiovascular disease. To the best of the authors’ knowledge a tool capturing multiple high-risk factors and foot disease complications in multiple at risk populations has yet to be tested. This study aimed to develop and test the validity and reliability of a Queensland High Risk Foot Form (QHRFF) tool. Methods The study was conducted in two phases. Phase one developed a QHRFF using an existing diabetes foot disease tool, literature searches, stakeholder groups and expert panel. Phase two tested the QHRFF for validity and reliability. Four clinicians, representing different levels of expertise, were recruited to test validity and reliability. Three cohorts of patients were recruited; one tested criterion measure reliability (n = 32), another tested criterion validity and inter-rater reliability (n = 43), and another tested intra-rater reliability (n = 19). Validity was determined using sensitivity, specificity and positive predictive values (PPV). Reliability was determined using Kappa, weighted Kappa and intra-class correlation (ICC) statistics. Results A QHRFF tool containing 46 items across seven domains was developed. Criterion measure reliability of at least moderate categories of agreement (Kappa > 0.4; ICC > 0.75) was seen in 91% (29 of 32) tested items. Criterion validity of at least moderate categories (PPV > 0.7) was seen in 83% (60 of 72) tested items. Inter- and intra-rater reliability of at least moderate categories (Kappa > 0.4; ICC > 0.75) was seen in 88% (84 of 96) and 87% (20 of 23) tested items respectively. Conclusions The QHRFF had

Development of the Music Therapy Assessment Tool for Advanced Huntington's Disease: A Pilot Validation Study.

PubMed

O'Kelly, Julian; Bodak, Rebeka

2016-01-01

Case studies of people with Huntington's disease (HD) report that music therapy provides a range of benefits that may improve quality of life; however, no robust music therapy assessment tools exist for this population. Develop and conduct preliminary psychometric testing of a music therapy assessment tool for patients with advanced HD. First, we established content and face validity of the Music Therapy Assessment Tool for Advanced HD (MATA-HD) through focus groups and field testing. Second, we examined psychometric properties of the resulting MATA-HD in terms of its construct validity, internal consistency, and inter-rater and intra-rater reliability over 10 group music therapy sessions with 19 patients. The resulting MATA-HD included a total of 15 items across six subscales (Arousal/Attention, Physical Presentation, Communication, Musical, Cognition, and Psychological/Behavioral). We found good construct validity (r ≥ 0.7) for Mood, Communication Level, Communication Effectiveness, Choice, Social Behavior, Arousal, and Attention items. Cronbach's α of 0.825 indicated good internal consistency across 11 items with a common focus of engagement in therapy. The inter-rater reliability (IRR) Intra-Class Coefficient (ICC) scores averaged 0.65, and a mean intra-rater ICC reliability of 0.68 was obtained. Further training and retesting provided a mean of IRR ICC of 0.7. Preliminary data indicate that the MATA-HD is a promising tool for measuring patient responses to music therapy interventions across psychological, physical, social, and communication domains of functioning in patients with advanced HD. © the American Music Therapy Association 2016. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Evaluation of tools used to measure critical thinking development in nursing and midwifery undergraduate students: a systematic review.

PubMed

Carter, Amanda G; Creedy, Debra K; Sidebotham, Mary

2015-07-01

Well developed critical thinking skills are essential for nursing and midwifery practices. The development of students' higher-order cognitive abilities, such as critical thinking, is also well recognised in nursing and midwifery education. Measurement of critical thinking development is important to demonstrate change over time and effectiveness of teaching strategies. To evaluate tools designed to measure critical thinking in nursing and midwifery undergraduate students. The following six databases were searched and resulted in the retrieval of 1191 papers: CINAHL, Ovid Medline, ERIC, Informit, PsycINFO and Scopus. After screening for inclusion, each paper was evaluated using the Critical Appraisal Skills Programme Tool. Thirty-four studies met the inclusion criteria and quality appraisal. Sixteen different tools that measure critical thinking were reviewed for reliability and validity and extent to which the domains of critical thinking were evident. Sixty percent of studies utilised one of four standardised commercially available measures of critical thinking. Reliability and validity were not consistently reported and there was a variation in reliability across studies that used the same measure. Of the remaining studies using different tools, there was also limited reporting of reliability making it difficult to assess internal consistency and potential applicability of measures across settings. Discipline specific instruments to measure critical thinking in nursing and midwifery are required, specifically tools that measure the application of critical thinking to practise. Given that critical thinking development occurs over an extended period, measurement needs to be repeated and multiple methods of measurement used over time. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.

Validity of a Self-Report Recall Tool for Estimating Sedentary Behavior in Adults.

PubMed

Gomersall, Sjaan R; Pavey, Toby G; Clark, Bronwyn K; Jasman, Adib; Brown, Wendy J

2015-11-01

Sedentary behavior is continuing to emerge as an important target for health promotion. The purpose of this study was to determine the validity of a self-report use of time recall tool, the Multimedia Activity Recall for Children and Adults (MARCA) in estimating time spent sitting/lying, compared with a device-based measure. Fifty-eight participants (48% female, [mean ± standard deviation] 28 ± 7.4 years of age, 23.9 ± 3.05 kg/m(2)) wore an activPAL device for 24-h and the following day completed the MARCA. Pearson correlation coefficients (r) were used to analyze convergent validity of the adult MARCA compared with activPAL estimates of total sitting/lying time. Agreement was examined using Bland-Altman plots. According to activPAL estimates, participants spent 10.4 hr/day [standard deviation (SD) = 2.06] sitting or lying down while awake. The correlation between MARCA and activPAL estimates of total sit/lie time was r = .77 (95% confidence interval = 0.64-0.86; P < .001). Bland-Altman analyses revealed a mean bias of +0.59 hr/day with moderately wide limits of agreement (-2.35 hr to +3.53 hr/day). This study found a moderate to strong agreement between the adult MARCA and the activPAL, suggesting that the MARCA is an appropriate tool for the measurement of time spent sitting or lying down in an adult population.

Reliability and validity of non-radiographic methods of thoracic kyphosis measurement: a systematic review.

PubMed

Barrett, Eva; McCreesh, Karen; Lewis, Jeremy

2014-02-01

A wide array of instruments are available for non-invasive thoracic kyphosis measurement. Guidelines for selecting outcome measures for use in clinical and research practice recommend that properties such as validity and reliability are considered. This systematic review reports on the reliability and validity of non-invasive methods for measuring thoracic kyphosis. A systematic search of 11 electronic databases located studies assessing reliability and/or validity of non-invasive thoracic kyphosis measurement techniques. Two independent reviewers used a critical appraisal tool to assess the quality of retrieved studies. Data was extracted by the primary reviewer. The results were synthesized qualitatively using a level of evidence approach. 27 studies satisfied the eligibility criteria and were included in the review. The reliability, validity and both reliability and validity were investigated by sixteen, two and nine studies respectively. 17/27 studies were deemed to be of high quality. In total, 15 methods of thoracic kyphosis were evaluated in retrieved studies. All investigated methods showed high (ICC ≥ .7) to very high (ICC ≥ .9) levels of reliability. The validity of the methods ranged from low to very high. The strongest levels of evidence for reliability exists in support of the Debrunner kyphometer, Spinal Mouse and Flexicurve index, and for validity supports the arcometer and Flexicurve index. Further reliability and validity studies are required to strengthen the level of evidence for the remaining methods of measurement. This should be addressed by future research. Copyright © 2013 Elsevier Ltd. All rights reserved.

Assessing physiotherapists' communication skills for promoting patient autonomy for self-management: reliability and validity of the communication evaluation in rehabilitation tool.

PubMed

Murray, Aileen; Hall, Amanda; Williams, Geoffrey C; McDonough, Suzanne M; Ntoumanis, Nikos; Taylor, Ian; Jackson, Ben; Copsey, Bethan; Hurley, Deirdre A; Matthews, James

2018-02-27

To assess the inter-rater reliability and concurrent validity of the Communication Evaluation in Rehabilitation Tool, which aims to externally assess physiotherapists competency in using Self-Determination Theory-based communication strategies in practice. Audio recordings of initial consultations between 24 physiotherapists and 24 patients with chronic low back pain in four hospitals in Ireland were obtained as part of a larger randomised controlled trial. Three raters, all of whom had Ph.Ds in psychology and expertise in motivation and physical activity, independently listened to the 24 audio recordings and completed the 18-item Communication Evaluation in Rehabilitation Tool. Inter-rater reliability between all three raters was assessed using intraclass correlation coefficients. Concurrent validity was assessed using Pearson's r correlations with a reference standard, the Health Care Climate Questionnaire. The total score for the Communication Evaluation in Rehabilitation Tool is an average of all 18 items. Total scores demonstrated good inter-rater reliability (Intraclass Correlation Coefficient (ICC) = 0.8) and concurrent validity with the Health Care Climate Questionnaire total score (range: r = 0.7-0.88). Item-level scores of the Communication Evaluation in Rehabilitation Tool identified five items that need improvement. Results provide preliminary evidence to support future use and testing of the Communication Evaluation in Rehabilitation Tool. Implications for Rehabilitation Promoting patient autonomy is a learned skill and while interventions exist to train clinicians in these skills there are no tools to assess how well clinicians use these skills when interacting with a patient. The lack of robust assessment has severe implications regarding both the fidelity of clinician training packages and resulting outcomes for promoting patient autonomy. This study has developed a novel measurement tool Communication Evaluation in Rehabilitation Tool and a

Are validated outcome measures used in distal radial fractures truly valid?

PubMed Central

Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.

2016-01-01

Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the

Is the presence of a validated malnutrition screening tool associated with better nutritional care in hospitalized patients?

PubMed

Eglseer, Doris; Halfens, Ruud J G; Lohrmann, Christa

2017-05-01

The aims of this study were to evaluate the association between the use of clinical guidelines and the use of validated screening tools, evaluate the nutritional screening policy in hospitals, and examine the association between the use of validated screening tools and the prevalence of malnutrition and nutritional interventions in hospitalized patients. This was a cross-sectional, multicenter study. Data were collected using a standardized questionnaire on three levels: institution (presence of a guideline for malnutrition), department (use of a validated screening tool), and patient (e.g., malnutrition prevalence). In all, 53 hospitals with 5255 patients participated. About 45% of the hospitals indicated that they have guidelines for malnutrition. Of the departments surveyed, 38.6% used validated screening tools as part of a standard procedure. The nutritional status of 74.5% of the patients was screened during admission, mostly on the basis of clinical observation and patient weight. A validated screening tool was used for 21.2% of the patients. Significant differences between wards with and without validated screening tools were found with regard to malnutrition prevalence (P = 0.002) and the following interventions: referral to a dietitian (P < 0.001), provision of energy-enriched snacks (P = 0.038), adjustment of consistency (food/drinks; P = 0.004), monitoring of the nutritional intake (P = 0.001), and adjustment of the meal ambiance (P < 0.001). Nutritional screening with validated tools in hospitalized patients remains poor. Generally, the nutritional status of patients is screened with unreliable parameters such as clinical observation and body mass index. The results of the present study suggest that the use of validated malnutrition screening tools is associated with better nutritional care and lower malnutrition prevalence rates in hospitalized patients. Copyright © 2017 Elsevier Inc. All rights reserved.

Development and validation of a Malawian version of the primary care assessment tool.

PubMed

Dullie, Luckson; Meland, Eivind; Hetlevik, Øystein; Mildestvedt, Thomas; Gjesdal, Sturla

2018-05-16

Malawi does not have validated tools for assessing primary care performance from patients' experience. The aim of this study was to develop a Malawian version of Primary Care Assessment Tool (PCAT-Mw) and to evaluate its reliability and validity in the assessment of the core primary care dimensions from adult patients' perspective in Malawi. A team of experts assessed the South African version of the primary care assessment tool (ZA-PCAT) for face and content validity. The adapted questionnaire underwent forward and backward translation and a pilot study. The tool was then used in an interviewer administered cross-sectional survey in Neno district, Malawi, to test validity and reliability. Exploratory factor analysis was performed on a random half of the sample to evaluate internal consistency, reliability and construct validity of items and scales. The identified constructs were then tested with confirmatory factor analysis. Likert scale assumption testing and descriptive statistics were done on the final factor structure. The PCAT-Mw was further tested for intra-rater and inter-rater reliability. From the responses of 631 patients, a 29-item PCAT-Mw was constructed comprising seven multi-item scales, representing five primary care dimensions (first contact, continuity, comprehensiveness, coordination and community orientation). All the seven scales achieved good internal consistency, item-total correlations and construct validity. Cronbach's alpha coefficient ranged from 0.66 to 0.91. A satisfactory goodness of fit model was achieved (GFI = 0.90, CFI = 0.91, RMSEA = 0.05, PCLOSE = 0.65). The full range of possible scores was observed for all scales. Scaling assumptions tests were achieved for all except the two comprehensiveness scales. Intra-class correlation coefficient (ICC) was 0.90 (n = 44, 95% CI 0.81-0.94, p < 0.001) for intra-rater reliability and 0.84 (n = 42, 95% CI 0.71-0.96, p < 0.001) for inter-rater reliability

Validation of a score tool for measurement of histological severity in juvenile dermatomyositis and association with clinical severity of disease

PubMed Central

Varsani, Hemlata; Charman, Susan C; Li, Charles K; Marie, Suely K N; Amato, Anthony A; Banwell, Brenda; Bove, Kevin E; Corse, Andrea M; Emslie-Smith, Alison M; Jacques, Thomas S; Lundberg, Ingrid E; Minetti, Carlo; Nennesmo, Inger; Rushing, Elisabeth J; Sallum, Adriana M E; Sewry, Caroline; Pilkington, Clarissa A; Holton, Janice L; Wedderburn, Lucy R

2015-01-01

Objectives To study muscle biopsy tissue from patients with juvenile dermatomyositis (JDM) in order to test the reliability of a score tool designed to quantify the severity of histological abnormalities when applied to biceps humeri in addition to quadriceps femoris. Additionally, to evaluate whether elements of the tool correlate with clinical measures of disease severity. Methods 55 patients with JDM with muscle biopsy tissue and clinical data available were included. Biopsy samples (33 quadriceps, 22 biceps) were prepared and stained using standardised protocols. A Latin square design was used by the International Juvenile Dermatomyositis Biopsy Consensus Group to score cases using our previously published score tool. Reliability was assessed by intraclass correlation coefficient (ICC) and scorer agreement (α) by assessing variation in scorers’ ratings. Scores from the most reliable tool items correlated with clinical measures of disease activity at the time of biopsy. Results Inter- and intraobserver agreement was good or high for many tool items, including overall assessment of severity using a Visual Analogue Scale. The tool functioned equally well on biceps and quadriceps samples. A modified tool using the most reliable score items showed good correlation with measures of disease activity. Conclusions The JDM biopsy score tool has high inter- and intraobserver agreement and can be used on both biceps and quadriceps muscle tissue. Importantly, the modified tool correlates well with clinical measures of disease activity. We propose that standardised assessment of muscle biopsy tissue should be considered in diagnostic investigation and clinical trials in JDM. PMID:24064003

The consultation and relational empathy (CARE) measure: development and preliminary validation and reliability of an empathy-based consultation process measure.

PubMed

Mercer, Stewart W; Maxwell, Margaret; Heaney, David; Watt, Graham Cm

2004-12-01

Empathy is a key aspect of the clinical encounter but there is a lack of patient-assessed measures suitable for general clinical settings. Our aim was to develop a consultation process measure based on a broad definition of empathy, which is meaningful to patients irrespective of their socio-economic background. Qualitative and quantitative approaches were used to develop and validate the new measure, which we have called the consultation and relational empathy (CARE) measure. Concurrent validity was assessed by correlational analysis against other validated measures in a series of three pilot studies in general practice (in areas of high or low socio-economic deprivation). Face and content validity was investigated by 43 interviews with patients from both types of areas, and by feedback from GPs and expert researchers in the field. The initial version of the new measure (pilot 1; high deprivation practice) correlated strongly (r = 0.85) with the Reynolds empathy measure (RES) and the Barrett-Lennard empathy subscale (BLESS) (r = 0.63), but had a highly skewed distribution (skew -1.879, kurtosis 3.563). Statistical analysis, and feedback from the 20 patients interviewed, the GPs and the expert researchers, led to a number of modifications. The revised, second version of the CARE measure, tested in an area of low deprivation (pilot 2) also correlated strongly with the established empathy measures (r = 0.84 versus RES and r = 0.77 versus BLESS) but had a less skewed distribution (skew -0.634, kurtosis -0.067). Internal reliability of the revised version was high (Cronbach's alpha 0.92). Patient feedback at interview (n = 13) led to only minor modification. The final version of the CARE measure, tested in pilot 3 (high deprivation practice) confirmed the validation with the other empathy measures (r = 0.85 versus RES and r = 0.84 versus BLESS) and the face validity (feedback from 10 patients). These preliminary results support the validity and reliability of the CARE

Validation of the Focus on the Outcomes of Communication under Six outcome measure

PubMed Central

Thomas-Stonell, Nancy; Oddson, Bruce; Robertson, Bernadette; Rosenbaum, Peter

2013-01-01

Aim The aim of this study was to establish the construct validity of the Focus on the Outcomes of Communication Under Six (FOCUS©),a tool designed to measure changes in communication skills in preschool children. Method Participating families' children (n=97; 68 males, 29 females; mean age 2y 8mo; SD 1.04y, range 10mo–4y 11mo) were recruited through eight Canadian organizations. The children were on a waiting list for speech and language intervention. Parents completed the Ages and Stages Questionnaire – Social/Emotional (ASQ-SE) and the FOCUS three times: at assessment and at the start and end of treatment. A second sample (n=28; 16 males 12 females) was recruited from another organization to correlate the FOCUS scores with speech, intelligibility and language measures. Second sample participants ranged in age from 3 years 1 month to 4 years 9 months (mean 3y 11mo; SD 0.41y). At the start and end of treatment, children were videotaped to obtain speech and language samples. Parents and speech–language pathologists (SLPs) independently completed the FOCUS tool. SLPs who were blind to the pre/post order of the videotapes analysed the samples. Results The FOCUS measured significantly more change (p<0.01) during treatment than during the waiting list period. It demonstrated both convergent and discriminant validity against the ASQ-SE. The FOCUS change corresponded to change measured by a combination of clinical speech and language measures (κ=0.31, p<0.05). Conclusion The FOCUS shows strong construct validity as a change-detecting instrument. PMID:23461266

Validation of Patient-Reported Outcomes Measurement Information System (PROMIS) computerized adaptive tests in cervical spine surgery.

PubMed

Boody, Barrett S; Bhatt, Surabhi; Mazmudar, Aditya S; Hsu, Wellington K; Rothrock, Nan E; Patel, Alpesh A

2018-03-01

OBJECTIVE The Patient-Reported Outcomes Measurement Information System (PROMIS), which is funded by the National Institutes of Health, is a set of adaptive, responsive assessment tools that measures patient-reported health status. PROMIS measures have not been validated for surgical patients with cervical spine disorders. The objective of this project is to evaluate the validity (e.g., convergent validity, known-groups validity, responsiveness to change) of PROMIS computer adaptive tests (CATs) for pain behavior, pain interference, and physical function in patients undergoing cervical spine surgery. METHODS The legacy outcome measures Neck Disability Index (NDI) and SF-12 were used as comparisons with PROMIS measures. PROMIS CATs, NDI-10, and SF-12 measures were administered prospectively to 59 consecutive tertiary hospital patients who were treated surgically for degenerative cervical spine disorders. A subscore of NDI-5 was calculated from NDI-10 by eliminating the lifting, headaches, pain intensity, reading, and driving sections and multiplying the final score by 4. Assessments were administered preoperatively (baseline) and postoperatively at 6 weeks and 3 months. Patients presenting for revision surgery, tumor, infection, or trauma were excluded. Participants completed the measures in Assessment Center, an online data collection tool accessed by using a secure login and password on a tablet computer. Subgroup analysis was also performed based on a primary diagnosis of either cervical radiculopathy or cervical myelopathy. RESULTS Convergent validity for PROMIS CATs was supported with multiple statistically significant correlations with the existing legacy measures, NDI and SF-12, at baseline. Furthermore, PROMIS CATs demonstrated known-group validity and identified clinically significant improvements in all measures after surgical intervention. In the cervical radiculopathy and myelopathic cohorts, the PROMIS measures demonstrated similar responsiveness to the

Predictive Validity of Measures of the Pathfinder Scaling Algorithm on Programming Performance: Alternative Assessment Strategy for Programming Education

ERIC Educational Resources Information Center

Lau, Wilfred W. F.; Yuen, Allan H. K.

2009-01-01

Recent years have seen a shift in focus from assessment of learning to assessment for learning and the emergence of alternative assessment methods. However, the reliability and validity of these methods as assessment tools are still questionable. In this article, we investigated the predictive validity of measures of the Pathfinder Scaling…

Development and validation of the Pediatric Stroke Quality of Life Measure.

PubMed

Fiume, Andrea; Deveber, Gabrielle; Jang, Shu-Hyun; Fuller, Colleen; Viner, Shani; Friefeld, Sharon

2018-06-01

To develop and validate a disease-specific parent proxy and child quality of life (QoL) measure for patients aged 2 to 18 years surviving cerebral sinovenous thrombosis (CSVT) and arterial ischaemic stroke (AIS). Utilizing qualitative and quantitative methods, we developed a 75-item Pediatric Stroke Quality of Life Measure (PSQLM) questionnaire. We mailed the PSQLM and a standardized generic QoL measure, Pediatric Quality of Life Inventory (PedsQL), to 353 families. Stroke type, age at stroke, and neurological outcome on the Pediatric Stroke Outcome Measure were documented. We calculated the internal consistency, validity, and reliability of the PSQLM. The response rate was 29%, yielding a sample of 101 patients (mean age 9y 9mo [SD 4.30]; 69 AIS [68.3%], 32 CSVT [31.7%]). The internal consistency of the PSQLM was high (Cronbach's α=0.94-0.97). Construct validity for the PSQLM was moderately strong (r=0.3-0.4; p<0.003) and, as expected, correlation with the PedsQL was moderate, suggesting the PSQLM operationalizes QoL distinct from the PedsQL. Test-retest reliability at 2 weeks was very good (intraclass correlation coefficient [ICC] 0.85-0.95; 95% confidence interval 0.83-0.97) and good agreement was established between parent and child report (ICC 0.63-0.76). The PSQLM demonstrates sound psychometric properties. Further research will seek to increase its clinical utility by reducing length and establishing responsiveness for descriptive and longitudinal evaluative assessment. A pediatric stroke-specific quality of life (QoL) measurement tool for assessments based on perceptions of importance and satisfaction. Moderate-to-high reliability and validity established for a new clinical scale evaluating QoL among children with stroke. Perceived QoL measured using the Pediatric Stroke Quality of Life Measure appears lower in children with neurological impairment. © 2018 Mac Keith Press.

Identification of validated questionnaires to measure adherence to pharmacological antihypertensive treatments

PubMed Central

Pérez-Escamilla, Beatriz; Franco-Trigo, Lucía; Moullin, Joanna C; Martínez-Martínez, Fernando; García-Corpas, José P

2015-01-01

Background Low adherence to pharmacological treatments is one of the factors associated with poor blood pressure control. Questionnaires are an indirect measurement method that is both economic and easy to use. However, questionnaires should meet specific criteria, to minimize error and ensure reproducibility of results. Numerous studies have been conducted to design questionnaires that quantify adherence to pharmacological antihypertensive treatments. Nevertheless, it is unknown whether questionnaires fulfil the minimum requirements of validity and reliability. The aim of this study was to compile validated questionnaires measuring adherence to pharmacological antihypertensive treatments that had at least one measure of validity and one measure of reliability. Methods A literature search was undertaken in PubMed, the Excerpta Medica Database (EMBASE), and the Latin American and Caribbean Health Sciences Literature database (Literatura Latino-Americana e do Caribe em Ciências da Saúde [LILACS]). References from included articles were hand-searched. The included papers were all that were published in English, French, Portuguese, and Spanish from the beginning of the database’s indexing until July 8, 2013, where a validation of a questionnaire (at least one demonstration of the validity and at least one of reliability) was performed to measure adherence to antihypertensive pharmacological treatments. Results A total of 234 potential papers were identified in the electronic database search; of these, 12 met the eligibility criteria. Within these 12 papers, six questionnaires were validated: the Morisky–Green–Levine; Brief Medication Questionnaire; Hill-Bone Compliance to High Blood Pressure Therapy Scale; Morisky Medication Adherence Scale; Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH); and Martín–Bayarre–Grau. Questionnaire length ranged from four to 28 items. Internal consistency, assessed by Cronbach’s α, varied from 0

Construction and Validation of a Holistic Education School Evaluation Tool Using Montessori Erdkinder Principles

ERIC Educational Resources Information Center

Setari, Anthony Philip

2016-01-01

The purpose of this study was to construct a holistic education school evaluation tool using Montessori Erdkinder principles, and begin the validation process of examining the proposed tool. This study addresses a vital need in the holistic education community for a school evaluation tool. The tool construction process included using Erdkinder…

Evaluation of Internal Construct Validity and Unidimensionality of the Brachial Assessment Tool, A Patient-Reported Outcome Measure for Brachial Plexus Injury.

PubMed

Hill, Bridget; Pallant, Julie; Williams, Gavin; Olver, John; Ferris, Scott; Bialocerkowski, Andrea

2016-12-01

To evaluate the internal construct validity and dimensionality of a new patient-reported outcome measure for people with traumatic brachial plexus injury (BPI) based on the International Classification of Functioning, Disability and Health definition of activity. Cross-sectional study. Outpatient clinics. Adults (age range, 18-82y) with a traumatic BPI (N=106). There were 106 people with BPI who completed a 51-item 5-response questionnaire. Responses were analyzed in 4 phases (missing responses, item correlations, exploratory factor analysis, and Rasch analysis) to evaluate the properties of fit to the Rasch model, threshold response, local dependency, dimensionality, differential item functioning, and targeting. Not applicable, as this study addresses the development of an outcome measure. Six items were deleted for missing responses, and 10 were deleted for high interitem correlations >.81. The remaining 35 items, while demonstrating fit to the Rasch model, showed evidence of local dependency and multidimensionality. Items were divided into 3 subscales: dressing and grooming (8 items), arm and hand (17 items), and no hand (6 items). All 3 subscales demonstrated fit to the model with no local dependency, minimal disordered thresholds, no unidimensionality or differential item functioning for age, time postinjury, or self-selected dominance. Subscales were combined into 3 subtests and demonstrated fit to the model, no misfit, and unidimensionality, allowing calculation of a summary score. This preliminary analysis supports the internal construct validity of the Brachial Assessment Tool, a unidimensional targeted 4-response patient-reported outcome measure designed to solely assess activity after traumatic BPI regardless of level of injury, age at recruitment, premorbid limb dominance, and time postinjury. Further examination is required to determine test-retest reliability and responsiveness. Copyright © 2016 American Congress of Rehabilitation Medicine

Development and validation of the Learning Disabilities Needs Assessment Tool (LDNAT), a HoNOS-based needs assessment tool for use with people with intellectual disability.

PubMed

Painter, J; Trevithick, L; Hastings, R P; Ingham, B; Roy, A

2016-12-01

In meeting the needs of individuals with intellectual disabilities (ID) who access health services, a brief, holistic assessment of need is useful. This study outlines the development and testing of the Learning Disabilities Needs Assessment Tool (LDNAT), a tool intended for this purpose. An existing mental health (MH) tool was extended by a multidisciplinary group of ID practitioners. Additional scales were drafted to capture needs across six ID treatment domains that the group identified. LDNAT ratings were analysed for the following: item redundancy, relevance, construct validity and internal consistency (n = 1692); test-retest reliability (n = 27); and concurrent validity (n = 160). All LDNAT scales were deemed clinically relevant with little redundancy apparent. Principal component analysis indicated three components (developmental needs, challenging behaviour, MH and well-being). Internal consistency was good (Cronbach alpha 0.80). Individual item test-retest reliability was substantial-near perfect for 20 scales and slight-fair for three scales. Overall reliability was near perfect (intra-class correlation = 0.91). There were significant associations with five of six condition-specific measures, i.e. the Waisman Activities of Daily Living Scale (general ability/disability), Threshold Assessment Grid (risk), Behaviour Problems Inventory for Individuals with Intellectual Disabilities-Short Form (challenging behaviour) Social Communication Questionnaire (autism) and a bespoke physical health questionnaire. Additionally, the statistically significant correlations between these tools and the LDNAT components made sense clinically. There were no statistically significant correlations with the Psychiatric Assessment Schedules for Adults with Developmental Disabilities (a measure of MH symptoms in people with ID). The LDNAT had clinically utility when rating the needs of people with ID prior to condition-specific assessment(s). Analyses of internal

Are measurements of patient safety culture and adverse events valid and reliable? Results from a cross sectional study.

PubMed

Farup, Per G

2015-05-02

The association between measurements of the patient safety culture and the "true" patient safety has been insufficiently documented, and the validity of the tools used for the measurements has been questioned. This study explored associations between the patient safety culture and adverse events, and evaluated the validity of the tools. In 2008/2009, a survey on patient safety culture was performed with Hospital Survey on Patient Safety Culture (HSOPSC) in two medical departments in two geographically separated hospitals of Innlandet Hospital Trust. Later, a retrospective analysis of adverse events during the same period was performed with the Global Trigger Tool (GTT). The safety culture and adverse events were compared between the departments. 185 employees participated in the study, and 272 patient records were analysed. The HSOPSC scores were lower and adverse events less prevalent in department 1 than in department 2. In departments 1 and 2 the mean HSOPSC scores (SD) were at the unit level 3.62 (0.42) and 3.90 (0.37) (p < 0.001), and at the hospital level 3.35 (1.53) and 3.67 (0.53) (ns, p = 0.19) respectively. The proportion of records with adverse events were 10/135 (7%) and 28/137 (20%) (p = 0.003) respectively. There was an inverse association between the patient safety culture and adverse events. Until the criterion validity of the tools for measuring patient safety culture and tracking of adverse events have been further evaluated, measurement of patient safety culture could not be used as a proxy for the "true" safety.

Validation protocols for blood pressure-measuring devices: status quo and development needs.

PubMed

Beime, Beate; Deutsch, Cornelia; Gomez, Timothy; Zwingers, Thomas; Mengden, Thomas; Bramlage, Peter

2016-02-01

Hypertension is a major risk factor for cardiovascular morbidity and mortality. Therefore, blood pressure self-measuring devices have emerged as valuable tools in patient care and the accuracy of these instruments is of fundamental importance. For this reason, several validation procedures for assessing the efficacy of blood pressure monitoring devices have been developed, including protocols by the Association for the Advancement of Medical Instrumentation, the British Hypertension Society, the German Hypertension League (Prüfsiegelprotokoll), and the International Protocol of the Working Group on Blood Pressure Monitoring of the European Society of Hypertension. In the past, most of the protocols have been reviewed and modified because of experiences gained during the validation studies carried out. However, each shows distinct differences, that is number and characteristics of patients required, blood pressure ranges, and the length of the validation procedure, which may result in unique advantages and/or limitations associated with their use. The continued standardization and evolution of these guidelines is essential to ensure the efficacy of blood pressure-measuring devices marketed for clinical and home use. Here, we aimed to compare four currently used validation protocols and to initiate a discussion on potential future improvements.

Measurement properties of screening and diagnostic tools for autism spectrum adults of mean normal intelligence: A systematic review.

PubMed

Baghdadli, A; Russet, F; Mottron, L

2017-07-01

The autism spectrum (AS) is a multifaceted neurodevelopmental variant associated with lifelong challenges. Despite the relevant importance of identifying AS in adults for epidemiological, public health, and quality of life issues, the measurement properties of the tools currently used to screen and diagnose adults without intellectual disabilities (ID) have not been assessed. This systematic review addresses the accuracy, reliability, and validity of the reported AS screening and diagnostic tools used in adults without ID. Electronic databases and bibliographies were searched, and identified papers evaluated against inclusion criteria. The PRISMA statement was used for reporting the review. We evaluated the quality of the papers using the COSMIN Checklist for psychometric data, and QUADAS-2 for diagnostic data. For the COSMIN assessment, evidence was considered to be strong when several methodologically good articles, or one excellent article, reported consistent evidence for or against a measurement property. For the QUADAS ratings, evidence was considered to be "satisfactory" if at least one study was rated with a low risk of bias and low concern about applicability. We included 38 articles comprising 32 studies, five reviews, and one book chapter and assessed nine tools (three diagnostic and six screening, including eight of their short versions). Among screening tools, only AQ-50, AQ-S, and RAADS-R and RAADS-14 were found to provide satisfactory or intermediate values for their psychometric properties, supported by strong or moderate evidence. Nevertheless, risks of bias and concerns on the applicability of these tools limit the evidence on their diagnostic properties. We found that none of the gold standard diagnostic tools used for children had satisfactory measurement properties. There is limited evidence for the measurement properties of the screening and diagnostic tools used for AS adults with a mean normal range of measured intelligence. This may lessen

Development of the Assessment of Burden of COPD tool: an integrated tool to measure the burden of COPD.

PubMed

Slok, Annerika H M; in 't Veen, Johannes C C M; Chavannes, Niels H; van der Molen, Thys; Rutten-van Mölken, Maureen P M H; Kerstjens, Huib A M; Salomé, Philippe L; Holverda, Sebastiaan; Dekhuijzen, P N Richard; Schuiten, Denise; Asijee, Guus M; van Schayck, Onno C P

2014-07-10

In deciding on the treatment plan for patients with chronic obstructive pulmonary disease (COPD), the burden of COPD as experienced by patients should be the core focus. It is therefore important for daily practice to develop a tool that can both assess the burden of COPD and facilitate communication with patients in clinical practice. This paper describes the development of an integrated tool to assess the burden of COPD in daily practice. A definition of the burden of COPD was formulated by a Dutch expert team. Interviews showed that patients and health-care providers agreed on this definition. We found no existing instruments that fully measured burden of disease according to this definition. However, the Clinical COPD Questionnaire meets most requirements, and was therefore used and adapted. The adapted questionnaire is called the Assessment of Burden of COPD (ABC) scale. In addition, the ABC tool was developed, of which the ABC scale is the core part. The ABC tool is a computer program with an algorithm that visualises outcomes and provides treatment advice. The next step in the development of the tool is to test the validity and effectiveness of both the ABC scale and tool in daily practice.

Satellite stratospheric aerosol measurement validation

NASA Technical Reports Server (NTRS)

Russell, P. B.; Mccormick, M. P.

1984-01-01

The validity of the stratospheric aerosol measurements made by the satellite sensors SAM II and SAGE was tested by comparing their results with each other and with results obtained by other techniques (lider, dustsonde, filter, and impactor). The latter type of comparison required the development of special techniques that convert the quantity measured by the correlative sensor (e.g. particle backscatter, number, or mass) to that measured by the satellite sensor (extinction) and quantitatively estimate the uncertainty in the conversion process. The results of both types of comparisons show agreement within the measurement and conversion uncertainties. Moreover, the satellite uncertainty is small compared to aerosol natural variability (caused by seasonal changes, volcanoes, sudden warmings, and vortex structure). It was concluded that the satellite measurements are valid.

Homework Stress: Construct Validation of a Measure

ERIC Educational Resources Information Center

Katz, Idit; Buzukashvili, Tamara; Feingold, Liat

2012-01-01

This article presents 2 studies aimed at validating a measure of stress experienced by children and parents around the issue of homework, applying Benson's program of validation (Benson, 1998). Study 1 provides external validity of the measure by supporting hypothesized relations between stress around homework and students' and parents' positive…

[Validity of the suicidality assessment instrument PRISM-S (Pictoral Representation of Illness Self Measure - Suicidality)].

PubMed

Ring, Mariann; Harbauer, Gregor; Haas, Sebastian; Schuetz, Christopher; Andreae, Andreas; Maercker, Andreas; Ajdacic-Gross, Vladeta

2014-01-01

In routine clinical practice the assessment of suicidality proves to be difficult and complex. The aim of the present study was to examine if PRISM can be used to measure validly the person's subjectively perceived suicidality. The nonverbal visualization technique PRISM (Pictoral Representation of Illness and Self Measure) has been developed by Büchi et al. (2002) to evaluate the perceived burden of suffering due to physical illness. The adapted version of PRISM used in our study is called PRISM-S (Pictoral Representation of Illness and Self Measure - Suicidality). 156 eligible inpatients, admitted voluntarily to the crisis intervention centre Winterthur, participated in the study. We used as gold standards the well established assessment tools the Beck Scale of Suicide Ideation (BSS) and the Depressive Symptome Inventory - Subscale (DSI-SS). The results showed high correlations between PRISM-S and the BSS (r = - 0,73) and the DSI-SS scores (r = - 0,76). Clinicians, general practitioners, psychiatrists and psychologists receive with PRISM-S a valid suicidality assessment tool that is very brief and easy to administer in clinical settings.

Measurement and Research Tools.

ERIC Educational Resources Information Center

1997

This document contains four papers from a symposium on measurement and research tools for human resource development (HRD). "The 'Best Fit' Training: Measure Employee Learning Style Strengths" (Daniel L. Parry) discusses a study of the physiological aspect of sensory intake known as modality, more specifically, modality as measured by…

Developing and Validating Field Measurement Scales for Absorptive Capacity and Experienced Community of Practice

ERIC Educational Resources Information Center

Cadiz, David; Sawyer, John E.; Griffith, Terri L.

2009-01-01

Research on knowledge transfer in organizations has been hampered by the lack of tools yielding valid scores for studying critical constructs in concert. The authors developed survey measures of absorptive capacity (the ability to transform new knowledge into usable knowledge) and experienced community of practice (the extent to which a person is…

Children's Physical Activity While Gardening: Development of a Valid and Reliable Direct Observation Tool.

PubMed

Myers, Beth M; Wells, Nancy M

2015-04-01

Gardens are a promising intervention to promote physical activity (PA) and foster health. However, because of the unique characteristics of gardening, no extant tool can capture PA, postures, and motions that take place in a garden. The Physical Activity Research and Assessment tool for Garden Observation (PARAGON) was developed to assess children's PA levels, tasks, postures, and motions, associations, and interactions while gardening. PARAGON uses momentary time sampling in which a trained observer watches a focal child for 15 seconds and then records behavior for 15 seconds. Sixty-five children (38 girls, 27 boys) at 4 elementary schools in New York State were observed over 8 days. During the observation, children simultaneously wore Actigraph GT3X+ accelerometers. The overall interrater reliability was 88% agreement, and Ebel was .97. Percent agreement values for activity level (93%), garden tasks (93%), motions (80%), associations (95%), and interactions (91%) also met acceptable criteria. Validity was established by previously validated PA codes and by expected convergent validity with accelerometry. PARAGON is a valid and reliable observation tool for assessing children's PA in the context of gardening.

Validation of tool mark analysis of cut costal cartilage.

PubMed

Love, Jennifer C; Derrick, Sharon M; Wiersema, Jason M; Peters, Charles

2012-03-01

This study was designed to establish the potential error rate associated with the generally accepted method of tool mark analysis of cut marks in costal cartilage. Three knives with different blade types were used to make experimental cut marks in costal cartilage of pigs. Each cut surface was cast, and each cast was examined by three analysts working independently. The presence of striations, regularity of striations, and presence of a primary and secondary striation pattern were recorded for each cast. The distance between each striation was measured. The results showed that striations were not consistently impressed on the cut surface by the blade's cutting edge. Also, blade type classification by the presence or absence of striations led to a 65% misclassification rate. Use of the classification tree and cross-validation methods and inclusion of the mean interstriation distance decreased the error rate to c. 50%. © 2011 American Academy of Forensic Sciences.

Validation tools for image segmentation

NASA Astrophysics Data System (ADS)

Padfield, Dirk; Ross, James

2009-02-01

A large variety of image analysis tasks require the segmentation of various regions in an image. For example, segmentation is required to generate accurate models of brain pathology that are important components of modern diagnosis and therapy. While the manual delineation of such structures gives accurate information, the automatic segmentation of regions such as the brain and tumors from such images greatly enhances the speed and repeatability of quantifying such structures. The ubiquitous need for such algorithms has lead to a wide range of image segmentation algorithms with various assumptions, parameters, and robustness. The evaluation of such algorithms is an important step in determining their effectiveness. Therefore, rather than developing new segmentation algorithms, we here describe validation methods for segmentation algorithms. Using similarity metrics comparing the automatic to manual segmentations, we demonstrate methods for optimizing the parameter settings for individual cases and across a collection of datasets using the Design of Experiment framework. We then employ statistical analysis methods to compare the effectiveness of various algorithms. We investigate several region-growing algorithms from the Insight Toolkit and compare their accuracy to that of a separate statistical segmentation algorithm. The segmentation algorithms are used with their optimized parameters to automatically segment the brain and tumor regions in MRI images of 10 patients. The validation tools indicate that none of the ITK algorithms studied are able to outperform with statistical significance the statistical segmentation algorithm although they perform reasonably well considering their simplicity.

Validation of the National Aeronautics and Space Administration Task Load Index as a tool to evaluate the learning curve for endoscopy training.

PubMed

Mohamed, Rachid; Raman, Maitreyi; Anderson, John; McLaughlin, Kevin; Rostom, Alaa; Coderre, Sylvain

2014-03-01

Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking. To validate such a workload tool and use it to map the progression of novice trainees in gastroenterology in performing their first endoscopies. The National Aeronautics and Space Administration Task Load Index (NASA-TLX) workload assessment tool was completed by eight novice trainees in gastroenterology and 10 practicing gastroenterologists⁄surgeons. An exploratory factor analysis was performed to construct a streamlined endoscopy-specific task load index, which was subsequently validated. The 'Endoscopy Task Load Index' was used to monitor progression of trainee exertion and self-assessed performance over their first 40 procedures. From the factor analysis of the NASA-TLX, two principal components emerged: a measure of exertion and a measure of self-efficacy. These items became the components of the newly validated Endoscopy Task Load Index. There was a steady decline in self-perceived exertion over the training period, which was more rapid for gastroscopy than colonoscopy. The self-efficacy scores for gastroscopy rapidly increased over the first few procedures, reaching a plateau after this period of time. For colonoscopy, there was a progressive increase in reported self-efficacy over the first three quartiles of procedures, followed by a drop in self-efficacy scores over the final quartile. The present study validated an Endoscopy Task Load Index that can be completed in <1 min. Practical implications of such a tool in endoscopy education include identifying periods of higher perceived exertion among novice endoscopists, facilitating appropriate levels of guidance from trainers.

Development, Sensibility, and Validity of a Systemic Autoimmune Rheumatic Disease Case Ascertainment Tool.

PubMed

Armstrong, Susan M; Wither, Joan E; Borowoy, Alan M; Landolt-Marticorena, Carolina; Davis, Aileen M; Johnson, Sindhu R

2017-01-01

Case ascertainment through self-report is a convenient but often inaccurate method to collect information. The purposes of this study were to develop, assess the sensibility, and validate a tool to identify cases of systemic autoimmune rheumatic diseases (SARD) in the outpatient setting. The SARD tool was administered to subjects sampled from specialty clinics. Determinants of sensibility - comprehensibility, feasibility, validity, and acceptability - were evaluated using a numeric rating scale from 1-7. Comprehensibility was evaluated using the Flesch Reading Ease and the Flesch-Kincaid Grade Level. Self-reported diagnoses were validated against medical records using Cohen's κ statistic. There were 141 participants [systemic lupus erythematosus (SLE), systemic sclerosis (SSc), rheumatoid arthritis, Sjögren syndrome (SS), inflammatory myositis (polymyositis/dermatomyositis; PM/DM), and controls] who completed the questionnaire. The Flesch Reading Ease score was 77.1 and the Flesch-Kincaid Grade Level was 4.4. Respondents endorsed (mean ± SD) comprehensibility (6.12 ± 0.92), feasibility (5.94 ± 0.81), validity (5.35 ± 1.10), and acceptability (3.10 ± 2.03). The SARD tool had a sensitivity of 0.91 (95% CI 0.88-0.94) and a specificity of 0.99 (95% CI 0.96-1.00). The agreement between the SARD tool and medical record was κ = 0.82 (95% CI 0.77-0.88). Subgroup analysis by SARD found κ coefficients for SLE to be κ = 0.88 (95% CI 0.79-0.97), SSc κ = 1.0 (95% CI 1.0-1.0), PM/DM κ = 0.72 (95% CI 0.49-0.95), and SS κ = 0.85 (95% CI 0.71-0.99). The screening questions had sensitivity ranging from 0.96 to 1.0 and specificity ranging from 0.88 to 1.0. This SARD case ascertainment tool has demonstrable sensibility and validity. The use of both screening and confirmatory questions confers added accuracy.

Development and validation of PSPSQ 2.0 measuring patient satisfaction with pharmacist services.

PubMed

Sakharkar, Prashant; Bounthavong, Mark; Hirsch, Jan D; Morello, Candis M; Chen, Timothy C; Law, Anandi V

2015-01-01

The extant literature reveals a lack of psychometrically validated tools measuring patient satisfaction with pharmacist clinical services. The Patient Satisfaction with Pharmacist Services Questionnaire (PSPSQ 2.0) was developed to address this need using a mixed methods approach. To assess the psychometric properties of the PSPSQ 2.0, an instrument developed to measure patient satisfaction with clinical services provided by pharmacists. Validation studies were conducted in two Veterans Affairs (VA)-based and two community-based (diabetes and psychiatric care) disease management/medication therapy management clinics. The PSPSQ 2.0 consisted of 22-items related to three domains identified as quality of care, patient-pharmacist relationship and overall satisfaction using a 4-point, Likert-type scale. It was administered to participants following their session with a pharmacist at the clinics. Collected data were analyzed for descriptive statistics, internal consistency, and validity using exploratory factor analysis. A total of 149 patients completed the survey. Patients from VA clinics were on average 61 years old, mostly white (63%), and predominantly male (95%). Patients from non-VA clinics were on average 47 years old, mostly White (47%) and male (53%). Non-VA patients mostly had Medicaid (42%) and commercial health insurance (31%), whereas VA patients retained benefits with the US Department of Veterans Affairs. Reliability of the scale using internal consistency metrics revealed a Cronbach's alpha of 0.98, 0.98 and 0.95 for VA, diabetes, and psychiatric care clinics, respectively, whereas the Cronbach's alpha for the pooled sample was 0.96. Factor analyses resulted in a three-factor solution accounting for 91% and 69% variance for diabetes and psychiatric care clinics, respectively; however, VA clinics and pooled sample yielded only 2-factor solution with 80% and 66% variance, respectively, with more items loading on patient-pharmacist relationship domain. The

Pictorial representation of illness and self measure (PRISM): an effective tool to assess the burden of psoriasis.

PubMed

Fotiou, K; Hofmann, M; Kaufmann, R; Thaci, D

2015-12-01

Psoriasis has a negative impact on patient's' quality of life, which may reflect the physical and psychosocial impact of the disease. However, little is known about the perceived burden of disease. Pictorial Representation of Illness and Self Measure (PRISM), a pictorial tool, was developed to measure this global suffering. Capturing quality of life impairments in psoriasis is an integral part of assessing the overall disease severity and planning effective treatment strategies. To validate Pictorial Representation of Illness and Self Measure (PRISM) in psoriasis patients. An investigator initiated, prospective cohort study was performed in 108 outpatients with psoriasis to validate PRISM as an appropriate tool; Reliability was assessed in a cohort with controlled stable disease, repeated after 1 hour and after a 3-month follow-up phase; Convergent validity determined by correlation against measures of life quality (DLQI) and reported severity of psoriasis (PASI, PGA and BSA) was performed. For PRISM, we found a high reliability for short-term measurements (ICC = 0.98, P < 0.001) and for follow-up assessments at 3 months (ICC = 0.76, P < 0.001). Our investigation showed significant differences between patients with clear to minimal (PGA 0, 1), mild (PGA 2) and moderate-to-severe disease (PGA 3, 4) and significant (P < 0.001) correlation with DLQI, PGA, PASI and BSA (ρ = -0.62, -0.54, -0.44 and -0.39 respectively). PRISM is a highly reliable tool and new approach to assess perceived burden of patients with psoriasis. It is easy to use and we recommend the application as an additional outcome measure in clinical trial settings. © 2015 European Academy of Dermatology and Venereology.

Rasch Validation of a Measure of Reform-Oriented Science Teaching Practices

NASA Astrophysics Data System (ADS)

You, Hye Sun

2016-06-01

Growing evidence from recent curriculum documents and previous research suggests that reform-oriented science teaching practices promote students' conceptual understanding, levels of achievement, and motivation to learn, especially when students are actively engaged in constructing their ideas through scientific inquiries. However, it is difficult to identify to what extent science teachers engage students in reform-oriented teaching practices (RTPs) in their science classrooms. In order to exactly diagnose the current status of science teachers' implementation of the RTPs, a valid and reliable instrument tool is needed. The principles of validity and reliability are fundamental cornerstones in developing a robust measurement tool. As such, this study was motivated by the desire to point out the limitations of the existing statistical and psychometric analyses and to further examine the validation of the RTP survey instrument. This paper thus aims at calibrating the items of the RTPs for science teachers using the Rasch model. The survey instrument scale was adapted from the 2012 National Survey of Science and Mathematics Education (NSSME) data. A total of 3701 science teachers from 1403 schools from across the USA participated in the NSSME survey. After calibrating the RTP items and persons on the same scale, the RTP instrument well represented the population of US science teachers. Model-data fit determined by Infit and Outfit statistics was within an appropriate range (0.5-1.5), supporting the unidimensional structure of the RTPs. The ordered category thresholds and the probability of the thresholds showed that the five-point rating scale functioned well. The results of this study support the use of the RTP measure from the 2012 NSSME in assessing usage of RTPs.

The identification and appraisal of assessment tools used to evaluate metatarsus adductus: a systematic review of their measurement properties.

PubMed

Marshall, Nicole; Ward, Emily; Williams, Cylie M

2018-01-01

Metatarsus adductus is the most common congenital foot deformity in newborns. It involves adduction of the metatarsals at the Lisfranc joint. A systematic literature review was conducted to investigate the following question: What tools are used to identify and quantify metatarsus adductus and how reliable, valid and responsive are they? The following electronic databases were searched for studies describing tools for the identification and quantification of metatarsus adductus in adults and children published from inception to June 2016: Ovid MEDLINE, Embase, CINAHL, Scopus, Web of Science and AMED. Two researchers initially searched all articles by screening titles and abstracts. If there was any doubt as to an article's eligibility, the full text paper was retrieved. Reference lists and citations of all retained studies were examined in an attempt to locate further studies. Articles were excluded if they were not in English or described other congenital foot conditions that did not include metatarsus adductus. Studies included in the review reporting measurement properties of measurement tools were critically appraised using the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) critical appraisal tool. There were 282 articles screened by title and abstract and 28 articles screened from full text. Fifteen articles were included and nine had data that were extractable for appraisal using the COSMIN critical appraisal tool. Techniques to measure metatarsus adductus included the heel bisector method, photocopies, ultrasound, footprints, dynamic foot pressure and radiographs. There was a paucity of quality data reporting the reliability, validity or responsiveness for measuring metatarsus adductus. Several radiographic angles showed good reliability (intraclass correlation (ICC) - 0.84, 0.97) in adults during pre-operative planning. There have been multiple assessment techniques proposed for quantification of metatarsus adductus

Measuring adverse events in helicopter emergency medical services: establishing content validity.

PubMed

Patterson, P Daniel; Lave, Judith R; Martin-Gill, Christian; Weaver, Matthew D; Wadas, Richard J; Arnold, Robert M; Roth, Ronald N; Mosesso, Vincent N; Guyette, Francis X; Rittenberger, Jon C; Yealy, Donald M

2014-01-01

We sought to create a valid framework for detecting adverse events (AEs) in the high-risk setting of helicopter emergency medical services (HEMS). We assembled a panel of 10 expert clinicians (n = 6 emergency medicine physicians and n = 4 prehospital nurses and flight paramedics) affiliated with a large multistate HEMS organization in the Northeast US. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the content validity index (CVI), to quantify the validity of the framework's content. The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: (1) a trigger tool, (2) a method for rating proximal cause, and (3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. We demonstrate a standardized process for the development of a content-valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS.

Are the available apathy measures reliable and valid? A review of the psychometric evidence

PubMed Central

Clarke, Diana E.; Ko, Jean Y.; Kuhl, Emily A.; van Reekum, Robert; Salvador, Rocio; Marin, Robert S.

2014-01-01

Objective Apathy is highly prevalent among neuropsychiatric populations and is associated with greater morbidity and worse functional outcomes. Despite this, it remains understudied and poorly understood, primarily due to lack of consensus definition and clear diagnostic criteria for apathy. Without a gold standard for defining and measuring apathy, the availability of empirically sound measures is imperative. This paper provides a psychometric review of the most commonly used apathy measures and provides recommendations for use and further research. Methods Pertinent literature databases were searched to identify all available assessment tools for apathy in adults aged 18 and older. Evidence of the reliability and validity of the scales were examined. Alternate variations of scales (e.g., non-English versions) were also evaluated if the validating articles were written in English. Results Fifteen apathy scales or subscales were examined. The most psychometrically robust measures for assessing apathy across any disease population appear to be the Apathy Evaluation Scale and the apathy subscale of the Neuropsychiatric Inventory based on the criteria set in this review. For assessment in specific populations, the Dementia Apathy Interview and Rating for patients with Alzheimer’s dementia, the Positive and Negative Symptom Scale for schizophrenia populations, and the Frontal System Behavior Scale for patients with fronto-temporal deficits are reliable and valid measures. Conclusion Clinicians and researchers have numerous apathy scales for use in broad and disease-specific neuropsychiatric populations. Our understanding of apathy would be advanced by research that helps build a consensus as to the definition and diagnosis of apathy, and further refine the psychometric properties of all apathy assessment tools. PMID:21193104

Development and Validation of a Monte Carlo Simulation Tool for Multi-Pinhole SPECT

PubMed Central

Mok, Greta S. P.; Du, Yong; Wang, Yuchuan; Frey, Eric C.; Tsui, Benjamin M. W.

2011-01-01

Purpose In this work, we developed and validated a Monte Carlo simulation (MCS) tool for investigation and evaluation of multi-pinhole (MPH) SPECT imaging. Procedures This tool was based on a combination of the SimSET and MCNP codes. Photon attenuation and scatter in the object, as well as penetration and scatter through the collimator detector, are modeled in this tool. It allows accurate and efficient simulation of MPH SPECT with focused pinhole apertures and user-specified photon energy, aperture material, and imaging geometry. The MCS method was validated by comparing the point response function (PRF), detection efficiency (DE), and image profiles obtained from point sources and phantom experiments. A prototype single-pinhole collimator and focused four- and five-pinhole collimators fitted on a small animal imager were used for the experimental validations. We have also compared computational speed among various simulation tools for MPH SPECT, including SimSET-MCNP, MCNP, SimSET-GATE, and GATE for simulating projections of a hot sphere phantom. Results We found good agreement between the MCS and experimental results for PRF, DE, and image profiles, indicating the validity of the simulation method. The relative computational speeds for SimSET-MCNP, MCNP, SimSET-GATE, and GATE are 1: 2.73: 3.54: 7.34, respectively, for 120-view simulations. We also demonstrated the application of this MCS tool in small animal imaging by generating a set of low-noise MPH projection data of a 3D digital mouse whole body phantom. Conclusions The new method is useful for studying MPH collimator designs, data acquisition protocols, image reconstructions, and compensation techniques. It also has great potential to be applied for modeling the collimator-detector response with penetration and scatter effects for MPH in the quantitative reconstruction method. PMID:19779896

Validation of a motivation survey tool for pharmacy students: Exploring a link to professional identity development.

PubMed

Mylrea, Martina F; Sen Gupta, Tarun; Glass, Beverley D

2017-09-01

Self-determination theory (SDT), which describes a continuum of motivation regulators, is proposed as an appropriate framework to study pharmacy student motivation. The aim was to develop a Pharmacy Motivation Scale (Pharm-S) to determine motivation regulators in undergraduate students and explore a possible link to professional identity development. The Pharm-S was adapted from the SDT-based, Sports Motivation Scale (SMS-II), and administered to undergraduate students in an Australian pharmacy course. Convergent validity was assessed by conducting a correlation analysis between the Pharm-S and MacLeod Clark Professional Identity Scale (MCPIS-9). Face, content and construct validity were established for the Pharm-S through the analysis of 327 survey responses. Factor analysis extracted four of the six theoretical subscales as proposed by SDT (variance explained: 65.7%). Support for the SDT structure was confirmed by high factor loadings in each of the subscales and acceptable reliability coefficients. Subscale correlations revealed a simplex pattern, supporting the presence of a motivation continuum, as described by SDT. A moderate positive correlation (0.64) between Pharm-S responses and the validated professional identity instrument, MCPIS-9, indicated a possible link between levels of motivation and professional identity. and conclusions: Content and structural validity and internal consistency of the Pharm-S confirmed the reliability of the Pharm-S as a valid tool to assess motivational regulators. Pharm-S and the MCPIS-9 were positively correlated, lending support to a link between motivation and professional identity. This suggests a potential role for the Pharm-S as a valid tool to measure pharmacy student professional identity development. Crown Copyright © 2017. Published by Elsevier Inc. All rights reserved.

Development and content validation of the power mobility training tool.

PubMed

Kenyon, Lisa K; Farris, John P; Cain, Brett; King, Emily; VandenBerg, Ashley

2018-01-01

This paper outlines the development and content validation of the power mobility training tool (PMTT), an observational tool designed to assist therapists in developing power mobility training programs for children who have multiple, severe impairments. Initial items on the PMTT were developed based on a literature review and in consultation with therapists experienced in the use of power mobility. Items were trialled in clinical settings, reviewed, and refined. Items were then operationalized and an administration manual detailing scoring for each item was created. Qualitative and quantitative methods were used to establish content validity via a 15 member, international expert panel. The content validity ratio (CVR) was determined for each possible item. Of the 19 original items, 10 achieved minimum required CVR values and were included in the final version of the PMTT. Items related to manoeuvring a power mobility device were merged and an item related to the number of switches used concurrently to operate a power mobility device were added to the PMTT. The PMTT may assist therapists in developing training programs that facilitate the acquisition of beginning power mobility skills in children who have multiple, severe impairments. Implications for Rehabilitation The Power Mobility Training Tool (PMTT) was developed to help guide the development of power mobility intervention programs for children who have multiple, severe impairments. The PMTT can be used with children who access a power mobility device using either a joystick or a switch. Therapists who have limited experience with power mobility may find the PMTT to be helpful in setting up and conducting power mobility training interventions as a feasible aspect of a plan of care for children who have multiple, severe impairments.

Measuring patient-provider communication skills in Rwanda: Selection, adaptation and assessment of psychometric properties of the Communication Assessment Tool.

PubMed

Cubaka, Vincent Kalumire; Schriver, Michael; Vedsted, Peter; Makoul, Gregory; Kallestrup, Per

2018-04-23

To identify, adapt and validate a measure for providers' communication and interpersonal skills in Rwanda. After selection, translation and piloting of the measure, structural validity, test-retest reliability, and differential item functioning were assessed. Identification and adaptation: The 14-item Communication Assessment Tool (CAT) was selected and adapted. Content validation found all items highly relevant in the local context except two, which were retained upon understanding the reasoning applied by patients. Eleven providers and 291 patients were involved in the field-testing. Confirmatory factor analysis showed a good fit for the original one factor model. Test-retest reliability assessment revealed a mean quadratic weighted Kappa = 0.81 (range: 0.69-0.89, N = 57). The average proportion of excellent scores was 15.7% (SD: 24.7, range: 9.9-21.8%, N = 180). Differential item functioning was not observed except for item 1, which focuses on greetings, for age groups (p = 0.02, N = 180). The Kinyarwanda version of CAT (K-CAT) is a reliable and valid patient-reported measure of providers' communication and interpersonal skills. K-CAT was validated on nurses and its use on other types of providers may require further validation. K-CAT is expected to be a valuable feedback tool for providers in practice and in training. Copyright © 2018 Elsevier B.V. All rights reserved.

Multilevel Assessment of Middle School Students’ Interest in the Health Sciences: Development and Validation of a New Measurement Tool

PubMed Central

Romine, William L.; Miller, Michele E.; Knese, Shawn A.; Folk, William R.

2016-01-01

Using the context of a 2-wk instructional unit focused on eye and vision health, we developed and validated a multilevel measure of middle school students’ interest in science and health careers. This survey contained three subscales positioned differently with respect to curricular content. Interest in Vision Care was most related, but less transferrable to other contexts. Interest in Science was most general, and Interest in Healthcare was positioned between the two. We found that, with two exceptions, items fitted well with validity expectations and were stable across a 2-wk intervention. Further, measures of interest in science, health, and vision-care careers were shown to be reliable and valid. We found that ease of facilitating change across the intervention was generally greater in subscales closely related to the curricular context but that the average magnitude of change in Interest in Healthcare and Interest in Science was not significantly different. We discuss use of these measures in informing instructional efforts and advise that changes in students’ perceptions of how science and healthcare relate should be considered in longitudinal analyses. PMID:27252297

Is BMI a valid measure of obesity in postmenopausal women?

PubMed

Banack, Hailey R; Wactawski-Wende, Jean; Hovey, Kathleen M; Stokes, Andrew

2018-03-01

Body mass index (BMI) is a widely used indicator of obesity status in clinical settings and population health research. However, there are concerns about the validity of BMI as a measure of obesity in postmenopausal women. Unlike BMI, which is an indirect measure of obesity and does not distinguish lean from fat mass, dual-energy x-ray absorptiometry (DXA) provides a direct measure of body fat and is considered a gold standard of adiposity measurement. The goal of this study is to examine the validity of using BMI to identify obesity in postmenopausal women relative to total body fat percent measured by DXA scan. Data from 1,329 postmenopausal women participating in the Buffalo OsteoPerio Study were used in this analysis. At baseline, women ranged in age from 53 to 85 years. Obesity was defined as BMI ≥ 30 kg/m and body fat percent (BF%) greater than 35%, 38%, or 40%. We calculated sensitivity, specificity, positive predictive value, and negative predictive value to evaluate the validity of BMI-defined obesity relative BF%. We further explored the validity of BMI relative to BF% using graphical tools, such as scatterplots and receiver-operating characteristic curves. Youden's J index was used to determine the empirical optimal BMI cut-point for each level of BF% defined obesity. The sensitivity of BMI-defined obesity was 32.4% for 35% body fat, 44.6% for 38% body fat, and 55.2% for 40% body fat. Corresponding specificity values were 99.3%, 97.1%, and 94.6%, respectively. The empirical optimal BMI cut-point to define obesity is 24.9 kg/m for 35% BF, 26.49 kg/m for 38% BF, and 27.05 kg/m for 40% BF according to the Youden's index. Results demonstrate that a BMI cut-point of 30 kg/m does not appear to be an appropriate indicator of true obesity status in postmenopausal women. Empirical estimates of the validity of BMI from this study may be used by other investigators to account for BMI-related misclassification in older women.

LACO-Wiki: A land cover validation tool and a new, innovative teaching resource for remote sensing and the geosciences

NASA Astrophysics Data System (ADS)

See, Linda; Perger, Christoph; Dresel, Christopher; Hofer, Martin; Weichselbaum, Juergen; Mondel, Thomas; Steffen, Fritz

2016-04-01

The validation of land cover products is an important step in the workflow of generating a land cover map from remotely-sensed imagery. Many students of remote sensing will be given exercises on classifying a land cover map followed by the validation process. Many algorithms exist for classification, embedded within proprietary image processing software or increasingly as open source tools. However, there is little standardization for land cover validation, nor a set of open tools available for implementing this process. The LACO-Wiki tool was developed as a way of filling this gap, bringing together standardized land cover validation methods and workflows into a single portal. This includes the storage and management of land cover maps and validation data; step-by-step instructions to guide users through the validation process; sound sampling designs; an easy-to-use environment for validation sample interpretation; and the generation of accuracy reports based on the validation process. The tool was developed for a range of users including producers of land cover maps, researchers, teachers and students. The use of such a tool could be embedded within the curriculum of remote sensing courses at a university level but is simple enough for use by students aged 13-18. A beta version of the tool is available for testing at: http://www.laco-wiki.net.

Validation of an early childhood caries risk assessment tool in a low-income Hispanic population.

PubMed

Custodio-Lumsden, Christie L; Wolf, Randi L; Contento, Isobel R; Basch, Charles E; Zybert, Patricia A; Koch, Pamela A; Edelstein, Burton L

2016-03-01

There is a recognized need for valid risk assessment tools for use by both dental and nondental personnel to identify young children at risk for, or with, precavitated stages of early childhood caries (i.e., early stage decalcifications or white spot lesions).The aim of this study is to establish concurrent criterion validity of "MySmileBuddy" (MSB), a novel technology-assisted ECC risk assessment and behavioral intervention tool against four measures of ECC activity: semi-quantitative assays of salivary mutans streptococci levels, visible quantity of dental plaque, visual evidence of enamel decalcifications, and cavitation status (none, ECC, severe ECC). One hundred eight children 2-6 years of age presenting to a pediatric dental clinic were recruited from a predominantly Spanish-speaking, low-income, urban population. All children received a comprehensive oral examination and saliva culture for assessment of ECC indicators. Their caregivers completed the iPad-based MSB assessment in its entirety (15-20 minutes). MSB calculated both diet and comprehensive ECC risk scores. Associations between all variables were determined using ordinal logistic regression. MSB diet risk scores were significantly positively associated with salivary mutans (P < 0.05), and approached significance with visible plaque levels (P < 0.1). MSB comprehensive risk scores were significantly associated with both oral mutans and visible plaque (P < 0.05). Neither was associated with visually evident decalcifications or cavitations. Findings suggest that MSB may have clinical utility as a valid risk assessment tool for identifying children with early precursors of cavitations but does not add value in identifying children with extant lesions. © 2015 American Association of Public Health Dentistry.

Assessing safety climate in acute hospital settings: a systematic review of the adequacy of the psychometric properties of survey measurement tools.

PubMed

Alsalem, Gheed; Bowie, Paul; Morrison, Jillian

2018-05-10

The perceived importance of safety culture in improving patient safety and its impact on patient outcomes has led to a growing interest in the assessment of safety climate in healthcare organizations; however, the rigour with which safety climate tools were developed and psychometrically tested was shown to be variable. This paper aims to identify and review questionnaire studies designed to measure safety climate in acute hospital settings, in order to assess the adequacy of reported psychometric properties of identified tools. A systematic review of published empirical literature was undertaken to examine sample characteristics and instrument details including safety climate dimensions, origin and theoretical basis, and extent of psychometric evaluation (content validity, criterion validity, construct validity and internal reliability). Five questionnaire tools, designed for general evaluation of safety climate in acute hospital settings, were included. Detailed inspection revealed ambiguity around concepts of safety culture and climate, safety climate dimensions and the methodological rigour associated with the design of these measures. Standard reporting of the psychometric properties of developed questionnaires was variable, although evidence of an improving trend in the quality of the reported psychometric properties of studies was noted. Evidence of the theoretical underpinnings of climate tools was limited, while a lack of clarity in the relationship between safety culture and patient outcome measures still exists. Evidence of the adequacy of the psychometric development of safety climate questionnaire tools is still limited. Research is necessary to resolve the controversies in the definitions and dimensions of safety culture and climate in healthcare and identify related inconsistencies. More importance should be given to the appropriate validation of safety climate questionnaires before extending their usage in healthcare contexts different from those in

Development of the Assessment of Burden of COPD tool: an integrated tool to measure the burden of COPD

PubMed Central

Slok, Annerika H M; in ’t Veen, Johannes C C M; Chavannes, Niels H; van der Molen, Thys; Rutten-van Mölken, Maureen P M H; Kerstjens, Huib A M; Salomé, Philippe L; Holverda, Sebastiaan; Dekhuijzen, PN Richard; Schuiten, Denise; Asijee, Guus M; van Schayck, Onno C P

2014-01-01

In deciding on the treatment plan for patients with chronic obstructive pulmonary disease (COPD), the burden of COPD as experienced by patients should be the core focus. It is therefore important for daily practice to develop a tool that can both assess the burden of COPD and facilitate communication with patients in clinical practice. This paper describes the development of an integrated tool to assess the burden of COPD in daily practice. A definition of the burden of COPD was formulated by a Dutch expert team. Interviews showed that patients and health-care providers agreed on this definition. We found no existing instruments that fully measured burden of disease according to this definition. However, the Clinical COPD Questionnaire meets most requirements, and was therefore used and adapted. The adapted questionnaire is called the Assessment of Burden of COPD (ABC) scale. In addition, the ABC tool was developed, of which the ABC scale is the core part. The ABC tool is a computer program with an algorithm that visualises outcomes and provides treatment advice. The next step in the development of the tool is to test the validity and effectiveness of both the ABC scale and tool in daily practice. PMID:25010353

Validation of Version 3.0 of the Breast Cancer Genetics Referral Screening Tool (B-RST™).

PubMed

Bellcross, Cecelia; Hermstad, April; Tallo, Christine; Stanislaw, Christine

2018-05-08

Despite increased awareness of hereditary breast and ovarian cancer among clinicians and the public, many BRCA1/2 mutation carriers remain unaware of their risk status. The Breast Cancer Genetics Referral Screening Tool (B-RST™) was created and validated to easily identify individuals at increased risk for hereditary breast and ovarian cancer for referral to cancer genetics services. The purpose of this study was to revise B-RST™ to maximize sensitivity against BRCA1/2 mutation status. We analyzed pedigrees of 277 individuals who had undergone BRCA1/2 testing to determine modifications to the B-RST™ 2.0 algorithm that would maximize sensitivity for mutations, while maintaining simplicity. We used McNemar's chi-square test to compare validation measures between the revised version (3.0) and the 2.0 version. Algorithmic changes made to B-RST™ 2.0 increased the sensitivity against BRCA1/2 mutation analysis from 71.1 to 94.0% (P < 0.0001). While specificity decreased, all screen-positive individuals were appropriate for cancer genetics referral, the primary purpose of the tool. Despite calls for BRCA1/2 population screening, there remains a critical need to identify those most at risk who should receive cancer genetics services. B-RST™ version 3.0 demonstrates high sensitivity for BRCA1/2 mutations, yet remains a simple and quick screening tool for at-risk individuals.

Validation of a screening tool for attention and executive functions (EpiTrack Junior) in children and adolescents with absence epilepsy.

PubMed

Kadish, Navah Ester; Baumann, Matthias; Pietz, Joachim; Schubert-Bast, Susanne; Reuner, Gitta

2013-10-01

Our prospective study aimed at the validation of EpiTrack Junior, a neuropsychological screening tool for attention and executive functions in children with epilepsy. Twenty-two children with absence epilepsy aged 8-17 years underwent comprehensive neuropsychological evaluation including EpiTrack Junior and measures of intelligence, verbal and nonverbal memory, word fluency and visuoconstructive organization. Concurrent and discriminant validity of EpiTrack Junior subtests and total score as well as sensitivity and specificity of the total score were analyzed. EpiTrack Junior total score was impaired in 59% of participants. Concurrent validity was demonstrated in 4/6 subtests and for the total score. Discriminant validity was shown with respect to verbal and nonverbal long-term memory. Sensitivity was higher than specificity and highest for the "working memory index". EpiTrack Junior is recommended as a sensitive and time-efficient screening tool for attention and executive functions in children with epilepsy. Impaired results should be followed up with detailed evaluation including information from the parents and school as well as counseling where indicated. © 2013.

Evacuation performance evaluation tool.

PubMed

Farra, Sharon; Miller, Elaine T; Gneuhs, Matthew; Timm, Nathan; Li, Gengxin; Simon, Ashley; Brady, Whittney

2016-01-01

Hospitals conduct evacuation exercises to improve performance during emergency events. An essential aspect in this process is the creation of reliable and valid evaluation tools. The objective of this article is to describe the development and implications of a disaster evacuation performance tool that measures one portion of the very complex process of evacuation. Through the application of the Delphi technique and DeVellis's framework, disaster and neonatal experts provided input in developing this performance evaluation tool. Following development, content validity and reliability of this tool were assessed. Large pediatric hospital and medical center in the Midwest. The tool was pilot tested with an administrative, medical, and nursing leadership group and then implemented with a group of 68 healthcare workers during a disaster exercise of a neonatal intensive care unit (NICU). The tool has demonstrated high content validity with a scale validity index of 0.979 and inter-rater reliability G coefficient (0.984, 95% CI: 0.948-0.9952). The Delphi process based on the conceptual framework of DeVellis yielded a psychometrically sound evacuation performance evaluation tool for a NICU.

Verification and Validation Strategy for LWRS Tools

DOE Office of Scientific and Technical Information (OSTI.GOV)

Carl M. Stoots; Richard R. Schultz; Hans D. Gougar

2012-09-01

One intension of the Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program is to create advanced computational tools for safety assessment that enable more accurate representation of a nuclear power plant safety margin. These tools are to be used to study the unique issues posed by lifetime extension and relicensing of the existing operating fleet of nuclear power plants well beyond their first license extension period. The extent to which new computational models / codes such as RELAP-7 can be used for reactor licensing / relicensing activities depends mainly upon the thoroughness with which they have been verifiedmore » and validated (V&V). This document outlines the LWRS program strategy by which RELAP-7 code V&V planning is to be accomplished. From the perspective of developing and applying thermal-hydraulic and reactivity-specific models to reactor systems, the US Nuclear Regulatory Commission (NRC) Regulatory Guide 1.203 gives key guidance to numeric model developers and those tasked with the validation of numeric models. By creating Regulatory Guide 1.203 the NRC defined a framework for development, assessment, and approval of transient and accident analysis methods. As a result, this methodology is very relevant and is recommended as the path forward for RELAP-7 V&V. However, the unique issues posed by lifetime extension will require considerations in addition to those addressed in Regulatory Guide 1.203. Some of these include prioritization of which plants / designs should be studied first, coupling modern supporting experiments to the stringent needs of new high fidelity models / codes, and scaling of aging effects.« less

Making and Executing Decisions for Safe and Independent Living (MED-SAIL): Development and Validation of a Brief Screening Tool

PubMed Central

Mills, Whitney L.; Regev, Tziona; Kunik, Mark E.; Wilson, Nancy L.; Moye, Jennifer; McCullough, Laurence B.; Naik, Aanand D.

2017-01-01

Objectives Older adults prefer to remain in their own homes for as long as possible. The purpose of this article is to describe the development and preliminary validation of Making and Executing Decisions for Safe and Independent Living (MED-SAIL), a brief screening tool for capacity to live safely and independently in the community. Design Prospective preliminary validation study. Setting Outpatient geriatrics clinic located in a community-based hospital. Participants Forty-nine community-dwelling older adults referred to the clinic for a comprehensive capacity assessment. Measurements We examined internal consistency, criterion-based validity, concurrent validity, and accuracy of classification for MED-SAIL. Results The items included in MED-SAIL demonstrated internal consistency (5 items; α = 0.85). MED-SAIL was significantly correlated with the Independent Living Scales (r = 0.573, p ≤ 0.001) and instrumental activities of daily living (r = 0.440, p ≤ 0.01). The Mann-Whitney U test revealed significant differences between the no capacity and partial/full capacity classifications on MED-SAIL (U(48) = 60.5, Z = −0.38, p <0.0001). The area under the curve was 0.864 (95% confidence interval: 0.84–0.99). Conclusions This study demonstrated the validity of MED-SAIL as a brief screening tool to identify older adults with impaired capacity for remaining safe and independent in their current living environment. MED-SAIL is useful tool for health and social service providers in the community for the purpose of referral for definitive capacity evaluation. PMID:23567420

The Validity and Reliability of an iPhone App for Measuring Running Mechanics.

PubMed

Balsalobre-Fernández, Carlos; Agopyan, Hovannes; Morin, Jean-Benoit

2017-07-01

The purpose of this investigation was to analyze the validity of an iPhone application (Runmatic) for measuring running mechanics. To do this, 96 steps from 12 different runs at speeds ranging from 2.77-5.55 m·s -1 were recorded simultaneously with Runmatic, as well as with an opto-electronic device installed on a motorized treadmill to measure the contact and aerial time of each step. Additionally, several running mechanics variables were calculated using the contact and aerial times measured, and previously validated equations. Several statistics were computed to test the validity and reliability of Runmatic in comparison with the opto-electronic device for the measurement of contact time, aerial time, vertical oscillation, leg stiffness, maximum relative force, and step frequency. The running mechanics values obtained with both the app and the opto-electronic device showed a high degree of correlation (r = .94-.99, p < .001). Moreover, there was very close agreement between instruments as revealed by the ICC (2,1) (ICC = 0.965-0.991). Finally, both Runmatic and the opto-electronic device showed almost identical reliability levels when measuring each set of 8 steps for every run recorded. In conclusion, Runmatic has been proven to be a highly reliable tool for measuring the running mechanics studied in this work.

Validating an Agency-based Tool for Measuring Women's Empowerment in a Complex Public Health Trial in Rural Nepal.

PubMed

Gram, Lu; Morrison, Joanna; Sharma, Neha; Shrestha, Bhim; Manandhar, Dharma; Costello, Anthony; Saville, Naomi; Skordis-Worrall, Jolene

2017-01-02

Despite the rising popularity of indicators of women's empowerment in global development programmes, little work has been done on the validity of existing measures of such a complex concept. We present a mixed methods validation of the use of the Relative Autonomy Index for measuring Amartya Sen's notion of agency freedom in rural Nepal. Analysis of think-aloud interviews ( n  = 7) indicated adequate respondent understanding of questionnaire items, but multiple problems of interpretation including difficulties with the four-point Likert scale, questionnaire item ambiguity and difficulties with translation. Exploratory Factor Analysis of a calibration sample ( n  = 511) suggested two positively correlated factors ( r  = 0.64) loading on internally and externally motivated behaviour. Both factors increased with decreasing education and decision-making power on large expenditures and food preparation. Confirmatory Factor Analysis on a validation sample ( n  = 509) revealed good fit (Root Mean Square Error of Approximation 0.05-0.08, Comparative Fit Index 0.91-0.99). In conclusion, we caution against uncritical use of agency-based quantification of women's empowerment. While qualitative and quantitative analysis revealed overall satisfactory construct and content validity, the positive correlation between external and internal motivations suggests the existence of adaptive preferences. High scores on internally motivated behaviour may reflect internalized oppression rather than agency freedom.

Validation of the National Aeronautics and Space Administration Task Load Index as a tool to evaluate-the learning curve for endoscopy training

PubMed Central

Mohamed, Rachid; Raman, Maitreyi; Anderson, John; McLaughlin, Kevin; Rostom, Alaa; Coderre, Sylvain

2014-01-01

BACKGROUND: Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking. OBJECTIVE: To validate such a workload tool and use it to map the progression of novice trainees in gastroenterology in performing their first endoscopies. METHODS: The National Aeronautics and Space Administration Task Load Index (NASA-TLX) workload assessment tool was completed by eight novice trainees in gastroenterology and 10 practicing gastroenterologists/surgeons. An exploratory factor analysis was performed to construct a streamlined endoscopy-specific task load index, which was subsequently validated. The ‘Endoscopy Task Load Index’ was used to monitor progression of trainee exertion and self-assessed performance over their first 40 procedures. RESULTS: From the factor analysis of the NASA-TLX, two principal components emerged: a measure of exertion and a measure of self-efficacy. These items became the components of the newly validated Endoscopy Task Load Index. There was a steady decline in self-perceived exertion over the training period, which was more rapid for gastroscopy than colonoscopy. The self-efficacy scores for gastroscopy rapidly increased over the first few procedures, reaching a plateau after this period of time. For colonoscopy, there was a progressive increase in reported self-efficacy over the first three quartiles of procedures, followed by a drop in self-efficacy scores over the final quartile. DISCUSSION: The present study validated an Endoscopy Task Load Index that can be completed in <1 min. Practical implications of such a tool in endoscopy education include identifying periods of higher perceived exertion among novice endoscopists, facilitating appropriate levels of guidance from trainers. PMID:24619638

Reliability and validity of the Pragmatics Observational Measure (POM): a new observational measure of pragmatic language for children.

PubMed

Cordier, Reinie; Munro, Natalie; Wilkes-Gillan, Sarah; Speyer, Renée; Pearce, Wendy M

2014-07-01

There is a need for a reliable and valid assessment of childhood pragmatic language skills during peer-peer interactions. This study aimed to evaluate the psychometric properties of a newly developed pragmatic assessment, the Pragmatic Observational Measure (POM). The psychometric properties of the POM were investigated from observational data of two studies - study 1 involved 342 children aged 5-11 years (108 children with ADHD; 108 typically developing playmates; 126 children in the control group), and study 2 involved 9 children with ADHD who attended a 7-week play-based intervention. The psychometric properties of the POM were determined based on the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) taxonomy of psychometric properties and definitions for health-related outcomes; the Pragmatic Protocol was used as the reference tool against which the POM was evaluated. The POM demonstrated sound psychometric properties in all the reliability, validity and interpretability criteria against which it was assessed. The findings showed that the POM is a reliable and valid measure of pragmatic language skills of children with ADHD between the age of 5 and 11 years and has clinical utility in identifying children with pragmatic language difficulty. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

The development and validation of an instrument to measure the quality of health research reports in the lay media.

PubMed

Zeraatkar, Dena; Obeda, Michael; Ginsberg, Jeffrey S; Hirsh, Jack

2017-04-20

The media serves as an important link between medical research, as reported in scholarly sources, and the public and has the potential to act as a powerful tool to improve public health. However, concerns about the reliability of health research reports have been raised. Tools to monitor the quality of health research reporting in the media are needed to identify areas of weakness in health research reporting and to subsequently work towards the efficient use of the lay media as a public health tool through which the public's health behaviors can be improved. We developed the Quality Index for health-related Media Reports (QIMR) as a tool to monitor the quality of health research reports in the lay media. The tool was developed according to themes generated from interviews with health journalists and researchers. Item and domain characteristics and scale reliability were assessed. The scale was correlated with a global quality assessment score and media report word count to provide evidence towards its construct validity. The items and domains of the QIMR demonstrated acceptable validity and reliability. Items from the 'validity' domain were negatively skewed, suggesting possible floor effect. These items were not eliminated due to acceptable content and face validity. QIMR total scores produced a strong correlation with raters' global assessment and a moderate correlation with media report word count, providing evidence towards the construct validity of the instrument. The results of this investigation indicate that QIMR can adequately measure the quality of health research reports, with acceptable reliability and validity.

A validated search assessment tool: assessing practice-based learning and improvement in a residency program.

PubMed

Rana, Gurpreet K; Bradley, Doreen R; Hamstra, Stanley J; Ross, Paula T; Schumacher, Robert E; Frohna, John G; Haftel, Hilary M; Lypson, Monica L

2011-01-01

The objective of this study was to validate an assessment instrument for MEDLINE search strategies at an academic medical center. Two approaches were used to investigate if the search assessment tool could capture performance differences in search strategy construction. First, data from an evaluation of MEDLINE searches from a pediatric resident's longitudinal assessment were investigated. Second, a cross-section of search strategies from residents in one incoming class was compared with strategies of residents graduating a year later. MEDLINE search strategies formulated by faculty who had been identified as having search expertise were used as a gold standard comparison. Participants were presented with a clinical scenario and asked to identify the search question and conduct a MEDLINE search. Two librarians rated the blinded search strategies. Search strategy scores were significantly higher for residents who received training than the comparison group with no training. There was no significant difference in search strategy scores between senior residents who received training and faculty experts. The results provide evidence for the validity of the instrument to evaluate MEDLINE search strategies. This assessment tool can measure improvements in information-seeking skills and provide data to fulfill Accreditation Council for Graduate Medical Education competencies.

Body Dysmorphic Disorder in aesthetic rhinoplasty: Validating a new screening tool.

PubMed

Lekakis, Garyfalia; Picavet, Valerie A; Gabriëls, Loes; Grietens, Jente; Hellings, Peter W

2016-08-01

To validate a new screening tool for body dysmorphic disorder (BDD) in patients seeking aesthetic rhinoplasty. We performed a prospective instrument validation study in an academic rhinology clinic. The Body Dysmorphic Disorder Questionnaire-Aesthetic Surgery (BDDQ-AS) is a seven-item short questionnaire validated in 116 patients undergoing aesthetic rhinoplasty. Screening was positive if the patient acknowledged on the BDDQ-AS that he/she was concerned about their appearance (question 1 = yes) AND preoccupied with these concerns (question 2 = yes) AND that these concerns caused at least moderate distress or impairment in different domains of daily life (question 3 or 4 or 5 or 6 ≥ 3 or question 7 = yes). Construct validity was assessed by comparing the BDDQ-AS to the Sheehan Disability Scale and the Derriford Appearance Scale-59. To determine concurrent validity, the BDDQ-AS was compared to the Yale-Brown Obsessive Compulsive Scale Modified for BDD. Finally, the predictive value of the BDDQ-AS on satisfaction 12 months after rhinoplasty was evaluated using a visual analogue scale and the Rhinoplasty Outcome Evaluation. Reliability of the BDDQ-AS was adequate, with Cronbach alpha = .83 for rhinoplasty patients and .84 for controls. Sensitivity was 89.6% and specificity 81.4%. BDDQ-AS-positive patients (n = 55) were more impaired in daily life and experienced more appearance-related distress and dysfunction compared to BDDQ-AS-negative patients. Moreover, they had more severe BDD symptoms. Finally, BDDQ-AS-positive patients were less satisfied after surgery compared to BDDQ-AS-negative patients. We hereby validated a new screening tool for BDD in an aesthetic rhinoplasty population. 3b. Laryngoscope, 126:1739-1745, 2016. © 2016 The American Laryngological, Rhinological and Otological Society, Inc.

Validity and measurement precision of the PROMIS physical function item bank and a content validity-driven 20-item short form in rheumatoid arthritis compared with traditional measures.

PubMed

Oude Voshaar, Martijn A H; Ten Klooster, Peter M; Glas, Cees A W; Vonkeman, Harald E; Taal, Erik; Krishnan, Eswar; Bernelot Moens, Hein J; Boers, Maarten; Terwee, Caroline B; van Riel, Piet L C M; van de Laar, Mart A F J

2015-12-01

To evaluate the content validity and measurement properties of the Patient-Reported Outcome Measurement Information System (PROMIS) physical function item bank and a 20-item short form in patients with RA in comparison with the HAQ disability index (HAQ-DI) and 36-item Short Form Health Survey (SF-36) physical functioning scale (PF-10). The content validity of the instruments was evaluated by linking their items to the International Classification of Functioning, Disability and Health (ICF) core set for RA. The measures were administered to 690 RA patients enrolled in the Dutch Rheumatoid Arthritis Monitoring registry. Measurement precision was evaluated using item response theory methods and construct validity was evaluated by correlating physical function scores with other clinical and patient-reported outcome measures. All 207 health concepts identified in the physical function measures referred to activities that are featured in the ICF. Twenty-three of 26 ICF RA core set domains are featured in the full PROMIS physical function item bank compared with 13 and 8 for the HAQ-DI and PF-10, respectively. As hypothesized, all three physical function instruments were highly intercorrelated (r 0.74-0.84), moderately correlated with disease activity measures (r 0.44-0.63) and weakly correlated with age (rs 0.07-0.14). Item response theory-based analysis revealed that a 20-item PROMIS physical function short form covered a wider range of physical function levels than the HAQ-DI or PF-10. The PROMIS physical function item bank demonstrated excellent measurement properties in RA. A content-driven 20-item short form may be a useful tool for assessing physical function in RA. © The Author 2015. Published by Oxford University Press on behalf of the British Society for Rheumatology. All rights reserved. For Permissions, please email: journals.permissions@oup.com.

Development and validation of a risk assessment tool for gastric cancer in a general Japanese population.

PubMed

Iida, Masahiro; Ikeda, Fumie; Hata, Jun; Hirakawa, Yoichiro; Ohara, Tomoyuki; Mukai, Naoko; Yoshida, Daigo; Yonemoto, Koji; Esaki, Motohiro; Kitazono, Takanari; Kiyohara, Yutaka; Ninomiya, Toshiharu

2018-05-01

There have been very few reports of risk score models for the development of gastric cancer. The aim of this study was to develop and validate a risk assessment tool for discerning future gastric cancer risk in Japanese. A total of 2444 subjects aged 40 years or over were followed up for 14 years from 1988 (derivation cohort), and 3204 subjects of the same age group were followed up for 5 years from 2002 (validation cohort). The weighting (risk score) of each risk factor for predicting future gastric cancer in the risk assessment tool was determined based on the coefficients of a Cox proportional hazards model in the derivation cohort. The goodness of fit of the established risk assessment tool was assessed using the c-statistic and the Hosmer-Lemeshow test in the validation cohort. During the follow-up, gastric cancer developed in 90 subjects in the derivation cohort and 35 subjects in the validation cohort. In the derivation cohort, the risk prediction model for gastric cancer was established using significant risk factors: age, sex, the combination of Helicobacter pylori antibody and pepsinogen status, hemoglobin A1c level, and smoking status. The incidence of gastric cancer increased significantly as the sum of risk scores increased (P trend < 0.001). The risk assessment tool was validated internally and showed good discrimination (c-statistic = 0.76) and calibration (Hosmer-Lemeshow test P = 0.43) in the validation cohort. We developed a risk assessment tool for gastric cancer that provides a useful guide for stratifying an individual's risk of future gastric cancer.

Design and validation of instruments to measure knowledge.

PubMed

Elliott, T E; Regal, R R; Elliott, B A; Renier, C M

2001-01-01

Measuring health care providers' learning after they have participated in educational interventions that use experimental designs requires valid, reliable, and practical instruments. A literature review was conducted. In addition, experience gained from designing and validating instruments for measuring the effect of an educational intervention informed this process. The eight main steps for designing, validating, and testing the reliability of instruments for measuring learning outcomes are presented. The key considerations and rationale for this process are discussed. Methods for critiquing and adapting existent instruments and creating new ones are offered. This study may help other investigators in developing valid, reliable, and practical instruments for measuring the outcomes of educational activities.

Measuring Adverse Events in Helicopter Emergency Medical Services: Establishing Content Validity

PubMed Central

Patterson, P. Daniel; Lave, Judith R.; Martin-Gill, Christian; Weaver, Matthew D.; Wadas, Richard J.; Arnold, Robert M.; Roth, Ronald N.; Mosesso, Vincent N.; Guyette, Francis X.; Rittenberger, Jon C.; Yealy, Donald M.

2015-01-01

Introduction We sought to create a valid framework for detecting Adverse Events (AEs) in the high-risk setting of Helicopter Emergency Medical Services (HEMS). Methods We assembled a panel of 10 expert clinicians (n=6 emergency medicine physicians and n=4 prehospital nurses and flight paramedics) affiliated with a large multi-state HEMS organization in the Northeast U.S. We used a modified Delphi technique to develop a framework for detecting AEs associated with the treatment of critically ill or injured patients. We used a widely applied measure, the Content Validity Index (CVI), to quantify the validity of the framework’s content. Results The expert panel of 10 clinicians reached consensus on a common AE definition and four-step protocol/process for AE detection in HEMS. The consensus-based framework is composed of three main components: 1) a trigger tool, 2) a method for rating proximal cause, and 3) a method for rating AE severity. The CVI findings isolate components of the framework considered content valid. Conclusions We demonstrate a standardized process for the development of a content valid framework for AE detection. The framework is a model for the development of a method for AE identification in other settings, including ground-based EMS. PMID:24003951

Assessing functional mobility in survivors of lower-extremity sarcoma: reliability and validity of a new assessment tool.

PubMed

Marchese, Victoria G; Rai, Shesh N; Carlson, Claire A; Hinds, Pamela S; Spearing, Elena M; Zhang, Lijun; Callaway, Lulie; Neel, Michael D; Rao, Bhaskar N; Ginsberg, Jill P

2007-08-01

Reliability and validity of a new tool, Functional Mobility Assessment (FMA), were examined in patients with lower-extremity sarcoma. FMA requires the patients to physically perform the functional mobility measures, unlike patient self-report or clinician administered measures. A sample of 114 subjects participated, 20 healthy volunteers and 94 patients with lower-extremity sarcoma after amputation, limb-sparing, or rotationplasty surgery. Reliability of the FMA was examined by three raters testing 20 healthy volunteers and 23 subjects with lower-extremity sarcoma. Concurrent validity was examined using data from 94 subjects with lower-extremity sarcoma who completed the FMA, Musculoskeletal Tumor Society (MSTS), Short-Form 36 (SF-36v2), and Toronto Extremity Salvage Scale (TESS) scores. Construct validity was measured by the ability of the FMA to discriminate between subjects with and without functional mobility deficits. FMA demonstrated excellent reliability (ICC [2,1] >or=0.97). Moderate correlations were found between FMA and SF-36v2 (r = 0.60, P < 0.01), FMA and MSTS (r = 0.68, P < 0.01), and FMA and TESS (r = 0.62, P < 0.01). The patients with lower-extremity sarcoma scored lower on the FMA as compared to healthy controls (P < 0.01). The FMA is a reliable and valid functional outcome measure for patients with lower-extremity sarcoma. This study supports the ability of the FMA to discriminate between patients with varying functional abilities and supports the need to include measures of objective functional mobility in examination of patients with lower-extremity sarcoma.

Development and validation of a questionnaire to measure moral distress in community pharmacists.

PubMed

Astbury, Jayne L; Gallagher, Cathal T

2017-02-01

Background Pharmacists work within a highly-regulated occupational sphere, and are bound by strict legal frameworks and codes of professional conduct. This regulatory environment creates the potential for moral distress to occur due to the limitations it places on acting in congruence with moral judgements. Very little research regarding this phenomenon has been undertaken in pharmacy: thus, prominent research gaps have arisen for the development of a robust tool to measure and quantify moral distress experienced in the profession. Objective The aim of this study was to develop an instrument to measure moral distress in community pharmacists. Setting Community pharmacies in the United Kingdom. Method This study adopted a three-phase exploratory sequential mixed-method design. Three semi-structured focus groups were then conducted to allow pharmacists to identify and explore scenarios that cause moral distress. Each of the identified scenarios were developed into a statement, which was paired with twin seven-point Likert scales to measure the frequency and intensity of the distress, respectively. Content validity, reliability, and construct validity were all tested, and the questionnaire was refined. Main outcome measure The successful development of the valid instrument for use in the United Kingdom. Results This research has led to the development of a valid and reliable instrument to measure moral distress in community pharmacists in the UK. The questionnaire has already been distributed to a large sample of community pharmacists. Conclusion Results from this distribution will be used to inform the formulation of coping strategies for dealing with moral distress.

Validity of a Measure of Assertiveness

ERIC Educational Resources Information Center

Galassi, John P.; Galassi, Merna D.

1974-01-01

This study was concerned with further validation of a measure of assertiveness. Concurrent validity was established for the College Self-Expression Scale using the method of contrasted groups and through correlations of self-and judges' ratings of assertiveness. (Author)

The ecological and construct validity of a newly developed measure of executive function: the Virtual Library Task.

PubMed

Renison, Belinda; Ponsford, Jennie; Testa, Renee; Richardson, Barry; Brownfield, Kylie

2012-05-01

Virtual reality (VR) assessment paradigms have the potential to address the limited ecological validity of pen and paper measures of executive function (EF) and the pragmatic and reliability issues associated with functional measures. To investigate the ecological validity and construct validity of a newly developed VR measure of EF, the Virtual Library Task (VLT); a real life analogous task--the Real Library Task (RLT); and five neuropsychological measures of EF were administered to 30 patients with traumatic brain injury (TBI) and 30 healthy Controls. Significant others for each participant also completed the Dysexecutive Questionnaire (DEX), which is a behavioral rating scale of everyday EF. Performances on the VLT and the RLT were significantly positively correlated indicating that VR performance is similar to real world performance. The TBI group performed significantly worse than the Control group on the VLT and the Modified Six Elements Test (MSET) but the other four neuropsychological measures of EF failed to differentiate the groups. Both the MSET and the VLT significantly predicted everyday EF suggesting that they are both ecologically valid tools for the assessment of EF. The VLT has the advantage over the MSET of providing objective measurement of individual components of EF.

Developing a Tool for Measuring the Decision-Making Competence of Older Adults

PubMed Central

Finucane, Melissa L.; Gullion, Christina M.

2010-01-01

The authors evaluated the reliability and validity of a tool for measuring older adults’ decision-making competence (DMC). Two-hundred-five younger adults (25-45 years), 208 young-older adults (65-74 years), and 198 old-older adults (75-97 years) made judgments and decisions related to health, finance, and nutrition. Reliable indices of comprehension, dimension weighting, and cognitive reflection were developed. Unlike previous research, the authors were able to compare old-older with young-older adults’ performance. As hypothesized, old-older adults performed more poorly than young-older adults; both groups of older adults performed more poorly than younger adults. Hierarchical regression analyses showed that a large amount of variance in decision performance across age groups (including mean trends) could be accounted for by social variables, health measures, basic cognitive skills, attitudinal measures, and numeracy. Structural equation modeling revealed significant pathways from three exogenous latent factors (crystallized intelligence, other cognitive abilities, and age) to the endogenous DMC latent factor. Further research is needed to validate the meaning of performance on these tasks for real-life decision making. PMID:20545413

Measuring Quality of Care in Community Mental Health: Validation of Concordant Clinician and Client Quality-of-Care Scales.

PubMed

Luther, Lauren; Fukui, Sadaaki; Garabrant, Jennifer M; Rollins, Angela L; Morse, Gary; Henry, Nancy; Shimp, Dawn; Gearhart, Timothy; Salyers, Michelle P

2018-04-12

Measuring quality of care can transform care, but few tools exist to measure quality from the client's perspective. The aim of this study was to create concordant clinician and client self-report quality-of-care scales in a sample of community mental health clinicians (n = 189) and clients (n = 469). The client scale had three distinct factors (Person-Centered Care, Negative Staff Interactions, and Inattentive Care), while the clinician scale had two: Person-Centered Care and Discordant Care. Both versions demonstrated adequate internal consistency and validity with measures related to satisfaction and the therapeutic relationship. These measures are promising, brief quality assessment tools.

Measuring psychosocial exposures: validation of the Persian of the copenhagen psychosocial questionnaire (COPSOQ)

PubMed Central

Pournik, Omid; Ghalichi, Leila; TehraniYazdi, Alireza; Tabatabaee, Seyed Mohammad; Ghaffari, Mostafa; Vingard, Eva

2015-01-01

Background: The effect of psychosocial work environment on personal and organizational aspects of employees is well-known; and it is of fundamental importance to have valid tools to evaluate them. This study aims to evaluate the reliability and validity of the Persian version of Copenhagen Psychosocial Questionnaire (COPSOQ). Methods: The questionnaire was translated into Persian and then back translated into English by two translators separately. The wording of the final Persian version was established by comparing the translated versions with the original questionnaire. One hundred three health care workers completed the questionnaire. Chronbach’s alpha was calculated, and factor analysis was performed. Results: Factor analysis revealed acceptable validity for the five contexts of the questionnaire. Cronbach’s alpha ranged from 0.73 to 0.82 in different contexts. Conclusion: This study revealed that the Persian version of COPSOQ is a reliable and valid instrument for measuring psychosocial factors at work. PMID:26478879

Validation of the Virtual MET as an assessment tool for executive functions.

PubMed

Rand, Debbie; Basha-Abu Rukan, Soraya; Weiss, Patrice L Tamar; Katz, Noomi

2009-08-01

The purpose of this study was to establish ecological validity and initial construct validity of a Virtual Multiple Errands Test (VMET) as an assessment tool for executive functions. It was implemented within the Virtual Mall (VMall), a novel functional video-capture virtual shopping environment. The main objectives were (1) to examine the relationships between the performance of three groups of participants in the Multiple Errands Test (MET) carried out in a real shopping mall and their performance in the VMET, (2) to assess the relationships between the MET and VMET of the post-stroke participant's level of executive functioning and independence in instrumental activities of daily living, and (3) to compare the performance of post-stroke participants to those of healthy young and older controls in both the MET and VMET. The study population included three groups; post-stroke participants (n = 9), healthy young participants (n = 20), and healthy older participants (n = 20). The VMET was able to differentiate between two age groups of healthy participants and between healthy and post-stroke participants thus demonstrating that it is sensitive to brain injury and ageing and supports construct validity between known groups. In addition, significant correlations were found between the MET and the VMET for both the post-stroke participants and older healthy participants. This provides initial support for the ecological validity of the VMET as an assessment tool of executive functions. However, further psychometric data on temporal stability are needed, namely test-retest reliability and responsiveness, before it is ready for clinical application. Further research using the VMET as an assessment tool within the VMall with larger groups and in additional populations is also recommended.

The Mayo Dysphagia Questionnaire-30: documentation of reliability and validity of a tool for interventional trials in adults with esophageal disease.

PubMed

McElhiney, Judith; Lohse, Matthew R; Arora, Amindra S; Peloquin, Joanna M; Geno, Debra M; Kuntz, Melissa M; Enders, Felicity B; Fredericksen, Mary; Abdalla, Adil A; Khan, Yulia; Talley, Nicholas J; Diehl, Nancy N; Beebe, Timothy J; Harris, Ann M; Farrugia, Gianrico; Graner, Darlene E; Murray, Joseph A; Locke, G Richard; Grothe, Rayna M; Crowell, Michael D; Francis, Dawn L; Grudell, April M B; Dabade, Tushar; Ramirez, Angelica; Alkhatib, MhdMaan; Alexander, Jeffrey A; Kimber, Jessica; Prasad, Ganapathy; Zinsmeister, Alan R; Romero, Yvonne

2010-09-01

The aim of this study was to develop the Mayo Dysphagia Questionnaire-30 Day (MDQ-30), a tool to measure esophageal dysphagia, by adapting items from validated instruments for use in clinical trials, and assess its feasibility, reproducibility, and concurrent validity. Outpatients referred to endoscopy for dysphagia or seen in a specialty clinic were recruited. Feasibility testing was done to identify problematic items. Reproducibility was measured by test-retest format. Concurrent validity reflects agreement between information gathered in a structured interview versus the patients' written responses. The MDQ-30, a 28-item instrument, took 10 min (range = 5-30 min) to complete. Four hundred thirty-one outpatients [210 (49%) men; mean age = 61 years] participated. Overall, most concurrent validity kappa values for dysphagia were very good to excellent with a median of 0.78 (min 0.28, max 0.95). The majority of reproducibility kappa values for dysphagia were moderate to excellent with a median kappa value of 0.66 (min 0.07, max 1.0). Overall, concurrent validity and reproducibility kappa values for gastroesophageal reflux disease (GERD) symptoms were 0.81 (95% CI = 0.72, 0.91) and 0.66 (95% CI = 0.55, 0.77), respectively. Individual item percent agreement was generally very good to excellent. Internal consistency was excellent. We conclude that the MDQ-30 is an easy-to-complete tool to evaluate reliably dysphagia symptoms over the last 30 days.

Vegetable behavioral tool demonstrates validity with MyPlate vegetable cups and carotenoid and inflammatory biomarkers.

PubMed

Townsend, Marilyn S; Shilts, Mical K; Styne, Dennis M; Drake, Christiana; Lanoue, Louise; Woodhouse, Leslie; Allen, Lindsay H

2016-12-01

Young children are not meeting recommendations for vegetable intake. Our objective is to provide evidence of validity and reliability for a pictorial vegetable behavioral assessment for use by federally funded community nutrition programs. Parent/child pairs (n=133) from Head Start and the Special Supplemental Nutrition Program for Women, Infants and Children [WIC] provided parent-administered vegetable tools, three child 24-hour diet recalls, child blood sample and measured heights/weights. The 10-item Focus on Veggies scale, with an alpha of .83 and a stability reliability coefficient of .74, was positively related to vegetables in cup equivalents [p≤.05]; dietary intakes of folate, vitamin C, β-carotene, potassium and magnesium [p≤.05-.01]; and soluble fiber [p≤.001]. The child vegetable scores were related to the parent's mediators [p≤.00001] and vegetable behaviors [p≤.00001]. Children's plasma inflammatory markers were negatively related to the 10 item scale [p≤.05] and are indicators of the child's health status. The positive relationship between the serum carotenoid index and a sub-scale of child vegetable behaviors offered additional support for criterion validity [p≤.05]. Finally, the inverse relationship of BMI-for-age percentile one year post baseline and a sub-scale of child vegetable behaviors supported the predictive validity [p≤.05]. Focus on Veggies, a simple assessment tool, can inform practitioners about the child's health status. A child with a high score, shows a healthful profile with a lower inflammation index, higher carotenoid index, lower BMI and higher vegetable intake. In conclusion, validity of Focus on Veggies has been demonstrated using vegetable cup equivalents and micronutrient intakes, anthropometry and blood biomarkers. Copyright © 2016 Elsevier Ltd. All rights reserved.

Healthcare provider cultural competency: development and initial validation of a patient report measure.

PubMed

Lucas, Todd; Michalopoulou, Georgia; Falzarano, Pamela; Menon, Shanti; Cunningham, Windy

2008-03-01

Health researchers have proposed that provider cultural competency may contribute to health disparities. Yet, this belief continues to lack empirical support, and this is due in part to measurement issues that have plagued the cultural competency construct. In the present research, we report on the development of a theoretically grounded, generally applicable, and patient report measure of provider cultural competency. Samples of predominantly African American patients (N=310) were recruited from three urban medical clinics to complete a survey about their relationship with their physician. We examined the factor structure, validity and other psychometric characteristics of a newly proposed patient report measure of provider cultural competency. Psychometric analyses supported a tripartite model of cultural competency that was comprised of patient judgments of their physician's cultural knowledge, awareness, and skill. In addition, this result was replicated across multiple clinical contexts, while also demonstrating convergent and incremental validity when correlated with measures of trust, satisfaction and discrimination. This newly proposed measure addresses prior limitations in cultural competency measurement and may enhance future research by providing a standardized tool for use in multiple clinical and cultural contexts. Copyright (c) 2008 APA, all rights reserved.

AdViSHE: A Validation-Assessment Tool of Health-Economic Models for Decision Makers and Model Users.

PubMed

Vemer, P; Corro Ramos, I; van Voorn, G A K; Al, M J; Feenstra, T L

2016-04-01

A trade-off exists between building confidence in health-economic (HE) decision models and the use of scarce resources. We aimed to create a practical tool providing model users with a structured view into the validation status of HE decision models, to address this trade-off. A Delphi panel was organized, and was completed by a workshop during an international conference. The proposed tool was constructed iteratively based on comments from, and the discussion amongst, panellists. During the Delphi process, comments were solicited on the importance and feasibility of possible validation techniques for modellers, their relevance for decision makers, and the overall structure and formulation in the tool. The panel consisted of 47 experts in HE modelling and HE decision making from various professional and international backgrounds. In addition, 50 discussants actively engaged in the discussion at the conference workshop and returned 19 questionnaires with additional comments. The final version consists of 13 items covering all relevant aspects of HE decision models: the conceptual model, the input data, the implemented software program, and the model outcomes. Assessment of the Validation Status of Health-Economic decision models (AdViSHE) is a validation-assessment tool in which model developers report in a systematic way both on validation efforts performed and on their outcomes. Subsequently, model users can establish whether confidence in the model is justified or whether additional validation efforts should be undertaken. In this way, AdViSHE enhances transparency of the validation status of HE models and supports efficient model validation.

Validation of hand and foot anatomical feature measurements from smartphone images

NASA Astrophysics Data System (ADS)

Amini, Mohammad; Vasefi, Fartash; MacKinnon, Nicholas

2018-02-01

A smartphone mobile medical application, previously presented as a tool for individuals with hand arthritis to assess and monitor the progress of their disease, has been modified and expanded to include extraction of anatomical features from the hand (joint/finger width, and angulation) and foot (length, width, big toe angle, and arch height index) from smartphone camera images. Image processing algorithms and automated measurements were validated by performing tests on digital hand models, rigid plastic hand models, and real human hands and feet to determine accuracy and reproducibility compared to conventional measurement tools such as calipers, rulers, and goniometers. The mobile application was able to provide finger joint width measurements with accuracy better than 0.34 (+/-0.25) millimeters. Joint angulation measurement accuracy was better than 0.50 (+/-0.45) degrees. The automatically calculated foot length accuracy was 1.20 (+/-1.27) millimeters and the foot width accuracy was 1.93 (+/-1.92) millimeters. Hallux valgus angle (used in assessing bunions) accuracy was 1.30 (+/-1.29) degrees. Arch height index (AHI) measurements had an accuracy of 0.02 (+/-0.01). Combined with in-app documentation of symptoms, treatment, and lifestyle factors, the anatomical feature measurements can be used by both healthcare professionals and manufacturers. Applications include: diagnosing hand osteoarthritis; providing custom finger splint measurements; providing compression glove measurements for burn and lymphedema patients; determining foot dimensions for custom shoe sizing, insoles, orthotics, or foot splints; and assessing arch height index and bunion treatment effectiveness.

Validation of the Italian version of the HSE Indicator Tool.

PubMed

Magnavita, N

2012-06-01

An Italian version of the Health & Safety Executive's (HSE) Management Standards Revised Indicator Tool (MS-RIT) has been used to monitor the working conditions that may lead to stress. To initially examine the factor structure of the Italian version of the MS-RIT, in comparison with the original UK tool, and to investigate its validity and reliability; second, to study the association between occupational stress and psychological distress. Workers from 17 companies self-completed the MS-RIT and the General Health Questionnaire used to measure the psychological distress while they waited for their periodic examination at the workplace. Factor analysis was employed to ascertain whether the Italian version maintained the original subdivision into seven scales. Odds ratios were calculated to estimate the risk of impairment associated with exposure to stress at the workplace. In total, 748 workers participated; the response rate was 91%. The factor structure of the Italian MS-RIT corresponded partially to the original UK version. The 'demand', 'control', 'role', ' relationship' and 'colleague-support' scales were equivalent to the UK ones. A principal factor, termed ' elasticity', incorporated the UK 'management-support' and 'change' scales. Reliability analysis of the sub-scales revealed Cronbach's alpha values ranging from 0.75 to 0.86. Our findings confirmed the usefulness of the Italian version of the HSE MS-RIT in stress control.

Validation of the tool assessment of clinical education (AssCE): A study using Delphi method and clinical experts.

PubMed

Löfmark, Anna; Mårtensson, Gunilla

2017-03-01

The aim of the present study was to establish the validity of the tool Assessment of Clinical Education (AssCE). The tool is widely used in Sweden and some Nordic countries for assessing nursing students' performance in clinical education. It is important that the tools in use be subjected to regular audit and critical reviews. The validation process, performed in two stages, was concluded with a high level of congruence. In the first stage, Delphi technique was used to elaborate the AssCE tool using a group of 35 clinical nurse lecturers. After three rounds, we reached consensus. In the second stage, a group of 46 clinical nurse lecturers representing 12 universities in Sweden and Norway audited the revised version of the AssCE in relation to learning outcomes from the last clinical course at their respective institutions. Validation of the revised AssCE was established with high congruence between the factors in the AssCE and examined learning outcomes. The revised AssCE tool seems to meet its objective to be a validated assessment tool for use in clinical nursing education. Copyright © 2016 Elsevier Ltd. All rights reserved.

Development and validation of an open source quantification tool for DSC-MRI studies.

PubMed

Gordaliza, P M; Mateos-Pérez, J M; Montesinos, P; Guzmán-de-Villoria, J A; Desco, M; Vaquero, J J

2015-03-01

This work presents the development of an open source tool for the quantification of dynamic susceptibility-weighted contrast-enhanced (DSC) perfusion studies. The development of this tool is motivated by the lack of open source tools implemented on open platforms to allow external developers to implement their own quantification methods easily and without the need of paying for a development license. This quantification tool was developed as a plugin for the ImageJ image analysis platform using the Java programming language. A modular approach was used in the implementation of the components, in such a way that the addition of new methods can be done without breaking any of the existing functionalities. For the validation process, images from seven patients with brain tumors were acquired and quantified with the presented tool and with a widely used clinical software package. The resulting perfusion parameters were then compared. Perfusion parameters and the corresponding parametric images were obtained. When no gamma-fitting is used, an excellent agreement with the tool used as a gold-standard was obtained (R(2)>0.8 and values are within 95% CI limits in Bland-Altman plots). An open source tool that performs quantification of perfusion studies using magnetic resonance imaging has been developed and validated using a clinical software package. It works as an ImageJ plugin and the source code has been published with an open source license. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development and validation of the health literacy assessment tool for older people in Taiwan: potential impacts of cultural differences.

PubMed

Chung, Min-Huey; Chen, Liang-Kung; Peng, Li-Ning; Chi, Mei-Ju

2015-01-01

To screen health literacy among urban elderly in Taiwan, who cannot be evaluated easily using the current measurement tools because of the "face", which meant someone felt embarrassed if he did not know how to do something. A literature review was performed to define a framework for developing the health literacy screening tool. Two hundred elderly were recruited to test the validity and reliability for pilot study. One thousand and eighty two elderly who came from quota sampling in Taipei City by administrative areas and gender were interviewed face-to-face to gather health literacy performance by the developed health literacy screening tool and the short-form Mandarin Health Literacy Scale (s-MHLS). 10-items of health literacy screening tool by self-perception were developed. The mean score of screening tool among analysis sample was 42.3 (0-50) and s-MHLS was 9.5 (0-11). Pearson correlation coefficient was 0.441 (p<0.0001) between these two measurements. Multiple regressions showed that, female, younger, higher education, living with family, has no primary caregiver, has few medical companionship, and higher score of health knowledge had better health literacy performance in both measurements. This screening tool should be applied to screen health literacy of elderly came from baby boomer who usually have lower education levels than the general population in Chinese regions. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.

An Overview of Tools for Creating, Validating and Using PDS Metadata

NASA Astrophysics Data System (ADS)

King, T. A.; Hardman, S. H.; Padams, J.; Mafi, J. N.; Cecconi, B.

2017-12-01

NASA's Planetary Data System (PDS) has defined information models for creating metadata to describe bundles, collections and products for all the assets acquired by a planetary science projects. Version 3 of the PDS Information Model (commonly known as "PDS3") is widely used and is used to describe most of the existing planetary archive. Recently PDS has released version 4 of the Information Model (commonly known as "PDS4") which is designed to improve consistency, efficiency and discoverability of information. To aid in creating, validating and using PDS4 metadata the PDS and a few associated groups have developed a variety of tools. In addition, some commercial tools, both free and for a fee, can be used to create and work with PDS4 metadata. We present an overview of these tools, describe those tools currently under development and provide guidance as to which tools may be most useful for missions, instrument teams and the individual researcher.

The Democritos Movement Screening Tool for Preschool Children (DEMOST-PRE©): development and factorial validity.

PubMed

Kambas, Antonis; Venetsanou, Fotini

2014-07-01

The aim of this study was (a) to develop an assessment tool (the Democritos Movement Screening Tool for Preschool Children - DEMOST-PRE), designed to provide preschool educators, clinicians and researchers with information about assessment and screening of the motor proficiency of children aged 4-6 years, as well as the development and control of movement programmes and (b) to assess its factorial validity. First, tool's content and face validity were established and its final structure was determined. Then, the DEMOST-PRE was administered to 435 children (197 girls) aged 48-71 months (M=60.48 months, SD=6.98). The factor analysis conducted revealed two distinct components. Present evidence combined with the DEMOST-PRE administrative traits make it promising for preschool aged children's assessment. Copyright © 2014 Elsevier Ltd. All rights reserved.

Furthering the Validity of a Tool to Assess Simulated Pregnancy Options Counseling Skills.

PubMed

Lupi, Carla; Ward-Peterson, Melissa; Coxe, Stefany; Minor, Suzanne; Eliacin, Irmanie; Obeso, Vivian

2016-10-01

To further the validity of a tool to assess nondirective pregnancy options counseling skills. Using a cross-sectional design, we explored four sources of construct validity evidence for an objective structured clinical examination for training and assessment of nondirective pregnancy options counseling: content, response process, internal structure, and relations to other variables. Content of the previously developed tool was enhanced through input from five family medicine educators. The objective structured clinical examination was implemented in a family medicine clerkship with third-year medical students from 2014 to 2015 using trained raters. Response process was addressed after a pilot round. Three new raters evaluated videotapes of 46 performances. Cronbach's alpha, intraclass correlation coefficients, and Spearman's rho were estimated with 95% confidence intervals. The content validity was affirmed. Cronbach's alpha was 0.71. According to Landis and Koch's criteria, all but two items unique to the clinical situation of pregnancy options counseling generated substantial to perfect agreement (0.62-1.00). Relations to other variables within the checklist were strong, ranging from 0.66 to 0.87. This tool for assessing pregnancy options counseling skills has excellent content and strong internal structure. Further work to improve the Global Rating Scale may be necessary for summative use.

Distribution and Validation of CERES Irradiance Global Data Products Via Web Based Tools

NASA Technical Reports Server (NTRS)

Rutan, David; Mitrescu, Cristian; Doelling, David; Kato, Seiji

2016-01-01

The CERES SYN1deg product provides climate quality 3-hourly globally gridded and temporally complete maps of top of atmosphere, in atmosphere, and surface fluxes. This product requires efficient release to the public and validation to maintain quality assurance. The CERES team developed web-tools for the distribution of both the global gridded products and grid boxes that contain long term validation sites that maintain high quality flux observations at the Earth's surface. These are found at: http://ceres.larc.nasa.gov/order_data.php. In this poster we explore the various tools available to users to sub-set, download, and validate using surface observations the SYN1Deg and Surface-EBAF products. We also analyze differences found in long-term records from well-maintained land surface sites such as the ARM central facility and high quality buoy radiometers, which due to their isolated nature cannot be maintained in a similar manner to their land based counterparts.

MEASURING SPORT-SPECIFIC PHYSICAL ABILITIES IN MALE GYMNASTS: THE MEN'S GYMNASTICS FUNCTIONAL MEASUREMENT TOOL.

PubMed

Sleeper, Mark D; Kenyon, Lisa K; Elliott, James M; Cheng, M Samuel

2016-12-01

Despite the availability of various field-tests for many competitive sports, a reliable and valid test specifically developed for use in men's gymnastics has not yet been developed. The Men's Gymnastics Functional Measurement Tool (MGFMT) was designed to assess sport-specific physical abilities in male competitive gymnasts. The purpose of this study was to develop the MGFMT by establishing a scoring system for individual test items and to initiate the process of establishing test-retest reliability and construct validity. A total of 83 competitive male gymnasts ages 7-18 underwent testing using the MGFMT. Thirty of these subjects underwent re-testing one week later in order to assess test-retest reliability. Construct validity was assessed using a simple regression analysis between total MGFMT scores and the gymnasts' USA-Gymnastics competitive level to calculate the coefficient of determination (r 2 ). Test-retest reliability was analyzed using Model 1 Intraclass correlation coefficients (ICC). Statistical significance was set at the p<0.05 level. The relationship between total MGFMT scores and subjects' current USA-Gymnastics competitive level was found to be good (r 2  = 0.63). Reliability testing of the MGFMT composite test score showed excellent test-retest reliability over a one-week period (ICC = 0.97). Test-retest reliability of the individual component tests ranged from good to excellent (ICC = 0.75-0.97). The results of this study provide initial support for the construct validity and test-retest reliability of the MGFMT. Level 3.

What can management theories offer evidence-based practice? A comparative analysis of measurement tools for organisational context.

PubMed

French, Beverley; Thomas, Lois H; Baker, Paula; Burton, Christopher R; Pennington, Lindsay; Roddam, Hazel

2009-05-19

Given the current emphasis on networks as vehicles for innovation and change in health service delivery, the ability to conceptualize and measure organisational enablers for the social construction of knowledge merits attention. This study aimed to develop a composite tool to measure the organisational context for evidence-based practice (EBP) in healthcare. A structured search of the major healthcare and management databases for measurement tools from four domains: research utilisation (RU), research activity (RA), knowledge management (KM), and organisational learning (OL). Included studies were reports of the development or use of measurement tools that included organisational factors. Tools were appraised for face and content validity, plus development and testing methods. Measurement tool items were extracted, merged across the four domains, and categorised within a constructed framework describing the absorptive and receptive capacities of organisations. Thirty measurement tools were identified and appraised. Eighteen tools from the four domains were selected for item extraction and analysis. The constructed framework consists of seven categories relating to three core organisational attributes of vision, leadership, and a learning culture, and four stages of knowledge need, acquisition of new knowledge, knowledge sharing, and knowledge use. Measurement tools from RA or RU domains had more items relating to the categories of leadership, and acquisition of new knowledge; while tools from KM or learning organisation domains had more items relating to vision, learning culture, knowledge need, and knowledge sharing. There was equal emphasis on knowledge use in the different domains. If the translation of evidence into knowledge is viewed as socially mediated, tools to measure the organisational context of EBP in healthcare could be enhanced by consideration of related concepts from the organisational and management sciences. Comparison of measurement tools across

Measuring Light with Useful Tools

ERIC Educational Resources Information Center

Peek, Gina; Hebert, Paulette; Frazier, Robert Scott; Knag, Mihyun

2013-01-01

Lighting, a necessary part of our home and work environment, is often considered as an afterthought. This article describes tools that Extension educators (Agriculture, Family and Consumer Sciences, and 4-H) can use to measure light levels. 4-H youth may also participate. These tools include light meters and Illuminating Engineering Society (IES)…

Validation of an explanatory tool for data-fused displays for high-technology future aircraft

NASA Astrophysics Data System (ADS)

Fletcher, Georgina C. L.; Shanks, Craig R.; Selcon, Stephen J.

1996-05-01

As the number of sensor and data sources in the military cockpit increases, pilots will suffer high levels of workload which could result in reduced performance and the loss of situational awareness. A DRA research program has been investigating the use of data-fused displays in decision support and has developed and laboratory-tested an explanatory tool for displaying information in air combat scenarios. The tool has been designed to provide pictorial explanations of data that maintain situational awareness by involving the pilot in the hostile aircraft threat assessment task. This paper reports a study carried out to validate the success of the explanatory tool in a realistic flight simulation facility. Aircrew were asked to perform a threat assessment task, either with or without the explanatory tool providing information in the form of missile launch success zone envelopes, while concurrently flying a waypoint course within set flight parameters. The results showed that there was a significant improvement (p less than 0.01) in threat assessment accuracy of 30% when using the explanatory tool. This threat assessment performance advantage was achieved without a trade-off with flying task performance. Situational awareness measures showed no general differences between the explanatory and control conditions, but significant learning effects suggested that the explanatory tool makes the task initially more intuitive and hence less demanding on the pilots' attentional resources. The paper concludes that DRA's data-fused explanatory tool is successful at improving threat assessment accuracy in a realistic simulated flying environment, and briefly discusses the requirements for further research in the area.

Older adult mistreatment risk screening: contribution to the validation of a screening tool in a domestic setting.

PubMed

Lindenbach, Jeannette M; Larocque, Sylvie; Lavoie, Anne-Marise; Garceau, Marie-Luce

2012-06-01

ABSTRACTThe hidden nature of older adult mistreatment renders its detection in the domestic setting particularly challenging. A validated screening instrument that can provide a systematic assessment of risk factors can facilitate this detection. One such instrument, the "expanded Indicators of Abuse" tool, has been previously validated in the Hebrew language in a hospital setting. The present study has contributed to the validation of the "e-IOA" in an English-speaking community setting in Ontario, Canada. It consisted of two phases: (a) a content validity review and adaptation of the instrument by experts throughout Ontario, and (b) an inter-rater reliability assessment by home visiting nurses. The adaptation, the "Mistreatment of Older Adult Risk Factors" tool, offers a comprehensive tool for screening in the home setting. This instrument is significant to professional practice as practitioners working with older adults will be better equipped to assess for risk of mistreatment.

Anxiety measures validated in perinatal populations: a systematic review.

PubMed

Meades, Rose; Ayers, Susan

2011-09-01

Research and screening of anxiety in the perinatal period is hampered by a lack of psychometric data on self-report anxiety measures used in perinatal populations. This paper aimed to review self-report measures that have been validated with perinatal women. A systematic search was carried out of four electronic databases. Additional papers were obtained through searching identified articles. Thirty studies were identified that reported validation of an anxiety measure with perinatal women. Most commonly validated self-report measures were the General Health Questionnaire (GHQ), State-Trait Anxiety Inventory (STAI), and Hospital Anxiety and Depression Scales (HADS). Of the 30 studies included, 11 used a clinical interview to provide criterion validity. Remaining studies reported one or more other forms of validity (factorial, discriminant, concurrent and predictive) or reliability. The STAI shows criterion, discriminant and predictive validity and may be most useful for research purposes as a specific measure of anxiety. The Kessler 10 (K-10) may be the best short screening measure due to its ability to differentiate anxiety disorders. The Depression Anxiety Stress Scales 21 (DASS-21) measures multiple types of distress, shows appropriate content, and remains to be validated against clinical interview in perinatal populations. Nineteen studies did not report sensitivity or specificity data. The early stages of research into perinatal anxiety, the multitude of measures in use, and methodological differences restrict comparison of measures across studies. There is a need for further validation of self-report measures of anxiety in the perinatal period to enable accurate screening and detection of anxiety symptoms and disorders. Copyright © 2010 Elsevier B.V. All rights reserved.

Validation of a modified FRAX® tool for improving outpatient efficiency--part of the "Catch Before a Fall" initiative.

PubMed

Parker, Simon; Ciaccio, Maria; Cook, Erica; Davenport, Graham; Cooper, Alun; Grange, Simon; Smitham, Peter

2015-01-01

We have validated our touch-screen-modified FRAX® tool against the traditional healthcare professional-led questionnaire, demonstrating strong concordance between doctor- and patient-derived results. We will use this in outpatient clinics and general practice to increase our capture rate of at-risk patients, making valuable use of otherwise wasted patient waiting times. Outpatient clinics offer an opportunity to collect valuable health information from a captive population. We have previously developed a modified fracture risk assessment (FRAX®) tool, enabling patients to self-assess their osteoporotic fracture risk in a touch-screen computer format and demonstrated its acceptability with patients. We aim to validate the accuracy of our tool against the traditional questionnaire. Fifty patients over 50 years of age within the fracture clinic independently completed a paper equivalent of our touch-screen-modified FRAX® questionnaire. Responses were analysed against the traditional healthcare professional (HCP)-led questionnaire which was carried out afterwards. Correlation was assessed by sensitivity, specificity, Cohen's kappa statistic and Fisher's exact test for each potential FRAX® outcome of "treat", "measure BMD" and "lifestyle advice". Age range was 51-98 years. The FRAX® tool was completed by 88 % of patients; six patients lacked confidence in estimating either their height or weight. Following question adjustment according to patient response and feedback, our tool achieved >95 % sensitivity and specificity for the "treat" and "lifestyle advice" groups, and 79 % sensitivity and 100 % specificity in the "measure BMD" group. Cohen's kappa value ranged from 0.823 to 0.995 across all groups, demonstrating "very good" agreement for all. Fisher's exact test demonstrated significant concordance between doctor and patient decisions. Our modified tool provides a simple, accurate and reliable method for patients to self-report their own FRAX® score

Validating an Agency-based Tool for Measuring Women’s Empowerment in a Complex Public Health Trial in Rural Nepal

PubMed Central

Gram, Lu; Morrison, Joanna; Sharma, Neha; Shrestha, Bhim; Manandhar, Dharma; Costello, Anthony; Saville, Naomi; Skordis-Worrall, Jolene

2017-01-01

Abstract Despite the rising popularity of indicators of women’s empowerment in global development programmes, little work has been done on the validity of existing measures of such a complex concept. We present a mixed methods validation of the use of the Relative Autonomy Index for measuring Amartya Sen’s notion of agency freedom in rural Nepal. Analysis of think-aloud interviews (n = 7) indicated adequate respondent understanding of questionnaire items, but multiple problems of interpretation including difficulties with the four-point Likert scale, questionnaire item ambiguity and difficulties with translation. Exploratory Factor Analysis of a calibration sample (n = 511) suggested two positively correlated factors (r = 0.64) loading on internally and externally motivated behaviour. Both factors increased with decreasing education and decision-making power on large expenditures and food preparation. Confirmatory Factor Analysis on a validation sample (n = 509) revealed good fit (Root Mean Square Error of Approximation 0.05–0.08, Comparative Fit Index 0.91–0.99). In conclusion, we caution against uncritical use of agency-based quantification of women’s empowerment. While qualitative and quantitative analysis revealed overall satisfactory construct and content validity, the positive correlation between external and internal motivations suggests the existence of adaptive preferences. High scores on internally motivated behaviour may reflect internalized oppression rather than agency freedom. PMID:28303173

Development and Validation of the Actionable Bladder Symptom Screening Tool for Multiple Sclerosis Patients

PubMed Central

Chancellor, Michael; Bates, David; Denys, Pierre; MacDiarmid, Scott; Nitti, Victor; Globe, Denise; Signori, Manuel; Hudgens, Stacie; Odderson, Ib; Panicker, Jalesh; Ross, Amy Perrin

2013-01-01

Bladder symptoms such as urinary urgency, frequency, and incontinence are common in people with multiple sclerosis (MS). These symptoms, which often result from neurogenic detrusor overactivity (NDO), can have a major impact on patients' day-to-day lives. However, in many cases they are over-looked in the clinical management of MS. The objective of this study was to develop and validate a reliable, sensitive, and specific screening tool for patients with bladder problems related to MS. We performed a literature review and then conducted a content validation study followed by a multisite observational study of a new screening tool, the Actionable Bladder Symptom Screening Tool (ABSST). All ABSST domains as well as the total score met the threshold for good internal consistency (Cronbach α ≥ 0.70), with a Cronbach α value of 0.95 for the total score and values ranging from 0.85 to 0.90 for the three domains. The validity of the ABSST was demonstrated by high correlation of the domains and total score with the Overactive Bladder Questionnaire Short Form (OAB-q SF) Symptom Severity and Total Health-Related Quality of Life (HRQOL) scores (Spearman correlation coefficient ≥ 0.782). The predictive validity of the ABSST total score to identify patients who might receive a recommendation to see a urologist was strong. This new instrument, which was developed with input from clinicians as well as MS patients, meets the current content validity and psychometric testing thresholds established by the US Food and Drug Administration, with high sensitivity and specificity. PMID:24453782

The FORGE AHEAD clinical readiness consultation tool: a validated tool to assess clinical readiness for chronic disease care mobilization in Canada's First Nations.

PubMed

Hayward, Mariam Naqshbandi; Mequanint, Selam; Paquette-Warren, Jann; Bailie, Ross; Chirila, Alexandra; Dyck, Roland; Green, Michael; Hanley, Anthony; Tompkins, Jordan; Harris, Stewart

2017-03-23

Given the astounding rates of diabetes and related complications, and the barriers to providing care present in Indigenous communities in Canada, intervention strategies that take into account contextual factors such as readiness to mobilize are needed to maximize improvements and increase the likelihood of success and sustainment. As part of the national FORGE AHEAD Program, we sought to develop, test and validate a clinical readiness consultation tool aimed at assessing the readiness of clinical teams working on-reserve in First Nations communities to participate in quality improvement (QI) to enhance diabetes care in Canada. A literature review was conducted to identify existing readiness tools. The ABCD - SAT was adapted using a consensus approach that emphasized a community-based participatory approach and prioritized the knowledge and wisdom held by community members. The tool was piloted with a group of 16 people from 7 provinces and 11 partnering communities to assess language use, clarity, relevance, format, and ease of completion using examples. Internal reliability analysis and convergence validity were conducted with data from 53 clinical team members from 11 First Nations communities (3-5 per community) who have participated in the FORGE AHEAD program. The 27-page Clinical Readiness Consultation Tool (CRCT) consists of five main components, 21 sub-components, and 74 items that are aligned with the Expanded Chronic Care Model. Five-point Likert scale feedback from the pilot ranged from 3.25 to 4.5. Length of the tool was reported as a drawback but respondents noted that all the items were needed to provide a comprehensive picture of the healthcare system. Results for internal consistency showed that all sub-components except for two were within acceptable ranges (0.77-0.93). The Team Structure and Function sub-component scale had a moderately significant positive correlation with the validated Team Climate Inventory, r = 0.45, p < 0.05. The

Procedure-specific assessment tool for flexible pharyngo-laryngoscopy: gathering validity evidence and setting pass-fail standards.

PubMed

Melchiors, Jacob; Petersen, K; Todsen, T; Bohr, A; Konge, Lars; von Buchwald, Christian

2018-06-01

The attainment of specific identifiable competencies is the primary measure of progress in the modern medical education system. The system, therefore, requires a method for accurately assessing competence to be feasible. Evidence of validity needs to be gathered before an assessment tool can be implemented in the training and assessment of physicians. This evidence of validity must according to the contemporary theory on validity be gathered from specific sources in a structured and rigorous manner. The flexible pharyngo-laryngoscopy (FPL) is central to the otorhinolaryngologist. We aim to evaluate the flexible pharyngo-laryngoscopy assessment tool (FLEXPAT) created in a previous study and to establish a pass-fail level for proficiency. Eighteen physicians with different levels of experience (novices, intermediates, and experienced) were recruited to the study. Each performed an FPL on two patients. These procedures were video recorded, blinded, and assessed by two specialists. The score was expressed as the percentage of a possible max score. Cronbach's α was used to analyze internal consistency of the data, and a generalizability analysis was performed. The scores of the three different groups were explored, and a pass-fail level was determined using the contrasting groups' standard setting method. Internal consistency was strong with a Cronbach's α of 0.86. We found a generalizability coefficient of 0.72 sufficient for moderate stakes assessment. We found a significant difference between the novice and experienced groups (p < 0.001) and strong correlation between experience and score (Pearson's r = 0.75). The pass/fail level was established at 72% of the maximum score. Applying this pass-fail level in the test population resulted in half of the intermediary group receiving a failing score. We gathered validity evidence for the FLEXPAT according to the contemporary framework as described by Messick. Our results support a claim of validity and are

Construct validity of the canadian occupational performance measure in participants with tendon injury and Dupuytren disease.

PubMed

van de Ven-Stevens, Lucelle A W; Graff, Maud J L; Peters, Marlijn A M; van der Linde, Harmen; Geurts, Alexander C H

2015-05-01

In patient-centered practice, instruments need to assess outcomes that are meaningful to patients with hand conditions. It is unclear which assessment tools address these subjective perspectives best. The aim of this study was to establish the construct validity of the Canadian Occupational Performance Measure (COPM) in relation to the Disabilities of Arm, Shoulder, and Hand (DASH) questionnaire and the Michigan Hand Outcomes Questionnaire (MHQ) in people with hand conditions. It was hypothesized that COPM scores would correlate with DASH and MHQ total scores only to a moderate degree and that the COPM, DASH questionnaire, and MHQ would all correlate weakly with measures of hand impairments. This was a validation study. The COPM, DASH questionnaire, and MHQ were scored, and then hand impairments were measured (pain [numerical rating scale], active range of motion [goniometer], grip strength [dynamometer], and pinch grip strength [pinch meter]). People who had received postsurgery rehabilitation for flexor tendon injuries, extensor tendon injuries, or Dupuytren disease were eligible. Seventy-two participants were included. For all diagnosis groups, the Pearson coefficient of correlation between the DASH questionnaire and the MHQ was higher than .60, whereas the correlation between the performance scale of the COPM and either the DASH questionnaire or the MHQ was lower than .51. Correlations of these assessment tools with measures of hand impairments were lower than .46. The small sample sizes may limit the generalization of the results. The results supported the hypotheses and, thus, the construct validity of the COPM after surgery in people with hand conditions. © 2015 American Physical Therapy Association.

The insight interview: a new tool for measuring deficits in awareness after traumatic brain injury.

PubMed

Malouf, Tania; Langdon, Robyn; Taylor, Alan

2014-01-01

Awareness deficits are common after traumatic brain injury (TBI); however, relatively little is known of awareness deficits in the early stages post-injury. This study outlines the development of a new tool, 'The Insight Interview', designed to measure awareness across different domains (awareness of change, severity of deficits, current and future functional consequences) from 3 months post-TBI. Forty-three patients with at least a severe TBI, their nominated family member and treating clinician were all administered different versions of the Insight Interview during the patient's inpatient stay. Awareness was measured; (1) by calculating a discrepancy score between the patient's and their family informant's and/or clinician's ratings of the patient's abilities and (2) using interviewer-based ratings of the patients' responses to interview questions. Awareness differed depending upon the domain being assessed, with patients demonstrating greatest awareness in the current functional consequences domain. Evidence for a distinction between awareness of current and future functional consequences of impairments was also seen. Discrepancy scores and interviewer-based ratings showed good concordance. Adequate reliability and validity was demonstrated. The Insight Interview is a useful and valid tool for measuring awareness in the acute stages following TBI and highlights that awareness depends on domain assessed.

Questionnaire development and validity to measure sexual intention among youth in Malaysia.

PubMed

Muhammad, Noor Azimah; Shamsuddin, Khadijah; Mohd Amin, Rahmah; Omar, Khairani; Thurasamy, Ramayah

2017-02-02

From the Theory of Planned Behaviour perspective, sexual intention is determined by a permissive attitude, perception of social norms and perceived self-efficacy in performing sexual activity. The aim of this study was to develop and validate the Youth Sexual Intention Questionnaire (YSI-Q), which was designed to measure sexual intention among youths in Malaysia. A total of 25 items were developed based on literature reviews encompassing four main constructs: sexual intention, attitude, social norms and self-efficacy. The YSI-Q then underwent a validation process that included content and face validity, exploratory factor analysis (EFA), reliability analysis, and confirmatory factor analysis (CFA). This study was conducted on unmarried youths aged 18 to 22 years who were studying in colleges around Klang Valley, Malaysia. EFA supported the four factor structure, but five items were removed due to incorrect placement or low factor loading (<0.60). Internal reliability using Cronbach's alpha ranged between 0.89 and 0.94. The CFA further confirmed the construct, convergent and discriminant validity of the YSI-Q with χ 2  = 392.43, df = 164, p < 0.001, χ 2 /df = 2.40, CFI = 0.93 and TLI = 0.92 and RMSEA = 0.08. The final set of YSI-Q consisted of 20 items measuring sexual intention (five items), attitude (five items), social norms (six items) and self-efficacy (four items) of practicing sexual activity. YSI-Q was shown to be a reliable and valid tool to be used among Malaysian youths.

Development and validation of brief scales to measure emotional and behavioural problems among Chinese adolescents

PubMed Central

Shen, Minxue; Hu, Ming; Sun, Zhenqiu

2017-01-01

Objectives To develop and validate brief scales to measure common emotional and behavioural problems among adolescents in the examination-oriented education system and collectivistic culture of China. Setting Middle schools in Hunan province. Participants 5442 middle school students aged 11–19 years were sampled. 4727 valid questionnaires were collected and used for validation of the scales. The final sample included 2408 boys and 2319 girls. Primary and secondary outcome measures The tools were assessed by the item response theory, classical test theory (reliability and construct validity) and differential item functioning. Results Four scales to measure anxiety, depression, study problem and sociality problem were established. Exploratory factor analysis showed that each scale had two solutions. Confirmatory factor analysis showed acceptable to good model fit for each scale. Internal consistency and test–retest reliability of all scales were above 0.7. Item response theory showed that all items had acceptable discrimination parameters and most items had appropriate difficulty parameters. 10 items demonstrated differential item functioning with respect to gender. Conclusions Four brief scales were developed and validated among adolescents in middle schools of China. The scales have good psychometric properties with minor differential item functioning. They can be used in middle school settings, and will help school officials to assess the students’ emotional/behavioural problems. PMID:28062469

An investigation of the validity of the Work Assessment Triage Tool clinical decision support tool for selecting optimal rehabilitation interventions for workers with musculoskeletal injuries.

PubMed

Qin, Ziling; Armijo-Olivo, Susan; Woodhouse, Linda J; Gross, Douglas P

2016-03-01

To evaluate the concurrent validity of a clinical decision support tool (Work Assessment Triage Tool (WATT)) developed to select rehabilitation treatments for injured workers with musculoskeletal conditions. Methodological study with cross-sectional and prospective components. Data were obtained from the Workers' Compensation Board of Alberta rehabilitation facility in Edmonton, Canada. A total of 432 workers' compensation claimants evaluated between November 2011 and June 2012. Percentage agreement between the Work Assessment Triage Tool and clinician recommendations was used to determine concurrent validity. In claimants returning to work, frequencies of matching were calculated and compared between clinician and Work Assessment Triage Tool recommendations and the actual programs undertaken by claimants. The frequency of each intervention recommended by clinicians, Work Assessment Triage Tool, and case managers were also calculated and compared. Percentage agreement between clinician and Work Assessment Triage Tool recommendations was poor (19%) to moderate (46%) and Kappa = 0.37 (95% CI -0.02, 0.76). The Work Assessment Triage Tool did not improve upon clinician recommendations as only 14 out of 31 claimants returning to work had programs that contradicted clinician recommendations, but were consistent with Work Assessment Triage Tool recommendations. Clinicians and case managers were inclined to recommend functional restoration, physical therapy, or no rehabilitation while the Work Assessment Triage Tool recommended additional evidence-based interventions, such as workplace-based interventions. Our findings do not provide evidence of concurrent validity for the Work Assessment Triage Tool compared with clinician recommendations. Based on these results, we cannot recommend further implementation of the Work Assessment Triage Tool. However, the Work Assessment Triage Tool appeared more likely than clinicians to recommend interventions supported by evidence

Validation of a short measure of effort-reward imbalance in the workplace: evidence from China.

PubMed

Li, Jian; Loerbroks, Adrian; Shang, Li; Wege, Natalia; Wahrendorf, Morten; Siegrist, Johannes

2012-01-01

Work stress is an emergent risk in occupational health in China, and its measurement is still a critical issue. The aim of this study was to examine the reliability and validity of a short version of the effort-reward imbalance (ERI) questionnaire in a sample of Chinese workers. A community-based survey was conducted in 1,916 subjects aged 30-65 years with paid employment (971 men and 945 women). Acceptable internal consistencies of the three scales, effort, reward and overcommitment, were obtained. Confirmatory factor analysis showed a good model fit of the data with the theoretical structure (goodness-of-fit index = 0.95). Evidence of criterion validity was demonstrated, as all three scales were independently associated with elevated odds ratios of both poor physical and mental health. Based on the findings of our study, this short version of the ERI questionnaire is considered to be a reliable and valid tool for measuring psychosocial work environment in Chinese working populations.

Chronic obstructive lung disease "expert system": validation of a predictive tool for assisting diagnosis.

PubMed

Braido, Fulvio; Santus, Pierachille; Corsico, Angelo Guido; Di Marco, Fabiano; Melioli, Giovanni; Scichilone, Nicola; Solidoro, Paolo

2018-01-01

The purposes of this study were development and validation of an expert system (ES) aimed at supporting the diagnosis of chronic obstructive lung disease (COLD). A questionnaire and a WebFlex code were developed and validated in silico. An expert panel pilot validation on 60 cases and a clinical validation on 241 cases were performed. The developed questionnaire and code validated in silico resulted in a suitable tool to support the medical diagnosis. The clinical validation of the ES was performed in an academic setting that included six different reference centers for respiratory diseases. The results of the ES expressed as a score associated with the risk of suffering from COLD were matched and compared with the final clinical diagnoses. A set of 60 patients were evaluated by a pilot expert panel validation with the aim of calculating the sample size for the clinical validation study. The concordance analysis between these preliminary ES scores and diagnoses performed by the experts indicated that the accuracy was 94.7% when both experts and the system confirmed the COLD diagnosis and 86.3% when COLD was excluded. Based on these results, the sample size of the validation set was established in 240 patients. The clinical validation, performed on 241 patients, resulted in ES accuracy of 97.5%, with confirmed COLD diagnosis in 53.6% of the cases and excluded COLD diagnosis in 32% of the cases. In 11.2% of cases, a diagnosis of COLD was made by the experts, although the imaging results showed a potential concomitant disorder. The ES presented here (COLD ES ) is a safe and robust supporting tool for COLD diagnosis in primary care settings.

Measurement of fatigue: Comparison of the reliability and validity of single-item and short measures to a comprehensive measure.

PubMed

Kim, Hee-Ju; Abraham, Ivo

2017-01-01

Evidence is needed on the clinicometric properties of single-item or short measures as alternatives to comprehensive measures. We examined whether two single-item fatigue measures (i.e., Likert scale, numeric rating scale) or a short fatigue measure were comparable to a comprehensive measure in reliability (i.e., internal consistency and test-retest reliability) and validity (i.e., convergent, concurrent, and predictive validity) in Korean young adults. For this quantitative study, we selected the Functional Assessment of Chronic Illness Therapy-Fatigue for the comprehensive measure and the Profile of Mood States-Brief, Fatigue subscale for the short measure; and constructed two single-item measures. A total of 368 students from four nursing colleges in South Korea participated. We used Cronbach's alpha and item-total correlation for internal consistency reliability and intraclass correlation coefficient for test-retest reliability. We assessed Pearson's correlation with a comprehensive measure for convergent validity, with perceived stress level and sleep quality for concurrent validity and the receiver operating characteristic curve for predictive validity. The short measure was comparable to the comprehensive measure in internal consistency reliability (Cronbach's alpha=0.81 vs. 0.88); test-retest reliability (intraclass correlation coefficient=0.66 vs. 0.61); convergent validity (r with comprehensive measure=0.79); concurrent validity (r with perceived stress=0.55, r with sleep quality=0.39) and predictive validity (area under curve=0.88). Single-item measures were not comparable to the comprehensive measure. A short fatigue measure exhibited similar levels of reliability and validity to the comprehensive measure in Korean young adults. Copyright © 2016 Elsevier Ltd. All rights reserved.

Validation of vocational assessment tool for persons with substance use disorders.

PubMed

Sethuraman, Lakshmanan; Subodh, B N; Murthy, Pratima

2016-01-01

Work-related problems are a serious concern among persons with substance use but due to lack of a standardized tool to measure it; these problems are neither systematically assessed nor appropriately addressed. Most existing measures of work performance cater to the needs of the workplace rather than focusing on the workers' perception of the difficulties at work. To develop a standardized instrument to measure work-related problems in persons with substance use disorders. Qualitative data obtained from interviews with substance users were used to develop a scale. The refined list of the scale was circulated among an expert panel for content validation. The modified scale was administered to 150 cases, and 50 cases completed the scale twice at the interval of 2 weeks for test-retest reliability. Items with a test-retest reliability kappa coefficient of 0.4 or greater were retained and subjected to factor analysis. The final 45-item scale has a five-factor structure. The value of Cronbach's alpha of the final version of the scale was 0.91. This self-report questionnaire, which can be completed in 10 min, may help us in making a baseline assessment of the work-related impairment among persons with substance use and the impact of substance use on work.

Perioperative Respiratory Adverse Events in Pediatric Ambulatory Anesthesia: Development and Validation of a Risk Prediction Tool.

PubMed

Subramanyam, Rajeev; Yeramaneni, Samrat; Hossain, Mohamed Monir; Anneken, Amy M; Varughese, Anna M

2016-05-01

Perioperative respiratory adverse events (PRAEs) are the most common cause of serious adverse events in children receiving anesthesia. Our primary aim of this study was to develop and validate a risk prediction tool for the occurrence of PRAE from the onset of anesthesia induction until discharge from the postanesthesia care unit in children younger than 18 years undergoing elective ambulatory anesthesia for surgery and radiology. The incidence of PRAE was studied. We analyzed data from 19,059 patients from our department's quality improvement database. The predictor variables were age, sex, ASA physical status, morbid obesity, preexisting pulmonary disorder, preexisting neurologic disorder, and location of ambulatory anesthesia (surgery or radiology). Composite PRAE was defined as the presence of any 1 of the following events: intraoperative bronchospasm, intraoperative laryngospasm, postoperative apnea, postoperative laryngospasm, postoperative bronchospasm, or postoperative prolonged oxygen requirement. Development and validation of the risk prediction tool for PRAE were performed using a split sampling technique to split the database into 2 independent cohorts based on the year when the patient received ambulatory anesthesia for surgery and radiology using logistic regression. A risk score was developed based on the regression coefficients from the validation tool. The performance of the risk prediction tool was assessed by using tests of discrimination and calibration. The overall incidence of composite PRAE was 2.8%. The derivation cohort included 8904 patients, and the validation cohort included 10,155 patients. The risk of PRAE was 3.9% in the development cohort and 1.8% in the validation cohort. Age ≤ 3 years (versus >3 years), ASA physical status II or III (versus ASA physical status I), morbid obesity, preexisting pulmonary disorder, and surgery (versus radiology) significantly predicted the occurrence of PRAE in a multivariable logistic regression

About my Child: measuring 'Complexity' in neurodisability. Evidence of reliability and validity.

PubMed

Ritzema, A M; Lach, L M; Rosenbaum, P; Nicholas, D

2016-05-01

About my Child, 26-item version (AMC-26) was developed as a measure of child health 'complexity' and has been proposed as a tool for understanding the functional needs of children and the priorities of families. The current study investigated the reliability and validity of AMC-26 with a sample of caregivers of children with neurodevelopmental disorders (NDD; n = 258) who completed AMC-26 as part of a larger study on parenting children with NDD. A subsample of children from the larger study (n = 49) were assessed using standardized measures of cognitive and adaptive functioning. Factor analysis revealed that a four-component model explained 51.12% of the variance. Cronbach's alpha was calculated for each of the four factors and for the scale as a whole, and ranged from 0.75 to 0.85, suggesting a high level of internal consistency. Construct validity was tested through comparisons with the results of standardized measures of child functioning. Predicted relationships for factors one, two and three were statistically significant and in the expected directions. Predictions for factor four were partially supported. AMC-26 was also expected to serve as an indicator of caregiver distress. Drawing on a sample of caregivers from the larger study (n = 251) the model was found to be significant and explained 23% of the variance in caregiver depressive symptoms (R(2)  = .053, F (1, 249) = 14.06, P < .001). Based on these observations, the authors contend that AMC-26 may be used by clinicians and researchers as a tool to capture child function and child health complexity. Such a measure may help elucidate the relationships between child complexity and family well-being. This is an important avenue for further investigation. © 2016 John Wiley & Sons Ltd.

Validity of a smartphone protractor to measure sagittal parameters in adult spinal deformity.

PubMed

Kunkle, William Aaron; Madden, Michael; Potts, Shannon; Fogelson, Jeremy; Hershman, Stuart

2017-10-01

Smartphones have become an integral tool in the daily life of health-care professionals (Franko 2011). Their ease of use and wide availability often make smartphones the first tool surgeons use to perform measurements. This technique has been validated for certain orthopedic pathologies (Shaw 2012; Quek 2014; Milanese 2014; Milani 2014), but never to assess sagittal parameters in adult spinal deformity (ASD). This study was designed to assess the validity, reproducibility, precision, and efficiency of using a smartphone protractor application to measure sagittal parameters commonly measured in ASD assessment and surgical planning. This study aimed to (1) determine the validity of smartphone protractor applications, (2) determine the intra- and interobserver reliability of smartphone protractor applications when used to measure sagittal parameters in ASD, (3) determine the efficiency of using a smartphone protractor application to measure sagittal parameters, and (4) elucidate whether a physician's level of experience impacts the reliability or validity of using a smartphone protractor application to measure sagittal parameters in ASD. An experimental validation study was carried out. Thirty standard 36″ standing lateral radiographs were examined. Three separate measurements were performed using a marker and protractor; then at a separate time point, three separate measurements were performed using a smartphone protractor application for all 30 radiographs. The first 10 radiographs were then re-measured two more times, for a total of three measurements from both the smartphone protractor and marker and protractor. The parameters included lumbar lordosis, pelvic incidence, and pelvic tilt. Three raters performed all measurements-a junior level orthopedic resident, a senior level orthopedic resident, and a fellowship-trained spinal deformity surgeon. All data, including the time to perform the measurements, were recorded, and statistical analysis was performed to

Systematic review of tools to measure outcomes for young children with autism spectrum disorder.

PubMed

McConachie, Helen; Parr, Jeremy R; Glod, Magdalena; Hanratty, Jennifer; Livingstone, Nuala; Oono, Inalegwu P; Robalino, Shannon; Baird, Gillian; Beresford, Bryony; Charman, Tony; Garland, Deborah; Green, Jonathan; Gringras, Paul; Jones, Glenys; Law, James; Le Couteur, Ann S; Macdonald, Geraldine; McColl, Elaine M; Morris, Christopher; Rodgers, Jacqueline; Simonoff, Emily; Terwee, Caroline B; Williams, Katrina

2015-06-01

tools was combined with information about their accessibility and presentation. Twelve tools were identified as having the strongest supporting evidence, the majority measuring autism characteristics and problem behaviour. The patchy evidence and limited scope of outcomes measured mean these tools do not constitute a 'recommended battery' for use. In particular, there is little evidence that the identified tools would be good at detecting change in intervention studies. The obvious gaps in available outcome measurement include well-being and participation outcomes for children, and family quality-of-life outcomes, domains particularly valued by our informants (young people with ASD and parents). This is the first systematic review of the quality and appropriateness of tools designed to monitor progress and outcomes of young children with ASD. Although it was not possible to recommend fully robust tools at this stage, the review consolidates what is known about the field and will act as a benchmark for future developments. With input from parents and other stakeholders, recommendations are made about priority targets for research. Priorities include development of a tool to measure child quality of life in ASD, and validation of a potential primary outcome tool for trials of early social communication intervention. This study is registered as PROSPERO CRD42012002223. The National Institute for Health Research Health Technology Assessment programme.

The Learning Loss Scale as an Assessment Tool: An Empirical Examination of Convergent Validity with Performative Measures

ERIC Educational Resources Information Center

Hooker, John; Denker, Katherine

2014-01-01

Higher education has placed an increasingly greater value on assessment. The Learning Loss Scale may be an appropriate tool to assess learning across disciplines. In this paper, we review the culture of assessment, conceptualizations of cognitive learning, the Learning Loss Scale, and a theoretical explanation, and then we test this measure to…

Developing and validating a perinatal depression screening tool in Kenya blending Western criteria with local idioms: A mixed methods study.

PubMed

Green, Eric P; Tuli, Hawa; Kwobah, Edith; Menya, D; Chesire, Irene; Schmidt, Christina

2018-03-01

Routine screening for perinatal depression is not common in most primary health care settings. The U.S. Preventive Services Task Force only recently updated their recommendation on depression screening to specifically recommend screening during the pre- and postpartum periods. While practitioners in high-income countries can respond to this new recommendation by implementing one of several existing depression screening tools developed in Western contexts, such as the Edinburgh Postnatal Depression Scale (EPDS) or the Patient Health Questionnaire-9 (PHQ-9), these tools lack strong evidence of cross-cultural equivalence, validity for case finding, and precision in measuring response to treatment in developing countries. Thus, there is a critical need to develop and validate new screening tools for perinatal depression that can be used by lay health workers, primary health care personnel, and patients. Working in rural Kenya, we used free listing, card sorting, and item analysis methods to develop a locally-relevant screening tool that blended Western psychiatric concepts with local idioms of distress. We conducted a validation study with a random sample of 193 pregnant women and new mothers to test the diagnostic accuracy of this scale along with the EPDS and PHQ-9. The sensitivity/specificity of the EPDS and PHQ-9 was estimated to be 0.70/0.72 and 0.70/0.73, respectively. This compared to sensitivity/specificity of 0.90/0.90 for a new 9-item locally-developed tool called the Perinatal Depression Screening (PDEPS). Across these three tools, internal consistency reliability ranged from 0.77 to 0.81 and test-retest reliability ranged from 0.57 to 0.67. The prevalence of depression ranges from 5.2% to 6.2% depending on the clinical reference standard. The EPDS and PHQ-9 are valid and reliable screening tools for perinatal depression in rural Western Kenya, the PDEPS may be a more useful alternative. At less than 10%, the prevalence of depression in this region appears

The Takei Handheld Dynamometer: An Effective Clinical Outcome Measure Tool for Hand and Wrist Function in Boxing.

PubMed

Gatt, Ian; Smith-Moore, Sophie; Steggles, Charlie; Loosemore, Mike

2018-05-01

The aim of this article was to explore retrospectively the Takei dynamometer as a valid and reliable outcome measure tool for hand and wrist pathology in the Great Britain amateur boxing squad between 2010 and 2014. Longitudinal retrospective injury surveillance of the Great Britain boxing squad was performed from 2010 to 2014. The location, region affected, description, and duration of each injury were recorded by the team doctor and team physiotherapists. For each significant injury, we recorded hand grip scores using the Takei handheld dynamometer and compared the scores with baseline measures. At the hand, fractures and dislocations were highly detected with an average difference of 40.2% ( P < .05) when comparing postinjury to baseline measures. At the wrist, carpometacarpal and carpal joint injuries were highly detected with an average difference of 32.6% ( P < .05). Other injuries provided varied results. In the absence of pathology, up to 15% difference between left and right scores can be considered normal with a predominance observed below 10%. A difference of 20% can be indicative of a form of pathology, although pathologies can also be present with lower difference or no apparent changes. A difference of >20% should be highly considered for significant pathology. The Takei dynamometer is a valid and reliable outcome measure tool for hand and wrist pathologies in boxing. Our study highlights the importance of appropriate clinical tools to guide injury management in this sport.

The predictive validity of common risk assessment tools in men with intellectual disabilities and problematic sexual behaviors.

PubMed

Fedoroff, J Paul; Richards, Deborah; Ranger, Rebekah; Curry, Susan

2016-10-01

This CIHR-funded study examined whether certain current risk assessment tools were effective in appraising risk of recidivism in a sample of sex offenders with intellectual disabilities (ID). Fifty men with ID who had engaged in problematic sexual behavior (PSB) were followed for an average of 2.5 years. Recidivism was defined and measured as any illegal or problematic behavior, as well as any problematic but not necessarily illegal behavior. At the beginning of the study, each participant was rated on two risk assessment tools: the Violence Risk Appraisal Guide (VRAG) and the Sex Offender Risk Appraisal Guide (SORAG). During each month of follow-up, participants were also rated on the Short-Dynamic Risk Scale (SDRS), an assessment tool intended to measure the risk of future problematic behaviors. Data was analyzed using t-tests, Cohen's d and area under the curve (AUC) to test predictive validity of the assessment tools. Using the AUC, results showed that the VRAG was predictive of sexual (AUC=0.74), sexual and/or violent (AUC=0.71) and of any criminally chargeable event (AUC=0.69). The SORAG was only significantly predictive of sexual events (AUC=0.70) and the SDRS was predictive of violent events (AUC=0.71). The t-test and Cohen's d analyses, which are less robust to deviations from the assumptions of normal and continuous distribution than AUC, did not yield significant results in each category, and therefore, while the results of this study suggest that the VRAG and the SORAG may be effective tools in measuring the short term risk of sexual recidivism; and the VRAG and SDRS may be effective tools in appraising long term risk of sexual and/or violent recidivism in this population, it should be used with caution. Regardless of the assessment tool used, risk assessments should take into account the differences between sex offenders with and without ID to ensure effective measurement. Copyright © 2016. Published by Elsevier Ltd.

Development and Validation of a Self-reported Questionnaire for Measuring Internet Search Dependence

PubMed Central

Wang, Yifan; Wu, Lingdan; Zhou, Hongli; Xu, Jiaojing; Dong, Guangheng

2016-01-01

Internet search has become the most common way that people deal with issues and problems in everyday life. The wide use of Internet search has largely changed the way people search for and store information. There is a growing interest in the impact of Internet search on users’ affect, cognition, and behavior. Thus, it is essential to develop a tool to measure the changes in psychological characteristics as a result of long-term use of Internet search. The aim of this study is to develop a Questionnaire on Internet Search Dependence (QISD) and test its reliability and validity. We first proposed a preliminary structure and items of the QISD based on literature review, supplemental investigations, and interviews. And then, we assessed the psychometric properties and explored the factor structure of the initial version via exploratory factor analysis (EFA). The EFA results indicated that four dimensions of the QISD were very reliable, i.e., habitual use of Internet search, withdrawal reaction, Internet search trust, and external storage under Internet search. Finally, we tested the factor solution obtained from EFA through confirmatory factor analysis (CFA). The results of CFA confirmed that the four dimensions model fits the data well. In all, this study suggests that the 12-item QISD is of high reliability and validity and can serve as a preliminary tool to measure the features of Internet search dependence. PMID:28066753

Development and Validation of a Self-reported Questionnaire for Measuring Internet Search Dependence.

PubMed

Wang, Yifan; Wu, Lingdan; Zhou, Hongli; Xu, Jiaojing; Dong, Guangheng

2016-01-01

Internet search has become the most common way that people deal with issues and problems in everyday life. The wide use of Internet search has largely changed the way people search for and store information. There is a growing interest in the impact of Internet search on users' affect, cognition, and behavior. Thus, it is essential to develop a tool to measure the changes in psychological characteristics as a result of long-term use of Internet search. The aim of this study is to develop a Questionnaire on Internet Search Dependence (QISD) and test its reliability and validity. We first proposed a preliminary structure and items of the QISD based on literature review, supplemental investigations, and interviews. And then, we assessed the psychometric properties and explored the factor structure of the initial version via exploratory factor analysis (EFA). The EFA results indicated that four dimensions of the QISD were very reliable, i.e., habitual use of Internet search, withdrawal reaction, Internet search trust, and external storage under Internet search. Finally, we tested the factor solution obtained from EFA through confirmatory factor analysis (CFA). The results of CFA confirmed that the four dimensions model fits the data well. In all, this study suggests that the 12-item QISD is of high reliability and validity and can serve as a preliminary tool to measure the features of Internet search dependence.

Validation of a Nutrition Screening Tool for Pediatric Patients with Cystic Fibrosis.

PubMed

Souza Dos Santos Simon, Miriam Isabel; Forte, Gabriele Carra; da Silva Pereira, Juliane; da Fonseca Andrade Procianoy, Elenara; Drehmer, Michele

2016-05-01

In cystic fibrosis (CF), nutrition diagnosis is of critical relevance because the early identification of nutrition-related compromise enables early, adequate intervention and, consequently, influences patient prognosis. Up to now, there has not been a validated nutrition screening tool that takes into consideration clinical variables. To validate a specific nutritional risk screening tool for patients with CF based on clinical variables, anthropometric parameters, and dietary intake. Cross-sectional study. The nutrition screening tool was compared with a risk screening tool proposed by McDonald and the Cystic Fibrosis Foundation criteria. Patients aged 6 to 18 years, with a diagnosis of CF confirmed by two determinations of elevated chloride level in sweat (sweat test) and/or by identification of two CF-associated genetic mutations who were receiving follow-up care through the outpatient clinic of a Cystic Fibrosis Treatment Center. Earlier identification of nutritional risk in CF patients aged 6 to 18 years when a new screening tool was applied. Agreement among the tested methods was assessed by means of the kappa coefficient for categorical variables. Sensitivity, specificity, and accuracy values were calculated. The significance level was set at 5% (P<0.05). Statistical analyses were carried out in PASW Statistics for Windows version 18.0 (2009, SPSS Inc). Eighty-two patients (49% men, aged 6 to 18 years) were enrolled in the study. The agreement between the proposed screening tool and the tool for screening nutritional risk for CF by the McDonald method was good (κ=0.804; P<0.001) and the sensitivity and specificity was 85% and 95%, respectively. Agreement with the Cystic Fibrosis Foundation criteria was lower (κ=0.418; P<0.001), and the sensitivity and specificity were both 72%. The proposed screening tool with defined clinical variables promotes earlier identification of nutritional risk in pediatric patients with CF. Copyright © 2016 Academy of Nutrition

Validation of a commercial inertial sensor system for spatiotemporal gait measurements in children.

PubMed

Lanovaz, Joel L; Oates, Alison R; Treen, Tanner T; Unger, Janelle; Musselman, Kristin E

2017-01-01

Although inertial sensor systems are becoming a popular tool for gait analysis in both healthy and pathological adult populations, there are currently no data on the validity of these systems for use with children. The purpose of this study was to validate spatiotemporal data from a commercial inertial sensor system (MobilityLab) in typically-developing children. Data from 10 children (5 males; 3.0-8.3 years, mean=5.1) were collected simultaneously from MobilityLab and 3D motion capture during gait at self-selected and fast walking speeds. Spatiotemporal parameters were compared between the two methods using a Bland-Altman method. The results indicate that, while the temporal gait measurements were similar between the two systems, MobilityLab demonstrated a consistent bias with respect to measurement of the spatial data (stride length). This error is likely due to differences in relative leg length and gait characteristics in children compared to the MobilityLab adult reference population used to develop the stride length algorithm. A regression-based equation was developed based on the current data to correct the MobilityLab stride length output. The correction was based on leg length, stride time, and shank range-of-motion, each of which were independently associated with stride length. Once the correction was applied, all of the spatiotemporal parameters evaluated showed good agreement. The results of this study indicate that MobilityLab is a valid tool for gait analysis in typically-developing children. Further research is needed to determine the efficacy of this system for use in children suffering from pathologies that impact gait mechanics. Copyright © 2016 Elsevier B.V. All rights reserved.

MBS Measurement Tool for Swallow Impairment—MBSImp: Establishing a Standard

PubMed Central

Martin-Harris, Bonnie; Brodsky, Martin B.; Michel, Yvonne; Castell, Donald O.; Schleicher, Melanie; Sandidge, John; Maxwell, Rebekah; Blair, Julie

2014-01-01

The aim of this study was to test reliability, content, construct, and external validity of a new modified barium swallowing study (MBSS) tool (MBSImp) that is used to quantify swallowing impairment. Multiple regression, confirmatory factor, and correlation analyses were used to analyze 300 in- and outpatients with heterogeneous medical and surgical diagnoses who were sequentially referred for MBS exams at a university medical center and private tertiary care community hospital. Main outcome measures were the MBSImp and index scores of aspiration, health status, and quality of life. Inter- and intrarater concordance were 80% or greater for blinded scoring of MBSSs. Regression analysis revealed contributions of eight of nine swallow types to impressions of overall swallowing impairment (p ≤ 0.05). Factor analysis revealed 13 significant components (loadings ≥ 0.5) that formed two impairment groupings (oral and pharyngeal). Significant correlations were found between Oral and Pharyngeal Impairment scores and Penetration-Aspiration Scale scores, and indexes of intake status, nutrition, health status, and quality of life. The MBSImp demonstrated clinical practicality, favorable inter- and intrarater reliability following standardized training, content, and external validity. This study reflects potential for establishment of a new standard for quantification and comparison of oropharyngeal swallowing impairment across patient diagnoses as measured on MBSS. PMID:18855050

MEASURING SPORT-SPECIFIC PHYSICAL ABILITIES IN MALE GYMNASTS: THE MEN'S GYMNASTICS FUNCTIONAL MEASUREMENT TOOL

PubMed Central

Kenyon, Lisa K.; Elliott, James M; Cheng, M. Samuel

2016-01-01

Purpose/Background Despite the availability of various field-tests for many competitive sports, a reliable and valid test specifically developed for use in men's gymnastics has not yet been developed. The Men's Gymnastics Functional Measurement Tool (MGFMT) was designed to assess sport-specific physical abilities in male competitive gymnasts. The purpose of this study was to develop the MGFMT by establishing a scoring system for individual test items and to initiate the process of establishing test-retest reliability and construct validity. Methods A total of 83 competitive male gymnasts ages 7-18 underwent testing using the MGFMT. Thirty of these subjects underwent re-testing one week later in order to assess test-retest reliability. Construct validity was assessed using a simple regression analysis between total MGFMT scores and the gymnasts’ USA-Gymnastics competitive level to calculate the coefficient of determination (r2). Test-retest reliability was analyzed using Model 1 Intraclass correlation coefficients (ICC). Statistical significance was set at the p<0.05 level. Results The relationship between total MGFMT scores and subjects’ current USA-Gymnastics competitive level was found to be good (r2 = 0.63). Reliability testing of the MGFMT composite test score showed excellent test-retest reliability over a one-week period (ICC = 0.97). Test-retest reliability of the individual component tests ranged from good to excellent (ICC = 0.75-0.97). Conclusions The results of this study provide initial support for the construct validity and test-retest reliability of the MGFMT. Level of Evidence Level 3 PMID:27999723

Is the Berg Balance Scale an effective tool for the measurement of early postural control impairments in patients with Parkinson's disease? Evidence from Rasch analysis.

PubMed

La Porta, F; Giordano, A; Caselli, S; Foti, C; Franchignoni, F

2015-12-01

It is unclear whether the BBS is an effective tool for the measurement of early postural control impairments in patients with Parkinson's disease (PD). The aim of this paper was to evaluate BBS' content validity, internal construct validity, reliability and targeting in patients with PD within the Rasch analysis framework. Observational, cross-sectional study. Outpatient Rehabilitation Unit. A sample of 285 outpatients with PD. The content validity of the BBS was assessed using standard linking techniques. The BBS was administered by trained physiotherapists. The data collected then underwent Rasch analysis. Content validity analysis showed a lack of items assessing postural responses to tripping and slips and stability during walking. On Rasch analysis, the BBS failed the requirements of monotonicity, local independence, unidimensionality and invariance. After rescoring 7 items, grouping of locally dependent items into testlets, and deletion of the static sitting balance item because mistargeted and underdiscriminating, the Rasch-modified BBS for PD (BBS-PD) showed adequate internal construct validity (χ(2)24=39.693; P=0.023), including absence of differential item functioning (DIF) across gender and age, and was, as a whole, sufficiently precise for individual person measurement (PSI=0.894). However, the scale was not well targeted to the sample in view of the prevalence of higher scores. This study demonstrated the internal construct validity and reliability of the BBS-PD as a measurement tool for patients with PD within the Rasch analysis framework. However, the lack of items critical to the assessment of postural control impairments typical of PD, affected negatively the targeting, so that a significant percentage of patients was located in the higher ability range of the measurement continuum, where precision of measurement is reduced. These findings suggest that the BBS, even if modified, may not be an effective tool for the measurement of early postural

Reliable and valid NEWS for Chinese seniors: measuring perceived neighborhood attributes related to walking.

PubMed

Cerin, Ester; Sit, Cindy Hp; Cheung, Man-Chin; Ho, Sai-Yin; Lee, Lok-Chun Janet; Chan, Wai-Man

2010-11-25

construct validity and generalizability to other Asian locations. In general, the measurement model of the original NEWS-A was generalizable to this study context, supporting the feasibility of cross-country and age-group comparisons of the effect of the neighborhood environment on walking using the NEWS-A as a tool to measure the perceived built environment.

Measuring Food Brand Awareness in Australian Children: Development and Validation of a New Instrument.

PubMed

Turner, Laura; Kelly, Bridget; Boyland, Emma; Bauman, Adrian E

2015-01-01

Children's exposure to food marketing is one environmental determinant of childhood obesity. Measuring the extent to which children are aware of food brands may be one way to estimate relative prior exposures to food marketing. This study aimed to develop and validate an Australian Brand Awareness Instrument (ABAI) to estimate children's food brand awareness. The ABAI incorporated 30 flashcards depicting food/drink logos and their corresponding products. An abbreviated version was also created using 12 flashcards (ABAI-a). The ABAI was presented to 60 primary school aged children (7-11 yrs) attending two Australian after-school centres. A week later, the full-version was repeated on approximately half the sample (n=27) and the abbreviated-version was presented to the remaining half (n=30). The test-retest reliability of the ABAI was analysed using Intra-class correlation coefficients. The concordance of the ABAI-a and full-version was assessed using Bland-Altman plots. The 'nomological' validity of the full tool was investigated by comparing children's brand awareness with food marketing-related variables (e.g. television habits, intake of heavily promoted foods). Brand awareness increased with age (p<0.01) but was not significantly correlated with other variables. Bland-Altman analyses showed good agreement between the ABAI and ABAI-a. Reliability analyses revealed excellent agreement between the two administrations of the full-ABAI. The ABAI was able to differentiate children's varying levels of brand awareness. It was shown to be a valid and reliable tool and may allow quantification of brand awareness as a proxy measure for children's prior food marketing exposure.

Multilevel Assessment of Middle School Students' Interest in the Health Sciences: Development and Validation of a New Measurement Tool.

PubMed

Romine, William L; Miller, Michele E; Knese, Shawn A; Folk, William R

2016-01-01

Using the context of a 2-wk instructional unit focused on eye and vision health, we developed and validated a multilevel measure of middle school students' interest in science and health careers. This survey contained three subscales positioned differently with respect to curricular content. Interest in Vision Care was most related, but less transferrable to other contexts. Interest in Science was most general, and Interest in Healthcare was positioned between the two. We found that, with two exceptions, items fitted well with validity expectations and were stable across a 2-wk intervention. Further, measures of interest in science, health, and vision-care careers were shown to be reliable and valid. We found that ease of facilitating change across the intervention was generally greater in subscales closely related to the curricular context but that the average magnitude of change in Interest in Healthcare and Interest in Science was not significantly different. We discuss use of these measures in informing instructional efforts and advise that changes in students' perceptions of how science and healthcare relate should be considered in longitudinal analyses. © 2016 W. L. Romine et al. CBE—Life Sciences Education © 2016 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

Validation study of an electronic method of condensed outcomes tools reporting in orthopaedics.

PubMed

Farr, Jack; Verma, Nikhil; Cole, Brian J

2013-12-01

Patient-reported outcomes (PRO) instruments are a vital source of data for evaluating the efficacy of medical treatments. Historically, outcomes instruments have been designed, validated, and implemented as paper-based questionnaires. The collection of paper-based outcomes information may result in patients becoming fatigued as they respond to redundant questions. This problem is exacerbated when multiple PRO measures are provided to a single patient. In addition, the management and analysis of data collected in paper format involves labor-intensive processes to score and render the data analyzable. Computer-based outcomes systems have the potential to mitigate these problems by reformatting multiple outcomes tools into a single, user-friendly tool.The study aimed to determine whether the electronic outcomes system presented produces results comparable with the test-retest correlations reported for the corresponding orthopedic paper-based outcomes instruments.The study is designed as a crossover study based on consecutive orthopaedic patients arriving at one of two designated orthopedic knee clinics.Patients were assigned to complete either a paper or a computer-administered questionnaire based on a similar set of questions (Knee injury and Osteoarthritis Outcome Score, International Knee Documentation Committee form, 36-Item Short Form survey, version 1, Lysholm Knee Scoring Scale). Each patient completed the same surveys using the other instrument, so that all patients had completed both paper and electronic versions. Correlations between the results from the two modes were studied and compared with test-retest data from the original validation studies.The original validation studies established test-retest reliability by computing correlation coefficients for two administrations of the paper instrument. Those correlation coefficients were all in the range of 0.7 to 0.9, which was deemed satisfactory. The present study computed correlation coefficients between

The Johns Hopkins Fall Risk Assessment Tool: A Study of Reliability and Validity.

PubMed

Poe, Stephanie S; Dawson, Patricia B; Cvach, Maria; Burnett, Margaret; Kumble, Sowmya; Lewis, Maureen; Thompson, Carol B; Hill, Elizabeth E

Patient falls and fall-related injury remain a safety concern. The Johns Hopkins Fall Risk Assessment Tool (JHFRAT) was developed to facilitate early detection of risk for anticipated physiologic falls in adult inpatients. Psychometric properties in acute care settings have not yet been fully established; this study sought to fill that gap. Results indicate that the JHFRAT is reliable, with high sensitivity and negative predictive validity. Specificity and positive predictive validity were lower than expected.

Validity and repeatability of inertial measurement units for measuring gait parameters.

PubMed

Washabaugh, Edward P; Kalyanaraman, Tarun; Adamczyk, Peter G; Claflin, Edward S; Krishnan, Chandramouli

2017-06-01

Inertial measurement units (IMUs) are small wearable sensors that have tremendous potential to be applied to clinical gait analysis. They allow objective evaluation of gait and movement disorders outside the clinic and research laboratory, and permit evaluation on large numbers of steps. However, repeatability and validity data of these systems are sparse for gait metrics. The purpose of this study was to determine the validity and between-day repeatability of spatiotemporal metrics (gait speed, stance percent, swing percent, gait cycle time, stride length, cadence, and step duration) as measured with the APDM Opal IMUs and Mobility Lab system. We collected data on 39 healthy subjects. Subjects were tested over two days while walking on a standard treadmill, split-belt treadmill, or overground, with IMUs placed in two locations: both feet and both ankles. The spatiotemporal measurements taken with the IMU system were validated against data from an instrumented treadmill, or using standard clinical procedures. Repeatability and minimally detectable change (MDC) of the system was calculated between days. IMUs displayed high to moderate validity when measuring most of the gait metrics tested. Additionally, these measurements appear to be repeatable when used on the treadmill and overground. The foot configuration of the IMUs appeared to better measure gait parameters; however, both the foot and ankle configurations demonstrated good repeatability. In conclusion, the IMU system in this study appears to be both accurate and repeatable for measuring spatiotemporal gait parameters in healthy young adults. Copyright © 2017 Elsevier B.V. All rights reserved.

What can management theories offer evidence-based practice? A comparative analysis of measurement tools for organisational context

PubMed Central

French, Beverley; Thomas, Lois H; Baker, Paula; Burton, Christopher R; Pennington, Lindsay; Roddam, Hazel

2009-01-01

Background Given the current emphasis on networks as vehicles for innovation and change in health service delivery, the ability to conceptualise and measure organisational enablers for the social construction of knowledge merits attention. This study aimed to develop a composite tool to measure the organisational context for evidence-based practice (EBP) in healthcare. Methods A structured search of the major healthcare and management databases for measurement tools from four domains: research utilisation (RU), research activity (RA), knowledge management (KM), and organisational learning (OL). Included studies were reports of the development or use of measurement tools that included organisational factors. Tools were appraised for face and content validity, plus development and testing methods. Measurement tool items were extracted, merged across the four domains, and categorised within a constructed framework describing the absorptive and receptive capacities of organisations. Results Thirty measurement tools were identified and appraised. Eighteen tools from the four domains were selected for item extraction and analysis. The constructed framework consists of seven categories relating to three core organisational attributes of vision, leadership, and a learning culture, and four stages of knowledge need, acquisition of new knowledge, knowledge sharing, and knowledge use. Measurement tools from RA or RU domains had more items relating to the categories of leadership, and acquisition of new knowledge; while tools from KM or learning organisation domains had more items relating to vision, learning culture, knowledge need, and knowledge sharing. There was equal emphasis on knowledge use in the different domains. Conclusion If the translation of evidence into knowledge is viewed as socially mediated, tools to measure the organisational context of EBP in healthcare could be enhanced by consideration of related concepts from the organisational and management sciences

Assessing reliability and validity measures in managed care studies.

PubMed

Montoya, Isaac D

2003-01-01

To review the reliability and validity literature and develop an understanding of these concepts as applied to managed care studies. Reliability is a test of how well an instrument measures the same input at varying times and under varying conditions. Validity is a test of how accurately an instrument measures what one believes is being measured. A review of reliability and validity instructional material was conducted. Studies of managed care practices and programs abound. However, many of these studies utilize measurement instruments that were developed for other purposes or for a population other than the one being sampled. In other cases, instruments have been developed without any testing of the instrument's performance. The lack of reliability and validity information may limit the value of these studies. This is particularly true when data are collected for one purpose and used for another. The usefulness of certain studies without reliability and validity measures is questionable, especially in cases where the literature contradicts itself

Validating a simple discharge planning tool following hospital admission for an isolated lower limb fracture.

PubMed

Kimmel, Lara A; Holland, Anne E; Simpson, Pam M; Edwards, Elton R; Gabbe, Belinda J

2014-07-01

Early, accurate prediction of discharge destination from the acute hospital assists individual patients and the wider hospital system. The Trauma Rehabilitation and Prediction Tool (TRaPT), developed using registry data, determines probability of inpatient rehabilitation discharge for patients with isolated lower limb fractures. The aims of this study were: (1) to prospectively validatate the TRaPT, (2) to assess whether its performance could be improved by adding additional demographic data, and (3) to simplify it for use as a bedside tool. This was a cohort, measurement-focused study. Patients with isolated lower limb fractures (N=114) who were admitted to a major trauma center in Melbourne, Australia, were included. The participants' TRaPT scores were calculated from admission data. Performance of the TRaPT score alone, and in combination with frailty, weight-bearing status, and home supports, was assessed using measures of discrimination and calibration. A simplified TRaPT was developed by rounding the coefficients of variables in the original model and grouping age into 8 categories. Simplified TRaPT performance measures, including specificity, sensitivity, and positive and negative predictive values, were evaluated. Prospective validation of the TRaPT showed excellent discrimination (C-statistic=0.90 [95% confidence interval=0.82, 0.97]), a sensitivity of 80%, and specificity of 94%. All participants able to weight bear were discharged directly home. Simplified TRaPT scores had a sensitivity of 80% and a specificity of 88%. Generalizability may be limited given the compensation system that exists in Australia, but the methods used will assist in designing a similar tool in any population. The TRaPT accurately predicted discharge destination for 80% of patients and may form a useful aid for discharge decision making, with the simplified version facilitating its use as a bedside tool. © 2014 American Physical Therapy Association.

The development and validation of the clinicians' awareness towards cognitive errors (CATChES) in clinical decision making questionnaire tool.

PubMed

Chew, Keng Sheng; Kueh, Yee Cheng; Abdul Aziz, Adlihafizi

2017-03-21

Despite their importance on diagnostic accuracy, there is a paucity of literature on questionnaire tools to assess clinicians' awareness toward cognitive errors. A validation study was conducted to develop a questionnaire tool to evaluate the Clinician's Awareness Towards Cognitive Errors (CATChES) in clinical decision making. This questionnaire is divided into two parts. Part A is to evaluate the clinicians' awareness towards cognitive errors in clinical decision making while Part B is to evaluate their perception towards specific cognitive errors. Content validation for both parts was first determined followed by construct validation for Part A. Construct validation for Part B was not determined as the responses were set in a dichotomous format. For content validation, all items in both Part A and Part B were rated as "excellent" in terms of their relevance in clinical settings. For construct validation using exploratory factor analysis (EFA) for Part A, a two-factor model with total variance extraction of 60% was determined. Two items were deleted. Then, the EFA was repeated showing that all factor loadings are above the cut-off value of >0.5. The Cronbach's alpha for both factors are above 0.6. The CATChES questionnaire tool is a valid questionnaire tool aimed to evaluate the awareness among clinicians toward cognitive errors in clinical decision making.

Validation of the Mobile Information Software Evaluation Tool (MISET) With Nursing Students.

PubMed

Secco, M Loretta; Furlong, Karen E; Doyle, Glynda; Bailey, Judy

2016-07-01

This study evaluated the Mobile Information Software Evaluation Tool (MISET) with a sample of Canadian undergraduate nursing students (N = 240). Psychometric analyses determined how well the MISET assessed the extent that nursing students find mobile device-based information resources useful and supportive of learning in the clinical and classroom settings. The MISET has a valid three-factor structure with high explained variance (74.7%). Internal consistency reliabilities were high for the MISET total (.90) and three subscales: Usefulness/Helpfulness, Information Literacy Support, and Use of Evidence-Based Sources (.87 to .94). Construct validity evidence included significantly higher mean total MISET, Helpfulness/Usefulness, and Information Literacy Support scores for senior students and those with higher computer competence. The MISET is a promising tool to evaluate mobile information technologies and information literacy support; however, longitudinal assessment of changes in scores over time would determine scale sensitivity and responsiveness. [J Nurs Educ. 2016;55(7):385-390.]. Copyright 2016, SLACK Incorporated.

Sustained Implementation Support Scale: Validation of a Measure of Program Characteristics and Workplace Functioning for Sustained Program Implementation.

PubMed

Hodge, Lauren M; Turner, Karen M T; Sanders, Matthew R; Filus, Ania

2017-07-01

An evaluation measure of enablers and inhibitors to sustained evidence-based program (EBP) implementation may provide a useful tool to enhance organizations' capacity. This paper outlines preliminary validation of such a measure. An expert informant and consumer feedback approach was used to tailor constructs from two existing measures assessing key domains associated with sustained implementation. Validity and reliability were evaluated for an inventory composed of five subscales: Program benefits, Program burden, Workplace support, Workplace cohesion, and Leadership style. Exploratory and confirmatory factor analysis with a sample of 593 Triple P-Positive Parenting Program-practitioners led to a 28-item scale with good reliability and good convergent, discriminant, and predictive validity. Practitioners sustaining implementation at least 3 years post-training were more likely to have supervision/peer support, reported higher levels of program benefit, workplace support, and positive leadership style, and lower program burden compared to practitioners who were non-sustainers.

The Dartmouth COOP Charts: a simple, reliable, valid and responsive quality of life tool for chronic obstructive pulmonary disease.

PubMed

Eaton, T; Young, P; Fergusson, W; Garrett, J E; Kolbe, J

2005-04-01

The negative impact of chronic obstructive pulmonary disease (COPD) on health-related quality of life (HRQL) is substantial. Measurement of HRQL is increasingly advocated in clinical practice; traditional outcome measures such as lung function are poorly responsive. However many HRQL tools are not user-friendly in the clinic setting. Hence HRQL is often neglected. The Dartmouth Cooperative Functional Assessment Charts (COOP) have the requisite attributes of a tool suitable for routine clinical practice: they are simple, reliable, quick and easy to perform and score and well accepted. We aimed to determine the reliability, validity and responsiveness of the COOP in patients with significant COPD. HRQL was assessed during a prospective, randomised, placebo-controlled, double-blind, 12 week cross-over interventional study of ambulatory oxygen in patients (n = 50) with COPD. Test-retest reliability of the COOP domains was only modest however it was measured over a 2 month period. Significant correlations ranging between 0.4 and 0.8 were observed between all comparable domains of the COOP and the Medical Outcomes Study 36-item Short-form Health Survey, Chronic Respiratory Questionnaire (CRQ) and Hospital Anxiety and Depression (HAD) scale. Following ambulatory oxygen significant improvements were noted in all CRQ and HAD domains. Several domains of the generic SF-36 (role emotional, social functioning, role-physical) showed significant improvements. Comparable domains of the COOP (social activities, feelings) also showed significant improvements. The COOP change in health domain improved very significantly. The COOP is a simple, reliable HRQL tool which proved valid and responsive in our study population of COPD patients and may have a valuable role in routine clinical practice.

The Healthy Meal Index: A tool for measuring the healthfulness of meals served to children

PubMed Central

Kasper, Nicole; Mandell, Cami; Ball, Sarah; Miller, Alison L.; Lumeng, Julie; Peterson, Karen E

2017-01-01

Family meals have been associated with higher diet quality and reduced risk of obesity in children. Observational studies of the family meal have been employed with increasing frequency, yet there is currently no tool available for measuring the healthfulness of food served during the meal. Here we present the development and validation of the Healthy Meal Index (HMI), a novel tool for scoring the healthfulness of foods served to children during a meal, as well as sociodemographic predictors of meal scores. Parents of 233 children, aged 4–8 years, self-recorded three home dinners. A research assistant obtained a list of foods available during the meal (meal report) via phone call on the night of each video-recorded meal. This meal report was coded into component foods groups. Subsequently, meals were scored based on the availability of more healthy “Adequacy foods” and the absence of “Moderation foods”, (of which reduced consumption is recommended, according to pediatric dietary guidelines). Adjusted linear regression tested the association of sociodemographic characteristics with HMI scores. A validation study was conducted in a separate sample of 133 children with detailed meal data. In adjusted models, female children had higher HMI Moderation scores (p=0.02), but did not differ in HMI Adequacy or Total scores. Parents with more education served meals with higher HMI Adequacy (p=0.001) and Total scores (p=0.001), though no significant difference was seen in HMI Moderation score (p=0.21). The validation study demonstrated that the HMI was highly correlated with servings of foods and nutrients estimated from observations conducted by research staff. The HMI is a valuable tool for measuring the quality of meals served to children. PMID:26994739

The Healthy Meal Index: A tool for measuring the healthfulness of meals served to children.

PubMed

Kasper, Nicole; Mandell, Cami; Ball, Sarah; Miller, Alison L; Lumeng, Julie; Peterson, Karen E

2016-08-01

Family meals have been associated with higher diet quality and reduced risk of obesity in children. Observational studies of the family meal have been employed with increasing frequency, yet there is currently no tool available for measuring the healthfulness of food served during the meal. Here we present the development and validation of the Healthy Meal Index (HMI), a novel tool for scoring the healthfulness of foods served to children during a meal, as well as sociodemographic predictors of meal scores. Parents of 233 children, aged 4-8 years, self-recorded three home dinners. A research assistant obtained a list of foods available during the meal (meal report) via phone call on the night of each video-recorded meal. This meal report was coded into component food groups. Subsequently, meals were scored based on the availability of more healthy "Adequacy foods" and the absence of "Moderation foods", (of which reduced consumption is recommended, according to pediatric dietary guidelines). Adjusted linear regression tested the association of sociodemographic characteristics with HMI scores. A validation study was conducted in a separate sample of 133 children with detailed meal data. In adjusted models, female children had higher HMI Moderation scores (p = 0.02), but did not differ in HMI Adequacy or Total scores. Parents with more education served meals with higher HMI Adequacy (p = 0.001) and Total scores (p = 0.001), though no significant difference was seen in HMI Moderation score (p = 0.21). The validation study demonstrated that the HMI was highly correlated with servings of foods and nutrients estimated from observations conducted by research staff. The HMI is a valuable tool for measuring the quality of meals served to children. Copyright © 2016. Published by Elsevier Ltd.

Validity of Measured Interest for Decided and Undecided Students.

ERIC Educational Resources Information Center

Bartling, Herbert C.; Hood, Albert B.

The usefulness of vocational interest measures has been questioned by those who have studied the predictive validity of expressed choice. The predictive validities of measured interest for decided and undecided students, expressed choice and measured interest, and expressed choice and measured interest when they are congruent and incongruent were…

Validation of an iPad activity to measure preschool children's food and physical activity knowledge and preferences.

PubMed

Wiseman, Nicola; Harris, Neil; Downes, Martin

2017-02-01

Preschool children's knowledge of, and preference for food and physical activity play an important role in the development of lifestyle behaviors throughout childhood. Valid and reliable instruments that are interactive and appealing to preschool children are needed, to obtain quality information in a way that actively engages children and encourages willing participation. The purpose of the current research is to assess the reliability and validity of an adapted computerized (iPad) version of the photo-pair food and exercise questionnaire (PPFEQ). The adaptation of the PPFEQ involved generating the questionnaire as an iPad-based tool, updating the photo-pairs within the questionnaire and testing for validity and reliability. This involved four phases of investigation to assess test-retest reliability, internal consistency, sensitivity to change and percent agreement of the questionnaire. The adaption of the PPFEQ resulted in an 18-item questionnaire, titled the preschool food and play questionnaire (Pre-FPQ). The Pre-FPQ demonstrated acceptable reliability and sensitivity to change. Test-retest reliability and internal consistency improved with age, however, it was evident that the tool was not suitable for children younger than 4 years of age. Children encounter a dynamic world that shapes their knowledge, preferences, choices and behaviors. The Pre-FPQ is an innovative tool to measure preschool children's knowledge of and preference for food and physical activity. The questionnaire offers the advantage of being presented in a well-received modality for preschool children as well as being easy and inexpensive to administer. This new tool is likely to be useful for the assessment of the effectiveness of healthy lifestyle programs implemented in the childcare setting. Future work is needed to refine and improve measures of physical activity preference in preschool children.

Validation of the Arabic version of the score for allergic rhinitis tool.

PubMed

Alharethy, Sami; Wedami, Mawaheb Al; Syouri, Falah; Alqabbani, Almaha A; Baqays, Abdulsalam; Mesallam, Tamer; Aldrees, Turki

2017-01-01

Allergic rhinitis (AR) is a common inflammation of the nasal mucosa in response to allergen exposure. We translated and validated the Score for Allergic Rhinitis (SFAR) into an Arabic version so that the disease can be studied in an Arabic population. SFAR is a non-invasive self-administered tool that evaluates eight items related to AR. This study aimed to translate and culturally adapt the SFAR questionnaire into Arabic, and assess the validity, consistency, and reliability of the translated version in an Arabic-speaking population of patients with suspected AR. Cross-sectional. Tertiary care hospital in Riyadh. The Arabic version of the SFAR was administered to patients with suspected AR and control participants. Comparison of the AR and control groups to determine the test-retest reliability and internal consistency of the instrument. The AR (n=173) and control (n=75) groups had significantly different Arabic SFAR scores (P < .0001). The instrument provided satisfactory internal consistency (Cronbach's alpha value of 0.7). The test-retest reliability was excellent for the total Arabic SFAR score (r =0.836, P < .0001). These findings demonstrate that the Arabic version of the SFAR is a valid tool that can be used to screen Arabic speakers with suspected AR. The absence of objective allergy testing.

Validation of a 4-item Negative Symptom Assessment (NSA-4): a short, practical clinical tool for the assessment of negative symptoms in schizophrenia.

PubMed

Alphs, Larry; Morlock, Robert; Coon, Cheryl; Cazorla, Pilar; Szegedi, Armin; Panagides, John

2011-06-01

The 16-item Negative Symptom Assessment (NSA-16) scale is a validated tool for evaluating negative symptoms of schizophrenia. The psychometric properties and predictive power of a four-item version (NSA-4) were compared with the NSA-16. Baseline data from 561 patients with predominant negative symptoms of schizophrenia who participated in two identically designed clinical trials were evaluated. Ordered logistic regression analysis of ratings using NSA-4 and NSA-16 were compared with ratings using several other standard tools to determine predictive validity and construct validity. Internal consistency and test--retest reliability were also analyzed. NSA-16 and NSA-4 scores were both predictive of scores on the NSA global rating (odds ratio = 0.83-0.86) and the Clinical Global Impressions--Severity scale (odds ratio = 0.91-0.93). NSA-16 and NSA-4 showed high correlation with each other (Pearson r = 0.85), similar high correlation with other measures of negative symptoms (demonstrating convergent validity), and lesser correlations with measures of other forms of psychopathology (demonstrating divergent validity). NSA-16 and NSA-4 both showed acceptable internal consistency (Cronbach α, 0.85 and 0.64, respectively) and test--retest reliability (intraclass correlation coefficient, 0.87 and 0.82). This study demonstrates that NSA-4 offers accuracy comparable to the NSA-16 in rating negative symptoms in patients with schizophrenia. Copyright © 2011 John Wiley & Sons, Ltd.

Validation of a measure of the Satter eating competence model with low-income females.

PubMed

Krall, Jodi S; Lohse, Barbara

2011-04-07

The purpose of this study was to evaluate the construct validity of a version of the ecSatter Inventory (ecSI), a measure of eating competence (EC), as adapted for use in a low-income (LI) population. Females (n=507), aged 18 to 45 years, living in households with a history of participating in the Supplemental Nutrition Assistance Program completed a web-based survey that included the ecSI for LI (ecSI/LI) and valid measures of cognitive and affective eating behavior, food preference and practice, and food preparation. Most correlations and differences between eating competent and non-eating competent categories and among EC tertiles were compatible with hypothesized relationships. ecSI/LI scores were positively related with self-reported physical activity, food acceptance, fruit and vegetable intake, and food planning/resource management. ecSI/LI scores were negatively associated with body mass index, dissatisfaction with body weight, tendency to overeat in response to external or emotional stimuli, and indices of psychosocial attributes related to disordered eating. The ecSI/LI is a valid measure of EC for low-income females and provides a tool for researchers and educators to assess intervention outcomes and further explore the EC construct. © 2011 Krall and Lohse; licensee BioMed Central Ltd.

Validation of a measure of the Satter eating competence model with low-income females

PubMed Central

2011-01-01

Background The purpose of this study was to evaluate the construct validity of a version of the ecSatter Inventory (ecSI), a measure of eating competence (EC), as adapted for use in a low-income (LI) population. Methods Females (n = 507), aged 18 to 45 years, living in households with a history of participating in the Supplemental Nutrition Assistance Program completed a web-based survey that included the ecSI for LI (ecSI/LI) and valid measures of cognitive and affective eating behavior, food preference and practice, and food preparation. Results Most correlations and differences between eating competent and non-eating competent categories and among EC tertiles were compatible with hypothesized relationships. ecSI/LI scores were positively related with self-reported physical activity, food acceptance, fruit and vegetable intake, and food planning/resource management. ecSI/LI scores were negatively associated with body mass index, dissatisfaction with body weight, tendency to overeat in response to external or emotional stimuli, and indices of psychosocial attributes related to disordered eating. Conclusions The ecSI/LI is a valid measure of EC for low-income females and provides a tool for researchers and educators to assess intervention outcomes and further explore the EC construct. PMID:21473765

Developing and testing a measurement tool for assessing predictors of breakfast consumption based on a health promotion model.

PubMed

Dehdari, Tahereh; Rahimi, Tahereh; Aryaeian, Naheed; Gohari, Mahmood Reza; Esfeh, Jabiz Modaresi

2014-01-01

To develop an instrument for measuring Health Promotion Model constructs in terms of breakfast consumption, and to identify the constructs that were predictors of breakfast consumption among Iranian female students. A questionnaire on Health Promotion Model variables was developed and potential predictors of breakfast consumption were assessed using this tool. One hundred female students, mean age 13 years (SD ± 1.2 years). Two middle schools from moderate-income areas in Qom, Iran. Health Promotion Model variables were assessed using a 58-item questionnaire. Breakfast consumption was also measured. Internal consistency (Cronbach alpha), content validity index, content validity ratio, multiple linear regression using stepwise method, and Pearson correlation. Content validity index and content validity ratio scores of the developed scale items were 0.89 and 0.93, respectively. Internal consistencies (range, .74-.91) of subscales were acceptable. Prior related behaviors, perceived barriers, self-efficacy, and competing demand and preferences were 4 constructs that could predict 63% variance of breakfast frequency per week among subjects. The instrument developed in this study may be a useful tool for researchers to explore factors affecting breakfast consumption among students. Students with a high level of self-efficacy, more prior related behavior, fewer perceived barriers, and fewer competing demands were most likely to regularly consume breakfast. Copyright © 2014 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Implementation of a digital preparation validation tool in dental skills laboratory training.

PubMed

Kozarovska, A; Larsson, C

2018-05-01

To describe the implementation of a digital tool for preparation validation and evaluate it as an aid in students' self-assessment. Students at the final semester of skills laboratory training were asked to use a digital preparation validation tool (PVT) when performing two different tasks; preparation of crowns for teeth 11 and 21. The students were divided into two groups. Group A self-assessed and scanned all three attempts at 21 ("prep-and-scan"). Group B self-assessed all attempts chose the best one and scanned it ("best-of-three"). The situation was reversed for 11. The students assessed five parameters of the preparation and marked them as approved (A) or failed (F). These marks were compared with the information from the PVT. The students also completed a questionnaire. Each question was rated from 1 to 5. Teachers' opinions were collected at staff meetings throughout the project. Most students in the "prep-and-scan" groups showed an increase in agreement between their self-assessment and the information from the PVT, whereas students in the "best-of-three" groups showed lower levels of agreement. All students rated the PVT positively. Most strongly agreed that the tool was helpful in developing skills (mean 4.15), easy to use (mean 4.23) and that it added benefits in comparison to existing assessment tools (mean 4.05). They did not however, fully agree that the tool is time efficient (mean 2.55), and they did not consider it a substitute for verbal teacher feedback. Teachers' feedback suggested advantages of the tool in the form of ease of use, visual aid and increasing interest and motivation during skills laboratory training however, they did not notice a reduction in need of verbal feedback. Within the limitations of the study, our conclusion is that a digital PVT may be a valuable adjunct to other assessment tools in skills laboratory training. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.

[Spanish translation and validation of the EMPATHIC-30 questionnaire to measure parental satisfaction in intensive care units].

PubMed

Pilar Orive, Francisco Javier; Basabe Lozano, Jasone; López Zuñiga, Aurora; López Fernández, Yolanda M; Escudero Argaluza, Julene; Latour, Jos M

2017-11-03

Few validated surveys measuring parental satisfaction in the Paediatric Intensive Care Unit (PICU) are available, and none of them in Spanish language. The aim of this study is to translate and validate the questionnaire EMpowerment of PArents in THe Intensive Care (EMPATHIC). This questionnaire measures parental perceptions of paediatric intensive care-related satisfaction items in the Spanish language. A prospective cohort study was carried out using questionnaires completed by relatives of children (range 0-17 years old) admitted into a tertiary PICU. Inclusion criteria were a length of stay more than 24h, and a suitable understanding of Spanish language by parents or guardians. Exclusion criteria were re-admissions and deceased patients. The questionnaire was translated from English to Spanish language using a standardised procedure, after which it was used in a cross-sectional observational study was performed to confirm its validity and consistency. Reliability was estimated using Cronbach's α, and content validity using Spearman's correlation analysis. A total of 150 questionnaires were collected. A Cronbach's α was obtained for domains greater than 0.7, showing a high internal consistency from the questionnaire. Validity was measured by correlating 5 domains with 4 general satisfaction items, documenting an adequate correlation (Rs: 0.41-0.66, P<.05). The Spanish version of EMPHATIC 30 is a feasible, easy, and suitable tool in this specific environment, based on the results. EMPATHIC 30 is able to measure parental satisfaction, and may serve as a valid indicator to measure quality of care in Spanish PICUs. Copyright © 2017. Publicado por Elsevier España, S.L.U.

Validation Analysis of a Geriatric Dehydration Screening Tool in Community-Dwelling and Institutionalized Elderly People

PubMed Central

Rodrigues, Susana; Silva, Joana; Severo, Milton; Inácio, Cátia; Padrão, Patrícia; Lopes, Carla; Carvalho, Joana; do Carmo, Isabel; Moreira, Pedro

2015-01-01

Dehydration is common among elderly people. The aim of this study was to perform validation analysis of a geriatric dehydration-screening tool (DST) in the assessment of hydration status in elderly people. This tool was based on the DST proposed by Vivanti et al., which is composed by 11 items (four physical signs of dehydration and seven questions about thirst sensation, pain and mobility), with four questions extra about drinking habits. The resulting questionnaire was evaluated in a convenience sample comprising institutionalized (n = 29) and community-dwelling (n = 74) elderly people. Urinary parameters were assessed (24-h urine osmolality and volume) and free water reserve (FWR) was calculated. Exploratory factor analysis was used to evaluate the scale’s dimensionality and Cronbach’s alpha was used to measure the reliability of each subscale. Construct’s validity was tested using linear regression to estimate the association between scores in each dimension and urinary parameters. Two factors emerged from factor analysis, which were named “Hydration Score” and “Pain Score”, and both subscales showed acceptable reliabilities. The “Hydration Score” was negatively associated with 24-h urine osmolality in community-dwelling; and the “Pain Score” was negatively associated with 24-h urine osmolality, and positively associated with 24-h urine volume and FWR in institutionalized elderly people. PMID:25739005

Reliability and validity of a scale to measure consumer attitudes regarding the private food safety certification of restaurants.

PubMed

Uggioni, Paula Lazzarin; Salay, Elisabete

2012-04-01

Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.

A Web-based Google-Earth Coincident Imaging Tool for Satellite Calibration and Validation

NASA Astrophysics Data System (ADS)

Killough, B. D.; Chander, G.; Gowda, S.

2009-12-01

The Group on Earth Observations (GEO) is coordinating international efforts to build a Global Earth Observation System of Systems (GEOSS) to meet the needs of its nine “Societal Benefit Areas”, of which the most demanding, in terms of accuracy, is climate. To accomplish this vision, satellite on-orbit and ground-based data calibration and validation (Cal/Val) of Earth observation measurements are critical to our scientific understanding of the Earth system. Existing tools supporting space mission Cal/Val are often developed for specific campaigns or events with little desire for broad application. This paper describes a web-based Google-Earth based tool for the calculation of coincident satellite observations with the intention to support a diverse international group of satellite missions to improve data continuity, interoperability and data fusion. The Committee on Earth Observing Satellites (CEOS), which includes 28 space agencies and 20 other national and international organizations, are currently operating and planning over 240 Earth observation satellites in the next 15 years. The technology described here will better enable the use of multiple sensors to promote increased coordination toward a GEOSS. The CEOS Systems Engineering Office (SEO) and the Working Group on Calibration and Validation (WGCV) support the development of the CEOS Visualization Environment (COVE) tool to enhance international coordination of data exchange, mission planning and Cal/Val events. The objective is to develop a simple and intuitive application tool that leverages the capabilities of Google-Earth web to display satellite sensor coverage areas and for the identification of coincident scene locations along with dynamic menus for flexibility and content display. Key features and capabilities include user-defined evaluation periods (start and end dates) and regions of interest (rectangular areas) and multi-user collaboration. Users can select two or more CEOS missions from a

Validation of the World Health Organization tool for situational analysis to assess emergency and essential surgical care at district hospitals in Ghana.