The Validation by Measurement Theory of Proposed Object-Oriented Software Metrics
NASA Technical Reports Server (NTRS)
Neal, Ralph D.
1996-01-01
Moving software development into the engineering arena requires controllability, and to control a process, it must be measurable. Measuring the process does no good if the product is not also measured, i.e., being the best at producing an inferior product does not define a quality process. Also, not every number extracted from software development is a valid measurement. A valid measurement only results when we are able to verify that the number is representative of the attribute that we wish to measure. Many proposed software metrics are used by practitioners without these metrics ever having been validated, leading to costly but often useless calculations. Several researchers have bemoaned the lack of scientific precision in much of the published software measurement work and have called for validation of software metrics by measurement theory. This dissertation applies measurement theory to validate fifty proposed object-oriented software metrics.
Assessing the validity of sales self-efficacy: a cautionary tale.
Gupta, Nina; Ganster, Daniel C; Kepes, Sven
2013-07-01
We developed a focused, context-specific measure of sales self-efficacy and assessed its incremental validity against the broad Big 5 personality traits with department store salespersons, using (a) both a concurrent and a predictive design and (b) both objective sales measures and supervisory ratings of performance. We found that in the concurrent study, sales self-efficacy predicted objective and subjective measures of job performance more than did the Big 5 measures. Significant differences between the predictability of subjective and objective measures of performance were not observed. Predictive validity coefficients were generally lower than concurrent validity coefficients. The results suggest that there are different dynamics operating in concurrent and predictive designs and between broad and contextualized measures; they highlight the importance of distinguishing between these designs and measures in meta-analyses. The results also point to the value of focused, context-specific personality predictors in selection research. PsycINFO Database Record (c) 2013 APA, all rights reserved.
There is a lack of validation of self-reported cognitive problems with objective neuropsychological measures. The validity of four self-reported cognitive items from a health questionnaire (HQ) and the Symptoms Checklist 90-Revised (SCL-90-R) was examined with objective clinical ...
The validation by measurement theory of proposed object-oriented software metrics
NASA Technical Reports Server (NTRS)
Neal, Ralph D.
1994-01-01
Moving software development into the engineering arena requires controllability, and to control a process, it must be measurable. Measuring the process does no good if the product is not also measured, i.e., being the best at producing an inferior product does not define a quality process. Also, not every number extracted from software development is a valid measurement. A valid measurement only results when we are able to verify that the number is representative of the attribute that we wish to measure. Many proposed software metrics are used by practitioners without these metrics ever having been validated, leading to costly but often useless calculations. Several researchers have bemoaned the lack of scientific precision in much of the published software measurement work and have called for validation of software metrics by measurement theory. This dissertation applies measurement theory to validate fifty proposed object-oriented software metrics (Li and Henry, 1993; Chidamber and Kemerrer, 1994; Lorenz and Kidd, 1994).
Pazira, Parvin; Rostami Haji-Abadi, Mahdi; Zolaktaf, Vahid; Sabahi, Mohammadfarzan; Pazira, Toomaj
2016-06-08
In relation to statistical analysis, studies to determine the validity, reliability, objectivity and precision of new measuring devices are usually incomplete, due in part to using only correlation coefficient and ignoring the data dispersion. The aim of this study was to demonstrate the best way to determine the validity, reliability, objectivity and accuracy of an electro-inclinometer or other measuring devices. Another purpose of this study is to answer the question of whether reliability and objectivity represent accuracy of measuring devices. The validity of an electro-inclinometer was examined by mechanical and geometric methods. The objectivity and reliability of the device was assessed by calculating Cronbach's alpha for repeated measurements by three raters and by measurements on the same person by mechanical goniometer and the electro-inclinometer. Measurements were performed on "hip flexion with the extended knee" and "shoulder abduction with the extended elbow." The raters measured every angle three times within an interval of two hours. The three-way ANOVA was used to determine accuracy. The results of mechanical and geometric analysis showed that validity of the electro-inclinometer was 1.00 and level of error was less than one degree. Objectivity and reliability of electro-inclinometer was 0.999, while objectivity of mechanical goniometer was in the range of 0.802 to 0.966 and the reliability was 0.760 to 0.961. For hip flexion, the difference between raters in joints angle measurement by electro-inclinometer and mechanical goniometer was 1.74 and 16.33 degree (P<0.05), respectively. The differences for shoulder abduction measurement by electro-inclinometer and goniometer were 0.35 and 4.40 degree (P<0.05). Although both the objectivity and reliability are acceptable, the results showed that measurement error was very high in the mechanical goniometer. Therefore, it can be concluded that objectivity and reliability alone cannot determine the accuracy of a device and it is preferable to use other statistical methods to compare and evaluate the accuracy of these two devices.
Measurement of Harm Outcomes in Older Adults after Hospital Discharge: Reliability and Validity
Douglas, Alison; Letts, Lori; Eva, Kevin; Richardson, Julie
2012-01-01
Objectives. Defining and validating a measure of safety contributes to further validation of clinical measures. The objective was to define and examine the psychometric properties of the outcome “incidents of harm.” Methods. The Incident of Harm Caregiver Questionnaire was administered to caregivers of older adults discharged from hospital by telephone. Caregivers completed daily logs for one month and medical charts were examined. Results. Test-retest reliability (n = 38) was high for the occurrence of an incident of harm (yes/no; kappa = 1.0) and the type of incident (agreement = 100%). Validation against daily logs found no disagreement regarding occurrence or types of incidents. Validation with medical charts found no disagreement regarding incident occurrence and disagreement in half regarding incident type. Discussion. The data support the Incident of Harm Caregiver Questionnaire as a reliable and valid estimation of incidents for this sample and are important to researchers as a method to measure safety when validating clinical measures. PMID:22649728
An Improved Suite of Object Oriented Software Measures
NASA Technical Reports Server (NTRS)
Neal, Ralph D.; Weistroffer, H. Roland; Coppins, Richard J.
1997-01-01
In the pursuit of ever increasing productivity, the need to be able to measure specific aspects of software is generally agreed upon. As object oriented programming languages are becoming more and more widely used, metrics specifically designed for object oriented software are required. In recent years there has been an explosion of new, object oriented software metrics proposed in the literature. Unfortunately, many or most of these proposed metrics have not been validated to measure what they claim to measure. In fact, an analysis of many of these metrics shows that they do not satisfy basic properties of measurement theory, and thus their application has to be suspect. In this paper ten improved metrics are proposed and are validated using measurement theory.
ERIC Educational Resources Information Center
Daigneault, Pierre-Marc; Jacob, Steve; Tremblay, Joel
2012-01-01
Background: Stakeholder participation is an important trend in the field of program evaluation. Although a few measurement instruments have been proposed, they either have not been empirically validated or do not cover the full content of the concept. Objectives: This study consists of a first empirical validation of a measurement instrument that…
ERIC Educational Resources Information Center
Uggioni, Paula Lazzarin; Salay, Elisabette
2013-01-01
Objective: The objective of this study was to develop a validated and reliable questionnaire to measure consumer knowledge regarding safe practices to prevent microbiological contamination in restaurants and commercial kitchens. Methods: Non-probabilistic samples of individuals were interviewed in the city of Campinas, Brazil. Questionnaire items…
ERIC Educational Resources Information Center
Grotevant, Harold D., Adams, Gerald R.
1984-01-01
Three studies evaluating the reliability and validity of the Objective Measure of Ego Identity Status (OM-EIS) are reported. Two studies analyzed college students' results from the OM-EIS, the Extended Range Vocabulary Test, the Crowne-Marlowe Social Disability Scale and achievement records. Study 3 correlated high school seniors' OM-EIS scores…
Measuring Eating Competence: Psychometric Properties and Validity of the ecSatter Inventory
ERIC Educational Resources Information Center
Lohse, Barbara; Satter, Ellyn; Horacek, Tanya; Gebreselassie, Tesfayi; Oakland, Mary Jane
2007-01-01
Objective: Assess validity of the ecSatter Inventory (ecSI) to measure eating competence (EC). Design: Concurrent administration of ecSI with validated measures of eating behaviors using on-line and paper-pencil formats. Setting: The on-line survey was completed by 370 participants; 462 completed the paper version. Participants: Participants…
Mikkelsen, Sigurd; Vilstrup, Imogen; Lassen, Christina Funch; Kryger, Ann Isabel; Thomsen, Jane Frølund; Andersen, Johan Hviid
2007-01-01
Objective To examine the validity and potential biases in self‐reports of computer, mouse and keyboard usage times, compared with objective recordings. Methods A study population of 1211 people was asked in a questionnaire to estimate the average time they had worked with computer, mouse and keyboard during the past four working weeks. During the same period, a software program recorded these activities objectively. The study was part of a one‐year follow‐up study from 2000–1 of musculoskeletal outcomes among Danish computer workers. Results Self‐reports on computer, mouse and keyboard usage times were positively associated with objectively measured activity, but the validity was low. Self‐reports explained only between a quarter and a third of the variance of objectively measured activity, and were even lower for one measure (keyboard time). Self‐reports overestimated usage times. Overestimation was large at low levels and declined with increasing levels of objectively measured activity. Mouse usage time proportion was an exception with a near 1:1 relation. Variability in objectively measured activity, arm pain, gender and age influenced self‐reports in a systematic way, but the effects were modest and sometimes in different directions. Conclusion Self‐reported durations of computer activities are positively associated with objective measures but they are quite inaccurate. Studies using self‐reports to establish relations between computer work times and musculoskeletal pain could be biased and lead to falsely increased or decreased risk estimates. PMID:17387136
Cross-Validating Chinese Language Mental Health Recovery Measures in Hong Kong
ERIC Educational Resources Information Center
Bola, John; Chan, Tiffany Hill Ching; Chen, Eric HY; Ng, Roger
2016-01-01
Objectives: Promoting recovery in mental health services is hampered by a shortage of reliable and valid measures, particularly in Hong Kong. We seek to cross validate two Chinese language measures of recovery and one of recovery-promoting environments. Method: A cross-sectional survey of people recovering from early episode psychosis (n = 121)…
Mikkelsen, Sigurd; Vilstrup, Imogen; Lassen, Christina Funch; Kryger, Ann Isabel; Thomsen, Jane Frølund; Andersen, Johan Hviid
2007-08-01
To examine the validity and potential biases in self-reports of computer, mouse and keyboard usage times, compared with objective recordings. A study population of 1211 people was asked in a questionnaire to estimate the average time they had worked with computer, mouse and keyboard during the past four working weeks. During the same period, a software program recorded these activities objectively. The study was part of a one-year follow-up study from 2000-1 of musculoskeletal outcomes among Danish computer workers. Self-reports on computer, mouse and keyboard usage times were positively associated with objectively measured activity, but the validity was low. Self-reports explained only between a quarter and a third of the variance of objectively measured activity, and were even lower for one measure (keyboard time). Self-reports overestimated usage times. Overestimation was large at low levels and declined with increasing levels of objectively measured activity. Mouse usage time proportion was an exception with a near 1:1 relation. Variability in objectively measured activity, arm pain, gender and age influenced self-reports in a systematic way, but the effects were modest and sometimes in different directions. Self-reported durations of computer activities are positively associated with objective measures but they are quite inaccurate. Studies using self-reports to establish relations between computer work times and musculoskeletal pain could be biased and lead to falsely increased or decreased risk estimates.
Lai, Jin-Shei; Goodnight, Siera; Downing, Nancy R; Ready, Rebecca E; Paulsen, Jane S; Kratz, Anna L; Stout, Julie C; McCormack, Michael K; Cella, David; Ross, Christopher; Russell, Jenna; Carlozzi, Noelle E
2018-03-01
Cognitive functioning impacts health-related quality of life (HRQOL) for individuals with Huntington disease (HD). The Neuro-QoL includes two patient-reported outcome (PRO) measures of cognition-Executive Function (EF) and General Concerns (GC). These measures have not previously been validated for use in HD. The purpose of this analysis is to evaluate the reliability and validity of the Neuro-QoL Cognitive Function measures for use in HD. Five hundred ten individuals with prodromal or manifest HD completed the Neuro-QoL Cognition measures, two other PRO measures of HRQOL (WHODAS 2.0 and EQ5D), and a depression measure (PROMIS Depression). Measures of functioning The Total Functional Capacity and behavior (Problem Behaviors Assessment) were completed by clinician interview. Objective measures of cognition were obtained using clinician-administered Symbol Digit Modalities Test and the Stroop Test (Word, Color, and Interference). Self-rated, clinician-rated, and objective composite scores were developed. We examined the Neuro-QoL measures for reliability, convergent validity, discriminant validity, and known-groups validity. Excellent reliabilities (Cronbach's alphas ≥ 0.94) were found. Convergent validity was supported, with strong relationships between self-reported measures of cognition. Discriminant validity was supported by less robust correlations between self-reported cognition and other constructs. Prodromal participants reported fewer cognitive problems than manifest groups, and early-stage HD participants reported fewer problems than late-stage HD participants. The Neuro-QoL Cognition measures provide reliable and valid assessments of self-reported cognitive functioning for individuals with HD. Findings support the utility of these measures for assessing self-reported cognition.
Generally objective measurement of human temperature and reading ability: some corollaries.
Stenner, A Jackson; Stone, Mark
2010-01-01
We argue that a goal of measurement is general objectivity: point estimates of a person's measure (height, temperature, and reader ability) should be independent of the instrument and independent of the sample in which the person happens to find herself. In contrast, Rasch's concept of specific objectivity requires only differences (i.e., comparisons) between person measures to be independent of the instrument. We present a canonical case in which there is no overlap between instruments and persons: each person is measured by a unique instrument. We then show what is required to estimate measures in this degenerate case. The canonical case encourages a simplification and reconceptualization of validity and reliability. Not surprisingly, this reconceptualization looks a lot like the way physicists and chemometricians think about validity and measurement error. We animate this presentation with a technology that blurs the distinction between instruction, assessment, and generally objective measurement of reader ability. We encourage adaptation of this model to health outcomes measurement.
Schwertner, Debora Soccal; Oliveira, Raul; Mazo, Giovana Zarpellon; Gioda, Fabiane Rosa; Kelber, Christian Roberto; Swarowsky, Alessandra
2016-05-04
Several posture evaluation devices have been used to detect deviations of the vertebral column. However it has been observed that the instruments present measurement errors related to the equipment, environment or measurement protocol. This study aimed to build, validate, analyze the reliability and describe a measurement protocol for the use of the Posture Evaluation Rotating Platform System (SPGAP, Brazilian abbreviation). The posture evaluation system comprises a Posture Evaluation Rotating Platform, video camera, calibration support and measurement software. Two pilot studies were carried out with 102 elderly individuals (average age 69 years old, SD = ±7.3) to establish a protocol for SPGAP, controlling the measurement errors related to the environment, equipment and the person under evaluation. Content validation was completed with input from judges with expertise in posture measurement. The variation coefficient method was used to validate the measurement by the instrument of an object with known dimensions. Finally, reliability was established using repeated measurements of the known object. Expert content judges gave the system excellent ratings for content validity (mean 9.4 out of 10; SD 1.13). The measurement of an object with known dimensions indicated excellent validity (all measurement errors <1 %) and test-retest reliability. A total of 26 images were needed to stabilize the system. Participants in the pilot studies indicated that they felt comfortable throughout the assessment. The use of only one image can offer measurements that underestimate or overestimate the reality. To verify the images of objects with known dimensions the values for the width and height were, respectively, CV 0.88 (width) and 2.33 (height), SD 0.22 (width) and 0.35 (height), minimum and maximum values 24.83-25.2 (width) and 14.56 - 15.75 (height). In the analysis of different images (similar) of an individual, greater discrepancies were observed in the values found. The cervical index, for example, presented minimum and maximum values of 15.38 and 37.5, a coefficient of variation of 0.29 and a standard deviation of 6.78. The SPGAP was shown to be a valid and reliable instrument for the quantitative analysis of body posture with applicability and clinical use, since it managed to reduce several measurement errors, amongst which parallax distortion.
Photogrammetric Technique for Center of Gravity Determination
NASA Technical Reports Server (NTRS)
Jones, Thomas W.; Johnson, Thomas H.; Shemwell, Dave; Shreves, Christopher M.
2012-01-01
A new measurement technique for determination of the center of gravity (CG) for large scale objects has been demonstrated. The experimental method was conducted as part of an LS-DYNA model validation program for the Max Launch Abort System (MLAS) crew module. The test was conducted on the full scale crew module concept at NASA Langley Research Center. Multi-camera photogrammetry was used to measure the test article in several asymmetric configurations. The objective of these measurements was to provide validation of the CG as computed from the original mechanical design. The methodology, measurement technique, and measurement results are presented.
Development and Validation of the Sorokin Psychosocial Love Inventory for Divorced Individuals
ERIC Educational Resources Information Center
D'Ambrosio, Joseph G.; Faul, Anna C.
2013-01-01
Objective: This study describes the development and validation of the Sorokin Psychosocial Love Inventory (SPSLI) measuring love actions toward a former spouse. Method: Classical measurement theory and confirmatory factor analysis (CFA) were utilized with an a priori theory and factor model to validate the SPSLI. Results: A 15-item scale…
Initial Validation of an Instrument Measuring Psychology-Specific Epistemological Beliefs
ERIC Educational Resources Information Center
Renken, Maggie D.; McMahan, Ethan A.; Nitkova, Martina
2015-01-01
Psychology-specific epistemological beliefs (EBs) are believed to influence students' approach to and performance in psychology courses. However, empirical research on this topic is limited due in part to a lack of well-validated instruments measuring this construct. The primary objective of this research was to develop and validate the…
ERIC Educational Resources Information Center
Pan, Jia-Yan; Wong, Daniel Fu Keung; Chan, Kin Sun; Chan, Cecilia Lai Wan
2008-01-01
Objective: The objective of this study is to develop and validate the Chinese Making Sense of Adversity Scale (CMSAS) to measure the cognitive coping strategies that Chinese people adopt to make sense of adversity. Method: A 12-item CMSAS was developed by in-depth interview and item analysis. The scale was validated with a sample of 627 Chinese…
Koch, Markus; Lunde, Lars-Kristian; Gjulem, Tonje; Knardahl, Stein; Veiersted, Kaj Bo
2016-01-01
To determine the criterion validity of a questionnaire on physical exposures compared to objective measurements at construction and health care sites and to examine exposure variation over several working days. Five hundred ninety-four construction and health care workers answered a baseline questionnaire. The daily activities (standing, moving, sitting, number of steps), postures (inclination of the arm and the trunk), and relative heart rate of 125 participants were recorded continuously over 3-4 working days. At the end of the first measurement day, the participants answered a second questionnaire (workday questionnaire). All objective activity measurements had significant correlations to their respective questions. Among health care workers, there were no correlations between postures and relative heart rate and the baseline questionnaire. The questionnaires overestimated the exposure durations. The highest explained variance in the adjusted models with self-reported variables were found for objectively measured sitting (R2 = 0.559) and arm inclination > 60° (R2 = 0.420). Objective measurements over several days showed a higher reliability compared to single day measurements. Questionnaires cannot provide an accurate description of mechanical exposures. Objective measurements over several days are recommended in occupations with varying tasks.
Ventura, Joseph; Subotnik, Kenneth L; Ered, Arielle; Hellemann, Gerhard S; Nuechterlein, Keith H
2016-04-01
Progress has been made in developing interview-based measures for the assessment of cognitive functioning, such as the Cognitive Assessment Interview (CAI), as co-primary measures that compliment objective neurocognitive assessments and daily functioning. However, a few questions remain, including whether the relationships with objective cognitive measures and daily functioning are high enough to justify the CAI as an co-primary measure and whether patient-only assessments are valid. Participants were first-episode schizophrenia patients (n=60) and demographically-similar healthy controls (n=35), chronic schizophrenia patients (n=38) and demographically similar healthy controls (n=19). Participants were assessed at baseline with an interview-based measure of cognitive functioning (CAI), a test of objective cognitive functioning, functional capacity, and role functioning at baseline, and in the first episode patients again 6 months later (n=28). CAI ratings were correlated with objective cognitive functioning, functional capacity, and functional outcomes in first-episode schizophrenia patients at similar magnitudes as in chronic patients. Comparisons of first-episode and chronic patients with healthy controls indicated that the CAI sensitively detected deficits in schizophrenia. The relationship of CAI Patient-Only ratings with objective cognitive functioning, functional capacity, and daily functioning were comparable to CAI Rater scores that included informant information. These results confirm in an independent sample the relationship of the CAI ratings with objectively measured cognition, functional capacity, and role functioning. Comparison of schizophrenia patients with healthy controls further validates the CAI as an co-primary measure of cognitive deficits. Also, CAI change scores were strongly related to objective cognitive change indicating sensitivity to change. Copyright © 2016 Elsevier B.V. All rights reserved.
Bridges, Patricia H; Carter, Vincent; Rehm, Stephanie; Tintl, Sara Bowers; Halperin, Rebecca; Kniesly, Elizabeth; Pelino, Soni
2013-01-01
Conduct a pilot study to establish the reliability and validity of a survey instrument that directly measures the objectives and content of the APTA CIECP; and measure the self-reported frequency of use of the behaviors taught in the APTA CIECP. Eighteen (18) APTA credentialed CIs. Develop a web-based survey consisting of 58 items representative of the behaviors taught in the APTA CIECP and 8 demographic characteristics. Establish the content validity and reliability of the survey instrument. Conduct a descriptive analysis of the frequency of self-reported use of the behaviors. The APTA Clinical Instructor Education Board (CIEB) reviewed the items and determined that the items matched the objectives and content of the APTA CIECP, thereby establishing content validity. Cronbach's alpha coefficients ranging from 0.79-0.90 confirmed the reliability. The overall mean for all items on a 1-6 scale was 4.81. The content validity and reliability of the survey instrument were established. The outcomes of this pilot study suggest that when measured by a valid and reliable instrument that is representative of the objectives and content of the CIECP, the behaviors taught in the CIECP are being applied in the clinical setting by APTA credentialed clinical instructors.
Modeling the Object-Oriented Space Through Validated Measures
NASA Technical Reports Server (NTRS)
Neal, Ralph D.
1996-01-01
In order to truly understand software and the software development process, software measurement must be better understood. A beginning step toward a better understanding of software measurement is the categorization of the measurements by some meaningful taxonomy. The most meaningful taxonomy would capture the basic nature of the subject oriented (O-O) space. The interesting characteristics of object oriented software offer a starting point for such a categorization of measures. A taxonomy has been developed based on fourteen characteristics of object-oriented software gathered from the literature This taxonomy allows us to easily see gaps and redundancies in the O-O measures. The taxonomy also clearly differentiates among taxa so that there is no ambiguity as to the taxon to which a measure belongs. The taxonomy has been populated with thirty-two measures that have been validated in the narrow sense of Fenton, using measurement theory with Zuse's augmentation.
Koch, Markus; Lunde, Lars-Kristian; Gjulem, Tonje; Knardahl, Stein; Veiersted, Kaj Bo
2016-01-01
Objectives To determine the criterion validity of a questionnaire on physical exposures compared to objective measurements at construction and health care sites and to examine exposure variation over several working days. Methods Five hundred ninety-four construction and health care workers answered a baseline questionnaire. The daily activities (standing, moving, sitting, number of steps), postures (inclination of the arm and the trunk), and relative heart rate of 125 participants were recorded continuously over 3–4 working days. At the end of the first measurement day, the participants answered a second questionnaire (workday questionnaire). Results All objective activity measurements had significant correlations to their respective questions. Among health care workers, there were no correlations between postures and relative heart rate and the baseline questionnaire. The questionnaires overestimated the exposure durations. The highest explained variance in the adjusted models with self-reported variables were found for objectively measured sitting (R2 = 0.559) and arm inclination > 60° (R2 = 0.420). Objective measurements over several days showed a higher reliability compared to single day measurements. Conclusions Questionnaires cannot provide an accurate description of mechanical exposures. Objective measurements over several days are recommended in occupations with varying tasks. PMID:27649499
Seeking Empirical Validity in an Assurance of Learning System
ERIC Educational Resources Information Center
Avery, Sherry L.; McWhorter, Rochell R.; Lirely, Roger; Doty, H. Harold
2014-01-01
Business schools have established measurement tools to support their assurance of learning (AoL) systems and to assess student achievement of learning objectives. However, business schools have not required their tools to be empirically validated, thus ensuring that they measure what they are intended to measure. The authors propose confirmatory…
Gupta, Nidhi; Jensen, Bjørn Søvsø; Søgaard, Karen; Carneiro, Isabella Gomes; Christiansen, Caroline Stordal; Hanisch, Christiana; Holtermann, Andreas
2014-01-01
Purpose: The purpose of this study was to investigate the face validity of the self-reported single item work ability with objectively measured heart rate reserve (%HRR) among blue-collar workers. Methods: We utilized data from 127 blue-collar workers (Female = 53; Male = 74) aged 18–65 years from the cross-sectional “New method for Objective Measurements of physical Activity in Daily living (NOMAD)” study. The workers reported their single item work ability and completed an aerobic capacity cycling test and objective measurements of heart rate reserve monitored with Actiheart for 3–4 days with a total of 5,810 h, including 2,640 working hours. Results: A significant moderate correlation between work ability and %HRR was observed among males (R = −0.33, P = 0.005), but not among females (R = 0.11, P = 0.431). In a gender-stratified multi-adjusted logistic regression analysis, males with high %HRR were more likely to report a reduced work ability compared to males with low %HRR [OR = 4.75, 95% confidence interval (95% CI) = 1.31 to 17.25]. However, this association was not found among females (OR = 0.26, 95% CI 0.03 to 2.16), and a significant interaction between work ability, %HRR and gender was observed (P = 0.03). Conclusions: The observed association between work ability and objectively measured %HRR over several days among male blue-collar workers supports the face validity of the single work ability item. It is a useful and valid measure of the relation between physical work demands and resources among male blue-collar workers. The contrasting association among females needs to be further investigated. PMID:24840350
Validity of self-reported solar UVR exposure compared with objectively measured UVR exposure.
Glanz, Karen; Gies, Peter; O'Riordan, David L; Elliott, Tom; Nehl, Eric; McCarty, Frances; Davis, Erica
2010-12-01
Reliance on verbal self-report of solar exposure in skin cancer prevention and epidemiologic studies may be problematic if self-report data are not valid due to systematic errors in recall, social desirability bias, or other reasons. This study examines the validity of self-reports of exposure to ultraviolet radiation (UVR) compared to objectively measured exposure among children and adults in outdoor recreation settings in 4 regions of the United States. Objective UVR exposures of 515 participants were measured using polysulfone film badge UVR dosimeters on 2 days. The same subjects provided self-reported UVR exposure data on surveys and 4-day sun exposure diaries, for comparison to their objectively measured exposure. Dosimeter data showed that lifeguards had the greatest UVR exposure (24.5% of weekday ambient UVR), children the next highest exposures (10.3% ambient weekday UVR), and parents had the lowest (6.6% ambient weekday UVR). Similar patterns were observed in self-report data. Correlations between diary reports and dosimeter findings were fair to good and were highest for lifeguards (r = 0.38-0.57), followed by parents (r = 0.28-0.29) and children (r = 0.18-0.34). Correlations between survey and diary measures were moderate to good for lifeguards (r = 0.20-0.54) and children (r = 0.35-0.53). This is the largest study of its kind to date, and supports the utility of self-report measures of solar UVR exposure. Overall, self-reports of sun exposure produce valid measures of UVR exposure among parents, children, and lifeguards who work outdoors. ©2010 AACR.
The Assignment of Scale to Object-Oriented Software Measures
NASA Technical Reports Server (NTRS)
Neal, Ralph D.; Weistroffer, H. Roland; Coppins, Richard J.
1997-01-01
In order to improve productivity (and quality), measurement of specific aspects of software has become imperative. As object oriented programming languages have become more widely used, metrics designed specifically for object-oriented software are required. Recently a large number of new metrics for object- oriented software has appeared in the literature. Unfortunately, many of these proposed metrics have not been validated to measure what they purport to measure. In this paper fifty (50) of these metrics are analyzed.
A comparison of subjective and objective measures of physical activity from the Newcastle 85+ study.
Innerd, Paul; Catt, Michael; Collerton, Joanna; Davies, Karen; Trenell, Michael; Kirkwood, Thomas B L; Jagger, Carol
2015-07-01
Little is known about physical activity (PA) in the very old, the fastest growing age group in the population. We aimed to examine the convergent validity of subjective and objective measures of PA in adults aged over 85 years. A total of 484 participants aged 87-89 years recruited to the Newcastle 85+ study completed a purpose-designed physical activity questionnaire (PAQ), which categorised participants as mildly active, moderately active and very active. Out of them, 337 participants wore a triaxial, raw accelerometer on the right wrist over a 5-7-day period to obtain objective measures of rest/activity, PA intensity and PA type. Data from subjective and objective measurement methods were compared. Self-reported PA was significantly associated with objective measures of the daily sedentary time, low-intensity PA and activity type classified as sedentary, activities of daily living and walking. Objective measures of PA were significantly different when low, moderate and high self-reported PA categories were compared (all P < 0.001). The Newcastle 85+ PAQ demonstrated convergent validity with objective measures of PA. Our findings suggest that this PAQ can be used in the very old to rank individuals according to their level of total PA. © The Author 2015. Published by Oxford University Press on behalf of the British Geriatrics Society.
ERIC Educational Resources Information Center
Westmaas, Johann; Moeller, Scott; Woicik, Patricia Butler
2007-01-01
Objective: The authors aimed to develop a measure of college students' intoxicated behaviors and to validate the measure using scales assessing alcohol outcome expectancies, motives for drinking, and personality traits. Participants and Method Summary: The authors administered these measures and an inventory describing 50 intoxicated behaviors to…
Validation of the Physical Activity Scale for individuals with physical disabilities.
van den Berg-Emons, Rita J; L'Ortye, Annemiek A; Buffart, Laurien M; Nieuwenhuijsen, Channah; Nooijen, Carla F; Bergen, Michael P; Stam, Henk J; Bussmann, Johannes B
2011-06-01
To determine the criterion validity of the Physical Activity Scale for Individuals With Physical Disabilities (PASIPD) by means of daily physical activity levels measured by using a validated accelerometry-based activity monitor in a large group of persons with a physical disability. Cross-sectional. Participants' home environment. Ambulatory and nonambulatory persons with cerebral palsy, meningomyelocele, or spinal cord injury (N=124). Not applicable. Self-reported physical activity level measured by using the PASIPD, a 2-day recall questionnaire, was correlated to objectively measured physical activity level measured by using a validated accelerometry-based activity monitor. Significant Spearman correlation coefficients between the PASIPD and activity monitor outcome measures ranged from .22 to .37. The PASIPD overestimated the duration of physical activity measured by using the activity monitor (mean ± SD, 3.9±2.9 vs 1.5±0.9h/d; P<.01). Significant correlation (ρ=-.74; P<.01) was found between average number of hours of physical activity per day measured by using the 2 methods and difference in hours between methods. This indicates larger overestimation for persons with higher activity levels. The PASIPD correlated poorly with objective measurements using an accelerometry-based activity monitor in people with a physical disability. However, similar low correlations between objective and subjective activity measurements have been found in the general population. Users of the PASIPD should be cautious about overestimating physical activity levels. Copyright © 2011 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.
Measuring the Style of Innovative Thinking among Engineering Students
ERIC Educational Resources Information Center
Passig, David; Cohen, Lizi
2014-01-01
Background: Many tools have been developed to measure the ability of workers to innovate. However, all of them are based on self-reporting questionnaires, which raises questions about their validity Purpose: The aim was to develop and validate a tool, called Ideas Generation Implementation (IGI), to objectively measure the style and potential of…
Parent-Reported Social Support for Child's Fruit and Vegetable Intake: Validity of Measures
ERIC Educational Resources Information Center
Dave, Jayna M.; Evans, Alexandra E.; Condrasky, Marge D.; Williams, Joel E.
2012-01-01
Objective: To develop and validate measures of parental social support to increase their child's fruit and vegetable (FV) consumption. Design: Cross-sectional study design. Setting: School and home. Participants: Two hundred three parents with at least 1 elementary school-aged child. Main Outcome Measure: Parents completed a questionnaire that…
Validating Machine Learning Algorithms for Twitter Data Against Established Measures of Suicidality
2016-01-01
Background One of the leading causes of death in the United States (US) is suicide and new methods of assessment are needed to track its risk in real time. Objective Our objective is to validate the use of machine learning algorithms for Twitter data against empirically validated measures of suicidality in the US population. Methods Using a machine learning algorithm, the Twitter feeds of 135 Mechanical Turk (MTurk) participants were compared with validated, self-report measures of suicide risk. Results Our findings show that people who are at high suicidal risk can be easily differentiated from those who are not by machine learning algorithms, which accurately identify the clinically significant suicidal rate in 92% of cases (sensitivity: 53%, specificity: 97%, positive predictive value: 75%, negative predictive value: 93%). Conclusions Machine learning algorithms are efficient in differentiating people who are at a suicidal risk from those who are not. Evidence for suicidality can be measured in nonclinical populations using social media data. PMID:27185366
Creating and validating GIS measures of urban design for health research.
Purciel, Marnie; Neckerman, Kathryn M; Lovasi, Gina S; Quinn, James W; Weiss, Christopher; Bader, Michael D M; Ewing, Reid; Rundle, Andrew
2009-12-01
Studies relating urban design to health have been impeded by the unfeasibility of conducting field observations across large areas and the lack of validated objective measures of urban design. This study describes measures for five dimensions of urban design - imageability, enclosure, human scale, transparency, and complexity - created using public geographic information systems (GIS) data from the US Census and city and state government. GIS measures were validated for a sample of 588 New York City block faces using a well-documented field observation protocol. Correlations between GIS and observed measures ranged from 0.28 to 0.89. Results show valid urban design measures can be constructed from digital sources.
Creating and validating GIS measures of urban design for health research
Purciel, Marnie; Neckerman, Kathryn M.; Lovasi, Gina S.; Quinn, James W.; Weiss, Christopher; Bader, Michael D.M.; Ewing, Reid; Rundle, Andrew
2012-01-01
Studies relating urban design to health have been impeded by the unfeasibility of conducting field observations across large areas and the lack of validated objective measures of urban design. This study describes measures for five dimensions of urban design – imageability, enclosure, human scale, transparency, and complexity – created using public geographic information systems (GIS) data from the US Census and city and state government. GIS measures were validated for a sample of 588 New York City block faces using a well-documented field observation protocol. Correlations between GIS and observed measures ranged from 0.28 to 0.89. Results show valid urban design measures can be constructed from digital sources. PMID:22956856
ERIC Educational Resources Information Center
Sherrill-Mittleman, D. A.; Klesges, L. M.; Lanctot, J. Q.; Stockton, M. B.; Klesges, R. C.
2009-01-01
Few measurement instruments for children's eating behaviors and beliefs have been specifically validated for African-American children. Validation within this population is important because of potential cultural and ethnic influences. Objectives were to evaluate established and newly developed or adapted dietary psychosocial measures in a sample…
Reliability and Validity of the Alcohol Consequences Expectations Scale
ERIC Educational Resources Information Center
Arriola, Kimberly R. Jacob; Usdan, Stuart; Mays, Darren; Weitzel, Jessica Aungst; Cremeens, Jennifer; Martin, Ryan J.; Borba, Christina; Bernhardt, Jay M.
2009-01-01
Objectives: To examine the reliability and validity of a new measure of alcohol outcome expectations for college students, the Alcohol Consequences Expectations Scale (ACES). Methods: College students (N = 169) completed the ACES and several other measures. Results: Results support the existence of 5 internally consistent subscales. Additionally,…
Glass, Leila; Graham, Diana M.; Deweese, Benjamin N.; Jones, Kenneth Lyons; Riley, Edward P.; Mattson, Sarah N.
2014-01-01
Clinical research and practice support a multi-method approach to validating behavioral problems in children. We examined whether parent-reported symptoms of hyperactivity and inattention (using the Disruptive Behavior Disorder Rating Scale) were substantiated by objective laboratory measures [hyperactivity measured by wrist-worn actigraphy (ACT) and inattention assessed using a 20-minute continuous performance task (CPT)] in three age- and demographically-matched groups of school-age children: children with prenatal alcohol exposure (AE), non-exposed children with idiopathic ADHD (ADHD), and controls (CON). Results indicated that the clinical groups (AE, ADHD) had significantly higher parent-reported levels for both domains compared to the CON group, and did not differ from each other. On the laboratory measures, the clinical groups were more inattentive than controls on the CPT, but did not differ from each other. In contrast, the ADHD group had higher objective activity on the ACT than AE and CON, which did not differ from each other. Thus, laboratory measures differentially validated parent reports in a group-dependent manner. Actigraphy substantiated parent-reported hyperactivity for children in the ADHD group but not for children in the AE group, while the CPT validated parent-reported inattention for both clinical groups. Although the majority of children in the AE group met criteria for ADHD, objective activity levels were not different from controls, indicating that hyperactivity may be a less prominent feature in the AE group. Thus, while there is considerable overlap between the effects of prenatal alcohol exposure and ADHD, differences in behavioral profiles may be clinically useful in differential diagnosis. Further, these data indicate that objective measures should be used to validate parent reports. PMID:24512965
DOE Office of Scientific and Technical Information (OSTI.GOV)
Jernigan, Dann A.; Blanchat, Thomas K.
It is necessary to improve understanding and develop temporally- and spatially-resolved integral scale validation data of the heat flux incident to a complex object in addition to measuring the thermal response of said object located within the fire plume for the validation of the SIERRA/FUEGO/SYRINX fire and SIERRA/CALORE codes. To meet this objective, a complex calorimeter with sufficient instrumentation to allow validation of the coupling between FUEGO/SYRINX/CALORE has been designed, fabricated, and tested in the Fire Laboratory for Accreditation of Models and Experiments (FLAME) facility. Validation experiments are specifically designed for direct comparison with the computational predictions. Making meaningful comparisonmore » between the computational and experimental results requires careful characterization and control of the experimental features or parameters used as inputs into the computational model. Validation experiments must be designed to capture the essential physical phenomena, including all relevant initial and boundary conditions. This report presents the data validation steps and processes, the results of the penlight radiant heat experiments (for the purpose of validating the CALORE heat transfer modeling of the complex calorimeter), and the results of the fire tests in FLAME.« less
2006-07-01
in bioremediation (such as lactate, citrate, benzoate , phenols, etc). Site Study Objectives • demonstrate and validate the PFM as an innovative...contaminants and alcohol tracers. However, organic acids (e.g., benzoate ) can be used as the PFM resident racers. We modified zeolites and GAC with a...bioremediation (such as lactate, citrate, benzoate , phenols, etc). 1.2. Objectives of the Demonstration The specific objectives of this
Køster, B; Søndergaard, J; Nielsen, J B; Allen, M; Olsen, A; Bentzen, J
2017-02-01
Few questionnaires used in monitoring sun-related behaviour have been tested for validity. We established the criteria validity of a questionnaire developed for monitoring population sun-related behaviour. During May-August 2013, 664 Danes wore a personal electronic ultraviolet radiation (UVR) dosimeter for 1 week that measured their outdoor time and dose of erythemal UVR exposure. In the following week, they answered a questionnaire on their sun-related behaviour in the measurement week. Outdoor time measured by dosimetry correlated strongly with both outdoor time and the developed exposure scale measured in the questionnaire. Exposure measured in standard erythema dose (SED) by dosimetry correlated strongly with the exposure scale. In a linear regression model of UVR (SED) received, 41% of the variation was explained by skin type, age, week of participation and exposure scale, with exposure scale as the main contributor. The weekly sunburn fraction correlated strongly with the number of ambient sun hours (r = 0·73, P < 0·001). This criteria-validated questionnaire provides evidence of the exposure that the questionnaire aimed to measure. The evidence provided showed a strong link between the objectively measured behaviour and the behaviour measured by this survey construct. The questionnaire is the first validated tool to measure the UVR exposure in a national population-based sample. © 2016 The Authors. British Journal of Dermatology published by John Wiley & Sons Ltd on behalf of British Association of Dermatologists.
Poulsen, Ingrid; Kreiner, Svend; Engberg, Aase W
2018-02-13
The Early Functional Abilities scale assesses the restoration of brain function after brain injury, based on 4 dimensions. The primary objective of this study was to evaluate the validity, objectivity, reliability and measurement precision of the Early Functional Abilities scale by Rasch model item analysis. A secondary objective was to examine the relationship between the Early Functional Abilities scale and the Functional Independence Measurement™, in order to establish the criterion validity of the Early Functional Abilities scale and to compare the sensitivity of measurements using the 2 instruments. The Rasch analysis was based on the assessment of 408 adult patients at admission to sub-acute rehabilitation in Copenhagen, Denmark after traumatic brain injury. The Early Functional Abilities scale provides valid and objective measurement of vegetative (autonomic), facio-oral, sensorimotor and communicative/cognitive functions. Removal of one item from the sensorimotor scale confirmed unidimensionality for each of the 4 subscales, but not for the entire scale. The Early Functional Abilities subscales are sensitive to differences between patients in ranges in which the Functional Independence Measurement™ has a floor effect. The Early Functional Abilities scale assesses the early recovery of important aspects of brain function after traumatic brain injury, but is not unidimensional. We recommend removal of the "standing" item and calculation of summary subscales for the separate dimensions.
NASA Astrophysics Data System (ADS)
Pearlman, Aaron J.; Padula, Francis; Shao, Xi; Cao, Changyong; Goodman, Steven J.
2016-09-01
One of the main objectives of the Geostationary Operational Environmental Satellite R-Series (GOES-R) field campaign is to validate the SI traceability of the Advanced Baseline Imager. The campaign plans include a feasibility demonstration study for new near surface unmanned aircraft system (UAS) measurement capability that is being developed to meet the challenges of validating geostationary sensors. We report our progress in developing our initial systems by presenting the design and preliminary characterization results of the sensor suite. The design takes advantage of off-the-shelf technologies and fiber-based optical components to make hemispheric directional measurements from a UAS. The characterization results - including laboratory measurements of temperature effects and polarization sensitivity - are used to refine the radiometric uncertainty budget towards meeting the validation objectives for the campaign. These systems will foster improved validation capabilities for the GOES-R field campaign and other next generation satellite systems.
Just Ask Me: Convergent Validity of Self-Reported Measures of Music Participation
ERIC Educational Resources Information Center
Elpus, Kenneth
2017-01-01
The purpose of this study was to determine the convergent validity of self-reported and objective measures of school music ensemble participation. Self-reported survey responses to a question about high school music ensemble participation and administrative data in the form of high school transcript-indicated ensemble enrollments were compared…
Reliability and Validity Testing of the Physical Resilience Measure
ERIC Educational Resources Information Center
Resnick, Barbara; Galik, Elizabeth; Dorsey, Susan; Scheve, Ann; Gutkin, Susan
2011-01-01
Objective: The purpose of this study was to test reliability and validity of the Physical Resilience Scale. Methods: A single-group repeated measure design was used and 130 older adults from three different housing sites participated. Participants completed the Physical Resilience Scale, Hardy-Gill Resilience Scale, 14-item Resilience Scale,…
Smartphone-Based Self-Assessment of Stress in Healthy Adult Individuals: A Systematic Review
Þórarinsdóttir, Helga; Kessing, Lars Vedel
2017-01-01
Background Stress is a common experience in today’s society. Smartphone ownership is widespread, and smartphones can be used to monitor health and well-being. Smartphone-based self-assessment of stress can be done in naturalistic settings and may potentially reflect real-time stress level. Objective The objectives of this systematic review were to evaluate (1) the use of smartphones to measure self-assessed stress in healthy adult individuals, (2) the validity of smartphone-based self-assessed stress compared with validated stress scales, and (3) the association between smartphone-based self-assessed stress and smartphone generated objective data. Methods A systematic review of the scientific literature was reported and conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. The scientific databases PubMed, PsycINFO, Embase, IEEE, and ACM were searched and supplemented by a hand search of reference lists. The databases were searched for original studies involving healthy individuals older than 18 years, measuring self-assessed stress using smartphones. Results A total of 35 published articles comprising 1464 individuals were included for review. According to the objectives, (1) study designs were heterogeneous, and smartphone-based self-assessed stress was measured using various methods (e.g., dichotomized questions on stress, yes or no; Likert scales on stress; and questionnaires); (2) the validity of smartphone-based self-assessed stress compared with validated stress scales was investigated in 3 studies, and of these, only 1 study found a moderate statistically significant positive correlation (r=.4; P<.05); and (3) in exploratory analyses, smartphone-based self-assessed stress was found to correlate with some of the reported smartphone generated objective data, including voice features and data on activity and phone usage. Conclusions Smartphones are being used to measure self-assessed stress in different contexts. The evidence of the validity of smartphone-based self-assessed stress is limited and should be investigated further. Smartphone generated objective data can potentially be used to monitor, predict, and reduce stress levels. PMID:28193600
Objective Measure of Nasal Air Emission Using Nasal Accelerometry
ERIC Educational Resources Information Center
Cler, Meredith J.; Lien, Yu-An, S.; Braden, Maia N.; Mittleman, Talia; Downing, Kerri; Stepp, Cara, E.
2016-01-01
Purpose: This article describes the development and initial validation of an objective measure of nasal air emission (NAE) using nasal accelerometry. Method: Nasal acceleration and nasal airflow signals were simultaneously recorded while an expert speech language pathologist modeled NAEs at a variety of severity levels. In addition, microphone and…
Validity and inter-observer reliability of subjective hand-arm vibration assessments.
Coenen, Pieter; Formanoy, Margriet; Douwes, Marjolein; Bosch, Tim; de Kraker, Heleen
2014-07-01
Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52% of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.
Biddle, Daniel J; Robillard, Rébecca; Hermens, Daniel F; Hickie, Ian B; Glozier, Nicholas
2015-09-01
Validation of self-report assessment of habitual sleep duration and onset time in young people with mental ill-health. Validation sample. Specialized early intervention centers for young people in Sydney, Australia. One hundred and forty-six young people with mental ill-health. N/A. Self-reported habitual sleep duration and onset time were compared against at least 7 days of actigraphy monitoring. Average bias in and calibration of subjective measures were assessed, along with correlation of subjective and objective measures. Differences by age, sex, mental-disorder type, and reported insomnia were also explored. On average, subjective estimates of sleep were unbiased. Overall, each additional hour of objective habitual sleep duration predicted 41 minutes more subjective habitual sleep duration, and each hour later objective habitual sleep onset occurred predicted a 43-minute later subjective habitual sleep onset. There were subgroup differences: subjective habitual sleep duration in self-reported insomnia was shorter than objective duration by 30 minutes (SD = 119), on average. Calibration of habitual sleep duration was worse for those with mood disorders than with other primary diagnoses (t = -2.39, P = .018). Correlation between subjective and objective measures was strong for sleep onset time (Á = .667, P < .001) and moderate for sleep duration (r = .332, P < .001). For the mood disorder group, subjective and objective sleep durations were uncorrelated. Self-reports seem valid for large-scale studies of habitual sleep duration and onset in help-seeking young people, but assessment of habitual sleep duration requires objective measures where individual accuracy is important. Copyright © 2015 National Sleep Foundation. Published by Elsevier Inc. All rights reserved.
Stein, Michelle B; Slavin-Mulford, Jenelle; Sinclair, S Justin; Siefert, Caleb J; Blais, Mark A
2012-01-01
The Social Cognition and Object Relations Scale-Global rating method (SCORS-G; Stein, Hilsenroth, Slavin-Mulford, & Pinsker, 2011; Westen, 1995) measures the quality of object relations in narrative material. This study employed a multimethod approach to explore the structure and construct validity of the SCORS-G. The Thematic Apperception Test (TAT; Murray, 1943) was administered to 59 patients referred for psychological assessment at a large Northeastern U.S. hospital. The resulting 301 TAT narratives were rated using the SCORS-G method. The 8 SCORS variables were found to have high interrater reliability and good internal consistency. Principal components analysis revealed a 3-component solution with components tapping emotions/affect regulation in relationships, self-image, and aspects of cognition. Next, the construct validity of the SCORS-G components was explored using measures of intellectual and executive functioning, psychopathology, and normal personality. The 3 SCORS-G components showed unique and theoretically meaningful relationships across these broad and diverse psychological measures. This study demonstrates the value of using a standardized scoring method, like the SCORS-G, to reveal the rich and complex nature of narrative material.
Translation, Cultural Adaptation and Validation of the Simple Shoulder Test to Spanish
Arcuri, Francisco; Barclay, Fernando; Nacul, Ivan
2015-01-01
Background: The validation of widely used scales facilitates the comparison across international patient samples. Objective: The objective was to translate, culturally adapt and validate the Simple Shoulder Test into Argentinian Spanish. Methods: The Simple Shoulder Test was translated from English into Argentinian Spanish by two independent translators, translated back into English and evaluated for accuracy by an expert committee to correct the possible discrepancies. It was then administered to 50 patients with different shoulder conditions.Psycometric properties were analyzed including internal consistency, measured with Cronbach´s Alpha, test-retest reliability at 15 days with the interclass correlation coefficient. Results: The internal consistency, validation, was an Alpha of 0,808, evaluated as good. The test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.835, evaluated as excellent. Conclusion: The Simple Shoulder Test translation and it´s cultural adaptation to Argentinian-Spanish demonstrated adequate internal reliability and validity, ultimately allowing for its use in the comparison with international patient samples.
Is the Maternal Q-Set a Valid Measure of Preschool Child Attachment Behavior?
ERIC Educational Resources Information Center
Moss, Ellen; Bureau, Jean-Francois; Cyr, Chantal; Dubois-Comtois, Karine
2006-01-01
The objective of this study is to examine preschool-age correlates of the maternal version of the Attachment Q-Set (AQS) (Waters & Deane, 1985) in order to provide validity data. Concurrent associations between the Attachment Q-Set and measures of separation-reunion attachment classifications (Cassidy & Marvin, 1992), quality of mother-child…
Development and Validation of the Family Feedback on Child Welfare Services (FF-CWS)
ERIC Educational Resources Information Center
Ayala-Nunes, Lara; Jiménez, Lucía; Hidalgo, Victoria; Dekovic, Maja; Jesus, Saul
2018-01-01
Objective: The measurement of Family Feedback on Child Welfare Services (FF-CWS) is gaining prominence as an efficacy indicator and is coherent with concerns about family-centered practice and empowerment. The aim of this study was to develop and validate an instrument that would overcome the scarcity of psychometrically sound measures in this…
Parent-reported social support for child’s fruit and vegetable intake: validity of measures
USDA-ARS?s Scientific Manuscript database
The objective of our study was to develop and validate measures of parental social support to increase their child’s fruit and vegetable (FV) consumption. We used a cross-sectional study design by studying participants at school and home. We studied two hundred three parents with at least 1 elemen...
ERIC Educational Resources Information Center
Counts, Jacqueline M.; Buffington, Elenor S.; Chang-Rios, Karin; Rasmussen, Heather N.; Preacher, Kristopher J.
2010-01-01
Objective: The objective of this study was to evaluate the internal structure of a self-report measure of multiple family-level protective factors against abuse and neglect and explore the relationship of this instrument to other measures of child maltreatment. Methods: For the exploratory factor analysis, 11 agencies from 4 states administered…
2011-01-01
Background In healthcare, a gap exists between what is known from research and what is practiced. Understanding this gap depends upon our ability to robustly measure research utilization. Objectives The objectives of this systematic review were: to identify self-report measures of research utilization used in healthcare, and to assess the psychometric properties (acceptability, reliability, and validity) of these measures. Methods We conducted a systematic review of literature reporting use or development of self-report research utilization measures. Our search included: multiple databases, ancestry searches, and a hand search. Acceptability was assessed by examining time to complete the measure and missing data rates. Our approach to reliability and validity assessment followed that outlined in the Standards for Educational and Psychological Testing. Results Of 42,770 titles screened, 97 original studies (108 articles) were included in this review. The 97 studies reported on the use or development of 60 unique self-report research utilization measures. Seven of the measures were assessed in more than one study. Study samples consisted of healthcare providers (92 studies) and healthcare decision makers (5 studies). No studies reported data on acceptability of the measures. Reliability was reported in 32 (33%) of the studies, representing 13 of the 60 measures. Internal consistency (Cronbach's Alpha) reliability was reported in 31 studies; values exceeded 0.70 in 29 studies. Test-retest reliability was reported in 3 studies with Pearson's r coefficients > 0.80. No validity information was reported for 12 of the 60 measures. The remaining 48 measures were classified into a three-level validity hierarchy according to the number of validity sources reported in 50% or more of the studies using the measure. Level one measures (n = 6) reported evidence from any three (out of four possible) Standards validity sources (which, in the case of single item measures, was all applicable validity sources). Level two measures (n = 16) had evidence from any two validity sources, and level three measures (n = 26) from only one validity source. Conclusions This review reveals significant underdevelopment in the measurement of research utilization. Substantial methodological advances with respect to construct clarity, use of research utilization and related theory, use of measurement theory, and psychometric assessment are required. Also needed are improved reporting practices and the adoption of a more contemporary view of validity (i.e., the Standards) in future research utilization measurement studies. PMID:21794144
Classen, Sherrilene; Winter, Sandra M.; Velozo, Craig A.; Bédard, Michel; Lanford, Desiree N.; Brumback, Babette; Lutz, Barbara J.
2010-01-01
OBJECTIVE We report on item development and validity testing of a self-report older adult safe driving behaviors measure (SDBM). METHOD On the basis of theoretical frameworks (Precede–Proceed Model of Health Promotion, Haddon’s matrix, and Michon’s model), existing driving measures, and previous research and guided by measurement theory, we developed items capturing safe driving behavior. Item development was further informed by focus groups. We established face validity using peer reviewers and content validity using expert raters. RESULTS Peer review indicated acceptable face validity. Initial expert rater review yielded a scale content validity index (CVI) rating of 0.78, with 44 of 60 items rated ≥0.75. Sixteen unacceptable items (≤0.5) required major revision or deletion. The next CVI scale average was 0.84, indicating acceptable content validity. CONCLUSION The SDBM has relevance as a self-report to rate older drivers. Future pilot testing of the SDBM comparing results with on-road testing will define criterion validity. PMID:20437917
ERIC Educational Resources Information Center
Shirazi, Mandana; Sadeghi, Majid; Emami, A.; Kashani, A. Sabouri; Parikh, Sagar; Alaeddini, F.; Arbabi, Mohammad; Wahlstrom, Rolf
2011-01-01
Objective: Standardized patients (SPs) have been developed to measure practitioner performance in actual practice settings, but results have not been fully validated for psychiatric disorders. This study describes the process of creating reliable and valid SPs for unannounced assessment of general-practitioners' management of depression disorders…
ERIC Educational Resources Information Center
O'Hare, Thomas; Sherrer, Margaret V.; LaButti, Annamaria; Emrick, Kelly
2004-01-01
Objective/Method: The use of brief, reliable, valid, and practical measures of substance use is critical for conducting individual assessments and program evaluation for integrated mental health-substance abuse services for persons with serious mental illness. This investigation examines the internal consistency reliability, concurrent validity,…
Development and Validation of the Student Tool for Technology Literacy (ST[superscript 2]L)
ERIC Educational Resources Information Center
Hohlfeld, Tina N.; Ritzhaupt, Albert D.; Barron, Ann E.
2010-01-01
This article provides an overview of the development and validation of the Student Tool for Technology Literacy (ST[superscript 2]L). Developing valid and reliable objective performance measures for monitoring technology literacy is important to all organizations charged with equipping students with the technology skills needed to successfully…
USDA-ARS?s Scientific Manuscript database
The objective of this study was to validate use of the washed The objective of this study was to validate use of the washed rumen technique for rapid measurement of fasting HP and RQ. The plateau of RQ values was 0.87 ± 0.01 and 0.72 ± 0.01 for unwashed and washed rumen, respectively. The RQ decreas...
A comparison of four measures of moral reasoning.
Wilmoth, G H; McFarland, S G
1977-08-01
Kohlberg's Moral Judgment Scale, Gilligan et al.'s Sexual Moral Judgment Scale, Maitland and Goldman's Objective Moral Judgment Scale, and Hogan's Maturity of Moral Judgment Scale, were examined for reliability and inter-scale relationships. All measures except the Objective Moral Judgment Scale had good reliabilities. The obtained relations between the Moral Judgment Scale and the Sexual Moral Judgment Scale replicated previous research. The Objective Moral Judgment Scale was not found to validly assess the Kohlberg stages. The Maturity of Moral Judgment Scale scores were strongly related to the subjects's classification on the Kohlberg stages, and the scale appears to offer a reliable, quickly scored, and valid index of mature thought, although the scale's continuous scores do not permit clear stage classification.
ERIC Educational Resources Information Center
Tarhini, Ali; Teo, Timothy; Tarhini, Takwa
2016-01-01
Despite the prevalence and significance of e-learning in education, there is a dearth of published instruments for educational researchers and practitioners that measure users' acceptance of e-learning. To meet this need, Teo (2010) developed the E-learning Acceptance Measure (ElAM). The main objective of this paper is to validate the ElAM (Teo,…
Terry, Paul E; Xi, Min
2010-12-01
The objective of this study was to assess the validity of 3 scoring techniques for presenteeism measures by exploring their relationship with patient activation, health, job satisfaction, and socioeconomic characteristics. The sample consisted of 631 employees from 2 predominantly white-collar employee groups in the northern Midwest. Employees completed the World Health Organization's Health and Work Performance Questionnaire, a wellness profile, and the Patient Activation Measure. Absolute measures reflect self-rated performance, while relative and stratified measures compare self-rated performance to that of co-workers. Multivariate analyses were used to validate scoring measures. All measures of presenteeism were positively correlated with being nonwhite, income, and smoking. The significance of age, employment, mental health, and patient activation depends on how presenteeism is defined. Practitioners must carefully consider which scoring method best addresses their program goals and objectives. Clearer measurement guidelines are needed.
Helmerhorst, Hendrik J F; Brage, Søren; Warren, Janet; Besson, Herve; Ekelund, Ulf
2012-08-31
Physical inactivity is one of the four leading risk factors for global mortality. Accurate measurement of physical activity (PA) and in particular by physical activity questionnaires (PAQs) remains a challenge. The aim of this paper is to provide an updated systematic review of the reliability and validity characteristics of existing and more recently developed PAQs and to quantitatively compare the performance between existing and newly developed PAQs.A literature search of electronic databases was performed for studies assessing reliability and validity data of PAQs using an objective criterion measurement of PA between January 1997 and December 2011. Articles meeting the inclusion criteria were screened and data were extracted to provide a systematic overview of measurement properties. Due to differences in reported outcomes and criterion methods a quantitative meta-analysis was not possible.In total, 31 studies testing 34 newly developed PAQs, and 65 studies examining 96 existing PAQs were included. Very few PAQs showed good results on both reliability and validity. Median reliability correlation coefficients were 0.62-0.71 for existing, and 0.74-0.76 for new PAQs. Median validity coefficients ranged from 0.30-0.39 for existing, and from 0.25-0.41 for new PAQs.Although the majority of PAQs appear to have acceptable reliability, the validity is moderate at best. Newly developed PAQs do not appear to perform substantially better than existing PAQs in terms of reliability and validity. Future PAQ studies should include measures of absolute validity and the error structure of the instrument.
2012-01-01
Physical inactivity is one of the four leading risk factors for global mortality. Accurate measurement of physical activity (PA) and in particular by physical activity questionnaires (PAQs) remains a challenge. The aim of this paper is to provide an updated systematic review of the reliability and validity characteristics of existing and more recently developed PAQs and to quantitatively compare the performance between existing and newly developed PAQs. A literature search of electronic databases was performed for studies assessing reliability and validity data of PAQs using an objective criterion measurement of PA between January 1997 and December 2011. Articles meeting the inclusion criteria were screened and data were extracted to provide a systematic overview of measurement properties. Due to differences in reported outcomes and criterion methods a quantitative meta-analysis was not possible. In total, 31 studies testing 34 newly developed PAQs, and 65 studies examining 96 existing PAQs were included. Very few PAQs showed good results on both reliability and validity. Median reliability correlation coefficients were 0.62–0.71 for existing, and 0.74–0.76 for new PAQs. Median validity coefficients ranged from 0.30–0.39 for existing, and from 0.25–0.41 for new PAQs. Although the majority of PAQs appear to have acceptable reliability, the validity is moderate at best. Newly developed PAQs do not appear to perform substantially better than existing PAQs in terms of reliability and validity. Future PAQ studies should include measures of absolute validity and the error structure of the instrument. PMID:22938557
Measuring Parenting Practices among Parents of Elementary School-Age Youth
ERIC Educational Resources Information Center
Randolph, Karen A.; Radey, Melissa
2011-01-01
Objectives: The objective of this study is to establish the factor structure of the Alabama Parenting Questionnaire (APQ), an instrument designed to measure parenting practices among parents of elementary school children. Methods: Exploratory (EFA) and confirmatory factor analytic (CFA) procedures are used to validate the APQ with 790 parents of…
Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio
2016-01-01
The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe.
Gobbi, Erica; Elliot, Catherine; Varnier, Maurizio; Carraro, Attilio
2016-01-01
The purpose of this research was to assess an Italian version of the Physical Activity Questionnaire for Older Children (PAQ-C-It). Three separate studies were conducted, whereby testing general psychometric properties, construct validity, concurrent validity and the factor structure of the PAQ-C-It among general and clinical pediatric population. Study 1 (n = 1170) examined the psychometric properties, internal consistency, factor structure (exploratory factor analysis, EFA) and construct validity with enjoyment perception during physical activity. Study 2 (n = 59) reported on reliability, construct validity with enjoyment and BMI, and on cross-sectional concurrent validity with objectively measured MVPA (tri-axial accelerometry) over the span of seven consecutive days. Study 3 (n = 58) examined the PAQ-C-It reliability, construct validity with BMI and VO2max as the objective measurement among a population of children with congenital heart defects (CHD). In study 2 and 3, the factor structure of the PAQ-C-It was then re-examined with an EFA. The PAQ-C-It showed acceptable to good reliability (alpha .70 to .83). Results on construct validity showed moderate but significant association with enjoyment perception (r = .30 and .36), with BMI (r = -.30 and -.79 for CHD simple form), and with the VO2max (r = .55 for CHD simple form). Significant concurrent validity with the objectively measured MVPA was reported (rho = .30, p < .05). Findings of the EFA suggested a two-factor structure for the PAQ-C-It, with items 2, 3, and 4 contributing little to the total score. This study supports the PAQ-C-It as an appropriate instrument to assess the MVPA levels of Italian children, including children with simple forms of CHD. Support is given to the possible instrument effectiveness on a large international perspective in order to level out data gathering across the globe. PMID:27228050
Validation of a Novel Virtual Reality Simulator for Robotic Surgery
Schreuder, Henk W. R.; Persson, Jan E. U.; Wolswijk, Richard G. H.; Ihse, Ingmar; Schijven, Marlies P.; Verheijen, René H. M.
2014-01-01
Objective. With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery. Methods. A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises. Results. Experts outperformed novices in most of the measured parameters. The most discriminative parameters were “time to complete” and “economy of motion” (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery. Conclusions. Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery. PMID:24600328
NASA Astrophysics Data System (ADS)
Marenco, Franco; Ryder, Claire; Estellés, Victor; Segura, Sara; Amiridis, Vassilis; Proestakis, Emmanouil; Marinou, Eleni; Tsekeri, Alexandra; Smith, Helen; Ulanowski, Zbigniew; O'Sullivan, Debbie; Brooke, Jennifer; Pradhan, Yaswant; Buxmann, Joelle
2018-04-01
In August 2015, the AER-D campaign made use of the FAAM research aircraft based in Cape Verde, and targeted mineral dust. First results will be shown here. The campaign had multiple objectives: (1) lidar dust mapping for the validation of satellite and model products; (2) validation of sunphotometer remote sensing with airborne measurements; (3) coordinated measurements with the CATS lidar on the ISS; (4) radiative closure studies; and (5) the validation of a new model of dustsonde.
ERIC Educational Resources Information Center
Lohse, Barbara; Cunningham-Sabo, Leslie; Walters, Lynn M.; Stacey, Jane E.
2011-01-01
Objective: To examine reliability of validity-tested instruments measuring fruit and vegetable (FV) preference and self-efficacy (SE) for and attitude (AT) toward cooking. Methods: In Santa Fe, New Mexico, following cognitive interviews with 123 fourth- and fifth-graders, surveys were administered twice, less than 2 weeks apart, to students in 16…
Smartphone-Based Self-Assessment of Stress in Healthy Adult Individuals: A Systematic Review.
Þórarinsdóttir, Helga; Kessing, Lars Vedel; Faurholt-Jepsen, Maria
2017-02-13
Stress is a common experience in today's society. Smartphone ownership is widespread, and smartphones can be used to monitor health and well-being. Smartphone-based self-assessment of stress can be done in naturalistic settings and may potentially reflect real-time stress level. The objectives of this systematic review were to evaluate (1) the use of smartphones to measure self-assessed stress in healthy adult individuals, (2) the validity of smartphone-based self-assessed stress compared with validated stress scales, and (3) the association between smartphone-based self-assessed stress and smartphone generated objective data. A systematic review of the scientific literature was reported and conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. The scientific databases PubMed, PsycINFO, Embase, IEEE, and ACM were searched and supplemented by a hand search of reference lists. The databases were searched for original studies involving healthy individuals older than 18 years, measuring self-assessed stress using smartphones. A total of 35 published articles comprising 1464 individuals were included for review. According to the objectives, (1) study designs were heterogeneous, and smartphone-based self-assessed stress was measured using various methods (e.g., dichotomized questions on stress, yes or no; Likert scales on stress; and questionnaires); (2) the validity of smartphone-based self-assessed stress compared with validated stress scales was investigated in 3 studies, and of these, only 1 study found a moderate statistically significant positive correlation (r=.4; P<.05); and (3) in exploratory analyses, smartphone-based self-assessed stress was found to correlate with some of the reported smartphone generated objective data, including voice features and data on activity and phone usage. Smartphones are being used to measure self-assessed stress in different contexts. The evidence of the validity of smartphone-based self-assessed stress is limited and should be investigated further. Smartphone generated objective data can potentially be used to monitor, predict, and reduce stress levels. ©Helga Þórarinsdóttir, Lars Vedel Kessing, Maria Faurholt-Jepsen. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 13.02.2017.
2007-02-01
Travis L. Hedman, MPT, OCS, Ted T. Chapman, OTR/L, Steven E. Wolf, MD, FACS, John B. Holcomb, MD, FACS Objective: Water volumetry is considered the...hand, using the figure-of-eight technique. A third tester per- formed two measurements, using water volumetry . An independent investigator recorded...all measurements. Intratester and intertester reliability were analyzed. Concurrent validity was examined and compared with water volumetry
Romero, Melissa M; Flood, Lisa Sue; Gasiewicz, Nanci K; Rovin, Richard; Conklin, Samantha
2015-12-01
At present there is a lack of well-validated surveys used to measure quality of life in patients with malignant brain tumors and their caregivers. The main objective of this pilot study was to validate the National Institutes of Health Patient-Reported Outcomes Measurement Information System (NIH PROMIS) survey for use as a quality-of-life measure in this population. This article presents the rationale for using the NIH PROMIS instrument as a quality-of-life measure for patients with malignant brain tumors and their caregivers. Copyright © 2015 Elsevier Inc. All rights reserved.
Oguma, Yuko; Osawa, Yusuke; Takayama, Michiyo; Abe, Yukiko; Tanaka, Shigeho; Lee, I-Min; Arai, Yasumichi
2017-04-01
To date, there is no physical activity (PA) questionnaire with convergent and construct validity for the oldest-old. The aim of the current study was to investigate the validity of questionnaire-assessed PA in comparison with objective measures determined by uniaxial and triaxial accelerometers and physical performance measures in the oldest-old. Participants were 155 elderly (mean age 90 years) who were examined at the university and agreed to wear an accelerometer for 7 days in the 3-year-follow-up survey of the Tokyo Oldest-Old Survey of Total Health. Fifty-nine participants wore a uniaxial and triaxial accelerometer simultaneously. Self-rated walking, exercise, and household PA were measured using a modified Zutphen PA Questionnaire (PAQ). Several physical performance tests were done, and the associations among PAQ, accelerometer-assessed PA, and physical performances were compared by Spearman's correlation coefficients. Significant, low to moderate correlations between PA measures were seen on questionnaire and accelerometer assessments (ρ = 0.19 to 0.34). Questionnaireassessed PA measure were correlated with a range of lower extremity performance (ρ = 0.21 to 0.29). This PAQ demonstrated convergent and construct validity. Our findings suggest that the PAQ can reasonably be used in this oldest-old population to rank their PA level.
Validation of a Group-Administered Pictorial Dietary Recall with 9- to 11-Year-Old Children
ERIC Educational Resources Information Center
Wallen, Victoria; Cunningham-Sabo, Leslie; Auld, Garry; Romaniello, Cathy
2011-01-01
Objective: Determine validity of Day in the Life Questionnaire-Colorado (DILQ-CO) as a dietary assessment tool for classroom-administered use. Methods: Agreement between DILQ-CO responses and weighed plate waste measured in 125 fourth-grade students in 2 low-income schools. Validity assessed by comparing reported school lunch items and portion…
Validity of Walk Score® as a measure of neighborhood walkability in Japan.
Koohsari, Mohammad Javad; Sugiyama, Takemi; Hanibuchi, Tomoya; Shibata, Ai; Ishii, Kaori; Liao, Yung; Oka, Koichiro
2018-03-01
Objective measures of environmental attributes have been used to understand how neighborhood environments relate to physical activity. However, this method relies on detailed spatial data, which are often not easily available. Walk Score® is a free, publicly available web-based tool that shows how walkable a given location is based on objectively-derived proximity to several types of local destinations and street connectivity. To date, several studies have tested the concurrent validity of Walk Score as a measure of neighborhood walkability in the USA and Canada. However, it is unknown whether Walk Score is a valid measure in other regions. The current study examined how Walk Score is correlated with objectively-derived attributes of neighborhood walkability, for residential addresses in Japan. Walk Scores were obtained for 1072 residential addresses in urban and rural areas in Japan. Five environmental attributes (residential density, intersection density, number of local destinations, sidewalk availability, and access to public transportation) were calculated using geographic information systems for each address. Pearson's correlation coefficients between Walk Score and these environmental attributes were calculated (conducted in May 2017). Significant positive correlations were observed between Walk Score and environmental attributes relevant to walking. Walk Score was most closely associated with intersection density ( r = 0.82) and with the number of local destinations ( r = 0.77). Walk Score appears to be a valid measure of neighborhood walkability in Japan. Walk Score will allow urban designers and public health practitioners to identify walkability of local areas without relying on detailed geographic data.
NASA Astrophysics Data System (ADS)
Venkata, Santhosh Krishnan; Roy, Binoy Krishna
2016-03-01
Design of an intelligent flow measurement technique using venturi flow meter is reported in this paper. The objectives of the present work are: (1) to extend the linearity range of measurement to 100 % of full scale input range, (2) to make the measurement technique adaptive to variations in discharge coefficient, diameter ratio of venturi nozzle and pipe (β), liquid density, and liquid temperature, and (3) to achieve the objectives (1) and (2) using an optimized neural network. The output of venturi flow meter is differential pressure. It is converted to voltage by using a suitable data conversion unit. A suitable optimized artificial neural network (ANN) is added, in place of conventional calibration circuit. ANN is trained, tested with simulated data considering variations in discharge coefficient, diameter ratio between venturi nozzle and pipe, liquid density, and liquid temperature. The proposed technique is then subjected to practical data for validation. Results show that the proposed technique has fulfilled the objectives.
Tissue tonometry is a simple, objective measure for pliability of burn scar: is it reliable?
Lye, Ian; Edgar, Dale W; Wood, Fiona M; Carroll, Sara
2006-01-01
Objective measurement of burn scar response to treatment is important to facilitate individual patient care, research, and service development. This work examines the validity and reliability of the tonometer as a means of quantifying scar pliability. Ten burn survivors were recruited into the study. Triplicate measures were taken for each of four scar and one normal skin point. The pliability score from the Vancouver Scar Scale also was used as a comparison. The tonometer demonstrated a high degree of reliability (intraclass correlation coefficients 0.91-0.94). It also was shown to provide a valid measure of pliability by quantifying decreased tissue deformation for scar (2.04 +/- 0.45 mm) compared with normal tissue (3.02 +/- 0.92 mm; t = 4.28, P = .004) and a moderate correlation with Vancouver Scar Scale scores. The tissue tonometer provides a repeatable, objective index of burn scar pliability. Using the methods described, it is a simple, clinically useful technique for monitoring an individual's scar.
Integrating Validity Theory with Use of Measurement Instruments in Clinical Settings
Kelly, P Adam; O'Malley, Kimberly J; Kallen, Michael A; Ford, Marvella E
2005-01-01
Objective To present validity concepts in a conceptual framework useful for research in clinical settings. Principal Findings We present a three-level decision rubric for validating measurement instruments, to guide health services researchers step-by-step in gathering and evaluating validity evidence within their specific situation. We address construct precision, the capacity of an instrument to measure constructs it purports to measure and differentiate from other, unrelated constructs; quantification precision, the reliability of the instrument; and translation precision, the ability to generalize scores from an instrument across subjects from the same or similar populations. We illustrate with specific examples, such as an approach to validating a measurement instrument for veterans when prior evidence of instrument validity for this population does not exist. Conclusions Validity should be viewed as a property of the interpretations and uses of scores from an instrument, not of the instrument itself: how scores are used and the consequences of this use are integral to validity. Our advice is to liken validation to building a court case, including discovering evidence, weighing the evidence, and recognizing when the evidence is weak and more evidence is needed. PMID:16178998
ITEM SELECTION TECHNIQUES AND EVALUATION OF INSTRUCTIONAL OBJECTIVES.
ERIC Educational Resources Information Center
COX, RICHARD C.
THE VALIDITY OF AN EDUCATIONAL ACHIEVEMENT TEST DEPENDS UPON THE CORRESPONDENCE BETWEEN SPECIFIED EDUCATIONAL OBJECTIVES AND THE EXTENT TO WHICH THESE OBJECTIVES ARE MEASURED BY THE EVALUATION INSTRUMENT. THIS STUDY IS DESIGNED TO EVALUATE THE EFFECT OF STATISTICAL ITEM SELECTION ON THE STRUCTURE OF THE FINAL EVALUATION INSTRUMENT AS COMPARED WITH…
ERIC Educational Resources Information Center
Langberg, Joshua M.; Molitor, Stephen J.; Oddo, Lauren E.; Eadeh, Hana-May; Dvorsky, Melissa R.; Becker, Stephen P.
2017-01-01
Objective: The primary objective of this study was to evaluate the prevalence of multiple types of sleep problems in young adolescents with ADHD. Method: 262 adolescents comprehensively diagnosed with ADHD and their caregivers completed well-validated measures of sleep problems and daytime sleepiness. Participants also completed measures related…
Validation of measures from the smartphone sway balance application: a pilot study.
Patterson, Jeremy A; Amick, Ryan Z; Thummar, Tarunkumar; Rogers, Michael E
2014-04-01
A number of different balance assessment techniques are currently available and widely used. These include both subjective and objective assessments. The ability to provide quantitative measures of balance and posture is the benefit of objective tools, however these instruments are not generally utilized outside of research laboratory settings due to cost, complexity of operation, size, duration of assessment, and general practicality. The purpose of this pilot study was to assess the value and validity of using software developed to access the iPod and iPhone accelerometers output and translate that to the measurement of human balance. Thirty healthy college-aged individuals (13 male, 17 female; age = 26.1 ± 8.5 years) volunteered. Participants performed a static Athlete's Single Leg Test protocol for 10 sec, on a Biodex Balance System SD while concurrently utilizing a mobile device with balance software. Anterior/posterior stability was recorded using both devices, described as the displacement in degrees from level, and was termed the "balance score." There were no significant differences between the two reported balance scores (p = 0.818. Mean balance score on the balance platform was 1.41 ± 0.90, as compared to 1.38 ± 0.72 using the mobile device. There is a need for a valid, convenient, and cost-effective tool to objectively measure balance. Results of this study are promising, as balance score derived from the Smartphone accelerometers were consistent with balance scores obtained from a previously validated balance system. However, further investigation is necessary as this version of the mobile software only assessed balance in the anterior/posterior direction. Additionally, further testing is necessary on a healthy populations and as well as those with impairment of the motor control system. Level 2b (Observational study of validity)(1.)
Reliability and validity of the AutoCAD software method in lumbar lordosis measurement
Letafatkar, Amir; Amirsasan, Ramin; Abdolvahabi, Zahra; Hadadnezhad, Malihe
2011-01-01
Objective The aim of this study was to determine the reliability and validity of the AutoCAD software method in lumbar lordosis measurement. Methods Fifty healthy volunteers with a mean age of 23 ± 1.80 years were enrolled. A lumbar lateral radiograph was taken on all participants, and the lordosis was measured according to the Cobb method. Afterward, the lumbar lordosis degree was measured via AutoCAD software and flexible ruler methods. The current study is accomplished in 2 parts: intratester and intertester evaluations of reliability as well as the validity of the flexible ruler and software methods. Results Based on the intraclass correlation coefficient, AutoCAD's reliability and validity in measuring lumbar lordosis were 0.984 and 0.962, respectively. Conclusions AutoCAD showed to be a reliable and valid method to measure lordosis. It is suggested that this method may replace those that are costly and involve health risks, such as radiography, in evaluating lumbar lordosis. PMID:22654681
Validation of self-reported cannabis dose and potency: an ecological study.
van der Pol, Peggy; Liebregts, Nienke; de Graaf, Ron; Korf, Dirk J; van den Brink, Wim; van Laar, Margriet
2013-10-01
To assess the reliability and validity of self-reported cannabis dose and potency measures. Cross-sectional study comparing self-reports with objective measures of amount of cannabis and delta-9-tetrahydrocannabinol (THC) concentration. Ecological study with assessments at participants' homes or in a coffee shop. Young adult frequent cannabis users (n = 106) from the Dutch Cannabis Dependence (CanDep) study. The objectively measured amount of cannabis per joint (dose in grams) was compared with self-reported estimates using a prompt card and average number of joints made from 1 g of cannabis. In addition, objectively assessed THC concentration in the participant's cannabis was compared with self-reported level of intoxication, subjective estimate of cannabis potency and price per gram of cannabis. Objective estimates of doses per joint (0.07-0.88 g/joint) and cannabis potency (1.1-24.7%) varied widely. Self-reported measures of dose were imprecise, but at group level, average dose per joint was estimated accurately with the number of joints made from 1 g [limit of agreement (LOA) = -0.02 g, 95% confidence interval (CI) = -0.29; 0.26], whereas the prompt card resulted in serious underestimation (LOA = 0.14 g, 95% CI = -0.10; 0.37). THC concentration in cannabis was associated with subjective potency ['average' 3.77% (P = 0.002) and '(very) strong' 5.13% more THC (P < 0.001) than '(very) mild' cannabis] and with cannabis price (about 1% increase in THC concentration per euro spent on 1 g of cannabis, P < 0.001), but not with level of intoxication. Self-report measures relating to cannabis use appear at best to be associated weakly with objective measures. Of the self-report measures, number of joints per gram, cannabis price and subjective potency have at least some validity. © 2013 Society for the Study of Addiction.
Content Validity of a Tool Measuring Medication Errors.
Tabassum, Nishat; Allana, Saleema; Saeed, Tanveer; Dias, Jacqueline Maria
2015-08-01
The objective of this study was to determine content and face validity of a tool measuring medication errors among nursing students in baccalaureate nursing education. Data was collected from the Aga Khan University School of Nursing and Midwifery (AKUSoNaM), Karachi, from March to August 2014. The tool was developed utilizing literature and the expertise of the team members, expert in different areas. The developed tool was then sent to five experts from all over Karachi for ensuring the content validity of the tool, which was measured on relevance and clarity of the questions. The Scale Content Validity Index (S-CVI) for clarity and relevance of the questions was found to be 0.94 and 0.98, respectively. The tool measuring medication errors has an excellent content validity. This tool should be used for future studies on medication errors, with different study populations such as medical students, doctors, and nurses.
Oosterhaven, Jart A F; Schuttelaar, Marie L A; Apfelbacher, Christian; Diepgen, Thomas L; Ofenloch, Robert F
2017-08-01
There is a need for well-developed and validated questionnaires to measure patient reported outcomes. The Quality of Life in Hand Eczema Questionnaire (QOLHEQ) is such a validated instrument measuring disease-specific health-related quality of life in hand eczema patients. A re-validation of measurement properties is required before an instrument is used in a new population. With the objective of arriving at a guideline for translation and national validation of the QOLHEQ, we have developed the design of a reference study on how to adequately assess measurement properties of the QOLHEQ based on interdisciplinary discussions and current standards. We present a step-by-step guideline to assess translation (including cross-cultural adaptation), scale structure, validity, reproducibility, responsiveness, and interpretability. We describe which outcomes should be reported for each measurement property, and give advice on how to calculate these. It is also specified which sample size is needed, how to deal with missing data, and which cutoff values should be applied for the measurement properties assessed during the validation process. In conclusion, this guideline, presenting a reference validation study for the QOLHEQ, creates the possibility to harmonize the national validation of the various language versions of the QOLHEQ. © 2017 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.
ERIC Educational Resources Information Center
Etienne, Anne-Marie; Dupuis, Gilles; Spitz, Elisabeth; Lemetayer, Fabienne; Missotten, Pierre
2011-01-01
The objective was to determine the interest and psychometric properties of a new QOL self-assessment questionnaire suitable for children 8-12 years old measuring alpha, beta and gamma changes: the "Inventaire Systemique de Qualite de vie pour Enfants" (ISQV-E[C]). This was a cross-sectional validation study. 288 children have completed…
ERIC Educational Resources Information Center
Abdel Latif, Muhammad M.
2009-01-01
This article reports on a study aimed at testing the hypothesis that, because of strategic and temporal variables, composing rate and text quantity may not be valid measures of writing fluency. A second objective was to validate the mean length of writers' translating episodes as a process-based indicator that mirrors their fluent written…
ERIC Educational Resources Information Center
Van Ravesteyn, Nicolien T.; Scholtes, Vanessa A.; Becher, Jules G.; Roorda, Leo D.; Verschuren, Olaf; Dallmeijer, Annet J.
2010-01-01
Aim: The objective of this study was to assess the validity of a mobility questionnaire (MobQues) that was developed to measure parent-reported mobility limitations in children with cerebral palsy (CP). Method: The parents of 439 children with CP (256 males and 183 females; age range 2-18y; Gross Motor Function Classification System [GMFCS] levels…
Boody, Barrett S; Bhatt, Surabhi; Mazmudar, Aditya S; Hsu, Wellington K; Rothrock, Nan E; Patel, Alpesh A
2018-03-01
OBJECTIVE The Patient-Reported Outcomes Measurement Information System (PROMIS), which is funded by the National Institutes of Health, is a set of adaptive, responsive assessment tools that measures patient-reported health status. PROMIS measures have not been validated for surgical patients with cervical spine disorders. The objective of this project is to evaluate the validity (e.g., convergent validity, known-groups validity, responsiveness to change) of PROMIS computer adaptive tests (CATs) for pain behavior, pain interference, and physical function in patients undergoing cervical spine surgery. METHODS The legacy outcome measures Neck Disability Index (NDI) and SF-12 were used as comparisons with PROMIS measures. PROMIS CATs, NDI-10, and SF-12 measures were administered prospectively to 59 consecutive tertiary hospital patients who were treated surgically for degenerative cervical spine disorders. A subscore of NDI-5 was calculated from NDI-10 by eliminating the lifting, headaches, pain intensity, reading, and driving sections and multiplying the final score by 4. Assessments were administered preoperatively (baseline) and postoperatively at 6 weeks and 3 months. Patients presenting for revision surgery, tumor, infection, or trauma were excluded. Participants completed the measures in Assessment Center, an online data collection tool accessed by using a secure login and password on a tablet computer. Subgroup analysis was also performed based on a primary diagnosis of either cervical radiculopathy or cervical myelopathy. RESULTS Convergent validity for PROMIS CATs was supported with multiple statistically significant correlations with the existing legacy measures, NDI and SF-12, at baseline. Furthermore, PROMIS CATs demonstrated known-group validity and identified clinically significant improvements in all measures after surgical intervention. In the cervical radiculopathy and myelopathic cohorts, the PROMIS measures demonstrated similar responsiveness to the SF-12 and NDI scores in the patients who self-identified as having postoperative clinical improvement. PROMIS CATs required a mean total of 3.2 minutes for PROMIS pain behavior (mean ± SD 0.9 ± 0.5 minutes), pain interference (1.2 ± 1.9 minutes), and physical function (1.1 ± 1.4 minutes) and compared favorably with 3.4 minutes for NDI and 4.1 minutes for SF-12. CONCLUSIONS This study verifies that PROMIS CATs demonstrate convergent and known-groups validity and comparable responsiveness to change as existing legacy measures. The PROMIS measures required less time for completion than legacy measures. The validity and efficiency of the PROMIS measures in surgical patients with cervical spine disorders suggest an improvement over legacy measures and an opportunity for incorporation into clinical practice.
Li-Tsang, Cecilia W P; Wong, Agnes S K; Leung, Howard W H; Cheng, Joyce S; Chiu, Billy H W; Tse, Linda F L; Chung, Raymond C K
2013-09-01
There are more children diagnosed with specific learning difficulties in recent years as people are more aware of these conditions. Diagnostic tool has been validated to screen out this condition from the population (SpLD test for Hong Kong children). However, for specific assessment on handwriting problem, there seems a lack of standardized and objective evaluation tool to look into the problems. The objective of this study was to validate the Chinese Handwriting Analysis System (CHAS), which is designed to measure both the process and production of handwriting. The construct validity, convergent validity, internal consistency and test-retest reliability of CHAS was analyzed using the data from 734 grade 1-6 students from 6 primary schools in Hong Kong. Principal Component Analysis revealed that measurements of CHAS loaded into 4 components which accounted for 77.73% of the variance. The correlation between the handwriting accuracy obtained from HAS and eyeballing was r=.73. Cronbach's alpha of all measurement items was .65. Except SD of writing time per character, all the measurement items regarding handwriting speed, handwriting accuracy and pen pressure showed good to excellent test-retest reliability (r=.72-.96), while measurement on the numbers of characters which exceeded grid showed moderate reliability (r=.48). Although there are still ergonomic, biomechanical or unspecified aspects which may not be determined by the system, the CHAS can definitely assist therapists in identifying primary school students with handwriting problems and implement interventions accordingly. Copyright © 2013 Elsevier Ltd. All rights reserved.
Guirao-Goris, Silamani J; Ferrer Ferrandis, Esperanza; Montejano Lozoya, Raimunda
2016-02-18
The aim of the study is to identify the construct and criterion validity of the nursing diagnosis label Sedentary Lifestyle. A cross-sectional study in a nursing consultation in primary health care was conducted. Participants were all people that was attended for one year over 50 who voluntarily wish to participate (n=85) in the study. Objective weekly physical activity was measured in METs with an Accelerometer, objective measure of performance was measured by gait speed EPESE Battery (both measures that were used as the gold standard), and physical activity questionnaires (RAPA), the COOP-WONCA physical fitness chart. Spearman correlation coefficients, mean comparison tests and analysis of sensitivity and specificity were used as statistical analysis. The diagnosis "Sedentary Lifestyle" showed a positive correlation between its manifestations and physical activity measured in METs (r=0.39) and EPESE gait speed (r=0.35). The diagnosis showed a sensitivity of 85.1% and a specificity of 65.2% and showed ability to discriminate active people from those that are not using METs as a measure of physical activity (t=-4.4). The diagnosis "Sedentary Lifestyle" shows criterion and construct validity.
ERIC Educational Resources Information Center
Maanen, Annette; Dewald-Kaufmann, Julia F.; Oort, Frans J.; de Bruin, Eduard J.; Smits, Marcel G.; Short, Michelle A.; Gradisar, Michael; Kerkhof, Gerard A.; Meijer, Anne Marie
2014-01-01
Background: Sleep reduction, resulting from insufficient or poor sleep, is a common phenomenon in adolescents. Due to its severe negative psychological and behavioral daytime consequences, it is important to have a short reliable and valid measure to assess symptoms of sleep reduction. Objective: This study aims to validate the Sleep Reduction…
Yousuf, Naveed; Violato, Claudio; Zuberi, Rukhsana W
2015-01-01
CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. The objective structured clinical examination (OSCE) was established for valid, reliable, and objective assessment of clinical skills in health professions education. Various standard setting methods have been proposed to identify objective, reliable, and valid cutoff scores on OSCEs. These methods may identify different cutoff scores for the same examinations. Identification of valid and reliable cutoff scores for OSCEs remains an important issue and a challenge. Thirty OSCE stations administered at least twice in the years 2010-2012 to 393 medical students in Years 2 and 3 at Aga Khan University are included. Psychometric properties of the scores are determined. Cutoff scores and pass/fail decisions of Wijnen, Cohen, Mean-1.5SD, Mean-1SD, Angoff, borderline group and borderline regression (BL-R) methods are compared with each other and with three variants of cluster analysis using repeated measures analysis of variance and Cohen's kappa. The mean psychometric indices on the 30 OSCE stations are reliability coefficient = 0.76 (SD = 0.12); standard error of measurement = 5.66 (SD = 1.38); coefficient of determination = 0.47 (SD = 0.19), and intergrade discrimination = 7.19 (SD = 1.89). BL-R and Wijnen methods show the highest convergent validity evidence among other methods on the defined criteria. Angoff and Mean-1.5SD demonstrated least convergent validity evidence. The three cluster variants showed substantial convergent validity with borderline methods. Although there was a high level of convergent validity of Wijnen method, it lacks the theoretical strength to be used for competency-based assessments. The BL-R method is found to show the highest convergent validity evidences for OSCEs with other standard setting methods used in the present study. We also found that cluster analysis using mean method can be used for quality assurance of borderline methods. These findings should be further confirmed by studies in other settings.
Validation of Self-Reported Cognitive Problems with Objective ...
There is a lack of validation of self-reported cognitive problems with objective neuropsychological measures. The validity of four self-reported cognitive items from a health questionnaire (HQ) and the Symptoms Checklist 90-Revised (SCL-90-R) was examined with objective clinical neuropsychological test performance in 147 manganese (Mn) exposed residents. These residents were from two Ohio towns exposed to ambient air-Mn from an industrial source with modeled average air-Mn concentrations of 0.54 µg/m3 (range: 0.01-4.58) and were part of a larger study of cognitive, motor, tremor abnormalities and their relationship to Mn exposure.The primarily white (94.6%) participants (aged 30-64) lived in the towns for at least 10 years (range: 10-64) and had 13.9 years of education, on average. In the last 7 days before testing, 94 (64.4%) participants self-reported concentration problems and 105 (71.8%) self-reported memory problems. After adjusting for age and education, participants who self-reported cognitive problems did not perform worse on the objective neuropsychological measures than those who reported not having problems, except on 1 of 17 neuropsychological tests (Stroop Color). Greater levels of depression and female sex predicted having more self-reported cognitive problems. Higher education was associated with fewer self-reported cognitive problems. Measures of Mn in air, blood, hair, and toenails were not associated with subjective cognitive self-reported p
Francis, Heather M; Osborne-Crowley, Katherine; McDonald, Skye
2017-01-01
To describe the reliability and validity of a new measure, the Social Skills Questionnaire for Traumatic Brain Injury (SSQ-TBI). Fifty-one adults with severe TBI completed the SSQ-TBI questionnaire. Scores were compared to informant- and self-report on questionnaires addressing frontal lobe mediated behaviour, as well as performance on an objective measure of social cognition and neuropsychological tasks, in order to provide evidence of concurrent, divergent and predictive validity. Internal consistency was excellent at α = 0.90. Convergent validity was good, with informant ratings on the SSQ-TBI significantly correlated with Neuropsychiatric Inventory Disinhibition sub-scales (r = 0.50-63), the Current Behaviour Scale (r = 0.39-0.48) and Frontal Systems Behaviour Scale (r = 0.60-0.83). However, no relationship was seen with an objective measure of social skills or neuropsychological tasks of disinhibition. There was a significant relationship with real-world psychosocial outcomes on the Sydney Psychosocial Reintegration Scale-2 (r = -0.38--0.69) Conclusions: This study provides preliminary findings of good internal consistency and convergent and predictive validity of a social skills questionnaire adapted to be appropriate for individuals with TBI. Further assessment of psychometric properties such as test-re-test reliability and factor structure is warranted.
Kumar, Senthil N S; Omar, Baharudin; Htwe, Ohnmar; Joseph, Leonard H; Krishnan, Jagannathan; Jafarzedah Esfehani, Ali; Min, Lee L
2014-01-01
Limb loading measurements serve as an objective evaluation of asymmetrical weight bearing in the lower limb. Digital weighing scales (DWSs) could be used in clinical settings for measurement of static limb loading. However, ambiguity exists whether limb loading measurements of DWSs are comparable with a standard tool such as MatScan. A cross-sectional study composed of 33 nondisabled participants was conducted to investigate the reliability, agreement, and validity of DWSs with MatScan in static standing. Amounts of weight distribution and plantar pressure on the individual lower limb were measured using two DWSs (A, B) and MatScan during eyes open (EO) and eyes closed (EC) conditions. The results showed that intra- and interrater reliability (3, 1) were excellent (0.94-0.97) within and between DWS A and B. Bland-Altman plot revealed good agreement between DWS and MatScan in EO and EC conditions. The area under the receiver operating characteristic curve was significant and identified as 0.68 (p = 0.01). The measurements obtained with DWSs are valid and in agreement with MatScan measurements. Hence, DWSs could be used interchangeably with MatScan and could provide clinicians an objective measurement of limb loading suitable for clinical settings.
Measures of crowding in the emergency department: a systematic review.
Hwang, Ula; McCarthy, Melissa L; Aronsky, Dominik; Asplin, Brent; Crane, Peter W; Craven, Catherine K; Epstein, Stephen K; Fee, Christopher; Handel, Daniel A; Pines, Jesse M; Rathlev, Niels K; Schafermeyer, Robert W; Zwemer, Frank L; Bernstein, Steven L
2011-05-01
Despite consensus regarding the conceptual foundation of crowding, and increasing research on factors and outcomes associated with crowding, there is no criterion standard measure of crowding. The objective was to conduct a systematic review of crowding measures and compare them in conceptual foundation and validity. This was a systematic, comprehensive review of four medical and health care citation databases to identify studies related to crowding in the emergency department (ED). Publications that "describe the theory, development, implementation, evaluation, or any other aspect of a 'crowding measurement/definition' instrument (qualitative or quantitative)" were included. A "measurement/definition" instrument is anything that assigns a value to the phenomenon of crowding in the ED. Data collected from papers meeting inclusion criteria were: study design, objective, crowding measure, and evidence of validity. All measures were categorized into five measure types (clinician opinion, input factors, throughput factors, output factors, and multidimensional scales). All measures were then indexed to six validation criteria (clinician opinion, ambulance diversion, left without being seen (LWBS), times to care, forecasting or predictions of future crowding, and other). There were 2,660 papers identified by databases; 46 of these papers met inclusion criteria, were original research studies, and were abstracted by reviewers. A total of 71 unique crowding measures were identified. The least commonly used type of crowding measure was clinician opinion, and the most commonly used were numerical counts (number or percentage) of patients and process times associated with patient care. Many measures had moderate to good correlation with validation criteria. Time intervals and patient counts are emerging as the most promising tools for measuring flow and nonflow (i.e., crowding), respectively. Standardized definitions of time intervals (flow) and numerical counts (nonflow) will assist with validation of these metrics across multiple sites and clarify which options emerge as the metrics of choice in this "crowded" field of measures. © 2011 by the Society for Academic Emergency Medicine.
Validation of the thermal code of RadTherm-IR, IR-Workbench, and F-TOM
NASA Astrophysics Data System (ADS)
Schwenger, Frédéric; Grossmann, Peter; Malaplate, Alain
2009-05-01
System assessment by image simulation requires synthetic scenarios that can be viewed by the device to be simulated. In addition to physical modeling of the camera, a reliable modeling of scene elements is necessary. Software products for modeling of target data in the IR should be capable of (i) predicting surface temperatures of scene elements over a long period of time and (ii) computing sensor views of the scenario. For such applications, FGAN-FOM acquired the software products RadTherm-IR (ThermoAnalytics Inc., Calumet, USA; IR-Workbench (OKTAL-SE, Toulouse, France). Inspection of the accuracy of simulation results by validation is necessary before using these products for applications. In the first step of validation, the performance of both "thermal solvers" was determined through comparison of the computed diurnal surface temperatures of a simple object with the corresponding values from measurements. CUBI is a rather simple geometric object with well known material parameters which makes it suitable for testing and validating object models in IR. It was used in this study as a test body. Comparison of calculated and measured surface temperature values will be presented, together with the results from the FGAN-FOM thermal object code F-TOM. In the second validation step, radiances of the simulated sensor views computed by RadTherm-IR and IR-Workbench will be compared with radiances retrieved from the recorded sensor images taken by the sensor that was simulated. Strengths and weaknesses of the models RadTherm-IR, IR-Workbench and F-TOM will be discussed.
Green, R.O.; Pieters, C.; Mouroulis, P.; Eastwood, M.; Boardman, J.; Glavich, T.; Isaacson, P.; Annadurai, M.; Besse, S.; Barr, D.; Buratti, B.; Cate, D.; Chatterjee, A.; Clark, R.; Cheek, L.; Combe, J.; Dhingra, D.; Essandoh, V.; Geier, S.; Goswami, J.N.; Green, R.; Haemmerle, V.; Head, J.; Hovland, L.; Hyman, S.; Klima, R.; Koch, T.; Kramer, G.; Kumar, A.S.K.; Lee, Kenneth; Lundeen, S.; Malaret, E.; McCord, T.; McLaughlin, S.; Mustard, J.; Nettles, J.; Petro, N.; Plourde, K.; Racho, C.; Rodriquez, J.; Runyon, C.; Sellar, G.; Smith, C.; Sobel, H.; Staid, M.; Sunshine, J.; Taylor, L.; Thaisen, K.; Tompkins, S.; Tseng, H.; Vane, G.; Varanasi, P.; White, M.; Wilson, D.
2011-01-01
The NASA Discovery Moon Mineralogy Mapper imaging spectrometer was selected to pursue a wide range of science objectives requiring measurement of composition at fine spatial scales over the full lunar surface. To pursue these objectives, a broad spectral range imaging spectrometer with high uniformity and high signal-to-noise ratio capable of measuring compositionally diagnostic spectral absorption features from a wide variety of known and possible lunar materials was required. For this purpose the Moon Mineralogy Mapper imaging spectrometer was designed and developed that measures the spectral range from 430 to 3000 nm with 10 nm spectral sampling through a 24 degree field of view with 0.7 milliradian spatial sampling. The instrument has a signal-to-noise ratio of greater than 400 for the specified equatorial reference radiance and greater than 100 for the polar reference radiance. The spectral cross-track uniformity is >90% and spectral instantaneous field-of-view uniformity is >90%. The Moon Mineralogy Mapper was launched on Chandrayaan-1 on the 22nd of October. On the 18th of November 2008 the Moon Mineralogy Mapper was turned on and collected a first light data set within 24 h. During this early checkout period and throughout the mission the spacecraft thermal environment and orbital parameters varied more than expected and placed operational and data quality constraints on the measurements. On the 29th of August 2009, spacecraft communication was lost. Over the course of the flight mission 1542 downlinked data sets were acquired that provide coverage of more than 95% of the lunar surface. An end-to-end science data calibration system was developed and all measurements have been passed through this system and delivered to the Planetary Data System (PDS.NASA.GOV). An extensive effort has been undertaken by the science team to validate the Moon Mineralogy Mapper science measurements in the context of the mission objectives. A focused spectral, radiometric, spatial, and uniformity validation effort has been pursued with selected data sets including an Earth-view data set. With this effort an initial validation of the on-orbit performance of the imaging spectrometer has been achieved, including validation of the cross-track spectral uniformity and spectral instantaneous field of view uniformity. The Moon Mineralogy Mapper is the first imaging spectrometer to measure a data set of this kind at the Moon. These calibrated science measurements are being used to address the full set of science goals and objectives for this mission. Copyright 2011 by the American Geophysical Union.
C. Pieters,; P. Mouroulis,; M. Eastwood,; J. Boardman,; Green, R.O.; Glavich, T.; Isaacson, P.; Annadurai, M.; Besse, S.; Cate, D.; Chatterjee, A.; Clark, R.; Barr, D.; Cheek, L.; Combe, J.; Dhingra, D.; Essandoh, V.; Geier, S.; Goswami, J.N.; Green, R.; Haemmerle, V.; Head, J.; Hovland, L.; Hyman, S.; Klima, R.; Koch, T.; Kramer, G.; Kumar, A.S.K.; Lee, K.; Lundeen, S.; Malaret, E.; McCord, T.; McLaughlin, S.; Mustard, J.; Nettles, J.; Petro, N.; Plourde, K.; Racho, C.; Rodriguez, J.; Runyon, C.; Sellar, G.; Smith, C.; Sobel, H.; Staid, M.; Sunshine, J.; Taylor, L.; Thaisen, K.; Tompkins, S.; Tseng, H.; Vane, G.; Varanasi, P.; White, M.; Wilson, D.
2011-01-01
The NASA Discovery Moon Mineralogy Mapper imaging spectrometer was selected to pursue a wide range of science objectives requiring measurement of composition at fine spatial scales over the full lunar surface. To pursue these objectives, a broad spectral range imaging spectrometer with high uniformity and high signal-to-noise ratio capable of measuring compositionally diagnostic spectral absorption features from a wide variety of known and possible lunar materials was required. For this purpose the Moon Mineralogy Mapper imaging spectrometer was designed and developed that measures the spectral range from 430 to 3000 nm with 10 nm spectral sampling through a 24 degree field of view with 0.7 milliradian spatial sampling. The instrument has a signal-to-noise ratio of greater than 400 for the specified equatorial reference radiance and greater than 100 for the polar reference radiance. The spectral cross-track uniformity is >90% and spectral instantaneous field-of-view uniformity is >90%. The Moon Mineralogy Mapper was launched on Chandrayaan-1 on the 22nd of October. On the 18th of November 2008 the Moon Mineralogy Mapper was turned on and collected a first light data set within 24 h. During this early checkout period and throughout the mission the spacecraft thermal environment and orbital parameters varied more than expected and placed operational and data quality constraints on the measurements. On the 29th of August 2009, spacecraft communication was lost. Over the course of the flight mission 1542 downlinked data sets were acquired that provide coverage of more than 95% of the lunar surface. An end-to-end science data calibration system was developed and all measurements have been passed through this system and delivered to the Planetary Data System (PDS.NASA.GOV). An extensive effort has been undertaken by the science team to validate the Moon Mineralogy Mapper science measurements in the context of the mission objectives. A focused spectral, radiometric, spatial, and uniformity validation effort has been pursued with selected data sets including an Earth-view data set. With this effort an initial validation of the on-orbit performance of the imaging spectrometer has been achieved, including validation of the cross-track spectral uniformity and spectral instantaneous field of view uniformity. The Moon Mineralogy Mapper is the first imaging spectrometer to measure a data set of this kind at the Moon. These calibrated science measurements are being used to address the full set of science goals and objectives for this mission.
Beringer, Richard M; Greenwood, Rosemary; Kilpatrick, Nicky
2014-02-01
Measuring perioperative behavior changes requires validated objective rating scales. We developed a simple score for children's behavior during induction of anesthesia (Pediatric Anesthesia Behavior score) and assessed its reliability, concurrent validity, and predictive validity. Data were collected as part of a wider observational study of perioperative behavior changes in children undergoing general anesthesia for elective dental extractions. One-hundred and two healthy children aged 2-12 were recruited. Previously validated behavioral scales were used as follows: the modified Yale Preoperative Anxiety Scale (m-YPAS); the induction compliance checklist (ICC); the Pediatric Anesthesia Emergence Delirium scale (PAED); and the Post-Hospitalization Behavior Questionnaire (PHBQ). Pediatric Anesthesia Behavior (PAB) score was independently measured by two investigators, to allow assessment of interobserver reliability. Concurrent validity was assessed by examining the correlation between the PAB score, the m-YPAS, and the ICC. Predictive validity was assessed by examining the association between the PAB score, the PAED scale, and the PHBQ. The PAB score correlated strongly with both the m-YPAS (P < 0.001) and the ICC (P < 0.001). PAB score was significantly associated with the PAED score (P = 0.031) and with the PHBQ (P = 0.034). Two independent investigators recorded identical PAB scores for 94% of children and overall, there was close agreement between scores (Kappa coefficient of 0.886 [P < 0.001]). The PAB score is simple to use and may predict which children are at increased risk of developing postoperative behavioral disturbance. This study provides evidence for its reliability and validity. © 2013 John Wiley & Sons Ltd.
2013-09-01
model , they are, for all intents and purposes, simply unit-less linear weights. Although this equation is technically valid for a Lambertian... modeled as a single flat facet, the same model cannot be assumed equally valid for the body. The body, after all, is a complex, three dimensional...facet (termed the “body”) and the solar tracking parts of the object as another facet (termed the solar panels). This comprises the two-facet model
The Grand Banks ERS-1 SAR wave spectra validation experiment
NASA Technical Reports Server (NTRS)
Vachon, P. W.; Dobson, F. W.; Smith, S. D.; Anderson, R. J.; Buckley, J. R.; Allingham, M.; Vandemark, D.; Walsh, E. J.; Khandekar, M.; Lalbeharry, R.
1993-01-01
As part of the ERS-1 validation program, the ERS-1 Synthetic Aperture Radar (SAR) wave spectra validation experiment was carried out over the Grand Banks of Newfoundland (Canada) in Nov. 1991. The principal objective of the experiment was to obtain complete sets of wind and wave data from a variety of calibrated instruments to validate SAR measurements of ocean wave spectra. The field program activities are described and the rather complex wind and wave conditions which were observed are summarized. Spectral comparisons with ERS-1 SAR image spectra are provided. The ERS-1 SAR is shown to have measured swell and range traveling wind seas, but did not measure azimuth traveling wind seas at any time during the experiment. Results of velocity bunching forward mapping and new measurements of the relationship between wind stress and sea state are also shown.
Objective validation of central sensitization in the rat UVB and heat rekindling model
Weerasinghe, NS; Lumb, BM; Apps, R; Koutsikou, S; Murrell, JC
2014-01-01
Background The UVB and heat rekindling (UVB/HR) model shows potential as a translatable inflammatory pain model. However, the occurrence of central sensitization in this model, a fundamental mechanism underlying chronic pain, has been debated. Face, construct and predictive validity are key requisites of animal models; electromyogram (EMG) recordings were utilized to objectively demonstrate validity of the rat UVB/HR model. Methods The UVB/HR model was induced on the heel of the hind paw under anaesthesia. Mechanical withdrawal thresholds (MWTs) were obtained from biceps femoris EMG responses to a gradually increasing pinch at the mid hind paw region under alfaxalone anaesthesia, 96 h after UVB irradiation. MWT was compared between UVB/HR and SHAM-treated rats (anaesthetic only). Underlying central mechanisms in the model were pharmacologically validated by MWT measurement following intrathecal N-methyl-d-aspartate (NMDA) receptor antagonist, MK-801, or saline. Results Secondary hyperalgesia was confirmed by a significantly lower pre-drug MWT {mean [±standard error of the mean (SEM)]} in UVB/HR [56.3 (±2.1) g/mm2, n = 15] compared with SHAM-treated rats [69.3 (±2.9) g/mm2, n = 8], confirming face validity of the model. Predictive validity was demonstrated by the attenuation of secondary hyperalgesia by MK-801, where mean (±SEM) MWT was significantly higher [77.2 (±5.9) g/mm2 n = 7] in comparison with pre-drug [57.8 (±3.5) g/mm2 n = 7] and saline [57.0 (±3.2) g/mm2 n = 8] at peak drug effect. The occurrence of central sensitization confirmed construct validity of the UVB/HR model. Conclusions This study used objective outcome measures of secondary hyperalgesia to validate the rat UVB/HR model as a translational model of inflammatory pain. What's already known about this topic? Most current animal chronic pain models lack translatability to human subjects. Primary hyperalgesia is an established feature of the UVB/heat rekindling inflammatory pain model in rodents and humans, but the presence of secondary hyperalgesia, a hallmark feature of central sensitization and thus chronic pain, is contentious. What does this study add? Secondary hyperalgesia was demonstrated in the rat UVB/heat rekindling model using an objective outcome measure (electromyogram), overcoming the subjective limitations of previous behavioural studies. PMID:24590815
STOPP/START Medication Criteria Modified for US Nursing Home Setting
Khodyakov, Dmitry; Ochoa, Aileen; Olivieri-Mui, Brianne L.; Bouwmeester, Carla; Zarowitz, Barbara J.; Patel, Meenakshi; Ching, Diana; Briesacher, Becky
2016-01-01
STRUCTURED ABSTRACT BACKGROUND/OBJECTIVES A barrier to assessing the quality of prescribing in nursing homes (NH) is the lack of explicit criteria for this setting. Our objective was to develop a set of prescribing indicators measurable with available data from electronic nursing home databases by adapting the European-based 2014 STOPP/START criteria of potentially inappropriate and underused medications for the US setting. DESIGN A two-stage expert panel process. In first stage, investigator team reviewed 114 criteria for compatibility and measurability. In second stage, we convened an online modified e-Delphi (OMD) panel to rate the validity of criteria and two webinars to identify criteria with highest relevance to US NHs. PARTICIPANTS Seventeen experts with recognized reputations in NH care participated in the e-Delphi panel and 12 in the webinar. MEASUREMENTS Compatibility and measurability were assessed by comparing criteria to US terminology/setting standards and data elements in NH databases. Validity was rated with a 9-point Likert-type scale (1=not valid at all, 9=highly valid). Mean, median, interpercentile ranges, and agreement were determined for each criterion score. Relevance was determined by ranking the mean panel ratings on criteria that reached agreement; half of the criteria with the highest mean values were reviewed and approved by the webinar participants. RESULTS Fifty-three STOPP/START criteria were deemed as compatible with US setting and measurable using data from electronic NH databases. E-Delphi panelists rated 48 criteria as valid for US NHs. Twenty-four criteria were deemed as most relevant, consisting of 22 measures of potentially inappropriate medications and 2 measures of underused medications. CONCLUSION This study created the first explicit criteria for assessing the quality of prescribing in US NHs. PMID:28008599
Sridharan, Sarup S; Burrowes, Lindsay M; Bouwmeester, J Christopher; Wang, Jiun-Jr; Shrive, Nigel G; Tyberg, John V
2012-05-01
Our "reservoir-wave approach" to arterial hemodynamics holds that measured arterial pressure should be considered to be the sum of a volume-related pressure (i.e., reservoir pressure, P(reservoir)) and a wave-related pressure (P(excess)). Because some have questioned whether P(reservoir) (and, by extension, P(excess)) is a real component of measured physiological pressure, it was important to demonstrate that P(reservoir) is implicit in Westerhof's classical electrical and hydraulic models of the 3-element Windkessel. To test the validity of our P(reservoir) determinations, we studied a freeware simulation of the electrical model and a benchtop recreation of the hydraulic model, respectively, measuring the voltage and the pressure distal to the proximal resistance. These measurements were then compared with P(reservoir), as calculated from physiological data. Thus, the first objective of this study was to demonstrate that respective voltage and pressure changes could be measured that were similar to calculated physiological values of P(reservoir). The second objective was to confirm previous predictions with respect to the specific effects of systematically altering proximal resistance, distal resistance, and capacitance. The results of this study validate P(reservoir) and, thus, the reservoir-wave approach.
The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity
Domes, Gregor; Marx, Lisa; Spenthof, Ines; Heinrichs, Markus
2016-01-01
Objective Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity. Methods Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures. Results The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version’s factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations. Conclusions The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research. PMID:26937638
Objective measures of situation awareness in a simulated medical environment
Wright, M; Taekman, J; Endsley, M
2004-01-01
One major limitation in the use of human patient simulators is a lack of objective, validated measures of human performance. Objective measures are necessary if simulators are to be used to evaluate the skills and training of medical practitioners and teams or to evaluate the impact of new processes or equipment design on overall system performance. Situation awareness (SA) refers to a person's perception and understanding of their dynamic environment. This awareness and comprehension is critical in making correct decisions that ultimately lead to correct actions in medical care settings. An objective measure of SA may be more sensitive and diagnostic than traditional performance measures. This paper reviews a theory of SA and discusses the methods required for developing an objective measure of SA within the context of a simulated medical environment. Analysis and interpretation of SA data for both individual and team performance in health care are also presented. PMID:15465958
NASA Rat Acoustic Tolerance Test 1994-1995
NASA Technical Reports Server (NTRS)
Holley, Daniel C.; Mele, Gary D.; Naidu, Sujata
1996-01-01
The major objective of this Cooperative Agreement was to develop a noise level specification for laboratory rats in the Centrifuge Facility Specimen Chambers (Space Station Biological Research Project), and to validate the specification for 3 noise octave bands: center frequencies 8 kHz, 16, kHz, and 32 kHz. This has been accomplished. Objective measures were used to verify that the chronic noise exposure was not harmful to the animals from physiological and behavioral perspectives. These measures were defined in the Stress Assessment Battery Validation for the Rat Acoustic Tolerance Test. In addition, the effects of the chronic noise exposure on rat hearing was assessed by the Brainstem Auditory Evoked Potential Method (BAER).
Clemes, Stacy A; Biddle, Stuart J H
2013-02-01
Pedometers are increasingly being used to measure physical activity in children and adolescents. This review provides an overview of common measurement issues relating to their use. Studies addressing the following measurement issues in children/adolescents (aged 3-18 years) were included: pedometer validity and reliability, monitoring period, wear time, reactivity, and data treatment and reporting. Pedometer surveillance studies in children/adolescents (aged: 4-18 years) were also included to enable common measurement protocols to be highlighted. In children > 5 years, pedometers provide a valid and reliable, objective measure of ambulatory activity. Further evidence is required on pedometer validity in preschool children. Across all ages, optimal monitoring frames to detect habitual activity have yet to be determined; most surveillance studies use 7 days. It is recommended that standardized wear time criteria are established for different age groups, and that wear times are reported. As activity varies between weekdays and weekend days, researchers interested in habitual activity should include both types of day in surveillance studies. There is conflicting evidence on the presence of reactivity to pedometers. Pedometers are a suitable tool to objectively assess ambulatory activity in children (> 5 years) and adolescents. This review provides recommendations to enhance the standardization of measurement protocols.
Development and Validation of a Test for Bulimia.
ERIC Educational Resources Information Center
Smith, Marcia C.; Thelen, Mark H.
1984-01-01
Developed the Bulimia Test (BULIT) based on responses of clinically identified females (N=18) and normal female college students (N=119) to preliminary test items. Results showed that the BULIT provided an objective, reliable, and valid measure by which to identify individuals with symptoms of bulimia. (Instrument is appended.) (LLL)
Validating the Food Behavior Questions from the Elementary School SPAN Questionnaire
ERIC Educational Resources Information Center
Thiagarajah, Krisha; Fly, Alyce D.; Hoelscher, Deanna M.; Bai, Yeon; Lo, Kaman; Leone, Angela; Shertzer, Julie A.
2008-01-01
Background: The School Physical Activity and Nutrition (SPAN) questionnaire was developed as a surveillance instrument to measure physical activity, nutrition attitudes, and dietary and physical activity behaviors in children and adolescents. The SPAN questionnaire has 2 versions. Objective: This study was conducted to evaluate the validity of…
Students' Self-Evaluation and Reflection (Part 1): "Measurement"
ERIC Educational Resources Information Center
Cambra-Fierro, Jesus; Cambra-Berdun, Jesus
2007-01-01
Purpose: The objective of the paper is the development and validation of scales to assess reflective learning. Design/methodology/approach: The research is based on a literature review plus in-classroom experience. For the scale validation process, exploratory and confirmatory analyses were conducted, following proposals made by Anderson and…
The Validity of the Interpersonal Behaviors Questionnaire (IBQ) in Sport
ERIC Educational Resources Information Center
Rocchi, Meredith; Pelletier, Luc; Desmarais, Philippe
2017-01-01
According to Self-Determination Theory (SDT), basic psychological needs will be influenced by other individuals' interpersonal behaviors. The objective of the present research is to extend the validity of the Interpersonal Behaviors Questionnaire (IBQ and IBQ-Self) to the sport context. The measure was designed to assess perceptions of…
Drug Use Disorder (DUD) Questionnaire: Scale Development and Validation
ERIC Educational Resources Information Center
Scherer, Michael; Furr-Holden, C. Debra; Voas, Robert B.
2013-01-01
Background: Despite the ample interest in the measurement of substance abuse and dependence, obtaining biological samples from participants as a means to validate a scale is considered time and cost intensive and is, subsequently, largely overlooked. Objectives: To report the psychometric properties of the drug use disorder (DUD) questionnaire…
ERIC Educational Resources Information Center
Gleason, Mary Margaret; Fox, Nathan A.; Drury, Stacy; Smyke, Anna; Egger, Helen L.; Nelson, Charles A., III; Gregas, Matthew C.; Zeanah, Charles H.
2011-01-01
Objective: This study examined the validity of criteria for indiscriminately social/disinhibited and emotionally withdrawn/inhibited reactive attachment disorder (RAD). Method: As part of a longitudinal intervention trial of previously institutionalized children, caregiver interviews and direct observational measurements provided continuous and…
NRA8-21 Cycle 2 RBCC Turbopump Risk Reduction
NASA Technical Reports Server (NTRS)
Ferguson, Thomas V.; Williams, Morgan; Marcu, Bogdan
2004-01-01
This project was composed of three sub-tasks. The objective of the first task was to use the CFD code INS3D to generate both on- and off-design predictions for the consortium optimized impeller flowfield. The results of the flow simulations are given in the first section. The objective of the second task was to construct a turbomachinery testing database comprised of measurements made on several different impellers, an inducer and a diffuser. The data was in the form of static pressure measurements as well as laser velocimeter measurements of velocities and flow angles within the stated components. Several databases with this information were created for these components. The third subtask objective was two-fold: first, to validate the Enigma CFD code for pump diffuser analysis, and secondly, to perform steady and unsteady analyses on some wide flow range diffuser concepts using Enigma. The code was validated using the consortium optimized impeller database and then applied to two different concepts for wide flow diffusers.
Measuring what matters: does 'objectivity' mean good science?
Kayes, Nicola M; McPherson, Kathryn M
2010-01-01
While the limitations of self-report measures are clearly acknowledged, less apparent is attention to the potential limitations of their 'objective' counterparts leading to the assumption that objectivity results in more robust and scientifically valid measurement tools. This article aims to: (1) test this assumption; (2) consider the implications of advocating for a measure on the basis of its objectivity; (3) propose an alternative approach to measure selection. A critical evaluation of one 'objective' measure highlights a number of potential limitations suggesting that the apparent willingness to adopt 'objective' measures with little questioning may be misguided. The possible implications of this are discussed and include a risk to the advancement of, and capacity for, knowledge in rehabilitation; or worse, of making clinical decisions based on erroneous conclusions. Characterising a measure on the basis of objectivity (or not) assumes an overly simplistic dichotomy that is unhelpful and perhaps misleading. We argue that assessing whether a measure is fit for purpose and makes mathematical sense is the key consideration. Indeed, in some cases, using both an 'objective' measure and a subjective rating scale may be appropriate and the only way of truly capturing the phenomenon of interest.
Predicting implementation from organizational readiness for change: a study protocol
2011-01-01
Background There is widespread interest in measuring organizational readiness to implement evidence-based practices in clinical care. However, there are a number of challenges to validating organizational measures, including inferential bias arising from the halo effect and method bias - two threats to validity that, while well-documented by organizational scholars, are often ignored in health services research. We describe a protocol to comprehensively assess the psychometric properties of a previously developed survey, the Organizational Readiness to Change Assessment. Objectives Our objective is to conduct a comprehensive assessment of the psychometric properties of the Organizational Readiness to Change Assessment incorporating methods specifically to address threats from halo effect and method bias. Methods and Design We will conduct three sets of analyses using longitudinal, secondary data from four partner projects, each testing interventions to improve the implementation of an evidence-based clinical practice. Partner projects field the Organizational Readiness to Change Assessment at baseline (n = 208 respondents; 53 facilities), and prospectively assesses the degree to which the evidence-based practice is implemented. We will conduct predictive and concurrent validities using hierarchical linear modeling and multivariate regression, respectively. For predictive validity, the outcome is the change from baseline to follow-up in the use of the evidence-based practice. We will use intra-class correlations derived from hierarchical linear models to assess inter-rater reliability. Two partner projects will also field measures of job satisfaction for convergent and discriminant validity analyses, and will field Organizational Readiness to Change Assessment measures at follow-up for concurrent validity (n = 158 respondents; 33 facilities). Convergent and discriminant validities will test associations between organizational readiness and different aspects of job satisfaction: satisfaction with leadership, which should be highly correlated with readiness, versus satisfaction with salary, which should be less correlated with readiness. Content validity will be assessed using an expert panel and modified Delphi technique. Discussion We propose a comprehensive protocol for validating a survey instrument for assessing organizational readiness to change that specifically addresses key threats of bias related to halo effect, method bias and questions of construct validity that often go unexplored in research using measures of organizational constructs. PMID:21777479
USDA-ARS?s Scientific Manuscript database
Objectives: Intake and status of carotenoids have been associated with chronic disease. The objectives of this study were to examine the association between carotenoid intakes as measured by two regional food-frequency questionnaires (FFQs) and their corresponding measures in serum, and to report ...
Blackhall, Leslie J; Erickson, Jeanne; Brashers, Valentina; Owen, John; Thomas, Shannon
2014-01-01
Helping families make end-of-life decisions requires close collaboration between physicians and nurses. However, medical and nursing students have little formal training in how to collaborate in this task, and few instruments are available to measure collaborative behaviors. The objective of this project was to develop and validate observational assessment tools to measure specific interprofessional competencies in medical and nursing students related to end-of-life discussions. A literature search for evidence-based guidelines and competencies and focus groups with an expert panel of nurses and physicians were used to outline best collaborative practice behaviors for nurses and physicians in an end-of-life decision making simulation. The panel used these practice-behavior checklists to rate videotaped student scenarios and then refined the checklists for validity and clarity until the tools had acceptable inter-rater reliability. The setting was a workshop teaching end-of-life communication to third-year nursing and medical students. Inter-rater reliability was measured using percent agreement and kappa; internal consistency was measured using Cronbach's alpha. Collaborative behaviors objective assessment tools (CBOATs) for nursing and medical students were developed. For the medical CBOAT we found 85% agreement between raters, with an overall kappa of 0.744 and Cronbach's alpha of 0.806. For the nursing CBOAT there was 81% agreement, with a kappa of 0.686 and Cronbach's alpha of 0.845. Development of an end-of-life CBOAT clarified the important collaborative behaviors needed by physician and nurse. The resulting instruments provide a helpful guide for teaching interprofessional sessions related to the end of life and measuring student outcomes using an objective strategy.
Validation to Spanish of the Caring Assessment Tool (CAT-V)
Ayuso, Rosa María Fernández; Velázquez, Juan Manuel Morillo; Ayuso, David Fernández; de la Torre-Montero, Julio César
2017-01-01
Resume Objective: to translate and validate to Spanish the Caring Assessment Scale tool, CAT-V, by Joanne Duffy, within the framework of Jean Watson; as a secondary objective, it is proposed to evaluate its psychometric properties. There are tools designed to measure the patient’s perception of provided cares, including CAT-V, the subject of our interest, in a way that it can be used in Spanish-speaking patients. Methods: to meet the objectives, it was performed sequential translation and retro-translation of the scale to be validated, through a standardized procedure. The final version of that scale was validated in a sample of 349 patients from four public and two private hospitals in Madrid, Spain. Results: The instrument was translated and validated with high internal consistency (Cronbach’s alpha .953). The subsequent factor analysis revealed a three-factor structure, not coincident with the data from the US population. Conclusion: it is considered that the translation of CAT-V is a suitable instrument to be used in the evaluation of patient care in Ibero-american health centers whose language is Spanish. PMID:29069268
Standards for Evaluating Criterion-Referenced Tests.
ERIC Educational Resources Information Center
Walker, Clinton B.
Standards for evaluating criterion-referenced tests are presented. Twenty-one standards, grouped in three categories, are discussed. Category one is defined as measurement properties and is comprised of conceptual validity, including description of the domain, test item agreement with objectives, and item representativeness of the objectives; and…
Remote sensing imagery classification using multi-objective gravitational search algorithm
NASA Astrophysics Data System (ADS)
Zhang, Aizhu; Sun, Genyun; Wang, Zhenjie
2016-10-01
Simultaneous optimization of different validity measures can capture different data characteristics of remote sensing imagery (RSI) and thereby achieving high quality classification results. In this paper, two conflicting cluster validity indices, the Xie-Beni (XB) index and the fuzzy C-means (FCM) (Jm) measure, are integrated with a diversity-enhanced and memory-based multi-objective gravitational search algorithm (DMMOGSA) to present a novel multi-objective optimization based RSI classification method. In this method, the Gabor filter method is firstly implemented to extract texture features of RSI. Then, the texture features are syncretized with the spectral features to construct the spatial-spectral feature space/set of the RSI. Afterwards, cluster of the spectral-spatial feature set is carried out on the basis of the proposed method. To be specific, cluster centers are randomly generated initially. After that, the cluster centers are updated and optimized adaptively by employing the DMMOGSA. Accordingly, a set of non-dominated cluster centers are obtained. Therefore, numbers of image classification results of RSI are produced and users can pick up the most promising one according to their problem requirements. To quantitatively and qualitatively validate the effectiveness of the proposed method, the proposed classification method was applied to classifier two aerial high-resolution remote sensing imageries. The obtained classification results are compared with that produced by two single cluster validity index based and two state-of-the-art multi-objective optimization algorithms based classification results. Comparison results show that the proposed method can achieve more accurate RSI classification.
Espinoza-Venegas, Maritza; Sanhueza-Alvarado, Olivia; Ramírez-Elizondo, Noé; Sáez-Carrillo, Katia
2015-01-01
OBJECTIVE: The current study aimed to validate the construct and reliability of an emotional intelligence scale. METHOD: The Trait Meta-Mood Scale-24 was applied to 349 nursing students. The process included content validation, which involved expert reviews, pilot testing, measurements of reliability using Cronbach's alpha, and factor analysis to corroborate the validity of the theoretical model's construct. RESULTS: Adequate Cronbach coefficients were obtained for all three dimensions, and factor analysis confirmed the scale's dimensions (perception, comprehension, and regulation). CONCLUSION: The Trait Meta-Mood Scale is a reliable and valid tool to measure the emotional intelligence of nursing students. Its use allows for accurate determinations of individuals' abilities to interpret and manage emotions. At the same time, this new construct is of potential importance for measurements in nursing leadership; educational, organizational, and personal improvements; and the establishment of effective relationships with patients. PMID:25806642
Validation of a condition-specific measure for women having an abnormal screening mammography.
Brodersen, John; Thorsen, Hanne; Kreiner, Svend
2007-01-01
The aim of this study is to assess the validity of a new condition-specific instrument measuring psychosocial consequences of abnormal screening mammography (PCQ-DK33). The draft version of the PCQ-DK33 was completed on two occasions by 184 women who had received an abnormal screening mammography and on one occasion by 240 women who had received a normal screening result. Item Response Theories and Classical Test Theories were used to analyze data. Construct validity, concurrent validity, known group validity, objectivity and reliability were established by item analysis examining the fit between item responses and Rasch models. Six dimensions covering anxiety, behavioral impact, sense of dejection, impact on sleep, breast examination, and sexuality were identified. One item belonging to the dejection dimension had uniform differential item functioning. Two items not fitting the Rasch models were retained because of high face validity. A sick leave item added useful information when measuring side effects and socioeconomic consequences of breast cancer screening. Five "poor items" were identified and should be deleted from the final instrument. Preliminary evidence for a valid and reliable condition-specific measure for women having an abnormal screening mammography was established. The measure includes 27 "good" items measuring different attributes of the same overall latent structure-the psychosocial consequences of abnormal screening mammography.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Ricks, Allen; Blanchat, Thomas K.; Jernigan, Dann A.
2006-06-01
It is necessary to improve understanding and develop validation data of the heat flux incident to an object located within the fire plume for the validation of SIERRA/ FUEGO/SYRINX fire and SIERRA/CALORE. One key aspect of the validation data sets is the determination of the relative contribution of the radiative and convective heat fluxes. To meet this objective, a cylindrical calorimeter with sufficient instrumentation to measure total and radiative heat flux had been designed and fabricated. This calorimeter will be tested both in the controlled radiative environment of the Penlight facility and in a fire environment in the FLAME/Radiant Heatmore » (FRH) facility. Validation experiments are specifically designed for direct comparison with the computational predictions. Making meaningful comparisons between the computational and experimental results requires careful characterization and control of the experimental features or parameters used as inputs into the computational model. Validation experiments must be designed to capture the essential physical phenomena, including all relevant initial and boundary conditions. A significant question of interest to modeling heat flux incident to an object in or near a fire is the contribution of the radiation and convection modes of heat transfer. The series of experiments documented in this test plan is designed to provide data on the radiation partitioning, defined as the fraction of the total heat flux that is due to radiation.« less
Object-oriented productivity metrics
NASA Technical Reports Server (NTRS)
Connell, John L.; Eller, Nancy
1992-01-01
Software productivity metrics are useful for sizing and costing proposed software and for measuring development productivity. Estimating and measuring source lines of code (SLOC) has proven to be a bad idea because it encourages writing more lines of code and using lower level languages. Function Point Analysis is an improved software metric system, but it is not compatible with newer rapid prototyping and object-oriented approaches to software development. A process is presented here for counting object-oriented effort points, based on a preliminary object-oriented analysis. It is proposed that this approach is compatible with object-oriented analysis, design, programming, and rapid prototyping. Statistics gathered on actual projects are presented to validate the approach.
Adams, Marc A; Ryan, Sherry; Kerr, Jacqueline; Sallis, James F; Patrick, Kevin; Frank, Lawrence D; Norman, Gregory J
2009-01-01
Concurrent validity of Neighborhood Environment Walkability Scale (NEWS) items was evaluated with objective measures of the built environment using geographic information systems (GIS). A sample of 878 parents of children 10 to 16 years old (mean age 43.5 years, SD = 6.8, 34.8% non-White, 63.8% overweight) completed NEWS and the International Physical Activity Questionnaire. GIS was used to develop 1-mile street network buffers around participants' residences. GIS measures of the built environment within participants' buffers included percent of commercial and institutional land uses; number of schools and colleges, recreational facilities, parks, transit stops, and trees; land topography; and traffic congestion. Except for trees and traffic, concordance between the NEWS and GIS measures were significant, with weak to moderate effect sizes (r = -0.09 to -0.36, all P < or = 01). After participants were stratified by physical activity level, stronger concordance was observed among active participants for some measures. A sensitivity analysis of self-reported distance to 15 neighborhood destinations found a 20-minute (compared with 10- or 30-minute) walking threshold generally had the strongest correlations with GIS measures. These findings provide evidence of the concurrent validity of self-reported built environment items with objective measures. Physically active adults may be more knowledgeable about their neighborhood characteristics.
de Mesquita, Gabriel Nunes; de Oliveira, Marcela Nicácio Medeiros; Matoso, Amanda Ellen Rodrigues; Filho, Alberto Galvão de Moura; de Oliveira, Rodrigo Ribeiro
2018-04-24
Study Design Clinical measurement study. Background Achilles tendon disorders are very common among athletes and it is important to objectively measure symptoms and functional limitations related to Achilles tendinopathy using outcome measures that have been validated in the language of the target population. Objectives To perform a cross-cultural adaptation and to evaluate the measurement properties of the Brazilian version of the Victorian Institute of Sport Assessment-Achilles (VISA-A) questionnaire. Methods We adapted the VISA-A questionnaire to Brazilian Portuguese (VISA-A-Br). The questionnaire was applied on 2 occasions with an interval of 5 to 14 days. We evaluated the following measurement properties: internal consistency, test-retest reliability, measurement error, construct validity, and ceiling and floor effects. Results The VISA-A-Br showed good internal consistency (Cronbach's alpha = 0.79; after excluding 1 item at a time, Cronbach's α = 0.73 to 0.84), good test-retest reliability (ICC agreement2,1 = 0.84, 95% confidence interval = 0.71-0.91), an acceptable measurement error (standard error of measurement = 3.25 points and Smallest Detectable Change= 9.02 points), good construct validity (Spearman's coefficient with LEFS= 0.73 and FAOS in its 5 subscales; Pain= 0.66, other Symptoms=0.48, Function in daily living (ADL)= 0.59, Function in sport and recreation=0.67, and foot and ankle-related Quality of Life = 0.7), and no ceiling and floor effects. Conclusion The VISA-A-Br is equivalent to the original version; it has been validated and confirmed as reliable to measure pain and function among the Brazilian population with Achilles tendinopathy, and it can be used in clinical and scientific settings. J Orthop Sports Phys Ther, Epub 24 Apr 2018. doi:10.2519/jospt.2018.7897.
ERIC Educational Resources Information Center
Wendt, Marilynn S.; Jacobson, Marjory E.
Specific objectives of this two-phase study included: (1) assessment of design of the behavioral objectives in all secondary level courses; (2) construction of criteria for evaluation of the design; (3) testing of objectives against the evaluative criteria and/or the specifications of the curriculum design; and (4) determination of the validity of…
The FLIR ONE thermal imager for the assessment of burn wounds: Reliability and validity study.
Jaspers, M E H; Carrière, M E; Meij-de Vries, A; Klaessens, J H G M; van Zuijlen, P P M
2017-11-01
Objective measurement tools may be of great value to provide early and reliable burn wound assessment. Thermal imaging is an easy, accessible and objective technique, which measures skin temperature as an indicator of tissue perfusion. These thermal images might be helpful in the assessment of burn wounds. However, before implementation of a novel measurement tool into clinical practice is considered, it is appropriate to test its clinimetric properties (i.e. reliability and validity). The objective of this study was to assess the reliability and validity of the recently introduced FLIR ONE thermal imager. Two observers obtained thermal images of burn wounds in adult patients at day 1-3, 4-7 and 8-10 after burn. Subsequently, temperature differences between the burn wound and healthy skin (ΔT) were calculated on an iPad mini containing the FLIR Tools app. To assess reliability, ΔT values of both observers were compared by calculating the intraclass correlation coefficient (ICC) and measurement error parameters. To assess validity, the ΔT values of the first observer were compared to the registered healing time of the burn wounds, which was specified into three categories: (I) ≤14 days, (II) 15-21 days and (III) >21 days. The ability of the FLIR ONE to discriminate between healing ≤21 days and >21 days was evaluated by means of a receiver operating characteristic curve and an optimal ΔT cut-off value. Reliability: ICCs were 0.99 for each time point, indicating excellent reliability up to 10 days after burn. The standard error of measurement varied between 0.17-0.22°C. the area under the curve was calculated at 0.69 (95% CI 0.54-0.84). A cut-off value of -1.15°C shows a moderate discrimination between burn wound healing ≤21 days and >21 days (46% sensitivity; 82% specificity). Our results show that the FLIR ONE thermal imager is highly reliable, but the moderate validity calls for additional research. However, the FLIR ONE is pre-eminently feasible, allowing easy and fast measurements in clinical burn practice. Copyright © 2017 Elsevier Ltd and ISBI. All rights reserved.
Solar Sail Models and Test Measurements Correspondence for Validation Requirements Definition
NASA Technical Reports Server (NTRS)
Ewing, Anthony; Adams, Charles
2004-01-01
Solar sails are being developed as a mission-enabling technology in support of future NASA science missions. Current efforts have advanced solar sail technology sufficient to justify a flight validation program. A primary objective of this activity is to test and validate solar sail models that are currently under development so that they may be used with confidence in future science mission development (e.g., scalable to larger sails). Both system and model validation requirements must be defined early in the program to guide design cycles and to ensure that relevant and sufficient test data will be obtained to conduct model validation to the level required. A process of model identification, model input/output documentation, model sensitivity analyses, and test measurement correspondence is required so that decisions can be made to satisfy validation requirements within program constraints.
ERIC Educational Resources Information Center
Wyker, Brett A.; Jordan, Patricia; Quigley, Danielle L.
2012-01-01
Objective: Application of the Transtheoretical Model (TTM) to Supplemental Nutrition Assistance Program Education (SNAP-Ed) evaluation and development and validation of an evaluation tool used to measure TTM constructs is described. Methods: Surveys were collected from parents of children receiving food at Summer Food Service Program sites prior…
Validation of the Adult ADHD Investigator Symptom Rating Scale (AISRS)
ERIC Educational Resources Information Center
Spencer, Thomas J.; Adler, Lenard A.; Qiao, Meihua; Saylor, Keith E.; Brown, Thomas E.; Holdnack, James A.; Schuh, Kory J.; Trzepacz, Paula T.; Kelsey, Douglas K.
2010-01-01
Objective: Validation of the Adult ADHD Investigator Symptom Rating Scale (AISRS) that measures aspects of ADHD in adults. Method: Psychometric properties of the AISRS total and AISRS subscales are analyzed and compared to the Conners' Adult Attention-Deficit/Hyperactivity Disorder Rating Scale-Investigator Rated: Screening Version (CAARS-Inv:SV)…
Validation of the School Conflict Negotiation Effectiveness Questionnaire
ERIC Educational Resources Information Center
Cunha, Pedro; Lourenço, Abílio; Paiva, Maria Olímpia; Monteiro, Ana Paula
2017-01-01
This research aimed to construct and validate the School Conflict Negotiation Effectiveness Questionnaire (SCNEQ). This objective is both based on the increasing relevance of the area of constructive conflict management in schools and also in the scarcity of instruments that try to measure these dimensions in the educational context. We used two…
ERIC Educational Resources Information Center
Matte, Melody; Lafontaine, Marie-France
2012-01-01
The objective of the present study was to provide validity evidence for the scores from the Romantic Relationship Perfectionism Scale. Results indicate a two-factor structure, adequate reliability, and overall good convergent, concurrent, discriminant, and incremental validity evidence. The strengths and limitations of this measure are discussed.…
Assessment of Perceived Parental Psychological Control in Chinese Adolescents in Hong Kong
ERIC Educational Resources Information Center
Shek, Daniel T. L.
2006-01-01
Objective: There is no validated self-report measure of parental psychological control in the Chinese culture. The reliability and validity of the Chinese Paternal Psychological Control Scale (CPPCS) and Chinese Maternal Psychological Control Scale (CMPCS) were examined. Method: A total of 3,017 Chinese secondary school students responded to the…
Calibration and validation of the COSMOS rover for surface soil moisture
USDA-ARS?s Scientific Manuscript database
The mobile COsmic-ray Soil Moisture Observing System (COSMOS) rover may be useful for validating satellite-based estimates of near surface soil moisture, but the accuracy with which the rover can measure 0-5 cm soil moisture has not been previously determined. Our objectives were to calibrate and va...
Paul, Marek A.; Kamali, Parisa; Chen, Austin D.; Ibrahim, Ahmed M. S.; Wu, Winona; Becherer, Babette E.; Medin, Caroline
2018-01-01
Background: Rhinoplasty is 1 of the most common aesthetic and reconstructive plastic surgical procedures performed within the United States. Yet, data on functional reconstructive open and closed rhinoplasty procedures with or without spreader graft placement are not definitive as only a few studies have examined both validated measurable objective and subjective outcomes of spreader grafting during rhinoplasty. The aim of this study was to utilize previously validated measures to assess objective, functional outcomes in patients who underwent open and closed rhinoplasty with spreader grafting. Methods: We performed a retrospective review of consecutive rhinoplasty patients. Patients with internal nasal valve insufficiency who underwent an open and closed approach rhinoplasty between 2007 and 2016 were studied. The Cottle test and Nasal Obstruction Symptom Evaluation survey was used to assess nasal obstruction. Patient-reported symptoms were recorded. Acoustic rhinometry was performed pre- and postoperatively. Average minimal cross-sectional area of the nose was measured. Results: One hundred seventy-eight patients were reviewed over a period of 8 years. Thirty-eight patients were included in this study. Of those, 30 patients underwent closed rhinoplasty and 8 open rhinoplasty. Mean age was 36.9 ± 18.4 years. The average cross-sectional area in closed and open rhinoplasty patients increased significantly (P = 0.019). There was a functional improvement in all presented cases using the Nasal Obstruction Symptom Evaluation scale evaluation. Conclusions: Closed rhinoplasty with spreader grafting may play a significant role in the treatment of nasal valve collapse. A closed approach rhinoplasty including spreader grafting is a viable option in select cases with objective and validated functional improvement. PMID:29707440
Validity of a parent-report measure of vocabulary and grammar for Spanish-speaking toddlers.
Thal, D; Jackson-Maldonado, D; Acosta, D
2000-10-01
The validity of the Fundación MacArthur Inventario del Desarrollo de Habilidades Comunicativas: Palabras y Enunciados (IDHC:PE) was examined with twenty 20- and nineteen 28-month-old, typically developing, monolingual, Spanish-speaking children living in Mexico. One measure of vocabulary (number of words) and two measures of grammar (mean of the three longest utterances and grammatical complexity score) from the IDHC:PE were compared to behavioral measures of vocabulary (number of different words from a language sample and number of objects named in a confrontation naming task) and one behavioral measure of grammar (mean length of utterance from a language sample). Only vocabulary measures were assessed in the 20-month-olds because of floor effects on the grammar measures. Results indicated validity for assessing expressive vocabulary in 20-month-olds and expressive vocabulary and grammar in 28-month-olds.
Gudbergsen, Henrik; Kjærgaard, Morten; Lykkegaard, Kasper Lundberg
2018-01-01
Physical inactivity is important to address, and an objective way of measuring inactivity is by accelerometry. The objective of this study was to determine the reliability and construct validity of the SENS motion system to record physical activity and inactivity in patients with knee osteoarthritis. Participants with an age > 40 years and an average weekly pain above 0 on a numeric rating scale (0 = no pain, 10 = worst pain) were included. Participants had a total of two study visits and at each visit participants completed a standardized activity. Data from 24 participants were analysed. A mean agreement of 99% (SD 3%) for sedentary behaviour and a mean agreement of 97% (SD 9%) for active behaviour were found. The agreement for “walking” was 28% (SD 18%). Mean agreement between recordings on the two visits was 96% (SD 8%) for sedentary behaviour and 99% (SD 1%) for active behaviour. The SENS motion activity measurement system can be regarded as a reliable and valid device for measuring sedentary behaviour in patients with knee OA, whereas detection of walking is not reliable and would require further work. PMID:29686901
Renison, Belinda; Ponsford, Jennie; Testa, Renee; Richardson, Barry; Brownfield, Kylie
2012-05-01
Virtual reality (VR) assessment paradigms have the potential to address the limited ecological validity of pen and paper measures of executive function (EF) and the pragmatic and reliability issues associated with functional measures. To investigate the ecological validity and construct validity of a newly developed VR measure of EF, the Virtual Library Task (VLT); a real life analogous task--the Real Library Task (RLT); and five neuropsychological measures of EF were administered to 30 patients with traumatic brain injury (TBI) and 30 healthy Controls. Significant others for each participant also completed the Dysexecutive Questionnaire (DEX), which is a behavioral rating scale of everyday EF. Performances on the VLT and the RLT were significantly positively correlated indicating that VR performance is similar to real world performance. The TBI group performed significantly worse than the Control group on the VLT and the Modified Six Elements Test (MSET) but the other four neuropsychological measures of EF failed to differentiate the groups. Both the MSET and the VLT significantly predicted everyday EF suggesting that they are both ecologically valid tools for the assessment of EF. The VLT has the advantage over the MSET of providing objective measurement of individual components of EF.
STS-41 crewmembers conduct DSO 0472 Intraocular Pressure on OV-103's middeck
1990-10-10
STS-41 crewmembers conduct Detailed Supplementary Objective (DSO) 0472 Intraocular Pressure on the middeck of Discovery, Orbiter Vehicle (OV) 103. Mission Specialist (MS) William M. Shepherd rests his head on the stowed treadmill while Pilot Robert D. Cabana, holding Shepherd's eye open, prepares to measure Shepherd's intraocular pressure using a tono pen (in his right hand). Objectives include: establishing a database of changes in intraocular pressures that can be used to evaluate crew health; validating ten degree head down bedrest as a model for cephalad fluid shifts in microgravity; facilitating the interpretation of data by providing a quantative measure of microgravity induced cephalad fluid shifts; and validating the tono pen as an effective tool for diagnostic and scientific data collection.
Assessing Anger Expression: Construct Validity of Three Emotion Expression-Related Measures
Jasinski, Matthew J.; Lumley, Mark A.; Latsch, Deborah V.; Schuster, Erik; Kinner, Ellen; Burns, John W.
2016-01-01
Self-report measures of emotional expression are common, but their validity to predict objective emotional expression, particularly of anger, is unclear. We tested the validity of the Anger Expression Inventory (AEI; Spielberger et al., 1985)), Emotional Approach Coping Scale (EAC; Stanton, Kirk, Cameron & Danoff-Burg, 2000), and Toronto Alexithymia Scale-20 (TAS-20; Bagby, Taylor, & Parker, 1994) to predict objective anger expression in 95 adults with chronic back pain. Participants attempted to solve a difficult computer maze by following the directions of a confederate who treated them rudely and unjustly. Participants then expressed their feelings for 4 minutes. Blinded raters coded the videos for anger expression, and a software program analyzed expression transcripts for anger-related words. Analyses related each questionnaire to anger expression. The AEI anger-out scale predicted greater anger expression, as expected, but AEI anger-in did not. The EAC emotional processing scale predicted less anger expression, but the EAC emotional expression scale was unrelated to anger expression. Finally, the TAS-20 predicted greater anger expression. Findings support the validity of the AEI anger-out scale but raise questions about the other measures. The assessment of emotional expression by self-report is complex and perhaps confounded by general emotional experience, the specificity or generality of the emotion(s) assessed, and self-awareness limitations. Performance-based or clinician-rated measures of emotion expression are needed. PMID:27248355
de Vries, Anna H; Muijtjens, Arno M M; van Genugten, Hilde G J; Hendrikx, Ad J M; Koldewijn, Evert L; Schout, Barbara M A; van der Vleuten, Cees P M; Wagner, Cordula; Tjiam, Irene M; van Merriënboer, Jeroen J G
2018-06-05
The current shift towards competency-based residency training has increased the need for objective assessment of skills. In this study, we developed and validated an assessment tool that measures technical and non-technical competency in transurethral resection of bladder tumour (TURBT). The 'Test Objective Competency' (TOCO)-TURBT tool was designed by means of cognitive task analysis (CTA), which included expert consensus. The tool consists of 51 items, divided into 3 phases: preparatory (n = 15), procedural (n = 21), and completion (n = 15). For validation of the TOCO-TURBT tool, 2 TURBT procedures were performed and videotaped by 25 urologists and 51 residents in a simulated setting. The participants' degree of competence was assessed by a panel of eight independent expert urologists using the TOCO-TURBT tool. Each procedure was assessed by two raters. Feasibility, acceptability and content validity were evaluated by means of a quantitative cross-sectional survey. Regression analyses were performed to assess the strength of the relation between experience and test scores (construct validity). Reliability was analysed by generalizability theory. The majority of assessors and urologists indicated the TOCO-TURBT tool to be a valid assessment of competency and would support the implementation of the TOCO-TURBT assessment as a certification method for residents. Construct validity was clearly established for all outcome measures of the procedural phase (all r > 0.5, p < 0.01). Generalizability-theory analysis showed high reliability (coefficient Phi ≥ 0.8) when using the format of two assessors and two cases. This study provides first evidence that the TOCO-TURBT tool is a feasible, valid and reliable assessment tool for measuring competency in TURBT. The tool has the potential to be used for future certification of competencies for residents and urologists. The methodology of CTA might be valuable in the development of assessment tools in other areas of clinical practice.
Osypuk, Theresa L; Kehm, Rebecca; Misra, Dawn P
2015-01-01
Early life exposures influence numerous social determinants of health, as distal causes or confounders of later health outcomes. Although a growing literature is documenting how early life socioeconomic position affects later life health, few epidemiologic studies have tested measures for operationalizing early life neighborhood context, or examined their effects on later life health. In the Life-course Influences on Fetal Environments (LIFE) Study, a retrospective cohort study among Black women in Southfield, Michigan (71% response rate), we tested the validity and reliability of retrospectively-reported survey-based subjective measures of early life neighborhood context(N=693). We compared 3 subjective childhood neighborhood measures (disorder, informal social control, victimization), with 3 objective childhood neighborhood measures derived from 4 decades of historical census tract data 1970-2000, linked through geocoded residential histories (tract % poverty, tract % black, tract deprivation score derived from principal components analysis), as well as with 2 subjective neighborhood measures in adulthood. Our results documented that internal consistency reliability was high for the subjective childhood neighborhood scales (Cronbach's α =0.89, 0.93). Comparison of subjective with objective childhood neighborhood measures found moderate associations in hypothesized directions. Associations with objective variables were strongest for neighborhood disorder (rhos=.40), as opposed to with social control or victimization. Associations between subjective neighborhood context in childhood versus adulthood were moderate and stronger for residentially-stable populations. We lastly formally tested for, but found little evidence of, recall bias of the retrospective subjective reports of childhood context. These results provide evidence that retrospective reports of subjective neighborhood context may be a cost-effective, valid, and reliable method to operationalize early life context for health studies.
Validation of Family, School, and Peer Influence on Volunteerism Scale among Adolescents
ERIC Educational Resources Information Center
Law, Ben M. F.; Shek, Daniel T. L.; Ma, Cecilia M. S.
2013-01-01
Social systems, particularly family, school, and peer, are especially critical in influencing adolescents to participate in volunteer service; however, no objective measures of this construct exist. Objectives: This study examined the psychometric properties of the Family, School, and Peer Influence on Volunteerism scale (FSPV) among Chinese…
Developing a Comparative Measure of the Learning Climate in Professional Schools
ERIC Educational Resources Information Center
Bowen, Donald D.; Kilmann, Ralph H.
1975-01-01
The Learning Climate Questionnaire (LCQ) compares the objective properties of schools with measures of overall student satisfaction. The validity of the instrument suggests its use for substantive research investigations into the organizational dynamics of professional schools. (Author/JR)
Measuring Maternal Behaviors in the Neonatal Intensive Care Unit
ERIC Educational Resources Information Center
Lakes, Kimberley D.; Guo, Yuqing; Taylor Lucas, Candice; Cooper, Dan
2017-01-01
One of the most important considerations in designing clinical infant research studies is the selection of reliable and valid measurement procedures. Few measures of caregiver-child interactions have been studied with newborns, particularly premature infants. The main objective of this study was to examine psychometric properties of the National…
NASA Technical Reports Server (NTRS)
Brinberg, Herbert R.; Pinelli, Thomas E.; Barclay, Rebecca O.
1995-01-01
Consideration effort has been devoted over the past 30 years to developing methods and means of assessing the value of information. Two approaches - value in exchange and value in use - dominate; however, neither approach enjoys much practical application because validation schema for decision-making is missing. The approaches fail to measure objectively the real costs of acquiring information and the real benefits that information will yield. Moreover, these approaches collectively fail to provide economic justification to build and/or continue to support an information product or service. In addition, the impact of Cyberspace adds a new dimension to the problem. A new paradigm is required to make economic sense in this revolutionary information environment. In previous work, the authors explored the various approaches to measuring the value of information and concluded that, in large measure, these methods were unworkable concepts and constructs. Instead, they proposed several axioms for valuing information. Most particularly they concluded that the 'value of information cannot be measured in the absence of a specific task, objective, or goal.' This paper builds on those axioms and describes under which circumstances information can be measured in objective and actionable terms. This paper also proposes a methodology for undertaking such measures and validating the results.
Abdulrahim, Sawsan; El Asmar, Khalil
2012-09-17
Some evidence from high-income countries suggests that self-rated health (SRH) is not a consistent predictor of objective health across social groups, and that its use may lead to inaccurate estimates of the effects of inequities on health. Given increased interest in studying and monitoring social inequities in health worldwide, the aim of the present study was to evaluate the validity of SRH as a consistent measure of health across socioeconomic categories in six Arab countries. We employed the PAPFAM population-based survey data on women from Morocco, Algeria, Tunisia, Lebanon, Syria, and the Occupied Palestinian Territories (OPT). Multivariate logistic regression analyses were performed to assess the strength of the association between fair/poor SRH and objective health (reporting at least one chronic condition), adjusting for available socio-demographic and health-related variables. Analyses were then stratified by two socioeconomic indicators: education and household economic status. The association between SRH and objective health is strong in Algeria, Tunisia, Lebanon, Syria, and OPT, but weak in Morocco. The strength of the association between reporting fair/poor health and objective health was not moderated by education or household economic status in any of the six countries. As the SRH-objective health association does not vary across social categories, the use of the measure in social inequities in health research is justified. These results should not preclude the need to carry out other validation studies using longitudinal data on men and women, or the need to advocate for improving the quality of morbidity and mortality data in the Arab region.
2012-01-01
Introduction Some evidence from high-income countries suggests that self-rated health (SRH) is not a consistent predictor of objective health across social groups, and that its use may lead to inaccurate estimates of the effects of inequities on health. Given increased interest in studying and monitoring social inequities in health worldwide, the aim of the present study was to evaluate the validity of SRH as a consistent measure of health across socioeconomic categories in six Arab countries. Methods We employed the PAPFAM population-based survey data on women from Morocco, Algeria, Tunisia, Lebanon, Syria, and the Occupied Palestinian Territories (OPT). Multivariate logistic regression analyses were performed to assess the strength of the association between fair/poor SRH and objective health (reporting at least one chronic condition), adjusting for available socio-demographic and health-related variables. Analyses were then stratified by two socioeconomic indicators: education and household economic status. Results The association between SRH and objective health is strong in Algeria, Tunisia, Lebanon, Syria, and OPT, but weak in Morocco. The strength of the association between reporting fair/poor health and objective health was not moderated by education or household economic status in any of the six countries. Conclusion As the SRH-objective health association does not vary across social categories, the use of the measure in social inequities in health research is justified. These results should not preclude the need to carry out other validation studies using longitudinal data on men and women, or the need to advocate for improving the quality of morbidity and mortality data in the Arab region. PMID:22985471
Brown, Gillian R.; Nemes, Christopher
2008-01-01
The exploratory behaviour of laboratory rodents is of interest within a number of areas of behavioural pharmacology. However, how best to measure exploratory behaviour in rodents remains a contentious issue. Many unconditioned tests, such as the open field, potentially confound general locomotor activity with exploration. The hole-board apparatus appears to avoid this confound, as head-dipping into holes in the floor is assumed to be a valid measure of the subject's attraction towards novelty (neophilia). This study aimed to investigate whether head-dipping should be considered a valid measure of neophilia by comparing performance of adult male and female Lister hooded rats on the hole-board task (a) over repeated sessions and (b) when novel objects were absent or present underneath the holes. The results show that head-dipping initially decreased across repeated exposures, while time spent in the aversive central area increased. No change in head-dipping was seen in response to objects being placed underneath the holes. Rather than being a measure of neophilia, these results support the hypothesis that head-dipping represents an escape response, which declines as the subject becomes less fearful. These results are compared with previous studies of repeated exposure to other novel environments. PMID:18406075
The validity of a simple outcome measure to assess stuttering therapy.
Huinck, Wendy; Rietveld, Toni
2007-01-01
The validity of a simple and not time-consuming self-assessment (SA) Scale was tested to establish progress after or during stuttering therapy. The scores on the SA scale were related to (1) objective measures (percentage of stuttered syllables, and syllables per minute) and (2) (self-)evaluation tests (self-evaluation questionnaires and perceptual evaluations or judgments of disfluency, naturalness and comfort by naïve listeners). Data were collected from two groups of stutterers at four measurement times: pretherapy, posttherapy, 12 months after therapy and 24 months after therapy. The first group attended the Comprehensive Stuttering Program: an integrated program based on fluency shaping techniques, and the second group participated in a Dutch group therapy: the Doetinchem Method that focuses on emotions and cognitions related to stuttering. Results showed similar score patterns on the SA scale, the self-evaluation questionnaires, the objective measures over time, and significant correlations between the SA scale and syllables per minute, percentage of stuttered syllables, Struggle subscale of the Perceptions of Stuttering Inventory and judged fluency on the T1-T2 difference scores. We concluded that the validity of the SA measure was proved and therefore encourage the use of such an instrument when (stuttering) treatment efficacy is studied.
Validation of the Rational and Experiential Multimodal Inventory in the Italian Context.
Monacis, Lucia; de Palo, Valeria; Di Nuovo, Santo; Sinatra, Maria
2016-08-01
The unfavorable relations of the Rational and Experiential Inventory Experiential scale with objective criterion measures and its limited content validity led Norris and Epstein to propose a more content-valid measure of the experiential thinking style, the Rational and Experiential Multimodal Inventory (REIm), in order to assess the several facets of a broader experiential system consisting of interrelated components. This study aimed to provide the Italian validation of the inventory by examining its psychometric features, its factor structure (Study 1, N = 545), and its convergent and discriminant validity (Study 2, N = 257). Study 1 supported the 2- and 4-factor solutions, and multi-group analyses confirmed the invariance measurement across age and gender for both models. Study 2 provided evidence for both the convergent validity by supporting the theoretical associations among Rational and Experiential Multimodal Inventory scores and similar and related measures, and the discriminant validity by showing associations between the two thinking styles and a different but conceptually related construct, i.e., identity formation. No associations between Rational and Experiential Multimodal Inventory scores and social desirability were found. The Italian version of the Rational and Experiential Multimodal Inventory showed satisfactory psychometric properties, thus confirming its validity. © The Author(s) 2016.
Lo, Wing-Sze; Ho, Sai-Yin; Wong, Bonny Yee-Man; Mak, Kwok-Kei; Lam, Tai-Hing
2011-06-01
The reliability and validity of Stunkard's Figure Rating Scale (FRS) as a measure of current body size (CBS) was established in Western adolescent girls but not in non-Western population. We examined the validity and test-retest reliability of Stunkard's FRS in assessing CBS among Chinese adolescents. Methods. In a school-based survey in Hong Kong, 5666 adolescents (boys: 45.1%; mean age 14.7 years) provided data on self-reported height and weight, CBS, perceived weight status, and health-related quality of life using the Medical Outcomes Study Short-Form version 2 (SF-12v2). Height and weight were also objectively measured. Spearman's correlation was used to assess construct validity, concurrent validity and test-retest reliability. Convergent and discriminant validity were good: CBS correlated strongly with weight and self-reported/measured BMI, but only weakly with SF-12v2. CBS correlated strongly with perceived weight status, showing concurrent validity. Spearman's correlation (r) for CBS was 0.78 for girls and 0.72 for boys indicating good test-retest reliability. Validity and reliability results did not differ significantly between senior and junior grade adolescents. Our findings support the use of Stunkard's FRS to measure body size among Chinese adolescents.
Smith, Chris; Edwards, Phil; Free, Caroline
2018-03-15
A variety of different approaches to measuring contraceptive use have been used or proposed, either to assess current use or adherence over time, using subjective or objective measures. This paper reports an overview of approaches to measuring adherence to the oral contraceptive, intra-uterine device, sub-dermal implant, and injectable and describes how we assessed contraception use in the MObile Technology for Improved Family Planning (MOTIF) trial in Cambodia. We summarise and discuss advantages and disadvantages of different subjective and objective approaches to measuring adherence to the oral contraceptive, intra-uterine device, sub-dermal implant, and injectable such as self-reports, clinic records, electronic monitoring devices, clinical examination and biomarkers. For the MOTIF trial, we did not consider it feasible to measure objective contraception use as many participants lived a long distance from the clinic and we were concerned whether it was appropriate to ask women to return to clinic for a physical examination simply to verify self-report information already provided. We aimed to assess the validity of the four-month data with 50 participants, calculating the sensitivity and specificity of self-reported data compared with objective measurement. For the 46 valid measurements obtained, the sensitivity and specificity was 100% for self-reported contraception use compared to objective measurement but this study had some limitations. To assess reliability of self-report data we compared calendar data collected on effective contraception use at months 1-4 post-abortion, collected separately at four and 12 months. Agreement ranged from 80 to 84% with a kappa statistic ranging from 0·59 to 0·67 indicating fair to good agreement. There is no perfect method of assessing contraception use and researchers designing future studies should give consideration of what to measure, for example current use or detailed patterns of use over time, and remain mindful of what will be feasible and acceptable to the study population. Although self-reported data on contraception use are considered less reliable, and prone to social desirability bias, it is often the standard approach for contraception research and provides data comparable to previous studies. ClinicalTrials.gov Identifier: NCT01823861 . Registered: March 30, 2013.
Traynor, Robyn; MacDermid, Joy C
2008-09-01
Intolerance to the cold is common following peripheral nerve injury and surgery of the upper extremity. Despite its prevalence, the exact pathophysiology and natural history of this condition are not well understood. Subjective, self-report questionnaires have been created and validated as reliable measures of post-traumatic cold intolerance. The difficulty currently lies in assigning an objective measure to this predominantly subjective phenomenon. The present study evaluated the test-retest reliability of a proposed objective measure of cold intolerance, the Immersion in Cold-water Evaluation (ICE), and its correlation with subjective measures in healthy control subjects. Two age groups were also compared to investigate the effect of age on cold intolerance and temperature recovery. On two separate testing days, subjects completed three health-related questionnaires and submersed their dominant hands in cold water. The temperature of their second and fifth digits was monitored during recovery. Both the objective cold-provocation testing and the subjective self-report questionnaires were highly reliable albeit not significantly correlated. No significant temperature recovery trend was noted between the age groups. Post-traumatic cold intolerance is postulated to have both a vascular and neural etiology among other contributing causes. The protocol studied here was centered predominantly on the former etiology, examining peripheral blood flow and associated temperature recovery. This study established ICE as a reliable means to objectively measure cold response, supplementing information provided by previously validated self-report methods.
Evaluating information skills training in health libraries: a systematic review.
Brettle, Alison
2007-12-01
Systematic reviews have shown that there is limited evidence to demonstrate that the information literacy training health librarians provide is effective in improving clinicians' information skills or has an impact on patient care. Studies lack measures which demonstrate validity and reliability in evaluating the impact of training. To determine what measures have been used; the extent to which they are valid and reliable; to provide guidance for health librarians who wish to evaluate the impact of their information skills training. Systematic review methodology involved searching seven databases, and personal files. Studies were included if they were about information skills training, used an objective measure to assess outcomes, and occurred in a health setting. Fifty-four studies were included in the review. Most outcome measures used in the studies were not tested for the key criteria of validity and reliability. Three tested for validity and reliability are described in more detail. Selecting an appropriate measure to evaluate the impact of training is a key factor in carrying out any evaluation. This systematic review provides guidance to health librarians by highlighting measures used in various circumstances, and those that demonstrate validity and reliability.
ERIC Educational Resources Information Center
Krall, Jodi Stotts; Lohse, Barbara
2010-01-01
Objective: Examine the validity of a self-report measure of eating competence with low-income women. Methods: Twenty-five females (18-49 years old) recruited from low-income venues in Pennsylvania completed cognitive testing through an iterative interview process. Respondents' oral responses were compared to researchers' intended meaning of…
Measuring Adolescent Social and Academic Self-Efficacy: Cross-Ethnic Validity of the SEQ-C
ERIC Educational Resources Information Center
Minter, Anthony; Pritzker, Suzanne
2017-01-01
Objective: This study examines the psychometric strength, including cross-ethnic validity, of two subscales of Muris' Self-Efficacy Questionnaire for Children: Academic Self-Efficacy (ASE) and Social Self-Efficacy (SSE). Methods: A large ethnically diverse sample of 3,358 early and late adolescents completed surveys including the ASE and SSE.…
ERIC Educational Resources Information Center
Martin, Nancy K.; Baldwin, Beatrice
A preliminary investigation was conducted of the construct validity of the Inventory of Classroom Management Style (ICMS), a scale to measure differences in perceptions of classroom management style. The main objective was to determine if the scale reflects differences between novice and experienced teachers. Classroom management is defined as a…
Validation of Measures of Cyberbullying Perpetration and Victimization in Emerging Adulthood
ERIC Educational Resources Information Center
Lee, Jungup; Abell, Neil; Holmes, Jennifer L.
2017-01-01
Objective: Cyber bullying represents a new and alarming form of bullying that potentially leads to serious and long-lasting consequences for young people; yet, there is a dearth of research on the assessment of cyberbullying behaviors among emerging adults. Thus, this study aims to close this gap by assessing the development and validation of the…
Validation of the Revised BSI-18 with Latino Migrant Day Laborers
ERIC Educational Resources Information Center
Negi, Nalini Junko; Iwamoto, Derek Kenji
2014-01-01
Objective: This study examines the factor structure of the Brief Symptom Inventory-18 (BSI-18; Derogatis, 2001) in a hard-to-reach population of mainly undocumented migrant Latino day laborers. While, the BSI-18 has been found to be a valid and reliable measure of psychological distress, cross-cultural assessments in sub-groups of Latinos are…
The Water Vapor Variability - Satellite/Sondes (WAVES) Field Campaigns
NASA Technical Reports Server (NTRS)
Whiteman, D. N.; Adam, M.; Barnet, C.; Bojkov, B.; Delgado, R.; Demoz, B.; Fitzgibbon, J.; Forno, R.; Herman, R.; Hoff, E.;
2008-01-01
Three NASA-funded field campaigns have been hosted at the Howard University Research Campus in Beltsville, MD. In each of the years 2006, 2007 and 2008, WAVES field campaigns have coordinated ozonesonde launches, lidar operations and other measurements with A-train satellite overpasses for the purposes of satellite validation. The unique mix of measurement systems, physical location and the interagency, international group of researchers and students has permitted other objectives, such as mesoscale meteorological studies, to be addressed as well. We review the goals and accomplishments of the three WAVES missions with the emphasis on the nonsatellite validation component of WAVES, as the satellite validation activities have been reported elsewhere.
López-Ortega, Mariana; Torres-Castro, Sara; Rosas-Carrasco, Oscar
2016-12-09
The Satisfaction with Life Scale (SWLS) has been widely used and has proven to be a valid and reliable instrument for assessing satisfaction with life in diverse population groups, however, research on satisfaction with life and validation of different measuring instruments in Mexican adults is still lacking. The objective was to evaluate the psychometric properties of the Satisfaction with Life Scale (SWLS) in a representative sample of Mexican adults. This is a methodological study to evaluate a satisfaction with life scale in a sample of 13,220 Mexican adults 50 years of age or older from the 2012 Mexican Health and Aging Study. The scale's reliability (internal consistency) was analysed using Cronbach's alpha and inter-item correlations. An exploratory factor analysis was also performed. Known-groups validity was evaluated comparing good-health and bad-health participants. Comorbidity, perceived financial situation, self-reported general health, depression symptoms, and social support were included to evaluate the validity between these measures and the total score of the scale using Spearman's correlations. The analysis of the scale's reliability showed good internal consistency (α = 0.74). The exploratory factor analysis confirmed the existence of a unique factor structure that explained 54% of the variance. SWLS was related to depression, perceived health, financial situation, and social support, and these relations were all statistically significant (P < .01). There was significant difference in life satisfaction between the good- and bad-health groups. Results show good internal consistency and construct validity of the SWLS. These results are comparable with results from previous studies. Meeting the study's objective to validate the scale, the results show that the Spanish version of the SWLS is a reliable and valid measure of satisfaction with life in the Mexican context.
Detailed Modeling and Analysis of the CPFM Dataset
NASA Technical Reports Server (NTRS)
Swartz, William H.; Lloyd, Steven A.; DeMajistre, Robert
2004-01-01
A quantitative understanding of photolysis rate coefficients (or "j-values") is essential to determining the photochemical reaction rates that define ozone loss and other crucial processes in the atmosphere. j-Values can be calculated with radiative transfer models, derived from actinic flux observations, or inferred from trace gas measurements. The principal objective of this study is to cross-validate j-values from the Composition and Photodissociative Flux Measurement (CPFM) instrument during the Photochemistry of Ozone Loss in the Arctic Region In Summer (POLARIS) and SAGE I11 Ozone Loss and Validation Experiment (SOLVE) field campaigns with model calculations and other measurements and to use this detailed analysis to improve our ability to determine j-values. Another objective is to analyze the spectral flux from the CPFM (not just the j-values) and, using a multi-wavelength/multi-species spectral fitting technique, determine atmospheric composition.
Bode, Rita K.; Heinemann, Allen W.; Butt, Zeeshan; Stallings, Jena; Taylor, Caitlin; Rowe, Morgan; Roth, Elliot J.
2013-01-01
Bode RK, Heinemann AW, Butt Z, Stallings J, Taylor C, Rowe M, Roth EJ. Development and validation of participation and positive psychologic function measures for stroke survivors. Objective To evaluate the reliability and validity of Neurologic Quality of Life (NeuroQOL) item banks that assess quality-of-life (QOL) domains not typically included in poststroke measures. Design Secondary analysis of item responses to selected NeuroQOL domains. Setting Community. Participants Community-dwelling stroke survivors (n=111) who were at least 12 months poststroke. Interventions Not applicable. Main Outcome Measures Five measures developed for 3 NeuroQoL domains: ability to participate in social activities, satisfaction with participation in social activities, and positive psychologic function. Results A single bank was developed for the positive psychologic function domain, but 2 banks each were developed for the ability-to-participate and satisfaction-with-participation domains. The resulting item banks showed good psychometric properties and external construct validity with correlations with the legacy instruments, ranging from .53 to .71. Using these measures, stroke survivors in this sample reported an overall high level of QOL. Conclusions The NeuroQoL-derived measures are promising and valid methods for assessing aspects of QOL not typically measured in this population. PMID:20801251
Neto, Jose Osni Bruggemann; Gesser, Rafael Lehmkuhl; Steglich, Valdir; Bonilauri Ferreira, Ana Paula; Gandhi, Mihir; Vissoci, João Ricardo Nickenig; Pietrobon, Ricardo
2013-01-01
Background The validation of widely used scales facilitates the comparison across international patient samples. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. Objective The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. Methods The Simple Shoulder Test was translated from English into Brazilian Portuguese, translated back into English, and evaluated for accuracy by an expert committee. It was then administered to 100 patients with shoulder conditions. Psychometric properties were analyzed including factor analysis, internal reliability, test-retest reliability at seven days, and construct validity in relation to the Short Form 36 health survey (SF-36). Results Factor analysis demonstrated a three factor solution. Cronbach’s alpha was 0.82. Test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.84. Associations were observed in the hypothesized direction with all subscales of SF-36 questionnaire. Conclusion The Simple Shoulder Test translation and cultural adaptation to Brazilian-Portuguese demonstrated adequate factor structure, internal reliability, and validity, ultimately allowing for its use in the comparison with international patient samples. PMID:23675436
Citizenship and recovery: two intertwined concepts for civic-recovery.
Pelletier, Jean-François; Corbière, Marc; Lecomte, Tania; Briand, Catherine; Corrigan, Patrick; Davidson, Larry; Rowe, Michael
2015-03-04
Validation of the psychometric properties of a new measure of citizenship was required for a research project in the province of Quebec, Canada. This study was meant to study the interplay between recovery- and citizenship-oriented supportive employment. As recovery and citizenship were expected to be two related concepts, convergent validity between the Citizenship Measure (CM) and the Recovery Assessment Scale (RAS) was tested. Study objectives were to: 1) conduct exploratory factor analyses on the CM and confirmatory factor analysis on the RAS tools (construct validity), 2) calculate Cronbach's alphas for each dimension emerging from objective 1 (reliability), and 3) calculate correlations between all dimensions from both tools (convergent validity). Data were collected from 174 individuals with serious mental illness, working in social firms. Serious mental illnesses include major depression, schizophrenia, bipolar disorder, obsessive compulsive disorder, panic disorder, post traumatic stress disorder and borderline personality disorder. Five factors emerged from the exploratory factor analysis of the CM, with good reliability. Confirmatory factor analyses showed that the short and the long versions of the RAS present satisfactory results. Finally, the correlation matrix indicated that all dimensions from both tools are significantly correlated, thus confirming their convergent validity. This study confirms the validity and reliability of two tools, CM and RAS. These tools can be used in combination to assess citizenship and recovery, both of which may be combined in the new concept of civic-recovery.
Quantitative measurement of hypertrophic scar: interrater reliability and concurrent validity.
Nedelec, Bernadette; Correa, José A; Rachelska, Grazyna; Armour, Alexis; LaSalle, Léo
2008-01-01
Research into the pathophysiology and treatment of hypertrophic scar (HSc) remains limited by the heterogeneity of scar and the imprecision with which its severity is measured. The objective of this study was to test the interrater reliability and concurrent validity of the Cutometer measurement of elasticity, the Mexameter measurement of erythema and pigmentation, and total thickness measure of the DermaScan C relative to the modified Vancouver Scar Scale (mVSS) in patient-matched normal skin, normal scar, and HSc. Three independent investigators evaluated 128 sites (severe HSc, moderate or mild HSc, donor site, and normal skin) on 32 burn survivors using all of the above measurement tools. The intraclass correlation coefficient, which was used to measure interrater reliability, reflects the inherent amount of error in the measure and is considered acceptable when it is >0.75. Interrater reliability of the totals of the height, pliability, and vascularity subscales of the mVSS fell below the acceptable limit ( congruent with0.50). The individual subscales of the mVSS fell well below the acceptable level (< or =0.3). The Cutometer reading of elasticity provided acceptable reliability (>0.89) for each study site with the exception of severe scar. Mexameter and DermaScan C reliability measurements were acceptable for all sites (>0.82). Concurrent validity correlations with the mVSS were significant except for the comparison of the mVSS pliability subscale and the Cutometer maximum deformation measure comparison in severe scar. In conclusion, the Mexameter and DermaScan C measurements of scar color and thickness of all sites, as well as the Cutometer measurement of elasticity in all but the most severe scars shows high interrater reliability. Their significant concurrent validity with the mVSS confirms that these tools are measuring the same traits as the mVSS, and in a more objective way.
Broderick, Joan E.; Schneider, Stefan; Junghaenel, Doerte U.; Schwartz, Joseph E.; Stone, Arthur A.
2013-01-01
Objective Evaluation of known group validity, ecological validity, and test-retest reliability of four domain instruments from the Patient Reported Outcomes Measurement System (PROMIS) in osteoarthritis (OA) patients. Methods Recruitment of an osteoarthritis sample and a comparison general population (GP) through an Internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Test (CAT) instruments that use a 7-day recall. Known group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CATs), and test-retest reliability were evaluated. Results The recruited samples matched (age, sex, race, ethnicity) the demographic characteristics of the U.S. sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent: > 95%. Known group validity for CATs was demonstrated with large effect sizes (pain intensity: 1.42, pain interference: 1.25, and fatigue: .85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥ .86). Test-retest validity (7-day) was very good (≥ .80). Conclusion PROMIS CAT instruments demonstrated known group and ecological validity in a comparison of osteoarthritis patients with a general population sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in osteoarthritis patients. PMID:23592494
Validation of a novel virtual reality simulator for robotic surgery.
Schreuder, Henk W R; Persson, Jan E U; Wolswijk, Richard G H; Ihse, Ingmar; Schijven, Marlies P; Verheijen, René H M
2014-01-01
With the increase in robotic-assisted laparoscopic surgery there is a concomitant rising demand for training methods. The objective was to establish face and construct validity of a novel virtual reality simulator (dV-Trainer, Mimic Technologies, Seattle, WA) for the use in training of robot-assisted surgery. A comparative cohort study was performed. Participants (n = 42) were divided into three groups according to their robotic experience. To determine construct validity, participants performed three different exercises twice. Performance parameters were measured. To determine face validity, participants filled in a questionnaire after completion of the exercises. Experts outperformed novices in most of the measured parameters. The most discriminative parameters were "time to complete" and "economy of motion" (P < 0.001). The training capacity of the simulator was rated 4.6 ± 0.5 SD on a 5-point Likert scale. The realism of the simulator in general, visual graphics, movements of instruments, interaction with objects, and the depth perception were all rated as being realistic. The simulator is considered to be a very useful training tool for residents and medical specialist starting with robotic surgery. Face and construct validity for the dV-Trainer could be established. The virtual reality simulator is a useful tool for training robotic surgery.
Visual conspicuity: a new simple standard, its reliability, validity and applicability.
Wertheim, A H
2010-03-01
A general standard for quantifying conspicuity is described. It derives from a simple and easy method to quantitatively measure the visual conspicuity of an object. The method stems from the theoretical view that the conspicuity of an object is not a property of that object, but describes the degree to which the object is perceptually embedded in, i.e. laterally masked by, its visual environment. First, three variations of a simple method to measure the strength of such lateral masking are described and empirical evidence for its reliability and its validity is presented, as are several tests of predictions concerning the effects of viewing distance and ambient light. It is then shown how this method yields a conspicuity standard, expressed as a number, which can be made part of a rule of law, and which can be used to test whether or not, and to what extent, the conspicuity of a particular object, e.g. a traffic sign, meets a predetermined criterion. An additional feature is that, when used under different ambient light conditions, the method may also yield an index of the amount of visual clutter in the environment. Taken together the evidence illustrates the methods' applicability in both the laboratory and in real-life situations. STATEMENT OF RELEVANCE: This paper concerns a proposal for a new method to measure visual conspicuity, yielding a numerical index that can be used in a rule of law. It is of importance to ergonomists and human factor specialists who are asked to measure the conspicuity of an object, such as a traffic or rail-road sign, or any other object. The new method is simple and circumvents the need to perform elaborate (search) experiments and thus has great relevance as a simple tool for applied research.
Reliability and Validity of the Turkish Version of the Job Performance Scale Instrument.
Harmanci Seren, Arzu Kader; Tuna, Rujnan; Eskin Bacaksiz, Feride
2018-02-01
Objective measurement of the job performance of nursing staff using valid and reliable instruments is important in the evaluation of healthcare quality. A current, valid, and reliable instrument that specifically measures the performance of nurses is required for this purpose. The aim of this study was to determine the validity and reliability of the Turkish version of the Job Performance Instrument. This study used a methodological design and a sample of 240 nurses working at different units in four hospitals in Istanbul, Turkey. A descriptive data form, the Job Performance Scale, and the Employee Performance Scale were used to collect data. Data were analyzed using IBM SPSS Statistics Version 21.0 and LISREL Version 8.51. On the basis of the data analysis, the instrument was revised. Some items were deleted, and subscales were combined. The Turkish version of the Job Performance Instrument was determined to be valid and reliable to measure the performance of nurses. The instrument is suitable for evaluating current nursing roles.
Development and validation of the Hospitality Axiological Scale for Humanization of Nursing Care
Galán González-Serna, José María; Ferreras-Mencia, Soledad; Arribas-Marín, Juan Manuel
2017-01-01
ABSTRACT Objective: to develop and validate a scale to evaluate nursing attitudes in relation to hospitality for the humanization of nursing care. Participants: the sample consisted of 499 nursing professionals and undergraduate students of the final two years of the Bachelor of Science in Nursing program. Method: the instrument has been developed and validated to evaluate the ethical values related to hospitality using a methodological approach. Subsequently, a model was developed to measure the dimensions forming the construct hospitality. Results: the Axiological Hospitality Scale showed a high internal consistency, with Cronbach’s Alpha=0.901. The validation of the measuring instrument was performed using factorial, exploratory and confirmatory analysis techniques with high goodness of fit measures. Conclusions: the developed instrument showed an adequate validity and a high internal consistency. Based on the consistency of its psychometric properties, it is possible to affirm that the scale provides a reliable measurement of the hospitality. It was also possible to determine the dimensions or sources that embrace it: respect, responsibility, quality and transpersonal care. PMID:28793127
Ruan, Bin; Mok, Magdalena Mo Ching; Edginton, Christopher R; Chin, Ming Kai
2012-01-01
This article describes the development and validation of the Core Competencies Scale (CCS) using Bok's (2006) competency framework for undergraduate education. The framework included: communication, critical thinking, character development, citizenship, diversity, global understanding, widening of interest, and career and vocational development. The sample comprised 70 college and university students. Results of analysis using Rasch rating scale modelling showed that there was strong empirical evidence on the validity of the measures in contents, structure, interpretation, generalizability, and response options of the CCS scale. The implication of having developed Rasch-based valid and dependable measures in this study for gauging the value added of college and university education to their students is that the feedback generated from CCS will enable evidence-based decision and policy making to be implemented and strategized. Further, program effectiveness can be measured and thus accountability on the achievement of the program objectives.
Marchman, Virginia A; Martine-Sussmann, Carmen
2002-10-01
The validity of two analogous caregiver/parent report measures of early language development in young children who are learning both English and Spanish is examined. Caregiver/parent report indices of vocabulary production and grammar were obtained for 26 children using the MacArthur Communicative Development Inventory: Words & Sentences (CDI; Fenson et al., 1994) and the Inventario del Desarrollo de Habilidades Comunicativas: Palabras y Enunciados (IDHC; Jackson-Maldonado, Bates, & Thal, 1992). Scores were significantly correlated with analogous laboratory measures in both English and Spanish, including a real-object naming task and spontaneous language use during free-play. The findings offer evidence that the CDI and IDHC provide valid assessments of early language milestones in young English- and Spanish-speaking children. Factors that may influence the validity of these tools for use with this population are also discussed.
Measuring the style of innovative thinking among engineering students
NASA Astrophysics Data System (ADS)
Passig, David; Cohen, Lizi
2014-01-01
Background: Many tools have been developed to measure the ability of workers to innovate. However, all of them are based on self-reporting questionnaires, which raises questions about their validity Purpose: The aim was to develop and validate a tool, called Ideas Generation Implementation (IGI), to objectively measure the style and potential of engineering students in generating innovative technological ideas. The cognitive framework of IGI is based on the Architectural Innovation Model (AIM). Tool description: The IGI tool was designed to measure the level of innovation in generating technological ideas and their potential to be implemented. These variables rely on the definition of innovation as 'creativity, implemented in a high degree of success'. The levels of innovative thinking are based on the AIM and consist of four levels: incremental innovation, modular innovation, architectural innovation and radical innovation. Sample: Sixty experts in technological innovation developed the tool. We checked its face validity and calculated its reliability in a pilot study (kappa = 0.73). Then, 145 undergraduate students were sampled at random from the seven Israeli universities offering engineering programs and asked to complete the questionnaire. Design and methods: We examined the construct validity of the tool by conducting a variance analysis and measuring the correlations between the innovator's style of each student, as suggested by the AIM, and the three subscale factors of creative styles (efficient, conformist and original), as suggested by the Kirton Adaptors and Innovators (KAI) questionnaire. Results: Students with a radical innovator's style inclined more than those with an incremental innovator's style towards the three creative cognitive styles. Students with an architectural innovator's style inclined moderately, but not significantly, towards the three creative styles. Conclusions: The IGI tool objectively measures innovative thinking among students, thus allowing screening of potential employees at an early stage, during their undergraduate studies. The tool was found to be reliable and valid in measuring the style and potential of technological innovation among engineering students.
Validation of Procedures for Monitoring Crewmember Immune Function
NASA Technical Reports Server (NTRS)
Pierson, Duane; Crucian, Brian; Mehta, Satish; Stowe, Raymond; Uchakin, Peter; Quiriarte, Heather; Sams, Clarence
2010-01-01
The objective of this Supplemental Medical Objective (SMO) is to determine the status of the immune system, physiological stress and latent viral reactivation (a clinical outcome that can be measured) during both short and long-duration spaceflight. In addition, this study will develop and validate an immune monitoring strategy consistent with operational flight requirements and constraints. Pre-mission, in-flight and post-flight blood and saliva samples will be obtained from participating crewmembers. Assays included peripheral immunophenotype, T cell function, cytokine profiles, viral-specific immunity, latent viral reactivation (EBV, CMV, VZV), and stress hormone measurements. To date, 18 short duration (now completed) and 8 long-duration crewmembers have completed the study. The long-duration phase of this study is ongoing. For this presentation, the final data set for the short duration subjects will be discussed.
Methods of Measurement in epidemiology: Sedentary Behaviour
Atkin, Andrew J; Gorely, Trish; Clemes, Stacy A; Yates, Thomas; Edwardson, Charlotte; Brage, Soren; Salmon, Jo; Marshall, Simon J; Biddle, Stuart JH
2012-01-01
Background Research examining sedentary behaviour as a potentially independent risk factor for chronic disease morbidity and mortality has expanded rapidly in recent years. Methods We present a narrative overview of the sedentary behaviour measurement literature. Subjective and objective methods of measuring sedentary behaviour suitable for use in population-based research with children and adults are examined. The validity and reliability of each method is considered, gaps in the literature specific to each method identified and potential future directions discussed. Results To date, subjective approaches to sedentary behaviour measurement, e.g. questionnaires, have focused predominantly on TV viewing or other screen-based behaviours. Typically, such measures demonstrate moderate reliability but slight to moderate validity. Accelerometry is increasingly being used for sedentary behaviour assessments; this approach overcomes some of the limitations of subjective methods, but detection of specific postures and postural changes by this method is somewhat limited. Instruments developed specifically for the assessment of body posture have demonstrated good reliability and validity in the limited research conducted to date. Miniaturization of monitoring devices, interoperability between measurement and communication technologies and advanced analytical approaches are potential avenues for future developments in this field. Conclusions High-quality measurement is essential in all elements of sedentary behaviour epidemiology, from determining associations with health outcomes to the development and evaluation of behaviour change interventions. Sedentary behaviour measurement remains relatively under-developed, although new instruments, both objective and subjective, show considerable promise and warrant further testing. PMID:23045206
ERIC Educational Resources Information Center
Hawes, Zachary; LeFevre, Jo-Anne; Xu, Chang; Bruce, Catherine D.
2015-01-01
There is an emerging consensus that spatial thinking is fundamental to later success in math and science. The goals of this study were to design and evaluate a novel test of three-dimensional (3D) mental rotation for 4- to 8-year-old children (N?=?165) that uses tangible 3D objects. Results revealed that the measure was both valid and reliable and…
Validating Machine Learning Algorithms for Twitter Data Against Established Measures of Suicidality.
Braithwaite, Scott R; Giraud-Carrier, Christophe; West, Josh; Barnes, Michael D; Hanson, Carl Lee
2016-05-16
One of the leading causes of death in the United States (US) is suicide and new methods of assessment are needed to track its risk in real time. Our objective is to validate the use of machine learning algorithms for Twitter data against empirically validated measures of suicidality in the US population. Using a machine learning algorithm, the Twitter feeds of 135 Mechanical Turk (MTurk) participants were compared with validated, self-report measures of suicide risk. Our findings show that people who are at high suicidal risk can be easily differentiated from those who are not by machine learning algorithms, which accurately identify the clinically significant suicidal rate in 92% of cases (sensitivity: 53%, specificity: 97%, positive predictive value: 75%, negative predictive value: 93%). Machine learning algorithms are efficient in differentiating people who are at a suicidal risk from those who are not. Evidence for suicidality can be measured in nonclinical populations using social media data.
The Association Between Self-Rated Fitness and Cardiorespiratory Fitness in Adults.
Jensen, Karina Gregersen; Rosthøj, Susanne; Linneberg, Allan; Aadahl, Mette
2018-06-01
To assess criterion validity of a single item question on self-rated physical fitness against objectively measured cardiorespiratory fitness. From the Health2008 study 749 men and women between 30 and 60 years of age rated their fitness as excellent, very good, good, fair or poor. Cardiorespiratory fitness was estimated with the watt-max test. Agreement between self-rated and objectively measured physical fitness was assessed by Cohen's weighted kappa coefficient. Correlation was determined by Goodman & Kruskal's gamma correlation coefficient. All analyses were stratified according to gender. Data from 323 men and 426 women were analysed. There was a slight agreement between self-rated and objectively measured fitness in men (weighted kappa: 0.18, [95%CI: 0.13;0.23]) and a fair agreement in women (weighted kappa: 0.27, [95%CI: 0.22;0.32]). In both genders, self-rated fitness was positively correlated with objectively measured fitness (moderate correlation; gamma correlation coefficient for men: 0.63 [95%CI: 0.54;0.72] and women: 0.67 [95%CI: 0.59;0.75]). There was a slight to fair agreement and moderate, positive correlations between self-rated physical fitness and watt-max estimated cardiorespiratory fitness. Hence, a single-item question on physical fitness may be a cost-effective method of assessing fitness in large population studies, but is not valid for individual assessments. © Georg Thieme Verlag KG Stuttgart · New York.
Subjective perception of sleep benefit in Parkinson's disease: Valid or irrelevant?
Lee, Will; Evans, Andrew; Williams, David R
2017-09-01
The phenomenon of sleep benefit (SB) in Parkinson's disease (PD), whereby waking motor function is improved despite no dopaminergic treatment overnight, is controversial. Previous studies suggested a significant discrepancy between subjective functional and objective motor improvement. The aim of this study was to determine how well subjective reporting of SB correlates with objective measures and if true motor improvement can be predicted by a standardized questionnaire. Ninety-two patients with PD participated. A structured questionnaire was developed to assess subjective SB. Quantitative motor assessment was performed using a validated smartphone application. Objective motor SB was considered to be present when the waking motor function was similar or superior to the daytime on-state. Twenty (22%) patients showed objective motor improvement on waking compared to end-of-dose. Most patients (77%) reported subjective SB without corresponding objective motor benefit. Our structured questionnaire could not predict Motor SB. The ability to delay morning medications and a perception of indifference or paradoxical worsening following the morning levodopa dose may suggest Motor SB. Most patients experience subjective SB with no measureable motor improvement. This perceived benefit could be related to non-motor improvement that is distinctly different to objective motor benefit. Copyright © 2017 Elsevier Ltd. All rights reserved.
Objective assessment of attention in delirium: a narrative review.
Tieges, Zoë; Brown, Laura J E; MacLullich, Alasdair M J
2014-12-01
Inattention is a core feature of delirium, and valid assessment of attention is central to diagnosis. Methods of measuring attention in delirium can be divided into two broad categories: (i) objective neuropsychological testing; and (ii) subjective grading of behaviour during interview and clinical examination. Here, we review and critically evaluate studies of objective neuropsychological testing of attention in delirium. We examine the implications of these studies for delirium detection and monitoring in clinical practice and research, and how these studies inform understanding of the nature of attentional deficits in delirium. Searches of MEDLINE and ISI Web of Knowledge databases were performed to identify studies in which objective tests of attention had been administered to patients with delirium, who had been diagnosed using DSM or ICD criteria. Sixteen publications were identified. The attention tests administered in these studies were grouped into the following categories: measures of attention span, vigilance tests, other pen-and-paper tests (e.g. Trail Making Test) and computerised tests of speeded reaction, vigilance and sustained attention. Patients with delirium showed deficits on all tasks, although most tasks were not considered pure measures of attention. Five papers provided data on differential diagnosis from dementia. Cancellation tests, spatial span tests and computerised tests of sustained attention discriminated delirium from dementia. Five studies presented reliability or validity statistics. The existing evidence base on objective assessment of attention in delirium is small. Objective testing of attention is underdeveloped but shows considerable promise in clinical practice and research. Copyright © 2014 John Wiley & Sons, Ltd.
Uggioni, Paula Lazzarin; Salay, Elisabete
2012-04-01
Validated and reliable instruments for measuring consumer attitudes regarding food quality certifications are lacking, but the measurement of consumer attitude could be an important tool for understanding consumer behavior. Thus the objective of this study was to develop an instrument for measuring consumer attitudes regarding private food safety certifications for commercial restaurants. To this end, the following steps were carried out: development of the interview items; complete pilot testing; item analyses (influence of social desirability and total-item correlation); reliability test (internal consistency and test-retest); and validity assessment (content and discriminative validity and exploratory and confirmatory factor analysis). The subjects, all over the age of 18 and drawn from six non-probabilistic samples (n=7-350) in the city of Campinas, Brazil, were all subjected to an interview. The final scale included 24 items and had a Cronbach's alpha coefficient of 0.79 and a content validation coefficient of 0.99, both within acceptable limits. The confirmatory factor analysis validated a model with five factors and the final instrument discriminated reasonably well between the groups and showed satisfactory reproducibility (r=0.955). Furthermore, the scale validity and reliability were satisfactory, suggesting it could also be applied to future studies. Copyright © 2011 Elsevier Ltd. All rights reserved.
ERIC Educational Resources Information Center
Fernandez, Maria; Benitez, Juan L.; Pichardo, M. Carmen; Fernandez, Eduardo; Justicia, Fernando; Garcia, Trinidad; Garcia-Berben, Ana; Justicia, Ana; Alba, Guadalupe
2010-01-01
Introduction: Different research studies point out the importance of social competence as a protective factor against antisocial behavior. They likewise alert us of the importance of having valid, reliable instruments that measure these constructs in early childhood. Method: The objective of this research is to validate the subscales of the…
ERIC Educational Resources Information Center
Ghilain, Christine S.; Parlade, Meaghan V.; McBee, Matthew T.; Coman, Drew C.; Owen, Taylor; Gutierrez, Anibal; Boyd, Brian; Odom, Samuel; Alessandri, Michael
2017-01-01
Joint attention, or the shared focus of attention between objects or events and a social partner, is a crucial milestone in the development of social communication and a notable area of deficit in children with autism spectrum disorder. While valid parent-report screening measures of social communication are available, the majority of these…
Rap-Music Attitude and Perception Scale: A Validation Study
ERIC Educational Resources Information Center
Tyson, Edgar H.
2006-01-01
Objective: This study tests the validity of the Rap-music Attitude and Perception (RAP) Scale, a 1-page, 24-item measure of a person's thoughts and feelings surrounding the effects and content of rap music. The RAP was designed as a rapid assessment instrument for youth programs and practitioners using rap music and hip hop culture in their work…
Human Rights Attitude Scale: A Validity and Reliability Study
ERIC Educational Resources Information Center
Ercan, Recep; Yaman, Tugba; Demir, Selcuk Besir
2015-01-01
The objective of this study is to develop a valid and reliable attitude scale having quality psychometric features that can measure secondary school students' attitudes towards human rights. The study group of the research is comprised by 710 6th, 7th and 8th grade students who study at 4 secondary schools in the centre of Sivas. The study group…
Measurement of Dietary Restraint: Validity Tests of Four Questionnaires
Williamson, Donald A.; Martin, Corby K.; York-Crowe, Emily; Anton, Stephen D.; Redman, Leanne M.; Han, Hongmei; Ravussin, Eric
2007-01-01
This study tested the validity of four measures of dietary restraint: Dutch Eating Behavior Questionnaire, Eating Inventory (EI), Revised Restraint Scale (RS), and the Current Dieting Questionnaire. Dietary restraint has been implicated as a determinant of overeating and binge eating. Conflicting findings have been attributed to different methods for measuring dietary restraint. The validity of four self-report measures of dietary restraint and dieting behavior was tested using: 1) factor analysis, 2) changes in dietary restraint in a randomized controlled trial of different methods to achieve calorie restriction, and 3) correlation of changes in dietary restraint with an objective measure of energy balance, calculated from the changes in fat mass and fat-free mass over a six-month dietary intervention. Scores from all four questionnaires, measured at baseline, formed a dietary restraint factor, but the RS also loaded on a binge eating factor. Based on change scores, the EI Restraint scale was the only measure that correlated significantly with energy balance expressed as a percentage of energy require d for weight maintenance. These findings suggest that that, of the four questionnaires tested, the EI Restraint scale was the most valid measure of the intent to diet and actual caloric restriction. PMID:17101191
Mohan, Arjun; Sethi, Sanjay
2014-03-01
Despite the increasing awareness of their pathogenesis and clinical consequences, research on and clinical management of acute exacerbations of chronic obstructive lung disease (AECOPDs) have been hindered by the lack of a consistent and reliable definition. Symptom-based definitions of exacerbations are sensitive to events and account for unreported exacerbations. Event (healthcare utilization)-based definitions are somewhat more definitive but miss unreported events. Objective quantification of symptoms in AECOPD is now possible with the development of the Exacerbations of Chronic Obstructive Pulmonary Disease Tool (EXACT-PRO), a patient-reported outcome (PRO) measure. Several studies have revealed that unreported AECOPDs are more frequent than reported events and are associated with long-term adverse consequences. New antibiotic development for AECOPD has been hampered by the lack of validated measures for resolution of exacerbations. As a result of these observations, a unique collaborative effort between academia, industry and regulatory agencies resulted in the development of the EXACT-PRO. It consists of 14 questions that generate a score between 0 and 100, and it has been shown to have excellent reliability and validity. In the absence of a reliable biomarker, the definition and measurement of exacerbations has been subjective and imprecise. PRO measures such as EXACT can provide much needed objectivity in assessing symptom-defined exacerbations, which may translate into a uniform outcome measure in clinical trials. With further development and validation, it may have a role in clinical practice in the earlier detection of exacerbations, stratification of an exacerbation severity and the assessment of clinical response to treatment.
Face value: amygdala response reflects the validity of first impressions.
Rule, Nicholas O; Moran, Joseph M; Freeman, Jonathan B; Whitfield-Gabrieli, Susan; Gabrieli, John D E; Ambady, Nalini
2011-01-01
The human amygdala responds to first impressions of people as judged from their faces, such as normative judgments about the trustworthiness of strangers. It is unknown, however, whether amygdala responses to first impressions can be validated by objective criteria. Here, we examined amygdala responses to faces of Chief Executive Officers (CEOs) where real-world outcomes could be measured objectively by the amounts of profits made by each CEO's company. During fMRI scanning, participants made incidental judgments about the symmetry of each CEO's face. After scanning, participants rated each CEO's face on leadership ability. Parametric analyses showed that greater left amygdala response to the CEOs' faces was associated with higher post-scan ratings of the CEOs' leadership ability. In addition, greater left amygdala response was also associated with greater profits made by the CEOs' companies and this relationship was statistically mediated by external raters' perceptions of arousal. Thus, amygdala response reflected both subjective judgments and objective measures of leadership ability based on first impressions. Copyright © 2010 Elsevier Inc. All rights reserved.
Embedded measures of performance validity using verbal fluency tests in a clinical sample.
Sugarman, Michael A; Axelrod, Bradley N
2015-01-01
The objective of this study was to determine to what extent verbal fluency measures can be used as performance validity indicators during neuropsychological evaluation. Participants were clinically referred for neuropsychological evaluation in an urban-based Veteran's Affairs hospital. Participants were placed into 2 groups based on their objectively evaluated effort on performance validity tests (PVTs). Individuals who exhibited credible performance (n = 431) failed 0 PVTs, and those with poor effort (n = 192) failed 2 or more PVTs. All participants completed the Controlled Oral Word Association Test (COWAT) and Animals verbal fluency measures. We evaluated how well verbal fluency scores could discriminate between the 2 groups. Raw scores and T scores for Animals discriminated between the credible performance and poor-effort groups with 90% specificity and greater than 40% sensitivity. COWAT scores had lower sensitivity for detecting poor effort. A combination of FAS and Animals scores into logistic regression models yielded acceptable group classification, with 90% specificity and greater than 44% sensitivity. Verbal fluency measures can yield adequate detection of poor effort during neuropsychological evaluation. We provide suggested cut points and logistic regression models for predicting the probability of poor effort in our clinical setting and offer suggested cutoff scores to optimize sensitivity and specificity.
Development of a Valid Volleyball Skills Test Battery.
ERIC Educational Resources Information Center
Bartlett, Jackie; And Others
1991-01-01
Describes the development of the North Carolina State University Volleyball Skills Test Battery which offers accurate measurement of three volleyball skills (serve, forearm pass, and set). When physical educators tested 313 students, the battery objectively measured their abilities, providing a gamelike means of teaching, testing, grouping, and…
Using Teacher-Made Measurement Devices.
ERIC Educational Resources Information Center
Mehrens, William A.; Lehmann, Irvin J.
1987-01-01
Classroom measurement devices, when tailored to fit a teacher's particular instructional objectives, are essential for optimal teaching and learning. Teachers use test data to assess students' progress but often fail to analyze tests for validity. This article shows how locally and correctly developed assessment tools may serve a variety of…
Development and preliminary testing of an instrumented object for force analysis during grasping.
Romeo, R A; Cordella, F; Zollo, L; Formica, D; Saccomandi, P; Schena, E; Carpino, G; Davalli, A; Sacchetti, R; Guglielmelli, E
2015-01-01
This paper presents the design and realization of an instrumented object for force analysis during grasping. The object, with spherical shape, has been constructed with three contact areas in order to allow performing a tripod grasp. Force Sensing Resistor (FSR) sensors have been employed for normal force measurements, while an accelerometer has been used for slip detection. An electronic board for data acquisition has been embedded into the object, so that only the cables for power supply exit from it. Validation tests have been carried out for: (i) comparing the force measurements with a ground truth; (ii) assessing the capability of the accelerometer to detect slippage for different roughness values; (iii) evaluating object performance in grasp trials performed by a human subject.
Sánchez-Margallo, Juan A; Sánchez-Margallo, Francisco M; Oropesa, Ignacio; Enciso, Silvia; Gómez, Enrique J
2017-02-01
The aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing. A group of novice ([Formula: see text] laparoscopic procedures), intermediate (11-100 laparoscopic procedures) and experienced ([Formula: see text] laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments' position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task. Eighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ([Formula: see text]), travelled less distance using both laparoscopic instruments ([Formula: see text]) and made more efficient use of the work space ([Formula: see text]) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ([Formula: see text] and [Formula: see text], [Formula: see text]). The suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.
NASA Technical Reports Server (NTRS)
Koster, Randal D.; Reichle, Rolf H.; De Lannoy, Gabrielle J. M.; Liu, Qing; Colliander, Andreas; Conaty, Austin; Jackson, Thomas; Kimball, John
2015-01-01
During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public beta release scheduled for 30 October 2015. The primary objective of the beta release is to allow users to familiarize themselves with the data product before the validated product becomes available. The beta release also allows users to conduct their own assessment of the data and to provide feedback to the L4_SM science data product team. The assessment of the L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to upscaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 1 validation and supports the beta release of the data. The validation against sparse network measurements and the evaluation of the assimilation diagnostics address Stage 2 validation criteria by expanding the assessment to regional and global scales.
Validation and Adaptation of the Singing Voice Handicap Index for Egyptian Singing Voice.
Abou-Elsaad, Tamer; Baz, Hemmat; Afsah, Omayma; Abo-Elsoud, Hend
2017-01-01
Measuring the severity of a voice disorder is difficult. This can be achieved by both subjective and objective measures. The Voice Handicap Index is the most known and used self-rating tool for voice disorders. The Classical Singing Handicap Index (CSHI) is a self-administered questionnaire measuring the impact of vocal deviation on the quality of life of singers. The objective of this study was to develop an Arabic version of the CSHI and to test its validity and reliability in Egyptian singers with different singing styles with normal voice and with voice disorders. The interpreted version was administered to 70 Egyptian singers including artistic singers (classical and popular) and specialized singers (Quran reciters and priests) who were divided into 40 asymptomatic singers (control group) and 30 singers with voice disorders. Participants' responses were statistically analyzed to assess the validity and reliability, and to compare the patient group with the control group. Quran reciters, patients with no previous professional training, and patients with vocal fold lesions demonstrated the highest scores. The Arabic version of CSHI is found to be a reliable, valid, and sensitive self-assessment tool that can be used in the clinical practice for the evaluation of the impact of voice disorders on singing voice. Copyright © 2017 The Voice Foundation. Published by Elsevier Inc. All rights reserved.
Aziz, M M; Galal, M A A; Elzohri, M H; El-Nouby, F; Leong, K P
2018-04-01
Systemic lupus erythematosus (SLE) is a chronic autoimmune disease which affects all aspects of quality of life (QoL) of the patients. Comprehensive patient assessment should include QoL measures in addition to the objective clinical measures of the disease. There is no specific Arabic instrument for assessment of QoL of SLE patients. The objective of this study was to translate and cross culturally adapt the SLEQOL questionnaire into Arabic and test its reliability and validity. The SLEQOL questionnaire was translated into Arabic based on the Guidelines for Translation and Cross-cultural Adaptation into other languages. Reliability was assessed by interviewing patients three times: two interviews on the same day by different interviewers and the third interview 14 days later by one of the first interviewers. Validity was assessed by correlating SLEQOL scores of 91 patients with 36-item Short Form Health Survey (SF-36) scores and clinical parameters of the patients. We found that the Arabic version of SLEQOL has a Cronbach's alpha of 0.936, interobserver and intraobserver correlation coefficients of 0.809 and 0.886 respectively. Strong correlations were also found between SLEQOL scores and SF-36 Physical and Mental Component summaries. In conclusion, the Arabic version of SLEQOL is a reliable and valid instrument for measuring QoL of Egyptian SLE patients.
Rinkel, R N P M; Verdonck-de Leeuw, I M; de Bree, R; Aaronson, N K; Leemans, C R
2015-04-01
The objective of this study was to test the construct validity of the patient-reported outcomes Swallowing Quality of Life Questionnaire (SWAL-QOL) and Speech Handicap Index (SHI) in relation to objectively measured oral function among patients treated for oral or oropharyngeal cancer. The study sample consisted of patients treated for oral or oropharyngeal cancer. Outcome measures were the SWAL-QOL and the SHI, and the Functional Rehabilitation Outcomes Grade (FROG), a test to measure oral and shoulder function. Spearman's rank correlation coefficient was used to test associations between the SHI and SWAL-QOL scales, and the FROG scales. During a study period of 3 months, 38 patients (21 males, 17 females; mean age 54 years) were included who visited the outpatient clinic for follow-up care 6-155 months after surgical treatment (n = 14) or combined surgery and radiotherapy (n = 24) for oral (n = 21) or oropharyngeal cancer (n = 17). Most SWAL-QOL and SHI scales (except the SWAL-QOL Fatigue scale) correlated significantly with one or more FROG oral function scales. None of the SWAL-QOL and SHI scales correlated significantly with the FROG shoulder function scale. These results support the construct validity of the SWAL-QOL and SHI questionnaires for assessing speech and swallowing problems in daily life that are moderately but significantly related to oral function. A multidimensional assessment protocol is recommended for use in clinical practice and for research purposes for measuring oral function and swallowing- and speech-related problems in daily life among head and neck cancer patients.
Measuring Pharmacy Student Attitudes toward Prayer: The Student Prayer Attitude Scale (SPAS)
ERIC Educational Resources Information Center
Pace, Adam C.; Greene, Joy; Deweese, Joseph E.; Brown, Dana A.; Cameron, Ginger; Nesbit, James M.; Wensel, Terri
2017-01-01
The objective of this study was to develop and validate an instrument to assess the attitude of student pharmacists toward prayer in general and in particular as it relates to their academic performance. To fulfill the study objective, faculty from seven colleges of pharmacy located at Christian universities collaboratively developed the Student…
Validation of the Common Objects Token (COT) Test for Children with Cochlear Implants
ERIC Educational Resources Information Center
Anderson, Ilona; Martin, Jane; Costa, Anne; Jamieson, Lyn; Bailey, Elspeth; Plant, Geoff; Pitterl, Markus
2005-01-01
Changes in selection criteria have meant that children are being provided with cochlear implants (CI) at increasingly younger ages. However, there is a paucity of measures that are appropriate for testing complex listening skills--most tests are too cognitively complex for such young children. The Common Objects Token (COT) Test was developed as a…
SCALES: SEVIRI and GERB CaL/VaL area for large-scale field experiments
NASA Astrophysics Data System (ADS)
Lopez-Baeza, Ernesto; Belda, Fernando; Bodas, Alejandro; Crommelynck, Dominique; Dewitte, Steven; Domenech, Carlos; Gimeno, Jaume F.; Harries, John E.; Jorge Sanchez, Joan; Pineda, Nicolau; Pino, David; Rius, Antonio; Saleh, Kauzar; Tarruella, Ramon; Velazquez, Almudena
2004-02-01
The main objective of the SCALES Project is to exploit the unique opportunity offered by the recent launch of the first European METEOSAT Second Generation geostationary satellite (MSG-1) to generate and validate new radiation budget and cloud products provided by the GERB (Geostationary Earth Radiation Budget) instrument. SCALES" specific objectives are: (i) definition and characterization of a large reasonably homogeneous area compatible to GERB pixel size (around 50 x 50 km2), (ii) validation of GERB TOA radiances and fluxes derived by means of angular distribution models, (iii) development of algorithms to estimate surface net radiation from GERB TOA measurements, and (iv) development of accurate methodologies to measure radiation flux divergence and analyze its influence on the thermal regime and dynamics of the atmosphere, also using GERB data. SCALES is highly innovative: it focuses on a new and unique space instrument and develops a new specific validation methodology for low resolution sensors that is based on the use of a robust reference meteorological station (Valencia Anchor Station) around which 3D high resolution meteorological fields are obtained from the MM5 Meteorological Model. During the 1st GERB Ground Validation Campaign (18th-24th June, 2003), CERES instruments on Aqua and Terra provided additional radiance measurements to support validation efforts. CERES instruments operated in the PAPS mode (Programmable Azimuth Plane Scanning) focusing the station. Ground measurements were taken by lidar, sun photometer, GPS precipitable water content, radiosounding ascents, Anchor Station operational meteorological measurements at 2m and 15m., 4 radiation components at 2m, and mobile stations to characterize a large area. In addition, measurements during LANDSAT overpasses on June 14th and 30th were also performed. These activities were carried out within the GIST (GERB International Science Team) framework, during GERB Commissioning Period.
NASA Technical Reports Server (NTRS)
Aiken, James; Hooker, Stanford
1997-01-01
Twice a year, the Royal Research Ship (RRS) James Clark Ross (JCR) steams a meridional transect of the atlantic Ocean between Grimsly (UK) and Stanley (Falkland Islands) with a port call in Montevideo (Uruguay), as part of the annual research activities of the British Antarctic Survey (BAS). In September, the JCR sails from the UK, and the following April it makes the return trip. The ship is operated by the BAS for the Natural Environment Research Council (NERC). The Atlantic Meridional Transect (AMT) Program exploits the passage of the JCR from approximately 50 deg. N to 50 deg. S with a primary objective to investigate physical and biological processes, as well as to measure the mesi-to-basin-scale bio-optical properties of the atlantic Ocean. The calibration and validation of remotely sensed observations of ocean colour is an inherent objective of these studies: first, by relating in situ measurements of water leaving radiance to satellite measurement, and second, by measuring the bio-optically active constituents of the water.
Readability of Self-Report Alcohol Misuse Measures
McHugh, R Kathryn; Sugarman, Dawn E; Kaufman, Julia S; Park, Sara; Weiss, Roger D; Greenfield, Shelly F
2014-01-01
Objective: Self-report measures of alcohol misuse and alcohol use disorders are valuable assessment tools for both research and clinical practice settings. However, readability is often overlooked when establishing the validity of these measures, which may result in measures written at a reading-grade level that is higher than the ability level of many potential respondents. The aim of the current study was to estimate the reading-grade level of validated measures of alcohol misuse and associated problems. Method: A total of 45 measures were identified, and reading-grade level was calculated using three validated readability formulas. Results: The majority of measures were written above the recommended reading-grade level for patient materials (5th–6th grade), with particularly poor readability for measure instructions. Conclusions: Given that many self-report alcohol misuse measures are written at a high reading-grade level, the consideration of readability is important when selecting measures for use in research and practice settings. Moreover, the development or modification of measures to target low-literacy populations may facilitate the broader applicability of these instruments. PMID:24650827
ERIC Educational Resources Information Center
Smedema, Susan Miller; Pfaller, Joseph; Moser, Erin; Tu, Wei-Mo; Chan, Fong
2013-01-01
Objective: To evaluate the measurement structure of the Trait Hope Scale (THS) among individuals with spinal cord injury. Design: Confirmatory factor analysis and reliability and validity analyses were performed. Participants: 242 individuals with spinal cord injury. Results: Results support the two-factor measurement model for the THS with agency…
Cross-Validation of Mental Health Recovery Measures in a Hong Kong Chinese Sample
ERIC Educational Resources Information Center
Ye, Shengquan; Pan, Jia-Yan; Wong, Daniel Fu Keung; Bola, John Robert
2013-01-01
Objectives: The concept of recovery has begun shifting mental health service delivery from a medical perspective toward a client-centered recovery orientation. This shift is also beginning in Hong Kong, but its development is hampered by a dearth of available measures in Chinese. Method: This article translates two measures of recovery (mental…
Sokal, Brad; Uswatte, Gitendra; Barman, Joydip; Brewer, Michael; Byrom, Ezekiel; Latten, Jessica; Joseph, Jeethu; Serafim, Camila; Ghaffari, Touraj; Sarkar, Nilanjan
2014-03-01
To test the convergent validity of an objective method, Sensor-Enabled Radio-frequency Identification System for Monitoring Arm Activity (SERSMAA), that distinguishes between functional and nonfunctional activity. Cross-sectional study. Laboratory. Participants (N=25) were ≥0.2 years poststroke (median, 9) with a wide range of severity of upper-extremity hemiparesis. Not applicable. After stroke, laboratory tests of the motor capacity of the more-affected arm poorly predict spontaneous use of that arm in daily life. However, available subjective methods for measuring everyday arm use are vulnerable to self-report biases, whereas available objective methods only provide information on the amount of activity without regard to its relation with function. The SERSMAA consists of a proximity-sensor receiver on the more-affected arm and multiple units placed on objects. Functional activity is signaled when the more-affected arm is close to an object that is moved. Participants were videotaped during a laboratory simulation of an everyday activity, that is, setting a table with cups, bowls, and plates instrumented with transmitters. Observers independently coded the videos in 2-second blocks with a validated system for classifying more-affected arm activity. There was a strong correlation (r=.87, P<.001) between time that the more-affected arm was used for handling objects according to the SERSMAA and functional activity according to the observers. The convergent validity of SERSMAA for measuring more-affected arm functional activity after stroke was supported in a simulation of everyday activity. Copyright © 2014 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.
The role of objective cognitive dysfunction in subjective cognitive complaints after stroke.
van Rijsbergen, M W A; Mark, R E; Kop, W J; de Kort, P L M; Sitskoorn, M M
2017-03-01
Objective cognitive performance (OCP) is often impaired in patients post-stroke but the consequences of OCP for patient-reported subjective cognitive complaints (SCC) are poorly understood. We performed a detailed analysis on the association between post-stroke OCP and SCC. Assessments of OCP and SCC were obtained in 208 patients 3 months after stroke. OCP was evaluated using conventional and ecologically valid neuropsychological tests. Levels of SCC were measured using the CheckList for Cognitive and Emotional (CLCE) consequences following stroke inventory. Multivariate hierarchical regression analyses were used to evaluate the association of OCP with CLCE scores adjusting for age, sex and intelligence quotient. Analyses were performed to examine the global extent of OCP dysfunction (based on the total number of impaired neuropsychological tests, i.e. objective cognitive impairment index) and for each OCP test separately using the raw neuropsychological (sub)test scores. The objective cognitive impairment index for global OCP was positively correlated with the CLCE score (Spearman's rho = 0.22, P = 0.003), which remained significant in multivariate adjusted models (β = 0.25, P = 0.01). Results for the separate neuropsychological tests indicated that only one task (the ecologically valid Rivermead Behavioural Memory Test) was independently associated with the CLCE in multivariate adjusted models (β = -0.34, P < 0.001). Objective neuropsychological test performance, as measured by the global dysfunction index or an ecologically valid memory task, was associated with SCC. These data suggest that cumulative deficits in multiple cognitive domains contribute to subjectively experienced poor cognitive abilities in daily life in patients post-stroke. © 2016 EAN.
Toohey, Liam Anthony; De Noronha, Marcos; Taylor, Carolyn; Thomas, James
2015-02-01
Muscle strength measurement is a key component of physiotherapists' assessment and is frequently used as an outcome measure. A sphygmomanometer is an instrument commonly used to measure blood pressure that can be potentially used as a tool to assess isometric muscle strength. To systematically review the evidence on the reliability and validity of a sphygmomanometer for measuring isometric strength of hip muscles. A literature search was conducted across four databases. Studies were eligible if they presented data on reliability and/or validity, used a sphygmomanometer to measure isometric muscle strength of the hip region, and were peer reviewed. The individual studies were evaluated for quality using a standardized critical appraisal tool. A total of 644 articles were screened for eligibility, with five articles chosen for inclusion. The use of a sphygmomanometer to objectively assess isometric muscle strength of the hip muscles appears to be reliable with intraclass correlation coefficient values ranging from 0.66 to 0.94 in elderly and young populations. No studies were identified that have assessed the validity of a sphygmomanometer. The sphygmomanometer appears to be reliable for assessment of isometric muscle strength around the hip joint, but further research is warranted to establish its validity.
Short forms of the Texas Social Behavior Inventory /TSBI/, an objective measure of self-esteem
NASA Technical Reports Server (NTRS)
Helmreich, R.; Stapp, J.
1974-01-01
Two short (16 item) forms of the Helmreich, Stapp, and Ervin (1974) Texas Social Behavior Inventory, a validated, objective measure of self-esteem or social competence are presented. Normative data and other statistics are described for males and females. Correlations between each short form and long (32-item) scale were .97. Factor analysis and part-whole correlations verified the similarity of the two forms. The utility of the scale in research is described.
NASA Astrophysics Data System (ADS)
Ubieta, Eduardo; Hoyo, Itzal del; Valenzuela, Loreto; Lopez-Martín, Rafael; Peña, Víctor de la; López, Susana
2017-06-01
A simulation model of a parabolic-trough solar collector developed in Modelica® language is calibrated and validated. The calibration is performed in order to approximate the behavior of the solar collector model to a real one due to the uncertainty in some of the system parameters, i.e. measured data is used during the calibration process. Afterwards, the validation of this calibrated model is done. During the validation, the results obtained from the model are compared to the ones obtained during real operation in a collector from the Plataforma Solar de Almeria (PSA).
Toyoshima, Kuniyoshi; Fujii, Yutaka; Mitsui, Nobuyuki; Kako, Yuki; Asakura, Satoshi; Martinez-Aran, Anabel; Vieta, Eduard; Kusumi, Ichiro
2017-08-01
In Japan, there are currently no reliable rating scales for the evaluation of subjective cognitive impairment in patients with bipolar disorder. We studied the relationship between the Japanese version of the Cognitive Complaints in Bipolar Disorder Rating Assessment (COBRA) and objective cognitive assessments in patients with bipolar disorder. We further assessed the reliability and validity of the COBRA. Forty-one patients, aged 16-64, in a remission period of bipolar disorder were recruited from Hokkaido University Hospital in Sapporo, Japan. The COBRA (Japanese version) and Frankfurt Complaint Questionnaire (FCQ), the gold standard in subjective cognitive assessment, were administered. A battery of neuropsychological tests was employed to measure objective cognitive impairment. Correlations among the COBRA, FCQ, and neuropsychological tests were determined using Spearman's correlation coefficient. The Japanese version of the COBRA had high internal consistency, good retest reliability, and concurrent validity-as indicated by a strong correlation with the FCQ. A significant correlation was also observed between the COBRA and objective cognitive measurements of processing speed. These findings are the first to demonstrate that the Japanese version of the COBRA may be clinically useful as a subjective cognitive impairment rating scale in Japanese patients with bipolar disorder. Copyright © 2017 Elsevier Ireland Ltd. All rights reserved.
Alcohol and Sexual Consent Scale: Development and Validation
ERIC Educational Resources Information Center
Ward, Rose Marie; Matthews, Molly R.; Weiner, Judith; Hogan, Kathryn M.; Popson, Halle C.
2012-01-01
Objective: To establish a short measure of attitudes toward sexual consent in the context of alcohol consumption. Methods: Using a multistage and systematic measurement development process, the investigators developed the Alcohol and Sexual Consent Scale using a sample of college students. Results: The resulting 12-item scale, the Alcohol and…
Measuring landscape esthetics: the scenic beauty estimation method
Terry C. Daniel; Ron S. Boster
1976-01-01
The Scenic Beauty Estimation Method (SBE) provides quantitative measures of esthetic preferences for alternative wildland management systems. Extensive experimentation and testing with user, interest, and professional groups validated the method. SBE shows promise as an efficient and objective means for assessing the scenic beauty of public forests and wildlands, and...
Zheng, Yongbin; Chen, Huimin; Zhou, Zongtan
2018-05-23
The accurate angle measurement of objects outside the linear field of view (FOV) is a challenging task for a strapdown semi-active laser seeker and is not yet well resolved. Considering the fact that the strapdown semi-active laser seeker is equipped with GPS and an inertial navigation system (INS) on a missile, in this work, we present an angle measurement method based on the fusion of the seeker’s data and GPS and INS data for a strapdown semi-active laser seeker. When an object is in the nonlinear FOV or outside the FOV, by solving the problems of space consistency and time consistency, the pitch angle and yaw angle of the object can be calculated via the fusion of the last valid angles measured by the seeker and the corresponding GPS and INS data. The numerical simulation results demonstrate the correctness and effectiveness of the proposed method.
Spinou, Arietta; Fragkos, Konstantinos C; Lee, Kai K; Elston, Caroline; Siegert, Richard J; Loebinger, Michael R; Wilson, Robert; Garrod, Rachel; Birring, Surinder S
2016-08-01
A range of questionnaires have been used to assess health-related quality of life (HRQOL) in bronchiectasis. A systematic review was conducted to evaluate their psychometric properties and assess associations between HRQOL and clinical measures. Five electronic databases were searched. Studies eligible for inclusion were those that investigated the validity of HRQOL questionnaires and/or their association with other outcomes in adults with bronchiectasis. Patients with cystic fibrosis were excluded. The identified questionnaires were assessed for convergent, discriminant and cross-cultural translation validity; missing data, floor and ceiling effects, internal consistency, responsiveness and test-retest reliability. A meta-analysis was conducted to estimate the strength of associations between HRQOL and clinical measures. From 1918 studies identified, 43 studies were included in the systematic review, of which 38 were suitable for the meta-analysis. Nine HRQOL questionnaires were identified, with the most widely used being: St George's Respiratory Questionnaire, Leicester Cough Questionnaire, Quality of Life-Bronchiectasis and Short Form-36. HRQOL questionnaires had moderate to good internal consistency and good test-retest reliability. Only 8 of 18 studies that used translated HRQOL questionnaires reported or referred to the validity of the translated questionnaire. There was a stronger correlation (mean r (95% CI)) between HRQOL and subjective outcome measures, such as dyspnoea (0.55 (0.41 to 0.68)) and fatigue (0.42 (0.23 to 0.58)) compared with objective measures; exercise capacity (-0.41 (-0.54 to -0.24)), FEV1% predicted (-0.31 (-0.40 to -0.23)) and extent of bronchiectasis on CT scan (0.35 (0.03 to 0.61)); all p<0.001. This review supports most HRQOL questionnaires used in bronchiectasis have good psychometric properties. There was a weak to moderate association between HRQOL and objective outcome measures. This suggests that HRQOL questionnaires assess a unique aspect of health not captured by objective measures. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/
Self-guided training for deep brain stimulation planning using objective assessment.
Holden, Matthew S; Zhao, Yulong; Haegelen, Claire; Essert, Caroline; Fernandez-Vidal, Sara; Bardinet, Eric; Ungi, Tamas; Fichtinger, Gabor; Jannin, Pierre
2018-04-04
Deep brain stimulation (DBS) is an increasingly common treatment for neurodegenerative diseases. Neurosurgeons must have thorough procedural, anatomical, and functional knowledge to plan electrode trajectories and thus ensure treatment efficacy and patient safety. Developing this knowledge requires extensive training. We propose a training approach with objective assessment of neurosurgeon proficiency in DBS planning. To assess proficiency, we propose analyzing both the viability of the planned trajectory and the manner in which the operator arrived at the trajectory. To improve understanding, we suggest a self-guided training course for DBS planning using real-time feedback. To validate the proposed measures of proficiency and training course, two experts and six novices followed the training course, and we monitored their proficiency measures throughout. At baseline, experts planned higher quality trajectories and did so more efficiently. As novices progressed through the training course, their proficiency measures increased significantly, trending toward expert measures. We developed and validated measures which reliably discriminate proficiency levels. These measures are integrated into a training course, which quantitatively improves trainee performance. The proposed training course can be used to improve trainees' proficiency, and the quantitative measures allow trainees' progress to be monitored.
Yu, H H; Bi, X; Liu, Y Y
2017-08-10
Objective: To evaluate the reliability and validity of the Chinese version on comprehensive scores for financial toxicity (COST), based on the patient-reported outcome measures. Methods: A total of 118 cancer patients were face-to-face interviewed by well-trained investigators. Cronbach's α and Pearson correlation coefficient were used to evaluate reliability. Content validity index (CVI) and exploratory factor analysis (EFA) were used to evaluate the content validity and construct validity, respectively. Results: The Cronbach's α coefficient appeared as 0.889 for the whole questionnaire, with the results of test-retest were between 0.77 and 0.98. Scale-content validity index (S-CVI) appeared as 0.82, with item-content validity index (I-CVI) between 0.83 and 1.00. Two components were extracted from the Exploratory factor analysis, with cumulative rate as 68.04% and loading>0.60 on every item. Conclusion: The Chinese version of COST scale showed high reliability and good validity, thus can be applied to assess the financial situation in cancer patients.
Aloba, Olutayo; Olabisi, Oluseyi; Aloba, Tolulope
2016-01-01
The 10-item Connor-Davidson Resilience Scale (CD-RISC) has demonstrated satisfactory psychometric properties as a measure of resilience in all the previous studies conducted in developed countries. The objective of this study was to explore the psychometric characteristics of the 10-item CD-RISC among students nurses in southwestern Nigeria. This descriptive cross-sectional study involved a total of 449 student nurses who completed the 10-item CD-RISC in addition to measures of self-esteem, depression, religiosity, and psychological distress. The scale demonstrated adequate reliability (Cronbach's α = .81) and satisfactory validity with significant correlations with the measures of self-esteem, depression, religiosity, and psychological distress. Factor analyses revealed that resilience was best explained by a two-factor construct. The scale is a valid measure of resilience among Nigerian student nurses. © The Author(s) 2016.
ERIC Educational Resources Information Center
DUENK, LESTER G.
THE PRIMARY OBJECTIVE OF THIS STUDY WAS TO ESTABLISH THE CONCURRENT VALIDITY OF THE MINNESOTA TESTS OF CREATIVE THINKING, ABBREVIATED FORM VII, (MTCT VII) BY DETERMINING THE RELATIONSHIP BETWEEN ITS SCORES AND CREATIVE ABILITY AS MEASURED BY ACCUMULATED TEACHER RATINGS OF INDUSTRIAL ARTS PROJECTS AND INVESTIGATOR-DEVELOPED TESTS OF CREATIVITY. THE…
ERIC Educational Resources Information Center
Eser, Mehmet Taha; Dogan, Nuri
2017-01-01
Purpose: The objective of this study is to develop the Inventory of Motive of Preference for Conventional Paper-And-Pencil Tests and to evaluate students' motives for preferring written tests, short-answer tests, true/false tests or multiple-choice tests. This will add a measurement tool to the literature with valid and reliable results to help…
Eckstein, Donna A; Wu, Rebecca L; Akinbiyi, Takintope; Silver, Lester; Taub, Peter J
2011-11-01
Patient-reported outcomes in cleft lip and palate treatment are critical for patient care. Traditional surgical outcomes focused on objective measures, such as photographs, anatomic measurements, morbidity, and mortality. Although these remain important, they leave many questions unanswered. Surveys that include aesthetics, speech, functionality, self-image, and quality of life provide more thorough outcomes assessment. It is vital that reliable, valid, and comprehensive questionnaires are available to craniofacial surgeons. The authors performed a literature review to identify questionnaires validated in cleft lip and palate patients. Qualifying instruments were assessed for adherence to guidelines for development and validation by the scientific advisory committee and for content. The authors identified 44 measures used in cleft lip and palate studies. After 15 ad hoc questionnaires, eight generic instruments, 11 psychiatric instruments, and one non-English language questionnaire were excluded, nine measures remained. Of these, four were never validated in the cleft population. Analysis revealed one craniofacial-specific measure (Youth Quality of Life-Facial Differences), two voice-related measures (Patient Voice-Related Quality of Life and Cleft Audit Protocol for Speech-Augmented), and two oral health-related measures (Child Oral Health Impact Profile and Child Oral Health Quality of Life). The Youth Quality of Life-Facial Differences, Child Oral Health Impact Profile, and Child Oral Health Quality of Life questionnaires were sufficiently validated. None was created specifically for clefts, resulting in content limitations. There is a lack of comprehensive, valid, and reliable questionnaires for cleft lip and palate surgery. For thorough assessment of satisfaction, further research to develop and validate cleft lip and palate surgery-specific instruments is needed.
Phillips, Kaye; Müller-Clemm, Werner; Ysselstein, Margaretha; Sachs, Jonathan
2013-02-01
Including context in the measurement and evaluation of health in equity interventions is critical to understanding how events that occur in an intervention's environment might contribute to or impede its success. This study adapted and piloted a contextual validity assessment framework on a selection of health inequity-related programs funded by the Canadian Health Services Research Foundation (CHSRF) between 1998 and 2006. The two overarching objectives of this study were (1) to determine the relative amount and quality of attention given to conceptualizing, measuring and validating context within CHSRF funded research final reports related to health-inequity; and (2) to contribute evaluative evidence towards the incorporation of context into the assessment and measurement of health inequity interventions. The study found that of the 42/146 CHSRF programs and projects, judged to be related to health inequity 20 adequately reported on the conceptualization, measurement and validation of context. Amongst these health-inequity related project reports, greatest emphasis was placed on describing the socio-political and economical context over actually measuring and validating contextual evidence. Applying a contextual validity assessment framework was useful for distinguishing between the descriptive (conceptual) versus empirical (measurement and validation) inclusion of documented contextual evidence. Although contextual validity measurement frameworks needs further development, this study contributes insight into identifying funded research related to health inequities and preliminary criteria for assessing interventions targeted at specific populations and jurisdictions. This study also feeds a larger critical dialogue (albeit beyond the scope of this study) regarding the relevance and utility of using evaluative techniques for understanding how specific external conditions support or impede the successful implementation of health inequity interventions. Copyright © 2012 Elsevier Ltd. All rights reserved.
The Parent Trauma Response Questionnaire (PTRQ): development and preliminary validation.
Williamson, Victoria; Hiller, Rachel M; Meiser-Stedman, Richard; Creswell, Cathy; Dalgleish, Tim; Fearon, Pasco; Goodall, Ben; McKinnon, Anna; Smith, Patrick; Wright, Isobel; Halligan, Sarah L
2018-01-01
Background : Following a child's experience of trauma, parental response is thought to play an important role in either facilitating or hindering their psychological adjustment. However, the ability to investigate the role of parenting responses in the post-trauma period has been hampered by a lack of valid and reliable measures. Objectives : The aim of this study was to design, and provide a preliminary validation of, the Parent Trauma Response Questionnaire (PTRQ), a self-report measure of parental appraisals and support for children's coping, in the aftermath of child trauma. Methods : We administered an initial set of 78 items to 365 parents whose children, aged 2-19 years, had experienced a traumatic event. We conducted principal axis factoring and then assessed the validity of the reduced measure against a standardized general measure of parental overprotection and via the measure's association with child post-trauma mental health. Results : Factor analysis generated three factors assessing parental maladaptive appraisals: (i) permanent change/damage, (ii) preoccupation with child's vulnerability, and (iii) self-blame. In addition, five factors were identified that assess parental support for child coping: (i) behavioural avoidance, (ii) cognitive avoidance, (iii) overprotection, (iv) maintaining pre-trauma routines, and (v) approach coping. Good validity was evidenced against the measure of parental overprotection and child post-traumatic stress symptoms. Good test-retest reliability of the measure was also demonstrated. Conclusions : The PTRQ is a valid and reliable self-report assessment of parenting cognitions and coping in the aftermath of child trauma.
Five-level emergency triage systems: variation in assessment of validity.
Kuriyama, Akira; Urushidani, Seigo; Nakayama, Takeo
2017-11-01
Triage systems are scales developed to rate the degree of urgency among patients who arrive at EDs. A number of different scales are in use; however, the way in which they have been validated is inconsistent. Also, it is difficult to define a surrogate that accurately predicts urgency. This systematic review described reference standards and measures used in previous validation studies of five-level triage systems. We searched PubMed, EMBASE and CINAHL to identify studies that had assessed the validity of five-level triage systems and described the reference standards and measures applied in these studies. Studies were divided into those using criterion validity (reference standards developed by expert panels or triage systems already in use) and those using construct validity (prognosis, costs and resource use). A total of 57 studies examined criterion and construct validity of 14 five-level triage systems. Criterion validity was examined by evaluating (1) agreement between the assigned degree of urgency with objective standard criteria (12 studies), (2) overtriage and undertriage (9 studies) and (3) sensitivity and specificity of triage systems (7 studies). Construct validity was examined by looking at (4) the associations between the assigned degree of urgency and measures gauged in EDs (48 studies) and (5) the associations between the assigned degree of urgency and measures gauged after hospitalisation (13 studies). Particularly, among 46 validation studies of the most commonly used triages (Canadian Triage and Acuity Scale, Emergency Severity Index and Manchester Triage System), 13 and 39 studies examined criterion and construct validity, respectively. Previous studies applied various reference standards and measures to validate five-level triage systems. They either created their own reference standard or used a combination of severity/resource measures. © Article author(s) (or their employer(s) unless otherwise stated in the text of the article) 2017. All rights reserved. No commercial use is permitted unless otherwise expressly granted.
Hill, Jonathan C; Kang, Sujin; Benedetto, Elena; Myers, Helen; Blackburn, Steven; Smith, Stephanie; Hay, Elaine; Rees, Jonathan; Beard, David; Glyn-Jones, Sion; Barker, Karen; Ellis, Benjamin; Fitzpatrick, Ray; Price, Andrew
2016-01-01
Objectives Current musculoskeletal outcome tools are fragmented across different healthcare settings and conditions. Our objectives were to develop and validate a single musculoskeletal outcome measure for use throughout the pathway and patients with different musculoskeletal conditions: the Arthritis Research UK Musculoskeletal Health Questionnaire (MSK-HQ). Setting A consensus workshop with stakeholders from across the musculoskeletal community, workshops and individual interviews with a broad mix of musculoskeletal patients identified and prioritised outcomes for MSK-HQ inclusion. Initial psychometric validation was conducted in four cohorts from community physiotherapy, and secondary care orthopaedic hip, knee and shoulder clinics. Participants Stakeholders (n=29) included primary care, physiotherapy, orthopaedic and rheumatology patients (n=8); general practitioners, physiotherapists, orthopaedists, rheumatologists and pain specialists (n=7), patient and professional national body representatives (n=10), and researchers (n=4). The four validation cohorts included 570 participants (n=210 physiotherapy, n=150 hip, n=150 knee, n=60 shoulder patients). Outcome measures Outcomes included the MSK-HQ's acceptability, feasibility, comprehension, readability and responder burden. The validation cohort outcomes were the MSK-HQ's completion rate, test–retest reliability and convergent validity with reference standards (EQ-5D-5L, Oxford Hip, Knee, Shoulder Scores, and the Keele MSK-PROM). Results Musculoskeletal domains prioritised were pain severity, physical function, work interference, social interference, sleep, fatigue, emotional health, physical activity, independence, understanding, confidence to self-manage and overall impact. Patients reported MSK-HQ items to be ‘highly relevant’ and ‘easy to understand’. Completion rates were high (94.2%), with scores normally distributed, and no floor/ceiling effects. Test–retest reliability was excellent, and convergent validity was strong (correlations 0.81–0.88). Conclusions A new musculoskeletal outcome measure has been developed through a coproduction process with patients to capture prioritised outcomes for use throughout the pathway and with different musculoskeletal conditions. Four validation cohorts found that the MSK-HQ had high completion rates, excellent test–retest reliability and strong convergent validity with reference standards. Further validation studies are ongoing, including a cohort with rheumatoid/inflammatory arthritis. PMID:27496243
Validity and reliability of food security measures.
Cafiero, Carlo; Melgar-Quiñonez, Hugo R; Ballard, Terri J; Kepple, Anne W
2014-12-01
This paper reviews some of the existing food security indicators, discussing the validity of the underlying concept and the expected reliability of measures under reasonably feasible conditions. The main objective of the paper is to raise awareness on existing trade-offs between different qualities of possible food security measurement tools that must be taken into account when such tools are proposed for practical application, especially for use within an international monitoring framework. The hope is to provide a timely, useful contribution to the process leading to the definition of a food security goal and the associated monitoring framework within the post-2015 Development Agenda. © 2014 New York Academy of Sciences.
The cross-cultural adaptation of the DASH questionnaire in Thai (DASH-TH).
Tongprasert, Siam; Rapipong, Jeeranan; Buntragulpoontawee, Montana
2014-01-01
Clinical measurement. Currently there are no self-report questionnaires in Thai to evaluate disability levels in patients suffering from upper extremity musculoskeletal disorders. To translate and cross-cultural adaptation the disabilities of the arm, shoulder and hand (DASH) questionnaire to Thai version and to evaluate content validity, construct validity and internal consistency of the questionnaire. The DASH-TH was produced by following cross-cultural adaptation guidelines stated by the Institute for Work and Health (IWH). Forty Thai patients with arm, shoulder or hand problems participated in field testing of the questionnaire. Content validity was determined by obtaining the item-objective congruence (IOC) value for each questionnaire item. Correlation between the DASH-TH score and numeric rating scale was used to assess construct validity. Internal consistency of DASH-TH was measured using Cronbach's alpha coefficient. Forty patients (14 males, 26 females) with arm, shoulder or hand problems enrolled in the present study. The average age of patients was 44.8 years. The index of item-objective congruence (IOC) of each item ranged from 0.7 to 1.0. The Cronbach's alpha coefficient of the questionnaire was 0.938. There was no correlation between DASH-TH score and numeric rating scale. The DASH-TH has high content validity and internal consistency. N/A. Copyright © 2014 Hanley & Belfus. Published by Elsevier Inc. All rights reserved.
Wisk, Lauren E; Gangnon, Ronald; Vanness, David J; Galbraith, Alison A; Mullahy, John; Witt, Whitney P
2014-01-01
Objective To develop and validate a theoretically based and empirically driven objective measure of financial burden for U.S. families with children. Data Sources The measure was developed using 149,021 families with children from the National Health Interview Survey, and it was validated using 18,488 families with children from the Medical Expenditure Panel Survey. Study Design We estimated the marginal probability of unmet health care need due to cost using a bivariate tensor product spline for family income and out-of-pocket health care costs (OOPC; e.g., deductibles, copayments), while adjusting for confounders. Recursive partitioning was performed on these probabilities, as a function of income and OOPC, to establish thresholds demarcating levels of predicted risk. Principal Findings We successfully generated a novel measure of financial burden with four categories that were associated with unmet need (vs. low burden: midlow OR: 1.93, 95 percent CI: 1.78–2.09; midhigh OR: 2.78, 95 percent CI: 2.49–3.10; high OR: 4.38, 95 percent CI: 3.99–4.80). The novel burden measure demonstrated significantly better model fit and less underestimation of financial burden compared to an existing measure (OOPC/income ≥10 percent). Conclusion The newly developed measure of financial burden establishes thresholds based on different combinations of family income and OOPC that can be applied in future studies of health care utilization and expenditures and in policy development and evaluation. PMID:25328073
Multicenter validation of a bedside antisaccade task as a measure of executive function
Hellmuth, J.; Mirsky, J.; Heuer, H.W.; Matlin, A.; Jafari, A.; Garbutt, S.; Widmeyer, M.; Berhel, A.; Sinha, L.; Miller, B.L.; Kramer, J.H.
2012-01-01
Objective: To create and validate a simple, standardized version of the antisaccade (AS) task that requires no specialized equipment for use as a measure of executive function in multicenter clinical studies. Methods: The bedside AS (BAS) task consisted of 40 pseudorandomized AS trials presented on a laptop computer. BAS performance was compared with AS performance measured using an infrared eye tracker in normal elders (NE) and individuals with mild cognitive impairment (MCI) or dementia (n = 33). The neuropsychological domain specificity of the BAS was then determined in a cohort of NE, MCI, and dementia (n = 103) at UCSF, and the BAS was validated as a measure of executive function in a 6-center cohort (n = 397) of normal adults and patients with a variety of brain diseases. Results: Performance on the BAS and laboratory AS task was strongly correlated and BAS performance was most strongly associated with neuropsychological measures of executive function. Even after controlling for disease severity and processing speed, BAS performance was associated with multiple assessments of executive function, most strongly the informant-based Frontal Systems Behavior Scale. Conclusions: The BAS is a simple, valid measure of executive function in aging and neurologic disease. PMID:22573640
Erdem, Emre; Aydogdu, Türkan; Akpolat, Tekin
2011-02-01
Standard validation protocols are objective guides for healthcare providers, physicians, and patients. The purpose of this study was to test validation of the Medisana MTP Plus upper arm blood pressure (BP) measuring monitor for self-measurement according to the European Society of Hypertension International Protocol (ESH-IP2) in adults. The Medisana MTP Plus monitor is an automated and oscillometric upper arm device for home BP monitoring. Nine consecutive measurements were made according to the ESH-IP2. Overseen by an independent supervisor, measurements were recorded by two observers blinded from both each other's readings and from the device readings. The Medisana MTP Plus device fulfills the validation criteria of the ESH-IP2 for the general population. The mean (standard deviation) of the difference between the observers and the device measurements was 0.6 mmHg (5.1 mmHg) for systolic and 2.7 mmHg (3.4 mmHg) for diastolic pressures, respectively. As the Medisana MTP Plus device has achieved the required standards, it is recommended for home BP monitoring in an adult population.
Burmester, Bridget; Leathem, Janet; Merrick, Paul
2016-12-01
Research investigating how subjective cognitive complaints (SCCs) might reliably indicate impairments in objective cognitive functioning has produced highly varied findings, and despite attempts to synthesise this literature (e.g., Jonker et al. International Journal of Geriatric Psychiatry, 15, 983-991, 2000; Reid and MacLullich Dementia and Geriatric Cognitive Disorders, 22(5-6), 471-485, 2006; Crumley et al. Psychology and Aging, 29(2), 250-263, 2014), recent work continues to offer little resolution. This review provides both quantitative and qualitative synthesis of research conducted since the last comprehensive review in 2006, with the aim of identifying reasons for these discrepancies that might provide fruitful avenues for future exploration. Meta-analysis found a small but significant association between SCCs and objective cognitive function, although it was limited by large heterogeneity between studies and evidence of potential publication bias. Often, assessments of SCCs and objective cognitive function were brief or not formally validated. However, studies that employed more comprehensive SCC measures tended to find that SCCs were associated independently with both objective cognitive function and depressive symptoms. Further explicit investigation of how assessment measures relate to reports of SCCs, and the validity of the proposed 'compensation theory' of SCC aetiology, is recommended.
Elfenbein, Hillary Anger; Jang, Daisung; Sharma, Sudeep; Sanchez-Burks, Jeffrey
2017-03-01
Emotional intelligence (EI) has captivated researchers and the public alike, but it has been challenging to establish its components as objective abilities. Self-report scales lack divergent validity from personality traits, and few ability tests have objectively correct answers. We adapt the Stroop task to introduce a new facet of EI called emotional attention regulation (EAR), which involves focusing emotion-related attention for the sake of information processing rather than for the sake of regulating one's own internal state. EAR includes 2 distinct components. First, tuning in to nonverbal cues involves identifying nonverbal cues while ignoring alternate content, that is, emotion recognition under conditions of distraction by competing stimuli. Second, tuning out of nonverbal cues involves ignoring nonverbal cues while identifying alternate content, that is, the ability to interrupt emotion recognition when needed to focus attention elsewhere. An auditory test of valence included positive and negative words spoken in positive and negative vocal tones. A visual test of approach-avoidance included green- and red-colored facial expressions depicting happiness and anger. The error rates for incongruent trials met the key criteria for establishing the validity of an EI test, in that the measure demonstrated test-retest reliability, convergent validity with other EI measures, divergent validity from factors such as general processing speed and mostly personality, and predictive validity in this case for well-being. By demonstrating that facets of EI can be validly theorized and empirically assessed, results also speak to the validity of EI more generally. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Object tracking using plenoptic image sequences
NASA Astrophysics Data System (ADS)
Kim, Jae Woo; Bae, Seong-Joon; Park, Seongjin; Kim, Do Hyung
2017-05-01
Object tracking is a very important problem in computer vision research. Among the difficulties of object tracking, partial occlusion problem is one of the most serious and challenging problems. To address the problem, we proposed novel approaches to object tracking on plenoptic image sequences. Our approaches take advantage of the refocusing capability that plenoptic images provide. Our approaches input the sequences of focal stacks constructed from plenoptic image sequences. The proposed image selection algorithms select the sequence of optimal images that can maximize the tracking accuracy from the sequence of focal stacks. Focus measure approach and confidence measure approach were proposed for image selection and both of the approaches were validated by the experiments using thirteen plenoptic image sequences that include heavily occluded target objects. The experimental results showed that the proposed approaches were satisfactory comparing to the conventional 2D object tracking algorithms.
Evaluation of the Validity and Reliability of the Waterlow Pressure Ulcer Risk Assessment Scale
Charalambous, Charalambos; Koulori, Agoritsa; Vasilopoulos, Aristidis; Roupa, Zoe
2018-01-01
Introduction Prevention is the ideal strategy to tackle the problem of pressure ulcers. Pressure ulcer risk assessment scales are one of the most pivotal measures applied to tackle the problem, much criticisms has been developed regarding the validity and reliability of these scales. Objective To investigate the validity and reliability of the Waterlow pressure ulcer risk assessment scale. Method The methodology used is a narrative literature review, the bibliography was reviewed through Cinahl, Pubmed, EBSCO, Medline and Google scholar, 26 scientific articles where identified. The articles where chosen due to their direct correlation with the objective under study and their scientific relevance. Results The construct and face validity of the Waterlow appears adequate, but with regards to content validity changes in the category age and gender can be beneficial. The concurrent validity cannot be assessed. The predictive validity of the Waterlow is characterized by high specificity and low sensitivity. The inter-rater reliability has been demonstrated to be inadequate, this may be due to lack of clear definitions within the categories and differentiating level of knowledge between the users. Conclusion Due to the limitations presented regarding the validity and reliability of the Waterlow pressure ulcer risk assessment scale, the scale should be used in conjunction with clinical assessment to provide optimum results. PMID:29736104
ERIC Educational Resources Information Center
Stone, Gregory Ethan; Koskey, Kristin L. K.; Sondergeld, Toni A.
2011-01-01
Typical validation studies on standard setting models, most notably the Angoff and modified Angoff models, have ignored construct development, a critical aspect associated with all conceptualizations of measurement processes. Stone compared the Angoff and objective standard setting (OSS) models and found that Angoff failed to define a legitimate…
Psychometric Properties of a Korean Measure of Person-Directed Care in Nursing Homes
ERIC Educational Resources Information Center
Choi, Jae-Sung; Lee, Minhong
2014-01-01
Objective: This study examined the validity and reliability of a person-directed care (PDC) measure for nursing homes in Korea. Method: Managerial personnel from 223 nursing homes in 2010 and 239 in 2012 were surveyed. Results: Item analysis and exploratory factor analysis for the first sample generated a 33-item PDC measure with eight factors.…
ERIC Educational Resources Information Center
Gan, Zhengdong
2012-01-01
This study, which is part of a large-scale study of using objective measures to validate assessment rating scales and assessment tasks in a high-profile school-based assessment initiative in Hong Kong, examined how grammatical complexity measures relate to task type and analytic evaluations of students' speaking proficiency in a classroom-based…
Testing and Validation of the Dynamic Interia Measurement Method
NASA Technical Reports Server (NTRS)
Chin, Alexander; Herrera, Claudia; Spivey, Natalie; Fladung, William; Cloutier, David
2015-01-01
This presentation describes the DIM method and how it measures the inertia properties of an object by analyzing the frequency response functions measured during a ground vibration test (GVT). The DIM method has been in development at the University of Cincinnati and has shown success on a variety of small scale test articles. The NASA AFRC version was modified for larger applications.
USDA-ARS?s Scientific Manuscript database
The objective was to determine the reliability and validity of scales measuring low-fat milk consumption self-efficacy and norms during school lunch among a cohort of 5th graders. Two hundred seventy-five students completed lunch food records and a psychosocial questionnaire measuring self-efficacy ...
Measuring End-of-Life Care Processes in Nursing Homes
ERIC Educational Resources Information Center
Temkin-Greener, Helena; Zheng, Nan; Norton, Sally A.; Quill, Timothy; Ladwig, Susan; Veazie, Peter
2009-01-01
Purpose: The objectives of this study were to develop measures of end-of-life (EOL) care processes in nursing homes and to validate the instrument for measuring them. Design and Methods: A survey of directors of nursing was conducted in 608 eligible nursing homes in New York State. Responses were obtained from 313 (51.5% response rate) facilities.…
An FMRI-compatible Symbol Search task.
Liebel, Spencer W; Clark, Uraina S; Xu, Xiaomeng; Riskin-Jones, Hannah H; Hawkshead, Brittany E; Schwarz, Nicolette F; Labbe, Donald; Jerskey, Beth A; Sweet, Lawrence H
2015-03-01
Our objective was to determine whether a Symbol Search paradigm developed for functional magnetic resonance imaging (FMRI) is a reliable and valid measure of cognitive processing speed (CPS) in healthy older adults. As all older adults are expected to experience cognitive declines due to aging, and CPS is one of the domains most affected by age, establishing a reliable and valid measure of CPS that can be administered inside an MR scanner may prove invaluable in future clinical and research settings. We evaluated the reliability and construct validity of a newly developed FMRI Symbol Search task by comparing participants' performance in and outside of the scanner and to the widely used and standardized Symbol Search subtest of the Wechsler Adult Intelligence Scale (WAIS). A brief battery of neuropsychological measures was also administered to assess the convergent and discriminant validity of the FMRI Symbol Search task. The FMRI Symbol Search task demonstrated high test-retest reliability when compared to performance on the same task administered out of the scanner (r=.791; p<.001). The criterion validity of the new task was supported, as it exhibited a strong positive correlation with the WAIS Symbol Search (r=.717; p<.001). Predicted convergent and discriminant validity patterns of the FMRI Symbol Search task were also observed. The FMRI Symbol Search task is a reliable and valid measure of CPS in healthy older adults and exhibits expected sensitivity to the effects of age on CPS performance.
Development and Validation of the Eyelash Satisfaction Questionnaire
Dang, Jeff; Cole, Jason C.; Burgess, Somali M.; Yang, Min; Daniels, Selena R.; Walt, John G.
2016-01-01
Background Patient-reported outcome (PRO) measures have been used to assess treatment benefit in a variety of therapeutic areas and are now becoming increasingly important in aesthetic research. Objectives The objective of the current study was to develop and validate a new PRO measure (Eyelash Satisfaction Questionnaire [ESQ]) to assess satisfaction with eyelash prominence. Methods The content of the questionnaire (including conceptual framework and questionnaire items) was generated by review of literature, participant interviews, and expert opinion. Cognitive interviews were conducted to pilot test the questionnaire. Psychometric properties of the questionnaire were examined in a combined sample of participants (n = 970) completing Internet- (n = 909) and paper-based (n = 61) versions. Item- and domain-level properties were examined using modern and classical psychometrics. Results Content-based analysis of qualitative data demonstrated the presence of 3 distinct domains (Length, Fullness, Overall Satisfaction; Confidence, Attractiveness, and Professionalism; and Daily Routine). Initial confirmatory factor analysis (CFA) results of 23 items revealed insufficient model-data fit (comparative fit index [CFI] of 0.86 and a non-normed fit index [NNFI] of 0.82). A revised model using 9 items (3 per domain) achieved appropriate fit (CFI of 0.99 and NNFI of 0.97). Analyses revealed measurement equivalence across the Internet- and paper-based versions. The 3 ESQ domains had strong internal consistency reliability (Cronbach's α [range] = 0.919-0.976) and adequate convergent and discriminant validity. Conclusions The ESQ was found to be a reliable and valid PRO measure for assessing satisfaction with eyelash prominence. Level of Evidence: 3 Therapeutic PMID:26691738
Professionalism among paramedic students: achieving the measure or missing the mark?
Bowen, L Michael; Williams, Brett; Stanke, Luke
2017-01-01
Background Professionalism is a pillar of paramedicine. Internationally paramedic curricula emphasize valid assessment of three domains: cognitive, psychomotor, and affective domains (professionalism). Little is reported on competency measures for professionalism specific to paramedicine. Literature suggests that paramedic students, paramedic practitioners, medical directors, and patients believe that professional attributes should have an increased focus. Objective The objective of this scoping review is to outline valid and reliable assessments that evaluate professional behaviors. Method This review used Arksey and O’Malley’s six-stage scoping methodology. In September 2016, five databases were searched for articles of relevance; these were MEDLINE, Scopus, Google Scholar, PsycINFO/APA, and EMBASE. Results A total of 1587 articles were identified after removal of 468 duplicates. Five articles met the inclusion criteria, two of the articles were from the US and three from UK. The studies range from 2004 to 2014. Three different scales were identified but only two were recommended for use. A US-based scale is composed of 11 items and one generic form of professionalism. The UK scale has 77 items and identified 11 factors within 68 items. Conclusions This scoping review serves to describe valid and reliable measures for professionalism among paramedicine by outlining the quantity of instruments evident in the literature. The scoping review aimed to report the scales supporting evidence of validity and reliability. Three scales were identified in a total of five different studies that specifically measured professional attributes in paramedicine. Currently, two scales are available: an evaluation with 11 items and a self-reported questionnaire with 77 items. PMID:29118588
Lenderking, William R; Wyrwich, Kathleen W; Stolar, Marilyn; Howard, Kellee A; Leibman, Chris; Buchanan, Jacqui; Lacey, Loretto; Kopp, Zoe; Stern, Yaakov
2013-12-01
The Dependence Scale (DS) was designed to measure dependence on others among patients with Alzheimer's disease (AD). The objectives of this research were primarily to strengthen the psychometric evidence for the use of the DS in AD studies. Patients with mild to moderately severe AD were examined in 3 study databases. Within each data set, internal consistency, validity, and responsiveness were examined, and structural equation models were fit. The DS has strong psychometric properties. The DS scores differed significantly across known groups and demonstrated moderate to strong correlations with measures hypothesized to be related to dependence (|r| ≥ .31). Structural equation modeling supported the validity of the DS concept. An anchor-based DS responder definition to interpret a treatment benefit over time was identified. The DS is a reliable, valid, and interpretable measure of dependence associated with AD and is shown to be related to--but provides information distinct from--cognition, functioning, and behavior.
Validity and repeatability of inertial measurement units for measuring gait parameters.
Washabaugh, Edward P; Kalyanaraman, Tarun; Adamczyk, Peter G; Claflin, Edward S; Krishnan, Chandramouli
2017-06-01
Inertial measurement units (IMUs) are small wearable sensors that have tremendous potential to be applied to clinical gait analysis. They allow objective evaluation of gait and movement disorders outside the clinic and research laboratory, and permit evaluation on large numbers of steps. However, repeatability and validity data of these systems are sparse for gait metrics. The purpose of this study was to determine the validity and between-day repeatability of spatiotemporal metrics (gait speed, stance percent, swing percent, gait cycle time, stride length, cadence, and step duration) as measured with the APDM Opal IMUs and Mobility Lab system. We collected data on 39 healthy subjects. Subjects were tested over two days while walking on a standard treadmill, split-belt treadmill, or overground, with IMUs placed in two locations: both feet and both ankles. The spatiotemporal measurements taken with the IMU system were validated against data from an instrumented treadmill, or using standard clinical procedures. Repeatability and minimally detectable change (MDC) of the system was calculated between days. IMUs displayed high to moderate validity when measuring most of the gait metrics tested. Additionally, these measurements appear to be repeatable when used on the treadmill and overground. The foot configuration of the IMUs appeared to better measure gait parameters; however, both the foot and ankle configurations demonstrated good repeatability. In conclusion, the IMU system in this study appears to be both accurate and repeatable for measuring spatiotemporal gait parameters in healthy young adults. Copyright © 2017 Elsevier B.V. All rights reserved.
The passive hamstring stretch test: clinical evaluation.
Fisk, J W
1979-03-28
The passive hamstring stretch test is described. Using a modified goniometer it is shown that independent measurements taken by trained examiners approximate very closely to each other. This establishes the test as a valid objective measurement. The possible value of this test as a research tool in low back pain problems is discussed.
ERIC Educational Resources Information Center
Temple, Viviene A.; Stanish, Heidi I.
2009-01-01
Pedometers are objective, inexpensive, valid, and reliable measures of physical activity. The minimum number of days of pedometer monitoring needed to estimate average weekly step counts was investigated. Seven days of pedometer data were collected from 154 ambulatory men and women ("ns" = 88 and 66, respectively) with intellectual disability.…
Measuring Compliance with Tobacco-Free Campus Policy
ERIC Educational Resources Information Center
Fallin, Amanda; Murrey, Megan; Johnson, Andrew O.; Riker, Carol A.; Rayens, Mary Kay; Hahn, Ellen J.
2012-01-01
Objective: The purpose is to describe psychometric testing and feasibility of the Tobacco-Free Compliance Assessment Tool (TF-CAT) to measure tobacco-free policy compliance at a public university and medical center. The aims are to (1) investigate concurrent validity by comparing the number of cigarette butts in areas covered by the policy with…
Measuring the Medical School Educational Environment: Validating an Approach from Saudi Arabia
ERIC Educational Resources Information Center
Alshehri, Sarah A.; Alshehri, Abdulrahman F.; Erwin, T. Dary
2012-01-01
Objective: This study is an empirical analysis of the female students' attitudes toward the medical educational environment and climate in the College of Medicine at King Khalid University. Setting: The Dundee Ready Educational Environment Measure (DREEM) questionnaire was administered on the same day to 100 female students studying in the third…
Attitudes and Opinions of Classroom Teacher Candidates Regarding Multiculturalism
ERIC Educational Resources Information Center
Akar, Cuneyt; Ulu, Mustafa
2016-01-01
The purpose of this study is twofold. The first objective is to develop a valid and reliable measurement tool for measuring the attitudes and opinions of classroom teachers regarding multiculturalism. The second one is to study the classroom teachers' attitudes and opinions towards multiculturalism in terms of gender, socio-economic and devoutness…
Measuring the Test-Wiseness of Medical Students.
ERIC Educational Resources Information Center
Harvill, Leo M.
The objectives for this study were to: (1) develop a valid, reliable measure of test-wiseness with equivalent forms for use with students in the health sciences; and (2) determine the level of test-wiseness of entering medical students. The test-wiseness areas included in this study were: similar options, umbrella term, item give-away, convergence…
Charlotte Attitudes towards Sleep (CATS) Scale: A Validated Measurement Tool for College Students
ERIC Educational Resources Information Center
Peach, Hannah; Gaultney, Jane F.
2017-01-01
Objective: Using a 4-phase study design, the present study developed and tested the Charlotte Attitudes Towards Sleep (CATS) Scale, a measurement tool for assessing sleep attitudes in college students. Participants: Participants were 706 undergraduate students recruited at a southeastern university and on a national recruitment Web site between…
The Road to Redemption: Reclaiming the Value in Assessment Retention Exams
ERIC Educational Resources Information Center
Stohlman, Trey
2015-01-01
A good assessment plan combines many direct and indirect measures to validate the collected data. One often controversial assessment measure comes in the form of retention exams. Although assessment retention exams may come with faults, others advocate for their inclusion in program assessment. Objective-based tests may offer insight to…
Finding Autonomy in Activity: Development and Validation of a Democratic Classroom Survey
ERIC Educational Resources Information Center
Hur, Eun Hye; Glassman, Michael; Kim, Yunhwan
2013-01-01
This paper developed a Democratic Classroom Survey to measure students' perceived democratic environment of the classroom. Perceived democratic environment is one of the most important variables for understanding classroom activity and indeed any type of group activity, but actually measuring perceptions in an objective manner has been…
ERIC Educational Resources Information Center
Plotnikoff, Ronald C.; Anderson, Donna; Raine, Kim; Cook, Kay; Barrett, Linda; Prodaniuk, Tricia R.
2005-01-01
Objective: The purpose of this study was to validate measures of individual and organisational infrastructure for health promotion within Alberta's (Canada) 17 Regional Health Authorities (RHAs). Design: A series of phases were conducted to develop individual and organisational scales to measure health promotion infrastructure. Instruments were…
ERIC Educational Resources Information Center
Tomyn, Adrian J.; Norrish, Jacolyn M.; Cummins, Robert A.
2013-01-01
By almost all measures of objective life quality, Indigenous Australians are disadvantaged relative to the general population. However, no measures of their Subjective Wellbeing (SWB) have been published. This paper presents the first such data, norm-referenced to the general Australian population. A total of 519 Indigenous adolescents, aged…
Martin, Lelia Gonçalves Rocha; Gaidzinski, Raquel Rapone
2014-01-01
Objective Construct and to validate an instrument for measuring the time spent by nursing staff in the interventions/activities in Outpatient Oncology and Hematology, interventions based on Nursing Interventions Classification (NIC), for key areas of Pediatric Oncology and Oncology Nursing. Methods Cross-sectional study divided into two steps: (1) construction of an instrument to measure the interventions/Nursing activities and (2) validation of this instrument. Results We selected 32 essential interventions from NIC for Pediatric Oncology and Oncology Nursing areas. The judges agreed with removing 13 and including 6 interventions in the instrument, beyond personal activity. Conclusion The choice of essential interventions from NIC is justified by the gain time on research. PMID:25295454
Fiber Optic Wing Shape Sensing on NASA's Ikhana UAV
NASA Technical Reports Server (NTRS)
Richards, Lance; Parker, Allen R.; Ko, William L.; Piazza, Anthony
2008-01-01
This document discusses the development of fiber optic wing shape sensing on NASA's Ikhana vehicle. The Dryden Flight Research Center's Aerostructures Branch initiated fiber-optic instrumentation development efforts in the mid-1990s. Motivated by a failure to control wing dihedral resulting in a mishap with the Helios aircraft, new wing displacement techniques were developed. Research objectives for Ikhana included validating fiber optic sensor measurements and real-time wing shape sensing predictions; the validation of fiber optic mathematical models and design tools; assessing technical viability and, if applicable, developing methodology and approaches to incorporate wing shape measurements within the vehicle flight control system; and, developing and flight validating approaches to perform active wing shape control using conventional control surfaces and active material concepts.
Broadband IR Measurements for Modis Validation
NASA Technical Reports Server (NTRS)
Jessup, Andrew T.
2003-01-01
The primary objective of this research was the development and deployment of autonomous shipboard systems for infrared measurement of ocean surface skin temperature (SST). The focus was on demonstrating long-term, all-weather capability and supplying calibrated skin SST to the MODIS Ocean Science Team (MOCEAN). A secondary objective was to investigate and account for environmental factors that affect in situ measurements of SST for validation of satellite products. We developed and extensively deployed the Calibrated, InfraRed, In situ Measurement System, or CIRIMS, for at-sea validation of satellite-derived SST. The design goals included autonomous operation at sea for up to 6 months and an accuracy of +/- 0.1 C. We used commercially available infrared pyrometers and a precision blackbody housed in a temperature-controlled enclosure. The sensors are calibrated at regular interval using a cylindro-cone target immersed in a temperature-controlled water bath, which allows the calibration points to follow the ocean surface temperature. An upward-looking pyrometer measures sky radiance in order to correct for the non-unity emissivity of water, which can introduce an error of up to 0.5 C. One of the most challenging aspects of the design was protection against the marine environment. A wide range of design strategies to provide accurate, all-weather measurements were investigated. The CIRIMS uses an infrared transparent window to completely protect the sensor and calibration blackbody from the marine environment. In order to evaluate the performance of this approach, the design incorporates the ability to make measurements with and without the window in the optical path.
Measurements of Ground Acoustic Environments for Small Solid Rocket Motor Firings
NASA Technical Reports Server (NTRS)
Vu, Bruce; Plotkin, Ken
2011-01-01
Mobile launcher deck and tower are exposed to severe acoustic environments during launch. These environments, if not properly managed, can weaken ground support equipment and result in structure failure. The objectives of this study were: (1) Characterize the acoustic ground environment with and without water suppression systems. (2) Validate the ground acoustic prediction based on scaling of Saturn V data. and (3) Validate a semi-empirical acoustic analysis.
Gregoski, Mathew J.; Mueller, Martina; Vertegel, Alexey; Shaporev, Aleksey; Jackson, Brenda B.; Frenzel, Ronja M.; Sprehn, Sara M.; Treiber, Frank A.
2012-01-01
Objective. Current generation smartphones' video camera technologies enable photoplethysmographic (PPG) acquisition and heart rate (HR) measurement. The study objective was to develop an Android application and compare HRs derived from a Motorola Droid to electrocardiograph (ECG) and Nonin 9560BT pulse oximeter readings during various movement-free tasks. Materials and Methods. HRs were collected simultaneously from 14 subjects, ages 20 to 58, healthy or with clinical conditions, using the 3 devices during 5-minute periods while at rest, reading aloud under observation, and playing a video game. Correlation between the 3 devices was determined, and Bland-Altman plots for all possible pairs of devices across all conditions assessed agreement. Results. Across conditions, all device pairs showed high correlations. Bland-Altman plots further revealed the Droid as a valid measure for HR acquisition. Across all conditions, the Droid compared to ECG, 95% of the data points (differences between devices) fell within the limits of agreement. Conclusion. The Android application provides valid HRs at varying levels of movement free mental/perceptual motor exertion. Lack of electrode patches or wireless sensor telemetric straps make it advantageous for use in mobile-cell-phone-delivered health promotion and wellness programs. Further validation is needed to determine its applicability while engaging in physical movement-related activities. PMID:22272197
Gregoski, Mathew J; Mueller, Martina; Vertegel, Alexey; Shaporev, Aleksey; Jackson, Brenda B; Frenzel, Ronja M; Sprehn, Sara M; Treiber, Frank A
2012-01-01
Objective. Current generation smartphones' video camera technologies enable photoplethysmographic (PPG) acquisition and heart rate (HR) measurement. The study objective was to develop an Android application and compare HRs derived from a Motorola Droid to electrocardiograph (ECG) and Nonin 9560BT pulse oximeter readings during various movement-free tasks. Materials and Methods. HRs were collected simultaneously from 14 subjects, ages 20 to 58, healthy or with clinical conditions, using the 3 devices during 5-minute periods while at rest, reading aloud under observation, and playing a video game. Correlation between the 3 devices was determined, and Bland-Altman plots for all possible pairs of devices across all conditions assessed agreement. Results. Across conditions, all device pairs showed high correlations. Bland-Altman plots further revealed the Droid as a valid measure for HR acquisition. Across all conditions, the Droid compared to ECG, 95% of the data points (differences between devices) fell within the limits of agreement. Conclusion. The Android application provides valid HRs at varying levels of movement free mental/perceptual motor exertion. Lack of electrode patches or wireless sensor telemetric straps make it advantageous for use in mobile-cell-phone-delivered health promotion and wellness programs. Further validation is needed to determine its applicability while engaging in physical movement-related activities.
Walters, Stephen John; Stern, Cindy; Robertson-Malt, Suzanne
2016-04-01
There is a growing call by consumers and governments for healthcare to adopt systems and approaches to care to improve patient safety. Collaboration within healthcare settings is an important factor for improving systems of care. By using validated measurement instruments a standardized approach to assessing collaboration is possible, otherwise it is only an assumption that collaboration is occurring in any healthcare setting. The objective of this review was to evaluate and compare measurement properties of instruments that measure collaboration within healthcare settings, specifically those which have been psychometrically tested and validated. Participants could be healthcare professionals, the patient or any non-professional who contributes to a patient's care, for example, family members, chaplains or orderlies. The term participant type means the designation of any one participant; for example 'nurse', 'social worker' or 'administrator'. More than two participant types was mandatory. The focus of this review was the validity of tools used to measure collaboration within healthcare settings. The types of studies considered for inclusion were validation studies, but quantitative study designs such as randomized controlled trials, controlled trials and case studies were also eligible for inclusion. Studies that focused on Interprofessional Education, were published as an abstract only, contained patient self-reporting only or were not about care delivery were excluded. The outcome of interest was validation and interpretability of the instrument being assessed and included content validity, construct validity and reliability. Interpretability is characterized by statistics such as mean and standard deviation which can be translated to a qualitative meaning. The search strategy aimed to find both published and unpublished studies. A three-step search strategy was utilized in this review. The databases searched included PubMed, CINAHL, Embase, Cochrane Central Register of Controlled Trials, Emerald Fulltext, MD Consult Australia, PsycARTICLES, Psychology and Behavioural Sciences Collection, PsycINFO, Informit Health Databases, Scopus, UpToDate and Web of Science. The search for unpublished studies included EThOS (Electronic Thesis Online Service), Index to Theses and ProQuest- Dissertations and Theses. The assessment of methodological quality of the included studies was undertaken using the COSMIN checklist which is a validated tool that assesses the process of design and validation of healthcare measurement instruments. An Excel spreadsheet version of COSMIN was developed for data collection which included a worksheet for extracting participant characteristics and interpretability data. Statistical pooling of data was not possible for this review. Therefore, the findings are presented in a narrative form including tables and figures to aid in data presentation. To make a synthesis of the assessments of methodological quality of the different studies, each instrument was rated by accounting for the number of studies performed with an instrument, the appraisal of methodological quality and the consistency of results between studies. Twenty-one studies of 12 instruments were included in the review. The studies were diverse in their theoretical underpinnings, target population/setting and measurement objectives. Measurement objectives included: investigating beliefs, behaviors, attitudes, perceptions and relationships associated with collaboration; measuring collaboration between different levels of care or within a multi-rater/target group; assessing collaboration across teams; or assessing internal participation of both teams and patients.Studies produced validity or interpretability data but none of the studies assessed all validity and reliability properties. However, most of the included studies produced a factor structure or referred to prior factor analysis. A narrative synthesis of the individual study factor structures was generated consisting of nine headings: organizational settings, support structures, purpose and goals; communication; reflection on process; cooperation; coordination; role interdependence and partnership; relationships; newly created professional activities; and professional flexibility. Among the many instruments that measure collaboration within healthcare settings, the quality of each instrument varies; instruments are designed for specific populations and purposes, and are validated in various settings. Selecting an instrument requires careful consideration of the qualities of each. Therefore, referring to systematic reviews of measurement properties of instruments may be helpful to clinicians or researchers in instrument selection. Systematic reviews of measurement properties of instruments are valuable in aiding in instrument selection. This systematic review may be useful in instrument selection for the measurement of collaboration within healthcare settings with a complex mix of participant types. Evaluating collaboration provides important information on the strengths and limitations of different healthcare settings and the opportunities for continuous improvement via any remedial actions initiated. Development of a tool that can be used to measure collaboration within teams of healthcare professionals and non-professionals is important for practice. The use of different statistical modelling techniques, such as Item Response Theory modelling and the translation of models into Computer Adaptive Tests, may prove useful. Measurement equivalence is an important consideration for future instrument development and validation. Further development of the COSMIN tool should include appraisal for measurement equivalence. Researchers developing and validating measurement tools should consider multi-method research designs.
Validation of self-reported figural drawing scales against anthropometric measurements in adults.
Dratva, Julia; Bertelsen, Randi; Janson, Christer; Johannessen, Ane; Benediktsdóttir, Bryndis; Bråbäck, Lennart; Dharmage, Shyamali C; Forsberg, Bertil; Gislason, Thorarinn; Jarvis, Debbie; Jogi, Rain; Lindberg, Eva; Norback, Dan; Omenaas, Ernst; Skorge, Trude D; Sigsgaard, Torben; Toren, Kjell; Waatevik, Marie; Wieslander, Gundula; Schlünssen, Vivi; Svanes, Cecilie; Real, Francisco Gomez
2016-08-01
The aim of the present study was to validate figural drawing scales depicting extremely lean to extremely obese subjects to obtain proxies for BMI and waist circumference in postal surveys. Reported figural scales and anthropometric data from a large population-based postal survey were validated with measured anthropometric data from the same individuals by means of receiver-operating characteristic curves and a BMI prediction model. Adult participants in a Scandinavian cohort study first recruited in 1990 and followed up twice since. Individuals aged 38-66 years with complete data for BMI (n 1580) and waist circumference (n 1017). Median BMI and waist circumference increased exponentially with increasing figural scales. Receiver-operating characteristic curve analyses showed a high predictive ability to identify individuals with BMI > 25·0 kg/m2 in both sexes. The optimal figural scales for identifying overweight or obese individuals with a correct detection rate were 4 and 5 in women, and 5 and 6 in men, respectively. The prediction model explained 74 % of the variance among women and 62 % among men. Predicted BMI differed only marginally from objectively measured BMI. Figural drawing scales explained a large part of the anthropometric variance in this population and showed a high predictive ability for identifying overweight/obese subjects. These figural scales can be used with confidence as proxies of BMI and waist circumference in settings where objective measures are not feasible.
Barnett, Lisa M; Ridgers, Nicola D; Zask, Avigdor; Salmon, Jo
2015-01-01
To determine reliability and face validity of an instrument to assess young children's perceived fundamental movement skill competence. Validation and reliability study. A pictorial instrument based on the Test Gross Motor Development-2 assessed perceived locomotor (six skills) and object control (six skills) competence using the format and item structure from the physical competence subscale of the Pictorial Scale of Perceived Competence and Acceptance for Young Children. Sample 1 completed object control items in May (n=32) and locomotor items in October 2012 (n=23) at two time points seven days apart. Children were asked at the end of the test-retest their understanding of what was happening in each picture to determine face validity. Sample 2 (n=58) completed 12 items in November 2012 on a single occasion to test internal reliability only. Sample 1 children were aged 5-7 years (M=6.0, SD=0.8) at object control assessment and 5-8 years at locomotor assessment (M=6.5, SD=0.9). Sample 2 children were aged 6-8 years (M=7.2, SD=0.73). Intra-class correlations assessed in Sample 1 children were excellent for object control (intra-class correlation=0.78), locomotor (intra-class correlation=0.82) and all 12 skills (intra-class correlations=0.83). Face validity was acceptable. Internal consistency was adequate in both samples for each subscale and all 12 skills (alpha range 0.60-0.81). This study has provided preliminary evidence for instrument reliability and face validity. This enables future alignment between the measurement of perceived and actual fundamental movement skill competence in young children. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.
An objective measure of physical function of elderly outpatients. The Physical Performance Test.
Reuben, D B; Siu, A L
1990-10-01
Direct observation of physical function has the advantage of providing an objective, quantifiable measure of functional capabilities. We have developed the Physical Performance Test (PPT), which assesses multiple domains of physical function using observed performance of tasks that simulate activities of daily living of various degrees of difficulty. Two versions are presented: a nine-item scale that includes writing a sentence, simulated eating, turning 360 degrees, putting on and removing a jacket, lifting a book and putting it on a shelf, picking up a penny from the floor, a 50-foot walk test, and climbing stairs (scored as two items); and a seven-item scale that does not include stairs. The PPT can be completed in less than 10 minutes and requires only a few simple props. We then tested the validity of PPT using 183 subjects (mean age, 79 years) in six settings including four clinical practices (one of Parkinson's disease patients), a board-and-care home, and a senior citizens' apartment. The PPT was reliable (Cronbach's alpha = 0.87 and 0.79, interrater reliability = 0.99 and 0.93 for the nine-item and seven-item tests, respectively) and demonstrated concurrent validity with self-reported measures of physical function. Scores on the PPT for both scales were highly correlated (.50 to .80) with modified Rosow-Breslau, Instrumental and Basic Activities of Daily Living scales, and Tinetti gait score. Scores on the PPT were more moderately correlated with self-reported health status, cognitive status, and mental health (.24 to .47), and negatively with age (-.24 and -.18). Thus, the PPT also demonstrated construct validity. The PPT is a promising objective measurement of physical function, but its clinical and research value for screening, monitoring, and prediction will have to be determined.
Ratanawongsa, Neda; Karter, Andrew J.; Quan, Judy; Parker, Melissa M.; Handley, Margaret; Sarkar, Urmimala; Schmittdiel, Julie A.; Schillinger, Dean
2015-01-01
Background With the expansion of Medicaid and low-cost health insurance plans among diverse patient populations, objective measures of medication adherence using pharmacy claims could advance clinical care and translational research for safety net care. However, safety net patients may experience fluctuating prescription drug coverage, affecting the performance of adherence measures. Objective To evaluate the performance of continuous medication gap (CMG) for diverse, low-income managed care members with diabetes. Methods We conducted this cross-sectional analysis using administrative and clinical data for 680 members eligible for a self-management support trial at a non-profit, government-sponsored managed care plan. We applied CMG methodology to cardiometabolic medication claims for English-, Cantonese-, or Spanish-speaking members with diabetes. We examined inclusiveness (the proportion with calculable CMG) and selectivity (sociodemographic and medical differences from members without CMG). To examine validity, we examined unadjusted associations of suboptimal adherence (CMG>20%) with suboptimal cardiometabolic control. Results 429 members (63%) had calculable CMG. Compared to members without CMG, members with CMG were younger; more likely employed; and had poorer glycemic control, but better blood pressure and lipid control. Suboptimal adherence occurred more frequently among members with poor cardiometabolic control than among members with optimal control (28% vs. 12%, p=0.02). Conclusions CMG demonstrated acceptable inclusiveness and validity in a diverse, low-income safety net population, comparable to its performance in studies among other insured populations. CMG may provide a useful tool to measure adherence among increasingly diverse Medicaid populations, complemented by other strategies to reach those not captured by CMG. Trial Registration NCT00683020 PMID:26233541
Barnea, Meirav; Benaroya-Milshtein, Noa; Gilboa-Sechtman, Eva; Woods, Douglas W; Piacentini, John; Fennig, Silvana; Apter, Alan; Steinberg, Tamar
2016-08-30
The objective of this study was to examine the influence of environmental challenges on tic expression by subjective and objective measures. The study group consisted of 41 children aged 6-18 years (M=10.15, SD=2.73) with a primary diagnosis of Tourette syndrome. Subjective measures included the Functional Assessment Interview developed for this study and three standard validated instruments. The objective measure was a video-recording of the patients in five daily-life situations: watching television, doing homework, being alone, receiving attention when ticcing, and talking to a stranger. In addition, the effect of premonitory urges on assessment of tic expression was evaluated. The associations between the subjective and objective measures of tic expression were moderate to low. A significantly higher number of tics were observed in the television situation, and a significantly lower number in the alone situation, compared to the other situations. Higher levels of premonitory urge were associated with greater awareness of objectively measured tic expression. In conclusion, tic expression is significantly influenced by the environment. Subjective measures of tic expression may be misleading. These results have implications for refining the clinical assessment of tics, improving research methodology, and developing new therapeutic strategies. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Sadegh Moghadam, Leila; Foroughan, Mahshid; Mohammadi Shahboulaghi, Farahnaz; Ahmadi, Fazlollah; Sajjadi, Moosa; Farhadi, Akram
2016-01-01
Background Perceptions of aging refer to individuals’ understanding of aging within their sociocultural context. Proper measurement of this concept in various societies requires accurate tools. Objective The present study was conducted with the aim to translate and validate the Brief Aging Perceptions Questionnaire (B-APQ) and assess its psychometric features in Iranian older adults. Method In this study, the Persian version of B-APQ was validated for 400 older adults. This questionnaire was translated into Persian according to the Wild et al’s model. The Persian version was validated using content, face, and construct (using confirmatory factor analysis) validities, and then its internal consistency and test–retest reliability were measured. Data were analyzed using the statistical software programs SPSS 18 and EQS-6.1. Results The confirmatory factor analysis confirmed construct validity and five subscales of B-APQ. Test–retest reliability with 3-week interval produced r=0.94. Cronbach’s alpha was found to be 0.75 for the whole questionnaire, and from 0.53 to 0.77 for the five factors. Conclusion The Persian version of B-APQ showed favorable validity and reliability, and thus it can be used for measuring different dimensions of perceptions of aging in Iranian older adults. PMID:27194907
Reliability and Validity of the Early Years Physical Activity Questionnaire (EY-PAQ)
Bingham, Daniel D.; Collings, Paul J.; Clemes, Stacy A.; Costa, Silvia; Santorelli, Gillian; Griffiths, Paula; Barber, Sally E.
2016-01-01
Measuring physical activity (PA) and sedentary time (ST) in young children (<5 years) is complex. Objective measures have high validity but require specialist expertise, are expensive, and can be burdensome for participants. A proxy-report instrument for young children that accurately measures PA and ST is needed. The aim of this study was to assess the reliability and validity of the Early Years Physical Activity Questionnaire (EY-PAQ). In a setting where English and Urdu are the predominant languages spoken by parents of young children, a sample of 196 parents and their young children (mean age 3.2 ± 0.8 years) from Bradford, UK took part in the study. A total of 156 (79.6%) questionnaires were completed in English and 40 (20.4%) were completed in transliterated Urdu. A total of 109 parents took part in the reliability aspect of the study, which involved completion of the EY-PAQ on two occasions (7.2 days apart; standard deviation (SD) = 1.1). All 196 participants took part in the validity aspect which involved comparison of EY-PAQ scores against accelerometry. Validty anaylsis used all data and data falling with specific MVPA and ST boundaries. Reliability was assessed using intra-class correlations (ICC) and validity by Bland–Altman plots and rank correlation coefficients. The test re-test reliability of the EY-PAQ was moderate for ST (ICC = 0.47) and fair for moderate-to-vigorous physical activity (MVPA)(ICC = 0.35). The EY-PAQ had poor agreement with accelerometer-determined ST (mean difference = −87.5 min·day−1) and good agreement for MVPA (mean difference = 7.1 min·day−1) limits of agreement were wide for all variables. The rank correlation coefficient was non-significant for ST (rho = 0.19) and significant for MVPA (rho = 0.30). The EY-PAQ has comparable validity and reliability to other PA self-report tools and is a promising population-based measure of young children’s habitual MVPA but not ST. In situations when objective methods are not possible for measurement of young children’s MVPA, the EY-PAQ may be a suitable alternative but only if boundaries are applied.
Reliability and Validity of Assessing User Satisfaction With Web-Based Health Interventions
Lehr, Dirk; Reis, Dorota; Vis, Christiaan; Riper, Heleen; Berking, Matthias; Ebert, David Daniel
2016-01-01
Background The perspective of users should be taken into account in the evaluation of Web-based health interventions. Assessing the users’ satisfaction with the intervention they receive could enhance the evidence for the intervention effects. Thus, there is a need for valid and reliable measures to assess satisfaction with Web-based health interventions. Objective The objective of this study was to analyze the reliability, factorial structure, and construct validity of the Client Satisfaction Questionnaire adapted to Internet-based interventions (CSQ-I). Methods The psychometric quality of the CSQ-I was analyzed in user samples from 2 separate randomized controlled trials evaluating Web-based health interventions, one from a depression prevention intervention (sample 1, N=174) and the other from a stress management intervention (sample 2, N=111). At first, the underlying measurement model of the CSQ-I was analyzed to determine the internal consistency. The factorial structure of the scale and the measurement invariance across groups were tested by multigroup confirmatory factor analyses. Additionally, the construct validity of the scale was examined by comparing satisfaction scores with the primary clinical outcome. Results Multigroup confirmatory analyses on the scale yielded a one-factorial structure with a good fit (root-mean-square error of approximation =.09, comparative fit index =.96, standardized root-mean-square residual =.05) that showed partial strong invariance across the 2 samples. The scale showed very good reliability, indicated by McDonald omegas of .95 in sample 1 and .93 in sample 2. Significant correlations with change in depressive symptoms (r=−.35, P<.001) and perceived stress (r=−.48, P<.001) demonstrated the construct validity of the scale. Conclusions The proven internal consistency, factorial structure, and construct validity of the CSQ-I indicate a good overall psychometric quality of the measure to assess the user’s general satisfaction with Web-based interventions for depression and stress management. Multigroup analyses indicate its robustness across different samples. Thus, the CSQ-I seems to be a suitable measure to consider the user’s perspective in the overall evaluation of Web-based health interventions. PMID:27582341
Gostin, Lawrence O
2018-01-03
The detection of wild poliovirus in Israeli sewage in May 2013 led the health authorities to vaccinate children with OPV (Oral Polio Vaccine). Shelly Kamin-Friedman explored the legal and ethical dimensions of this policy. This commentary makes three claims: (1) Mandatory vaccination is a valid exercise of the state's police powers to protect the common good. (2) A disease eradication campaign is a sufficient ground for the exercise of those powers. (3) The state is obliged to use the least restrictive/invasive measure to achieve community-wide vaccine coverage, but need not use less effective measures; further, determining which measure is most effective is a fact-specific determination. This commentary offers grounds to support state powers to protect the public's health and safety. It shows why governments have both the duty and power to safeguard the collective good. State powers also have limits, whose boundaries are determined by the public health necessity. If the state is reasonably using the least restrictive intervention to achieve an important public health objective, it is well within the limits of its authority. The commentary uses legal and ethical norms and evidence to support its conclusions. Governments have a duty and power to achieve population-based vaccine coverage sufficient to stem the spread of infectious diseases, including in isolated geographical areas with high numbers of individuals claiming religious and/or conscientious exemptions to vaccine requirements. Governments are obliged to reasonably seek the least restrictive/invasive measure to achieve valid public health objectives; and governments are not obliged to use less effective measures simply because they are voluntary or less invasive. Finding the most effective, least invasive intervention is fact-specific. The essence of public health law is to recognize the state's power and duty to safeguard the public's health and safety, and to establish and enforce limits on those powers when the government overreaches-that is, adopts a measure more invasive/restrictive than needed to achieve a valid public health objective.
Kaye, Sherrie-Anne; Lewis, Ioni; Freeman, James
2018-06-01
This research systematically reviewed the existing literature in regards to studies which have used both self-report and objective measures of driving behavior. The objective of the current review was to evaluate disparities or similarities between self-report and objective measures of driving behavior. Searches were undertaken in the following electronic databases, PsycINFO, PubMed, and Scopus, for peer-reviewed full-text articles that (1) focused on road safety, and (2) compared both subjective and objective measures of driving performance or driver safety. A total of 22,728 articles were identified, with 19 articles, comprising 20 studies, included as part of the review. The research reported herein suggested that for some behaviors (e.g., driving in stressful situations) there were similarities between self-report and objective measures while for other behaviors (e.g., sleepiness and vigilance states) there were differences between these measurement techniques. In addition, findings from some studies suggested that in-vehicle devices may be a valid measurement tool to assess driving exposure in older drivers. Further research is needed to examine the correspondence between self-report and objective measures of driving behavior. In particular, there is a need to increase the number of studies which compare "like with like" as it is difficult to draw comparisons when there are variations in measurement tools used. Incorporating a range of objective and self-report measurements tools in research would help to ensure that the methods used offer the most reliable measures of assessing on-road behaviors. Crown Copyright © 2018. Published by Elsevier Ltd. All rights reserved.
Seligman, Sarah C; Giovannetti, Tania; Sestito, John; Libon, David J
2014-01-01
Mild functional difficulties have been associated with early cognitive decline in older adults and increased risk for conversion to dementia in mild cognitive impairment, but our understanding of this decline has been limited by a dearth of objective methods. This study evaluated the reliability and validity of a new system to code subtle errors on an established performance-based measure of everyday action and described preliminary findings within the context of a theoretical model of action disruption. Here 45 older adults completed the Naturalistic Action Test (NAT) and neuropsychological measures. NAT performance was coded for overt errors, and subtle action difficulties were scored using a novel coding system. An inter-rater reliability coefficient was calculated. Validity of the coding system was assessed using a repeated-measures ANOVA with NAT task (simple versus complex) and error type (overt versus subtle) as within-group factors. Correlation/regression analyses were conducted among overt NAT errors, subtle NAT errors, and neuropsychological variables. The coding of subtle action errors was reliable and valid, and episodic memory breakdown predicted subtle action disruption. Results suggest that the NAT can be useful in objectively assessing subtle functional decline. Treatments targeting episodic memory may be most effective in addressing early functional impairment in older age.
Use of Objective Metrics in Dynamic Facial Reanimation: A Systematic Review.
Revenaugh, Peter C; Smith, Ryan M; Plitt, Max A; Ishii, Lisa; Boahene, Kofi; Byrne, Patrick J
2018-06-21
Facial nerve deficits cause significant functional and social consequences for those affected. Existing techniques for dynamic restoration of facial nerve function are imperfect and result in a wide variety of outcomes. Currently, there is no standard objective instrument for facial movement as it relates to restorative techniques. To determine what objective instruments of midface movement are used in outcome measurements for patients treated with dynamic methods for facial paralysis. Database searches from January 1970 to June 2017 were performed in PubMed, Embase, Cochrane Library, Web of Science, and Scopus. Only English-language articles on studies performed in humans were considered. The search terms used were ("Surgical Flaps"[Mesh] OR "Nerve Transfer"[Mesh] OR "nerve graft" OR "nerve grafts") AND (face [mh] OR facial paralysis [mh]) AND (innervation [sh]) OR ("Face"[Mesh] OR facial paralysis [mh]) AND (reanimation [tiab]). Two independent reviewers evaluated the titles and abstracts of all articles and included those that reported objective outcomes of a surgical technique in at least 2 patients. The presence or absence of an objective instrument for evaluating outcomes of midface reanimation. Additional outcome measures were reproducibility of the test, reporting of symmetry, measurement of multiple variables, and test validity. Of 241 articles describing dynamic facial reanimation techniques, 49 (20.3%) reported objective outcome measures for 1898 patients. Of those articles reporting objective measures, there were 29 different instruments, only 3 of which reported all outcome measures. Although instruments are available to objectively measure facial movement after reanimation techniques, most studies do not report objective outcomes. Of objective facial reanimation instruments, few are reproducible and able to measure symmetry and multiple data points. To accurately compare objective outcomes in facial reanimation, a reproducible, objective, and universally applied instrument is needed.
Neighborhood walkability: field validation of geographic information system measures.
Hajna, Samantha; Dasgupta, Kaberi; Halparin, Max; Ross, Nancy A
2013-06-01
Given the health benefits of walking, there is interest in understanding how physical environments favor walking. Although GIS-derived measures of land-use mix, street connectivity, and residential density are commonly combined into indices to assess how conducive neighborhoods are to walking, field validation of these measures is limited. To assess the relationship between audit- and GIS-derived measures of overall neighborhood walkability and between objective (audit- and GIS-derived) and participant-reported measures of walkability. Walkability assessments were conducted in 2009. Street-level audits were conducted using a modified version of the Pedestrian Environmental Data Scan. GIS analyses were used to derive land-use mix, street connectivity, and residential density. Participant perceptions were assessed using a self-administered questionnaire. Audit, GIS, and participant-reported indices of walkability were calculated. Spearman correlation coefficients were used to assess the relationships between measures. All analyses were conducted in 2012. The correlation between audit- and GIS-derived measures of overall walkability was high (R=0.7 [95% CI=0.6, 0.8]); the correlations between objective (audit and GIS-derived) and participant-reported measures were low (R=0.2 [95% CI=0.06, 0.3]; R=0.2 [95% CI=0.04, 0.3], respectively). For comparable audit and participant-reported items, correlations were higher for items that appeared more objective (e.g., sidewalk presence, R=0.4 [95% CI=0.3, 0.5], versus safety, R=0.1 [95% CI=0.003, 0.3]). The GIS-derived measure of walkability correlated well with the in-field audit, suggesting that it is reasonable to use GIS-derived measures in place of more labor-intensive audits. Interestingly, neither audit- nor GIS-derived measures correlated well with participants' perceptions of walkability. Copyright © 2013 American Journal of Preventive Medicine. Published by Elsevier Inc. All rights reserved.
Components of Standing Postural Control Evaluated in Pediatric Balance Measures: A Scoping Review.
Sibley, Kathryn M; Beauchamp, Marla K; Van Ooteghem, Karen; Paterson, Marie; Wittmeier, Kristy D
2017-10-01
To identify measures of standing balance validated in pediatric populations, and to determine the components of postural control captured in each tool. Electronic searches of MEDLINE, Embase, and CINAHL databases using key word combinations of postural balance/equilibrium, psychometrics/reproducibility of results/predictive value of tests, and child/pediatrics; gray literature; and hand searches. Inclusion criteria were measures with a stated objective to assess balance, with pediatric (≤18y) populations, with at least 1 psychometric evaluation, with at least 1 standing task, with a standardized protocol and evaluation criteria, and published in English. Two reviewers independently identified studies for inclusion. There were 21 measures included. Two reviewers extracted descriptive characteristics, and 2 investigators independently coded components of balance in each measure using a systems perspective for postural control, an established framework for balance in pediatric populations. Components of balance evaluated in measures were underlying motor systems (100% of measures), anticipatory postural control (72%), static stability (62%), sensory integration (52%), dynamic stability (48%), functional stability limits (24%), cognitive influences (24%), verticality (9%), and reactive postural control (0%). Assessing children's balance with valid and comprehensive measures is important for ensuring development of safe mobility and independence with functional tasks. Balance measures validated in pediatric populations to date do not comprehensively assess standing postural control and omit some key components for safe mobility and independence. Existing balance measures, that have been validated in adult populations and address some of the existing gaps in pediatric measures, warrant consideration for validation in children. Copyright © 2017 American Congress of Rehabilitation Medicine. Published by Elsevier Inc. All rights reserved.
Objective measurement of paranormal belief: a rebuttal to Vitulli.
Lange, R; Irwin, H J; Houran, J
2001-06-01
Effects of age and sex in paranormal belief remain controversial because issues of scaling and differential item function are not given due attention. Therefore, in response to the recent debate between Irwin and Vitulli, these issues are reviewed and validated as crucial approaches for obtaining an objective measure of paranormal belief. A Rasch version of Tobacyk's Paranormal Belief Scale has been developed, but research with this scale suggests that--contrary to past literature and recently refined studies--age and sex are neither consistent nor crucial factors mediating paranormal belief.
Stochastic digital holography for visualizing inside strongly refracting transparent objects.
Desse, Jean-Michel; Picart, Pascal
2015-01-01
This paper presents a digital holographic method to visualize and measure refractive index variations, convection currents, or thermal gradients, occurring inside a transparent and refracting object. The proof of principle is provided through the visualization of refractive index variation inside a lighting bulb. Comparison with transmission and reflection holography is also provided. A very good agreement is obtained, thus validating the proposed approach.
Analysis of the In-Water and Sky Radiance Distribution Data Acquired During the RaDyO Project
2011-09-30
radiative transfer to model the BRDF of particulate surfaces. OBJECTIVES The major objective of this research is to understand the downwelling spectral...in the water, was also used by the two major modeling groups in RaDyO, to successfully validate their radiative transfer models . This work is...image and radiative transfer models used in the ocean. My near term ocean optics objectives have been: 1) to improve the measurement capability of
Grybauskas, Simonas; Balciuniene, Irena; Vetra, Janis
2007-01-01
The emerging market of digital cephalographs and computerized cephalometry is overwhelming the need to examine the advantages and drawbacks of manual cephalometry, meanwhile, small offices continue to benefit from the economic efficacy and ease of use of analogue cephalograms. The use of modern cephalometric software requires import of digital cephalograms or digital capture of analogue data: scanning and digital photography. The validity of digital photographs of analogue headfilms rather than original headfilms in clinical practice has not been well established. Digital photography could be a fast and inexpensive method of digital capture of analogue cephalograms for use in digital cephalometry. The objective of this study was to determine the validity and reproducibility of measurements obtained from digital photographs of analogue headfilms in lateral cephalometry. Analogue cephalometric radiographs were performed on 15 human dry skulls. Each of them was traced on acetate paper and photographed three times independently. Acetate tracings and digital photographs were digitized and analyzed in cephalometric software. Linear regression model, paired t-test intergroup analysis and coefficient of repeatability were used to assess validity and reproducibility for 63 angular, linear and derivative measurements. 54 out of 63 measurements were determined to have clinically acceptable reproducibility in the acetate tracing group as well as 46 out of 63 in the digital photography group. The worst reproducibility was determined for measurements dependent on landmarks of incisors and poorly defined outlines, majority of them being angular measurements. Validity was acceptable for all measurements, and although statistically significant differences between methods existed for as many as 15 parameters, they appeared to be clinically insignificant being smaller than 1 unit of measurement. Validity was acceptable for 59 of 63 measurements obtained from digital photographs, substantiating the use of digital photography for headfilm capture and computer-aided cephalometric analysis.
Haddad, Monoem; Chaouachi, Anis; Castagna, Carlo; Wong, Del P; Chamari, Karim
2012-01-01
Various studies used objective heart rate (HR)-based methods to assess training load (TL). The common methods were Banister's Training Impulse (TRIMP; weights the duration using a weighting factor) and Edwards' TL (a summated HR zone score). Both the methods use the direct physiological measure of HR as a fundamental part of the calculation. To eliminate the redundancy of using various methods to quantify the same construct (i.e., TL), we have to verify if these methods are strongly convergent and are interchangeable. Therefore, the aim of this study was to investigate the convergent validity between Banister's TRIMP and Edwards' TL used for the assessment of internal TL. The HRs were recorded and analyzed during 10 training weeks of the preseason period in 10 male Taekwondo (TKD) athletes. The TL was calculated using Banister's TRIMP and Edwards' TL. Pearson product moment correlation coefficient was used to evaluate the convergent validity between the 2 methods for assessing TL. Very large to nearly perfect relationships were found between individual Banister's TRIMP and Edwards' TL (r values from 0.80 to 0.99; p < 0.001). Pooled Banister's TRIMP and pooled Edwards' TL (pooled data n = 284) were nearly largely correlated (r = 0.89; p < 0.05; 95% confidence interval: 0.86-0.91). In conclusion, these findings suggest that these 2 objective methods, measuring a similar construct, are interchangeable.
Quality of Work: Validation of a New Instrument in Three Languages
Steffgen, Georges; Kohl, Diane; Reese, Gerhard; Happ, Christian; Sischka, Philipp
2015-01-01
Introduction and objective: A new instrument to measure quality of work was developed in three languages (German, French and Luxembourgish) and validated in a study of employees working in Luxembourg. Methods and results: A representative sample (n = 1529) was taken and exploratory factor analysis revealed a six-factor solution for the 21-item instrument (satisfaction and respect, mobbing, mental strain at work, cooperation, communication and feedback, and appraisal). Reliability analysis showed satisfying reliability for all six factors and the total questionnaire. In order to examine the construct validity of the new instrument, regression analyses were conducted to test whether the instrument predicted work characteristics’ influence on three components of well-being—burnout, psychological stress and maladaptive coping behaviors. Conclusion: The present validation offers a trilingual inventory for measuring quality of work that may be used, for example, as an assessment tool or for testing the effectiveness of interventions. PMID:26703634
Validation of Scratching Severity as an Objective Assessment for Itch.
Udkoff, Jeremy; Silverberg, Jonathan I
2018-05-01
There are currently no simple, standardized, objective assessments of itch for clinical trials and practice. We sought to validate and test the severity of scratching as an objective measure of itch (4-point ordinal scale ranging from 0 [not present] to 3 [very prominent] based on the observation of scratching lesions). We performed a prospective outpatient study using questionnaires and evaluations by a dermatologist in adults with atopic dermatitis (n = 261). Severity of scratching best correlated with patient-reported global atopic dermatitis severity (Kendall τ = 0.336, P < 0.0001), numeric rating scale of itch in the past 24 hours (τ = 0.266, P = 0.0010) and 3 days (τ = 0.296, P < 0.0001). Severity of scratching showed responsiveness over time. Patients experiencing improvement of scratching severity of 1 point or greater had significantly lower itch based on numeric rating scale in the past 3 days (Wilcoxon rank sum test, P = 0.0175), 5-D itch scale (P = 0.0146), and Patient-Oriented Eczema Measure scores (P = 0.0146). There was a significant decrease in scratching severity for patients experiencing itch improvement of 4 points or greater in the past 3 days on the numeric rating scale (Fisher exact test, P = 0.0026), Patient-Oriented Eczema Measure (P < 0.0001), and Dermatology Life Quality Index (P = 0.0285). Severity of scratching may be a useful endpoint in clinical trials and practice across the gamut of pruritic disorders. Future studies are needed to validate severity of scratching in other pruritic disease. Copyright © 2017 The Authors. Published by Elsevier Inc. All rights reserved.
Consistent Measurement and Physical Character of the DSD: Disdrometer to Satellite
NASA Technical Reports Server (NTRS)
Petersen, Walt; Thurai, Merhala; Gatlin, Patrick; Tokay, Ali; Morris, Bob; Wolff, David; Pippitt, Jason; Marks, David; Berendes, Todd
2017-01-01
Objective: Validate GPM (Global Precipitation Measurement) Drop Size Distribution Retrievals: Drop size distributions (DSD) are critical to GPM DPR (Dual-frequency Precipitation Radar)-based rainfall retrievals; NASA GPM Science Requirements stipulate that the GPM Core observatory radar estimation of D (sub m) (mean diameter) shall be within plus or minus 0.5 millimeters of GV (Ground Validation); GV translates disdrometer measurements to polarimetric radar-based DSD and precipitation type retrievals (e.g., convective vs. stratiform (C/S)) for coincident match-up to GPM core overpasses; How well do we meet the requirement across product versions, rain types (e.g., C/S partitioning), and rain rates (heavy, light) and is behavior physically and internally consistent?
Validated Smartphone-Based Apps for Ear and Hearing Assessments: A Review
Pallawela, Danuk
2016-01-01
Background An estimated 360 million people have a disabling hearing impairment globally, the vast majority of whom live in low- and middle-income countries (LMICs). Early identification through screening is important to negate the negative effects of untreated hearing impairment. Substantial barriers exist in screening for hearing impairment in LMICs, such as the requirement for skilled hearing health care professionals and prohibitively expensive specialist equipment to measure hearing. These challenges may be overcome through utilization of increasingly available smartphone app technologies for ear and hearing assessments that are easy to use by unskilled professionals. Objective Our objective was to identify and compare available apps for ear and hearing assessments and consider the incorporation of such apps into hearing screening programs Methods In July 2015, the commercial app stores Google Play and Apple App Store were searched to identify apps for ear and hearing assessments. Thereafter, six databases (EMBASE, MEDLINE, Global Health, Web of Science, CINAHL, and mHealth Evidence) were searched to assess which of the apps identified in the commercial review had been validated against gold standard measures. A comparison was made between validated apps. Results App store search queries returned 30 apps that could be used for ear and hearing assessments, the majority of which are for performing audiometry. The literature search identified 11 eligible validity studies that examined 6 different apps. uHear, an app for self-administered audiometry, was validated in the highest number of peer reviewed studies against gold standard pure tone audiometry (n=5). However, the accuracy of uHear varied across these studies. Conclusions Very few of the available apps have been validated in peer-reviewed studies. Of the apps that have been validated, further independent research is required to fully understand their accuracy at detecting ear and hearing conditions. PMID:28582261
Garcimartin, Paloma; Comin-Colet, Josep; Delgado-Hito, Pilar; Badosa-Marcé, Neus; Linas-Alonso, Anna
2017-05-04
Patient empowerment is a key element to improve the results in health, increase satisfaction amongst users and obtain higher treatment compliance. The main objective of this study is to validate the Spanish version of the questionnaire "Patient empowerment in long-term conditions" which evaluates the patients' level of empowerment of chronic diseases. The secondary objective is to identify factors which predict basal empowerment and changes (improvement or deterioration) in patients with Heart Failure (HF). An observational and prospective design of psychometric type to validate a questionnaire (aim 1) and a prospective study of cohorts (aim 2). The study will include 121 patients with confirmed diagnosis of HF. Three measurements (basal, at 15 days and at 3 months) will be carried out: quality of life, self-care and empowerment. Descriptive and inferential analyses will be used. For the first aim of the study (validation), the test-retest reproducibility will be assessed through intraclass correlation coefficient; internal consistency will be assessed through Cronbach's alpha coefficient; construct validity through Pearson's correlation coefficient; and sensibility to change through effect size coefficient. Set a valid questionnaire to measure the level of empowerment of patients with chronic diseases could be an effective tool to assess the results from the provision of the health care services. It will also allow us to identify at an early stage, those groups of patients with a low level of empowerment. Hence, they could become a risk group due to poor management of the disease, with a high rate of decompensation and a higher use rate of the health system resources.
Evaluating a technical university's placement test using the Rasch measurement model
NASA Astrophysics Data System (ADS)
Salleh, Tuan Salwani; Bakri, Norhayati; Zin, Zalhan Mohd
2016-10-01
This study discusses the process of validating a mathematics placement test at a technical university. The main objective is to produce a valid and reliable test to measure students' prerequisite knowledge to learn engineering technology mathematics. It is crucial to have a valid and reliable test as the results will be used in a critical decision making to assign students into different groups of Technical Mathematics 1. The placement test which consists of 50 mathematics questions were tested on 82 new diplomas in engineering technology students at a technical university. This study employed rasch measurement model to analyze the data through the Winsteps software. The results revealed that there are ten test questions lower than less able students' ability. Nevertheless, all the ten questions satisfied infit and outfit standard values. Thus, all the questions can be reused in the future placement test at the technical university.
van Hees, Vincent T; Renström, Frida; Wright, Antony; Gradmark, Anna; Catt, Michael; Chen, Kong Y; Löf, Marie; Bluck, Les; Pomeroy, Jeremy; Wareham, Nicholas J; Ekelund, Ulf; Brage, Søren; Franks, Paul W
2011-01-01
Few studies have compared the validity of objective measures of physical activity energy expenditure (PAEE) in pregnant and non-pregnant women. PAEE is commonly estimated with accelerometers attached to the hip or waist, but little is known about the validity and participant acceptability of wrist attachment. The objectives of the current study were to assess the validity of a simple summary measure derived from a wrist-worn accelerometer (GENEA, Unilever Discover, UK) to estimate PAEE in pregnant and non-pregnant women, and to evaluate participant acceptability. Non-pregnant (N = 73) and pregnant (N = 35) Swedish women (aged 20-35 yrs) wore the accelerometer on their wrist for 10 days during which total energy expenditure (TEE) was assessed using doubly-labelled water. PAEE was calculated as 0.9×TEE-REE. British participants (N = 99; aged 22-65 yrs) wore accelerometers on their non-dominant wrist and hip for seven days and were asked to score the acceptability of monitor placement (scored 1 [least] through 10 [most] acceptable). There was no significant correlation between body weight and PAEE. In non-pregnant women, acceleration explained 24% of the variation in PAEE, which decreased to 19% in leave-one-out cross-validation. In pregnant women, acceleration explained 11% of the variation in PAEE, which was not significant in leave-one-out cross-validation. Median (IQR) acceptability of wrist and hip placement was 9(8-10) and 9(7-10), respectively; there was a within-individual difference of 0.47 (p<.001). A simple summary measure derived from a wrist-worn tri-axial accelerometer adds significantly to the prediction of energy expenditure in non-pregnant women and is scored acceptable by participants.
Najafi, Bijan; Mohseni, Hooman; Grewal, Gurtej S.; Talal, Talal K.; Menzies, Robert A.; Armstrong, David G.
2017-01-01
Objective: This study aimed to validate a smart-textile based on fiber-optics for simultaneous measurement of plantar temperature, pressure, and joint angles in patients with diabetic peripheral neuropathy (DPN). Methods: After in-vitro validation in the laboratory, 33 eligible subjects with DPN were recruited (age: 58 ± 8 years, BMI: 31.5 ± 8 kg/m2) for assessing plantar pressure and temperature during habitual gait-speed in a clinical-setting. All participants were asked to walk at their habitual speed while wearing a pair of sensorized socks made from highly flexible fiber optics (SmartSox). An algorithm was designed to estimate temperature, pressure, and toe range of motion from optical wavelength generated from SmartSox. To validate the device, results from thermal stress response (TSR) using thermography and peak pressure measured by computerized pressure insoles (F-Scan) were used as gold standards. Results: In laboratory and under controlled conditions, the agreements for parameters of interest were excellent (r > .98, P = .000), and no noticeable cross-talks between measurements of temperature, angle, and pressure were observed. During clinical data acquisition, a significant correlation was found for pressure profile under different anatomical regions of interest between SmartSox and F-Scan (r = .67, P < .050) as well as between thermography and SmartSox (r = .55, P < .050). Conclusion: This study demonstrates the validity of an innovative smart textile for assessing simultaneously the key parameters associated with risk of foot ulcers in patients with DPN. It may empower clinicians to objectively stratify foot risk and provide timely care. Another study is warranted to validate its clinical application in preventing limb threating problems in patients with DPN. PMID:28513212
Anderson, Kim; Aito, Sergio; Atkins, Michal; Biering-Sørensen, Fin; Charlifue, Susan; Curt, Armin; Ditunno, John; Glass, Clive; Marino, Ralph; Marshall, Ruth; Mulcahey, Mary Jane; Post, Marcel; Savic, Gordana; Scivoletto, Giorgio; Catz, Amiram
2008-01-01
Background/Objective: The end goal of clinical care and clinical research involving spinal cord injury (SCI) is to improve the overall ability of persons living with SCI to function on a daily basis. Neurologic recovery does not always translate into functional recovery. Thus, sensitive outcome measures designed to assess functional status relevant to SCI are important to develop. Method: Evaluation of currently available SCI functional outcome measures by a multinational work group. Results: The 4 measures that fit the prespecified inclusion criteria were the Modified Barthel Index (MBI), the Functional Independence Measure (FIM), the Quadriplegia Index of Function (QIF), and the Spinal Cord Independence Measure (SCIM). The MBI and the QIF were found to have minimal evidence for validity, whereas the FIM and the SCIM were found to be reliable and valid. The MBI has little clinical utility for use in the SCI population. Likewise, the FIM applies mainly when measuring burden of care, which is not necessarily a reflection of functional recovery. The QIF is useful for measuring functional recovery but only in a subpopulation of people with SCI, and substantial validity data are still required. The SCIM is the only functional recovery outcome measure designed specifically for SCI. Conclusions: The multinational work group recommends that the latest version of the SCIM (SCIM III) continue to be refined and validated and subsequently implemented worldwide as the primary functional recovery outcome measure for SCI. The QIF may continue to be developed and validated for use as a supplemental tool for the nonambulatory tetraplegic population. PMID:18581660
2017-01-01
Background The Information Assessment Method (IAM) allows clinicians to report the cognitive impact, clinical relevance, intention to use, and expected patient health benefits associated with clinical information received by email. More than 15,000 Canadian physicians and pharmacists use the IAM in continuing education programs. In addition, information providers can use IAM ratings and feedback comments from clinicians to improve their products. Objective Our general objective was to validate the IAM questionnaire for the delivery of educational material (ecological and logical content validity). Our specific objectives were to measure the relevance and evaluate the representativeness of IAM items for assessing information received by email. Methods A 3-part mixed methods study was conducted (convergent design). In part 1 (quantitative longitudinal study), the relevance of IAM items was measured. Participants were 5596 physician members of the Canadian Medical Association who used the IAM. A total of 234,196 ratings were collected in 2012. The relevance of IAM items with respect to their main construct was calculated using descriptive statistics (relevance ratio R). In part 2 (qualitative descriptive study), the representativeness of IAM items was evaluated. A total of 15 family physicians completed semistructured face-to-face interviews. For each construct, we evaluated the representativeness of IAM items using a deductive-inductive thematic qualitative data analysis. In part 3 (mixing quantitative and qualitative parts), results from quantitative and qualitative analyses were reviewed, juxtaposed in a table, discussed with experts, and integrated. Thus, our final results are derived from the views of users (ecological content validation) and experts (logical content validation). Results Of the 23 IAM items, 21 were validated for content, while 2 were removed. In part 1 (quantitative results), 21 items were deemed relevant, while 2 items were deemed not relevant (R=4.86% [N=234,196] and R=3.04% [n=45,394], respectively). In part 2 (qualitative results), 22 items were deemed representative, while 1 item was not representative. In part 3 (mixing quantitative and qualitative results), the content validity of 21 items was confirmed, and the 2 nonrelevant items were excluded. A fully validated version was generated (IAM-v2014). Conclusions This study produced a content validated IAM questionnaire that is used by clinicians and information providers to assess the clinical information delivered in continuing education programs. PMID:28292738
Schmitt, Jochen; Spuls, Phyllis I; Thomas, Kim S; Simpson, Eric; Furue, Masutaka; Deckert, Stefanie; Dohil, Magdalene; Apfelbacher, Christian; Singh, Jasvinder A; Chalmers, Joanne; Williams, Hywel C
2014-10-01
The lack of core outcome sets for atopic eczema (AE) is a major obstacle for advancing evidence-based treatment. The global Harmonising Outcome Measures for Eczema (HOME) initiative has already defined clinical signs, symptoms, quality of life, and long-term control of flares as core outcome domains for AE trials. This article deals with the standardization of measurement instruments to assess clinical signs of AE. To resolve the current lack of standardization of the assessment of clinical signs of AE, we followed a structured process of systematic reviews and international consensus sessions to identify 1 core outcome measurement instrument for assessment of clinical signs in all future AE trials. Systematic reviews indicated that from 16 different instruments identified to assess clinical signs of AE, only the Eczema Area and Severity Index (EASI) and the objective Scoring Atopic Dermatitis (SCORAD) index were identified as extensively validated. The EASI has adequate validity, responsiveness, internal consistency, and intraobserver reliability. The objective SCORAD index has adequate validity, responsiveness, and interobserver reliability but unclear intraobserver reliability to measure clinical signs of AE. In an international consensus study, patients, physicians, nurses, methodologists, and pharmaceutical industry representatives agreed that the EASI is the preferred core instrument to measure clinical signs in all future AE trials. All stakeholders involved in designing, reporting, and using clinical trials on AE are asked to comply with this consensus to enable better evidence-based decision making, clearer scientific communication, and improved patient care. Copyright © 2014 American Academy of Allergy, Asthma & Immunology. Published by Elsevier Inc. All rights reserved.
Validity of the Factor Structure of Conners' CPT
ERIC Educational Resources Information Center
Egeland, Jens; Kovalik-Gran, Iwona
2010-01-01
Objective: A previous factor analysis of the Conners' Continuous Performance Test (CCPT) indicates that the test measures 5 sub-functions of attention, namely "focused attention," "hyperactivity/impulsivity," "sustained attention," "vigilance," and "change in control." The present study further…
Procedures for Constructing and Using Criterion-Referenced Performance Tests.
ERIC Educational Resources Information Center
Campbell, Clifton P.; Allender, Bill R.
1988-01-01
Criterion-referenced performance tests (CRPT) provide a realistic method for objectively measuring task proficiency against predetermined attainment standards. This article explains the procedures of constructing, validating, and scoring CRPTs and includes a checklist for a welding test. (JOW)
Knowledge Sharing among Academics in Institutions of Higher Learning: A Research Agenda
ERIC Educational Resources Information Center
Ramayah, T.; Ignatius, Joshua; Leen, Jasmine Yeap Ai
2009-01-01
This paper presents a research agenda for a funded research project on knowledge sharing among academics in Malaysia. One of the main objectives is to develop validate and measure of knowledge sharing which is suitable for academicians. Previous studies on knowledge sharing have used standard measurement items which do not cater for the multiple…
ERIC Educational Resources Information Center
Haertel, Edward H.
It has been recommended that the National Assessment of Educational Progress (NAEP) specify comprehensive exercise domains to measure academic achievement, and provide a national item pool to measure the objectives in these domains. These domain specifications and item pools would serve to satisfy the increasing demand for valid, accurate, and…
Diagnostic Group Differences in Parent and Teacher Ratings on the BRIEF and Conners' Scales
ERIC Educational Resources Information Center
Sullivan, Jeremy R.; Riccio, Cynthia A.
2007-01-01
Objective: Behavioral rating scales are common instruments used in evaluations of ADHD and executive function. It is important to explore how different diagnostic groups perform on these measures, as this information can be used to provide criterion-related validity evidence for the measures. Method: Data from 92 children and adolescents were used…
Assessing the Quality of Problems in Problem-Based Learning
ERIC Educational Resources Information Center
Sockalingam, Nachamma; Rotgans, Jerome; Schmidt, Henk
2012-01-01
This study evaluated the construct validity and reliability of a newly devised 32-item problem quality rating scale intended to measure the quality of problems in problem-based learning. The rating scale measured the following five characteristics of problems: the extent to which the problem (1) leads to learning objectives, (2) is familiar, (3)…
ERIC Educational Resources Information Center
Wong, Lai Cheung; Chu, Amanda M. Y.; Chan, Cecilia L. W.
2014-01-01
Objective: Because forgiveness is an important aspect of studies in marital relationships, there is a need for a culturally relevant measure of forgiveness for Chinese couples. This study aims to validate the Transgression-related Interpersonal Motivations Inventory in marital relationships within a Chinese context (C-TRIM). Method: Data were…
ERIC Educational Resources Information Center
Lakes, Kimberley D.; Swanson, James M.; Riggs, Matt
2012-01-01
Objective: To evaluate the reliability and validity of the English and Spanish versions of the Strengths and Weaknesses of ADHD-symptom and Normal-behavior (SWAN) rating scale. Method: Parents of preschoolers completed both a SWAN and the well-established Strengths and Difficulties Questionnaire (SDQ) on two separate occasions over a span of 3…
Vectra DA for the objective measurement of disease activity in patients with rheumatoid arthritis.
Segurado, O G; Sasso, E H
2014-01-01
Quantitative and regular assessment of disease activity in rheumatoid arthritis (RA) is required to achieve treatment targets such as remission and to optimize clinical outcomes. To assess inflammation accurately, predict joint damage and monitor treatment response, a measure of disease activity in RA should reflect the pathological processes resulting in irreversible joint damage and functional disability. The Vectra DA blood test is an objective measure of disease activity for patients with RA. Vectra DA provides an accurate, reproducible score on a scale of 1 to 100 based on the concentrations of 12 biomarkers that reflect the pathophysiologic diversity of RA. The analytical validity, clinical validity, and clinical utility of Vectra DA have been evaluated for patients with RA in registries and prospective and retrospective clinical studies. As a biomarker-based instrument for assessing disease activity in RA, the Vectra DA test can help monitor therapeutic response to methotrexate and biologic agents and assess clinically challenging situations, such as when clinical measures are confounded by non-inflammatory pain from fibromyalgia. Vectra DA scores correlate with imaging of joint inflammation and are predictive for radiographic progression, with high Vectra DA scores being associated with more frequent and severe progression and low scores being predictive for non-progression. In summary, the Vectra DA score is an objective measure of RA disease activity that quantifies inflammatory status. By predicting risk for joint damage more effectively than conventional clinical and laboratory measures, it has the potential to complement these measures and optimise clinical decision making.
Standards for Environmental Measurement Using GIS: Toward a Protocol for Protocols.
Forsyth, Ann; Schmitz, Kathryn H; Oakes, Michael; Zimmerman, Jason; Koepp, Joel
2006-02-01
Interdisciplinary research regarding how the built environment influences physical activity has recently increased. Many research projects conducted jointly by public health and environmental design professionals are using geographic information systems (GIS) to objectively measure the built environment. Numerous methodological issues remain, however, and environmental measurements have not been well documented with accepted, common definitions of valid, reliable variables. This paper proposes how to create and document standardized definitions for measures of environmental variables using GIS with the ultimate goal of developing reliable, valid measures. Inherent problems with software and data that hamper environmental measurement can be offset by protocols combining clear conceptual bases with detailed measurement instructions. Examples demonstrate how protocols can more clearly translate concepts into specific measurement. This paper provides a model for developing protocols to allow high quality comparative research on relationships between the environment and physical activity and other outcomes of public health interest.
Cha, Young Joo; Lee, Jae Jin; Kim, Do Hyun; You, Joshua Sung H
2017-10-23
Core stabilization plays an important role in the regulation of postural stability. To overcome shortcomings associated with pain and severe core instability during conventional core stabilization tests, we recently developed the dynamic neuromuscular stabilization-based heel sliding (DNS-HS) test. The purpose of this study was to establish the criterion validity and test-retest reliability of the novel DNS-HS test. Twenty young adults with core instability completed both the bilateral straight leg lowering test (BSLLT) and DNS-HS test for the criterion validity study and repeated the DNS-HS test for the test-retest reliability study. Criterion validity was determined by comparing hip joint angle data that were obtained from BSLLT and DNS-HS measures. The test-retest reliability was determined by comparing hip joint angle data. Criterion validity was (ICC2,3) = 0.700 (p< 0.05), suggesting a good relationship between the two core stability measures. Test-retest reliability was (ICC3,3) = 0.953 (p< 0.05), indicating excellent consistency between the repeated DNS-HS measurements. Criterion validity data demonstrated a good relationship between the gold standard BSLLT and DNS-HS core stability measures. Test-retest reliability data suggests that DNS-HS core stability was a reliable test for core stability. Clinically, the DNS-HS test is useful to objectively quantify core instability and allow early detection and evaluation.
Shen, Minxue; Hu, Ming; Sun, Zhenqiu
2017-01-01
Objectives To develop and validate brief scales to measure common emotional and behavioural problems among adolescents in the examination-oriented education system and collectivistic culture of China. Setting Middle schools in Hunan province. Participants 5442 middle school students aged 11–19 years were sampled. 4727 valid questionnaires were collected and used for validation of the scales. The final sample included 2408 boys and 2319 girls. Primary and secondary outcome measures The tools were assessed by the item response theory, classical test theory (reliability and construct validity) and differential item functioning. Results Four scales to measure anxiety, depression, study problem and sociality problem were established. Exploratory factor analysis showed that each scale had two solutions. Confirmatory factor analysis showed acceptable to good model fit for each scale. Internal consistency and test–retest reliability of all scales were above 0.7. Item response theory showed that all items had acceptable discrimination parameters and most items had appropriate difficulty parameters. 10 items demonstrated differential item functioning with respect to gender. Conclusions Four brief scales were developed and validated among adolescents in middle schools of China. The scales have good psychometric properties with minor differential item functioning. They can be used in middle school settings, and will help school officials to assess the students’ emotional/behavioural problems. PMID:28062469
Design and Validation of an Infrared Badal Optometer for Laser Speckle (IBOLS)
Teel, Danielle F. W.; Copland, R. James; Jacobs, Robert J.; Wells, Thad; Neal, Daniel R.; Thibos, Larry N.
2009-01-01
Purpose To validate the design of an infrared wavefront aberrometer with a Badal optometer employing the principle of laser speckle generated by a spinning disk and infrared light. The instrument was designed for subjective meridional refraction in infrared light by human patients. Methods Validation employed a model eye with known refractive error determined with an objective infrared wavefront aberrometer. The model eye was used to produce a speckle pattern on an artificial retina with controlled amounts of ametropia introduced with auxiliary ophthalmic lenses. A human observer performed the psychophysical task of observing the speckle pattern (with the aid of a video camera sensitive to infrared radiation) formed on the artificial retina. Refraction was performed by adjusting the vergence of incident light with the Badal optometer to nullify the motion of laser speckle. Validation of the method was performed for different levels of spherical ametropia and for various configurations of an astigmatic model eye. Results Subjective measurements of meridional refractive error over the range −4D to + 4D agreed with astigmatic refractive errors predicted by the power of the model eye in the meridian of motion of the spinning disk. Conclusions Use of a Badal optometer to control laser speckle is a valid method for determining subjective refractive error at infrared wavelengths. Such an instrument will be useful for comparing objective measures of refractive error obtained for the human eye with autorefractors and wavefront aberrometers that employ infrared radiation. PMID:18772719
de Vries, C E E; Kalff, M C; Prinsen, C A C; Coulman, K D; den Haan, C; Welbourn, R; Blazeby, J M; Morton, J M; van Wagensveld, B A
2018-06-08
The objective of this study is to systematically assess the quality of existing patient-reported outcome measures developed and/or validated for Quality of Life measurement in bariatric surgery (BS) and body contouring surgery (BCS). We conducted a systematic literature search in PubMed, EMBASE, PsycINFO, CINAHL, Cochrane Database Systematic Reviews and CENTRAL identifying studies on measurement properties of BS and BCS Quality of Life instruments. For all eligible studies, we evaluated the methodological quality of the studies by using the COnsensus-based Standards for the selection of health Measurement INstruments checklist and the quality of the measurement instruments by applying quality criteria. Four degrees of recommendation were assigned to validated instruments (A-D). Out of 4,354 articles, a total of 26 articles describing 24 instruments were included. No instrument met all requirements (category A). Seven instruments have the potential to be recommended depending on further validation studies (category B). Of these seven, the BODY-Q has the strongest evidence for content validity in BS and BCS. Two instruments had poor quality in at least one required quality criterion (category C). Fifteen instruments were minimally validated (category D). The BODY-Q, developed for BS and BCS, possessed the strongest evidence for quality of measurement properties and has the potential to be recommended in future clinical trials. © 2018 The Authors. Obesity Reviews published by John Wiley & Sons Ltd on behalf of World Obesity Federation.
Victoria Symptom Validity Test performance in children and adolescents with neurological disorders.
Brooks, Brian L
2012-12-01
It is becoming increasingly more important to study, use, and promote the utility of measures that are designed to detect non-compliance with testing (i.e., poor effort, symptom non-validity, response bias) as part of neuropsychological assessments with children and adolescents. Several measures have evidence for use in pediatrics, but there is a paucity of published support for the Victoria Symptom Validity Test (VSVT) in this population. The purpose of this study was to examine the performance on the VSVT in a sample of pediatric patients with known neurological disorders. The sample consisted of 100 consecutively referred children and adolescents between the ages of 6 and 19 years (mean = 14.0, SD = 3.1) with various neurological diagnoses. On the VSVT total items, 95% of the sample had performance in the "valid" range, with 5% being deemed "questionable" and 0% deemed "invalid". On easy items, 97% were "valid", 2% were "questionable", and 1% was "invalid." For difficult items, 84% were "valid," 16% were "questionable," and 0% was "invalid." For those patients given two effort measures (i.e., VSVT and Test of Memory Malingering; n = 65), none was identified as having poor test-taking compliance on both measures. VSVT scores were significantly correlated with age, intelligence, processing speed, and functional ratings of daily abilities (attention, executive functioning, and adaptive functioning), but not objective performance on the measure of sustained attention, verbal memory, or visual memory. The VSVT has potential to be used in neuropsychological assessments with pediatric patients.
Improving the Validity of Activity of Daily Living Dependency Risk Assessment
Clark, Daniel O.; Stump, Timothy E.; Tu, Wanzhu; Miller, Douglas K.
2015-01-01
Objectives Efforts to prevent activity of daily living (ADL) dependency may be improved through models that assess older adults’ dependency risk. We evaluated whether cognition and gait speed measures improve the predictive validity of interview-based models. Method Participants were 8,095 self-respondents in the 2006 Health and Retirement Survey who were aged 65 years or over and independent in five ADLs. Incident ADL dependency was determined from the 2008 interview. Models were developed using random 2/3rd cohorts and validated in the remaining 1/3rd. Results Compared to a c-statistic of 0.79 in the best interview model, the model including cognitive measures had c-statistics of 0.82 and 0.80 while the best fitting gait speed model had c-statistics of 0.83 and 0.79 in the development and validation cohorts, respectively. Conclusion Two relatively brief models, one that requires an in-person assessment and one that does not, had excellent validity for predicting incident ADL dependency but did not significantly improve the predictive validity of the best fitting interview-based models. PMID:24652867
Van Houtven, Courtney Harold; Miller, Katherine E M; O'Brien, Emily C; Wolff, Jennifer L; Lindquist, Jennifer; Kabat, Margaret; Campbell-Kotler, Margaret; Henius, Jennifer; Voils, Corrine I
2017-12-01
Despite the important role that family caregivers play managing the care of persons with complex health needs, little is known about how caregivers perceive themselves to be recognized and valued by health care professionals. Our objective was to develop and validate a novel measure, the CAregiver Perceptions About Commun Ication with Clinical Team members (CAPACITY) instrument. Questions focus on perceived quality of communication with the health care team and the extent to which caregivers believe that the health care team considers their capacity and preferences in decision making. A confirmatory factor analysis supported a two-factor solution addressing communication and capacity. Internal consistency reliability was .90 for the communication domain and .93 for the capacity domain. Correlations between these two subscales and individual difference measures provided evidence of convergent and discriminant validity. The CAPACITY instrument may be a useful performance measure that quantifies the extent to which caregivers' experience person- and family-centered health care.
A New Lebanese Medication Adherence Scale: Validation in Lebanese Hypertensive Adults.
Bou Serhal, R; Salameh, P; Wakim, N; Issa, C; Kassem, B; Abou Jaoude, L; Saleh, N
2018-01-01
A new Lebanese scale measuring medication adherence considered socioeconomic and cultural factors not taken into account by the eight-item Morisky Medication Adherence Scale (MMAS-8). Objectives were to validate the new adherence scale and its prediction of hypertension control, compared to MMAS-8, and to assess adherence rates and factors. A cross-sectional study, including 405 patients, was performed in outpatient cardiology clinics of three hospitals in Beirut. Blood pressure was measured, a questionnaire filled, and sodium intake estimated by a urine test. Logistic regression defined predictors of hypertension control and adherence. 54.9% had controlled hypertension. 82.4% were adherent by the new scale, which showed good internal consistency, adequate questions (KMO coefficient = 0.743), and four factors. It predicted hypertension control (OR = 1.217; p value = 0.003), unlike MMAS-8, but the scores were correlated (ICC average measure = 0.651; p value < 0.001). Stress and smoking predicted nonadherence. This study elaborated a validated, practical, and useful tool measuring adherence to medications in Lebanese hypertensive patients.
Development and initial validation of the Impression Motivation in Sport Questionnaire-Team.
Payne, Simon Mark; Hudson, Joanne; Akehurst, Sally; Ntoumanis, Nikos
2013-06-01
Impression motivation is an important individual difference variable that has been under-researched in sport psychology, partly due to having no appropriate measure. This study was conducted to design a measure of impression motivation in team-sport athletes. Construct validity checks decreased the initial pool of items, factor analysis (n = 310) revealed the structure of the newly developed scale, and exploratory structural equation modeling procedures (n = 406) resulted in a modified scale that retained theoretical integrity and psychometric parsimony. This process produced a 15-item, 4-factor model; the Impression Motivation in Sport Questionnaire-Team (IMSQ-T) is forwarded as a valid measure of the respondent's dispositional strength of motivation to use self-presentation in striving for four distinct interpersonal objectives: self-development, social identity development, avoidance of negative outcomes, and avoidance of damaging impressions. The availability of this measure has contributed to theoretical development, will facilitate research, and offers a tool for use in applied settings.
Anderson, Ruth A.; Hsieh, Pi-Ching; Su, Hui Fang; Landerman, Lawrence R.; McDaniel, Reuben R.
2013-01-01
Objectives. To (1) describe participation in decision-making as a systems-level property of complex adaptive systems and (2) present empirical evidence of reliability and validity of a corresponding measure. Method. Study 1 was a mail survey of a single respondent (administrators or directors of nursing) in each of 197 nursing homes. Study 2 was a field study using random, proportionally stratified sampling procedure that included 195 organizations with 3,968 respondents. Analysis. In Study 1, we analyzed the data to reduce the number of scale items and establish initial reliability and validity. In Study 2, we strengthened the psychometric test using a large sample. Results. Results demonstrated validity and reliability of the participation in decision-making instrument (PDMI) while measuring participation of workers in two distinct job categories (RNs and CNAs). We established reliability at the organizational level aggregated items scores. We established validity of the multidimensional properties using convergent and discriminant validity and confirmatory factor analysis. Conclusions. Participation in decision making, when modeled as a systems-level property of organization, has multiple dimensions and is more complex than is being traditionally measured. Managers can use this model to form decision teams that maximize the depth and breadth of expertise needed and to foster connection among them. PMID:24349771
Dishion, Thomas J.; Kim, Hanjoe; Stormshak, Elizabeth A.; O'Neill, Maya
2014-01-01
Objective Conduct a multiagent–multimethod analysis of the validity of a brief measure of deviant peer affiliations and social acceptance (PASA) in young adolescents. Peer relationships are critical to child and adolescent social and emotional development, but currently available measures are tedious and time consuming. The PASA consists of a youth, parent, and teacher report that can be collected longitudinally to study development and intervention effectiveness. Method This longitudinal study included 998 middle school students and their families. We collected the PASA and peer sociometrics data in Grade 7 and a multiagent–multimethod construct of deviant peer clustering in Grade 8. Results Confirmatory factor analyses of the multiagent–multimethod data revealed that the constructs of deviant peer affiliations and social acceptance and rejection were distinguishable as unique but correlated constructs within the PASA. Convergent, discriminant, concurrent, and predictive validity of the PASA was satisfactory, although the acceptance and rejection constructs were highly correlated and showed similar patterns of concurrent validity. Factor invariance was established for mother and for father reports. Conclusions Results suggest that the PASA is a valid and reliable measure of peer affiliation and of social acceptance among peers during the middle school years and provides a comprehensive yet brief assessment of peer affiliations and social acceptance. PMID:24611623
Validation of an instrument to measure older adults' expectations regarding movement (ERM).
Dahodwala, Nabila; Karlawish, Jason; Shea, Judy A; Zubritsky, Cynthia; Stern, Matthew; Mandell, David S
2012-01-01
Many individuals with Parkinson's disease are not diagnosed and treated. Attitudes about aging and related help-seeking may affect the timely diagnosis of Parkinson's disease. Our objectives were to develop measures of older adults' expectations regarding movement with aging, specifically related to parkinsonism, and their beliefs about seeking healthcare for the diagnosis and treatment of parkinsonism. We established content and face validity from interviews with experts, review of the literature, and pre-testing with key informants. Two 9-item instruments resulted: Expectations Regarding Movement (ERM) and Healthcare Seeking Beliefs for parkinsonism (HSB). These instruments were administered to 210 older adults at senior centers to investigate internal consistency and construct validity. 192 (91%) of the older adults completed more than 90% of the survey. The mean age was 76; 17 (9%) reported parkinsonism. Both scales demonstrated good internal consistency (α = 0.90). Factor analysis supported construct validity of the ERM and HSB scores. Older age, lower education, worse self-reported health and African American race each were associated with lower ERM scores, but not HSB scores. The ERM, a brief measure of expectations regarding movement with aging, shows reliability and validity. This scale may be useful in identifying older adults at increased risk for under-identification of Parkinson's disease. Further work is needed to measure healthcare seeking for parkinsonism.
Anderson, Ruth A; Plowman, Donde; Corazzini, Kirsten; Hsieh, Pi-Ching; Su, Hui Fang; Landerman, Lawrence R; McDaniel, Reuben R
2013-01-01
Objectives. To (1) describe participation in decision-making as a systems-level property of complex adaptive systems and (2) present empirical evidence of reliability and validity of a corresponding measure. Method. Study 1 was a mail survey of a single respondent (administrators or directors of nursing) in each of 197 nursing homes. Study 2 was a field study using random, proportionally stratified sampling procedure that included 195 organizations with 3,968 respondents. Analysis. In Study 1, we analyzed the data to reduce the number of scale items and establish initial reliability and validity. In Study 2, we strengthened the psychometric test using a large sample. Results. Results demonstrated validity and reliability of the participation in decision-making instrument (PDMI) while measuring participation of workers in two distinct job categories (RNs and CNAs). We established reliability at the organizational level aggregated items scores. We established validity of the multidimensional properties using convergent and discriminant validity and confirmatory factor analysis. Conclusions. Participation in decision making, when modeled as a systems-level property of organization, has multiple dimensions and is more complex than is being traditionally measured. Managers can use this model to form decision teams that maximize the depth and breadth of expertise needed and to foster connection among them.
Validity test and its consistency in the construction of patient loyalty model
NASA Astrophysics Data System (ADS)
Yanuar, Ferra
2016-04-01
The main objective of this present study is to demonstrate the estimation of validity values and its consistency based on structural equation model. The method of estimation was then implemented to an empirical data in case of the construction the patient loyalty model. In the hypothesis model, service quality, patient satisfaction and patient loyalty were determined simultaneously, each factor were measured by any indicator variables. The respondents involved in this study were the patients who ever got healthcare at Puskesmas in Padang, West Sumatera. All 394 respondents who had complete information were included in the analysis. This study found that each construct; service quality, patient satisfaction and patient loyalty were valid. It means that all hypothesized indicator variables were significant to measure their corresponding latent variable. Service quality is the most measured by tangible, patient satisfaction is the most mesured by satisfied on service and patient loyalty is the most measured by good service quality. Meanwhile in structural equation, this study found that patient loyalty was affected by patient satisfaction positively and directly. Service quality affected patient loyalty indirectly with patient satisfaction as mediator variable between both latent variables. Both structural equations were also valid. This study also proved that validity values which obtained here were also consistence based on simulation study using bootstrap approach.
The Reliability and Validity of Measures of Gait Variability in Community-Dwelling Older Adults
Brach, Jennifer S.; Perera, Subashan; Studenski, Stephanie; Newman, Anne B.
2009-01-01
Objective To examine the test-retest reliability and concurrent validity of variability of gait characteristics. Design Cross-sectional study. Setting Research laboratory. Participants Older adults (N=558) from the Cardiovascular Health Study. Interventions Not applicable. Main Outcome Measures Gait characteristics were measured using a 4-m computerized walkway. SD determined from the steps recorded were used as the measures of variability. Intraclass correlation coefficients (ICC) were calculated to examine test-retest reliability of a 4-m walk and two 4-m walks. To establish concurrent validity, the measures of gait variability were compared across levels of health, functional status, and physical activity using independent t tests and analysis of variances. Results Gait variability measures from the two 4-m walks demonstrated greater test-retest reliability than those from the single 4-m walk (ICC=.22–.48 and ICC=.40–.63, respectively). Greater step length and stance time variability were associated with poorer health, functional status and physical activity (P<.05). Conclusions Gait variability calculated from a limited number of steps has fair to good test-retest reliability and concurrent validity. Reliability of gait variability calculated from a greater number of steps should be assessed to determine if the consistency can be improved. PMID:19061741
Observations with the ROWS instrument during the Grand Banks calibration/validation experiments
NASA Technical Reports Server (NTRS)
Vandemark, D.; Chapron, B.
1994-01-01
As part of a global program to validate the ocean surface sensors on board ERS-1, a joint experiment on the Grand Banks of Newfoundland was carried out in Nov. 1991. The principal objective was to provide a field validation of ERS-1 Synthetic Aperture Radar (SAR) measurement of ocean surface structure. The NASA-P3 aircraft measurements made during this experiment provide independent measurements of the ocean surface along the validation swath. The Radar Ocean Wave Spectrometer (ROWS) is a radar sensor designed to measure direction of the long wave components using spectral analysis of the tilt induced radar backscatter modulation. This technique greatly differs from SAR and thus, provides a unique set of measurements for use in evaluating SAR performance. Also, an altimeter channel in the ROWS gives simultaneous information on the surface wave height and radar mean square slope parameter. The sets of geophysical parameters (wind speed, significant wave height, directional spectrum) are used to study the SAR's ability to accurately measure ocean gravity waves. The known distortion imposed on the true directional spectrum by the SAR imaging mechanism is discussed in light of the direct comparisons between ERS-1 SAR, airborne Canadian Center for Remote Sensing (CCRS) SAR, and ROWS spectra and the use of the nonlinear ocean SAR transform.
Levis, Alexander W; Harel, Daphna; Kwakkenbos, Linda; Carrier, Marie-Eve; Mouthon, Luc; Poiraudeau, Serge; Bartlett, Susan J; Khanna, Dinesh; Malcarne, Vanessa L; Sauve, Maureen; van den Ende, Cornelia H M; Poole, Janet L; Schouffoer, Anne A; Welling, Joep; Thombs, Brett D
2016-11-01
To develop and validate a short form of the Cochin Hand Function Scale (CHFS), which measures hand disability, for use in systemic sclerosis, using objective criteria and reproducible techniques. Responses on the 18-item CHFS were obtained from English-speaking patients enrolled in the Scleroderma Patient-Centered Intervention Network Cohort. CHFS unidimensionality was verified using confirmatory factor analysis, and an item response theory model was fit to CHFS items. Optimal test assembly (OTA) methods identified a maximally precise short form for each possible form length between 1 and 17 items. The final short form selected was the form with the least number of items that maintained statistically equivalent convergent validity, compared to the full-length CHFS, with the Health Assessment Questionnaire (HAQ) disability index (DI) and the physical function domain of the 29-item Patient-Reported Outcomes Measurement Information System (PROMIS-29). There were 601 patients included. A 6-item short form of the CHFS (CHFS-6) was selected. The CHFS-6 had a Cronbach's alpha of 0.93. Correlations of the CHFS-6 summed score with HAQ DI (r = 0.79) and PROMIS-29 physical function (r = -0.54) were statistically equivalent to the CHFS (r = 0.81 and r = -0.56). The correlation with the full CHFS was high (r = 0.98). The OTA procedure generated a valid short form of the CHFS with minimal loss of information compared to the full-length form. The OTA method used was based on objective, prespecified criteria, but should be further studied for viability as a general procedure for shortening patient-reported outcome measures in health research. © 2016, American College of Rheumatology.
A Prognostic Model for One-year Mortality in Patients Requiring Prolonged Mechanical Ventilation
Carson, Shannon S.; Garrett, Joanne; Hanson, Laura C.; Lanier, Joyce; Govert, Joe; Brake, Mary C.; Landucci, Dante L.; Cox, Christopher E.; Carey, Timothy S.
2009-01-01
Objective A measure that identifies patients who are at high risk of mortality after prolonged ventilation will help physicians communicate prognosis to patients or surrogate decision-makers. Our objective was to develop and validate a prognostic model for 1-year mortality in patients ventilated for 21 days or more. Design Prospective cohort study. Setting University-based tertiary care hospital Patients 300 consecutive medical, surgical, and trauma patients requiring mechanical ventilation for at least 21 days were prospectively enrolled. Measurements and Main Results Predictive variables were measured on day 21 of ventilation for the first 200 patients and entered into logistic regression models with 1-year and 3-month mortality as outcomes. Final models were validated using data from 100 subsequent patients. One-year mortality was 51% in the development set and 58% in the validation set. Independent predictors of mortality included requirement for vasopressors, hemodialysis, platelet count ≤150 ×109/L, and age ≥50. Areas under the ROC curve for the development model and validation model were 0.82 (se 0.03) and 0.82 (se 0.05) respectively. The model had sensitivity of 0.42 (se 0.12) and specificity of 0.99 (se 0.01) for identifying patients who had ≥90% risk of death at 1 year. Observed mortality was highly consistent with both 3- and 12-month predicted mortality. These four predictive variables can be used in a simple prognostic score that clearly identifies low risk patients (no risk factors, 15% mortality) and high risk patients (3 or 4 risk factors, 97% mortality). Conclusions Simple clinical variables measured on day 21 of mechanical ventilation can identify patients at highest and lowest risk of death from prolonged ventilation. PMID:18552692
DOE Office of Scientific and Technical Information (OSTI.GOV)
Golosio, Bruno; Carpinelli, Massimo; Masala, Giovanni Luca
Phase contrast imaging is a technique widely used in synchrotron facilities for nondestructive analysis. Such technique can also be implemented through microfocus x-ray tube systems. Recently, a relatively new type of compact, quasimonochromatic x-ray sources based on Compton backscattering has been proposed for phase contrast imaging applications. In order to plan a phase contrast imaging system setup, to evaluate the system performance and to choose the experimental parameters that optimize the image quality, it is important to have reliable software for phase contrast imaging simulation. Several software tools have been developed and tested against experimental measurements at synchrotron facilities devotedmore » to phase contrast imaging. However, many approximations that are valid in such conditions (e.g., large source-object distance, small transverse size of the object, plane wave approximation, monochromatic beam, and Gaussian-shaped source focal spot) are not generally suitable for x-ray tubes and other compact systems. In this work we describe a general method for the simulation of phase contrast imaging using polychromatic sources based on a spherical wave description of the beam and on a double-Gaussian model of the source focal spot, we discuss the validity of some possible approximations, and we test the simulations against experimental measurements using a microfocus x-ray tube on three types of polymers (nylon, poly-ethylene-terephthalate, and poly-methyl-methacrylate) at varying source-object distance. It will be shown that, as long as all experimental conditions are described accurately in the simulations, the described method yields results that are in good agreement with experimental measurements.« less
Roberson, David W; Kentala, Erna; Forbes, Peter
2005-12-01
The goals of this project were 1) to develop and validate an objective instrument to measure surgical performance at tonsillectomy, 2) to assess its interobserver and interobservation reliability and construct validity, and 3) to select those items with best reliability and most independent information to design a simplified form suitable for routine use in otolaryngology surgical evaluation. Prospective, observational data collection for an educational quality improvement project. The evaluation instrument was based on previous instruments developed in general surgery with input from attending otolaryngologic surgeons and experts in medical education. It was pilot tested and subjected to iterative improvements. After the instrument was finalized, a total of 55 tonsillectomies were observed and scored during academic year 2002 to 2003: 45 cases by residents at different points during their rotation, 5 by fellows, and 5 by faculty. Results were assessed for interobserver reliability, interobservation reliability, and construct validity. Factor analysis was used to identify items with independent information. Interobserver and interobservation reliability was high. On technical items, faculty substantially outperformed fellows, who in turn outperformed residents (P < .0001 for both comparisons). On the "global" scale (overall assessment), residents improved an average of 1 full point (on a 5 point scale) during a 3 month rotation (P = .01). In the subscale of "patient care," results were less clear cut: fellows outperformed residents, who in turn outperformed faculty, but only the fellows to faculty comparison was statistically significant (P = .04), and residents did not clearly improve over time (P = .36). Factor analysis demonstrated that technical items and patient care items factor separately and thus represent separate skill domains in surgery. It is possible to objectively measure surgical skill at tonsillectomy with high reliability and good construct validity. Factor analysis demonstrated that patient care is a distinct domain in surgical skill. Although the interobserver reliability for some patient care items reached statistical significance, it was not high enough for "high stakes testing" purposes. Using reliability and factor analysis results, we propose a simplified instrument for use in evaluating trainees in otolaryngologic surgery.
Development and validation of a multi-dimensional measure of intellectual humility
Alfano, Mark; Iurino, Kathryn; Stey, Paul; Robinson, Brian; Christen, Markus; Yu, Feng; Lapsley, Daniel
2017-01-01
This paper presents five studies on the development and validation of a scale of intellectual humility. This scale captures cognitive, affective, behavioral, and motivational components of the construct that have been identified by various philosophers in their conceptual analyses of intellectual humility. We find that intellectual humility has four core dimensions: Open-mindedness (versus Arrogance), Intellectual Modesty (versus Vanity), Corrigibility (versus Fragility), and Engagement (versus Boredom). These dimensions display adequate self-informant agreement, and adequate convergent, divergent, and discriminant validity. In particular, Open-mindedness adds predictive power beyond the Big Six for an objective behavioral measure of intellectual humility, and Intellectual Modesty is uniquely related to Narcissism. We find that a similar factor structure emerges in Germanophone participants, giving initial evidence for the model’s cross-cultural generalizability. PMID:28813478
Meltzer, Lisa J.; Avis, Kristin T.; Biggs, Sarah; Reynolds, Amy C.; Crabtree, Valerie McLaughlin; Bevans, Katherine B.
2013-01-01
Study Objectives: (1) Present preliminary psychometrics for the Children's Report of Sleep Patterns (CRSP), a three-module measure of Sleep Patterns, Sleep Hygiene, and Sleep Disturbance; and (2) explore whether the CRSP provides information about a child's sleep above and beyond parental report. Methods: A multi-method, multi-reporter approach was used to validate the CRSP with 456 children aged 8-12 years (inclusive). Participants were recruited from pediatricians' offices, sleep clinics/laboratories, children's hospitals, schools, and the general population. Participants completed measures of sleep habits, sleep hygiene, anxiety, and sleepiness, with actigraphy and polysomnography used to provide objective measures of child sleep. Results: The CRSP demonstrated good reliability and validity. Differences in sleep hygiene and sleep disturbances were found for children presenting to a sleep clinic/laboratory (vs. community population); for younger children (vs. older children); and for children who slept less than 8 hours or had a sleep onset later than 22:00 on actigraphy. Further, significant associations were found between the CRSP and child-reported anxiety or sleepiness. Notably, approximately 40% of parents were not aware of child reported difficulties with sleep onset latency, night wakings, or poor sleep quality. Conclusions: The three modules of the CRSP can be used together or independently, providing a reliable and valid self-report measure of sleep patterns, sleep hygiene, and sleep disturbances for children ages 8-12 years. Children not only provide valid information about their sleep, but may provide information that would not be otherwise captured in both clinical and research settings if relying solely on parental report. Citation: Meltzer LJ; Avis KT; Biggs S; Reynolds AC; Crab-tree VM; Bevans KB. The Children's Report of Sleep Patterns (CRSP): a self-report measure of sleep for school-aged children. J Clin Sleep Med 2013;9(3):235-245. PMID:23493949
The Parent Trauma Response Questionnaire (PTRQ): development and preliminary validation
Creswell, Cathy; Dalgleish, Tim; Fearon, Pasco; Goodall, Ben; McKinnon, Anna; Smith, Patrick; Wright, Isobel
2018-01-01
ABSTRACT Background: Following a child’s experience of trauma, parental response is thought to play an important role in either facilitating or hindering their psychological adjustment. However, the ability to investigate the role of parenting responses in the post-trauma period has been hampered by a lack of valid and reliable measures. Objectives: The aim of this study was to design, and provide a preliminary validation of, the Parent Trauma Response Questionnaire (PTRQ), a self-report measure of parental appraisals and support for children’s coping, in the aftermath of child trauma. Methods: We administered an initial set of 78 items to 365 parents whose children, aged 2–19 years, had experienced a traumatic event. We conducted principal axis factoring and then assessed the validity of the reduced measure against a standardized general measure of parental overprotection and via the measure’s association with child post-trauma mental health. Results: Factor analysis generated three factors assessing parental maladaptive appraisals: (i) permanent change/damage, (ii) preoccupation with child’s vulnerability, and (iii) self-blame. In addition, five factors were identified that assess parental support for child coping: (i) behavioural avoidance, (ii) cognitive avoidance, (iii) overprotection, (iv) maintaining pre-trauma routines, and (v) approach coping. Good validity was evidenced against the measure of parental overprotection and child post-traumatic stress symptoms. Good test–retest reliability of the measure was also demonstrated. Conclusions: The PTRQ is a valid and reliable self-report assessment of parenting cognitions and coping in the aftermath of child trauma. PMID:29938010
Estimating learning outcomes from pre- and posttest student self-assessments: a longitudinal study.
Schiekirka, Sarah; Reinhardt, Deborah; Beißbarth, Tim; Anders, Sven; Pukrop, Tobias; Raupach, Tobias
2013-03-01
Learning outcome is an important measure for overall teaching quality and should be addressed by comprehensive evaluation tools. The authors evaluated the validity of a novel evaluation tool based on student self-assessments, which may help identify specific strengths and weaknesses of a particular course. In 2011, the authors asked 145 fourth-year students at Göttingen Medical School to self-assess their knowledge on 33 specific learning objectives in a pretest and posttest as part of a cardiorespiratory module. The authors compared performance gain calculated from self-assessments with performance gain derived from formative examinations that were closely matched to these 33 learning objectives. Eighty-three students (57.2%) completed the assessment. There was good agreement between performance gain derived from subjective data and performance gain derived from objective examinations (Pearson r=0.78; P<.0001) on the group level. The association between the two measures was much weaker when data were analyzed on the individual level. Further analysis determined a quality cutoff for performance gain derived from aggregated student self-assessments. When using this cutoff, the evaluation tool was highly sensitive in identifying specific learning objectives with favorable or suboptimal objective performance gains. The tool is easy to implement, takes initial performance levels into account, and does not require extensive pre-post testing. By providing valid estimates of actual performance gain obtained during a teaching module, it may assist medical teachers in identifying strengths and weaknesses of a particular course on the level of specific learning objectives.
Hampson, Sarah E; Edmonds, Grant W; Goldberg, Lewis R
2017-01-01
This study examined the factor structure and predictive validity of the commonly used multidimensional Health Behavior Checklist. A three-factor structure was found in two community samples that included men and women. The new 16-item Good Health Practices scale and the original Wellness Maintenance scale were the only Health Behavior Checklist scales to be related to cardiovascular and metabolic risk factors. While the other Health Behavior Checklist scales require further validation, the Good Health Practices scale could be used where more objective or longer measures are not feasible.
NASA Technical Reports Server (NTRS)
Munk, Michelle M.; Little, Alan; Kuhl, Chris; Bose, Deepak; Santos, Jose
2013-01-01
Objectives: Measure Pressure: a) Confirm spacecraft aerodynamics. b) Independently measure attitude. c) Determine density profile. d) Determine wind component. Measure Temperature: a) Verify heating levels on spacecraft surface. b) Determine recession amount and rate. c) Validate material response at Mars conditions. The better we understand the Mars entry environment, the better we can design the next spacecraft.
ERIC Educational Resources Information Center
Steele, Michael M.; Burns, Leonard G.; Whitaker, Brandi N.
2013-01-01
Objective. The purpose of this study was to examine the psychometric properties of the self-efficacy for healthy eating and physical activity measure (SE-HEPA) for preadolescents. Method. The reliability of the measure was examined to determine if the internal consistency of the measure was adequate (i.e., [alpha]s greater than 0.70). Next, in an…
Kim, Yong-Wook
2013-01-01
. [Purpose] The purpose of the present study was to investigate the clinical usefulness (reliability and validity) of the pendulum test using a Noland-Kuckhoff (NK) table with an attached electrogoniometer to measure the spasticity of patients with brain lesions. [Subjects] The subjects were 31 patients with stroke or traumatic brain injury. [Methods] The intraclass correlation coefficient (ICC) was used to verify the test–retest reliability of spasticity measures obtained using the pendulum test. Pearson's product correlation coefficient was used to examine the validity of the pendulum test using the amplitude of the patellar tendon reflex (PTR) test, an objective and quantitative measure of spasticity. [Results] The test–retest reliability was high, reflecting a significant correlation between the test and the retest (ICCs = 0.95–0.97). A significant negative correlation was found between the amplitude of the PTR test and the four variables measured in the pendulum test (r = −0.77– −0.85). [Conclusion] The pendulum test using a NK table is an objective measure of spasticity and can be used in the clinical setting in place of more expensive and complicated equipment. Further studies are needed to investigate the therapeutic effect of this method on spasticity. PMID:24259775
Kim, Yong-Wook
2013-10-01
. [Purpose] The purpose of the present study was to investigate the clinical usefulness (reliability and validity) of the pendulum test using a Noland-Kuckhoff (NK) table with an attached electrogoniometer to measure the spasticity of patients with brain lesions. [Subjects] The subjects were 31 patients with stroke or traumatic brain injury. [Methods] The intraclass correlation coefficient (ICC) was used to verify the test-retest reliability of spasticity measures obtained using the pendulum test. Pearson's product correlation coefficient was used to examine the validity of the pendulum test using the amplitude of the patellar tendon reflex (PTR) test, an objective and quantitative measure of spasticity. [Results] The test-retest reliability was high, reflecting a significant correlation between the test and the retest (ICCs = 0.95-0.97). A significant negative correlation was found between the amplitude of the PTR test and the four variables measured in the pendulum test (r = -0.77- -0.85). [Conclusion] The pendulum test using a NK table is an objective measure of spasticity and can be used in the clinical setting in place of more expensive and complicated equipment. Further studies are needed to investigate the therapeutic effect of this method on spasticity.
Monyeki, Makama Andries; Moss, Sarah J; Kemper, Han C G; Twisk, Jos W R
2018-06-06
Physical activity plays an important role in the prevention of chronic lifestyle-related diseases. The development of valid instruments for the assessment of physical activity remains a challenge in field studies. The purpose of the present study was therefore to determine the level of agreement between physical activity objectively measured by the ActiHeart ® (Cambridge Neurotechnology Ltd, Cambridge, UK) device and subjectively reported physical activity by means of the International Physical Activity Questionnaire Short Form (IPAQ-SF) among adolescents attending schools in the Tlokwe Local Municipality, South Africa. A cross-sectional study design was used with a total of 63 boys and 45 girls aged 15 years who took part in the Physical Activity and Health Longitudinal Study (PHALS). Stature and weight were measured according to standard International Society for the Advancement of Kinanthropometry (ISAK) protocols. Objective physical activity (PA) was measured by a combined heart rate and accelerometer device (ActiHeart ® ) for seven consecutive days. Time spent in moderate-to-vigorous intensity physical activity (MVPA) was assessed. Subjective physical activity was assessed with the self-reported IPAQ-SF. Objective PA indicated that 93% of the participants were inactive and only 6% were highly active. The IPAQ-SF showed that 24% were inactive, with 57% active. A non-significant correlation ( r = 0.11; p = 0.29) between the ActiHeart ® measure of activity energy expenditure (AEE) and total physical activity (IPAQ-SF) was observed. The Bland⁻Altman plot showed no agreement between the two measurement instruments and also a variation in the level of equivalence. When Cohen’s kappa ( κ ) was run to determine the agreement between the two measurement instruments for estimated physical activity, a poor agreement (κ = 0.011, p < 0.005) between the two was found. The poor level of agreement between the objective measure of physical activity (ActiHeart ® ) and the IPAQ-SF questionnaire should be interpreted cautiously. Future physical activity research using a combination of subjective and objective assessment methods in a large-scale cohort in adolescents is recommended.
NASA Astrophysics Data System (ADS)
Bernand-Mantel, A.; Bouzehouane, K.; Seneor, P.; Fusil, S.; Deranlot, C.; Brenac, A.; Notin, L.; Morel, R.; Petroff, F.; Fert, A.
2010-11-01
We report on the high yield connection of single nano-objects as small as a few nanometres in diameter to separately elaborated metallic electrodes, using a 'table-top' nanotechnology. Single-electron transport measurements validate that transport occurs through a single nano-object. The vertical geometry of the device natively allows an independent choice of materials for each electrode and the nano-object. In addition ferromagnetic materials can be used without encountering oxidation problems. The possibility of elaborating such hybrid nanodevices opens new routes for the democratization of spintronic studies in low dimensions.
Are validated outcome measures used in distal radial fractures truly valid?
Nienhuis, R. W.; Bhandari, M.; Goslings, J. C.; Poolman, R. W.; Scholtes, V. A. B.
2016-01-01
Objectives Patient-reported outcome measures (PROMs) are often used to evaluate the outcome of treatment in patients with distal radial fractures. Which PROM to select is often based on assessment of measurement properties, such as validity and reliability. Measurement properties are assessed in clinimetric studies, and results are often reviewed without considering the methodological quality of these studies. Our aim was to systematically review the methodological quality of clinimetric studies that evaluated measurement properties of PROMs used in patients with distal radial fractures, and to make recommendations for the selection of PROMs based on the level of evidence of each individual measurement property. Methods A systematic literature search was performed in PubMed, EMbase, CINAHL and PsycINFO databases to identify relevant clinimetric studies. Two reviewers independently assessed the methodological quality of the studies on measurement properties, using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Level of evidence (strong / moderate / limited / lacking) for each measurement property per PROM was determined by combining the methodological quality and the results of the different clinimetric studies. Results In all, 19 out of 1508 identified unique studies were included, in which 12 PROMs were rated. The Patient-rated wrist evaluation (PRWE) and the Disabilities of Arm, Shoulder and Hand questionnaire (DASH) were evaluated on most measurement properties. The evidence for the PRWE is moderate that its reliability, validity (content and hypothesis testing), and responsiveness are good. The evidence is limited that its internal consistency and cross-cultural validity are good, and its measurement error is acceptable. There is no evidence for its structural and criterion validity. The evidence for the DASH is moderate that its responsiveness is good. The evidence is limited that its reliability and the validity on hypothesis testing are good. There is no evidence for the other measurement properties. Conclusion According to this systematic review, there is, at best, moderate evidence that the responsiveness of the PRWE and DASH are good, as are the reliability and validity of the PRWE. We recommend these PROMs in clinical studies in patients with distal radial fractures; however, more clinimetric studies of higher methodological quality are needed to adequately determine the other measurement properties. Cite this article: Dr Y. V. Kleinlugtenbelt. Are validated outcome measures used in distal radial fractures truly valid?: A critical assessment using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Bone Joint Res 2016;5:153–161. DOI: 10.1302/2046-3758.54.2000462. PMID:27132246
Assessment of validity with polytrauma Veteran populations.
Bush, Shane S; Bass, Carmela
2015-01-01
Veterans with polytrauma have suffered injuries to multiple body parts and organs systems, including the brain. The injuries can generate a triad of physical, neurologic/cognitive, and emotional symptoms. Accurate diagnosis is essential for the treatment of these conditions and for fair allocation of benefits. To accurately diagnose polytrauma disorders and their related problems, clinicians take into account the validity of reported history and symptoms, as well as clinical presentations. The purpose of this article is to describe the assessment of validity with polytrauma Veteran populations. Review of scholarly and other relevant literature and clinical experience are utilized. A multimethod approach to validity assessment that includes objective, standardized measures increases the confidence that can be placed in the accuracy of self-reported symptoms and physical, cognitive, and emotional test results. Due to the multivariate nature of polytrauma and the multiple disciplines that play a role in diagnosis and treatment, an ideal model of validity assessment with polytrauma Veteran populations utilizes neurocognitive, neurological, neuropsychiatric, and behavioral measures of validity. An overview of these validity assessment approaches as applied to polytrauma Veteran populations is presented. Veterans, the VA, and society are best served when accurate diagnoses are made.
The Role of Structural Models in the Solar Sail Flight Validation Process
NASA Technical Reports Server (NTRS)
Johnston, John D.
2004-01-01
NASA is currently soliciting proposals via the New Millennium Program ST-9 opportunity for a potential Solar Sail Flight Validation (SSFV) experiment to develop and operate in space a deployable solar sail that can be steered and provides measurable acceleration. The approach planned for this experiment is to test and validate models and processes for solar sail design, fabrication, deployment, and flight. These models and processes would then be used to design, fabricate, and operate scaleable solar sails for future space science missions. There are six validation objectives planned for the ST9 SSFV experiment: 1) Validate solar sail design tools and fabrication methods; 2) Validate controlled deployment; 3) Validate in space structural characteristics (focus of poster); 4) Validate solar sail attitude control; 5) Validate solar sail thrust performance; 6) Characterize the sail's electromagnetic interaction with the space environment. This poster presents a top-level assessment of the role of structural models in the validation process for in-space structural characteristics.
Validation of biomarkers of food intake-critical assessment of candidate biomarkers.
Dragsted, L O; Gao, Q; Scalbert, A; Vergères, G; Kolehmainen, M; Manach, C; Brennan, L; Afman, L A; Wishart, D S; Andres Lacueva, C; Garcia-Aloy, M; Verhagen, H; Feskens, E J M; Praticò, G
2018-01-01
Biomarkers of food intake (BFIs) are a promising tool for limiting misclassification in nutrition research where more subjective dietary assessment instruments are used. They may also be used to assess compliance to dietary guidelines or to a dietary intervention. Biomarkers therefore hold promise for direct and objective measurement of food intake. However, the number of comprehensively validated biomarkers of food intake is limited to just a few. Many new candidate biomarkers emerge from metabolic profiling studies and from advances in food chemistry. Furthermore, candidate food intake biomarkers may also be identified based on extensive literature reviews such as described in the guidelines for Biomarker of Food Intake Reviews (BFIRev). To systematically and critically assess the validity of candidate biomarkers of food intake, it is necessary to outline and streamline an optimal and reproducible validation process. A consensus-based procedure was used to provide and evaluate a set of the most important criteria for systematic validation of BFIs. As a result, a validation procedure was developed including eight criteria, plausibility, dose-response, time-response, robustness, reliability, stability, analytical performance, and inter-laboratory reproducibility. The validation has a dual purpose: (1) to estimate the current level of validation of candidate biomarkers of food intake based on an objective and systematic approach and (2) to pinpoint which additional studies are needed to provide full validation of each candidate biomarker of food intake. This position paper on biomarker of food intake validation outlines the second step of the BFIRev procedure but may also be used as such for validation of new candidate biomarkers identified, e.g., in food metabolomic studies.
Artefacts for optical surface measurement
NASA Astrophysics Data System (ADS)
Robson, Stuart; Beraldin, J.-Angelo; Brownhill, Andrew; MacDonald, Lindsay
2011-07-01
Flexible manufacturing technologies are supporting the routine production of components with freeform surfaces in a wide variety of materials and surface finishes. Such surfaces may be exploited for both aesthetic and performance criteria for a wide range of industries, for example automotive, aircraft, small consumer goods and medial components. In order to ensure conformance between manufactured part and digital design it is necessary to understand, validate and promote best practice of the available measurement technologies. Similar, but currently less quantifiable, measurement requirements also exist in heritage, museum and fine art recording where objects can be individually hand crafted to extremely fine levels of detail. Optical 3D measurement systems designed for close range applications are typified by one or more illumination sources projecting a spot, line or structured light pattern onto a surface or surfaces of interest. Reflections from the projected light are detected in one or more imaging devices and measurements made concerning the location, intensity and optionally colour of the image. Coordinates of locations on the surface may be computed either directly from an understanding of the illumination and imaging geometry or indirectly through analysis of the spatial frequencies of the projected pattern. Regardless of sensing configuration some independent means is necessary to ensure that measurement capability will meet the requirements of a given level of object recording and is consistent for variations in surface properties and structure. As technologies mature, guidelines for best practice are emerging, most prominent at the current time being the German VDI/VDE 2634 and ISO/DIS 10360-8 guidelines. This considers state of the art capabilities for independent validation of optical non-contact measurement systems suited to the close range measurement of table top sized manufactured or crafted objects.
Aeroacoustic Validation of Installed Low Noise Propulsion for NASA's N+2 Supersonic Airliner
NASA Technical Reports Server (NTRS)
Bridges, James
2018-01-01
An aeroacoustic test was conducted at NASA Glenn Research Center on an integrated propulsion system designed to meet noise regulations of ICAO Chapter 4 with 10EPNdB cumulative margin. The test had two objectives: to demonstrate that the aircraft design did meet the noise goal, and to validate the acoustic design tools used in the design. Variations in the propulsion system design and its installation were tested and the results compared against predictions. Far-field arrays of microphones measured the acoustic spectral directivity, which was transformed to full scale as noise certification levels. Phased array measurements confirmed that the shielding of the installation model adequately simulated the full aircraft and provided data for validating RANS-based noise prediction tools. Particle image velocimetry confirmed that the flow field around the nozzle on the jet rig mimicked that of the full aircraft and produced flow data to validate the RANS solutions used in the noise predictions. The far-field acoustic measurements confirmed the empirical predictions for the noise. Results provided here detail the steps taken to ensure accuracy of the measurements and give insights into the physics of exhaust noise from installed propulsion systems in future supersonic vehicles.
van der Wal, Martijn; Bloemen, Monica; Verhaegen, Pauline; Tuinebreijer, Wim; de Vet, Henrica; van Zuijlen, Paul; Middelkoop, Esther
2013-01-01
Color measurements are an essential part of scar evaluation. Thus, vascularization (erythema) and pigmentation (melanin) are common outcome parameters in scar research. The aim of this study was to investigate the clinimetric properties and clinical feasibility of the Mexameter, Colorimeter, and the DSM II ColorMeter for objective measurements on skin and scars. Fifty scars with a mean age of 6 years (2 months to 53 years) were included. Reliability was tested using the single-measure interobserver intraclass correlation coefficient. Validity was determined by measuring the Pearson correlation with the Fitzpatrick skin type classification (for skin) and the Patient and Observer Scar Assessment Scale (for scar tissue). All three instruments provided reliable readings (intraclass correlation coefficient ≥ 0.83; confidence interval: 0.71-0.90) on normal skin and scar tissue. Parameters with the highest correlations with the Fitzpatrick classification were melanin (Mexameter), 0.72; ITA (Colorimeter), -0.74; and melanin (DSM II), 0.70. On scars, the highest correlations with the Patient and Observer Scar Assessment Scale vascularization scores were the following: erythema (Mexameter), 0.59; LAB2 (Colorimeter), 0.69; and erythema (DSM II), 0.66. For hyperpigmentation, the highest correlations were melanin (Mexameter), 0.75; ITA (Colorimeter), -0.80; and melanin (DSM II), 0.83. This study shows that all three instruments can provide reliable color data on skin and scars with a single measurement. The authors also demonstrated that they can assist in objective skin type classification. For scar assessment, the most valid parameters in each instrument were identified.
NASA Technical Reports Server (NTRS)
Gazarik, Michael J.; Hwang, Helen; Little, Alan; Cheatwood, Neil; Wright, Michael; Herath, Jeff
2007-01-01
The Mars Science Laboratory Entry, Descent, and Landing Instrumentation (MEDLI) Project's objectives are to measure aerothermal environments, sub-surface heatshield material response, vehicle orientation, and atmospheric density for the atmospheric entry and descent phases of the Mars Science Laboratory (MSL) entry vehicle. The flight science objectives of MEDLI directly address the largest uncertainties in the ability to design and validate a robust Mars entry system, including aerothermal, aerodynamic and atmosphere models, and thermal protection system (TPS) design. The instrumentation suite will be installed in the heatshield of the MSL entry vehicle. The acquired data will support future Mars entry and aerocapture missions by providing measured atmospheric data to validate Mars atmosphere models and clarify the design margins for future Mars missions. MEDLI thermocouple and recession sensor data will significantly improve the understanding of aeroheating and TPS performance uncertainties for future missions. MEDLI pressure data will permit more accurate trajectory reconstruction, as well as separation of aerodynamic and atmospheric uncertainties in the hypersonic and supersonic regimes. This paper provides an overview of the project including the instrumentation design, system architecture, and expected measurement response.
NASA Technical Reports Server (NTRS)
Gazarik, Michael J.; Little, Alan; Cheatwood, F. Neil; Wright, Michael J.; Herath, Jeff A.; Martinez, Edward R.; Munk, Michelle; Novak, Frank J.; Wright, Henry S.
2008-01-01
The Mars Science Laboratory Entry, Descent, and Landing Instrumentation (MEDLI) Project s objectives are to measure aerothermal environments, sub-surface heatshield material response, vehicle orientation, and atmospheric density for the atmospheric entry and descent phases of the Mars Science Laboratory (MSL) entry vehicle. The flight science objectives of MEDLI directly address the largest uncertainties in the ability to design and validate a robust Mars entry system, including aerothermal, aerodynamic and atmosphere models, and thermal protection system (TPS) design. The instrumentation suite will be installed in the heatshield of the MSL entry vehicle. The acquired data will support future Mars entry and aerocapture missions by providing measured atmospheric data to validate Mars atmosphere models and clarify the design margins for future Mars missions. MEDLI thermocouple and recession sensor data will significantly improve the understanding of aeroheating and TPS performance uncertainties for future missions. MEDLI pressure data will permit more accurate trajectory reconstruction, as well as separation of aerodynamic and atmospheric uncertainties in the hypersonic and supersonic regimes. This paper provides an overview of the project including the instrumentation design, system architecture, and expected measurement response.
NASA Technical Reports Server (NTRS)
Stramski, Dariusz; Stramska, Malgorzata; Starr, David OC. (Technical Monitor)
2002-01-01
The overall goal of this project was to validate and refine ocean color algorithms at high latitudes in the north polar region of the Atlantic. The specific objectives were defined as follows: (1) to identify and quantify errors in the satellite-derived water-leaving radiances and chlorophyll concentration; (2) to develop understanding of these errors; and (3) to improve in-water ocean color algorithms for retrieving chlorophyll concentration in the investigated region.
2014-09-01
Analysis Simulation for Advanced Tracking (TASAT) satellite modeling tool [8,9]. The method uses the bi-reflectance distribution functions ( BRDF ...directional Reflectance Model Validation and Utilization, Air Force Avionics Laboratory Technical Report, AFAL-TR-73-303, October 1973. [10] Hall, D...failing to comply with a collection of information if it does not display a currently valid OMB control number. 1. REPORT DATE SEP 2014 2. REPORT
The Canadian Experiment for Freeze/Thaw in 2012 or 2013 CanEx-FT12 or FT13
NASA Technical Reports Server (NTRS)
Belair, Stephane; Bernier, Monique; Colliander, Andreas; Jackson, Thomas; McDonald, Kyle; Walker, Anne
2011-01-01
General objectives of the experiment are: Pre-launch Calibration/Validation of SMAP Freeze/Thaw products and retrieval algorithms and rehearsal for Soil Moisture Active-Passive (SMAP) post launch validation. The basis of the radar freeze-thaw measurement is the large shift in dielectric constant and backscatter (dB) between predominantly frozen & thawed conditions. The Dielectric constant of liquid water varies with frequency, whereas that of pure ice is constant
2017-10-01
been shown in many studies to improve predictive accuracy for cancer on initial biopsy,3,7-9 and to be correlated with more aggressive cancer at...our multi-center, prospectively accrued prostate cancer active surveillance cohort – the Canary Prostate Active Surveillance Study (PASS). We are in...objective of the study is to utilize analytically validated assays that take into account tumor heterogeneity to measure biomarkers in specimens that were
Russell, Alexandra C; Stone, Amanda L; Wang, Andi; Walker, Lynn S
2018-06-01
The objective of this study was to develop a pediatric measure of chronic nausea severity, the Nausea Severity Scale (NSS), and evaluate its reliability and validity in youth with abdominal pain-related functional gastrointestinal disorders (AP-FGID). Pediatric patients (aged 11⁻17 years-old, n = 236) presenting to an outpatient clinic for evaluation of abdominal pain completed the NSS, Children's Somatization Inventory (CSI), Functional Disability Inventory (FDI), Abdominal Pain Index (API), Patient-Report Outcomes Measurement Information System (PROMIS), Anxiety and Depression Scales and the Pediatric Rome III Questionnaire for FGIDs. The NSS demonstrated good concurrent, discriminant, and construct validity, as well as good internal consistency. One-third (34%) of AP-FGID patients reported experiencing nausea "most" or "every day" in the previous two weeks. The severity of nausea was higher in females than males and correlated significantly with the severity of somatic symptoms, functional disability, anxiety, and depression. The NSS is a valid and reliable measure of nausea in children with AP-FGID.
Duncan, Dustin T; Aldstadt, Jared; Whalen, John; Melly, Steven J; Gortmaker, Steven L
2011-11-01
Neighborhood walkability can influence physical activity. We evaluated the validity of Walk Score(®) for assessing neighborhood walkability based on GIS (objective) indicators of neighborhood walkability with addresses from four US metropolitan areas with several street network buffer distances (i.e., 400-, 800-, and 1,600-meters). Address data come from the YMCA-Harvard After School Food and Fitness Project, an obesity prevention intervention involving children aged 5-11 years and their families participating in YMCA-administered, after-school programs located in four geographically diverse metropolitan areas in the US (n = 733). GIS data were used to measure multiple objective indicators of neighborhood walkability. Walk Scores were also obtained for the participant's residential addresses. Spearman correlations between Walk Scores and the GIS neighborhood walkability indicators were calculated as well as Spearman correlations accounting for spatial autocorrelation. There were many significant moderate correlations between Walk Scores and the GIS neighborhood walkability indicators such as density of retail destinations and intersection density (p < 0.05). The magnitude varied by the GIS indicator of neighborhood walkability. Correlations generally became stronger with a larger spatial scale, and there were some geographic differences. Walk Score(®) is free and publicly available for public health researchers and practitioners. Results from our study suggest that Walk Score(®) is a valid measure of estimating certain aspects of neighborhood walkability, particularly at the 1600-meter buffer. As such, our study confirms and extends the generalizability of previous findings demonstrating that Walk Score is a valid measure of estimating neighborhood walkability in multiple geographic locations and at multiple spatial scales.
Reviewing the psychometric properties of contemporary circadian typology measures.
Di Milia, Lee; Adan, Ana; Natale, Vincenzo; Randler, Christoph
2013-12-01
The accurate measurement of circadian typology (CT) is critical because the construct has implications for a number of health disorders. In this review, we focus on the evidence to support the reliability and validity of the more commonly used CT scales: the Morningness-Eveningness Questionnaire (MEQ), reduced Morningness-Eveningness Questionnaire (rMEQ), the Composite Scale of Morningness (CSM), and the Preferences Scale (PS). In addition, we also consider the Munich ChronoType Questionnaire (MCTQ). In terms of reliability, the MEQ, CSM, and PS consistently report high levels of reliability (>0.80), whereas the reliability of the rMEQ is satisfactory. The stability of these scales is sound at follow-up periods up to 13 mos. The MCTQ is not a scale; therefore, its reliability cannot be assessed. Although it is possible to determine the stability of the MCTQ, these data are yet to be reported. Validity must be given equal weight in assessing the measurement properties of CT instruments. Most commonly reported is convergent and construct validity. The MEQ, rMEQ, and CSM are highly correlated and this is to be expected, given that these scales share common items. The level of agreement between the MCTQ and the MEQ is satisfactory, but the correlation between these two constructs decreases in line with the number of "corrections" applied to the MCTQ. The interesting question is whether CT is best represented by a psychological preference for behavior or by using a biomarker such as sleep midpoint. Good-quality subjective and objective data suggest adequate construct validity for each of the CT instruments, but a major limitation of this literature is studies that assess the predictive validity of these instruments. We make a number of recommendations with the aim of advancing science. Future studies need to (1) focus on collecting data from representative samples that consider a number of environmental factors; (2) employ longitudinal designs to allow the predictive validity of CT measures to be assessed and preferably make use of objective data; (3) employ contemporary statistical approaches, including structural equation modeling and item-response models; and (4) provide better information concerning sample selection and a rationale for choosing cutoff points.
Human Caring in the Social Work Context: Continued Development and Validation of a Complex Measure
ERIC Educational Resources Information Center
Ellis, Jacquelyn I.; Ellett, Alberta J.; DeWeaver, Kevin
2007-01-01
Objectives: (a) to continue the development of a measure of human caring in the context of social work practice and (b) to expand a line of inquiry exploring the relationship between human caring characteristics and the retention of public child welfare workers. Methodology: Surveys were received from a sample (n = 786) child welfare workers in…
Evaluating Journal Quality: Is the H-Index a Better Measure than Impact Factors?
ERIC Educational Resources Information Center
Hodge, David R.; Lacasse, Jeffrey R.
2011-01-01
Objectives: This study evaluates the utility of a new measure--the h-index--that may provide a more valid approach to evaluating journal quality in the social work profession. Method: H-index values are compared with Thomson ISI 5-year impact factors and expert opinion. Results: As hypothesized, the h-index correlates highly with ISI 5-year impact…
Test de Français Laval-Montreal: Does It Measure What It Should Measure?
ERIC Educational Resources Information Center
Schmit, Romain; Saif, Shahrzad
2015-01-01
This article reports on a study conducted as part of a larger investigation of the predictive validity of the Test de Français Laval-Montreal (TFLM), a high-stakes French language test used for admission and placement purposes for Teacher-Training Programs (TTPs) in major francophone universities in Canada (Schmitt, 2015). The objective of this…
Validation of Greyscale-Based Quantitative Ultrasound in Manual Wheelchair Users
Collinger, Jennifer L.; Fullerton, Bradley; Impink, Bradley G.; Koontz, Alicia M.; Boninger, Michael L.
2010-01-01
Objective The primary aim of this study is to establish the validity of greyscale-based quantitative ultrasound (QUS) measures of the biceps and supraspinatus tendons. Design Nine QUS measures of the biceps and supraspinatus tendons were computed from ultrasound images collected from sixty-seven manual wheelchair users. Shoulder pathology was measured using questionnaires, physical examination maneuvers, and a clinical ultrasound grading scale. Results Increased age, duration of wheelchair use, and body mass correlated with a darker, more homogenous tendon appearance. Subjects with pain during physical examination tests for biceps tenderness and acromioclavicular joint tenderness exhibited significantly different supraspinatus QUS values. Even when controlling for tendon depth, QUS measures of the biceps tendon differed significantly between subjects with healthy tendons, mild tendinosis, and severe tendinosis. Clinical grading of supraspinatus tendon health was correlated with QUS measures of the supraspinatus tendon. Conclusions Quantitative ultrasound is valid method to quantify tendinopathy and may allow for early detection of tendinosis. Manual wheelchair users are at a high risk for developing shoulder tendon pathology and may benefit from quantitative ultrasound-based research that focuses on identifying interventions designed to reduce this risk. PMID:20407304
NASA Astrophysics Data System (ADS)
Studer, Stephan P.; Bucher, Andreas; Mueller, Felix
1993-09-01
The oral health of the Swiss population was significantly improved by the successful prevention of dental caries and periodontitis. Along with the healthy dentition the demand for aesthetic dentistry is increasing. Removable partial dentures are becoming less accepted. Therefore, to substitute lost teeth by permanent fixed partial prosthesis (bridges), the often deformed alveolar ridge has to be operated, either to improve the aesthetic appearance or to make it possible to restore the missing teeth by a fixed cemented bridge. The aim of this paper is (1) to evaluate whether the moire technique is an appropriate and handy method, and (2) to validate the precision of the new method. The measuring system consisted of a moire projector with an integrated phase shift device and a moire viewer with a CCD video camera, connected to a frame grabber in a personal computer. a highly versatile software was allowed to control the system as well as to grab the moire images using the four-phase shift technique in order to compute the phase image of the actual object. The new technique was validated with one solid test object measured by a 3D coordination, high precision measuring machine.
Astronomical Instrumentation Systems Quality Management Planning: AISQMP
NASA Astrophysics Data System (ADS)
Goldbaum, Jesse
2017-06-01
The capability of small aperture astronomical instrumentation systems (AIS) to make meaningful scientific contributions has never been better. The purpose of AIS quality management planning (AISQMP) is to ensure the quality of these contributions such that they are both valid and reliable. The first step involved with AISQMP is to specify objective quality measures not just for the AIS final product, but also for the instrumentation used in its production. The next step is to set up a process to track these measures and control for any unwanted variation. The final step is continual effort applied to reducing variation and obtaining measured values near optimal theoretical performance. This paper provides an overview of AISQMP while focusing on objective quality measures applied to astronomical imaging systems.
Astronomical Instrumentation Systems Quality Management Planning: AISQMP (Abstract)
NASA Astrophysics Data System (ADS)
Goldbaum, J.
2017-12-01
(Abstract only) The capability of small aperture astronomical instrumentation systems (AIS) to make meaningful scientific contributions has never been better. The purpose of AIS quality management planning (AISQMP) is to ensure the quality of these contributions such that they are both valid and reliable. The first step involved with AISQMP is to specify objective quality measures not just for the AIS final product, but also for the instrumentation used in its production. The next step is to set up a process to track these measures and control for any unwanted variation. The final step is continual effort applied to reducing variation and obtaining measured values near optimal theoretical performance. This paper provides an overview of AISQMP while focusing on objective quality measures applied to astronomical imaging systems.
Pohl, Rüdiger F; Michalkiewicz, Martha; Erdfelder, Edgar; Hilbig, Benjamin E
2017-07-01
According to the recognition-heuristic theory, decision makers solve paired comparisons in which one object is recognized and the other not by recognition alone, inferring that recognized objects have higher criterion values than unrecognized ones. However, success-and thus usefulness-of this heuristic depends on the validity of recognition as a cue, and adaptive decision making, in turn, requires that decision makers are sensitive to it. To this end, decision makers could base their evaluation of the recognition validity either on the selected set of objects (the set's recognition validity), or on the underlying domain from which the objects were drawn (the domain's recognition validity). In two experiments, we manipulated the recognition validity both in the selected set of objects and between domains from which the sets were drawn. The results clearly show that use of the recognition heuristic depends on the domain's recognition validity, not on the set's recognition validity. In other words, participants treat all sets as roughly representative of the underlying domain and adjust their decision strategy adaptively (only) with respect to the more general environment rather than the specific items they are faced with.
Vahedi, Shahram; Farrokhi, Farahman
2011-01-01
Objective The aim of this study is to explore the confirmatory factor analysis results of the Persian adaptation of Statistics Anxiety Measure (SAM), proposed by Earp. Method The validity and reliability assessments of the scale were performed on 298 college students chosen randomly from Tabriz University in Iran. Confirmatory factor analysis (CFA) was carried out to determine the factor structures of the Persian adaptation of SAM. Results As expected, the second order model provided a better fit to the data than the three alternative models. Conclusions Hence, SAM provides an equally valid measure for use among college students. The study both expands and adds support to the existing body of math anxiety literature. PMID:22952530
Heller, Aaron S.; Greischar, Lawrence L; Honor, Ann; Anderle, Michael J; Davidson, Richard J.
2011-01-01
The development of functional neuroimaging of emotion holds the promise to enhance our understanding of the biological bases of affect and improve our knowledge of psychiatric diseases. However, up to this point, researchers have been unable to objectively, continuously and unobtrusively measure the intensity and dynamics of affect concurrently with functional magnetic resonance imaging (fMRI). This has hindered the development and generalizability of our field. Facial electromyography (EMG) is an objective, reliable, valid, sensitive, and unobtrusive measure of emotion. Here, we report the successful development of a method for simultaneously acquiring fMRI and facial EMG. The ability to simultaneously acquire brain activity and facial physiology will allow affective neuroscientists to address theoretical, psychiatric, and individual difference questions in a more rigorous and generalizable way. PMID:21742043
Validation of time to task performance assessment method in simulation: A comparative design study.
Shinnick, Mary Ann; Woo, Mary A
2018-05-01
There is a lack of objective and valid measures for assessing nursing clinical competence which could adversely impact patient safety. Therefore, we evaluated an objective assessment of clinical competence, Time to Task (ability to perform specific, critical nursing care activities within 5 min), and compared it to two subjective measures, (Lasater Clinical Judgement Rubric [LCJR] and common "pass/fail" assessment). Using a prospective, "Known Groups" (Expert vs. Novice nurses) comparative design, Expert nurses (ICU nurses with >5 years of ICU experience) and Novice nurses (senior prelicensure nursing students) participated individually in a simulation of a patient in decompensated heart failure. Fourteen nursing instructors or preceptors, blinded to group assignment, reviewed 28 simulation videos (15 Expert and 13 Novice) and scored them using the LCJR and pass/fail assessments. Time to Task assessment was scored based on time thresholds for specific nursing actions prospectively set by an expert clinical panel. Statistical analysis consisted of Medians Test and sensitivity and specificity analyses. The LCJR total score was significantly different between Experts and Novices (p < 0.01) and revealed adequate sensitivity (ability to correctly identify "Expert" nurses; 0.72) but had a low specificity (ability to correctly identify "Novice" nurses; 0.40). For the subjective measure 'pass/fail', sensitivity was high (0.90) but specificity was low (0.47). The Time to Task measure had statistical significance between Expert and Novice groups (p < 0.01) and sensitivity (0.80) and specificity (0.85) were good. Commonly used subjective measures of clinical nursing competence have difficulties with achieving acceptable specificity. However, an objective measure, Time to Task, had good sensitivity and specificity in differentiating between groups. While more than one assessment instrument should be used to determine nurse competency, an objective measure, such as Time to Task, warrants further study. Copyright © 2018 Elsevier Ltd. All rights reserved.
Automated Measurement of Facial Expression in Infant-Mother Interaction: A Pilot Study
Messinger, Daniel S.; Mahoor, Mohammad H.; Chow, Sy-Miin; Cohn, Jeffrey F.
2009-01-01
Automated facial measurement using computer vision has the potential to objectively document continuous changes in behavior. To examine emotional expression and communication, we used automated measurements to quantify smile strength, eye constriction, and mouth opening in two six-month-old/mother dyads who each engaged in a face-to-face interaction. Automated measurements showed high associations with anatomically based manual coding (concurrent validity); measurements of smiling showed high associations with mean ratings of positive emotion made by naive observers (construct validity). For both infants and mothers, smile strength and eye constriction (the Duchenne marker) were correlated over time, creating a continuous index of smile intensity. Infant and mother smile activity exhibited changing (nonstationary) local patterns of association, suggesting the dyadic repair and dissolution of states of affective synchrony. The study provides insights into the potential and limitations of automated measurement of facial action. PMID:19885384
Aabenhus, Rune; Thorsen, Hanne; Siersma, Volkert; Brodersen, John
2013-01-01
Patient-reported outcomes are seldom validated measures in clinical trials of acute respiratory tract infections (ARTIs) in primary care. We developed and validated a patient-reported outcome sum-scaling measure to assess the severity and functional impacts of ARTIs. Qualitative interviews and field testing among adults with an ARTI were conducted to ascertain a high degree of face and content validity of the questionnaire. Subsequently, a draft version of the Acute Respiratory Tract Infection Questionnaire (ARTIQ) was statistically validated by using the partial credit Rasch model to test dimensionality, objectivity, and reliability of items. Test of known groups' validity was conducted by comparing participants with and without an ARTI. The final version of the ARTIQ consisted of 38 items covering five dimensions (Physical-upper, Physical-lower, Psychological, Sleep, and Medicine) and five single items. All final dimensions were confirmed to fit the Rasch model, thus enabling sum-scaling of responses. The ARTIQ scores in participants with an ARTI were significantly higher than in those without ARTI (known groups' validity). A self-administered, multidimensional, sum-scaling questionnaire with high face and content validity and adequate psychometric properties for assessing severity and functional impacts from ARTIs in adults is available to clinical trials and audits in primary care. Copyright © 2013, International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc.
The French-Canadian validation of a disease-specific, patient-reported outcome measure for lupus.
Bourré-Tessier, J; Clarke, A E; Kosinski, M; Mikolaitis-Preuss, R A; Bernatsky, S; Block, J A; Jolly, M
2014-12-01
The objective of this paper is to perform the cross-cultural validation of the French version of the LupusPRO, a disease-targeted patient-reported outcome measure, among systemic lupus erythematosus (SLE) patients in Canada. The French version of the LupusPRO and the MOS SF-36 were administered; demographic, clinical and serological characteristics were obtained. Disease activity (SELENA-SLEDAI and the Lupus Foundation of America definition of flare) and damage (SLICC/ACR SDI) were assessed. Physician disease activity and damage assessments were ascertained using visual analog scales. Internal consistency reliability (ICR), test-retest reliability (TRT), convergent and discriminant validity (against corresponding domains of the SF-36), criterion validity (against disease activity, damage or health status) and known group validity were tested. A total of 99 French-Canadian SLE patients participated (97% women, mean (SD) age 45.2 (14.5) years). The median (IQR) SELENA-SLEDAI and SDI were 3.5 (6.0) and 1.0 (2.0), respectively. The ICR of the LupusPRO domains ranged from 0.81 to 0.93 (except for lupus symptoms, procreation and coping), while TRT ranged from 0.72 to 0.95. Convergent and discriminant validity, criterion validity and known group validity against disease activity, damage and health status measures were observed. Confirmatory factor analysis showed a good fit. The LupusPRO has fair psychometric properties among French-Canadian patients with SLE. © The Author(s) 2014 Reprints and permissions: sagepub.co.uk/journalsPermissions.nav.
Real-time reliability measure-driven multi-hypothesis tracking using 2D and 3D features
NASA Astrophysics Data System (ADS)
Zúñiga, Marcos D.; Brémond, François; Thonnat, Monique
2011-12-01
We propose a new multi-target tracking approach, which is able to reliably track multiple objects even with poor segmentation results due to noisy environments. The approach takes advantage of a new dual object model combining 2D and 3D features through reliability measures. In order to obtain these 3D features, a new classifier associates an object class label to each moving region (e.g. person, vehicle), a parallelepiped model and visual reliability measures of its attributes. These reliability measures allow to properly weight the contribution of noisy, erroneous or false data in order to better maintain the integrity of the object dynamics model. Then, a new multi-target tracking algorithm uses these object descriptions to generate tracking hypotheses about the objects moving in the scene. This tracking approach is able to manage many-to-many visual target correspondences. For achieving this characteristic, the algorithm takes advantage of 3D models for merging dissociated visual evidence (moving regions) potentially corresponding to the same real object, according to previously obtained information. The tracking approach has been validated using video surveillance benchmarks publicly accessible. The obtained performance is real time and the results are competitive compared with other tracking algorithms, with minimal (or null) reconfiguration effort between different videos.
Land surface temperature measurements from EOS MODIS data
NASA Technical Reports Server (NTRS)
Wan, Zhengming
1993-01-01
The task objectives of this reporting phase included: (1) completing the draft of the LST Algorithms Theoretical Basic Document by July 30, 1993; (2) making a detailed characterization of the thermal infrared measurement system including spectrometer, blackbody, and radiation sources; (3) making TIR spectral measurements of water and snow-cover surfaces with the MIDAC M2401 spectrometer; and (4) making conceptual and engineering design of an accessory system for spectrometric measurements at variable angles. These objectives are based on the requirements by the MODIS Science Team and the unique challenge in the development of MODIS LST algorithms: to acquire accurate spectral emissivity data of land covers in the near-term and to make ground validations of the LST product in the long-term with a TIR measurement system.
Collection of LAI and FPAR Data Over The Terra Core Sites
NASA Technical Reports Server (NTRS)
Myneni, Ranga B.; Knjazihhin, J.; Tian, Y.; Wang, Y.
2001-01-01
The objective of our effort was to collect and archive data on LAI (leaf area index) and FPAR (Fraction of Photosynthetically active Radiation absorbed by vegetation) at the EOS Core validation sites as well as to validate and evaluate global fields of LAI and FPAR derived from atmospherically corrected MODIS (Moderate Resolution Imaging Spectrometer) surface reflectance data by comparing these fields with the EOS Core validation data set. The above has been accomplished by: (a) the participation in selected field campaigns within the EOS Validation Program; (b) the processing of the collected data so that suitable comparison between field measurements and the MODIS LAI/FPAR fields can be made; (c) the comparison of the MODAS LAI/FRAM fields with the EOS Terra Core validation data set.
Measuring episodic memory across the lifespan: NIH Toolbox Picture Sequence Memory Test.
Dikmen, Sureyya S; Bauer, Patricia J; Weintraub, Sandra; Mungas, Dan; Slotkin, Jerry; Beaumont, Jennifer L; Gershon, Richard; Temkin, Nancy R; Heaton, Robert K
2014-07-01
Episodic memory is one of the most important cognitive domains that involves acquiring, storing and recalling new information. In this article, we describe a new measure developed for the NIH Toolbox, called the Picture Sequence Memory Test (PSMT) that is the first to examine episodic memory across the age range from 3 to 85. We describe the development of the measure and present validation data for ages 20 to 85. The PSMT involves presentation of sequences of pictured objects and activities in a fixed order on a computer screen and simultaneously verbally described, that the participant must remember and then reproduce over three learning trials. The results indicate good test-retest reliability and construct validity. Performance is strongly related to well-established "gold standard" measures of episodic memory and, as expected, much less well correlated with those of a measure of vocabulary. It shows clear decline with aging in parallel with a gold standard summary measure and relates to several other demographic factors and to self-reported general health status. The PSMT appears to be a reliable and valid test of episodic memory for adults, a finding similar to those found for the same measure with children.
Validity of a New Patient Engagement Measure: The Altarum Consumer Engagement (ACE) Measure.
Duke, Christopher C; Lynch, Wendy D; Smith, Brad; Winstanley, Julie
2015-12-01
The objective of this study was to report on the validation of new scales [called the Altarum Consumer Engagement (ACE) Measure] that are indicative of an individual's engagement in health and healthcare decisions. The instrument was created to broaden the scope of how engagement is measured and understood, and to update the concept of engagement to include modern information sources, such as online health resources and ratings of providers and patient health. Data were collected through an online survey with a US population of 2079 participants. A combination of Principal Component Analysis (PCA) and detailed Rasch analyses were conducted to identify specific subscales of engagement. Results were compared to another commonly used survey instrument, and outcomes were compared for construct validity. The PCA identified a four-factor structure composed of 21 items. The factors were named Commitment, Informed Choice, Navigation, and Ownership. Rasch analyses confirmed scale stability. Relevant outcomes were correlated in the expected direction, such as health status, lifestyle behaviors, medication adherence, and observed expected group differences. This study confirmed the validity of the new ACE Measure and its utility in screening for and finding group differences in activities related to patient engagement and health consumerism, such as using provider comparison tools and asking about medical costs.
Slip resistance of winter footwear on snow and ice measured using maximum achievable incline.
Hsu, Jennifer; Shaw, Robert; Novak, Alison; Li, Yue; Ormerod, Marcus; Newton, Rita; Dutta, Tilak; Fernie, Geoff
2016-05-01
Protective footwear is necessary for preventing injurious slips and falls in winter conditions. Valid methods for assessing footwear slip resistance on winter surfaces are needed in order to evaluate footwear and outsole designs. The purpose of this study was to utilise a method of testing winter footwear that was ecologically valid in terms of involving actual human testers walking on realistic winter surfaces to produce objective measures of slip resistance. During the experiment, eight participants tested six styles of footwear on wet ice, on dry ice, and on dry ice after walking over soft snow. Slip resistance was measured by determining the maximum incline angles participants were able to walk up and down in each footwear-surface combination. The results indicated that testing on a variety of surfaces is necessary for establishing winter footwear performance and that standard mechanical bench tests for footwear slip resistance do not adequately reflect actual performance. Practitioner Summary: Existing standardised methods for measuring footwear slip resistance lack validation on winter surfaces. By determining the maximum inclines participants could walk up and down slopes of wet ice, dry ice, and ice with snow, in a range of footwear, an ecologically valid test for measuring winter footwear performance was established.
Slip resistance of winter footwear on snow and ice measured using maximum achievable incline
Hsu, Jennifer; Shaw, Robert; Novak, Alison; Li, Yue; Ormerod, Marcus; Newton, Rita; Dutta, Tilak; Fernie, Geoff
2016-01-01
Abstract Protective footwear is necessary for preventing injurious slips and falls in winter conditions. Valid methods for assessing footwear slip resistance on winter surfaces are needed in order to evaluate footwear and outsole designs. The purpose of this study was to utilise a method of testing winter footwear that was ecologically valid in terms of involving actual human testers walking on realistic winter surfaces to produce objective measures of slip resistance. During the experiment, eight participants tested six styles of footwear on wet ice, on dry ice, and on dry ice after walking over soft snow. Slip resistance was measured by determining the maximum incline angles participants were able to walk up and down in each footwear–surface combination. The results indicated that testing on a variety of surfaces is necessary for establishing winter footwear performance and that standard mechanical bench tests for footwear slip resistance do not adequately reflect actual performance. Practitioner Summary: Existing standardised methods for measuring footwear slip resistance lack validation on winter surfaces. By determining the maximum inclines participants could walk up and down slopes of wet ice, dry ice, and ice with snow, in a range of footwear, an ecologically valid test for measuring winter footwear performance was established. PMID:26555738
Validation of a psychometric instrument to assess motivation in veterinary bachelor students.
Vandeweerd, Jean-Michel; Dugdale, Alexandra; Romainville, Marc
2014-01-01
There are indications that motivation correlates with better performance for those studying veterinary medicine. To assess objectively whether motivation profiles influence both veterinary students' attitudes towards educational interventions and their academic success and whether changes in curriculum can affect students' motivation, there is need for an instrument that can provide a valid measurement of the strength of motivation for the study of veterinary medicine. Our objectives were to design and validate a questionnaire that can be used as a psychometric scale to capture the motivation profiles of veterinary students. Question items were obtained from semi-structured interviews with students and from a review of the relevant literature. Each item was scored on a 5-point scale. The preliminary instrument was trialed on a cohort of 450 students. Responses were subjected to reliability and principal component analysis. A 14-item scale was designed, within which two factors explained 53.4% of the variance among the items. The scale had good face, content, and construct validities as well as a good internal consistency (Cronbach's alpha=.88).
Merghati-Khoei, E; Maasoumi, R; Rahdari, F; Bayat, A; Hajmirzaei, S; Lotfi, S; Hajiaghababaei, M; Emami-Razavi, SH; Korte, JE; Atoof, F
2016-01-01
Study design This is a cross-sectional study Objectives The objective of this study was to examine the psychometric properties of the Sexual Adjustment Questionnaire (SAQ) for Iranian people with spinal cord injury Setting This study was conducted in the brain and Spinal Cord Injury Research Center, Tehran University of Medical Sciences, Tehran, Iran Methods We assessed the psychometric properties of the SAQ, with 200 participants (men = 146, women = 54) completing the scale. An evaluation of its test–retest reliability was performed over a 2-weeks period, on a subsample of 30 patients recruited from the overall group. Cronbach’s α-coefficient was computed for assessment of internal consistency reliability. In addition, content and face validity were examined by an expert committee. Construct validity was assessed by examining convergent and discriminant validity. Finally, exploratory factor analysis was used to extract the factor structure of the questionnaire. Results The Cronbach’s α and intraclass correlation coefficient were 0.77 and 0.72 retrospectively. With regard to construct validity, there was a significant (P = 0.009) negative correlation (r = − 0.28) between the SAQ score and age. Those with lower levels of educations scored significantly lower on the SAQ (P = 0.04). The exploratory factor analysis indicated a four-factor structure for the questionnaire, accounting for 68.9% of the observed variance. The expert committee approved the face and content validity of the developed measure. Conclusion The SAQ is a valid measure for assessing sexual adjustment in people with spinal cord injury. The evaluation of sexual well-being may be useful in clinical trials and practical settings. PMID:25917953
Neto, Jose Osni Bruggemann; Gesser, Rafael Lehmkuhl; Steglich, Valdir; Bonilauri Ferreira, Ana Paula; Gandhi, Mihir; Vissoci, João Ricardo Nickenig; Pietrobon, Ricardo
2013-01-01
The validation of widely used scales facilitates the comparison across international patient samples. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. The Simple Shoulder Test was translated from English into Brazilian Portuguese, translated back into English, and evaluated for accuracy by an expert committee. It was then administered to 100 patients with shoulder conditions. Psychometric properties were analyzed including factor analysis, internal reliability, test-retest reliability at seven days, and construct validity in relation to the Short Form 36 health survey (SF-36). Factor analysis demonstrated a three factor solution. Cronbach's alpha was 0.82. Test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.84. Associations were observed in the hypothesized direction with all subscales of SF-36 questionnaire. The Simple Shoulder Test translation and cultural adaptation to Brazilian-Portuguese demonstrated adequate factor structure, internal reliability, and validity, ultimately allowing for its use in the comparison with international patient samples.
NASA Astrophysics Data System (ADS)
Percoco, Gianluca; Sánchez Salmerón, Antonio J.
2015-09-01
The measurement of millimetre and micro-scale features is performed by high-cost systems based on technologies with narrow working ranges to accurately control the position of the sensors. Photogrammetry would lower the costs of 3D inspection of micro-features and would be applicable to the inspection of non-removable micro parts of large objects too. Unfortunately, the behaviour of photogrammetry is not known when photogrammetry is applied to micro-features. In this paper, the authors address these issues towards the application of digital close-range photogrammetry (DCRP) to the micro-scale, taking into account that in literature there are research papers stating that an angle of view (AOV) around 10° is the lower limit to the application of the traditional pinhole close-range calibration model (CRCM), which is the basis of DCRP. At first a general calibration procedure is introduced, with the aid of an open-source software library, to calibrate narrow AOV cameras with the CRCM. Subsequently the procedure is validated using a reflex camera with a 60 mm macro lens, equipped with extension tubes (20 and 32 mm) achieving magnification of up to 2 times approximately, to verify literature findings with experimental photogrammetric 3D measurements of millimetre-sized objects with micro-features. The limitation experienced by the laser printing technology, used to produce the bi-dimensional pattern on common paper, has been overcome using an accurate pattern manufactured with a photolithographic process. The results of the experimental activity prove that the CRCM is valid for AOVs down to 3.4° and that DCRP results are comparable with the results of existing and more expensive commercial techniques.
Rachakonda, Tara; Jeffe, Donna B.; Shin, Jennifer J.; Mankarious, Leila; Fanning, Robert J.; Lesperance, Marci M.; Lieu, Judith E.C.
2014-01-01
Objectives The prevalence of hearing loss (HL) in adolescents has grown over the past decade, but hearing-related quality of life (QOL) has not been well-measured. We sought to develop a reliable, valid measure of hearing-related QOL for adolescents, the Hearing Environments And Reflection on Quality of Life (HEAR-QL). Study Design Multi-site observational study. Methods Adolescents with HL and siblings without HL were recruited from five centers. Participants completed the HEAR-QL and validated questionnaires measuring generic pediatric QOL (PedsQL), depression and anxiety (RCADS-25), and hearing-related QOL for adults (HHIA) to determine construct and discriminant validity. Participants completed the HEAR-QL two weeks later for test-retest reliability. We used exploratory principal components analysis to determine the HEAR-QL factor structure and measured reliability. Sensitivity and specificity of the HEAR-QL, PedsQL, HHIA and RCADS-25 were assessed. We compared scores on all surveys between those with normal hearing, unilateral and bilateral HL. Results 233 adolescents (13–18 years old) participated—179 with HL, 54 without HL. The original 45-item HEAR-QL was shortened to 28 items after determining factor structure. The resulting HEAR-QL-28 demonstrated excellent reliability (Cronbach’s alpha= 0.95) and construct validity (HHIA: r =.845, PedsQL: r =.587; RCADS-25: r =.433). The HEAR-QL-28 displayed excellent discriminant validity, with higher area under the curve (0.932) than the PedsQL (0.597) or RCADS-25 (0.529). Teens with bilateral HL using hearing devices reported worse QOL on the HEAR-QL and HHIA than peers with HL not using devices. Conclusions The HEAR-QL is a sensitive, reliable and valid measure of hearing-related QOL for adolescents. PMID:23900836
Meltzer, Lisa J.; Brimeyer, Chasity; Russell, Kathryn; Avis, Kristin T.; Biggs, Sarah; Reynolds, Amy C.; Crabtree, Valerie McLaughlin
2014-01-01
Objective Sleep is critical for adolescent health and well-being. However, there are a limited number of validated self-report measures of sleep for adolescents, and no well-validated measures of sleep that can be used across middle childhood and adolescence. The Children's Report of Sleep Patterns (CRSP) has already been validated in children ages 8-12 years. The purpose of this study was to examine the psychometric properties of the CRSP as a multidimensional, self-report sleep measure for adolescents. Methods Participants included 570 adolescents aged 13 – 18 years, 60% female, recruited from pediatricians’ offices, sleep clinics, children's hospitals, schools, and the general population. A multi-method, multi-reporter approach was used to validate the CRSP. Along with the CRSP, a subset of the sample completed the Adolescent Sleep Hygiene Scale (ASHS), with a different subset of adolescents undergoing polysomnography. Results The CRSP demonstrated good reliability and validity. Group differences on the CRSP were found for adolescents presenting to a sleep or medical clinic (vs. community sample), for older adolescents (vs. younger adolescents), those who regularly napped (vs. infrequently napped), and those with poor sleep quality (vs. good sleep quality). Self-reported sleep quality in adolescents was also associated with higher apnea-hypopnea index scores from polysomnography. Finally, the CRSP Sleep Hygiene Indices were significantly correlated with indices of the ASHS. Conclusions The CRSP is a valid and reliable measure of adolescent sleep hygiene and sleep disturbances. With a parallel version for middle childhood (8-12 years), the CRSP likely provides clinicians and researchers the ability to measure self-reported sleep across development. PMID:25441749
Psychometric Evaluation of the PSQI in U.S. College Students
Dietch, Jessica R.; Taylor, Daniel J.; Sethi, Kevin; Kelly, Kimberly; Bramoweth, Adam D.; Roane, Brandy M.
2016-01-01
Study Objectives: Examine the psychometric properties of the PSQI in two U.S. college samples. Methods: Study I assessed convergent and divergent validity in 866 undergraduates who completed a sleep diary, PSQI, and other sleep and psychosocial measures. Study II assessed PSQI insomnia diagnostic accuracy in a separate sample of 147 healthy undergraduates with and without insomnia. Results: The PSQI global score had only moderate convergent validity with sleep diary sleep efficiency (prospective global measure of sleep continuity; r = 0.53), the Insomnia Severity Index (r = 0.63), and fatigue (r = 0.44). The PSQI global score demonstrated good divergent validity with measures of excessive daytime sleepiness (r = 0.18), circadian preference (r = −0.08), alcohol (r = 0.08) and marijuana (r = 0.05) abuse scales, and poor divergent validity with depression (r = 0.48), anxiety (r = 0.40), and perceived stress (r = 0.33). Examination of other analogous PSQI and sleep diary components showed low to moderate convergent validity: sleep latency (r = 0.70), wake after sleep onset (r = 0.37), sleep duration (r = 0.51), and sleep efficiency (r = −0.32). Diagnostic accuracy of the PSQI to detect insomnia was very high (area under the curve = 0.999). Sensitivity and specificity were maximized at a cutoff of 6. Conclusions: The PSQI demonstrated moderate convergent validity compared to measures of insomnia and fatigue and good divergent validity with measures of daytime sleepiness, circadian phase preference, and alcohol and marijuana use. The PSQI demonstrated considerable overlap with depression, anxiety, and perceived stress. Therefore, caution should be used with interpretation. Citation: Dietch JR, Taylor DJ, Sethi K, Kelly K, Bramoweth AD, Roane BM. Psychometric evaluation of the PSQI in U.S. college students. J Clin Sleep Med 2016;12(8):1121–1129. PMID:27166299
Updating the OMERACT Filter: Implications for imaging and soluble biomarkers
D’Agostino, Maria-Antonietta; Boers, Maarten; Kirwan, John; van der Heijde, Desirée; Østergaard, Mikkel; Schett, Georg; Landewé, Robert B.M.; Maksymowych, Walter P.; Naredo, Esperanza; Dougados, Maxime; Iagnocco, Annamaria; Bingham, Clifton O.; Brooks, Peter; Beaton, Dorcas; Gandjbakhch, Frederique; Gossec, Laure; Guillemin, Francis; Hewlett, Sarah; Kloppenburg, Margreet; March, Lyn; Mease, Philip J; Moller, Ingrid; Simon, Lee S; Singh, Jasvinder A; Strand, Vibeke; Wakefield, Richard J; Wells, George; Tugwell, Peter; Conaghan, Philip G
2014-01-01
Objective The OMERACT Filter provides a framework for the validation of outcome measures for use in rheumatology clinical research. However, imaging and biochemical measures may face additional validation challenges due to their technical nature. The Imaging and Soluble Biomarker Session at OMERACT 11 aimed to provide a guide for the iterative development of an imaging or biochemical measurement instrument so it can be used in therapeutic assessment. Methods A hierarchical structure was proposed, reflecting 3 dimensions needed for validating an imaging or biochemical measurement instrument: outcome domain(s), study setting and performance of the instrument. Movement along the axes in any dimension reflects increasing validation. For a given test instrument, the 3-axis structure assesses the extent to which the instrument is a validated measure for the chosen domain, whether it assesses a patient or disease centred-variable, and whether its technical performance is adequate in the context of its application. Some currently used imaging and soluble biomarkers for rheumatoid arthritis, spondyloarthritis and knee osteoarthritis were then evaluated using the original OMERACT filter and the newly proposed structure. Break-out groups critically reviewed the extent to which the candidate biomarkers complied with the proposed step-wise approach, as a way of examining the utility of the proposed 3 dimensional structure. Results Although there was a broad acceptance of the value of the proposed structure in general, some areas for improvement were suggested including clarification of criteria for achieving a certain level of validation and how to deal with extension of the structure to areas beyond clinical trials. Conclusion General support was obtained for a proposed tri-axis structure to assess validation of imaging and soluble biomarkers; nevertheless, additional work is required to better evaluate its place within the OMERACT Filter 2.0. PMID:24584916
O'Neil, Margaret E; Fragala-Pinkham, Maria; Lennon, Nancy; George, Ameeka; Forman, Jeffrey; Trost, Stewart G
2016-01-01
Physical therapy for youth with cerebral palsy (CP) who are ambulatory includes interventions to increase functional mobility and participation in physical activity (PA). Thus, reliable and valid measures are needed to document PA in youth with CP. The purpose of this study was to evaluate the inter-instrument reliability and concurrent validity of 3 accelerometer-based motion sensors with indirect calorimetry as the criterion for measuring PA intensity in youth with CP. Fifty-seven youth with CP (mean age=12.5 years, SD=3.3; 51% female; 49.1% with spastic hemiplegia) participated. Inclusion criteria were: aged 6 to 20 years, ambulatory, Gross Motor Function Classification System (GMFCS) levels I through III, able to follow directions, and able to complete the full PA protocol. Protocol activities included standardized activity trials with increasing PA intensity (resting, writing, household chores, active video games, and walking at 3 self-selected speeds), as measured by weight-relative oxygen uptake (in mL/kg/min). During each trial, participants wore bilateral accelerometers on the upper arms, waist/hip, and ankle and a portable indirect calorimeter. Intraclass coefficient correlations (ICCs) were calculated to evaluate inter-instrument reliability (left-to-right accelerometer placement). Spearman correlations were used to examine concurrent validity between accelerometer output (activity and step counts) and indirect calorimetry. Friedman analyses of variance with post hoc pair-wise analyses were conducted to examine the validity of accelerometers to discriminate PA intensity across activity trials. All accelerometers exhibited excellent inter-instrument reliability (ICC=.94-.99) and good concurrent validity (rho=.70-.85). All accelerometers discriminated PA intensity across most activity trials. This PA protocol consisted of controlled activity trials. Accelerometers provide valid and reliable measures of PA intensity among youth with CP. © 2016 American Physical Therapy Association.
Use of LiDAR to Assist in Delineating Waters of the United States, Including Wetlands
2014-03-01
investigator’s objective. For example, if the sole objective is to identify geomorphic breaks in slope associated with the OHWM, points representing vegetation... geomorphic position. During the data-gathering stage of wetland delinea- tions, measurements made using LiDAR data should be considered esti- mates...field. Field validation of LiDAR topographic data is essential before using them as evidence of a secondary hydrology indicator, such as geomorphic
2017-09-01
interactive video game regardless of ambulatory status. The objective of this project is to produce a trial ready outcome measure that will enable clinical...custom-designed video game using the Microsoft Kinect camera, measures functional reaching volume (FRV) across the spectrum of the disease in DMD...Kinect, video game , clinical trial readiness, neuromuscular disease, Soliton, functional reaching volume 3. ACCOMPLISHMENTS: The PI is reminded
NASA Technical Reports Server (NTRS)
Chin, Alexander; Herrera, Claudia; Spivey, Natalie; Fladung, William; Cloutier, David
2015-01-01
This presentation describes the DIM method and how it measures the inertia properties of an object by analyzing the frequency response functions measured during a ground vibration test (GVT). The DIM method has been in development at the University of Cincinnati and has shown success on a variety of small scale test articles. The NASA AFRC version was modified for larger applications.
Steele, Catriona M.; Namasivayam-MacDonald, Ashwini M.; Guida, Brittany T.; Cichero, Julie A.; Duivestein, Janice; MRSc; Hanson, Ben; Lam, Peter; Riquelme, Luis F.
2018-01-01
Objective To assess consensual validity, interrater reliability, and criterion validity of the International Dysphagia Diet Standardisation Initiative Functional Diet Scale, a new functional outcome scale intended to capture the severity of oropharyngeal dysphagia, as represented by the degree of diet texture restriction recommended for the patient. Design Participants assigned International Dysphagia Diet Standardisation Initiative Functional Diet Scale scores to 16 clinical cases. Consensual validity was measured against reference scores determined by an author reference panel. Interrater reliability was measured overall and across quartile subsets of the dataset. Criterion validity was evaluated versus Functional Oral Intake Scale (FOIS) scores assigned by survey respondents to the same case scenarios. Feedback was requested regarding ease and likelihood of use. Setting Web-based survey. Participants Respondents (NZ170) from 29 countries. Interventions Not applicable. Main Outcome Measures Consensual validity (percent agreement and Kendall t), criterion validity (Spearman rank correlation), and interrater reliability (Kendall concordance and intraclass coefficients). Results The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed strong consensual validity, criterion validity, and interrater reliability. Scenarios involving liquid-only diets, transition from nonoral feeding, or trial diet advances in therapy showed the poorest consensus, indicating a need for clear instructions on how to score these situations. The International Dysphagia Diet Standardisation Initiative Functional Diet Scale showed greater sensitivity than the FOIS to specific changes in diet. Most (>70%) respondents indicated enthusiasm for implementing the International Dysphagia Diet Standardisation Initiative Functional Diet Scale. Conclusions This initial validation study suggests that the International Dysphagia Diet Standardisation Initiative Functional Diet Scale has strong consensual and criterion validity and can be used reliably by clinicians to capture diet texture restriction and progression in people with dysphagia. PMID:29428348
Development and validation of the Perceived Game-Specific Soccer Competence Scale.
Forsman, Hannele; Gråstén, Arto; Blomqvist, Minna; Davids, Keith; Liukkonen, Jarmo; Konttinen, Niilo
2016-07-01
The objective of this study was to create a valid, self-reported, game-specific soccer competence scale. A structural model of perceived competence, performance measures and motivation was tested as the basis for the scale. A total of 1321 soccer players (261 females, 1060 males) ranging from 12 to 15 years (13.4 ± 1.0 years) participated in the study. They completed the Perceived Game-Specific Soccer Competence Scale (PGSSCS), self-assessments of tactical skills and motivation, as well as technical and speed and agility tests. Results of factor analyses, tests of internal consistency and correlations between PGSSCS subscales, performance measures and motivation supported the reliability and validity of the PGSSCS. The scale can be considered a suitable instrument to assess perceived game-specific competence among young soccer players.
Measurement in Sensory Modulation: The Sensory Processing Scale Assessment
Miller, Lucy J.; Sullivan, Jillian C.
2014-01-01
OBJECTIVE. Sensory modulation issues have a significant impact on participation in daily life. Moreover, understanding phenotypic variation in sensory modulation dysfunction is crucial for research related to defining homogeneous groups and for clinical work in guiding treatment planning. We thus evaluated the new Sensory Processing Scale (SPS) Assessment. METHOD. Research included item development, behavioral scoring system development, test administration, and item analyses to evaluate reliability and validity across sensory domains. RESULTS. Items with adequate reliability (internal reliability >.4) and discriminant validity (p < .01) were retained. Feedback from the expert panel also contributed to decisions about retaining items in the scale. CONCLUSION. The SPS Assessment appears to be a reliable and valid measure of sensory modulation (scale reliability >.90; discrimination between group effect sizes >1.00). This scale has the potential to aid in differential diagnosis of sensory modulation issues. PMID:25184464
An international measure of awareness and beliefs about cancer: development and testing of the ABC
Simon, Alice E; Forbes, Lindsay J L; Boniface, David; Warburton, Fiona; Brain, Kate E; Dessaix, Anita; Donnelly, Michael; Haynes, Kerry; Hvidberg, Line; Lagerlund, Magdalena; Petermann, Lisa; Tishelman, Carol; Vedsted, Peter; Vigmostad, Maria Nyre; Wardle, Jane; Ramirez, Amanda J
2012-01-01
Objectives To develop an internationally validated measure of cancer awareness and beliefs; the awareness and beliefs about cancer (ABC) measure. Design and setting Items modified from existing measures were assessed by a working group in six countries (Australia, Canada, Denmark, Norway, Sweden and the UK). Validation studies were completed in the UK, and cross-sectional surveys of the general population were carried out in the six participating countries. Participants Testing in UK English included cognitive interviewing for face validity (N=10), calculation of content validity indexes (six assessors), and assessment of test–retest reliability (N=97). Conceptual and cultural equivalence of modified (Canadian and Australian) and translated (Danish, Norwegian, Swedish and Canadian French) ABC versions were tested quantitatively for equivalence of meaning (≥4 assessors per country) and in bilingual cognitive interviews (three interviews per translation). Response patterns were assessed in surveys of adults aged 50+ years (N≥2000) in each country. Main outcomes Psychometric properties were evaluated through tests of validity and reliability, conceptual and cultural equivalence and systematic item analysis. Test–retest reliability used weighted-κ and intraclass correlations. Construction and validation of aggregate scores was by factor analysis for (1) beliefs about cancer outcomes, (2) beliefs about barriers to symptomatic presentation, and item summation for (3) awareness of cancer symptoms and (4) awareness of cancer risk factors. Results The English ABC had acceptable test–retest reliability and content validity. International assessments of equivalence identified a small number of items where wording needed adjustment. Survey response patterns showed that items performed well in terms of difficulty and discrimination across countries except for awareness of cancer outcomes in Australia. Aggregate scores had consistent factor structures across countries. Conclusions The ABC is a reliable and valid international measure of cancer awareness and beliefs. The methods used to validate and harmonise the ABC may serve as a methodological guide in international survey research. PMID:23253874
Virtual gonio-spectrophotometer for validation of BRDF designs
NASA Astrophysics Data System (ADS)
Mihálik, Andrej; Ďurikovič, Roman
2011-10-01
Measurement of the appearance of an object consists of a group of measurements to characterize the color and surface finish of the object. This group of measurements involves the spectral energy distribution of propagated light measured in terms of reflectance and transmittance, and the spatial energy distribution of that light measured in terms of the bidirectional reflectance distribution function (BRDF). In this article we present the virtual gonio-spectrophotometer, a device that measures flux (power) as a function of illumination and observation. Virtual gonio-spectrophotometer measurements allow the determination of the scattering profile of specimens that can be used to verify the physical characteristics of the computer model used to simulate the scattering profile. Among the characteristics that we verify is the energy conservation of the computer model. A virtual gonio-spectrophotometer is utilized to find the correspondence between industrial measurements obtained from gloss meters and the parameters of a computer reflectance model.
PedsQL gastrointestinal symptoms module feasibility reliability and validity
USDA-ARS?s Scientific Manuscript database
The objective of this study was to report on the measurement properties of the Pediatric Quality of Life Inventory (PedsQL) Gastrointestinal Symptoms Module for patients with functional gastrointestinal (GI) disorders (FGIDs) and organic GI diseases, hereafter referred to as "GI disorders," for pati...
Role of the adverse outcome pathway framework in the validation of predictive biomarkers
Gene expression, enzyme activities, changes in endogenous metabolite or hormone titers, altered histology, etc. are widely used as biomarkers, but rarely, if ever, used for regulatory decision-making or to define management objectives. The disconnect between the measurements comm...
Validating a Measure of Organizational Cultural Competence in Voluntary Child Welfare
ERIC Educational Resources Information Center
Schudrich, Wendy Zeitlin
2014-01-01
Objective: This research examines the psychometric properties of two subscales of the Association of University Centers on Disabilities (AUCD) Multicultural Council's Organizational Cultural Competence Assessment, which together have been used to assess organizational cultural competence in child welfare agencies. Method: Confirmatory factor…
Validity and reliability of the Delta Healthy Eating Attitudes Scale
USDA-ARS?s Scientific Manuscript database
The objective of this study was to evaluate psychometric properties of an instrument developed to measure psychosocial factors related to the Dietary Guidelines for Americans for a nutrition intervention in the Lower Mississippi Delta (LMD). Social Cognitive Theory constructs social support (SS), s...
Wagenlehner, Florian Martin Erich; Fröhlich, Oliver; Bschleipfer, Thomas; Weidner, Wolfgang; Perletti, Gianpaolo
2014-06-01
Anatomical damage to pelvic floor structures may cause multiple symptoms. The Integral Theory System Questionnaire (ITSQ) is a holistic questionnaire that uses symptoms to help locate damage in specific connective tissue structures as a guide to reconstructive surgery. It is based on the integral theory, which states that pelvic floor symptoms and prolapse are both caused by lax suspensory ligaments. The aim of the present study was to psychometrically validate the ITSQ. Established psychometric properties including validity, reliability, and responsiveness were considered for evaluation. Criterion validity was assessed in a cohort of 110 women with pelvic floor dysfunctions by analyzing the correlation of questionnaire responses with objective clinical data. Test-retest was performed with questionnaires from 47 patients. Cronbach's alpha and "split-half" reliability coefficients were calculated for inner consistency analysis. Psychometric properties of ITSQ were comparable to the ones of previously validated Pelvic Floor Questionnaires. Face validity and content validity were approved by an expert group of the International Collaboration of Pelvic Floor surgeons. Convergent validity assessed using Bayesian method was at least as accurate as the expert assessment of anatomical defects. Objective data measurement in patients demonstrated significant correlations with ITSQ domains fulfilling criterion validity. Internal consistency values ranked from 0.85 to 0.89 in different scenarios. The ITSQ proofed accurate and is able to serve as a holistic Pelvic Floor Questionnaire directing symptoms to site-specific pelvic floor reconstructive surgery.
Barrero, Lope H; Katz, Jeffrey N; Dennerlein, Jack T
2012-01-01
Objectives To describe the relation of the measured validity of self-reported mechanical demands (self-reports) with the quality of validity assessments and the variability of the assessed exposure in the study population. Methods We searched for original articles, published between 1990 and 2008, reporting the validity of self-reports in three major databases: EBSCOhost, Web of Science, and PubMed. Identified assessments were classified by methodological characteristics (eg, type of self-report and reference method) and exposure dimension was measured. We also classified assessments by the degree of comparability between the self-report and the employed reference method, and the variability of the assessed exposure in the study population. Finally, we examined the association of the published validity (r) with this degree of comparability, as well as with the variability of the exposure variable in the study population. Results Of the 490 assessments identified, 75% used observation-based reference measures and 55% tested self-reports of posture duration and movement frequency. Frequently, validity studies did not report demographic information (eg, education, age, and gender distribution). Among assessments reporting correlations as a measure of validity, studies with a better match between the self-report and the reference method, and studies conducted in more heterogeneous populations tended to report higher correlations [odds ratio (OR) 2.03, 95% confidence interval (95% CI) 0.89–4.65 and OR 1.60, 95% CI 0.96–2.61, respectively]. Conclusions The reported data support the hypothesis that validity depends on study-specific factors often not examined. Experimentally manipulating the testing setting could lead to a better understanding of the capabilities and limitations of self-reported information. PMID:19562235
2017-10-01
mRNA and has been shown in many studies to improve predictive accuracy for cancer on initial biopsy,3,7-9 and to be correlated with more aggressive... Study (PASS). We are in the process of evaluating these three biomarker panels in tissue, blood, and urine samples with well annotated clinical and...during AS. The objective of the study is to utilize analytically validated assays that take into account tumor heterogeneity to measure biomarkers in
Sorbara, Luigina; Simpson, Trefford; Duench, Stephanie; Schulze, Marc; Fonn, Desmond
2007-03-01
The primary objective was to compare measures of bulbar redness objectively using a photometric method with standard grading methods. Measures of redness were made on 24 participants wearing a silicone hydrogel contact lens in one eye for overnight wear. This report compares hyperaemia after 1 week of daily wear (baseline) with redness measured after 6 months of overnight wear. A new method of objectively measuring bulbar conjunctival redness was performed using the Spectrascan650 Photometer by Photo Research under fixed illumination. Photometric measures in CIEu(*) chromaticity values involve the measurement of chromaticity, a physical analogue of redness, greenness and blueness in the image. This method was validated in Part 1 of the study using repeated measurements on the photographic CCLRU scale. In Part 2 of the study, the photographic grading scale (CCLRU) from 0 (none) to 100 (extreme) was used to make the comparison. Part 1 indicated that the photometer provides a repeatable and reliable measure of bulbar redness (CCC=0.989). A moderately strong and significant correlation was found between the CIEu(*) chromaticity values and the analogue data (R=0.795, p=0.000) at each measurement session (from baseline to 1 day, 1 week, and 1, 3 and 6 months of overnight wear). This new standardized and objective method of measuring bulbar redness has great potential to replace subjective grading scales, especially with multi-centre studies, where variability between investigators occurs. This method may also detect smaller changes between visits or between eyes.
Objectification of steering feel around straight-line driving for vehicle/tyre design
NASA Astrophysics Data System (ADS)
Kim, Jungsik; Yoon, Yong-San
2015-02-01
This paper presents the objectification techniques for the assessment of steering feel including {on-centre} feel and steering response by measurement data. Here, new objective parameters are developed by considering not only the process by which the steering feel is evaluated subjectively but also by the ergonomic perceptive sensitivity of the driver. In order to validate such objective parameters, subjective tests are carried out by professional drivers. Objective measurements are also performed for several cars at a proving ground. The linear correlation coefficients between the subjective ratings and the objective parameters are calculated. As one of new objective parameters, steering wheel angle defined by ergonomic perception sensitivity shows high correlation with the subjective questionnaires of on-center responses. Newly defined steering torque curvature also shows high correlation with the subjective questionnaires of on-center effort. These correlation results conclude that the subjective assessment of steering feel can be successfully explained and objectified by means of the suggested objective parameters.
Kopec, Jacek A; Sayre, Eric C; Rogers, Pamela; Davis, Aileen M; Badley, Elizabeth M; Anis, Aslam H; Abrahamowicz, Michal; Russell, Lara; Rahman, Md Mushfiqur; Esdaile, John M
2015-10-01
The CAT-5D-QOL is a previously reported item response theory (IRT)-based computerized adaptive tool to measure five domains (attributes) of health-related quality of life. The objective of this study was to develop and validate a multiattribute health utility (MAHU) scoring method for this instrument. The MAHU scoring system was developed in two stages. In phase I, we obtained standard gamble (SG) utilities for 75 hypothetical health states in which only one domain varied (15 states per domain). In phase II, we obtained SG utilities for 256 multiattribute states. We fit a multiplicative regression model to predict SG utilities from the five IRT domain scores. The prediction model was constrained using data from phase I. We validated MAHU scores by comparing them with the Health Utilities Index Mark 3 (HUI3) and directly measured utilities and by assessing between-group discrimination. MAHU scores have a theoretical range from -0.842 to 1. In the validation study, the scores were, on average, higher than HUI3 utilities and lower than directly measured SG utilities. MAHU scores correlated strongly with the HUI3 (Spearman ρ = 0.78) and discriminated well between groups expected to differ in health status. Results reported here provide initial evidence supporting the validity of the MAHU scoring system for the CAT-5D-QOL. Copyright © 2015 Elsevier Inc. All rights reserved.
NASA Astrophysics Data System (ADS)
Jaspers, Mariëlle E. H.; Maltha, Ilse; Klaessens, John H. G. M.; de Vet, Henrica C. W.; Verdaasdonk, Rudolf M.; van Zuijlen, Paul P. M.
2016-09-01
Adequate assessment of burn wounds is crucial in the management of burn patients. Thermography, as a noninvasive measurement tool, can be utilized to detect the remaining perfusion over large burn wound areas by measuring temperature, thereby reflecting the healing potential (HP) (i.e., number of days that burns require to heal). The objective of this study was to evaluate the clinimetric properties (i.e., reliability and validity) of thermography for measuring burn wound HP. To evaluate reliability, two independent observers performed a thermography measurement of 50 burns. The intraclass correlation coefficient (ICC), the standard error of measurement (SEM), and the limits of agreement (LoA) were calculated. To assess validity, temperature differences between burned and nonburned skin (ΔT) were compared to the HP found by laser Doppler imaging (serving as the reference standard). By applying a visual method, one ΔT cutoff point was identified to differentiate between burns requiring conservative versus surgical treatment. The ICC was 0.99, expressing an excellent correlation between two measurements. The SEM was calculated at 0.22°C, the LoA at -0.58°C and 0.64°C. The ΔT cutoff point was -0.07°C (sensitivity 80% specificity 80%). These results show that thermography is a reliable and valid technique in the assessment of burn wound HP.
Leutwyler, Heather; Hubbard, Erin; Cooper, Bruce; Dowling, Glenna
2015-01-01
The purpose of this report is to describe the impact of a videogame-based pilot physical activity program using the Kinect for Xbox 360 game system (Microsoft, Redmond, WA, USA) on physical activity in older adults with schizophrenia. In this one group pre-test, post-test pilot study, 20 participants played an active videogame for 30 min, once a week for 6 weeks. Physical activity was measured by self-report with the Yale Physical Activity Survey and objectively with the Sensewear Pro armband at enrollment and at the end of the 6-week program. There was a significant increase in frequency of self-reported vigorous physical activity. We did not detect a statistically significant difference in objectively measured physical activity although increase in number of steps and sedentary activity were in the desired direction. These results suggest participants' perception of physical activity intensity differs from the intensity objectively captured with a valid and reliable physical activity monitor.
GITLIN, LAURA N.; ROTH, DAVID L.; BURGIO, LOUIS D.; LOEWENSTEIN, DAVID A.; WINTER, LARAINE; NICHOLS, LINDA; ARGÜELLES, SOLEDAD; CORCORAN, MARY; BURNS, ROBERT; MARTINDALE, JENNIFER
2008-01-01
Objective To evaluate psychometric properties and response patterns of the Caregiver Assessment of Function and Upset (CAFU), a 15-item multidimensional measure of dependence in dementia patients and caregiver reaction. Method 640 families were administered the CAFU (53% White, 43% African American, and 4% mixed race and ethnicity). We created a random split of the sample and conducted exploratory factor analyses on Sample 1 and confirmatory factor analyses on Sample 2. Convergent and discriminant validity were evaluated using Spearman rank correlation coefficients. Results A two-factor structure for functional items was derived, and excellent factorial validity was obtained. Convergent and discriminant validity were obtained for function and upset measures. Differential response patterns for dependence and caregiver upset were found for caregiver race, relationship, and care recipient gender but not for caregiver gender. Discussion The CAFU is easily administered, reliable, and valid for evaluating appraisals of dependencies and upsetting care areas. PMID:15750049
Development of a Composite Measure of State-Level Malpractice Environment
Chung, Jeanette W; Sohn, Min-Woong; Merkow, Ryan P; Oh, Elissa H; Minami, Christina; Black, Bernard S; Bilimoria, Karl Y
2014-01-01
Objective To develop a composite measure of state-level malpractice environment. Data Sources Public use data from the National Practitioner Data Bank, Medical Liability Monitor, the National Conference of State Legislatures, and the American Bar Association. Study Design Principal component analysis of state-level indicators (paid claims rate, malpractice premiums, lawyers per capita, average award size, and malpractice laws), with indirect validation of the composite using receiver-operating characteristic curves to determine how accurately the composite could identify states with high-tort activity and costs. Principal Findings A single composite accounted for over 73 percent of total variance in the seven indicators and demonstrated reasonable criterion validity. Conclusion An empirical composite measure of state-level malpractice risk may offer advantages over single indicators in measuring overall risk and may facilitate cross-state comparisons of malpractice environments. PMID:24117397
ERIC Educational Resources Information Center
Tondeur, Jo; Aesaert, Koen; Pynoo, Bram; van Braak, Johan; Fraeyman, Norbert; Erstad, Ola
2017-01-01
The main objective of this study is to develop a self-report instrument to measure preservice teachers' ICT competencies in education. The questionnaire items of this instrument are based on an existing comprehensive framework and were created with input from experts in the field. The data were collected from a sample of 931 final-year preservice…
Development and validation of a measure of pediatric oral health-related quality of life: the POQL
Huntington, Noelle L; Spetter, Dante; Jones, Judith A.; Rich, Sharon E.; Garcia, Raul I.; Spiro, Avron
2011-01-01
Objective To develop a brief measure of oral health-related quality of life in children and demonstrate its reliability and validity in a diverse population. Methods We administered the initial 20-item POQL to children (Child Self-Report) and parents (Parent Report on Child) from diverse populations in both school-based and clinic-based settings. Clinical oral health status was measured on a subset of children. We used factor analysis to determine the underlying scales and then reduced the measure to 10 items based on several considerations. Multitrait analysis on the resulting 10-item POQL was used to reaffirm the discrimination of scales and assess the measure’s internal consistency and interscale correlations. We established discriminant and convergent validity with clinical status, perceived oral health and responses on the PedsQL and determined sensitivity to change with children undergoing ECC surgical repair. Results Factor analysis returned a four-scale solution for the initial items – Physical Functioning, Role Functioning, Social Functioning and Emotional Functioning. The reduced items represented the same four scales – two each on Physical and Role and three each on Social and Emotional. Good reliability and validity were shown for the POQL as a whole and for each of the scales. Conclusions The POQL is a valid and reliable measure of oral health-related quality of life for use in pre-school and school-aged children, with high utility for both clinical assessments and large-scale population studies. PMID:21972458
Reliability and Validity of an Internet-based Questionnaire Measuring Lifetime Physical Activity
De Vera, Mary A.; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek
2010-01-01
Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005–2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity. PMID:20876666
Physical activity measurement instruments for children with cerebral palsy: a systematic review.
Capio, Catherine M; Sit, Cindy H P; Abernethy, Bruce; Rotor, Esmerita R
2010-10-01
this paper is a systematic review of physical activity measurement instruments for field-based studies involving children with cerebral palsy (CP). database searches using PubMed Central, MEDLINE, CINAHL Plus, PsycINFO, EMBASE, Cochrane Library, and PEDro located 12 research papers, identifying seven instruments that met the inclusion criteria of (1) having been developed for children aged 0 to 18 years, (2) having been used to evaluate a physical activity dimension, and (3) having been used in a field-based study involving children with CP. The instruments reviewed were the Activities Scale for Kids - Performance version (ASKp), the Canada Fitness Survey, the Children's Assessment of Participation and Enjoyment/Preferences for Activities of Children (CAPE/PAC), the Compendium of Physical Activities, the Physical Activity Questionnaire - Adolescents (PAQ-A), StepWatch, and the Uptimer. Second-round searches yielded 11 more papers, providing reliability and validity evidence for the instruments. the instruments measure physical activity frequency, mode, domain, and duration. Although most instruments demonstrated adequate reliability and validity, only the ASKp and CAPE/PAC have established reliability and validity for children with physical disabilities; the Uptimer has established concurrent validity. No instrument measuring intensity in free-living has been validated or found reliable for children with CP. the findings suggest that further studies are needed to examine the methodological properties of physical activity measurement in children with CP. Combining subjective and objective instruments is recommended to achieve better understanding of physical activity participation.
Reliability and validity of an internet-based questionnaire measuring lifetime physical activity.
De Vera, Mary A; Ratzlaff, Charles; Doerfling, Paul; Kopec, Jacek
2010-11-15
Lifetime exposure to physical activity is an important construct for evaluating associations between physical activity and disease outcomes, given the long induction periods in many chronic diseases. The authors' objective in this study was to evaluate the measurement properties of the Lifetime Physical Activity Questionnaire (L-PAQ), a novel Internet-based, self-administered instrument measuring lifetime physical activity, among Canadian men and women in 2005-2006. Reliability was examined using a test-retest study. Validity was examined in a 2-part study consisting of 1) comparisons with previously validated instruments measuring similar constructs, the Lifetime Total Physical Activity Questionnaire (LT-PAQ) and the Chasan-Taber Physical Activity Questionnaire (CT-PAQ), and 2) a priori hypothesis tests of constructs measured by the L-PAQ. The L-PAQ demonstrated good reliability, with intraclass correlation coefficients ranging from 0.67 (household activity) to 0.89 (sports/recreation). Comparison between the L-PAQ and the LT-PAQ resulted in Spearman correlation coefficients ranging from 0.41 (total activity) to 0.71 (household activity); comparison between the L-PAQ and the CT-PAQ yielded coefficients of 0.58 (sports/recreation), 0.56 (household activity), and 0.50 (total activity). L-PAQ validity was further supported by observed relations between the L-PAQ and sociodemographic variables, consistent with a priori hypotheses. Overall, the L-PAQ is a useful instrument for assessing multiple domains of lifetime physical activity with acceptable reliability and validity.
Using the Rasch Measurement Model in Psychometric Analysis of the Family Effectiveness Measure
McCreary, Linda L.; Conrad, Karen M.; Conrad, Kendon J.; Scott, Christy K; Funk, Rodney R.; Dennis, Michael L.
2013-01-01
Background Valid assessment of family functioning can play a vital role in optimizing client outcomes. Because family functioning is influenced by family structure, socioeconomic context, and culture, existing measures of family functioning--primarily developed with nuclear, middle class European American families--may not be valid assessments of families in diverse populations. The Family Effectiveness Measure was developed to address this limitation. Objectives To test the Family Effectiveness Measure with data from a primarily low-income African American convenience sample, using the Rasch measurement model. Method A sample of 607 adult women completed the measure. Rasch analysis was used to assess unidimensionality, response category functioning, item fit, person reliability, differential item functioning by race and parental status, and item hierarchy. Criterion-related validity was tested using correlations with five other variables related to family functioning. Results The Family Effectiveness Measure measures two separate constructs: The effective family functioning construct was a psychometrically sound measure of the target construct that was more efficient due to the deletion of 22 items. The ineffective family functioning construct consisted of 16 of those deleted items but was not as strong psychometrically. Items in both constructs evidenced no differential item functioning by race. Criterion-related validity was supported for both. Discussion In contrast to the prevailing conceptualization that family functioning is a single construct, assessed by positively and negatively worded items, use of the Rasch analysis suggested the existence of two constructs. While the effective family functioning is a strong and efficient measure of family functioning, the ineffective family functioning will require additional item development and psychometric testing. PMID:23636342
Nursing Home Administrator Quality Improvement Self-Efficacy Scale.
Siegel, Elena O; Zisberg, Anna; Bakerjian, Debra; Zysberg, Leehu
Nursing home (NH) quality improvement (QI) is challenging. The critical role of NH leaders in successful QI is well established; however, current options for assessing the QI capabilities of leaders such as the licensed NH administrator are limited. This article presents the development and preliminary validation of an instrument to measure NH administrator self-efficacy in QI. We used a mixed-methods cross-sectional design to develop and test the measure. For item generation, 39 NH leaders participated in qualitative interviews. Item reduction and content validity were established with a sample of eight subject matter experts. A random sample of 211 administrators from NHs with the lowest and highest Centers for Medicare and Medicaid Services Five-Star Quality ratings completed the measure. We conducted exploratory and confirmatory factor analyses and tested the measure for internal reliability and convergent, discriminant, and known group validity. The final measure included five subscales and 32 items. Confirmatory factor analysis reaffirmed the factorial structure with good fit indices. The new measure's subscales correlated with valid measures of self-efficacy and locus of control, supporting the measure's convergent and discriminant validity. Significant differences in most of the subscales were found between the objective (Centers for Medicare and Medicaid Services Five-Star Quality rating) and subjective (Self-Rated Facility QI Index) quality outcomes, supporting the measure's known group validity. The instrument has usefulness to both NH organizations and individual NH administrators as a diagnostic tool to identify administrators with higher/lower chances of successfully implementing QI. Organizations and individuals can use this diagnostic to identify the administrator's professional development needs for QI, in general, and specific to the instrument's five subscales, informing directions for in-house training, mentoring, and outside professional development. Attending to NH administrators' QI professional development needs prior to implementing QI holds promise to enhance the chances for successful implementation of QI, which is urgently needed in many NHs.
Jeffery, Emily; Lee, Yc Gary; McVeigh, Joanne; Straker, Leon; Wooding, Troy; Newton, Robert U; Peddle-McIntyre, Carolyn
2017-10-01
Malignant pleural effusion (MPE) affects 1 million people worldwide annually and can significantly impair physical activity. Accelerometry is a validated method of objectively assessing physical activity. The purpose of this study was to determine the compliance in patients with MPE to accelerometry and describe their activity. Patients with MPE wore an Actigraph GT3X accelerometer over a 7-day continuous wear protocol. Compliance was measured as the percent of patients who had ≥4 valid days (i.e., 8-h/day of waking wear-time). Eastern Cooperative Oncology Group performance status was documented the day of actigraphy initialization. Forty-six patients with MPE received accelerometers; 44 (95.7%) returned their device. No complications were reported on their use. Forty subjects (90.9%) had ≥4 valid days of wear-time. Patients spent most of their waking hours sedentary [mean 11.0 h (SD 1.95)], with limited participation in moderate and vigorous physical activity [mean 9.5 min (SD 14.16)]. Compared to patients with better performance status (n = 32), patients with poorer performance status (n = 11) spent significantly more hours/day sedentary [mean difference 2.1 (CI 0.86-3.32); p = 0.001], as did those who survived <3 months (n = 5) compared to >12 months (n = 27) [mean difference 2.6 (CI 0.49-4.77); p = 0.013). Accelerometry was applied successfully in patients with MPE with high compliance and no adverse events. This is the first reported objectively measured physical activity in patients with MPE and revealed high sedentary behavior and low physical activity. The data reflected patient performance status and discriminated between survival groups. Accelerometry can provide a useful measure for future interventional studies in patients with MPE.
Fell, Matthew; Meirte, Jill; Anthonissen, Mieke; Maertens, Koen; Pleat, Jonathon; Moortgat, Peter
2016-03-01
Objective scar assessment tools were designed to help identify problematic scars and direct clinical management. Their use has been restricted by their measurement of a single scar property and the bulky size of equipment. The Scarbase Duo(®) was designed to assess both trans-epidermal water loss (TEWL) and colour of a burn scar whilst being compact and easy to use. Twenty patients with a burn scar were recruited and measurements taken using the Scarbase Duo(®) by two observers. The Scarbase Duo(®) measures TEWL via an open-chamber system and undertakes colorimetry via narrow-band spectrophotometry, producing values for relative erythema and melanin pigmentation. Validity was assessed by comparing the Scarbase Duo(®) against the Dermalab(®) and the Minolta Chromameter(®) respectively for TEWL and colorimetry measurements. The intra-class correlation coefficient (ICC) was used to assess reliability with standard error of measurement (SEM) used to assess reproducibility of measurements. The Pearson correlation coefficient (r) was used to assess the convergent validity. The Scarbase Duo(®) TEWL mode had excellent reliability when used on scars for both intra- (ICC=0.95) and inter-rater (ICC=0.96) measurements with moderate SEM values. The erythema component of the colorimetry mode showed good reliability for use on scars for both intra-(ICC=0.81) and inter-rater (ICC=0.83) measurements with low SEM values. Pigmentation values showed excellent reliability on scar tissue for both intra- (ICC=0.97) and inter-rater (ICC=0.97) with moderate SEM values. The Scarbase Duo(®) TEWL function had excellent correlation with the Dermalab(®) (r=0.93) whilst the colorimetry erythema value had moderate correlation with the Minolta Chromameter (r=0.72). The Scarbase Duo(®) is a reliable and objective scar assessment tool, which is specifically designed for burn scars. However, for clinical use, standardised measurement conditions are recommended. Copyright © 2015 Elsevier Ltd and ISBI. All rights reserved.
Measuring sleep habits without using a diary: the sleep timing questionnaire
NASA Technical Reports Server (NTRS)
Monk, Timothy H.; Buysse, Daniel J.; Kennedy, Kathy S.; Pods, Jaime M.; DeGrazia, Jean M.; Miewald, Jean M.
2003-01-01
STUDY OBJECTIVES: To develop a single-administration instrument yielding equivalent measures of sleep to those obtained from a formal (2-week) sleep diary. DESIGN & SETTING: A single-administration Sleep riming Questionnaire (STQ) is described (and reproduced in the Appendix). Test-retest reliability was examined in 40 subjects who were given the STQ on two occasions separated by less than 1 year. Convergent validity was measured both by comparing STO-derived measures with objective measures derived from wrist actigraphy (n=23) and by comparing STQ-derived measures with other subjective measures derived from a detailed 2-week sleep diary in two nonoverlapping samples (n=101, 93). Correlations of STQ measures with age and momingness-eveningness (chronotype) were also examined. SUBJECTS: The analyses used sample sizes of 40, 23, 101, and 93 (both genders, overall age range 20y-89y). Most subjects were healthy volunteers; some Study 4 subjects were patients (enrolled in research protocols). RESULTS: Test-retest reliability for the STQ was demonstrated for estimates of bedtime (r = 0.705, p < 0.001) and waketime (r = 0.826, p < 0.001). Convergent validity using wrist actigraphy was demonstrated by correlations of 0.592 (p < 0.005) for bedtime, and of 0.769 (p < 0.001) for waketime. Diary studies indicated STQ bedtime and waketime data to be highly correlated (at about 0.8) with those obtained from a formal 2-week sleep diary. The STQ also provided data on estimated sleep latency and wake after sleep onset (WASO), which correlated reliably (at about 0.7) with average nightly ratings of these variables from a 2-week sleep diary. Mean estimated values of sleep latency and WASO from the two instruments were within 1 minute of each other. ST-derived bedtimes and waketimes correlated with both age and chronotype in the expected direction (older subjects earlier, morning types earlier). CONCLUSION: The STQ may be a reliable valid measure of sleep timing that could provide a time-efficient alternative to traditional sleep diaries.
MERKEL, PETER A.; SILLIMAN, NANCY P.; DENTON, CHRISTOPHER P.; FURST, DANIEL E.; KHANNA, DINESH; EMERY, PAUL; HSU, VIVIEN M.; STREISAND, JAMES B.; POLISSON, RICHARD P.; ÅKESSON, ANITA; COPPOCK, JOHN; van den HOOGEN, FRANK; HERRICK, ARIANE; MAYES, MAUREEN D.; VEALE, DOUGLAS; SEIBOLD, JAMES R.; BLACK, CAROL M.; KORN, JOSEPH H.
2013-01-01
Objective To determine the validity, reliability, and feasibility of durometer measurements of skin hardness as an outcome measure in clinical trials of scleroderma. Methods Skin hardness was measured during a multicenter treatment trial for scleroderma using handheld digital durometers with a continuous scale. Skin thickness was measured by modified Rodnan skin score (MRSS). Other outcome data collected included the Scleroderma Health Assessment Questionnaire. In a reliability exercise in advance of the trial, 9 investigators examined the same 5 scleroderma patients by MRSS and durometry. Results Forty-three patients with early diffuse cutaneous systemic sclerosis were studied at 11 international centers (mean age 49 years [range 24–76], median disease duration 6.4 months [range 0.3–23], and median baseline MRSS 22 [range 11–38]). The reliability of durometer measurements was excellent, with high interobserver intraclass correlation coefficients (ICCs) (0.82–0.92), and each result was greater than the corresponding skin site ICCs for MRSS (0.54–0.85). Baseline durometer scores correlated well with MRSS (r = 0.69, P < 0.0001), patient self-assessments of skin disease (r = 0.69, P < 0.0001), and Health Assessment Questionnaire (HAQ) disability scores (r = 0.34, P = 0.03). Change in durometer scores correlated with change in MRSS (r = 0.70, P < 0.0001), change in patient self-assessments of skin disease (r = 0.52, P = 0.003), and change in HAQ disability scores (r = 0.42, P = 0.017). The effect size was greater for durometry than for MRSS or patient self-assessment. Conclusion Durometer measurements of skin hardness in patients with scleroderma are reliable, simple, accurate, demonstrate good sensitivity to change compared with traditional skin scoring, and reflect patients' self-assessments of their disease. Durometer measurements are valid, objective, and scalable, and should be considered for use as a complementary outcome measure to skin scoring in clinical trials of scleroderma. PMID:18438905
Jaffer, Usman; Normahani, Pasha; Lackenby, Kimberly; Aslam, Mohammed; Standfield, Nigel J
2015-01-01
Duplex ultrasound measurement of reflux time is central to the diagnosis of venous incompetence. We have developed an assessment tool for Duplex measurement of venous reflux for both simulator and patient-based training. A novel assessment tool, Venous Duplex Ultrasound Assessment of Technical Skills (V-DUOSATS), was developed. A modified DUOSATS was used for simulator training. Participants of varying skill level were invited to viewed an instructional video and were allowed ample time to familiarize with the Duplex equipment. Attempts made by the participants were recorded and independently assessed by 3 expert assessors and 5 novice assessors using the modified V-DUOSATS. "Global" assessment was also done by expert assessors on a 4-point Likert scale. Content, construct, and concurrent validities as well as reliability were evaluated. Content and construct validity as well as reliability were demonstrated. Receiver operator characteristic analysis-established cut points of 19/22 and 21/30 were most appropriate for simulator and patient-based assessment, respectively. We have validated a novel assessment tool for Duplex venous reflux measurement. Further work is required to establish transference validity of simulator training to improve skill in scanning patients. We have developed and validated V-DUOSATS for simulator training. Copyright © 2015 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.
Gupta, Nidhi; Heiden, Marina; Mathiassen, Svend Erik; Holtermann, Andreas
2016-05-01
We aimed at developing and evaluating statistical models predicting objectively measured occupational time spent sedentary or in physical activity from self-reported information available in large epidemiological studies and surveys. Two-hundred-and-fourteen blue-collar workers responded to a questionnaire containing information about personal and work related variables, available in most large epidemiological studies and surveys. Workers also wore accelerometers for 1-4 days measuring time spent sedentary and in physical activity, defined as non-sedentary time. Least-squares linear regression models were developed, predicting objectively measured exposures from selected predictors in the questionnaire. A full prediction model based on age, gender, body mass index, job group, self-reported occupational physical activity (OPA), and self-reported occupational sedentary time (OST) explained 63% (R (2)adjusted) of the variance of both objectively measured time spent sedentary and in physical activity since these two exposures were complementary. Single-predictor models based only on self-reported information about either OPA or OST explained 21% and 38%, respectively, of the variance of the objectively measured exposures. Internal validation using bootstrapping suggested that the full and single-predictor models would show almost the same performance in new datasets as in that used for modelling. Both full and single-predictor models based on self-reported information typically available in most large epidemiological studies and surveys were able to predict objectively measured occupational time spent sedentary or in physical activity, with explained variances ranging from 21-63%.
Stergiou, George S; Asmar, Roland; Myers, Martin; Palatini, Paolo; Parati, Gianfranco; Shennan, Andrew; Wang, Jiguang; O'Brien, Eoin
2018-03-01
The European Society of Hypertension (ESH) International Protocol (ESH-IP) for the validation of blood pressure (BP) measuring devices was published in 2002, with the main objective of simplifying the validation procedures, so that more BP monitors would be subjected to independent validation. This article provides an overview of the international impact of the ESH-IP and of the lessons learned from its use, to be able to justify further developments in validation protocols. A review of published (PubMed) validation studies from 2002 to 2017 was performed. One hundred and seventy-seven validation studies using the ESH-IP, 59 using the British Hypertension Society protocol, 46 using the Association for the Advancement of Medical Instrumentation (AAMI) standard and 23 using the International Organization for Standardization (ISO) standard were identified. Lists of validated office-clinic, home and ambulatory BP monitors are provided. Of the ESH-IP studies, 93% tested oscillometric devices, 80% upper arm, 71% home, 25% office and 7% ambulatory monitors (some had more than one function). The original goal of the ESH-IP has been fulfilled in that in the last decade the number of published validation studies has more than doubled. It is now recognized that the provision of accurate devices would be best served by having a universal protocol. An international initiative has been put in place by AAMI, ESH and ISO experts aiming to reach consensus for a universal validation protocol to be accepted worldwide, which will allow a more thorough evaluation of the accuracy and performance of future BP monitors.
Bertisch, Hilary; Rivara, Frederick P; Kisala, Pamela A; Wang, Jin; Yeates, Keith Owen; Durbin, Dennis; Zonfrillo, Mark R; Bell, Michael J; Temkin, Nancy; Tulsky, David S
2017-07-01
The primary objective is to provide evidence of convergent and discriminant validity for the pediatric and parent-proxy versions of the Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety, Depression, Anger, Peer Relations, Mobility, Pain Interference, and Fatigue item banks, the Neurology Quality of Life measurement system (Neuro-QOL) Cognition-General Concerns and Stigma item banks, and the Traumatic Brain Injury Quality of Life (TBI-QOL) Executive Function and Headache item banks in a pediatric traumatic brain injury (TBI) sample. Participants were 134 parent-child (ages 8-18 years) days. Children all sustained TBI and the dyads completed outcome ratings 6 months after injury at one of six medical centers across the United States. Ratings included PROMIS, Neuro-QOL, and TBI-QOL item banks, as well as the Pediatric Quality of Life inventory (PedsQL), the Health Behavior Inventory (HBI), and the Strengths and Difficulties Questionnaire (SDQ) as legacy criterion measures against which these item banks were validated. The PROMIS, Neuro-QOL, and TBI-QOL item banks demonstrated good convergent validity, as evidenced by moderate to strong correlations with comparable scales on the legacy measures. PROMIS, Neuro-QOL, and TBI-QOL item banks showed weaker correlations with ratings of unrelated constructs on legacy measures, providing evidence of discriminant validity. Our results indicate that the constructs measured by the PROMIS, Neuro-QOL, and TBI-QOL item banks are valid in our pediatric TBI sample and that it is appropriate to use these standardized scores for our primary study analyses.
Developing Indicators of Student Coursework.
ERIC Educational Resources Information Center
McDonnell, Lorraine M.; Ormseth, Tor
The School Reform Assessment (SRA) project began in 1987 with the objective of developing indicators of student coursework that reliably and validly measure this central feature of schooling, while remaining sensitive to major policy changes and the information needs of policymakers, and efficiently collecting and reporting data. This paper…
Video Game Learning Dynamics: Actionable Measures of Multidimensional Learning Trajectories
ERIC Educational Resources Information Center
Reese, Debbie Denise; Tabachnick, Barbara G.; Kosko, Robert E.
2015-01-01
Valid, accessible, reusable methods for instructional video game design and embedded assessment can provide actionable information enhancing individual and collective achievement. Cyberlearning through game-based, metaphor-enhanced learning objects (CyGaMEs) design and embedded assessment quantify player behavior to study knowledge discovery and…
ERIC Educational Resources Information Center
Bijlenga, Denise; van der Heijden, Kristiaan B.; Breuk, Minda; van Someren, Eus J. W.; Lie, Maria E. H.; Boonstra, A. Marije; Swaab, Hanna J. T.; Kooij, J. J. Sandra
2013-01-01
Objective: The authors explored associations between ADHD symptoms, seasonal depressive symptoms, lifestyle, and health. Method: Adult ADHD patients ("n" = 202) and controls ("n" = 189) completed the ASESA questionnaire involving lifestyle, eating pattern, and physical and psychological health, and validated measures on ADHD…
Student Climate Survey, Spring 1998.
ERIC Educational Resources Information Center
Truckee Meadows Community Coll., Sparks, NV.
Every three years, Truckee Meadows Community College (Nevada) administers a student climate survey that measures the attitudes, perceptions, and opinions of its student population. The instrument used to survey the student body was designed with three basic objectives in mind: (1) validate the institutional mission; (2) obtain input regarding the…
A New Lebanese Medication Adherence Scale: Validation in Lebanese Hypertensive Adults
Wakim, N.; Issa, C.; Kassem, B.; Abou Jaoude, L.; Saleh, N.
2018-01-01
Background A new Lebanese scale measuring medication adherence considered socioeconomic and cultural factors not taken into account by the eight-item Morisky Medication Adherence Scale (MMAS-8). Objectives were to validate the new adherence scale and its prediction of hypertension control, compared to MMAS-8, and to assess adherence rates and factors. Methodology A cross-sectional study, including 405 patients, was performed in outpatient cardiology clinics of three hospitals in Beirut. Blood pressure was measured, a questionnaire filled, and sodium intake estimated by a urine test. Logistic regression defined predictors of hypertension control and adherence. Results 54.9% had controlled hypertension. 82.4% were adherent by the new scale, which showed good internal consistency, adequate questions (KMO coefficient = 0.743), and four factors. It predicted hypertension control (OR = 1.217; p value = 0.003), unlike MMAS-8, but the scores were correlated (ICC average measure = 0.651; p value < 0.001). Stress and smoking predicted nonadherence. Conclusion This study elaborated a validated, practical, and useful tool measuring adherence to medications in Lebanese hypertensive patients. PMID:29887993
Tsai, Chung-Yu
2012-04-01
An exact analytical approach is proposed for measuring the six-degree-of-freedom (6-DOF) motion of an object using the image-orientation-change (IOC) method. The proposed measurement system comprises two reflector systems, where each system consists of two reflectors and one position sensing detector (PSD). The IOCs of the object in the two reflector systems are described using merit functions determined from the respective PSD readings before and after motion occurs, respectively. The three rotation variables are then determined analytically from the eigenvectors of the corresponding merit functions. After determining the three rotation variables, the order of the translation equations is downgraded to a linear form. Consequently, the solution for the three translation variables can also be analytically determined. As a result, the motion transformation matrix describing the 6-DOF motion of the object is fully determined. The validity of the proposed approach is demonstrated by means of an illustrative example.
Development and validation of a questionnaire to measure moral distress in community pharmacists.
Astbury, Jayne L; Gallagher, Cathal T
2017-02-01
Background Pharmacists work within a highly-regulated occupational sphere, and are bound by strict legal frameworks and codes of professional conduct. This regulatory environment creates the potential for moral distress to occur due to the limitations it places on acting in congruence with moral judgements. Very little research regarding this phenomenon has been undertaken in pharmacy: thus, prominent research gaps have arisen for the development of a robust tool to measure and quantify moral distress experienced in the profession. Objective The aim of this study was to develop an instrument to measure moral distress in community pharmacists. Setting Community pharmacies in the United Kingdom. Method This study adopted a three-phase exploratory sequential mixed-method design. Three semi-structured focus groups were then conducted to allow pharmacists to identify and explore scenarios that cause moral distress. Each of the identified scenarios were developed into a statement, which was paired with twin seven-point Likert scales to measure the frequency and intensity of the distress, respectively. Content validity, reliability, and construct validity were all tested, and the questionnaire was refined. Main outcome measure The successful development of the valid instrument for use in the United Kingdom. Results This research has led to the development of a valid and reliable instrument to measure moral distress in community pharmacists in the UK. The questionnaire has already been distributed to a large sample of community pharmacists. Conclusion Results from this distribution will be used to inform the formulation of coping strategies for dealing with moral distress.
2017-01-01
Objectives Muscular targets that are deep or inaccessible to surface electromyography (sEMG) require intrinsic recording using fine-wire electromyography (fEMG). It is unknown if fEMG validly record cortically evoked muscle responses compared to sEMG. The purpose of this investigation was to establish the validity and agreement of fEMG compared to sEMG to quantify typical transcranial magnetic stimulation (TMS) measures pre and post repetitive TMS (rTMS). The hypotheses were that fEMG would demonstrate excellent validity and agreement compared with sEMG. Materials and methods In ten healthy volunteers, paired pulse and cortical silent period (CSP) TMS measures were collected before and after 1200 pulses of 1Hz rTMS to the motor cortex. Data were simultaneously recorded with sEMG and fEMG in the first dorsal interosseous. Concurrent validity (r and rho) and agreement (Tukey mean-difference) were calculated. Results fEMG quantified corticospinal excitability with good to excellent validity compared to sEMG data at both pretest (r = 0.77–0.97) and posttest (r = 0.83–0.92). Pairwise comparisons indicated no difference between sEMG and fEMG for all outcomes; however, Tukey mean-difference plots display increased variance and questionable agreement for paired pulse outcomes. CSP displayed the highest estimates of validity and agreement. Paired pulse MEP responses recorded with fEMG displayed reduced validity, agreement and less sensitivity to changes in MEP amplitude compared to sEMG. Change scores following rTMS were not significantly different between sEMG and fEMG. Conclusion fEMG electrodes are a valid means to measure CSP and paired pulse MEP responses. CSP displays the highest validity estimates, while caution is warranted when assessing paired pulse responses with fEMG. Corticospinal excitability and neuromodulatory aftereffects from rTMS may be assessed using fEMG. PMID:28231250
2007-09-30
combined with measured sediment properties, to test the validity of sediment acoustic models , and in particular the poroelastic (Biot) model . Addressing...TERM GOALS 1. Development of accurate models for acoustic scattering from, penetration into, and propagation within shallow water ocean sediments...2. Development of reliable methods for modeling acoustic detection of buried objects at subcritical grazing angles. 3. Improving our
Psychomotor Vigilance Self Test on ISS (Reaction Self Test on Expeditions 21 and 22)
NASA Technical Reports Server (NTRS)
Dinges, David F.; Mollicone, Daniel; Ecker, Adrian
2009-01-01
The experiment addresses the following high-priority NASA Risk Gaps in the Behavioral Health and Performance (BHP) area: 1) Identify brief, valid objective measures of changes in cognitive functions during spaceflight that astronauts can use with minimal burden. 2) Find a practical objective aid for astronauts to quickly identify and manage the effects of fatigue (from sleep loss, circadian disruptions, workload and other factors) on their performance during space flight.
Wolmer, L; Laor, N; Cicchetti, D V
2001-06-01
This study furthers the validation of the Comprehensive Assessment of Defense Style (CADS) as a measure of children's defensive behavior. Participants were 81 mothers who assessed the defense style (CADS) of their 8- to 10-year-old children, as well as their own defense style and level of object relations. Five years earlier, the mothers had rated their children's symptom level and personality after the missile attacks during the Gulf War. The original factor structure of the CADS was replicated for the most part. Self-oriented and other-oriented defenses were related to the children's early personality and symptomatic reaction, as well as to their mother's defense style and level of object relations. The CADS factors correlated with the defenses of the Defense Mechanisms Manual. The results provide further validation of the CADS and suggest possible areas of implementation, such as longitudinal examination of defenses, psychopathology screening, and therapeutic improvement.
Goldschmidt, Andrea B.
2017-01-01
Background Binge eating is a marker of weight gain and obesity, and a hallmark feature of eating disorders. Yet, its component constructs—overeating and loss of control (LOC) while eating—are poorly understood and difficult to measure. Objective To critically review the human literature concerning the validity of LOC and overeating across the age and weight spectrum. Data sources English-language articles addressing the face, convergent, discriminant, and predictive validity of LOC and overeating were included. Results LOC and overeating appear to have adequate face validity. Emerging evidence supports the convergent and predictive validity of the LOC construct, given its unique cross-sectional and prospective associations with numerous anthropometric, psychosocial, and eating behavior-related factors. Overeating may be best conceptualized as a marker of excess weight status. Limitations Binge eating constructs, particularly in the context of subjectively large episodes, are challenging to measure reliably. Few studies addressed overeating in the absence of LOC, thereby limiting conclusions about the validity of the overeating construct independent of LOC. Additional studies addressing the discriminant validity of both constructs are warranted. Discussion Suggestions for future weight-related research and for appropriately defining binge eating in the eating disorders diagnostic scheme are presented. PMID:28165655
Validating Neuro-QoL short forms and targeted scales with people who have multiple sclerosis.
Miller, Deborah M; Bethoux, Francois; Victorson, David; Nowinski, Cindy J; Buono, Sarah; Lai, Jin-Shei; Wortman, Katy; Burns, James L; Moy, Claudia; Cella, David
2016-05-01
Multiple sclerosis (MS) is a chronic, progressive, and disabling disease of the central nervous system with dramatic variations in the combination and severity of symptoms it can produce. The lack of reliable disease-specific health-related quality of life (HRQL) measures for use in clinical trials prompted the development of the Neurology Quality of Life (Neuro-QOL) instrument, which includes 13 scales that assess physical, emotional, cognitive, and social domains, for use in a variety of neurological illnesses. The objective of this research paper is to conduct an initial assessment of the reliability and validation of the Neuro-QOL short forms (SFs) in MS. We assessed reliability, concurrent validity, known groups validity, and responsiveness between cross-sectional and longitudinal data in 161 recruited MS patients. Internal consistency was high for all measures (α = 0.81-0.95) and ICCs were within the acceptable range (0.76-0.91); concurrent and known groups validity were highest with the Global HRQL question. Longitudinal assessment was limited by the lack of disease progression in the group. The Neuro-QOL SFs demonstrate good internal consistency, test-re-test reliability, and concurrent and known groups validity in this MS population, supporting the validity of Neuro-QOL in adults with MS. © The Author(s), 2015.
Johansson, Fredrik R.; Skillgate, Eva; Lapauw, Mattis L.; Clijmans, Dorien; Deneulin, Valentijn P.; Palmans, Tanneke; Engineer, Human Kinetic; Cools, Ann M.
2015-01-01
Context Shoulder strength assessment plays an important role in the clinical examination of the shoulder region. Eccentric strength measurements are of special importance in guiding the clinician in injury prevention or return-to-play decisions after injury. Objective To examine the absolute and relative reliability and validity of a standardized eccentric strength-measurement protocol for the glenohumeral external rotators. Design Descriptive laboratory study. Setting Testing environment at the Department of Rehabilitation Sciences and Physiotherapy of Ghent University, Belgium. Patients or Other Participants Twenty-five healthy participants (9 men and 16 women) without any history of shoulder pain were tested by 2 independent assessors using a handheld dynamometer (HHD) and underwent an isokinetic testing procedure. Intervention(s) The clinical protocol used an HHD, a DynaPort accelerometer to measure acceleration and angular velocity of testing 30°/s over 90° of range of motion, and a Biodex dynamometer to measure isokinetic activity. Main Outcome Measure(s) Three eccentric strength measurements: (1) tester 1 with the HHD, (2) tester 2 with the HHD, and (3) Biodex isokinetic strength measurement. Results The intratester reliability was excellent (0.879 and 0.858), whereas the intertester reliability was good, with an intraclass correlation coefficient between testers of 0.714. Pearson product moment correlation coefficients of 0.78 and 0.70 were noted between the HHD and the isokinetic data, showing good validity of this new procedure. Conclusions Standardized eccentric rotator cuff strength can be tested and measured in the clinical setting with good-to-excellent reliability and validity using an HHD. PMID:25974381
Duncan, Dustin T.; Aldstadt, Jared; Whalen, John; Melly, Steven J.; Gortmaker, Steven L.
2011-01-01
Neighborhood walkability can influence physical activity. We evaluated the validity of Walk Score® for assessing neighborhood walkability based on GIS (objective) indicators of neighborhood walkability with addresses from four US metropolitan areas with several street network buffer distances (i.e., 400-, 800-, and 1,600-meters). Address data come from the YMCA-Harvard After School Food and Fitness Project, an obesity prevention intervention involving children aged 5–11 years and their families participating in YMCA-administered, after-school programs located in four geographically diverse metropolitan areas in the US (n = 733). GIS data were used to measure multiple objective indicators of neighborhood walkability. Walk Scores were also obtained for the participant’s residential addresses. Spearman correlations between Walk Scores and the GIS neighborhood walkability indicators were calculated as well as Spearman correlations accounting for spatial autocorrelation. There were many significant moderate correlations between Walk Scores and the GIS neighborhood walkability indicators such as density of retail destinations and intersection density (p < 0.05). The magnitude varied by the GIS indicator of neighborhood walkability. Correlations generally became stronger with a larger spatial scale, and there were some geographic differences. Walk Score® is free and publicly available for public health researchers and practitioners. Results from our study suggest that Walk Score® is a valid measure of estimating certain aspects of neighborhood walkability, particularly at the 1600-meter buffer. As such, our study confirms and extends the generalizability of previous findings demonstrating that Walk Score is a valid measure of estimating neighborhood walkability in multiple geographic locations and at multiple spatial scales. PMID:22163200
Validation of accelerometer wear and nonwear time classification algorithm.
Choi, Leena; Liu, Zhouwen; Matthews, Charles E; Buchowski, Maciej S
2011-02-01
the use of movement monitors (accelerometers) for measuring physical activity (PA) in intervention and population-based studies is becoming a standard methodology for the objective measurement of sedentary and active behaviors and for the validation of subjective PA self-reports. A vital step in PA measurement is the classification of daily time into accelerometer wear and nonwear intervals using its recordings (counts) and an accelerometer-specific algorithm. the purpose of this study was to validate and improve a commonly used algorithm for classifying accelerometer wear and nonwear time intervals using objective movement data obtained in the whole-room indirect calorimeter. we conducted a validation study of a wear or nonwear automatic algorithm using data obtained from 49 adults and 76 youth wearing accelerometers during a strictly monitored 24-h stay in a room calorimeter. The accelerometer wear and nonwear time classified by the algorithm was compared with actual wearing time. Potential improvements to the algorithm were examined using the minimum classification error as an optimization target. the recommended elements in the new algorithm are as follows: 1) zero-count threshold during a nonwear time interval, 2) 90-min time window for consecutive zero or nonzero counts, and 3) allowance of 2-min interval of nonzero counts with the upstream or downstream 30-min consecutive zero-count window for detection of artifactual movements. Compared with the true wearing status, improvements to the algorithm decreased nonwear time misclassification during the waking and the 24-h periods (all P values < 0.001). the accelerometer wear or nonwear time algorithm improvements may lead to more accurate estimation of time spent in sedentary and active behaviors.
Spector, P E; Jex, S M
1998-10-01
Despite the widespread use of self-report measures of both job-related stressors and strains, relatively few carefully developed scales for which validity data exist are available. In this article, we discuss 3 job stressor scales (Interpersonal Conflict at Work Scale, Organizational Constraints Scale, and Quantitative Workload Inventory) and 1 job strain scale (Physical Symptoms Inventory). Using meta-analysis, we combined the results of 18 studies to provide estimates of relations between our scales and other variables. Data showed moderate convergent validity for the 3 job stressor scales, suggesting some objectively to these self-reports. Norms for each scale are provided.
Ratanawongsa, Neda; Karter, Andrew J; Quan, Judy; Parker, Melissa M; Handley, Margaret; Sarkar, Urmimala; Schmittdiel, Julie A; Schillinger, Dean
2015-08-01
With the expansion of Medicaid and low-cost health insurance plans among diverse patient populations, objective measures of medication adherence using pharmacy claims could advance clinical care and translational research for safety net care. However, safety net patients may experience fluctuating prescription drug coverage, affecting the performance of adherence measures. To evaluate the performance of continuous medication gap (CMG) for diverse, low-income managed care members with diabetes. We conducted this cross-sectional analysis using administrative and clinical data for 680 members eligible for a self-management support trial at a nonprofit, government-sponsored managed care plan. We applied CMG methodology to cardiometabolic medication claims for English- , Cantonese- , or Spanish-speaking members with diabetes. We examined inclusiveness (the proportion with calculable CMG) and selectivity (sociodemographic and medical differences from members without CMG). For validity, we examined unadjusted associations of suboptimal adherence (CMG > 20%) with suboptimal cardiometabolic control. 429 members (63%) had calculable CMG. Compared with members without CMG, members with CMG were younger, more likely employed, and had poorer glycemic control but had better blood pressure and lipid control. Suboptimal adherence occurred more frequently among members with poor cardiometabolic control than among members with optimal control (28% vs. 12%, P = 0.02). CMG demonstrated acceptable inclusiveness and validity in a diverse, low-income safety net population, comparable with its performance in studies among other insured populations. CMG may provide a useful tool to measure adherence among increasingly diverse Medicaid populations, complemented by other strategies to reach those not captured by CMG.
Measuring Implementation Fidelity in a Community-Based Parenting Intervention
Breitenstein, Susan M.; Fogg, Louis; Garvey, Christine; Hill, Carri; Resnick, Barbara; Gross, Deborah
2012-01-01
Background Establishing the feasibility and validity of implementation fidelity monitoring strategies is an important methodological step in implementing evidence-based interventions on a large scale. Objectives The objective of the study was to examine the reliability and validity of the Fidelity Checklist, a measure designed to assess group leader adherence and competence delivering a parent training intervention (the Chicago Parent Program) in child care centers serving low-income families. Method The sample included 9 parent groups (12 group sessions each), 12 group leaders, and 103 parents. Independent raters reviewed 106 audiotaped parent group sessions and coded group leaders’ fidelity on the Adherence and Competence Scales of the Fidelity Checklist. Group leaders completed self-report adherence checklists and a measure of parent engagement in the intervention. Parents completed measures of consumer satisfaction and child behavior. Results High interrater agreement (Adherence Scale = 94%, Competence Scale = 85%) and adequate intraclass correlation coefficients (Adherence Scale = .69, Competence Scale = .91) were achieved for the Fidelity Checklist. Group leader adherence changed over time, but competence remained stable. Agreement between group leader self-report and independent ratings on the Adherence Scale was 85%; disagreements were more frequently due to positive bias in group leader self-report. Positive correlations were found between group leader adherence and parent attendance and engagement in the intervention and between group leader competence and parent satisfaction. Although child behavior problems improved, improvements were not related to fidelity. Discussion The results suggest that the Fidelity Checklist is a feasible, reliable, and valid measure of group leader implementation fidelity in a group-based parenting intervention. Future research will be focused on testing the Fidelity Checklist with diverse and larger samples and generalizing to other group-based interventions using a similar intervention model. PMID:20404777
On the magnetic polarizability tensor of US coinage
NASA Astrophysics Data System (ADS)
Davidson, John L.; Abdel-Rehim, Omar A.; Hu, Peipei; Marsh, Liam A.; O'Toole, Michael D.; Peyton, Anthony J.
2018-03-01
The magnetic dipole polarizability tensor of a metallic object gives unique information about the size, shape and electromagnetic properties of the object. In this paper, we present a novel method of coin characterization based on the spectroscopic response of the absolute tensor. The experimental measurements are validated using a combination of tests with a small set of bespoke coin surrogates and simulated data. The method is applied to an uncirculated set of US coins. Measured and simulated spectroscopic tensor responses of the coins show significant differences between different coin denominations. The presented results are encouraging as they strongly demonstrate the ability to characterize coins using an absolute tensor approach.
Using Clinical Data Standards to Measure Quality: A New Approach.
D'Amore, John D; Li, Chun; McCrary, Laura; Niloff, Jonathan M; Sittig, Dean F; McCoy, Allison B; Wright, Adam
2018-04-01
Value-based payment for care requires the consistent, objective calculation of care quality. Previous initiatives to calculate ambulatory quality measures have relied on billing data or individual electronic health records (EHRs) to calculate and report performance. New methods for quality measure calculation promoted by federal regulations allow qualified clinical data registries to report quality outcomes based on data aggregated across facilities and EHRs using interoperability standards. This research evaluates the use of clinical document interchange standards as the basis for quality measurement. Using data on 1,100 patients from 11 ambulatory care facilities and 5 different EHRs, challenges to quality measurement are identified and addressed for 17 certified quality measures. Iterative solutions were identified for 14 measures that improved patient inclusion and measure calculation accuracy. Findings validate this approach to improving measure accuracy while maintaining measure certification. Organizations that report care quality should be aware of how identified issues affect quality measure selection and calculation. Quality measure authors should consider increasing real-world validation and the consistency of measure logic in respect to issues identified in this research. Schattauer GmbH Stuttgart.
NASA Astrophysics Data System (ADS)
Xu, Baodong; Li, Jing; Liu, Qinhuo; Zeng, Yelu; Yin, Gaofei
2014-11-01
Leaf Area Index (LAI) is known as a key vegetation biophysical variable. To effectively use remote sensing LAI products in various disciplines, it is critical to understand the accuracy of them. The common method for the validation of LAI products is firstly establish the empirical relationship between the field data and high-resolution imagery, to derive LAI maps, then aggregate high-resolution LAI maps to match moderate-resolution LAI products. This method is just suited for the small region, and its frequencies of measurement are limited. Therefore, the continuous observing LAI datasets from ground station network are important for the validation of multi-temporal LAI products. However, due to the scale mismatch between the point observation in the ground station and the pixel observation, the direct comparison will bring the scale error. Thus it is needed to evaluate the representativeness of ground station measurement within pixel scale of products for the reasonable validation. In this paper, a case study with Chinese Ecosystem Research Network (CERN) in situ data was taken to introduce a methodology to estimate representativeness of LAI station observation for validating LAI products. We first analyzed the indicators to evaluate the observation representativeness, and then graded the station measurement data. Finally, the LAI measurement data which can represent the pixel scale was used to validate the MODIS, GLASS and GEOV1 LAI products. The result shows that the best agreement is reached between the GLASS and GEOV1, while the lowest uncertainty is achieved by GEOV1 followed by GLASS and MODIS. We conclude that the ground station measurement data can validate multi-temporal LAI products objectively based on the evaluation indicators of station observation representativeness, which can also improve the reliability for the validation of remote sensing products.
Objective speech quality evaluation of real-time speech coders
NASA Astrophysics Data System (ADS)
Viswanathan, V. R.; Russell, W. H.; Huggins, A. W. F.
1984-02-01
This report describes the work performed in two areas: subjective testing of a real-time 16 kbit/s adaptive predictive coder (APC) and objective speech quality evaluation of real-time coders. The speech intelligibility of the APC coder was tested using the Diagnostic Rhyme Test (DRT), and the speech quality was tested using the Diagnostic Acceptability Measure (DAM) test, under eight operating conditions involving channel error, acoustic background noise, and tandem link with two other coders. The test results showed that the DRT and DAM scores of the APC coder equalled or exceeded the corresponding test scores fo the 32 kbit/s CVSD coder. In the area of objective speech quality evaluation, the report describes the development, testing, and validation of a procedure for automatically computing several objective speech quality measures, given only the tape-recordings of the input speech and the corresponding output speech of a real-time speech coder.
Discharge rate measurements in a canal using radiotracer methods.
Pant, H J; Goswami, Sunil; Biswal, Jayashree; Samantray, J S; Sharma, V K
2016-06-01
Discharge rates of water were measured in a canal using radiotracer methods with an objective to validate the efficacy of Concrete Volute Pumps (CVPs) installed at various pumping stations along the canal. Pulse velocity and dilution methods were applied to measure the discharge rates using Iodine-131 as a radiotracer. The discharge rate measured in one of the sections of the canal using the pulse velocity method was found to be 22.5m(3)/s, whereas the discharge rates measured using the dilution method in four different sections of the canal varied from 20.27 to 20.62m(3)/s with single CVP in operation. The standard error in discharge rate measurements using dilution method ranged from ±1.1 to ±1.8%. The experimentally measured values of the discharge rate were in good agreement with the design value of the discharge rate (20m(3)/s) thus validating the performance of the CVPs used in the canal. Copyright © 2016 Elsevier Ltd. All rights reserved.
Van Oyen, Herman; Bogaert, Petronille; Yokota, Renata T C; Berger, Nicolas
2018-01-01
GALI or Global Activity Limitation Indicator is a global survey instrument measuring participation restriction. GALI is the measure underlying the European indicator Healthy Life Years (HLY). Gali has a substantial policy use within the EU and its Member States. The objective of current paper is to bring together what is known from published manuscripts on the validity and the reliability of GALI. Following the PRISMA guidelines, two search strategies (PUBMED, Google Scholar) were combined to identify manuscripts published in English with publication date 2000 or beyond. Articles were classified as reliability studies, concurrent or predictive validity studies, in national or international populations. Four cross-sectional studies (of which 2 international) studied how GALI relates to other health measures (concurrent validity). A dose-response effect by GALI severity level on the association with the other health status measures was observed in the national studies. The 2 international studies (SHARE, EHIS) concluded that the odds of reporting participation restriction was higher in subjects with self-reported or observed functional limitations. In SHARE, the size of the Odds Ratio's (ORs) in the different countries was homogeneous, while in EHIS the size of the ORs varied more strongly. For the predictive validity, subjects were followed over time (4 studies of which one international). GALI proved, both in national and international data, to be a consistent predictor of future health outcomes both in terms of mortality and health care expenditure. As predictors of mortality, the two distinct health concepts, self-rated health and GALI, acted independently and complementary of each other. The one reliability study identified reported a sufficient reliability of GALI. GALI as inclusive one question instrument fits all conceptual characteristics specified for a global measure on participation restriction. In none of the studies, included in the review, there was evidence of a failing validity. The review shows that GALI has a good and sufficient concurrent and predictive validity, and reliability.
NASA Technical Reports Server (NTRS)
Moes, Timothy R.
2009-01-01
The principal objective of the Supersonics Project is to develop and validate multidisciplinary physics-based predictive design, analysis and optimization capabilities for supersonic vehicles. For aircraft, the focus will be on eliminating the efficiency, environmental and performance barriers to practical supersonic flight. Previous flight projects found that a shaped sonic boom could propagate all the way to the ground (F-5 SSBD experiment) and validated design tools for forebody shape modifications (F-5 SSBD and Quiet Spike experiments). The current project, Lift and Nozzle Change Effects on Tail Shock (LaNCETS) seeks to obtain flight data to develop and validate design tools for low-boom tail shock modifications. Attempts will be made to alter the shock structure of NASA's NF-15B TN/837 by changing the lift distribution by biasing the canard positions, changing the plume shape by under- and over-expanding the nozzles, and changing the plume shape using thrust vectoring. Additional efforts will measure resulting shocks with a probing aircraft (F-15B TN/836) and use the results to validate and update predictive tools. Preliminary flight results are presented and are available to provide truth data for developing and validating the CFD tools required to design low-boom supersonic aircraft.
The psychometric properties of the Retrospective Child Feeding Questionnaire in Hebrew.
Lev-Ari, Lilac; Zohar, Ada H
2013-06-01
The objective of this study was to develop the Retrospective Child Feeding Questionnaire (RCFQ), and to assess its structural validity. In its original version, the CFQ was constructed to measure current practices of maternal feeding of children. For the present study, the CFQ was translated into Hebrew by translation, independent back-translation, and revision, and was then reworded to assess a retrospective assessment of maternal child feeding practices by adults. A large community sample of volunteers (N=406) was recruited and administered the RCFQ, and self-reported on body satisfaction, disordered eating, and body mass. The structural validity of the RCFQ was established by exploratory and confirmatory factor analysis for men and women. Some measure of construct validity is provided by correlational analysis. The RCFQ is structurally robust, and useful in assessing early influences on adult BMI, eating behavior, and body dissatisfaction. Copyright © 2013 Elsevier Ltd. All rights reserved.
Xia, Zeyang; Chen, Jie
2014-01-01
Objectives To develop an artificial tooth–periodontal ligament (PDL)–bone complex (ATPBC) that simulates clinical crown displacement. Material and Methods An ATPBC was created. It had a socket hosting a tooth with a thin layer of silicon mixture in between for simulating the PDL. The complex was attached to a device that allows applying a controlled force to the crown and measuring the resulting crown displacement. Crown displacements were compared to previously published data for validation. Results The ATPBC that had a PDL made of two types of silicones, 50% gasket sealant No. 2 and 50% RTV 587 silicone, with a thickness of 0.3 mm, simulated the PDL well. The mechanical behaviors (1) force-displacement relationship, (2) stress relaxation, (3) creep, and (4) hysteresis were validated by the published results. Conclusion The ATPBC simulated the crown displacement behavior reported from biological studies well. PMID:22970752
Hinton, Pamela S; Kubas, Karen L
2005-01-01
Female athletes may be at greater risk for disordered eating than their nonathletic peers, but the psychological antecedents of this dysfunctional behavior in athletes have yet to be elucidated. The objective of this study was to develop an athletics-oriented measure of psychological predictors of disordered eating and to test its initial reliability and validity. Female athletes from 3 National Collegiate Athletics Association (NCAA) Division I universities completed the ATHLETE, a written questionnaire designed to assess psychosocial factors associated with disordered eating in athletes. Five distinct and internally consistent factors (Drive for Thinness and Performance, Social Pressure on Eating, Performance Perfectionism, Social Pressure on Body Shape, and Team Trust) were positively associated with and predictive of disordered eating behaviors in female athletes. The ATHLETE is a reliable and valid measure of psychological predictors of disordered eating in athletics and will be useful in studying the etiology of disordered eating in female athletes.
Measuring Empathy in Pharmacy Students
Van Winkle, Lon J.; Hojat, Mohammadreza
2011-01-01
Objective. To validate the Jefferson Scale of Empathy-Health Profession Students version (JSE-HPS) in pharmacy students. Methods. The JSE-HPS (20 items), adapted from the original Jefferson Scale of Empathy for use among students in the healthcare professions, was completed by 187 first-year pharmacy students at Midwestern University Chicago College of Pharmacy. Results. Two factors, “perspective-taking” and “compassionate care,” emerged from factor analysis in this study, accounting for 31% and 8% of the variance, respectively. These factors are similar to the prominent ones reported in previous research involving physicians and medical students, supporting the construct validity of this instrument for pharmacy students. In the current study, mean JSE-HPS score was comparable to those reported for medical students, and consistent with previous findings with medical students and physicians. Women scored significantly higher than men. Conclusions. Findings support the construct validity and reliability of the JSE-HPS for measuring empathy in pharmacy students. PMID:21931447
Shea, Beverley J; Grimshaw, Jeremy M; Wells, George A; Boers, Maarten; Andersson, Neil; Hamel, Candyce; Porter, Ashley C; Tugwell, Peter; Moher, David; Bouter, Lex M
2007-02-15
Our objective was to develop an instrument to assess the methodological quality of systematic reviews, building upon previous tools, empirical evidence and expert consensus. A 37-item assessment tool was formed by combining 1) the enhanced Overview Quality Assessment Questionnaire (OQAQ), 2) a checklist created by Sacks, and 3) three additional items recently judged to be of methodological importance. This tool was applied to 99 paper-based and 52 electronic systematic reviews. Exploratory factor analysis was used to identify underlying components. The results were considered by methodological experts using a nominal group technique aimed at item reduction and design of an assessment tool with face and content validity. The factor analysis identified 11 components. From each component, one item was selected by the nominal group. The resulting instrument was judged to have face and content validity. A measurement tool for the 'assessment of multiple systematic reviews' (AMSTAR) was developed. The tool consists of 11 items and has good face and content validity for measuring the methodological quality of systematic reviews. Additional studies are needed with a focus on the reproducibility and construct validity of AMSTAR, before strong recommendations can be made on its use.
Criterion-Referenced Testing in Foreign Language Teaching.
ERIC Educational Resources Information Center
Takala, Sauli
A review of literature serves as the basis for a discussion of various aspects of criterion-referenced tests. The aspects discussed are: teaching and evaluation objectives, criterion- and norm-referenced measurement, stages in construction of criterion-referenced tests, construction and selection of items, test validity, and test reliability.…
Comparison of Field Measurements to Methane Emissions Models at a New Landfill
Due to both technical and economic limitations, estimates of methane emissions from landfills rely primarily on models. While models are easy to implement, there is uncertainty due to the use of parameters that are difficult to validate. The objective of this research was to comp...
USDA-ARS?s Scientific Manuscript database
Stool form and changes in stool form are important criteria in both clinical practice and clinical research. However, descriptions of stool form from both patients and physicians alike may be subjective and objective measurements of stool form are not well developed. Although the Bristol stool scale...
Plant, soil and weather-based cues for irrigation termination timing in soybean.
USDA-ARS?s Scientific Manuscript database
Irrigation termination timing was evaluated on Mississippi County commercial farms in 2014 and 2015 in furrow-irrigated fields with Sharkey clay soils. A major objective was to validate and expand irrigation timing recommendations that pair plant growth measures with weather cues including use of lo...
Using Comparison Peers as an Objective Measure of Social Validity: Recommendations for Researchers
ERIC Educational Resources Information Center
Ennis, Robin Parks; Jolivette, Kristine; Fredrick, Laura D.; Alberto, Paul A.
2013-01-01
In this article, students with challenging behaviors (SWCB) in a classroom may include those with attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder (ASD), emotional and behavioral disorders (E/BD), intellectual disabilities, learning disabilities, and those at risk of these disabilities. These students may present…
Irrigation initiation timing in soybean grown on sandy soils in Northeast Arkansas
USDA-ARS?s Scientific Manuscript database
Irrigation initiation timing was evaluated in furrow-irrigated soybean field with sandy soils in Mississippi County, AR. A major objective of this 2015 study was to validate and expand irrigation timing recommendations that pair plant growth measures with weather cues including use of local weather ...
Toward Objectivity in Diagnosing Learning Disabilities: Refinement of Established Procedures.
ERIC Educational Resources Information Center
Goodman, Marvin; Mina, Elias
Variability in diagnostic procedures and a lack of valid and reliable measures led to the development of a comprehensive battery, which incorporated an operational definition of learning disabilities. The battery consisted of forms for observing these functions: intelligence, academic achievement, gross and fine motor control, visual perception,…
Developing a Questionnaire to Measure Perceived Attributes of eHealth Innovations
ERIC Educational Resources Information Center
Atkinson, Nancy L.
2007-01-01
Objectives: To design a valid and reliable questionnaire to assess perceived attributes of technology-based health education innovations. Methods: College students in 12 personal health courses reviewed a prototype eHealth intervention using a 30-item instrument based upon diffusion theory's perceived attributes of an innovation. Results:…
Psychometric Properties of the Commitment to Physical Activity Scale
ERIC Educational Resources Information Center
DeBate, Rita DiGioacchino; Huberty, Jennifer; Pettee, Kelley
2009-01-01
Objective: To assess psychometric properties of the Commitment to Physical Activity Scale (CPAS). Methods: Girls in third to fifth grades (n = 932) completed the CPAS before and after a physical activity intervention. Psychometric measures included internal consistency, factor analysis, and concurrent validity. Results: Three CPAS factors emerged:…
The Development of an Objective Scale to Measure a Transpersonal Orientation to Learning.
ERIC Educational Resources Information Center
Shapiro, Stewart B.; Fitzgerald, Louise F.
1989-01-01
A 40-item Likert scale, Transpersonal Orientation to Learning, was developed to investigate transpersonal (spiritual or mystical) orientation. The scale was validated via administration to 166 graduate students in education to determine their beliefs about the development of spiritual potential in learning environments. Satisfactory reliability…
USDA-ARS?s Scientific Manuscript database
Quantitative information on sediment provenance is badly needed for calibration and validation of process-based soil erosion models. However, sediment source data are rather limited due to difficulties in direct measurement of various source contributions at a watershed scale. The objectives are t...
Multi-site p-loss assessment from privately owned cropland in Northeast Missouri
USDA-ARS?s Scientific Manuscript database
Phosphorus exported from watersheds can accelerate eutrophication and is identified as one of the main causes of water impairment. Accurate phosphorus (P) loss assessment has become vital for effective implementation of conservation measures. The study objective was to assess the validity of a cla...
Assessment of Preschool Hyperactivity: Combining Rating Scale and Objective Observation Measures.
ERIC Educational Resources Information Center
Mayes, Susan Dickerson
1987-01-01
Advantages and disadvantages of behavior rating scales and observation systems are presented, followed by preliminary validity data for the Mayes Hyperactivity Observation System, a clinically feasible system to identify preschool children with both Attention Deficit Disorder and Hyperactivity. Hyperactive and normal children were identified with…
Izuma, Keise; Kennedy, Kate; Fitzjohn, Alexander; Sedikides, Constantine; Shibata, Kazuhisa
2018-03-01
Self-esteem, arguably the most important attitudes an individual possesses, has been a premier research topic in psychology for more than a century. Following a surge of interest in implicit attitude measures in the 90s, researchers have tried to assess self-esteem implicitly to circumvent the influence of biases inherent in explicit measures. However, the validity of implicit self-esteem measures remains elusive. Critical tests are often inconclusive, as the validity of such measures is examined in the backdrop of imperfect behavioral measures. To overcome this serious limitation, we tested the neural validity of the most widely used implicit self-esteem measure, the implicit association test (IAT). Given the conceptualization of self-esteem as attitude toward the self, and neuroscience findings that the reward-related brain regions represent an individual's attitude or preference for an object when viewing its image, individual differences in implicit self-esteem should be associated with neural signals in the reward-related regions during passive-viewing of self-face (the most obvious representation of the self). Using multi-voxel pattern analysis (MVPA) on functional MRI (fMRI) data, we demonstrate that the neural signals in the reward-related regions were robustly associated with implicit (but not explicit) self-esteem, thus providing unique evidence for the neural validity of the self-esteem IAT. In addition, both implicit and explicit self-esteem were related, although differently, to neural signals in regions involved in self-processing. Our finding highlights the utility of neuroscience methods in addressing fundamental psychological questions and providing unique insights into important psychological constructs. (PsycINFO Database Record (c) 2018 APA, all rights reserved).
Examining techniques for measuring the effects of nutrients on mental performance and mood state.
Hamer, Mark; Dye, Louise; Siobhan Mitchell, E; Layé, Sophie; Saunders, Caroline; Boyle, Neil; Schuermans, Jeroen; Sijben, John
2016-09-01
Intake of specific nutrients has been linked to mental states and various indices of cognitive performance although the effects are often subtle and difficult to interpret. Measurement of so-called objective variables (e.g. reaction times) is often considered to be the gold standard for assessing outcomes in this field of research. It can, however, be argued that data on subjective experience (e.g. mood) are also important and may enrich existing objective data. The aim of this review is to evaluate methods for measuring mental performance and mood, considering the definition of subjective mood and the validity of measures of subjective experience. A multi-stakeholder expert group was invited by ILSI Europe to come to a consensus around the utility of objective and subjective measurement in this field, which forms the basis of the paper. Therefore, the present review reflects a succinct overview of the science but is not intended to be a systematic review. The proposed approach extends the traditional methodology using standard 'objective' measurements to also include the consumers' subjective experiences in relation to food. Specific recommendations include 1) using contemporary methods to capture transient mood states; 2) using sufficiently sensitive measures to capture effects of nutritional intervention; 3) considering the possibility that subjective and objective responses will occur over different time frames; and 4) recognition of the importance of expectancy and placebo effects for subjective measures. The consensus reached was that the most informative approach should involve collection and consideration of both objective and subjective data.
Kerns, Connor Morrow; Renno, Patricia; Kendall, Philip C.; Wood, Jeffrey J.; Storch, Eric A.
2017-01-01
Objective Assessing anxiety in autism spectrum disorder (ASD) is inherently challenging due to overlapping (e.g., social avoidance) and ambiguous symptoms (e.g., fears of change). An ASD addendum to the Anxiety Disorders Interview Schedule–Child/Parent, Parent Version (ADIS/ASA) was developed to provide a systematic approach for differentiating traditional anxiety disorders from symptoms of ASD and more ambiguous, ASD-related anxiety symptoms. Method Inter-rater reliability and convergent and discriminant validity were examined in a sample of 69 youth with ASD (8–13 years, 75% male, IQ:68–143) seeking treatment for anxiety. The parents of participants completed the ADIS/ASA and a battery of behavioral measures. A second rater independently observed and scored recordings of the original interviews. Results Findings suggest reliable measurement of comorbid (ICC=0.85–0.98; κ =0.67–0.91) as well as ambiguous anxiety-like symptoms (ICC=0.87–95, κ=0.77–0.90) in children with ASD. Convergent and discriminant validity were supported for the traditional anxiety symptoms on the ADIS/ASA, whereas convergent and discriminant validity were partially supported for the ambiguous anxiety-like symptoms. Conclusions Results provide evidence for the reliability and validity of the ADIS/ASA as a measure of traditional anxiety categories in youth with ASD, with partial support for the validity of the ambiguous anxiety-like categories. Unlike other measures, the ADIS/ASA differentiates comorbid anxiety disorders from overlapping and ambiguous anxiety-like symptoms in ASD, allowing for more precise measurement and clinical conceptualization. Ambiguous anxiety-like symptoms appear phenomenologically distinct from comorbid anxiety disorders and may reflect either symptoms of ASD or a novel variant of anxiety in ASD. PMID:27925775
Goldenberg, Neil A.; Donadini, Marco P.; Kahn, Susan R.; Crowther, Mark; Kenet, Gili; Nowak-Göttl, Ulrike; Manco-Johnson, Marilyn J.
2010-01-01
Background Post-thrombotic syndrome is a manifestation of chronic venous insufficiency following deep venous thrombosis. This systematic review was conducted to critically evaluate pediatric evidence on frequency of occurrence, validity of outcome measures, and prognostic indicators of post-thrombotic syndrome. Design and Methods A comprehensive literature search of original reports revealed 19 eligible studies, totaling 977 patients with upper/lower extremity deep venous thrombosis. Calculated weighted mean frequency of post-thrombotic syndrome was 26% (95% confidence interval: 23–28%) overall, and differed significantly by prospective/non-prospective analysis and use/non-use of a standardized outcome measure. Results Standardized post-thrombotic syndrome outcome measures included an adaptation of the Villalta scale, the Clinical-Etiologic-Anatomic-Pathologic classification, and the Manco-Johnson instrument. Data on validity were reported only for the Manco-Johnson instrument. No publications on post-thrombotic syndrome-related quality of life outcomes were identified. Candidate prognostic factors for post-thrombotic syndrome in prospective studies included use/non-use of thrombolysis and plasma levels of factor VIII activity and D-dimer. Conclusions Given that affected children must endure chronic sequelae for many decades, it is imperative that future collaborative pediatric prospective cohort studies and trials assess as key objectives and outcomes the incidence, severity, prognostic indicators, and health impact of post-thrombotic syndrome, using validated measures. PMID:20595095
Measuring Physical Activity in Pregnancy Using Questionnaires: A Meta-Analysis
Schuster, Snježana; Šklempe Kokić, Iva; Sindik, Joško
2016-09-01
Physical activity (PA) during normal pregnancy has various positive effects on pregnant women’s health. Determination of the relationship between PA and health outcomes requires accurate measurement of PA in pregnant women. The purpose of this review is to provide a summary of valid and reliable PA questionnaires for pregnant women. During 2013, Pubmed, OvidSP and Web of Science databases were searched for trials on measurement properties of PA questionnaires for pregnant population. Six studies and four questionnaires met the inclusion criteria: Pregnancy Physical Activity Questionnaire, Modified Kaiser Physical Activity Survey, Short Pregnancy Leisure Time Physical Activity Questionnaire and Third Pregnancy Infection and Nutrition Study Physical Activity Questionnaire. Assessment of validity and reliability was performed using correlations of the scores in these questionnaires with objective measures and subjective measures (self-report) of PA, as well as test-retest reliability coefficients. Sample sizes included in analysis varied from 45 to 177 subjects. The best validity and reliability characteristics (together with effect sizes) were identified for the Modified Kaiser Physical Activity Survey and Pregnancy Physical Activity Questionnaire (French, Vietnamese, standard). In conclusion, assessment of PA during pregnancy remains a challenging and complex task. Questionnaires are a simple and effective, yet limited tool for assessing PA.
Patient-completed or symptom-based screening tools for endometriosis: a scoping review.
Surrey, Eric; Carter, Cathryn M; Soliman, Ahmed M; Khan, Shahnaz; DiBenedetti, Dana B; Snabes, Michael C
2017-08-01
The objective of this review was to evaluate existing patient-completed screening questionnaires and/or symptom-based predictive models with respect to their potential for use as screening tools for endometriosis in adult women. Validated instruments were of particular interest. We conducted structured searches of PubMed and targeted searches of the gray literature to identify studies reporting on screening instruments used in endometriosis. Studies were screened according to inclusion and exclusion criteria that followed the PICOS (population, intervention, comparison, outcomes, study design) framework. A total of 16 studies were identified, of which 10 described measures for endometriosis in general, 2 described measures for endometriosis at specific sites, and 4 described measures for deep-infiltrating endometriosis. Only 1 study evaluated a questionnaire that was solely patient-completed. Most measures required physician, imaging, or laboratory assessments in addition to patient-completed questionnaires, and several measures relied on complex scoring. Validation for use as a screening tool in adult women with potential endometriosis was lacking in all studies, as most studies focused on diagnosis versus screening. This literature review did not identify any fully validated, symptom-based, patient-reported questionnaires for endometriosis screening in adult women.
The German Version of the Gaze Anxiety Rating Scale (GARS): Reliability and Validity.
Domes, Gregor; Marx, Lisa; Spenthof, Ines; Heinrichs, Markus
2016-01-01
Fear of eye gaze and avoidance of eye contact are core features of social anxiety disorders (SAD). To measure self-reported fear and avoidance of eye gaze, the Gaze Anxiety Rating Scale (GARS) has been developed and validated in recent years in its English version. The main objectives of the present study were to psychometrically evaluate the German translation of the GARS concerning its reliability, factorial structure, and validity. Three samples of participants were enrolled in the study. (1) A non-patient sample (n = 353) completed the GARS and a set of trait questionnaires to assess internal consistency, test-retest reliability, factorial structure, and concurrent and divergent validity. (2) A sample of patients with SAD (n = 33) was compared to a healthy control group (n = 30) regarding their scores on the GARS and the trait measures. The German GARS fear and avoidance scales exhibited excellent internal consistency and high stability over 2 and 4 months, as did the original version. The English version's factorial structure was replicated, yielding two categories of situations: (1) everyday situations and (2) situations involving high evaluative threat. GARS fear and avoidance displayed convergent validity with trait measures of social anxiety and were markedly higher in patients with GSAD than in healthy controls. Fear and avoidance of eye contact in situations involving high levels of evaluative threat related more closely to social anxiety than to gaze anxiety in everyday situations. The German version of the GARS has demonstrated reliability and validity similar to the original version, and is thus well suited to capture fear and avoidance of eye contact in different social situations as a valid self-report measure of social anxiety and related disorders in the social domain for use in both clinical practice and research.
Enhanced data validation strategy of air quality monitoring network.
Harkat, Mohamed-Faouzi; Mansouri, Majdi; Nounou, Mohamed; Nounou, Hazem
2018-01-01
Quick validation and detection of faults in measured air quality data is a crucial step towards achieving the objectives of air quality networks. Therefore, the objectives of this paper are threefold: (i) to develop a modeling technique that can be used to predict the normal behavior of air quality variables and help provide accurate reference for monitoring purposes; (ii) to develop fault detection method that can effectively and quickly detect any anomalies in measured air quality data. For this purpose, a new fault detection method that is based on the combination of generalized likelihood ratio test (GLRT) and exponentially weighted moving average (EWMA) will be developed. GLRT is a well-known statistical fault detection method that relies on maximizing the detection probability for a given false alarm rate. In this paper, we propose to develop GLRT-based EWMA fault detection method that will be able to detect the changes in the values of certain air quality variables; (iii) to develop fault isolation and identification method that allows defining the fault source(s) in order to properly apply appropriate corrective actions. In this paper, reconstruction approach that is based on Midpoint-Radii Principal Component Analysis (MRPCA) model will be developed to handle the types of data and models associated with air quality monitoring networks. All air quality modeling, fault detection, fault isolation and reconstruction methods developed in this paper will be validated using real air quality data (such as particulate matter, ozone, nitrogen and carbon oxides measurement). Copyright © 2017 Elsevier Inc. All rights reserved.
Validation of Storm Water Management Model Storm Control Measures Modules
NASA Astrophysics Data System (ADS)
Simon, M. A.; Platz, M. C.
2017-12-01
EPA's Storm Water Management Model (SWMM) is a computational code heavily relied upon by industry for the simulation of wastewater and stormwater infrastructure performance. Many municipalities are relying on SWMM results to design multi-billion-dollar, multi-decade infrastructure upgrades. Since the 1970's, EPA and others have developed five major releases, the most recent ones containing storm control measures modules for green infrastructure. The main objective of this study was to quantify the accuracy with which SWMM v5.1.10 simulates the hydrologic activity of previously monitored low impact developments. Model performance was evaluated with a mathematical comparison of outflow hydrographs and total outflow volumes, using empirical data and a multi-event, multi-objective calibration method. The calibration methodology utilized PEST++ Version 3, a parameter estimation tool, which aided in the selection of unmeasured hydrologic parameters. From the validation study and sensitivity analysis, several model improvements were identified to advance SWMM LID Module performance for permeable pavements, infiltration units and green roofs, and these were performed and reported herein. Overall, it was determined that SWMM can successfully simulate low impact development controls given accurate model confirmation, parameter measurement, and model calibration.
Arnold, Donald H; Wang, Li; Hartert, Tina V
2016-03-01
Pulsus paradoxus is one of the few objective bedside measures of acute asthma exacerbation severity but is difficult to measure in tachypneic and tachycardic patients and in noisy clinical environments. Our primary objective was to examine whether pulse oximeter plethysmograph estimate of pulsus paradoxus (PEP) is associated with physiologic and symptom measures of acute exacerbation severity (airway resistance by impulse oscillometry [%IOS] and the Acute Asthma Intensity Research Score [AAIRS]). Secondary objectives were to validate the previous association of PEP with percent predicted forced expiratory volume in 1 second (%FEV1 ) and to examine associations of change of PEP with change of these outcomes after 2 hours of treatment. This was a secondary analysis of data from a prospective observational study of patients aged 5-17 years with acute asthma exacerbations. The predictor variable, PEP, was measured using a dedicated pulse oximeter and waveform analysis program. Outcome measures included the AAIRS, %IOS, and %FEV1 at baseline and after 2 hours of treatment. We examined associations of PEP with %IOS and the AAIRS at baseline using multiple linear regression models adjusted for age, sex, and race. As secondary analyses we similarly examined the association of PEP with %FEV1 at baseline and change of PEP with change of %IOS, the AAIRS, and %FEV1 after 2 hours of treatment using multiple linear regression models adjusted for the baseline value of the outcome measure and the AAIRS. Among 684 participants (61% males; 61% African American) there were associations of baseline PEP with %IOS, the AAIRS, and %FEV1 (p < 0.001). Change of PEP after 2 hours of treatment was associated with change of %FEV1 (p < 0.001) and change of the AAIRS (p = 0.01) but not with change of %IOS (p = 0.60). PEP demonstrates criterion validity in predicting baseline %IOS, the AAIRS, and %FEV1 , and responsiveness to change of the AAIRS and %FEV1 . Data contained in the oximeter plethysmograph waveform might be utilized as a continuous, objective measure of acute asthma exacerbation severity and real-time response to treatment. © 2016 by the Society for Academic Emergency Medicine.
McGaghie, William C; Cohen, Elaine R; Wayne, Diane B
2011-01-01
United States Medical Licensing Examination (USMLE) scores are frequently used by residency program directors when evaluating applicants. The objectives of this report are to study the chain of reasoning and evidence that underlies the use of USMLE Step 1 and 2 scores for postgraduate medical resident selection decisions and to evaluate the validity argument about the utility of USMLE scores for this purpose. This is a research synthesis using the critical review approach. The study first describes the chain of reasoning that underlies a validity argument about using test scores for a specific purpose. It continues by summarizing correlations of USMLE Step 1 and 2 scores and reliable measures of clinical skill acquisition drawn from nine studies involving 393 medical learners from 2005 to 2010. The integrity of the validity argument about using USMLE Step 1 and 2 scores for postgraduate residency selection decisions is tested. The research synthesis shows that USMLE Step 1 and 2 scores are not correlated with reliable measures of medical students', residents', and fellows' clinical skill acquisition. The validity argument about using USMLE Step 1 and 2 scores for postgraduate residency selection decisions is neither structured, coherent, nor evidence based. The USMLE score validity argument breaks down on grounds of extrapolation and decision/interpretation because the scores are not associated with measures of clinical skill acquisition among advanced medical students, residents, and subspecialty fellows. Continued use of USMLE Step 1 and 2 scores for postgraduate medical residency selection decisions is discouraged.
Salisbury, Joseph P; Keshav, Neha U; Sossong, Anthony D
2018-01-01
Background Lightweight and portable devices that objectively measure concussion-related impairments could improve injury detection and critical decision-making in contact sports and the military, where brain injuries commonly occur but remain underreported. Current standard assessments often rely heavily on subjective methods such as symptom self-reporting. Head-mounted wearables, such as smartglasses, provide an emerging platform for consideration that could deliver the range of assessments necessary to develop a rapid and objective screen for brain injury. Standing balance assessment, one parameter that may inform a concussion diagnosis, could theoretically be performed quantitatively using current off-the-shelf smartglasses with an internal accelerometer. However, the validity of balance measurement using smartglasses has not been investigated. Objective This study aimed to perform preliminary validation of a smartglasses-based balance accelerometer measure (BAM) compared with the well-described and characterized waist-based BAM. Methods Forty-two healthy individuals (26 male, 16 female; mean age 23.8 [SD 5.2] years) participated in the study. Following the BAM protocol, each subject performed 2 trials of 6 balance stances while accelerometer and gyroscope data were recorded from smartglasses (Glass Explorer Edition). Test-retest reliability and correlation were determined relative to waist-based BAM as used in the National Institutes of Health’s Standing Balance Toolbox. Results Balance measurements obtained using a head-mounted wearable were highly correlated with those obtained through a waist-mounted accelerometer (Spearman rho, ρ=.85). Test-retest reliability was high (intraclass correlation coefficient, ICC2,1=0.85, 95% CI 0.81-0.88) and in good agreement with waist balance measurements (ICC2,1=0.84, 95% CI 0.80-0.88). Considering the normalized path length magnitude across all 3 axes improved interdevice correlation (ρ=.90) while maintaining test-retest reliability (ICC2,1=0.87, 95% CI 0.83-0.90). All subjects successfully completed the study, demonstrating the feasibility of using a head-mounted wearable to assess balance in a healthy population. Conclusions Balance measurements derived from the smartglasses-based accelerometer were consistent with those obtained using a waist-mounted accelerometer. Additional research is necessary to determine to what extent smartglasses-based accelerometry measures can detect balance dysfunction associated with concussion. However, given the potential for smartglasses to perform additional concussion-related assessments in an integrated, wearable platform, continued development and validation of a smartglasses-based balance assessment is warranted. This approach could lead to a wearable platform for real-time assessment of concussion-related impairments that could be further augmented with telemedicine capabilities to integrate professional clinical guidance. Smartglasses may be superior to fully immersive virtual reality headsets for this application, given their lighter weight and reduced likelihood of potential safety concerns. PMID:29362210
Phase-stepped fringe projection by rotation about the camera's perspective center.
Huddart, Y R; Valera, J D; Weston, N J; Featherstone, T C; Moore, A J
2011-09-12
A technique to produce phase steps in a fringe projection system for shape measurement is presented. Phase steps are produced by introducing relative rotation between the object and the fringe projection probe (comprising a projector and camera) about the camera's perspective center. Relative motion of the object in the camera image can be compensated, because it is independent of the distance of the object from the camera, whilst the phase of the projected fringes is stepped due to the motion of the projector with respect to the object. The technique was validated with a static fringe projection system by moving an object on a coordinate measuring machine (CMM). The alternative approach, of rotating a lightweight and robust CMM-mounted fringe projection probe, is discussed. An experimental accuracy of approximately 1.5% of the projected fringe pitch was achieved, limited by the standard phase-stepping algorithms used rather than by the accuracy of the phase steps produced by the new technique.
Smartphone Photography as a Tool to Measure Knee Range of Motion.
Mica, Megan Conti; Wagner, Eric R; Shin, Alexander Y
2018-01-01
The objective of this study was to validate measuring knee range of motion (ROM) from smartphone photography. Thirty-two participants (64 knees) obtained smartphone photographs of knee flexion and extension. Surgeons obtained the same photographs and goniometric measurement of ROM. ROM was measured using Adobe Photoshop. Goniometer versus digital measurements, participant versus surgeon photographs, and interobserver measurements were analyzed. The average difference in goniometer and digital photograph measurements was 5°. The interclass correlation was .642(L) and .656(R). The Bland-Altman plots demonstrated that 29/32 digital measurements were within the 95% confidence interval (CI). Participants' versus researchers' photographs averaged a 2° difference. The interclass correlation was .924(L) and .91(R). Bland-Altman plots demonstrated that 31/32 measurements were within the 95% CI. Interobserver reliability averaged aROMdifference of 5°. The concordance coefficients were .647(L) and .723(R). Bland-Altman plots demonstrated that 30 of 32 digital measurements were within the 95% CI. Measuring knee ROM using smartphone digital photography is valid and reliable. (Journal of Surgical Orthopaedic Advances 27(1):52-57, 2018).
Ecological validity of the five digit test and the oral trails test.
Paiva, Gabrielle Chequer de Castro; Fialho, Mariana Braga; Costa, Danielle de Souza; Paula, Jonas Jardim de
2016-01-01
Tests evaluating the attentional-executive system are widely used in clinical practice. However, proximity of an objective cognitive test with real-world situations (ecological validity) is not frequently investigated. The present study evaluate the association between measures of the Five Digit Test (FDT) and the Oral Trails Test (OTT) with self-reported cognitive failures in everyday life as measured by the Cognitive Failures Questionnaire (CFQ). Brazilian adults from 18-to-65 years old voluntarily performed the FDT and OTT tests and reported the frequency of cognitive failures in their everyday life through the CFQ. After controlling for the age effect, the measures of controlled attentional processes were associated with cognitive failures, yet the cognitive flexibility of both FDT and OTT accounted for by the majority of variance in most aspects of the CFQ factors. The FDT and the OTT measures were predictive of real-world problems such as cognitive failures in everyday activities/situations.
The Validity of Dependence as a Health Outcome Measure in Alzheimer’s Disease
Spackman, D. Eldon; Kadiyala, Srikanth; Neumann, Peter J.; Veenstra, David L.; Sullivan, Sean D.
2013-01-01
Background Relating to Alzheimer’s disease (AD), dependence has been defined as the increased need for assistance due to deterioration in cognition, physical functioning, and behavior. Our objective was to evaluate the association between dependence and measures of functional impairment. Methods Data were compiled by the National Alzheimer’s Coordinating Center. We used multinomial logistic regression to estimate the association between dependence and cognition, physical functioning, and behavior. Results The independent association with dependence was positive. Dependence was most strongly associated with physical functioning. A secondary analysis suggested a strong association of dependence with multiple impairments, as measured by the interaction terms, in more severe patients. Conclusions We find that dependence is simultaneously associated with physical functioning, cognition, and behavior, which support the construct validity of dependence. Dependence might be a more simple measure to explain the multifaceted disease progression of AD and convey the increasing need for care. PMID:23512996
The validity of dependence as a health outcome measure in Alzheimer's disease.
Spackman, D Eldon; Kadiyala, Srikanth; Neumann, Peter J; Veenstra, David L; Sullivan, Sean D
2013-05-01
Relating to Alzheimer's disease (AD), dependence has been defined as the increased need for assistance due to deterioration in cognition, physical functioning, and behavior. Our objective was to evaluate the association between dependence and measures of functional impairment. Data were compiled by the National Alzheimer's Coordinating Center. We used multinomial logistic regression to estimate the association between dependence and cognition, physical functioning, and behavior. The independent association with dependence was positive. Dependence was most strongly associated with physical functioning. A secondary analysis suggested a strong association of dependence with multiple impairments, as measured by the interaction terms, in more severe patients. We find that dependence is simultaneously associated with physical functioning, cognition, and behavior, which support the construct validity of dependence. Dependence might be a more simple measure to explain the multifaceted disease progression of AD and convey the increasing need for care.
Candela-Toha, Ángel; Pardo, María Carmen; Pérez, Teresa; Muriel, Alfonso; Zamora, Javier
2018-04-20
and objective Acute kidney injury (AKI) diagnosis is still based on serum creatinine and diuresis. However, increases in creatinine are typically delayed 48h or longer after injury. Our aim was to determine the utility of routine postoperative renal function blood tests, to predict AKI one or 2days in advance in a cohort of cardiac surgery patients. Using a prospective database, we selected a sample of patients who had undergone major cardiac surgery between January 2002 and December 2013. The ability of the parameters to predict AKI was based on Acute Kidney Injury Network serum creatinine criteria. A cohort of 3,962 cases was divided into 2groups of similar size, one being exploratory and the other a validation sample. The exploratory group was used to show primary objectives and the validation group to confirm results. The ability to predict AKI of several kidney function parameters measured in routine postoperative blood tests, was measured with time-dependent ROC curves. The primary endpoint was time from measurement to AKI diagnosis. AKI developed in 610 (30.8%) and 623 (31.4%) patients in the exploratory and validation samples, respectively. Estimated glomerular filtration rate using the MDRD-4 equation showed the best AKI prediction capacity, with values for the AUC ROC curves between 0.700 and 0.946. We obtained different cut-off values for estimated glomerular filtration rate depending on the degree of AKI severity and on the time elapsed between surgery and parameter measurement. Results were confirmed in the validation sample. Postoperative estimated glomerular filtration rate using the MDRD-4 equation showed good ability to predict AKI following cardiac surgery one or 2days in advance. Copyright © 2018 Sociedad Española de Nefrología. Published by Elsevier España, S.L.U. All rights reserved.
Discomfort Evaluation of Truck Ingress/Egress Motions Based on Biomechanical Analysis
Choi, Nam-Chul; Lee, Sang Hun
2015-01-01
This paper presents a quantitative discomfort evaluation method based on biomechanical analysis results for human body movement, as well as its application to an assessment of the discomfort for truck ingress and egress. In this study, the motions of a human subject entering and exiting truck cabins with different types, numbers, and heights of footsteps were first measured using an optical motion capture system and load sensors. Next, the maximum voluntary contraction (MVC) ratios of the muscles were calculated through a biomechanical analysis of the musculoskeletal human model for the captured motion. Finally, the objective discomfort was evaluated using the proposed discomfort model based on the MVC ratios. To validate this new discomfort assessment method, human subject experiments were performed to investigate the subjective discomfort levels through a questionnaire for comparison with the objective discomfort levels. The validation results showed that the correlation between the objective and subjective discomforts was significant and could be described by a linear regression model. PMID:26067194
Quality Assurance handbook for air pollution measurement systems
DOE Office of Scientific and Technical Information (OSTI.GOV)
Not Available
1990-08-01
The purpose of this volume of the QA Handbook is to provide information and guidance for both the meteorologist and the non-meteorologist who must make judgments about the validity of data and accuracy of measurement systems. Care has been taken to provide definitions to help those making these judgments to communicate without ambiguity. Methods are described in the handbook which will objectively define the quality of measurements so the non-meteorologist can communicate with the meteorologist or environmental scientist or engineer with precision of meaning.
Kamamoto, Cristhine de Souza Leão; Hassun, Karime Marques; Bagatin, Ediléia; Tomimori, Jane
2014-01-01
BACKGROUND many studies about the psychosocial impact of acne have been reported in international medical literature describing quality of life as a relevant clinical outcome. It is well known that the patient's perception about the disease may be different from the physician's evaluation. Therefore, it is important to use validated instruments that turn the patient's subjective opinion into objective information. OBJECTIVES to translate into Brazilian-Portuguese language and to culturally adapt a quality of life questionnaire, the Acne-Specific Quality of Life Questionnaire (Acne-QoL), as well as to evaluate its reliability and validity. METHODS measurement properties were assessed: 1) validity: comparison between severity and Acne-QoL domain scores, correlations between acne duration and Acne-QoL domain scores, and correlation between Acne-QoL domain scores and SF-36 components; 2) internal consistency: Cronbach's α coefficient; 3) test-retest reproducibility: intraclass correlation coefficient and Wilcoxon test. RESULTS Eighty subjects with a mean age of 20.5 ± 4.8 years presenting mild (33.8%), moderate (36.2%) and severe (30%) facial acne were enrolled. Acne-QoL domain scores were similar among the different acne severity groups except for role-social domain. Subjects with shorter acne duration presented significant higher scores. Acne-QoL domains showed significant correlations, both between themselves and with SF-36 role-social and mental health components. Internal consistency (0.925-0.952) and test-retest reproducibility were considered acceptable (0.768-0.836). CONCLUSIONS the Brazilian-Portuguese version of the Acne-QoL is a reliable and valid satisfactory outcome measure to be used in facial acne studies. PMID:24626652
Automatic Detection of Whole Night Snoring Events Using Non-Contact Microphone
Dafna, Eliran; Tarasiuk, Ariel; Zigel, Yaniv
2013-01-01
Objective Although awareness of sleep disorders is increasing, limited information is available on whole night detection of snoring. Our study aimed to develop and validate a robust, high performance, and sensitive whole-night snore detector based on non-contact technology. Design Sounds during polysomnography (PSG) were recorded using a directional condenser microphone placed 1 m above the bed. An AdaBoost classifier was trained and validated on manually labeled snoring and non-snoring acoustic events. Patients Sixty-seven subjects (age 52.5±13.5 years, BMI 30.8±4.7 kg/m2, m/f 40/27) referred for PSG for obstructive sleep apnea diagnoses were prospectively and consecutively recruited. Twenty-five subjects were used for the design study; the validation study was blindly performed on the remaining forty-two subjects. Measurements and Results To train the proposed sound detector, >76,600 acoustic episodes collected in the design study were manually classified by three scorers into snore and non-snore episodes (e.g., bedding noise, coughing, environmental). A feature selection process was applied to select the most discriminative features extracted from time and spectral domains. The average snore/non-snore detection rate (accuracy) for the design group was 98.4% based on a ten-fold cross-validation technique. When tested on the validation group, the average detection rate was 98.2% with sensitivity of 98.0% (snore as a snore) and specificity of 98.3% (noise as noise). Conclusions Audio-based features extracted from time and spectral domains can accurately discriminate between snore and non-snore acoustic events. This audio analysis approach enables detection and analysis of snoring sounds from a full night in order to produce quantified measures for objective follow-up of patients. PMID:24391903
How should the psychological well-being of zoo elephants be objectively investigated?
Mason, Georgia J; Veasey, Jake S
2010-01-01
Animal welfare (sometimes termed "well-being") is about feelings - states such as "suffering" or "contentment" that we can infer but cannot measure directly. Welfare indices have been developed from two main sources: studies of suffering humans, and of research animals deliberately subjected to challenges known to affect emotional state. We briefly review the resulting indices here, and discuss how well they are understood for elephants, since objective welfare assessment should play a central role in evidence-based elephant management. We cover behavioral and cognitive responses (approach/avoidance; intention, redirected and displacement activities; vigilance/startle; warning signals; cognitive biases, apathy and depression-like changes; stereotypic behavior); physiological responses (sympathetic responses; corticosteroid output - often assayed non-invasively via urine, feces or even hair; other aspects of HPA function, e.g. adrenal hypertrophy); and the potential negative effects of prolonged stress on reproduction (e.g. reduced gametogenesis; low libido; elevated still-birth rates; poor maternal care) and health (e.g. poor wound-healing; enhanced disease rates; shortened lifespans). The best validated, most used welfare indices for elephants are corticosteroid outputs and stereotypic behavior. Indices suggested as valid, partially validated, and/or validated but not yet applied within zoos include: measures of preference/avoidance; displacement movements; vocal/postural signals of affective (emotional) state; startle/vigilance; apathy; salivary and urinary epinephrine; female acyclity; infant mortality rates; skin/foot infections; cardio-vascular disease; and premature adult death. Potentially useful indices that have not yet attracted any validation work in elephants include: operant responding and place preference tests; intention and vacuum movements; fear/stress pheromone release; cognitive biases; heart rate, pupil dilation and blood pressure; corticosteroid assay from hair, especially tail-hairs (to access endocrine events up to a year ago); adrenal hypertrophy; male infertility; prolactinemia; and immunological changes.
2013-09-30
Contrasting Mesotidal Flats Sediment Flux through the Mekong Tidal River, Delta and Mangrove Shoreline Instrumentation to Support Investigation of Large...scales), and thereby validate localized measurements and numerical models of sediment transport for diverse tidal systems (tidal flats , mangrove forests...deltaic distributaries). OBJECTIVES The specific objectives are to: a) document changes in bed elevation (deposition, erosion) on time
Clary, Christelle M; Kestens, Yan
2013-06-19
Validation studies of secondary datasets used to characterize neighborhood food businesses generally evaluate how accurately the database represents the true situation on the ground. Depending on the research objectives, the characterization of the business environment may tolerate some inaccuracies (e.g. minor imprecisions in location or errors in business names). Furthermore, if the number of false negatives (FNs) and false positives (FPs) is balanced within a given area, one could argue that the database still provides a "fair" representation of existing resources in this area. Yet, traditional validation measures do not relax matching criteria, and treat FNs and FPs independently. Through the field validation of food businesses found in a Canadian database, this paper proposes alternative criteria for validity. Field validation of the 2010 Enhanced Points of Interest (EPOI) database (DMTI Spatial®) was performed in 2011 in 12 census tracts (CTs) in Montreal, Canada. Some 410 food outlets were extracted from the database and 484 were observed in the field. First, traditional measures of sensitivity and positive predictive value (PPV) accounting for every single mismatch between the field and the database were computed. Second, relaxed measures of sensitivity and PPV that tolerate mismatches in business names or slight imprecisions in location were assessed. A novel measure of representativity that further allows for compensation between FNs and FPs within the same business category and area was proposed. Representativity was computed at CT level as ((TPs +|FPs-FNs|)/(TPs+FNs)), with TPs meaning true positives, and |FPs-FNs| being the absolute value of the difference between the number of FNs and the number of FPs within each outlet category. The EPOI database had a "moderate" capacity to detect an outlet present in the field (sensitivity: 54.5%) or to list only the outlets that actually existed in the field (PPV: 64.4%). Relaxed measures of sensitivity and PPV were respectively 65.5% and 77.3%. The representativity of the EPOI database was 77.7%. The novel measure of representativity might serve as an alternative to traditional validity measures, and could be more appropriate in certain situations, depending on the nature and scale of the research question.
McGugin, Rankin W.; Richler, Jennifer J.; Herzmann, Grit; Speegle, Magen; Gauthier, Isabel
2012-01-01
Individual differences in face recognition are often contrasted with differences in object recognition using a single object category. Likewise, individual differences in perceptual expertise for a given object domain have typically been measured relative to only a single category baseline. In Experiment 1, we present a new test of object recognition, the Vanderbilt Expertise Test (VET), which is comparable in methods to the Cambridge Face Memory Task (CFMT) but uses eight different object categories. Principal component analysis reveals that the underlying structure of the VET can be largely explained by two independent factors, which demonstrate good reliability and capture interesting sex differences inherent in the VET structure. In Experiment 2, we show how the VET can be used to separate domain-specific from domain-general contributions to a standard measure of perceptual expertise. While domain-specific contributions are found for car matching for both men and women and for plane matching in men, women in this sample appear to use more domain-general strategies to match planes. In Experiment 3, we use the VET to demonstrate that holistic processing of faces predicts face recognition independently of general object recognition ability, which has a sex-specific contribution to face recognition. Overall, the results suggest that the VET is a reliable and valid measure of object recognition abilities and can measure both domain-general skills and domain-specific expertise, which were both found to depend on the sex of observers. PMID:22877929
Creating High Reliability in Health Care Organizations
Pronovost, Peter J; Berenholtz, Sean M; Goeschel, Christine A; Needham, Dale M; Sexton, J Bryan; Thompson, David A; Lubomski, Lisa H; Marsteller, Jill A; Makary, Martin A; Hunt, Elizabeth
2006-01-01
Objective The objective of this paper was to present a comprehensive approach to help health care organizations reliably deliver effective interventions. Context Reliability in healthcare translates into using valid rate-based measures. Yet high reliability organizations have proven that the context in which care is delivered, called organizational culture, also has important influences on patient safety. Model for Improvement Our model to improve reliability, which also includes interventions to improve culture, focuses on valid rate-based measures. This model includes (1) identifying evidence-based interventions that improve the outcome, (2) selecting interventions with the most impact on outcomes and converting to behaviors, (3) developing measures to evaluate reliability, (4) measuring baseline performance, and (5) ensuring patients receive the evidence-based interventions. The comprehensive unit-based safety program (CUSP) is used to improve culture and guide organizations in learning from mistakes that are important, but cannot be measured as rates. Conclusions We present how this model was used in over 100 intensive care units in Michigan to improve culture and eliminate catheter-related blood stream infections—both were accomplished. Our model differs from existing models in that it incorporates efforts to improve a vital component for system redesign—culture, it targets 3 important groups—senior leaders, team leaders, and front line staff, and facilitates change management—engage, educate, execute, and evaluate for planned interventions. PMID:16898981