GOSAT validation out standing in the field: A case study of satellite validation using the SSEC Portable Atmospheric Research Center (SPARC)

NASA Astrophysics Data System (ADS)

Wagner, T. J.; Borg, L. A.; Feltz, M.; Gero, P. J.; Knuteson, R. O.; Olson, E.

2016-12-01

The Space Science and Engineering Center (SSEC) at the University of Wisconsin-Madison has developed the SSEC Portable Atmospheric Research Center (SPARC), a mobile 11 m trailer that houses numerous in situ and ground-based remote sensing instruments. Available instrumentation includes the Atmospheric Emitted Radiance Interferometer (AERI), a hyperspectral infrared radiometer from which trace gas concentrations and profiles of temperature and water vapor can be retrieved; the High Spectral Resolution Lidar (HSRL), a multichannel lidar capable of directly retrieving profiles of optical depth and backscatter depolarization; and a Doppler lidar wind profiler. The remote instrumentation suite is complemented by surface meteorology observations and a radiosonde ground station. Collectively, these instruments enable SPARC to participate in a wide variety of field studies, including meteorological field experiments and ground-based satellite calibration and validation studies. In August 2016, SPARC traveled to the Chequamegon National Forest in northern Wisconsin for a two week long deployment alongside the WLEF-TV tower. This 447 m tower houses long-term observations of thermodynamic and atmospheric composition at multiple heights, enabling studies of phenomena like atmospheric/land surface interactions and carbon uptake. During this deployment, SPARC launched radiosondes coincident with clear-sky overpasses of the Greenhouse gases Observing SATellite (GOSAT). Thermodynamic profiles from the radiosondes and AERI combined with the trace gas observations from the tower were used to validate the GOSAT observations of carbon dioxide and methane. The on-site presence of SPARC allowed for better characterization of the environment and greater observational certainty than was possible with the tower alone. Examples from this particular validation study as well as a discussion of how SPARC can contribute to other satellite calibration and validation investigations will be presented.

Assessing the Relationship Between Observed Teaching Practice and Reading Growth in First Grade English Learners: A Validation Study

ERIC Educational Resources Information Center

Baker, Scott K.; Gersten, Russell; Haager, Diane; Dingle, Mary; Goldenberg, Claude

2005-01-01

Validation of a classroom observation measure for use with English Learners (ELs) in Grade 1 is the focus of this study. Fourteen teachers were observed during reading and language arts instruction with an instrument used to generate overall ratings of instructional quality on a number of dimensions. In these classrooms, the reading performance of…

Validating an Observation Protocol to Measure Special Education Teacher Effectiveness

ERIC Educational Resources Information Center

Johnson, Evelyn S.; Semmelroth, Carrie L.

2015-01-01

This study used Kane's (2013) Interpretation/Use Argument (IUA) to measure validity on the Recognizing Effective Special Education Teachers (RESET) observation tool. The RESET observation tool is designed to evaluate special education teacher effectiveness using evidence-based instructional practices as the basis for evaluation. In alignment with…

Assessing validity of observational intervention studies - the Benchmarking Controlled Trials.

PubMed

Malmivaara, Antti

2016-09-01

Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. To create and pilot test a checklist for appraising methodological validity of a BCT. The checklist was created by extracting the most essential elements from the comprehensive set of criteria in the previous paper on BCTs. Also checklists and scientific papers on observational studies and respective systematic reviews were utilized. Ten BCTs published in the Lancet and in the New England Journal of Medicine were used to assess feasibility of the created checklist. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. However, the piloted checklist should be validated in further studies. Key messages Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. This paper presents a checklist for appraising methodological validity of BCTs and pilot-tests the checklist with ten BCTs published in leading medical journals. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies.

Evidence-based dentistry: analysis of dental anxiety scales for children.

PubMed

Al-Namankany, A; de Souza, M; Ashley, P

2012-03-09

To review paediatric dental anxiety measures (DAMs) and assess the statistical methods used for validation and their clinical implications. A search of four computerised databases between 1960 and January 2011 associated with DAMs, using pre-specified search terms, to assess the method of validation including the reliability as intra-observer agreement 'repeatability or stability' and inter-observer agreement 'reproducibility' and all types of validity. Fourteen paediatric DAMs were predominantly validated in schools and not in the clinical setting while five of the DAMs were not validated at all. The DAMs that were validated were done so against other paediatric DAMs which may not have been validated previously. Reliability was not assessed in four of the DAMs. However, all of the validated studies assessed reliability which was usually 'good' or 'acceptable'. None of the current DAMs used a formal sample size technique. Diversity was seen between the studies ranging from a few simple pictograms to lists of questions reported by either the individual or an observer. To date there is no scale that can be considered as a gold standard, and there is a need to further develop an anxiety scale with a cognitive component for children and adolescents.

Incremental Validity of Test Session and Classroom Observations in a Multimethod Assessment of Attention Deficit/Hyperactivity Disorder

ERIC Educational Resources Information Center

McConaughy, Stephanie H.; Harder, Valerie S.; Antshel, Kevin M.; Gordon, Michael; Eiraldi, Ricardo; Dumenci, Levent

2010-01-01

This study tested the incremental validity of behavioral observations, over and above parent and teacher reports, for assessing symptoms of Attention Deficit/Hyperactivity Disorder (ADHD) in children ages 6 to 12, using the Test Observation Form (TOF) and Direct Observation Form (DOF) from the Achenbach System of Empirically Based Assessment. The…

Validating an Environmental Education Field Day Observation Tool

ERIC Educational Resources Information Center

Carlson, Stephan P.; Heimlich, Joe E.; Storksdieck, Martin

2011-01-01

Environmental Field Days (EFD) are held throughout the country and provide a unique opportunity to involve students in real world science. A study to assess the validity of an observation tool for EFD programs was conducted at the Metro Water Festival with fifth grade students. Items from the observation tool were mapped to students' evaluation…

Psychometric properties of the Bulgarian translation of noise sensitivity scale short form (NSS-SF): implementation in the field of noise control.

PubMed

Dzhambov, Angel M; Dimitrova, Donka D

2014-01-01

The Noise Sensitivity Scale Short Form (NSS-SF), developed in English as a more practical form of the classical Weinstein NSS, has not to date been validated in other cultures, and its validity and reliability have not yet been confirmed. This study aimed to validate NSS-SF in Bulgarian and to demonstrate its applicability. The study comprised test-retest (n = 115) and a field-testing (n = 71) of the newly validated scale. Its construct validity was examined with confirmatory factor analysis, and very good model-fit was observed. Temporal stability was assessed in a test-retest (r = 0.990), convergent validity was examined with single-item susceptibility to the noise scale (r = 0.906) and discriminant validity was confirmed with single-item noise annoyance scale (r = 0.718). The lowest observed McDonald's omega across the studies was 0.923. The cross-cultural validation of NSS-SF was successful but it proved to be somewhat problematic with respect to its annoyance-based items.

Assessing validity of observational intervention studies – the Benchmarking Controlled Trials

PubMed Central

Malmivaara, Antti

2016-01-01

Abstract Background: Benchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations. Aims: To create and pilot test a checklist for appraising methodological validity of a BCT. Methods: The checklist was created by extracting the most essential elements from the comprehensive set of criteria in the previous paper on BCTs. Also checklists and scientific papers on observational studies and respective systematic reviews were utilized. Ten BCTs published in the Lancet and in the New England Journal of Medicine were used to assess feasibility of the created checklist. Results: The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies. Conclusions: The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. However, the piloted checklist should be validated in further studies.Key messagesBenchmarking Controlled Trial (BCT) is a concept which covers all observational studies aiming to assess impact of interventions or health care system features to patients and populations.This paper presents a checklist for appraising methodological validity of BCTs and pilot-tests the checklist with ten BCTs published in leading medical journals. The appraised studies seem to have several methodological limitations, some of which could be avoided in planning, conducting and reporting phases of the studies.The checklist can be used for planning, conducting, reporting, reviewing, and critical reading of observational intervention studies. PMID:27238631

Concurrent Validity of the Classroom Strategies Scale for Elementary School--Observer Form

ERIC Educational Resources Information Center

Reddy, Linda A.; Fabiano, Gregory A.; Dudek, Christopher M.

2013-01-01

The present study is an initial investigation of the concurrent validity of a new assessment, the Classroom Strategies Scale (CSS version 2.0) for Elementary School--Observer Form. The CSS assesses teachers' use of instructional and behavioral management strategies. In the present study, the CSS is compared to the Classroom Assessment Scoring…

The social perception of emotional abilities: expanding what we know about observer ratings of emotional intelligence.

PubMed

Elfenbein, Hillary Anger; Barsade, Sigal G; Eisenkraft, Noah

2015-02-01

We examine the social perception of emotional intelligence (EI) through the use of observer ratings. Individuals frequently judge others' emotional abilities in real-world settings, yet we know little about the properties of such ratings. This article examines the social perception of EI and expands the evidence to evaluate its reliability and cross-judge agreement, as well as its convergent, divergent, and predictive validity. Three studies use real-world colleagues as observers and data from 2,521 participants. Results indicate significant consensus across observers about targets' EI, moderate but significant self-observer agreement, and modest but relatively consistent discriminant validity across the components of EI. Observer ratings significantly predicted interdependent task performance, even after controlling for numerous factors. Notably, predictive validity was greater for observer-rated than for self-rated or ability-tested EI. We discuss the minimal associations of observer ratings with ability-tested EI, study limitations, future directions, and practical implications. PsycINFO Database Record (c) 2015 APA, all rights reserved.

A methodology to estimate representativeness of LAI station observation for validation: a case study with Chinese Ecosystem Research Network (CERN) in situ data

NASA Astrophysics Data System (ADS)

Xu, Baodong; Li, Jing; Liu, Qinhuo; Zeng, Yelu; Yin, Gaofei

2014-11-01

Leaf Area Index (LAI) is known as a key vegetation biophysical variable. To effectively use remote sensing LAI products in various disciplines, it is critical to understand the accuracy of them. The common method for the validation of LAI products is firstly establish the empirical relationship between the field data and high-resolution imagery, to derive LAI maps, then aggregate high-resolution LAI maps to match moderate-resolution LAI products. This method is just suited for the small region, and its frequencies of measurement are limited. Therefore, the continuous observing LAI datasets from ground station network are important for the validation of multi-temporal LAI products. However, due to the scale mismatch between the point observation in the ground station and the pixel observation, the direct comparison will bring the scale error. Thus it is needed to evaluate the representativeness of ground station measurement within pixel scale of products for the reasonable validation. In this paper, a case study with Chinese Ecosystem Research Network (CERN) in situ data was taken to introduce a methodology to estimate representativeness of LAI station observation for validating LAI products. We first analyzed the indicators to evaluate the observation representativeness, and then graded the station measurement data. Finally, the LAI measurement data which can represent the pixel scale was used to validate the MODIS, GLASS and GEOV1 LAI products. The result shows that the best agreement is reached between the GLASS and GEOV1, while the lowest uncertainty is achieved by GEOV1 followed by GLASS and MODIS. We conclude that the ground station measurement data can validate multi-temporal LAI products objectively based on the evaluation indicators of station observation representativeness, which can also improve the reliability for the validation of remote sensing products.

Converting Soil Moisture Observations to Effective Values for Improved Validation of Remotely Sensed Soil Moisture

NASA Technical Reports Server (NTRS)

Laymon, Charles A.; Crosson, William L.; Limaye, Ashutosh; Manu, Andrew; Archer, Frank

2005-01-01

We compare soil moisture retrieved with an inverse algorithm with observations of mean moisture in the 0-6 cm soil layer. A significant discrepancy is noted between the retrieved and observed moisture. Using emitting depth functions as weighting functions to convert the observed mean moisture to observed effective moisture removes nearly one-half of the discrepancy noted. This result has important implications in remote sensing validation studies.

Validity of the Autism Spectrum Disorder Observation for Children (ASD-OC)

ERIC Educational Resources Information Center

Neal, Daniene; Matson, Johnny L.; Hattier, Megan A.

2014-01-01

The Autism Spectrum Disorder Observation for Children (ASD-OC) is a 45-item observation scale used to assess autistic symptomatology. The reliability of this measure has been established in previous research; therefore, the purpose of this study is to evaluate its validity among a sample of children (1-15 years). The large correlation between the…

Parental modelling of eating behaviours: observational validation of the Parental Modelling of Eating Behaviours scale (PARM).

PubMed

Palfreyman, Zoe; Haycraft, Emma; Meyer, Caroline

2015-03-01

Parents are important role models for their children's eating behaviours. This study aimed to further validate the recently developed Parental Modelling of Eating Behaviours Scale (PARM) by examining the relationships between maternal self-reports on the PARM with the modelling practices exhibited by these mothers during three family mealtime observations. Relationships between observed maternal modelling and maternal reports of children's eating behaviours were also explored. Seventeen mothers with children aged between 2 and 6 years were video recorded at home on three separate occasions whilst eating a meal with their child. Mothers also completed the PARM, the Children's Eating Behaviour Questionnaire and provided demographic information about themselves and their child. Findings provided validation for all three PARM subscales, which were positively associated with their observed counterparts on the observational coding scheme (PARM-O). The results also indicate that habituation to observations did not change the feeding behaviours displayed by mothers. In addition, observed maternal modelling was significantly related to children's food responsiveness (i.e., their interest in and desire for foods), enjoyment of food, and food fussiness. This study makes three important contributions to the literature. It provides construct validation for the PARM measure and provides further observational support for maternal modelling being related to lower levels of food fussiness and higher levels of food enjoyment in their children. These findings also suggest that maternal feeding behaviours remain consistent across repeated observations of family mealtimes, providing validation for previous research which has used single observations. Copyright © 2014 Elsevier Ltd. All rights reserved.

Intra- and inter-tester reliability and validity of normal finger size measurement using the Japanese ring gauge system.

PubMed

Suzuki, T; Sato, Y; Sotome, S; Arai, H; Arai, A; Yoshida, H

2017-06-01

This study was designed to investigate the reliability and validity of measurements of finger diameters with a ring gauge. A reliability study enrolled two independent samples (50 participants and seven examiners in Study I; 26 participants and 26 examiners in Study II). The sizes of each participant's little fingers were measured twice with a ring gauge by each examiner. To investigate the validity of the measurements, five hand therapists compared the finger size and hand volume of 30 participants with the ring gauge and with a figure-of-eight technique (Study III). The intra-class correlation coefficient for intra-observer reliability ranged from 0.97 to 0.99 in Study I, and 0.90 to 0.97 in Study II. The intra-class correlation coefficient for inter-observer reliability was 0.95 in Study I and 0.94 in Study II. The validity study showed a Pearson product moment correlation coefficient of 0.75. The ring gauge showed high reliability and validity for measurement of finger size. III, diagnostic.

Five-Factor Screener in the 2005 National Health Interview Survey Cancer Control Supplement: Validation Results

Cancer.gov

Risk Factor Assessment Branch staff have assessed indirectly the validity of parts of the Five-Factor Screener in two studies: NCI's Observing Protein and Energy (OPEN) Study and the Eating at America's Table Study (EATS). In both studies, multiple 24-hour recalls in conjunction with a measurement error model were used to assess validity.

Sensitivity of regression calibration to non-perfect validation data with application to the Norwegian Women and Cancer Study.

PubMed

Buonaccorsi, John P; Dalen, Ingvild; Laake, Petter; Hjartåker, Anette; Engeset, Dagrun; Thoresen, Magne

2015-04-15

Measurement error occurs when we observe error-prone surrogates, rather than true values. It is common in observational studies and especially so in epidemiology, in nutritional epidemiology in particular. Correcting for measurement error has become common, and regression calibration is the most popular way to account for measurement error in continuous covariates. We consider its use in the context where there are validation data, which are used to calibrate the true values given the observed covariates. We allow for the case that the true value itself may not be observed in the validation data, but instead, a so-called reference measure is observed. The regression calibration method relies on certain assumptions.This paper examines possible biases in regression calibration estimators when some of these assumptions are violated. More specifically, we allow for the fact that (i) the reference measure may not necessarily be an 'alloyed gold standard' (i.e., unbiased) for the true value; (ii) there may be correlated random subject effects contributing to the surrogate and reference measures in the validation data; and (iii) the calibration model itself may not be the same in the validation study as in the main study; that is, it is not transportable. We expand on previous work to provide a general result, which characterizes potential bias in the regression calibration estimators as a result of any combination of the violations aforementioned. We then illustrate some of the general results with data from the Norwegian Women and Cancer Study. Copyright © 2015 John Wiley & Sons, Ltd.

[Validity 'and Utilities' clinic of a grid observation (PACSLAC-F) to evaluate the pain in seniors with dementia's living in the Long-Term Care ].

PubMed

Aubin, Michèle; Verreault, René; Savoie, Maryse; LeMay, Sylvie; Hadjistavropoulos, Thomas; Fillion, Lise; Beaulieu, Marie; Viens, Chantal; Bergeron, Rénald; Vézina, Lucie; Misson, Lucie; Fuchs-Lacelle, Shannon

2008-01-01

This study presents the validation of the French Canadian version (PACLSAC-F) of the Pain Assessment Checklist for Seniors with Limited Ability to Communicate (PACSLAC). Unlike the published validation of the English version of the PACSLAC, which was validated retrospectively, the French version was validated prospectively. The PACSLAC-F was completed by nurses working in long-term care facilities after observing 86 seniors, with severe cognitive impairment, in calm, painful or distressing but non-painful situations. The test-retest and inter-observer reliability, the internal consistency, and the discriminent validity were found to be satisfactory. To evaluate the convergent validity with the DOLOPLUS-2 and the clinical relevance of the PACSLAC, it was also completed by nurses during their work shift, with 26 additional patients, for three days per week during a period of four weeks. These results encourage us to test the PACSLAC in a comprehensive program of pain management targeting this population.

Dietary Screener in the 2009 CHIS: Validation

Cancer.gov

In the Eating at America's Table Study and the Observing Protein and Energy Nutrition Study, Risk Factors Branch staff assessed the validity of created aggregate variables from the 2009 CHIS Dietary Screener.

An observational examination of the literature in diagnostic anatomic pathology.

PubMed

Foucar, Elliott; Wick, Mark R

2005-05-01

Original research published in the medical literature confronts the reader with three very basic and closely linked questions--are the authors' conclusions true in the contextual setting in which the work was performed (internally valid); if so, are the conclusions also applicable in other practice settings (externally valid); and, if the conclusions of the study are bona fide, do they represent an important contribution to medical practice or are they true-but-insignificant? Most publications attempt to convince readers that the researchers' conclusions are both internally valid and important, and occasionally papers also directly address external validity. Developing standardized methods to facilitate the prospective determination of research importance would be useful to both journals and their readers, but has proven difficult. In contrast, the evidence-based medicine (EBM) movement has had more success with understanding and codifying factors thought to promote research validity. Of the many variables that can influence research validity, research design is the one that has received the most attention. The present paper reviews the contributions of EBM to understanding research validity, looking for areas where EBM's body of knowledge is applicable to the anatomic pathology (AP) literature. As part of this project, the authors performed a pilot observational analysis of a representative sample of the current pertinent literature on diagnostic tissue pathology. The results of that review showed that most of the latter publications employ one of the four categories of "observational" research design that have been delineated by the EBM movement, and that the most common of these observational designs is a "cross-sectional" comparison. Pathologists do not presently use the "experimental" research designs so admired by advocates of EBM. Slightly > 50% of AP observational studies employed statistical evaluations to support their final conclusions. Comparison of the current AP literature with a selected group of papers published in 1977 shows a discernible change over that period that has affected not just technological procedures, but also research design and use of statistics. Although we feel that advocates of EBM deserve credit for bringing attention to the close link between research design and research validity, much of the EBM effort has centered on refining "experimental" methodology, and the complexities of observational research have often been treated in an inappropriately dismissive manner. For advocates of EBM, an observational study is what you are relegated to as a second choice when you are unable to do an experimental study. The latter viewpoint may be true for evaluating new chemotherapeutic agents, but is unacceptable to pathologists, whose research advances are currently completely dependent on well-conducted observational research. Rather than succumb to randomization envy and accept EBM's assertion that observational research is second best, the challenge to AP is to develop and adhere to standards for observational research that will allow our patients to benefit from the full potential of this time tested approach to developing valid insights into disease.

Validity and inter-observer reliability of subjective hand-arm vibration assessments.

PubMed

Coenen, Pieter; Formanoy, Margriet; Douwes, Marjolein; Bosch, Tim; de Kraker, Heleen

2014-07-01

Exposure to mechanical vibrations at work (e.g., due to handling powered tools) is a potential occupational risk as it may cause upper extremity complaints. However, reliable and valid assessment methods for vibration exposure at work are lacking. Measuring hand-arm vibration objectively is often difficult and expensive, while often used information provided by manufacturers lacks detail. Therefore, a subjective hand-arm vibration assessment method was tested on validity and inter-observer reliability. In an experimental protocol, sixteen tasks handling powered tools were executed by two workers. Hand-arm vibration was assessed subjectively by 16 observers according to the proposed subjective assessment method. As a gold standard reference, hand-arm vibration was measured objectively using a vibration measurement device. Weighted κ's were calculated to assess validity, intra-class-correlation coefficients (ICCs) were calculated to assess inter-observer reliability. Inter-observer reliability of the subjective assessments depicting the agreement among observers can be expressed by an ICC of 0.708 (0.511-0.873). The validity of the subjective assessments as compared to the gold-standard reference can be expressed by a weighted κ of 0.535 (0.285-0.785). Besides, the percentage of exact agreement of the subjective assessment compared to the objective measurement was relatively low (i.e., 52% of all tasks). This study shows that subjectively assessed hand-arm vibrations are fairly reliable among observers and moderately valid. This assessment method is a first attempt to use subjective risk assessments of hand-arm vibration. Although, this assessment method can benefit from some future improvement, it can be of use in future studies and in field-based ergonomic assessments. Copyright © 2014 Elsevier Ltd and The Ergonomics Society. All rights reserved.

Effect of individual shades on reliability and validity of observers in colour matching.

PubMed

Lagouvardos, P E; Diamanti, H; Polyzois, G

2004-06-01

The effect of individual shades in shade guides, on the reliability and validity of measurements in a colour matching process is very important. Observer's agreement on shades and sensitivity/specificity of shades, can give us an estimate of shade's effect on observer's reliability and validity. In the present study, a group of 16 students, matched 15 shades of a Kulzer's guide and 10 human incisors to Kulzer's and/or Vita's shade tabs, in 4 different tests. The results showed shades I, B10, C40, A35 and A10 were those with the highest reliability and validity values. In conclusion, a) the matching process with shades of different materials was not accurate enough, b) some shades produce a more reliable and valid match than others and c) teeth are matched with relative difficulty.

Instructional Interactions of Kindergarten Mathematics Classrooms: Validating a Direct Observation Instrument

ERIC Educational Resources Information Center

Doabler, Christian; Smolkowski, Keith; Fien, Hank; Kosty, Derek B.; Cary, Mari Strand

2010-01-01

In this paper, the authors report research focused directly on the validation of the Coding of Academic Teacher-Student interactions (CATS) direct observation instrument. They use classroom information gathered by the CATS instrument to better understand the potential mediating variables hypothesized to influence student achievement. Their study's…

Bayesian data analysis in observational comparative effectiveness research: rationale and examples.

PubMed

Olson, William H; Crivera, Concetta; Ma, Yi-Wen; Panish, Jessica; Mao, Lian; Lynch, Scott M

2013-11-01

Many comparative effectiveness research and patient-centered outcomes research studies will need to be observational for one or both of two reasons: first, randomized trials are expensive and time-consuming; and second, only observational studies can answer some research questions. It is generally recognized that there is a need to increase the scientific validity and efficiency of observational studies. Bayesian methods for the design and analysis of observational studies are scientifically valid and offer many advantages over frequentist methods, including, importantly, the ability to conduct comparative effectiveness research/patient-centered outcomes research more efficiently. Bayesian data analysis is being introduced into outcomes studies that we are conducting. Our purpose here is to describe our view of some of the advantages of Bayesian methods for observational studies and to illustrate both realized and potential advantages by describing studies we are conducting in which various Bayesian methods have been or could be implemented.

Improved Diagnostic Validity of the ADOS Revised Algorithms: A Replication Study in an Independent Sample

ERIC Educational Resources Information Center

Oosterling, Iris; Roos, Sascha; de Bildt, Annelies; Rommelse, Nanda; de Jonge, Maretha; Visser, Janne; Lappenschaar, Martijn; Swinkels, Sophie; van der Gaag, Rutger Jan; Buitelaar, Jan

2010-01-01

Recently, Gotham et al. ("2007") proposed revised algorithms for the Autism Diagnostic Observation Schedule (ADOS) with improved diagnostic validity. The aim of the current study was to replicate predictive validity, factor structure, and correlations with age and verbal and nonverbal IQ of the ADOS revised algorithms for Modules 1 and 2…

Validation of Malayalam Version of National Comprehensive Cancer Network Distress Thermometer and its Feasibility in Oncology Patients.

PubMed

Biji, M S; Dessai, Sampada; Sindhu, N; Aravind, Sithara; Satheesan, B

2018-01-01

This study was designed to translate and validate the National Comprehensive Cancer Network (NCCN) distress thermometer (DT) in regional language " Malayalam" and to see the feasibility of using it in our patients. (1) To translate and validate the NCCN DT. (2) To study the feasibility of using validated Malayalam translated DT in Malabar Cancer center. This is a single-arm prospective observational study. The study was conducted at author's institution between December 8, 2015, and January 20, 2016 in the Department of Cancer Palliative Medicine. This was a prospective observational study carried out in two phases. In Phase 1, the linguistic validation of the NCCN DT was done. In Phase 2, the feasibility, face validity, and utility of the translated of NCCN DT in accordance with QQ-10 too was done. SPSS version 16 (SPSS Inc. Released 2007. SPSS for Windows, Version 16.0. Chicago, SPSS Inc.) was used for analysis. Ten patients were enrolled in Phase 2. The median age was 51.5 years and 40% of patients were male. All patients had completed at least basic education up to the primary level. The primary site of cancer was heterogeneous. The NCCN DT completion rate was 100%. The face validity, utility, reliability, and feasibility were 100%, 100%, 100%, and 90%, respectively. It can be concluded that the Malayalam validated DT has high face validity, utility, and it is feasible for its use.

Validating Pseudo-dynamic Source Models against Observed Ground Motion Data at the SCEC Broadband Platform, Ver 16.5

NASA Astrophysics Data System (ADS)

Song, S. G.

2016-12-01

Simulation-based ground motion prediction approaches have several benefits over empirical ground motion prediction equations (GMPEs). For instance, full 3-component waveforms can be produced and site-specific hazard analysis is also possible. However, it is important to validate them against observed ground motion data to confirm their efficiency and validity before practical uses. There have been community efforts for these purposes, which are supported by the Broadband Platform (BBP) project at the Southern California Earthquake Center (SCEC). In the simulation-based ground motion prediction approaches, it is a critical element to prepare a possible range of scenario rupture models. I developed a pseudo-dynamic source model for Mw 6.5-7.0 by analyzing a number of dynamic rupture models, based on 1-point and 2-point statistics of earthquake source parameters (Song et al. 2014; Song 2016). In this study, the developed pseudo-dynamic source models were tested against observed ground motion data at the SCEC BBP, Ver 16.5. The validation was performed at two stages. At the first stage, simulated ground motions were validated against observed ground motion data for past events such as the 1992 Landers and 1994 Northridge, California, earthquakes. At the second stage, they were validated against the latest version of empirical GMPEs, i.e., NGA-West2. The validation results show that the simulated ground motions produce ground motion intensities compatible with observed ground motion data at both stages. The compatibility of the pseudo-dynamic source models with the omega-square spectral decay and the standard deviation of the simulated ground motion intensities are also discussed in the study

The statistical validity of nursing home survey findings.

PubMed

Woolley, Douglas C

2011-11-01

The Medicare nursing home survey is a high-stakes process whose findings greatly affect nursing homes, their current and potential residents, and the communities they serve. Therefore, survey findings must achieve high validity. This study looked at the validity of one key assessment made during a nursing home survey: the observation of the rate of errors in administration of medications to residents (med-pass). Statistical analysis of the case under study and of alternative hypothetical cases. A skilled nursing home affiliated with a local medical school. The nursing home administrators and the medical director. Observational study. The probability that state nursing home surveyors make a Type I or Type II error in observing med-pass error rates, based on the current case and on a series of postulated med-pass error rates. In the common situation such as our case, where med-pass errors occur at slightly above a 5% rate after 50 observations, and therefore trigger a citation, the chance that the true rate remains above 5% after a large number of observations is just above 50%. If the true med-pass error rate were as high as 10%, and the survey team wished to achieve 75% accuracy in determining that a citation was appropriate, they would have to make more than 200 med-pass observations. In the more common situation where med pass errors are closer to 5%, the team would have to observe more than 2000 med-passes to achieve even a modest 75% accuracy in their determinations. In settings where error rates are low, large numbers of observations of an activity must be made to reach acceptable validity of estimates for the true rates of errors. In observing key nursing home functions with current methodology, the State Medicare nursing home survey process does not adhere to well-known principles of valid error determination. Alternate approaches in survey methodology are discussed. Copyright © 2011 American Medical Directors Association. Published by Elsevier Inc. All rights reserved.

Reliability and validity of the Pragmatics Observational Measure (POM): a new observational measure of pragmatic language for children.

PubMed

Cordier, Reinie; Munro, Natalie; Wilkes-Gillan, Sarah; Speyer, Renée; Pearce, Wendy M

2014-07-01

There is a need for a reliable and valid assessment of childhood pragmatic language skills during peer-peer interactions. This study aimed to evaluate the psychometric properties of a newly developed pragmatic assessment, the Pragmatic Observational Measure (POM). The psychometric properties of the POM were investigated from observational data of two studies - study 1 involved 342 children aged 5-11 years (108 children with ADHD; 108 typically developing playmates; 126 children in the control group), and study 2 involved 9 children with ADHD who attended a 7-week play-based intervention. The psychometric properties of the POM were determined based on the COnsensus-based Standards for the selection of health status Measurement INstruments (COSMIN) taxonomy of psychometric properties and definitions for health-related outcomes; the Pragmatic Protocol was used as the reference tool against which the POM was evaluated. The POM demonstrated sound psychometric properties in all the reliability, validity and interpretability criteria against which it was assessed. The findings showed that the POM is a reliable and valid measure of pragmatic language skills of children with ADHD between the age of 5 and 11 years and has clinical utility in identifying children with pragmatic language difficulty. Copyright © 2014 The Authors. Published by Elsevier Ltd.. All rights reserved.

Validity of covering-up sun-protection habits: Association of observations and self-report

PubMed Central

O'Riordan, David L.; Nehl, Eric; Gies, Peter; Bundy, Lucja; Burgess, Kristen; Davis, Erica; Glanz, Karen

2013-01-01

Background Few studies have reported the accuracy of measures used to assess sun-protection practices. Valid measures are critical to the internal validity and use of skin cancer control research. Objectives We sought to validate self-reported covering-up practices of pool-goers. Methods A total of 162 lifeguards and 201 parent/child pairs from 16 pools in 4 metropolitan regions in the United States completed a survey and a 4-day sun-habits diary. Observations of sun-protective behaviors were conducted on two occasions. Results Agreement between observations and diaries ranged from slight to substantial, with most values in the fair to moderate range. Highest agreement was observed for parent hat use (κ = 0.58–0.70). There was no systematic pattern of over- or under-reporting among the 3 study groups. Limitations Potential reactivity and a relatively affluent sample are limitations. Conclusion There was little over-reporting and no systematic bias, which increases confidence in reliance on verbal reports of these behaviors in surveys and intervention research. PMID:19278750

Multifactor Screener in the 2000 National Health Interview Survey Cancer Control Supplement: Validation Results

Cancer.gov

Risk Factor Assessment Branch (RFAB) staff have assessed the validity of the Multifactor Screener in several studies: NCI's Observing Protein and Energy (OPEN) Study, the Eating at America's Table Study (EATS), and the joint NIH-AARP Diet and Health Study.

Development and testing of the cancer multidisciplinary team meeting observational tool (MDT-MOT)

PubMed Central

Harris, Jenny; Taylor, Cath; Sevdalis, Nick; Jalil, Rozh; Green, James S.A.

2016-01-01

Abstract Objective To develop a tool for independent observational assessment of cancer multidisciplinary team meetings (MDMs), and test criterion validity, inter-rater reliability/agreement and describe performance. Design Clinicians and experts in teamwork used a mixed-methods approach to develop and refine the tool. Study 1 observers rated pre-determined optimal/sub-optimal MDM film excerpts and Study 2 observers independently rated video-recordings of 10 MDMs. Setting Study 2 included 10 cancer MDMs in England. Participants Testing was undertaken by 13 health service staff and a clinical and non-clinical observer. Intervention None. Main Outcome Measures Tool development, validity, reliability/agreement and variability in MDT performance. Results Study 1: Observers were able to discriminate between optimal and sub-optimal MDM performance (P ≤ 0.05). Study 2: Inter-rater reliability was good for 3/10 domains. Percentage of absolute agreement was high (≥80%) for 4/10 domains and percentage agreement within 1 point was high for 9/10 domains. Four MDTs performed well (scored 3+ in at least 8/10 domains), 5 MDTs performed well in 6–7 domains and 1 MDT performed well in only 4 domains. Leadership and chairing of the meeting, the organization and administration of the meeting, and clinical decision-making processes all varied significantly between MDMs (P ≤ 0.01). Conclusions MDT-MOT demonstrated good criterion validity. Agreement between clinical and non-clinical observers (within one point on the scale) was high but this was inconsistent with reliability coefficients and warrants further investigation. If further validated MDT-MOT might provide a useful mechanism for the routine assessment of MDMs by the local workforce to drive improvements in MDT performance. PMID:27084499

Development and testing of the cancer multidisciplinary team meeting observational tool (MDT-MOT).

PubMed

Harris, Jenny; Taylor, Cath; Sevdalis, Nick; Jalil, Rozh; Green, James S A

2016-06-01

To develop a tool for independent observational assessment of cancer multidisciplinary team meetings (MDMs), and test criterion validity, inter-rater reliability/agreement and describe performance. Clinicians and experts in teamwork used a mixed-methods approach to develop and refine the tool. Study 1 observers rated pre-determined optimal/sub-optimal MDM film excerpts and Study 2 observers independently rated video-recordings of 10 MDMs. Study 2 included 10 cancer MDMs in England. Testing was undertaken by 13 health service staff and a clinical and non-clinical observer. None. Tool development, validity, reliability/agreement and variability in MDT performance. Study 1: Observers were able to discriminate between optimal and sub-optimal MDM performance (P ≤ 0.05). Study 2: Inter-rater reliability was good for 3/10 domains. Percentage of absolute agreement was high (≥80%) for 4/10 domains and percentage agreement within 1 point was high for 9/10 domains. Four MDTs performed well (scored 3+ in at least 8/10 domains), 5 MDTs performed well in 6-7 domains and 1 MDT performed well in only 4 domains. Leadership and chairing of the meeting, the organization and administration of the meeting, and clinical decision-making processes all varied significantly between MDMs (P ≤ 0.01). MDT-MOT demonstrated good criterion validity. Agreement between clinical and non-clinical observers (within one point on the scale) was high but this was inconsistent with reliability coefficients and warrants further investigation. If further validated MDT-MOT might provide a useful mechanism for the routine assessment of MDMs by the local workforce to drive improvements in MDT performance. © The Author 2016. Published by Oxford University Press in association with the International Society for Quality in Health Care; all rights reserved.

How Mathematicians Determine if an Argument Is a Valid Proof

ERIC Educational Resources Information Center

Weber, Keith

2008-01-01

The purpose of this article is to investigate the mathematical practice of proof validation--that is, the act of determining whether an argument constitutes a valid proof. The results of a study with 8 mathematicians are reported. The mathematicians were observed as they read purported mathematical proofs and made judgments about their validity;…

Multidimensional measures validated for home health needs of older persons: A systematic review.

PubMed

de Rossi Figueiredo, Daniela; Paes, Lucilene Gama; Warmling, Alessandra Martins; Erdmann, Alacoque Lorenzini; de Mello, Ana Lúcia Schaefer Ferreira

2018-01-01

To conduct a systematic review of the literature on valid and reliable multidimensional instruments to assess home health needs of older persons. Systematic review. Electronic databases, PubMed/Medline, Web of Science, Scopus, Cumulative Index to Nursing and Allied Health Literature, Scientific Electronic Library Online and the Latin American and Caribbean Health Sciences Information. All English, Portuguese and Spanish literature which included studies of reliability and validity of instruments that assessed at least two dimensions: physical, psychological, social support and functional independence, self-rated health behaviors and contextual environment and if such instruments proposed interventions after evaluation and/or monitoring changes over a period of time. Older persons aged 60 years or older. Of the 2397 studies identified, 32 were considered eligible. Two-thirds of the instruments proposed the physical, psychological, social support and functional independence dimensions. Inter-observer and intra-observer reliability and internal consistency values were 0.7 or above. More than two-thirds of the studies included validity (n=26) and more than one validity was tested in 15% (n=4) of these. Only 7% (n=2) proposed interventions after evaluation and/or monitoring changes over a period of time. Although the multidimensional assessment was performed, and the reliability values of the reviewed studies were satisfactory, different validity tests were not present in several studies. A gap at the instrument conception was observed related to interventions after evaluation and/or monitoring changes over a period of time. Further studies with this purpose are necessary for home health needs of the older persons. Copyright © 2017 Elsevier Ltd. All rights reserved.

Reliability and Validity of the Dyadic Observed Communication Scale (DOCS).

PubMed

Hadley, Wendy; Stewart, Angela; Hunter, Heather L; Affleck, Katelyn; Donenberg, Geri; Diclemente, Ralph; Brown, Larry K

2013-02-01

We evaluated the reliability and validity of the Dyadic Observed Communication Scale (DOCS) coding scheme, which was developed to capture a range of communication components between parents and adolescents. Adolescents and their caregivers were recruited from mental health facilities for participation in a large, multi-site family-based HIV prevention intervention study. Seventy-one dyads were randomly selected from the larger study sample and coded using the DOCS at baseline. Preliminary validity and reliability of the DOCS was examined using various methods, such as comparing results to self-report measures and examining interrater reliability. Results suggest that the DOCS is a reliable and valid measure of observed communication among parent-adolescent dyads that captures both verbal and nonverbal communication behaviors that are typical intervention targets. The DOCS is a viable coding scheme for use by researchers and clinicians examining parent-adolescent communication. Coders can be trained to reliably capture individual and dyadic components of communication for parents and adolescents and this complex information can be obtained relatively quickly.

Measuring physical activity in preschoolers: Reliability and validity of The System for Observing Fitness Instruction Time for Preschoolers (SOFIT-P)

PubMed Central

Sharma, Shreela; Chuang, Ru-Jye; Skala, Katherine; Atteberry, Heather

2012-01-01

The purpose of this study is describe the initial feasibility, reliability, and validity of an instrument to measure physical activity in preschoolers using direct observation. The System for Observing Fitness Instruction Time for Preschoolers was developed and tested among 3- to 6-year-old children over fall 2008 for feasibility and reliability (Phase I, n=67) and in fall 2009 for concurrent validity (Phase II, n=27). Phase I showed that preschoolers spent >75% of their active time at preschool in light physical activity. The mean inter-observer agreements scores were ≥.75 for physical activity level and type. Correlation coefficients, measuring construct validity between the lesson context and physical activity types with and with the activity levels, were moderately strong. Phase II showed moderately strong correlations ranging from .50 to .54 between the System for Observing Fitness Instruction Time for Preschoolers and Actigraph accelerometers for physical activity levels. The System for Observing Fitness Instruction Time for Preschoolers shows promising initial results as a new method for measuring physical activity among preschoolers. PMID:22485071

The Effect of Different Cultural Lenses on Reliability and Validity in Observational Data: The Example of Chinese Immigrant Parent-Toddler Dinner Interactions

ERIC Educational Resources Information Center

Wang, Yan Z.; Wiley, Angela R.; Zhou, Xiaobin

2007-01-01

This study used a mixed methodology to investigate reliability, validity, and analysis level with Chinese immigrant observational data. European-American and Chinese coders quantitatively rated 755 minutes of Chinese immigrant parent-toddler dinner interactions on parental sensitivity, intrusiveness, detachment, negative affect, positive affect,…

A Validation of the Classroom Assessment Scoring System in Finnish Kindergartens

ERIC Educational Resources Information Center

Pakarinen, Eija; Lerkkanen, Marja-Kristiina; Poikkeus, Anna-Maija; Kiuru, Noona; Siekkinen, Martti; Rasku-Puttonen, Helena; Nurmi, Jari-Erik

2010-01-01

Research Findings: This study examined the validity and reliability of the Classroom Assessment Scoring System (CLASS; R. C. Pianta, K. M. La Paro, & B. K. Hamre, 2008) in Finnish kindergartens. A pair of trained observers used the CLASS to observe 49 kindergarten teachers (47 female, 2 male) on two different days. Questionnaires measuring…

Using the Autism Diagnostic Interview-Revised and the Autism Diagnostic Observation Schedule with Young Children with Developmental Delay: Evaluating Diagnostic Validity

ERIC Educational Resources Information Center

Gray, Kylie M.; Tonge, Bruce J.; Sweeney, Deborah J.

2008-01-01

Few studies have focused on the validity of the ADI-R and ADOS in the assessment of preschool children with developmental delay. This study aimed to evaluate the diagnostic validity of the ADI-R and the ADOS in young children. Two-hundred and nine children aged 20-55 months participated in the study, 120 of whom received a diagnosis of autism.…

Validity and reliability of the Paprosky acetabular defect classification.

PubMed

Yu, Raymond; Hofstaetter, Jochen G; Sullivan, Thomas; Costi, Kerry; Howie, Donald W; Solomon, Lucian B

2013-07-01

The Paprosky acetabular defect classification is widely used but has not been appropriately validated. Reliability of the Paprosky system has not been evaluated in combination with standardized techniques of measurement and scoring. This study evaluated the reliability, teachability, and validity of the Paprosky acetabular defect classification. Preoperative radiographs from a random sample of 83 patients undergoing 85 acetabular revisions were classified by four observers, and their classifications were compared with quantitative intraoperative measurements. Teachability of the classification scheme was tested by dividing the four observers into two groups. The observers in Group 1 underwent three teaching sessions; those in Group 2 underwent one session and the influence of teaching on the accuracy of their classifications was ascertained. Radiographic evaluation showed statistically significant relationships with intraoperative measurements of anterior, medial, and superior acetabular defect sizes. Interobserver reliability improved substantially after teaching and did not improve without it. The weighted kappa coefficient went from 0.56 at Occasion 1 to 0.79 after three teaching sessions in Group 1 observers, and from 0.49 to 0.65 after one teaching session in Group 2 observers. The Paprosky system is valid and shows good reliability when combined with standardized definitions of radiographic landmarks and a structured analysis. Level II, diagnostic study. See the Guidelines for Authors for a complete description of levels of evidence.

The Validation of a Classroom Observation Instrument Based on the Construct of Teacher Adaptive Practice

ERIC Educational Resources Information Center

Loughland, Tony; Vlies, Penny

2016-01-01

Teacher adaptability is a key disposition for teachers that has been linked to outcomes of interests to schools. The aim of this study was to examine how the broader disposition of teacher adaptability might be observable as classroom-based adaptive practices using an argument-based approach to validation. The findings from the initial phase of…

Identifying and classifying hyperostosis frontalis interna via computerized tomography.

PubMed

May, Hila; Peled, Nathan; Dar, Gali; Hay, Ori; Abbas, Janan; Masharawi, Youssef; Hershkovitz, Israel

2010-12-01

The aim of this study was to recognize the radiological characteristics of hyperostosis frontalis interna (HFI) and to establish a valid and reliable method for its identification and classification. A reliability test was carried out on 27 individuals who had undergone a head computerized tomography (CT) scan. Intra-observer reliability was obtained by examining the images three times, by the same researcher, with a 2-week interval between each sample ranking. The inter-observer test was performed by three independent researchers. A validity test was carried out using two methods for identifying and classifying HFI: 46 cadaver skullcaps were ranked twice via computerized tomography scans and then by direct observation. Reliability and validity were calculated using Kappa test (SPSS 15.0). Reliability tests of ranking HFI via CT scans demonstrated good results (K > 0.7). As for validity, a very good consensus was obtained between the CT and direct observation, when moderate and advanced types of HFI were present (K = 0.82). The suggested classification method for HFI, using CT, demonstrated a sensitivity of 84%, specificity of 90.5%, and positive predictive value of 91.3%. In conclusion, volume rendering is a reliable and valid tool for identifying HFI. The suggested three-scale classification is most suitable for radiological diagnosis of the phenomena. Considering the increasing awareness of HFI as an early indicator of a developing malady, this study may assist radiologists in identifying and classifying the phenomena.

Development and validation of self-reported line drawings of the modified Beighton score for the assessment of generalised joint hypermobility.

PubMed

Cooper, Dale J; Scammell, Brigitte E; Batt, Mark E; Palmer, Debbie

2018-01-17

The impracticalities and comparative expense of carrying out a clinical assessment is an obstacle in many large epidemiological studies. The purpose of this study was to develop and validate a series of electronic self-reported line drawing instruments based on the modified Beighton scoring system for the assessment of self-reported generalised joint hypermobility. Five sets of line drawings were created to depict the 9-point Beighton score criteria. Each instrument consisted of an explanatory question whereby participants were asked to select the line drawing which best represented their joints. Fifty participants completed the self-report online instrument on two occasions, before attending a clinical assessment. A blinded expert clinical observer then assessed participants' on two occasions, using a standardised goniometry measurement protocol. Validity of the instrument was assessed by participant-observer agreement and reliability by participant repeatability and observer repeatability using unweighted Cohen's kappa (k). Validity and reliability were assessed for each item in the self-reported instrument separately, and for the sum of the total scores. An aggregate score for generalised joint hypermobility was determined based on a Beighton score of 4 or more out of 9. Observer-repeatability between the two clinical assessments demonstrated perfect agreement (k 1.00; 95% CI 1.00, 1.00). Self-reported participant-repeatability was lower but it was still excellent (k 0.91; 95% CI 0.74, 1.00). The participant-observer agreement was excellent (k 0.96; 95% CI 0.87, 1.00). Validity was excellent for the self-report instrument, with a good sensitivity of 0.87 (95% CI 0.81, 0.91) and excellent specificity of 0.99 (95% CI 0.98, 1.00). The self-reported instrument provides a valid and reliable assessment of the presence of generalised joint hypermobility and may have practical use in epidemiological studies.

Teacher Evaluation Project. The Beginning Teacher Program, Intellectual Skills Development, Validity Studies of the Evaluation System, Special Instrument Development. Report for 1984-1985.

ERIC Educational Resources Information Center

Florida Coalition for the Development of a Performance Measurement System, Tallahassee.

Reports, summaries, and recommendations are presented on the following research studies: (1) Beginning Teacher Studies; (2) Instructional Skills for Teaching Higher Order Thinking; (3) Development of the Conferential Observation Instrument; (4) Predictive Validity Studies Conducted to Test the Relationship Between Teacher Performance as Measured…

Validity of the Child Observation Record: An Investigation of the Relationship between Cor Dimensions and Social-Emotional and Cognitive Outcomes for Head Start Children

ERIC Educational Resources Information Center

Sekino, Yumiko; Fantuzzo, John

2005-01-01

The study examined the validity of the Child Observation Record (COR). Participants were 242 children, a stratified, random sample of a large, urban Head Start program. Teachers trained to collect COR data provided assessments on the Cognitive, Social Engagement, and Coordinated Movement dimensions of the COR. Outcome data included cognitive and…

Gravity Waves Generated by Convection: A New Idealized Model Tool and Direct Validation with Satellite Observations

NASA Astrophysics Data System (ADS)

Alexander, M. Joan; Stephan, Claudia

2015-04-01

In climate models, gravity waves remain too poorly resolved to be directly modelled. Instead, simplified parameterizations are used to include gravity wave effects on model winds. A few climate models link some of the parameterized waves to convective sources, providing a mechanism for feedback between changes in convection and gravity wave-driven changes in circulation in the tropics and above high-latitude storms. These convective wave parameterizations are based on limited case studies with cloud-resolving models, but they are poorly constrained by observational validation, and tuning parameters have large uncertainties. Our new work distills results from complex, full-physics cloud-resolving model studies to essential variables for gravity wave generation. We use the Weather Research Forecast (WRF) model to study relationships between precipitation, latent heating/cooling and other cloud properties to the spectrum of gravity wave momentum flux above midlatitude storm systems. Results show the gravity wave spectrum is surprisingly insensitive to the representation of microphysics in WRF. This is good news for use of these models for gravity wave parameterization development since microphysical properties are a key uncertainty. We further use the full-physics cloud-resolving model as a tool to directly link observed precipitation variability to gravity wave generation. We show that waves in an idealized model forced with radar-observed precipitation can quantitatively reproduce instantaneous satellite-observed features of the gravity wave field above storms, which is a powerful validation of our understanding of waves generated by convection. The idealized model directly links observations of surface precipitation to observed waves in the stratosphere, and the simplicity of the model permits deep/large-area domains for studies of wave-mean flow interactions. This unique validated model tool permits quantitative studies of gravity wave driving of regional circulation and provides a new method for future development of realistic convective gravity wave parameterizations.

Validation of the Medipro MediCare 100f upper arm blood pressure monitor, for self-measurement, according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Yi, Jun; Wan, Yi; Pan, Feng; Yu, Xiaorong; Zhao, Huadong; Shang, Fujun; Xu, Yongyong

2011-08-01

The validation of sphygmomanometer is important in accurate blood pressure measurement. This study presents the validation results by the Medipro MediCare 100f upper arm blood pressure monitor according to the European Society of Hypertension International Protocol (ESH-IP) revision 2010. The ESH-IP revision 2010 for the validation of blood pressure measuring devices in adults was followed precisely. A total of 99 couples of test device and reference blood pressure measurements were obtained during the study (three pairs for each of the 33 participants). The device produced 73, 93, and 98 measurements within 5, 10, and 15 mmHg for systolic blood pressure (SBP) and 79, 93, and 96 for diastolic blood pressure (DBP), respectively. The mean standard deviation device-observer difference was 1.4 ± 5.2 mmHg for SBP and 0.02±5.8 mmHg for DBP. The number of participants with two or three of the device-observer differences within 5 mmHg was 24 for SBP and 30 for DBP, whereas there was no participant with none of the device-observer differences within 5 mmHg. According to the results of the validation study based on the ESH-IP revision 2010, the Medipro MediCare 100f can be recommended for self-measurement in an adult population.

Validity Evidence for the Security Scale as a Measure of Perceived Attachment Security in Adolescence

ERIC Educational Resources Information Center

Van Ryzin, Mark J.; Leve, Leslie D.

2012-01-01

In this study, the validity of a self-report measure of children's perceived attachment security (the Kerns Security Scale) was tested using adolescents. With regards to predictive validity, the Security Scale was significantly associated with (1) observed mother-adolescent interactions during conflict and (2) parent- and teacher-rated social…

Observation of early childhood physical aggression: a psychometric study of the system for coding early physical aggression.

PubMed

Mesman, Judi; Alink, Lenneke R A; van Zeijl, Jantien; Stolk, Mirjam N; Bakermans-Kranenburg, Marian J; van Ijzendoorn, Marinus H; Juffer, Femmie; Koot, Hans M

2008-01-01

We investigated the reliability and (convergent and discriminant) validity of an observational measure of physical aggression in toddlers and preschoolers, originally developed by Keenan and Shaw [1994]. The observation instrument is based on a developmental definition of aggression. Physical aggression was observed twice in a laboratory setting, the first time when children were 1-3 years old, and again 1 year later. Observed physical aggression was significantly related to concurrent mother-rated physical aggression for 2- to 4-year-olds, but not to maternal ratings of nonaggressive externalizing problems, indicating the measure's discriminant validity. However, we did not find significant 1-year stability of observed physical aggression in any of the age groups, whereas mother-rated physical aggression was significantly stable for all ages. The observational measure shows promise, but may have assessed state rather than trait aggression in our study. Copyright 2008 Wiley-Liss, Inc.

Using GLEAMS to Select Environmental Windows for Herbicide Application in Forests

Treesearch

M.C. Smith; J.L. Michael; W.G. Koisel; D.G. Nealy

1994-01-01

Observed herbicide runoff and groundwater data from a pine-release herbicide application study near Gainesville, Florida were used to validate the GLEAMS model hydrology and pesticide component for forest application. The study revealed that model simulations agreed relatively well with the field data for the one-year study. Following validation, a modified version of...

Prediction of Outcome after Moderate and Severe Traumatic Brain Injury: External Validation of the IMPACT and CRASH Prognostic Models

PubMed Central

Roozenbeek, Bob; Lingsma, Hester F.; Lecky, Fiona E.; Lu, Juan; Weir, James; Butcher, Isabella; McHugh, Gillian S.; Murray, Gordon D.; Perel, Pablo; Maas, Andrew I.R.; Steyerberg, Ewout W.

2012-01-01

Objective The International Mission on Prognosis and Analysis of Clinical Trials (IMPACT) and Corticoid Randomisation After Significant Head injury (CRASH) prognostic models predict outcome after traumatic brain injury (TBI) but have not been compared in large datasets. The objective of this is study is to validate externally and compare the IMPACT and CRASH prognostic models for prediction of outcome after moderate or severe TBI. Design External validation study. Patients We considered 5 new datasets with a total of 9036 patients, comprising three randomized trials and two observational series, containing prospectively collected individual TBI patient data. Measurements Outcomes were mortality and unfavourable outcome, based on the Glasgow Outcome Score (GOS) at six months after injury. To assess performance, we studied the discrimination of the models (by AUCs), and calibration (by comparison of the mean observed to predicted outcomes and calibration slopes). Main Results The highest discrimination was found in the TARN trauma registry (AUCs between 0.83 and 0.87), and the lowest discrimination in the Pharmos trial (AUCs between 0.65 and 0.71). Although differences in predictor effects between development and validation populations were found (calibration slopes varying between 0.58 and 1.53), the differences in discrimination were largely explained by differences in case-mix in the validation studies. Calibration was good, the fraction of observed outcomes generally agreed well with the mean predicted outcome. No meaningful differences were noted in performance between the IMPACT and CRASH models. More complex models discriminated slightly better than simpler variants. Conclusions Since both the IMPACT and the CRASH prognostic models show good generalizability to more recent data, they are valid instruments to quantify prognosis in TBI. PMID:22511138

The brief negative symptom scale: validation of the German translation and convergent validity with self-rated anhedonia and observer-rated apathy.

PubMed

Bischof, Martin; Obermann, Caitriona; Hartmann, Matthias N; Hager, Oliver M; Kirschner, Matthias; Kluge, Agne; Strauss, Gregory P; Kaiser, Stefan

2016-11-22

Negative symptoms are considered core symptoms of schizophrenia. The Brief Negative Symptom Scale (BNSS) was developed to measure this symptomatic dimension according to a current consensus definition. The present study examined the psychometric properties of the German version of the BNSS. To expand former findings on convergent validity, we employed the Temporal Experience Pleasure Scale (TEPS), a hedonic self-report that distinguishes between consummatory and anticipatory pleasure. Additionally, we addressed convergent validity with observer-rated assessment of apathy with the Apathy Evaluation Scale (AES), which was completed by the patient's primary nurse. Data were collected from 75 in- and outpatients from the Psychiatric Hospital, University Zurich diagnosed with either schizophrenia or schizoaffective disorder. We assessed convergent and discriminant validity, internal consistency and inter-rater reliability. We largely replicated the findings of the original version showing good psychometric properties of the BNSS. In addition, the primary nurses evaluation correlated moderately with interview-based clinician rating. BNSS anhedonia items showed good convergent validity with the TEPS. Overall, the German BNSS shows good psychometric properties comparable to the original English version. Convergent validity extends beyond interview-based assessments of negative symptoms to self-rated anhedonia and observer-rated apathy.

Observing Parent Behavior: Reconciling Theoretical Concepts with Empirical Reality.

ERIC Educational Resources Information Center

Ge, Xiaojia

Using data from the Iowa Youth and Families Project, this longitudinal study investigated the predictive validity of different dimensions of observed parent behavior on adolescent externalizing (aggression, hostility) and internalizing (depression, anxiety) problems over a 2-year period. In addition, the study examined how observer ratings…

Socially indiscriminate attachment behavior in the Strange Situation: convergent and discriminant validity in relation to caregiving risk, later behavior problems, and attachment insecurity.

PubMed

Lyons-Ruth, Karlen; Bureau, Jean-François; Riley, Caitlin D; Atlas-Corbett, Alisha F

2009-01-01

Socially indiscriminate attachment behavior has been repeatedly observed among institutionally reared children. Socially indiscriminate behavior has also been associated with aggression and hyperactivity. However, available data rely heavily on caregiver report of indiscriminate behavior. In addition, few studies have been conducted with samples of home-reared infants exposed to inadequate care. The current study aimed to develop a reliable laboratory measure of socially indiscriminate forms of attachment behavior based on direct observation and to validate the measure against assessments of early care and later behavior problems among home-reared infants. Strange Situation episodes of 75 socially at-risk mother-infant dyads were coded for infant indiscriminate attachment behavior on the newly developed Rating for Infant-Stranger Engagement. After controlling for infant insecure-organized and disorganized behavior in all analyses, extent of infant-stranger engagement at 18 months was significantly related to serious caregiving risk (maltreatment or maternal psychiatric hospitalization), observed quality of disrupted maternal affective communication, and aggressive and hyperactive behavior problems at age 5. Results are discussed in relation to the convergent and discriminant validity of the new measure and to the potential utility of a standardized observational measure of indiscriminate attachment behavior. Further validation is needed in relation to caregiver report measures of indiscriminate behavior.

Analyzing self-controlled case series data when case confirmation rates are estimated from an internal validation sample.

PubMed

Xu, Stanley; Clarke, Christina L; Newcomer, Sophia R; Daley, Matthew F; Glanz, Jason M

2018-05-16

Vaccine safety studies are often electronic health record (EHR)-based observational studies. These studies often face significant methodological challenges, including confounding and misclassification of adverse event. Vaccine safety researchers use self-controlled case series (SCCS) study design to handle confounding effect and employ medical chart review to ascertain cases that are identified using EHR data. However, for common adverse events, limited resources often make it impossible to adjudicate all adverse events observed in electronic data. In this paper, we considered four approaches for analyzing SCCS data with confirmation rates estimated from an internal validation sample: (1) observed cases, (2) confirmed cases only, (3) known confirmation rate, and (4) multiple imputation (MI). We conducted a simulation study to evaluate these four approaches using type I error rates, percent bias, and empirical power. Our simulation results suggest that when misclassification of adverse events is present, approaches such as observed cases, confirmed case only, and known confirmation rate may inflate the type I error, yield biased point estimates, and affect statistical power. The multiple imputation approach considers the uncertainty of estimated confirmation rates from an internal validation sample, yields a proper type I error rate, largely unbiased point estimate, proper variance estimate, and statistical power. © 2018 WILEY-VCH Verlag GmbH & Co. KGaA, Weinheim.

Validity of a practitioner-administered observational tool to measure physical activity, nutrition, and screen time in school-age programs.

PubMed

Lee, Rebekka M; Emmons, Karen M; Okechukwu, Cassandra A; Barrett, Jessica L; Kenney, Erica L; Cradock, Angie L; Giles, Catherine M; deBlois, Madeleine E; Gortmaker, Steven L

2014-11-28

Nutrition and physical activity interventions have been effective in creating environmental changes in afterschool programs. However, accurate assessment can be time-consuming and expensive as initiatives are scaled up for optimal population impact. This study aims to determine the criterion validity of a simple, low-cost, practitioner-administered observational measure of afterschool physical activity, nutrition, and screen time practices and child behaviors. Directors from 35 programs in three cities completed the Out-of-School Nutrition and Physical Activity Observational Practice Assessment Tool (OSNAP-OPAT) on five days. Trained observers recorded snacks served and obtained accelerometer data each day during the same week. Observations of physical activity participation and snack consumption were conducted on two days. Correlations were calculated to validate weekly average estimates from OSNAP-OPAT compared to criterion measures. Weekly criterion averages are based on 175 meals served, snack consumption of 528 children, and physical activity levels of 356 children. OSNAP-OPAT validly assessed serving water (r = 0.73), fruits and vegetables (r = 0.84), juice >4oz (r = 0.56), and grains (r = 0.60) at snack; sugary drinks (r = 0.70) and foods (r = 0.68) from outside the program; and children's water consumption (r = 0.56) (all p <0.05). Reports of physical activity time offered were correlated with accelerometer estimates (minutes of moderate and vigorous physical activity r = 0.59, p = 0.02; vigorous physical activity r = 0.63, p = 0.01). The reported proportion of children participating in moderate and vigorous physical activity was correlated with observations (r = 0.48, p = 0.03), as were reports of computer (r = 0.85) and TV/movie (r = 0.68) time compared to direct observations (both p < 0.01). OSNAP-OPAT can assist researchers and practitioners in validly assessing nutrition and physical activity environments and behaviors in afterschool settings. Phase 1 of this measure validation was conducted during a study registered at clinicaltrials.gov NCT01396473.

The Construct Validity of Teachers' Perceptions of Change in Schools Implementing Comprehensive School Reform Models

ERIC Educational Resources Information Center

Nunnery, John A.; Ross, Steven M.; Bol, Linda

2008-01-01

This study reports the results of a validation study of the Comprehensive School Restructuring Teacher Questionnaire (CSRTQ) and the School Observation Measure (SOM), which are intended for use in evaluating comprehensive school reform efforts. The CSRTQ, which putatively measures five factors related to school restructuring (internal focus,…

Validity of the Working Alliance Inventory within Child Protection Services

ERIC Educational Resources Information Center

Killian, Michael; Forrester, Donald; Westlake, David; Antonopoulou, Paraskevi

2017-01-01

The Working Alliance Inventory remains a widely studied measure of quality of therapeutic relationships between the practitioner and client. No prior study has examined the psychometrics and validity of the Working Alliance Inventory-Short (WAI-S) in a sample of families, social workers, and trained observers within child protection services.…

Validation of SMAP Root Zone Soil Moisture Estimates with Improved Cosmic-Ray Neutron Probe Observations

NASA Astrophysics Data System (ADS)

Babaeian, E.; Tuller, M.; Sadeghi, M.; Franz, T.; Jones, S. B.

2017-12-01

Soil Moisture Active Passive (SMAP) soil moisture products are commonly validated based on point-scale reference measurements, despite the exorbitant spatial scale disparity. The difference between the measurement depth of point-scale sensors and the penetration depth of SMAP further complicates evaluation efforts. Cosmic-ray neutron probes (CRNP) with an approximately 500-m radius footprint provide an appealing alternative for SMAP validation. This study is focused on the validation of SMAP level-4 root zone soil moisture products with 9-km spatial resolution based on CRNP observations at twenty U.S. reference sites with climatic conditions ranging from semiarid to humid. The CRNP measurements are often biased by additional hydrogen sources such as surface water, atmospheric vapor, or mineral lattice water, which sometimes yield unrealistic moisture values in excess of the soil water storage capacity. These effects were removed during CRNP data analysis. Comparison of SMAP data with corrected CRNP observations revealed a very high correlation for most of the investigated sites, which opens new avenues for validation of current and future satellite soil moisture products.

Assessing the Validity and Reliability of the Peristomal Skin Lesion Assessment Instrument Adapted for Use in Turkey.

PubMed

Ay, Ali; Bulut, Hulya

2015-08-01

Many ostomy patients experience peristomal skin lesions. A descriptive study was conducted to assess the validity, usability, and reliability of the Peristomal Skin Lesions Assessment instrument (SACS instrument) adapted to Turkish from English. The SACS Instrument consists of 2 main assessments: lesion type (utilizing definitions and photographs) and lesion area by location around the ostomy. The study was performed in 2 stages: 1) the SACS language was changed and its content validity established; and 2) the instrument\\'92s content validity and inter-observer agreement (consistency) were determined among pairs of nurses who used the tool to assess peristomal skin lesions. Patients (included if they were >18 years old and receiving treatment/observation at 1 of the 4 participating stomatherapy units) and 8 stomatherapy nurses also completed appropriate sociodemographic questionnaires. Of the 393 patients screened during the 7-month study, 100 (average age 56.74 \\'b1 14.03 years, 55 men) participated; most (79) had a planned operation. A little more than half (59) of the patients had colorectal cancer and 28 had their stoma site marked preoperatively by a stomatherapy nurse. The most common peristomal skin lesion risk factors were having an ileostomy and unplanned surgery. The content validity index of the entire Turkish SACS instrument was 1, and the inter-observer agreement Kappa statistic was very good (K = 0.90, 95% CI 0.80- 0.99). Individual SACS item K values ranged from K = 0.84 (95% CI 0.63\\'961) to K = 1 (95% CI 1). Most (62.5%) nurses found the terms and pictures used in the SACS classification adequate and suitable, and 50% believed the Turkish version of the SACS instrument was a valid and suitable assessment tool for use by Turkish stomatherapy nurses. Validity and reliability studies involving larger and more diverse patient and nurse samples are warranted.

Validation of Satellite Retrieved Land Surface Variables

NASA Technical Reports Server (NTRS)

Lakshmi, Venkataraman; Susskind, Joel

1999-01-01

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Validity of a parent vocabulary checklist for young Spanish speaking children of Mexican immigrants.

PubMed

Guiberson, Mark

2008-01-01

The primary objective of the current investigation was to examine the concurrent and predictive validity of a parent vocabulary checklist with young Spanish speaking children of Mexican immigrants. This study implemented a longitudinal approach. Nineteen families participated when children were 15-16 months of age, and then again at 30-32 months of age. The Spanish version of the MacArthur Communicative Development Inventory (Inventarios del Desarrollo de Habilidades Communicativas, INV) and spontaneous language samples collected during naturalistic play were used to examine the relationship between observed and reported vocabulary. Vocabulary reported through the INV-II and vocabulary observed at 30-32 months were significantly correlated, suggesting that the INV-II captures a valid representation of vocabulary at this age. Comparatively, vocabulary reported on the INV-I, was not correlated with observed vocabulary at 15-16 months of age or reported or observed vocabulary at 30-32 months of age. These results suggest that the INV-I, when used with 14-16-month-olds, demonstrates limited concurrent and predictive validity. Implications for the clinical use of the INV-I and INV-II are presented.

RELIABILITY AND VALIDITY OF A BIOMECHANICALLY BASED ANALYSIS METHOD FOR THE TENNIS SERVE

PubMed Central

Kibler, W. Ben; Lamborn, Leah; Smith, Belinda J.; English, Tony; Jacobs, Cale; Uhl, Tim L.

2017-01-01

Background An observational tennis serve analysis (OTSA) tool was developed using previously established body positions from three-dimensional kinematic motion analysis studies. These positions, defined as nodes, have been associated with efficient force production and minimal joint loading. However, the tool has yet to be examined scientifically. Purpose The primary purpose of this investigation was to determine the inter-observer reliability for each node between two health care professionals (HCPs) that developed the OTSA, and secondarily to investigate the validity of the OTSA. Methods Two separate studies were performed to meet these objectives. An inter-observer reliability study preceded the validity study by examining 28 videos of players serving. Two HCPs graded each video and scored the presence or absence of obtaining each node. Discriminant validity was determined in 33 tennis players using video taped records of three first serves. Serve mechanics were graded using the OSTA and categorized players into those with good ( ≥ 5) and poor ( ≤ 4) mechanics. Participants performed a series of field tests to evaluate trunk flexibility, lower extremity and trunk power, and dynamic balance. Results The group with good mechanics demonstrated greater backward trunk flexibility (p=0.02), greater rotational power (p=0.02), and higher single leg countermovement jump (p=0.05). Reliability of the OTSA ranged from K = 0.36-1.0, with the majority of all the nodes displaying substantial reliability (K>0.61). Conclusion This study provides HCPs with a valid and reliable field tool used to assess serve mechanics. Physical characteristics of trunk mobility and power appear to discriminate serve mechanics between players. Future intervention studies are needed to determine if improvement in physical function contribute to improved serve mechanics. Level of Evidence 3 PMID:28593098

Test Takers' Beliefs and Experiences of a High-Stakes Computer-Based English Listening and Speaking Test

ERIC Educational Resources Information Center

Zhan, Ying; Wan, Zhi Hong

2016-01-01

Test takers' beliefs or experiences have been overlooked in most validation studies in language education. Meanwhile, a mutual exclusion has been observed in the literature, with little or no dialogue between validation studies and studies concerning the uses and consequences of testing. To help fill these research gaps, a group of Senior III…

Validating Components of Teacher Effectiveness: A Random Assignment Study of Value-Added, Observation, and Survey Scores

ERIC Educational Resources Information Center

Bacher-Hicks, Andrew; Chin, Mark; Kane, Thomas J.; Staiger, Douglas O.

2015-01-01

Policy changes from the past decade have resulted in a growing interest in identifying effective teachers and their characteristics. This study is the third study to use data from a randomized experiment to test the validity of measures of teacher effectiveness. The authors collected effectiveness measures across three school years from three…

Concurrent validity of Physiological Cost Index in walking over ground and during robotic training in subacute stroke patients.

PubMed

Delussu, Anna Sofia; Morone, Giovanni; Iosa, Marco; Bragoni, Maura; Paolucci, Stefano; Traballesi, Marco

2014-01-01

Physiological Cost Index (PCI) has been proposed to assess gait demand. The purpose of the study was to establish whether PCI is a valid indicator in subacute stroke patients of energy cost of walking in different walking conditions, that is, over ground and on the Gait Trainer (GT) with body weight support (BWS). The study tested if correlations exist between PCI and ECW, indicating validity of the measure and, by implication, validity of PCI. Six patients (patient group (PG)) with subacute stroke and 6 healthy age- and size-matched subjects as control group (CG) performed, in a random sequence in different days, walking tests overground and on the GT with 0, 30, and 50% BWS. There was a good to excellent correlation between PCI and ECW in the observed walking conditions: in PG Pearson correlation was 0.919 (p < 0.001); in CG Pearson correlation was 0.852 (p < 0.001). In conclusion, the high significant correlations between PCI and ECW, in all the observed walking conditions, suggest that PCI is a valid outcome measure in subacute stroke patients.

Observed Parenting Behavior with Teens: Measurement Invariance and Predictive Validity Across Race

PubMed Central

Skinner, Martie L.; MacKenzie, Elizabeth P.; Haggerty, Kevin P.; Hill, Karl G.; Roberson, Kendra C.

2011-01-01

Previous reports supporting measurement equality between European American and African American families have often focused on self-reported risk factors or observed parent behavior with young children. This study examines equality of measurement of observer ratings of parenting behavior with adolescents during structured tasks; mean levels of observed parenting; and predictive validity of teen self-reports of antisocial behaviors and beliefs using a sample of 163 African American and 168 European American families. Multiple-group confirmatory factor analyses supported measurement invariance across ethnic groups for 4 measures of observed parenting behavior: prosocial rewards, psychological costs, antisocial rewards, and problem solving. Some mean-level differences were found: African American parents exhibited lower levels of prosocial rewards, higher levels of psychological costs, and lower problem solving when compared to European Americans. No significant mean difference was found in rewards for antisocial behavior. Multigroup structural equation models suggested comparable relationships across race (predictive validity) between parenting constructs and youth antisocial constructs (i.e., drug initiation, positive drug attitudes, antisocial attitudes, problem behaviors) in all but one of the tested relationships. This study adds to existing evidence that family-based interventions targeting parenting behaviors can be generalized to African American families. PMID:21787057

Validation of the Artsana CSI 610 automated blood pressure monitor in adults according to the International Protocol of the European Society of Hypertension.

PubMed

Pini, Claudio; Pastori, Marco; Baccheschi, Jordan; Omboni, Stefano; Parati, Gianfranco

2007-06-01

There is evidence that blood pressure measurement outside the doctor's office can provide valuable information for the diagnostic evaluation of hypertensive patients and for monitoring their response to treatment. Home blood pressure monitoring devices have a major role in this setting, provided that their accuracy in measuring blood pressure is demonstrated by validation studies. This study aimed at verifying whether the automatic electronic oscillometric blood pressure measuring device Artsana CSI 610 complied with the standard of accuracy indicated by the ESH International Protocol. Sequential measurements of systolic and diastolic blood pressure were obtained in 33 participants using the mercury sphygmomanometer (two observers) and the test device (one supervisor). A standard adult cuff was always employed during the study. According to the ESH validation protocol, 99 couples of test device and reference blood pressure measurements were obtained during the two phases of the study (three pairs for each of the 33 participants). The Artsana CSI 610 device successfully passed phase 1 of study validation with the number of absolute differences between test and reference device never <35 within 5 mmHg and never <40 within 10 and 15 mmHg. The test device also passed phase 2 of the validation study with a mean (+/-SD) device-observer difference of -1.4+/-4.8 mmHg for systolic and -0.9+/-3.5 mmHg for diastolic blood pressure. According to the results of the validation study on the basis of the ESH International Protocol, the Artsana CSI 610 can be recommended for clinical use in adults.

Assessing anger regulation in middle childhood: development and validation of a behavioral observation measure.

PubMed

Rohlf, Helena L; Krahé, Barbara

2015-01-01

An observational measure of anger regulation in middle childhood was developed that facilitated the in situ assessment of five maladaptive regulation strategies in response to an anger-eliciting task. 599 children aged 6-10 years (M = 8.12, SD = 0.92) participated in the study. Construct validity of the measure was examined through correlations with parent- and self-reports of anger regulation and anger reactivity. Criterion validity was established through links with teacher-rated aggression and social rejection measured by parent-, teacher-, and self-reports. The observational measure correlated significantly with parent- and self-reports of anger reactivity, whereas it was unrelated to parent- and self-reports of anger regulation. It also made a unique contribution to predicting aggression and social rejection.

Assessing anger regulation in middle childhood: development and validation of a behavioral observation measure

PubMed Central

Rohlf, Helena L.; Krahé, Barbara

2015-01-01

An observational measure of anger regulation in middle childhood was developed that facilitated the in situ assessment of five maladaptive regulation strategies in response to an anger-eliciting task. 599 children aged 6–10 years (M = 8.12, SD = 0.92) participated in the study. Construct validity of the measure was examined through correlations with parent- and self-reports of anger regulation and anger reactivity. Criterion validity was established through links with teacher-rated aggression and social rejection measured by parent-, teacher-, and self-reports. The observational measure correlated significantly with parent- and self-reports of anger reactivity, whereas it was unrelated to parent- and self-reports of anger regulation. It also made a unique contribution to predicting aggression and social rejection. PMID:25964767

Content Validation and Evaluation of an Endovascular Teamwork Assessment Tool.

PubMed

Hull, L; Bicknell, C; Patel, K; Vyas, R; Van Herzeele, I; Sevdalis, N; Rudarakanchana, N

2016-07-01

To modify, content validate, and evaluate a teamwork assessment tool for use in endovascular surgery. A multistage, multimethod study was conducted. Stage 1 included expert review and modification of the existing Observational Teamwork Assessment for Surgery (OTAS) tool. Stage 2 included identification of additional exemplar behaviours contributing to effective teamwork and enhanced patient safety in endovascular surgery (using real-time observation, focus groups, and semistructured interviews of multidisciplinary teams). Stage 3 included content validation of exemplar behaviours using expert consensus according to established psychometric recommendations and evaluation of structure, content, feasibility, and usability of the Endovascular Observational Teamwork Assessment Tool (Endo-OTAS) by an expert multidisciplinary panel. Stage 4 included final team expert review of exemplars. OTAS core team behaviours were maintained (communication, coordination, cooperation, leadership team monitoring). Of the 114 OTAS behavioural exemplars, 19 were modified, four removed, and 39 additional endovascular-specific behaviours identified. Content validation of these 153 exemplar behaviours showed that 113/153 (73.9%) reached the predetermined Item-Content Validity Index rating for teamwork and/or patient safety. After expert team review, 140/153 (91.5%) exemplars were deemed to warrant inclusion in the tool. More than 90% of the expert panel agreed that Endo-OTAS is an appropriate teamwork assessment tool with observable behaviours. Some concerns were noted about the time required to conduct observations and provide performance feedback. Endo-OTAS is a novel teamwork assessment tool, with evidence for content validity and relevance to endovascular teams. Endo-OTAS enables systematic objective assessment of the quality of team performance during endovascular procedures. Copyright © 2016. Published by Elsevier Ltd.

Assessing physical activity during youth sport: the Observational System for Recording Activity in Children: Youth Sports.

PubMed

Cohen, Alysia; McDonald, Samantha; McIver, Kerry; Pate, Russell; Trost, Stewart

2014-05-01

The purpose of this study was to evaluate the validity and interrater reliability of the Observational System for Recording Activity in Children: Youth Sports (OSRAC:YS). Children (N = 29) participating in a parks and recreation soccer program were observed during regularly scheduled practices. Physical activity (PA) intensity and contextual factors were recorded by momentary time-sampling procedures (10-second observe, 20-second record). Two observers simultaneously observed and recorded children's PA intensity, practice context, social context, coach behavior, and coach proximity. Interrater reliability was based on agreement (Kappa) between the observer's coding for each category, and the Intraclass Correlation Coefficient (ICC) for percent of time spent in MVPA. Validity was assessed by calculating the correlation between OSRAC:YS estimated and objectively measured MVPA. Kappa statistics for each category demonstrated substantial to almost perfect interobserver agreement (Kappa = 0.67-0.93). The ICC for percent time in MVPA was 0.76 (95% C.I. = 0.49-0.90). A significant correlation (r = .73) was observed for MVPA recorded by observation and MVPA measured via accelerometry. The results indicate the OSRAC:YS is a reliable and valid tool for measuring children's PA and contextual factors during a youth soccer practice.

Accuracy of clinical observations of push-off during gait after stroke.

PubMed

McGinley, Jennifer L; Morris, Meg E; Greenwood, Ken M; Goldie, Patricia A; Olney, Sandra J

2006-06-01

To determine the accuracy (criterion-related validity) of real-time clinical observations of push-off in gait after stroke. Criterion-related validity study of gait observations. Rehabilitation hospital in Australia. Eleven participants with stroke and 8 treating physical therapists. Not applicable. Pearson product-moment correlation between physical therapists' observations of push-off during gait and criterion measures of peak ankle power generation from a 3-dimensional motion analysis system. A high correlation was obtained between the observational ratings and the measurements of peak ankle power generation (Pearson r =.98). The standard error of estimation of ankle power generation was .32W/kg. Physical therapists can make accurate real-time clinical observations of push-off during gait following stroke.

Validation of High Wind Retrievals from the Cyclone Global Navigation Satellite System (CYGNSS) Mission

NASA Astrophysics Data System (ADS)

McKague, D. S.; Ruf, C. S.; Balasubramaniam, R.; Clarizia, M. P.

2017-12-01

The Cyclone Global Navigation Satellite System (CYGNSS) mission, launched in December of 2016, provides all-weather observations of sea surface winds. Using GPS-based bistatic reflectometry, the CYGNSS satellites can estimate sea surface winds even through a hurricane eye wall. This, combined with the high temporal resolution of the CYGNSS constellation (median revisit time of 2.8 hours), yields unprecedented ability to estimate hurricane strength winds. While there are a number of other sources of sea surface wind estimates, such as buoys, dropsondes, passive and active microwave from aircraft and satellite, and models, the combination of all-weather, high accuracy, short revisit time, high spatial coverage, and continuous operation of the CYGNSS mission enables significant advances in the understanding, monitoring, and prediction of cyclones. Validating CYGNSS wind retrievals over the bulk of the global wind speed distribution, which peaks at around 7 meters per second, is relatively straight-forward, requiring spatial-temporal matching of observations with independent sources (such as those mentioned above). Validating CYGNSS wind retrievals for "high" winds (> 20 meters per second), though, is problematic. Such winds occur only in intense storms. While infrequent, making validation opportunities also infrequent and problematic due to their intense nature, such storms are important to study because of the high potential for damage and loss of life. This presentation will describe the efforts of the CYGNSS Calibration/Validation team to gather measurements of high sea surface winds for development and validation of the CYGNSS geophysical model function (GMF), which forms the basis of retrieving winds from CYGNSS observations. The bulk of these observations come from buoy measurements as well as aircraft ("hurricane hunter") measurements from passive microwave and dropsondes. These data are matched in space and time to CYGNSS observations for training of the CYGNSS GMF and an independent set is used for validation of the resulting high wind speed retrievals. In addition to describing the general validation process, results from matchups over the 2017 hurricane season will be presented.

Validation of the Somnotouch-NIBP noninvasive continuous blood pressure monitor according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Bilo, Grzegorz; Zorzi, Cristina; Ochoa Munera, Juan E; Torlasco, Camilla; Giuli, Valentina; Parati, Gianfranco

2015-10-01

The present study aimed to evaluate the accuracy of the Somnotouch-NIBP noninvasive continuous blood pressure monitor according to the European Society of Hypertension International Protocol revision 2010. Systolic and diastolic blood pressures were sequentially measured in 33 adults (11 women, mean age 63.5±11.9 years) using a mercury sphygmomanometer (two observers) and the Somnotouch-NIBP device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. All the validation requirements were fulfilled. The Somnotouch-NIBP device fulfilled the requirements of the part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 75/99, 90/99, and 96/99, respectively, for systolic blood pressure and 90/99, 99/99, and 99/99, respectively, for diastolic blood pressure. The device also fulfilled the criteria in part 2 of the validation study. Twenty-seven and 31 participants had at least two of the three device-observers differences less than or equal to 5 mmHg for systolic and diastolic blood pressure, respectively. All three device-observer differences were greater than 5 mmHg in two participants for systolic and in one participant for diastolic blood pressure. The Somnotouch-NIBP noninvasive continuous blood pressure monitor has passed the requirements of the International Protocol revision 2010, and hence can be recommended for blood pressure monitoring in adults, at least under conditions corresponding to those investigated in our study.

Evolution of Precipitation Structure During the November DYNAMO MJO Event: Cloud-Resolving Model Intercomparison and Cross Validation Using Radar Observations

NASA Astrophysics Data System (ADS)

Li, Xiaowen; Janiga, Matthew A.; Wang, Shuguang; Tao, Wei-Kuo; Rowe, Angela; Xu, Weixin; Liu, Chuntao; Matsui, Toshihisa; Zhang, Chidong

2018-04-01

Evolution of precipitation structures are simulated and compared with radar observations for the November Madden-Julian Oscillation (MJO) event during the DYNAmics of the MJO (DYNAMO) field campaign. Three ground-based, ship-borne, and spaceborne precipitation radars and three cloud-resolving models (CRMs) driven by observed large-scale forcing are used to study precipitation structures at different locations over the central equatorial Indian Ocean. Convective strength is represented by 0-dBZ echo-top heights, and convective organization by contiguous 17-dBZ areas. The multi-radar and multi-model framework allows for more stringent model validations. The emphasis is on testing models' ability to simulate subtle differences observed at different radar sites when the MJO event passed through. The results show that CRMs forced by site-specific large-scale forcing can reproduce not only common features in cloud populations but also subtle variations observed by different radars. The comparisons also revealed common deficiencies in CRM simulations where they underestimate radar echo-top heights for the strongest convection within large, organized precipitation features. Cross validations with multiple radars and models also enable quantitative comparisons in CRM sensitivity studies using different large-scale forcing, microphysical schemes and parameters, resolutions, and domain sizes. In terms of radar echo-top height temporal variations, many model sensitivity tests have better correlations than radar/model comparisons, indicating robustness in model performance on this aspect. It is further shown that well-validated model simulations could be used to constrain uncertainties in observed echo-top heights when the low-resolution surveillance scanning strategy is used.

Convergent Validity of the Autism Spectrum Disorder-Diagnostic for Children (ASD-DC) and Childhood Autism Rating Scales (CARS)

ERIC Educational Resources Information Center

Matson, Johnny L.; Mahan, Sara; Hess, Julie A.; Fodstad, Jill C.; Neal, Daniene

2010-01-01

Previous studies analyzed the reliability as well as sensitivity and specificity of the Autism Spectrum Disorder-Diagnostic for Children (ASD-DC). This study further examines the psychometric properties of the ASD-DC by assessing whether the ASD-DC has convergent validity against a psychometrically sound observational instrument for Autistic…

(In)validation in the Minority: The Experiences of Latino Students Enrolled in an HBCU

ERIC Educational Resources Information Center

Allen, Taryn Ozuna

2016-01-01

This qualitative, phenomenological study examined the academic and interpersonal validation experiences of four female and four male Latino students who were enrolled in their second- to fifth-year at an HBCU in Texas. Using interviews, campus observations, a questionnaire, and analytic memos, this study sought to understand the role of in- and…

Reliability and validity of a tool to measure the severity of tongue thrust in children: the Tongue Thrust Rating Scale.

PubMed

Serel Arslan, S; Demir, N; Karaduman, A A

2017-02-01

This study aimed to develop a scale called Tongue Thrust Rating Scale (TTRS), which categorised tongue thrust in children in terms of its severity during swallowing, and to investigate its validity and reliability. The study describes the developmental phase of the TTRS and presented its content and criterion-based validity and interobserver and intra-observer reliability. For content validation, seven experts assessed the steps in the scale over two Delphi rounds. Two physical therapists evaluated videos of 50 children with cerebral palsy (mean age, 57·9 ± 16·8 months), using the TTRS to test criterion-based validity, interobserver and intra-observer reliability. The Karaduman Chewing Performance Scale (KCPS) and Drooling Severity and Frequency Scale (DSFS) were used for criterion-based validity. All the TTRS steps were deemed necessary. The content validity index was 0·857. A very strong positive correlation was found between two examinations by one physical therapist, which indicated intra-observer reliability (r = 0·938, P < 0·001). A very strong positive correlation was also found between the TTRS scores of two physical therapists, indicating interobserver reliability (r = 0·892, P < 0·001). There was also a strong positive correlation between the TTRS and KCPS (r = 0·724, P < 0·001) and a very strong positive correlation between the TTRS scores and DSFS (r = 0·822 and r = 0·755; P < 0·001). These results demonstrated the criterion-based validity of the TTRS. The TTRS is a valid, reliable and clinically easy-to-use functional instrument to document the severity of tongue thrust in children. © 2016 John Wiley & Sons Ltd.

AMSR2 Soil Moisture Product Validation

NASA Technical Reports Server (NTRS)

Bindlish, R.; Jackson, T.; Cosh, M.; Koike, T.; Fuiji, X.; de Jeu, R.; Chan, S.; Asanuma, J.; Berg, A.; Bosch, D.;

Examining the Validity of Behavioral Self-Regulation Tools in Predicting Preschoolers' Academic Achievement

ERIC Educational Resources Information Center

Schmitt, Sara A.; Pratt, Megan E.; McClelland, Megan M.

2014-01-01

The current study investigated the predictive utility among teacher-rated, observed, and directly assessed behavioral self-regulation skills to academic achievement in preschoolers. Specifically, this study compared how a teacher report, the Child Behavior Rating Scale, an observer report, the Observed Child Engagement Scale, and a direct…

Examining the Validity of Behavioral Self-Regulation Tools in Predicting Preschoolers' Academic Achievement

ERIC Educational Resources Information Center

Schmitt, Sara A.; Pratt, Megan E.; McClelland, Megan M.

2014-01-01

Research Findings: The current study investigated the predictive utility of teacher-rated, observed, and directly assessed behavioral self-regulation skills to academic achievement in preschoolers. Specifically, this study compared how a teacher report (the Child Behavior Rating Scale), an observer report (the Observed Child Engagement Scale), and…

The Role of Anchor Stations in the Validation of Earth Observation Satellite Data and Products. The Valencia and the Alacant Anchor Stations

NASA Astrophysics Data System (ADS)

Lopez-Baeza, Ernesto; Geraldo Ferreira, A.; Saleh-Contell, Kauzar

Space technology facilitates humanity and science with a global revolutionary view of the Earth through the acquisition of Earth Observation satellite data. Satellites capture information over different spatial and temporal scales and assist in understanding natural climate processes and in detecting and explaining climate change. Accurate Earth Observation data is needed to describe climate processes by improving the parameterisations of different climate elements. Algorithms to produce geophysical parameters from raw satellite observations should go through selection processes or participate in inter-comparison programmes to ensure performance reliability. Geophysical parameter datasets, obtained from satellite observations, should pass a quality control before they are accepted in global databases for impact, diagnostic or sensitivity studies. Calibration and Validation, or simply "Cal/Val", is the activity that endeavours to ensure that remote sensing products are highly consistent and reproducible. This is an evolving scientific activity that is becoming increasingly important as more long-term studies on global change are undertaken, and new satellite missions are launched. Calibration is the process of quantitatively defining the system responses to known, controlled signal inputs. Validation refers to the process of assessing, by independent means, the quality of the data products derived from the system outputs. These definitions are generally accepted and most often used in the remote sensing context to refer specifically and respectively to sensor radiometric calibration and geophysical parameter validation. Anchor Stations are carefully selected locations at which instruments measure quantities that are needed to run, calibrate or validate models and algorithms. These are needed to quanti-tatively evaluate satellite data and convert it into geophysical information. The instruments collect measurements of basic quantities over a long timescale. Measurements are made of meteorological and hydrological background data, and of quantities not readily assessed at operational stations. Anchor Stations also offer infrastructure to undertake validation experi-ments. These are more detailed measurements over shorter intensive observation periods. The Valencia Anchor Station is showing its capabilities and conditions as a reference validation site in the framework of low spatial resolution remote sensing missions such as CERES, GERB and SMOS. The Alacant Anchor Station is a reference site in studies on the interactions between desertification and climate. This paper presents the activities so far carried out at both Anchor Stations, the precise and detailed ground and aircraft experiments carefully designed to develop a specific methodology to validate low spatial resolution satellite data and products, and the knowledge exchange currently being exercised between the University of Valencia, Spain, and FUNCEME, Brazil, in common objectives of mutual interest.

The predictive validity of three versions of the MCAT in relation to performance in medical school, residency, and licensing examinations: a longitudinal study of 36 classes of Jefferson Medical College.

PubMed

Callahan, Clara A; Hojat, Mohammadreza; Veloski, Jon; Erdmann, James B; Gonnella, Joseph S

2010-06-01

The Medical College Admission Test (MCAT) has undergone several revisions for content and validity since its inception. With another comprehensive review pending, this study examines changes in the predictive validity of the MCAT's three recent versions. Study participants were 7,859 matriculants in 36 classes entering Jefferson Medical College between 1970 and 2005; 1,728 took the pre-1978 version of the MCAT; 3,032 took the 1978-1991 version, and 3,099 took the post-1991 version. MCAT subtest scores were the predictors, and performance in medical school, attrition, scores on the medical licensing examinations, and ratings of clinical competence in the first year of residency were the criterion measures. No significant improvement in validity coefficients was observed for performance in medical school or residency. Validity coefficients for all three versions of the MCAT in predicting Part I/Step 1 remained stable (in the mid-0.40s, P < .01). A systematic decline was observed in the validity coefficients of the MCAT versions in predicting Part II/Step 2. It started at 0.47 for the pre-1978 version, decreased to between 0.42 and 0.40 for the 1978-1991 versions, and to 0.37 for the post-1991 version. Validity coefficients for the MCAT versions in predicting Part III/Step 3 remained near 0.30. These were generally larger for women than men. Although the findings support the short- and long-term predictive validity of the MCAT, opportunities to strengthen it remain. Subsequent revisions should increase the test's ability to predict performance on United States Medical Licensing Examination Step 2 and must minimize the differential validity for gender.

A tool to assess sex-gender when selecting health research projects.

PubMed

Tomás, Concepción; Yago, Teresa; Eguiluz, Mercedes; Samitier, M A Luisa; Oliveros, Teresa; Palacios, Gemma

2015-04-01

To validate the questionnaire "Gender Perspective in Health Research" (GPIHR) to assess the inclusion of gender perspective in research projects. Validation study in two stages. Feasibility was analysed in the first, and reliability, internal consistence and validity in the second. Aragón Institute of Health Science, Aragón, Spain. GPIHR was applied to 118 research projects funded in national and international competitive tenders from 2003 to 2012. Analysis of inter- and intra-observer reliability with Kappa index and internal consistency with Cronbach's alpha. Content validity analysed through literature review and construct validity with an exploratory factor analysis. Validated GPIHR has 10 questions: 3 in the introduction, 1 for objectives, 3 for methodology and 3 for research purpose. Average time of application was 13min Inter-observer reliability (Kappa) varied between 0.35 and 0.94 and intra-observer between 0.40 and 0.94. Theoretical construct is supported in the literature. Factor analysis identifies three levels of GP inclusion: "difference by sex", "gender sensitive" and "feminist research" with an internal consistency of 0.64, 0.87 and 0.81, respectively, which explain 74.78% of variance. GPIHR questionnaire is a valid tool to assess GP and useful for those researchers who would like to include GP in their projects. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Intercomparison among tropospheric ozone and nitrogen dioxide data obtained by satellite- and ground-based measurements

NASA Astrophysics Data System (ADS)

Noguchi, K.; Urita, N.; Ohta, E.; Hayashida, S.; Richter, A.; Burrows, J. P.; Liu, X.; Chance, K.; Ziemke, J. R.

2005-12-01

Rapid economical growth and industrial development in East Asian regions are causing serious air pollution. The influence of such air pollution is not limited to a local scale but reaches an intercontinental or hemispheric scale. Satellite-borne observations can monitor the behaviors of air pollutants in a global scale for long periods with a single instrument. In particular, ozone and nitrogen dioxide in the troposphere have a crucial role in air pollution, and many studies have tried to derive those species. Recently, instrumentations and retrieval techniques have made a lot of progress in measurements of tropospheric constituents. However, tropospheric observations from space need careful validation because of difficulties in detecting signals from the lower atmosphere through the middle atmosphere. In the present study, we intercompare the tropospheric ozone and nitrogen dioxide data obtained by satellite- and ground-based measurements in order to validate the satellite measurements. For the validation of tropospheric ozone, we utilize ozonesonde data provided by WOUDC, and three satellite-borne data (Tropospheric Ozone Residual (TOR), Cloud Slicing, and GOME) are intercompared. For nitrogen dioxide, we compare GOME observations with ground-based air monitoring measurements in Japan which are operationally conducted by the Ministry of the Environment Japan. This study demonstrates the validity and potential of those satellite datasets to apply for quantitative analysis of dispersion of air pollutants and their chemical lifetime. Acknowledgments. TOR data is provided by J. Fishman via http://asd-www.larc.nasa.gov/TOR/data.html. The ground observation data of nitrogen dioxide over Japan is provided by National Institute for Environmental Studies (NIES) under the collaboration study with NIES and Nara Women's University.

Inter-calibration and validation of observations from SAPHIR and ATMS instruments

NASA Astrophysics Data System (ADS)

Moradi, I.; Ferraro, R. R.

2015-12-01

We present the results of evaluating observations from microwave instruments aboard the Suomi National Polar-orbiting Partnership (NPP, ATMS instrument) and Megha-Tropiques (SAPHIR instrument) satellites. The study includes inter-comparison and inter-calibration of observations of similar channels from the two instruments, evaluation of the satellite data using high-quality radiosonde data from Atmospheric Radiation Measurement Program and GPS Radio Occultaion Observations from COSMIC mission, as well as geolocation error correction. The results of this study are valuable for generating climate data records from these instruments as well as for extending current climate data records from similar instruments such as AMSU-B and MHS to the ATMS and SAPHIR instruments. Reference: Moradi et al., Intercalibration and Validation of Observations From ATMS and SAPHIR Microwave Sounders. IEEE Transactions on Geoscience and Remote Sensing. 01/2015; DOI: 10.1109/TGRS.2015.2427165

Technical note: Validation of an automated system for monitoring and restricting water intake in group-housed beef steers.

PubMed

Allwardt, K; Ahlberg, C; Broocks, A; Bruno, K; Taylor, A; Place, S; Richards, C; Krehbiel, C; Calvo-Lorenzo, M; DeSilva, U; VanOverbeke, D; Mateescu, R; Goad, C; Rolf, M M

2017-09-01

The Insentec Roughage Intake Control (RIC) system has been validated for the collection of water intake; however, this system has not been validated for water restriction. The objective of this validation was to evaluate the agreement between direct observations and automated intakes collected by the RIC system under both ad libitum and restricted water conditions. A total of 239 crossbred steers were used in a 3-d validation trial, which assessed intake values generated by the RIC electronic intake monitoring system for both ad libitum water intake ( = 122; BASE) and restricted water intake ( = 117; RES). Direct human observations were collected on 4 Insentec water bins for three 24-h periods and three 12-h periods for BASE and RES, respectively. An intake event was noted by the observer when the electronic identification of the animal was read by the transponder and the gate lowered, and starting and ending bin weights were recorded for each intake event. Data from direct observations across each validation period were compared to automated observations generated from the RIC system. Missing beginning or ending weight values for visual observations occasionally occurred due to the observer being unable to capture the value before the monitor changed when bin activity was high. To estimate the impact of these missing values, analyses denoted as OBS were completed with the incomplete record coded as missing data. These analyses were contrasted with analyses where observations with a single missing beginning or end weight (but not both) were assumed to be identical to that which was recorded by the Insentec system (OBS). Difference in mean total intake across BASE steers was 0.60 ± 2.06 kg OBS (0.54 ± 1.99 kg OBS) greater for system observations than visual observations. The comparison of mean total intake across the 3 RES validation days was 0.53 ± 2.30 kg OBS (0.13 ± 1.83 kg OBS) greater for system observations than direct observations. Day was not a significant source of error in this study ( > 0.05). These results indicate that the system was capable of limiting water of individual animals with reasonable accuracy, although errors are slightly higher during water restriction than during ad libitum access. The Insentec system is a suitable resource for monitoring individual water intake of growing, group-housed steers under ad libitum and restricted water conditions.

Use of a mobile phone diary for observing weight management and related behaviours.

PubMed

Mattila, Elina; Lappalainen, Raimo; Pärkkä, Juha; Salminen, Jukka; Korhonen, Ilkka

2010-01-01

We studied self-observations related to weight management recorded with a Wellness Diary application on a mobile phone. The data were recorded by 27 participants in a 12-week study, which included a short weight management lecture followed by independent usage of the Wellness Diary. We studied the validity of self-observed weight, and behavioural changes and weight patterns related to weight management success. Self-observed weight data tended to underestimate pre- and poststudy measurements, but there were high correlations between the measures (r >or= 0.80). The amount of physical activity correlated significantly with weight loss (r = 0.44) as did different measures representing healthy changes in dietary behaviours (r >or= 0.45). Weight changes and the weekly rhythms of weight indicated a strong tendency to compensate for high-risk periods among successful weight-losers compared to unsuccessful ones. These preliminary results suggest that the mobile phone diary is a valid tool for observing weight management and related behaviours.

Measuring disability: a systematic review of the validity and reliability of the Global Activity Limitations Indicator (GALI).

PubMed

Van Oyen, Herman; Bogaert, Petronille; Yokota, Renata T C; Berger, Nicolas

2018-01-01

GALI or Global Activity Limitation Indicator is a global survey instrument measuring participation restriction. GALI is the measure underlying the European indicator Healthy Life Years (HLY). Gali has a substantial policy use within the EU and its Member States. The objective of current paper is to bring together what is known from published manuscripts on the validity and the reliability of GALI. Following the PRISMA guidelines, two search strategies (PUBMED, Google Scholar) were combined to identify manuscripts published in English with publication date 2000 or beyond. Articles were classified as reliability studies, concurrent or predictive validity studies, in national or international populations. Four cross-sectional studies (of which 2 international) studied how GALI relates to other health measures (concurrent validity). A dose-response effect by GALI severity level on the association with the other health status measures was observed in the national studies. The 2 international studies (SHARE, EHIS) concluded that the odds of reporting participation restriction was higher in subjects with self-reported or observed functional limitations. In SHARE, the size of the Odds Ratio's (ORs) in the different countries was homogeneous, while in EHIS the size of the ORs varied more strongly. For the predictive validity, subjects were followed over time (4 studies of which one international). GALI proved, both in national and international data, to be a consistent predictor of future health outcomes both in terms of mortality and health care expenditure. As predictors of mortality, the two distinct health concepts, self-rated health and GALI, acted independently and complementary of each other. The one reliability study identified reported a sufficient reliability of GALI. GALI as inclusive one question instrument fits all conceptual characteristics specified for a global measure on participation restriction. In none of the studies, included in the review, there was evidence of a failing validity. The review shows that GALI has a good and sufficient concurrent and predictive validity, and reliability.

Use of the Environment and Policy Evaluation and Observation as a Self-Report Instrument (EPAO-SR) to measure nutrition and physical activity environments in child care settings: validity and reliability evidence.

PubMed

Ward, Dianne S; Mazzucca, Stephanie; McWilliams, Christina; Hales, Derek

2015-09-26

Early care and education (ECE) centers are important settings influencing young children's diet and physical activity (PA) behaviors. To better understand their impact on diet and PA behaviors as well as to evaluate public health programs aimed at ECE settings, we developed and tested the Environment and Policy Assessment and Observation - Self-Report (EPAO-SR), a self-administered version of the previously validated, researcher-administered EPAO. Development of the EPAO-SR instrument included modification of items from the EPAO, community advisory group and expert review, and cognitive interviews with center directors and classroom teachers. Reliability and validity data were collected across 4 days in 3-5 year old classrooms in 50 ECE centers in North Carolina. Center teachers and directors completed relevant portions of the EPAO-SR on multiple days according to a standardized protocol, and trained data collectors completed the EPAO for 4 days in the centers. Reliability and validity statistics calculated included percent agreement, kappa, correlation coefficients, coefficients of variation, deviations, mean differences, and intraclass correlation coefficients (ICC), depending on the response option of the item. Data demonstrated a range of reliability and validity evidence for the EPAO-SR instrument. Reporting from directors and classroom teachers was consistent and similar to the observational data. Items that produced strongest reliability and validity estimates included beverages served, outside time, and physical activity equipment, while items such as whole grains served and amount of teacher-led PA had lower reliability (observation and self-report) and validity estimates. To overcome lower reliability and validity estimates, some items need administration on multiple days. This study demonstrated appropriate reliability and validity evidence for use of the EPAO-SR in the field. The self-administered EPAO-SR is an advancement of the measurement of ECE settings and can be used by researchers and practitioners to assess the nutrition and physical activity environments of ECE settings.

Cross-Cultural Adaptation, Validity, and Reliability of the Persian Version of the Orebro Musculoskeletal Pain Screening Questionnaire.

PubMed

Shafeei, Asrin; Mokhtarinia, Hamid Reza; Maleki-Ghahfarokhi, Azam; Piri, Leila

2017-08-01

Observational study. To cross-culturally translate the Orebro Musculoskeletal Pain Screening Questionnaire (OMPQ) into Persian and then evaluate its psychometric properties (reliability, validity, ceiling, and flooring effects). To the authors' knowledge, prior to this study there has been no validated instrument to screen the risk of chronicity in Persian-speaking patients with low back pain (LBP) in Iran. The OMPQ was specifically developed as a self-administered screening tool for assessing the risk of LBP chronicity. The forward-backward translation method was used for the translation and cross-cultural adaptation of the original questionnaire. In total, 202 patients with subacute LBP completed the OMPQ and the pain disability questionnaire (PDQ), which was used to assess convergent validity. 62 patients completed the OMPQ a week later as a retest. Slight changes were made to the OMPQ during the translation/cultural adaptation process; face validity of the Persian version was obtained. The Persian OMPQ showed excellent test-retest reliability (intraclass correlation coefficient=0.89). Its internal consistency was 0.71, and its convergent validity was confirmed by good correlation coefficient between the OMPQ and PDQ total scores ( r =0.72, p <0.05). No ceiling or floor effects were observed. The Persian version of the OMPQ is acceptable for the target society in terms of face validity, construct validity, reliability, and consistency. It is therefore considered a useful instrument for screening Iranian patients with LBP.

Evaluation of the psychometric properties of the phlebitis and infiltration scales for the assessment of complications of peripheral vascular access devices.

PubMed

Groll, Dianne; Davies, Barbara; Mac Donald, Joan; Nelson, Susanne; Virani, Tazim

2010-01-01

To prevent complications from peripheral vascular access device (PVAD) therapy, the Infusion Nurses Society (INS) developed 2 scales to measure the extent and severity of phlebitis and infiltration in PVADs. This study evaluated the psychometric properties of these scales to validate them with respect to their interrater reliability, concurrent validity, feasibility, and acceptability. A total of 182 patients at 2 sites were enrolled, and 416 observations of PVAD sites were made. Two nurses independently rated each PVAD site for the presence or absence of phlebitis and/or infiltration by using the INS scales. The interrater reliability was calculated, as was the agreement of the observed versus charted incidence of phlebitis and infiltration (concurrent validity) and the ease of use of the scales (feasibility, acceptability). Interrater reliability for both the Phlebitis and Infiltration scales and concurrent validity were found to be statistically significant (P < .05). The study nurses reported the scales to be easy to use, taking an average of 1.3 minutes to complete both. The importance of valid measures for use in research cannot be underestimated. The INS Phlebitis and Infiltration scales have been shown to be easy to use, valid, and reliable scales.

Innovative use of self-organising maps (SOMs) in model validation.

NASA Astrophysics Data System (ADS)

Jolly, Ben; McDonald, Adrian; Coggins, Jack

2016-04-01

We present an innovative combination of techniques for validation of numerical weather prediction (NWP) output against both observations and reanalyses using two classification schemes, demonstrated by a validation of the operational NWP 'AMPS' (the Antarctic Mesoscale Prediction System). Historically, model validation techniques have centred on case studies or statistics at various time scales (yearly/seasonal/monthly). Within the past decade the latter technique has been expanded by the addition of classification schemes in place of time scales, allowing more precise analysis. Classifications are typically generated for either the model or the observations, then used to create composites for both which are compared. Our method creates and trains a single self-organising map (SOM) on both the model output and observations, which is then used to classify both datasets using the same class definitions. In addition to the standard statistics on class composites, we compare the classifications themselves between the model and the observations. To add further context to the area studied, we use the same techniques to compare the SOM classifications with regimes developed for another study to great effect. The AMPS validation study compares model output against surface observations from SNOWWEB and existing University of Wisconsin-Madison Antarctic Automatic Weather Stations (AWS) during two months over the austral summer of 2014-15. Twelve SOM classes were defined in a '4 x 3' pattern, trained on both model output and observations of 2 m wind components, then used to classify both training datasets. Simple statistics (correlation, bias and normalised root-mean-square-difference) computed for SOM class composites showed that AMPS performed well during extreme weather events, but less well during lighter winds and poorly during the more changeable conditions between either extreme. Comparison of the classification time-series showed that, while correlations were lower during lighter wind periods, AMPS actually forecast the existence of those periods well suggesting that the correlations may be unfairly low. Further investigation showed poor temporal alignment during more changeable conditions, highlighting problems AMPS has around the exact timing of events. There was also a tendency for AMPS to over-predict certain wind flow patterns at the expense of others. In order to gain a larger scale perspective, we compared our mesoscale SOM classification time-series with synoptic scale regimes developed by another study using ERA-Interim reanalysis output and k-means clustering. There was good alignment between the regimes and the observations classifications (observations/regimes), highlighting the effect of synoptic scale forcing on the area. However, comparing the alignment between observations/regimes and AMPS/regimes showed that AMPS may have problems accurately resolving the strength and location of cyclones in the Ross Sea to the north of the target area.

The Validity of Observational Measures in Detecting Optimal Maternal Communication Styles: Evidence from European Americans and Latinos

ERIC Educational Resources Information Center

Nadeem, Erum; Romo, Laura F.; Sigman, Marian; Lefkowitz, Eva S.; Au, Terry K.

2007-01-01

This study examined the sensitivity of an observational coding system for assessing positive and negative maternal behaviors of Latino and European American mothers toward their adolescent children. Ninety Latino (54 Spanish speaking and 35 English speaking) and 20 European American mother-adolescent dyads participated in an observational study of…

Evaluating the Sensitivity of Agricultural Model Performance to Different Climate Inputs: Supplemental Material

NASA Technical Reports Server (NTRS)

Glotter, Michael J.; Ruane, Alex C.; Moyer, Elisabeth J.; Elliott, Joshua W.

2015-01-01

Projections of future food production necessarily rely on models, which must themselves be validated through historical assessments comparing modeled and observed yields. Reliable historical validation requires both accurate agricultural models and accurate climate inputs. Problems with either may compromise the validation exercise. Previous studies have compared the effects of different climate inputs on agricultural projections but either incompletely or without a ground truth of observed yields that would allow distinguishing errors due to climate inputs from those intrinsic to the crop model. This study is a systematic evaluation of the reliability of a widely used crop model for simulating U.S. maize yields when driven by multiple observational data products. The parallelized Decision Support System for Agrotechnology Transfer (pDSSAT) is driven with climate inputs from multiple sources reanalysis, reanalysis that is bias corrected with observed climate, and a control dataset and compared with observed historical yields. The simulations show that model output is more accurate when driven by any observation-based precipitation product than when driven by non-bias-corrected reanalysis. The simulations also suggest, in contrast to previous studies, that biased precipitation distribution is significant for yields only in arid regions. Some issues persist for all choices of climate inputs: crop yields appear to be oversensitive to precipitation fluctuations but under sensitive to floods and heat waves. These results suggest that the most important issue for agricultural projections may be not climate inputs but structural limitations in the crop models themselves.

Evaluating the sensitivity of agricultural model performance to different climate inputs

PubMed Central

Glotter, Michael J.; Moyer, Elisabeth J.; Ruane, Alex C.; Elliott, Joshua W.

2017-01-01

Projections of future food production necessarily rely on models, which must themselves be validated through historical assessments comparing modeled to observed yields. Reliable historical validation requires both accurate agricultural models and accurate climate inputs. Problems with either may compromise the validation exercise. Previous studies have compared the effects of different climate inputs on agricultural projections, but either incompletely or without a ground truth of observed yields that would allow distinguishing errors due to climate inputs from those intrinsic to the crop model. This study is a systematic evaluation of the reliability of a widely-used crop model for simulating U.S. maize yields when driven by multiple observational data products. The parallelized Decision Support System for Agrotechnology Transfer (pDSSAT) is driven with climate inputs from multiple sources – reanalysis, reanalysis bias-corrected with observed climate, and a control dataset – and compared to observed historical yields. The simulations show that model output is more accurate when driven by any observation-based precipitation product than when driven by un-bias-corrected reanalysis. The simulations also suggest, in contrast to previous studies, that biased precipitation distribution is significant for yields only in arid regions. However, some issues persist for all choices of climate inputs: crop yields appear oversensitive to precipitation fluctuations but undersensitive to floods and heat waves. These results suggest that the most important issue for agricultural projections may be not climate inputs but structural limitations in the crop models themselves. PMID:29097985

Validity and reliability of sleep time questionnaires in children and adolescents: A systematic review and meta-analysis.

PubMed

Nascimento-Ferreira, Marcus V; Collese, Tatiana S; de Moraes, Augusto César F; Rendo-Urteaga, Tara; Moreno, Luis A; Carvalho, Heráclito B

2016-12-01

Sleep duration has been associated with several health outcomes in children and adolescents. As an extensive number of questionnaires are currently used to investigate sleep schedule or sleep time, we performed a systematic review of criterion validation of sleep time questionnaires for children and adolescents, considering accelerometers as the reference method. We found a strong correlation between questionnaires and accelerometers for weeknights and a moderate correlation for weekend nights. When considering only studies performing a reliability assessment of the used questionnaires, a significant increase in the correlations for both weeknights and weekend nights was observed. In conclusion, moderate to strong criterion validity of sleep time questionnaires was observed; however, the reliability assessment of the questionnaires showed strong validation performance. Copyright © 2015 Elsevier Ltd. All rights reserved.

Is Ultrasound a Valid and Reliable Imaging Modality for Airway Evaluation?: An Observational Computed Tomographic Validation Study Using Submandibular Scanning of the Mouth and Oropharynx.

PubMed

Abdallah, Faraj W; Yu, Eugene; Cholvisudhi, Phantila; Niazi, Ahtsham U; Chin, Ki J; Abbas, Sherif; Chan, Vincent W

2017-01-01

Ultrasound (US) imaging of the airway may be useful in predicting difficulty of airway management (DAM); but its use is limited by lack of proof of its validity and reliability. We sought to validate US imaging of the airway by comparison to CT-scan, and to assess its inter- and intra-observer reliability. We used submandibular sonographic imaging of the mouth and oropharynx to examine how well the ratio of tongue thickness to oral cavity height correlates with the ratio of tongue volume to oral cavity volume, an established tomographic measure of DAM. A cohort of 34 patients undergoing CT-scan was recruited. Study standardized assessments included CT-measured ratios of tongue volume to oropharyngeal cavity volume; tongue thickness to oral cavity height; and US-measured ratio of tongue thickness to oral cavity height. Two sonographers independently performed US imaging of the airway before and after CT-scan. Our findings indicate that the US-measured ratio of tongue thickness to oral cavity height highly correlates with the CT-measured ratio of tongue volume to oral cavity volume. US measurements also demonstrated strong inter- and intra-observer reliability. This study suggests that US is a valid and reliable tool for imaging the oral and oropharyngeal parts of the airway, as well as for measuring the volumetric relationship between the tongue and oral cavity, and may therefore be a useful predictor of DAM. © 2016 by the American Institute of Ultrasound in Medicine.

The Anaclitic-Introjective Depression Assessment: Development and preliminary validity of an observer-rated measure.

PubMed

Rost, Felicitas; Luyten, Patrick; Fonagy, Peter

2018-03-01

The two-configurations model developed by Blatt and colleagues offers a comprehensive conceptual and empirical framework for understanding depression. This model suggests that depressed patients struggle, at different developmental levels, with issues related to dependency (anaclitic issues) or self-definition (introjective issues), or a combination of both. This paper reports three studies on the development and preliminary validation of the Anaclitic-Introjective Depression Assessment, an observer-rated assessment tool of impairments in relatedness and self-definition in clinical depression based on the item pool of the Shedler-Westen Assessment Procedure. Study 1 describes the development of the measure using expert consensus rating and Q-methodology. Studies 2 and 3 report the assessment of its psychometric properties, preliminary reliability, and validity in a sample of 128 patients diagnosed with treatment-resistant depression. Four naturally occurring clusters of depressed patients were identified using Q-factor analysis, which, overall, showed meaningful and theoretically expected relationships with anaclitic/introjective prototypes as formulated by experts, as well as with clinical, social, occupational, global, and relational functioning. Taken together, findings reported in this paper provide preliminary evidence for the reliability and validity of the Anaclitic-Introjective Depression Assessment, an observer-rated measure that allows the detection of important nuanced differentiations between and within anaclitic and introjective depression. Copyright © 2017 John Wiley & Sons, Ltd.

Ensemble assimilation of ARGO temperature profile, sea surface temperature and Altimetric satellite data into an eddy permitting primitive equation model of the North Atlantic ocean

NASA Astrophysics Data System (ADS)

Yan, Yajing; Barth, Alexander; Beckers, Jean-Marie; Candille, Guillem; Brankart, Jean-Michel; Brasseur, Pierre

2015-04-01

Sea surface height, sea surface temperature and temperature profiles at depth collected between January and December 2005 are assimilated into a realistic eddy permitting primitive equation model of the North Atlantic Ocean using the Ensemble Kalman Filter. 60 ensemble members are generated by adding realistic noise to the forcing parameters related to the temperature. The ensemble is diagnosed and validated by comparison between the ensemble spread and the model/observation difference, as well as by rank histogram before the assimilation experiments. Incremental analysis update scheme is applied in order to reduce spurious oscillations due to the model state correction. The results of the assimilation are assessed according to both deterministic and probabilistic metrics with observations used in the assimilation experiments and independent observations, which goes further than most previous studies and constitutes one of the original points of this paper. Regarding the deterministic validation, the ensemble means, together with the ensemble spreads are compared to the observations in order to diagnose the ensemble distribution properties in a deterministic way. Regarding the probabilistic validation, the continuous ranked probability score (CRPS) is used to evaluate the ensemble forecast system according to reliability and resolution. The reliability is further decomposed into bias and dispersion by the reduced centred random variable (RCRV) score in order to investigate the reliability properties of the ensemble forecast system. The improvement of the assimilation is demonstrated using these validation metrics. Finally, the deterministic validation and the probabilistic validation are analysed jointly. The consistency and complementarity between both validations are highlighted. High reliable situations, in which the RMS error and the CRPS give the same information, are identified for the first time in this paper.

Validation sampling can reduce bias in healthcare database studies: an illustration using influenza vaccination effectiveness

PubMed Central

Nelson, Jennifer C.; Marsh, Tracey; Lumley, Thomas; Larson, Eric B.; Jackson, Lisa A.; Jackson, Michael

2014-01-01

Objective Estimates of treatment effectiveness in epidemiologic studies using large observational health care databases may be biased due to inaccurate or incomplete information on important confounders. Study methods that collect and incorporate more comprehensive confounder data on a validation cohort may reduce confounding bias. Study Design and Setting We applied two such methods, imputation and reweighting, to Group Health administrative data (full sample) supplemented by more detailed confounder data from the Adult Changes in Thought study (validation sample). We used influenza vaccination effectiveness (with an unexposed comparator group) as an example and evaluated each method’s ability to reduce bias using the control time period prior to influenza circulation. Results Both methods reduced, but did not completely eliminate, the bias compared with traditional effectiveness estimates that do not utilize the validation sample confounders. Conclusion Although these results support the use of validation sampling methods to improve the accuracy of comparative effectiveness findings from healthcare database studies, they also illustrate that the success of such methods depends on many factors, including the ability to measure important confounders in a representative and large enough validation sample, the comparability of the full sample and validation sample, and the accuracy with which data can be imputed or reweighted using the additional validation sample information. PMID:23849144

In Infants' Hands: Identification of Preverbal Infants at Risk for Primary Language Delay

ERIC Educational Resources Information Center

Lüke, Carina; Grimminger, Angela; Rohlfing, Katharina J.; Liszkowski, Ulf; Ritterfeld, Ute

2017-01-01

Early identification of primary language delay is crucial to implement effective prevention programs. Available screening instruments are based on parents' reports and have only insufficient predictive validity. This study employed observational measures of preverbal infants' gestural communication to test its predictive validity for identifying…

The Role of Maternal Emotional Validation and Invalidation on Children's Emotional Awareness

ERIC Educational Resources Information Center

Lambie, John A.; Lindberg, Anja

2016-01-01

Emotional awareness--that is, accurate emotional self-report--has been linked to positive well-being and mental health. However, it is still unclear how emotional awareness is socialized in young children. This observational study examined how a particular parenting communicative style--emotional validation versus emotional invalidation--was…

Validity of Evidence-Derived Criteria for Reactive Attachment Disorder: Indiscriminately Social/Disinhibited and Emotionally Withdrawn/Inhibited Types

ERIC Educational Resources Information Center

Gleason, Mary Margaret; Fox, Nathan A.; Drury, Stacy; Smyke, Anna; Egger, Helen L.; Nelson, Charles A., III; Gregas, Matthew C.; Zeanah, Charles H.

2011-01-01

Objective: This study examined the validity of criteria for indiscriminately social/disinhibited and emotionally withdrawn/inhibited reactive attachment disorder (RAD). Method: As part of a longitudinal intervention trial of previously institutionalized children, caregiver interviews and direct observational measurements provided continuous and…

Validation of the Andon KD-5965 upper-arm blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Huang, Jinhua; Li, Zhijie; Li, Guimei; Liu, Zhaoying

2015-10-01

This study aimed to evaluate the accuracy of the Andon KD-5965 upper-arm blood pressure monitor according to the European Society of Hypertension International Protocol revision 2010. Systolic and diastolic blood pressures were sequentially measured in 33 adults, with 20 women using a mercury sphygmomanometer (two observers) and the Andon KD-5965 device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. The device achieved the targets in part 1 of the validation study. The number of absolute differences between the device and observers within 5, 10, and 15 mmHg was 70/99, 91/99, and 98/99, respectively, for systolic blood pressure and 81/99, 99/99, and 99/99, respectively, for diastolic blood pressure. The device also fulfilled the criteria in part 2 of the validation study. Twenty-five and 29 participants, for systolic and diastolic blood pressure, respectively, had at least two of the three device-observers differences within 5 mmHg (required≥24). Two and one participants for systolic and diastolic blood pressure, respectively, had all three device-observers comparisons greater than 5 mmHg. According to the validation results, with better performance for diastolic blood pressure than that for systolic blood pressure, the Andon automated oscillometric upper-arm blood pressure monitor KD-5965 fulfilled the requirements of the European Society of Hypertension International Protocol revision 2010, and hence can be recommended for blood pressure measurement in adults.

Validation of an observation tool to assess physical activity-promoting physical education lessons in high schools: SOFIT.

PubMed

Fairclough, Stuart J; Weaver, R Glenn; Johnson, Siobhan; Rawlinson, Jack

2018-05-01

SOFIT+ is an observation tool to measure teacher practices related to moderate-to-vigorous physical activity (MVPA) promotion during physical education (PE). The objective of the study was to examine the validity of SOFIT+ during high school PE lessons. This cross-sectional, observational study tested the construct validity of SOFIT+ in boys' and girls' high school PE lessons. Twenty-one PE lessons were video-recorded and retrospectively coded using SOFIT+. Students wore hip-mounted accelerometers during lessons as an objective measure of MVPA. Multinomial logistic regression was used to estimate the likelihood of students engaging in MVPA during different teacher practices represented by observed individual codes and a combined SOFIT+ index-score. Fourteen individual SOFIT+ variables demonstrated a statistically significant relationship with girls' and boys' MVPA. Observed lesson segments identified as high MVPA-promoting were related to an increased likelihood of girls engaging in 5-10 (OR=2.86 [95% CI 2.41-3.40]), 15-25 (OR=7.41 [95% CI 6.05-9.06]), and 30-40 (OR=22.70 [95% CI 16.97-30.37])s of MVPA. For boys, observed high-MVPA promoting segments were related to an increased likelihood of engaging in 5-10 (OR=1.71 [95% CI 1.45-2.01]), 15-25 (OR=2.69 [95% CI 2.31-3.13]) and 30-40 (OR=4.26 [95% CI 3.44-5.29])s of MVPA. Teacher practices during high school PE lessons are significantly related to students' participation in MVPA. SOFIT+ is a valid and reliable tool to examine relationships between PE teacher practices and student MVPA during PE. Copyright © 2017 Sports Medicine Australia. Published by Elsevier Ltd. All rights reserved.

Iowa Hydrologic and Environmental Validation Site: A Proposal to the Community

NASA Astrophysics Data System (ADS)

Bradley, A. A.; Ciach, G. J.; Eichinger, W. N.; Hornbuckle, K. C.; Illman, W.; Krajewski, W. F.; Kruger, A.; Patel, V. C.; Weirich, F. H.; Zhang, Y.

2002-05-01

We present a proposal to the hydrologic research community to establish a validation site in eastern Iowa. Many hydrological and meteorological variables observed using remote sensing techniques or predicted using numerical simulation models require validation. Validation, understood as quantification of the uncertainty, is difficult and often even impossible using operationally available in-situ observations. Specialized high-density networks of sensors with well-established error characteristics are required to serve as reference. We propose to establish a well-instrumented site for validation of several hydrometeorlogical and environmental variables near Iowa City, Iowa. We foresee this site as a national resource of detailed information collected in partnership with federal, state, and local agencies but independent of their routine mission oriented operations. The data would be distributed in real-time via the Internet to the research community nation wide to support model validation and development studies. In the presentation we justify the need for such sites, we make the case for setting a prototype site in Iowa, and we present preliminary considerations for the site's design and the data distribution system.

Real-world research and the role of observational data in the field of gynaecology - a practical review.

PubMed

Heikinheimo, Oskari; Bitzer, Johannes; García Rodríguez, Luis

2017-08-01

In the context of women's health, we examine (1) the role that observational ('real-world') studies have in overcoming limitations of randomised clinical trials, (2) the relative advantages and disadvantages of different study designs, (3) the importance of outcome data from observational studies when making health-economic or clinical decisions, and (4) provide insights into changing perceptions of observational clinical data. PubMed and internet searches were used to identify (i) guidance and expert commentary on designing, conducting, analysing, and reporting clinical trials or observational studies, (ii) supporting evidence of the rapid growth of observational ('real world') studies and publications since the turn of millennium in the fields of contraception, reproductive health, obstetrics or gynaecology. The rapidly growing use and validation of large, computerised medical records and related databases (e.g., health insurance or national registries) have played a major part in changing perceptions of observational data among researchers and clinicians. In the past 10 years, a distinct increase in the number of observational studies published tends to confirm their growing acceptance, appreciation and use. Observational studies can provide information that is impossible or infeasible to obtain otherwise (e.g., impractical, very expensive, or ethically unacceptable). Greater understanding, dissemination, uptake and use of observational data might be expected to drive ongoing evolution of research, data collection, analysis, and validation, in turn improving quality and therefore credibility, utility, and further application by clinicians.

Observational studies: a valuable source for data on the true value of RA therapies.

PubMed

van Vollenhoven, Ronald F; Severens, Johan L

2011-03-01

The validity of observational studies is sometimes questioned because of the limitations of non-randomly assigned controls, various biases such as channeling bias, confounding by indication, and other pitfalls. Yet, (post-marketing) observational data can provide important information regarding not only drug safety but also the effectiveness and appropriate use of agents in the real world, outside of clinical trials. Observational studies also provide data regarding the wider value of these agents in terms of, for example, reducing the need for surgical procedures, reducing absenteeism and increasing productivity. Importantly, data from some observational registry studies have subsequently been confirmed by clinical trials, supporting the overall validity of the registry-based approach. Observational studies also allow measures such as health assessment questionnaire scores, disease activity scores, and glucocorticoid use over time to be monitored for longer periods. Furthermore, observational data in real, less strictly selected patients without the constraints of formal study populations may produce findings not observed in clinical trials but that warrant further investigation in a controlled trial environment. For example, recent data from the Stockholm tumor necrosis factor follow-up registry in Sweden showed increases in the time people worked after initiation of biologics that, surprisingly, continued into the fourth and fifth years of treatment--a finding not observed with standardized outcomes. Observational studies are truly an underappreciated and valuable source of data on the real value of anti-rheumatic therapies, and these data are essential for making sound decisions regarding coverage and reimbursement.

Risk perception and information processing: the development and validation of a questionnaire to assess self-reported information processing.

PubMed

Smerecnik, Chris M R; Mesters, Ilse; Candel, Math J J M; De Vries, Hein; De Vries, Nanne K

2012-01-01

The role of information processing in understanding people's responses to risk information has recently received substantial attention. One limitation of this research concerns the unavailability of a validated questionnaire of information processing. This article presents two studies in which we describe the development and validation of the Information-Processing Questionnaire to meet that need. Study 1 describes the development and initial validation of the questionnaire. Participants were randomized to either a systematic processing or a heuristic processing condition after which they completed a manipulation check and the initial 15-item questionnaire and again two weeks later. The questionnaire was subjected to factor reliability and validity analyses on both measurement times for purposes of cross-validation of the results. A two-factor solution was observed representing a systematic processing and a heuristic processing subscale. The resulting scale showed good reliability and validity, with the systematic condition scoring significantly higher on the systematic subscale and the heuristic processing condition significantly higher on the heuristic subscale. Study 2 sought to further validate the questionnaire in a field study. Results of the second study corresponded with those of Study 1 and provided further evidence of the validity of the Information-Processing Questionnaire. The availability of this information-processing scale will be a valuable asset for future research and may provide researchers with new research opportunities. © 2011 Society for Risk Analysis.

Research Vessel Meteorological and Oceanographic Systems Support Satellite and Model Validation Studies

NASA Astrophysics Data System (ADS)

Smith, S. R.; Lopez, N.; Bourassa, M. A.; Rolph, J.; Briggs, K.

2012-12-01

The research vessel data center at the Florida State University routinely acquires, quality controls, and distributes underway surface meteorological and oceanographic observations from vessels. The activities of the center are coordinated by the Shipboard Automated Meteorological and Oceanographic System (SAMOS) initiative in partnership with the Rolling Deck to Repository (R2R) project. The data center evaluates the quality of the observations, collects essential metadata, provides data quality feedback to vessel operators, and ensures the long-term data preservation at the National Oceanographic Data Center. A description of the SAMOS data stewardship protocols will be provided, including dynamic web tools that ensure users can select the highest quality observations from over 30 vessels presently recruited to the SAMOS initiative. Research vessels provide underway observations at high-temporal frequency (1 min. sampling interval) that include navigational (position, course, heading, and speed), meteorological (air temperature, humidity, wind, surface pressure, radiation, rainfall), and oceanographic (surface sea temperature and salinity) samples. Recruited vessels collect a high concentration of data within the U.S. continental shelf and also frequently operate well outside routine shipping lanes, capturing observations in extreme ocean environments (Southern Ocean, Arctic, South Atlantic and Pacific). The unique quality and sampling locations of research vessel observations and there independence from many models and products (RV data are rarely distributed via normal marine weather reports) makes them ideal for validation studies. We will present comparisons between research vessel observations and model estimates of the sea surface temperature and salinity in the Gulf of Mexico. The analysis reveals an underestimation of the freshwater input to the Gulf from rivers, resulting in an overestimation of near coastal salinity in the model. Additional comparisons between surface atmospheric products derived from satellite observations and the underway research vessel observations will be shown. The strengths and limitations of research observations for validation studies will be highlighted through these case studies.

TOLNet - A Tropospheric Ozone Lidar Profiling Network for Satellite Continuity and Process Studies

NASA Technical Reports Server (NTRS)

Newchurch, Michael J.; Kuang, Shi; Wang, Lihua; LeBlanc, Thierry; Alvarez II, Raul J.; Langford, Andrew O.; Senff, Christoph J.; Brown, Steve; Johnson, Bryan; Burris, John F.;

Cooperate to Validate: OBSERVAL-NET Experts' Report on Validation of Non-Formal and Informal Learning (VNIL) 2013

ERIC Educational Resources Information Center

Weber Guisan, Saskia; Voit, Janine; Lengauer, Sonja; Proinger, Eva; Duvekot, Ruud; Aagaard, Kirsten

2014-01-01

The present publication is one of the outcomes of the OBSERVAL-NET project (follow-up of the OBSERVAL project). The main aim of OBSERVAL-NET was to set up a stakeholder-centric network of organisations supporting the validation of non-formal and informal learning in Europe based on the formation of national working groups in the 8 participating…

Cooperate to Validate. Observal-Net Experts' Report on Validation of Non-Formal and Informal Learning (VNIL) 2013

ERIC Educational Resources Information Center

Weber Guisan, Saskia; Voit, Janine; Lengauer, Sonja; Proinger, Eva; Duvekot, Ruud; Aagaard, Kirsten

2014-01-01

The present publication is one of the outcomes of the OBSERVAL-NET project (followup of the OBSERVAL project). The main aim of OBSERVAL-NET was to set up a stakeholder centric network of organisations supporting the validation of non-formal and informal learning in Europe based on the formation of national working groups in the 8 participating…

Validation sampling can reduce bias in health care database studies: an illustration using influenza vaccination effectiveness.

PubMed

Nelson, Jennifer Clark; Marsh, Tracey; Lumley, Thomas; Larson, Eric B; Jackson, Lisa A; Jackson, Michael L

2013-08-01

Estimates of treatment effectiveness in epidemiologic studies using large observational health care databases may be biased owing to inaccurate or incomplete information on important confounders. Study methods that collect and incorporate more comprehensive confounder data on a validation cohort may reduce confounding bias. We applied two such methods, namely imputation and reweighting, to Group Health administrative data (full sample) supplemented by more detailed confounder data from the Adult Changes in Thought study (validation sample). We used influenza vaccination effectiveness (with an unexposed comparator group) as an example and evaluated each method's ability to reduce bias using the control time period before influenza circulation. Both methods reduced, but did not completely eliminate, the bias compared with traditional effectiveness estimates that do not use the validation sample confounders. Although these results support the use of validation sampling methods to improve the accuracy of comparative effectiveness findings from health care database studies, they also illustrate that the success of such methods depends on many factors, including the ability to measure important confounders in a representative and large enough validation sample, the comparability of the full sample and validation sample, and the accuracy with which the data can be imputed or reweighted using the additional validation sample information. Copyright © 2013 Elsevier Inc. All rights reserved.

Validation of Ocean Color Remote Sensing Reflectance Using Autonomous Floats

NASA Technical Reports Server (NTRS)

Gerbi, Gregory P.; Boss, Emanuel; Werdell, P. Jeremy; Proctor, Christopher W.; Haentjens, Nils; Lewis, Marlon R.; Brown, Keith; Sorrentino, Diego; Zaneveld, J. Ronald V.; Barnard, Andrew H.;

Validation of an image-based technique to assess the perceptual quality of clinical chest radiographs with an observer study

NASA Astrophysics Data System (ADS)

Lin, Yuan; Choudhury, Kingshuk R.; McAdams, H. Page; Foos, David H.; Samei, Ehsan

2014-03-01

We previously proposed a novel image-based quality assessment technique1 to assess the perceptual quality of clinical chest radiographs. In this paper, an observer study was designed and conducted to systematically validate this technique. Ten metrics were involved in the observer study, i.e., lung grey level, lung detail, lung noise, riblung contrast, rib sharpness, mediastinum detail, mediastinum noise, mediastinum alignment, subdiaphragm-lung contrast, and subdiaphragm area. For each metric, three tasks were successively presented to the observers. In each task, six ROI images were randomly presented in a row and observers were asked to rank the images only based on a designated quality and disregard the other qualities. A range slider on the top of the images was used for observers to indicate the acceptable range based on the corresponding perceptual attribute. Five boardcertificated radiologists from Duke participated in this observer study on a DICOM calibrated diagnostic display workstation and under low ambient lighting conditions. The observer data were analyzed in terms of the correlations between the observer ranking orders and the algorithmic ranking orders. Based on the collected acceptable ranges, quality consistency ranges were statistically derived. The observer study showed that, for each metric, the averaged ranking orders of the participated observers were strongly correlated with the algorithmic orders. For the lung grey level, the observer ranking orders completely accorded with the algorithmic ranking orders. The quality consistency ranges derived from this observer study were close to these derived from our previous study. The observer study indicates that the proposed image-based quality assessment technique provides a robust reflection of the perceptual image quality of the clinical chest radiographs. The derived quality consistency ranges can be used to automatically predict the acceptability of a clinical chest radiograph.

Validation plays the role of a "bridge" in connecting remote sensing research and applications

NASA Astrophysics Data System (ADS)

Wang, Zhiqiang; Deng, Ying; Fan, Yida

2018-07-01

Remote sensing products contribute to improving earth observations over space and time. Uncertainties exist in products of different levels; thus, validation of these products before and during their applications is critical. This study discusses the meaning of validation in depth and proposes a new definition of reliability for use with such products. In this context, validation should include three aspects: a description of the relevant uncertainties, quantitative measurement results and a qualitative judgment that considers the needs of users. A literature overview is then presented evidencing improvements in the concepts associated with validation. It shows that the root mean squared error (RMSE) is widely used to express accuracy; increasing numbers of remote sensing products have been validated; research institutes contribute most validation efforts; and sufficient validation studies encourage the application of remote sensing products. Validation plays a connecting role in the distribution and application of remote sensing products. Validation connects simple remote sensing subjects with other disciplines, and it connects primary research with practical applications. Based on the above findings, it is suggested that validation efforts that include wider cooperation among research institutes and full consideration of the needs of users should be promoted.

Validity of a figure rating scale assessing body size perception in school-age children.

PubMed

Lombardo, Caterina; Battagliese, Gemma; Pezzuti, Lina; Lucidi, Fabio

2014-01-01

This study aimed to provide data concerning the validity of a short sequence of face valid pictorial stimuli assessing the perception of body size in school-age children. A sequence of gender and age-appropriate silhouettes was administered to 314 boys and girls aged 6-14 years. The self-evaluations provided by the children correlated significantly with their actual BMI corrected for age. Furthermore, the children's self-evaluations always significantly correlated with the evaluations provided by the three external observers; i.e., both parents and the interviewers. The results indicate that this sequence of pictorial stimuli, depicting realistic human forms appropriate for children, is a valid measure of children's body image. Relevant differences across age groups were also found, indicating that before the age of eight, the correlations between the children's self-evaluations and their BMI or the judgments of the three observers are lower than in the other age groups.

Cluster designs to assess the prevalence of acute malnutrition by lot quality assurance sampling: a validation study by computer simulation.

PubMed

Olives, Casey; Pagano, Marcello; Deitchler, Megan; Hedt, Bethany L; Egge, Kari; Valadez, Joseph J

2009-04-01

Traditional lot quality assurance sampling (LQAS) methods require simple random sampling to guarantee valid results. However, cluster sampling has been proposed to reduce the number of random starting points. This study uses simulations to examine the classification error of two such designs, a 67x3 (67 clusters of three observations) and a 33x6 (33 clusters of six observations) sampling scheme to assess the prevalence of global acute malnutrition (GAM). Further, we explore the use of a 67x3 sequential sampling scheme for LQAS classification of GAM prevalence. Results indicate that, for independent clusters with moderate intracluster correlation for the GAM outcome, the three sampling designs maintain approximate validity for LQAS analysis. Sequential sampling can substantially reduce the average sample size that is required for data collection. The presence of intercluster correlation can impact dramatically the classification error that is associated with LQAS analysis.

Empirical Validation of a New Category System: One Example.

ERIC Educational Resources Information Center

Rosenshine, Barak; And Others

This study found that data from previous research can be used to validate a new observational category system and that subscripting of the original ten categories of the Flanders Interaction Analysis System is useful in identifying more specific behaviors which correlate with student achievement. The new category system was the Expanded…

The Trichotillomania Scale for Children: Development and Validation

ERIC Educational Resources Information Center

Tolin, David F.; Diefenbach, Gretchen J.; Flessner, Christopher A.; Franklin, Martin E.; Keuthen, Nancy J.; Moore, Phoebe; Piacentini, John; Stein, Dan J.; Woods, Douglas W.

2008-01-01

Trichotillomania (TTM) is a chronic impulse control disorder characterized by repetitive hair-pulling resulting in alopecia. Although this condition is frequently observed in children and adolescents, research on pediatric TTM has been hampered by the absence of validated measures. The aim of the present study was to develop and test a new…

Development of a quality assessment tool for systematic reviews of observational studies (QATSO) of HIV prevalence in men having sex with men and associated risk behaviours

PubMed Central

Wong, William CW; Cheung, Catherine SK; Hart, Graham J

2008-01-01

Background Systematic reviews based on the critical appraisal of observational and analytic studies on HIV prevalence and risk factors for HIV transmission among men having sex with men are very useful for health care decisions and planning. Such appraisal is particularly difficult, however, as the quality assessment tools available for use with observational and analytic studies are poorly established. Methods We reviewed the existing quality assessment tools for systematic reviews of observational studies and developed a concise quality assessment checklist to help standardise decisions regarding the quality of studies, with careful consideration of issues such as external and internal validity. Results A pilot version of the checklist was developed based on epidemiological principles, reviews of study designs, and existing checklists for the assessment of observational studies. The Quality Assessment Tool for Systematic Reviews of Observational Studies (QATSO) Score consists of five items: External validity (1 item), reporting (2 items), bias (1 item) and confounding factors (1 item). Expert opinions were sought and it was tested on manuscripts that fulfil the inclusion criteria of a systematic review. Like all assessment scales, QATSO may oversimplify and generalise information yet it is inclusive, simple and practical to use, and allows comparability between papers. Conclusion A specific tool that allows researchers to appraise and guide study quality of observational studies is developed and can be modified for similar studies in the future. PMID:19014686

Learning about Teachers' Literacy Instruction from Classroom Observations

ERIC Educational Resources Information Center

Kelcey, Ben; Carlisle, Joanne F.

2013-01-01

The purpose of this study is to contribute to efforts to improve methods for gathering and analyzing data from classroom observations in early literacy. The methodological approach addresses current problems of reliability and validity of classroom observations by taking into account differences in teachers' uses of instructional actions (e.g.,…

Validity of parent's self-reported responses to home safety questions.

PubMed

Osborne, Jodie M; Shibl, Rania; Cameron, Cate M; Kendrick, Denise; Lyons, Ronan A; Spinks, Anneliese B; Sipe, Neil; McClure, Roderick J

2016-09-01

The aim of the study was to describe the validity of parent's self-reported responses to questions on home safety practices for children of 2-4 years. A cross-sectional validation study compared parent's self-administered responses to items in the Home Injury Prevention Survey with home observations undertaken by trained researchers. The relationship between the questionnaire and observation results was assessed using percentage agreement, sensitivity, specificity, positive predictive value, negative predictive value and intraclass correlation coefficients. Percentage agreements ranged from 44% to 100% with 40 of the total 45 items scoring higher than 70%. Sensitivities ranged from 0% to 100%, with 27 items scoring at least 70%. Specificities also ranged from 0% to 100%, with 33 items scoring at least 70%. As such, the study identified a series of self-administered home safety questions that have sensitivities, specificities and predictive values sufficiently high to allow the information to be useful in research and injury prevention practice.

Validation of the UNESP-Botucatu unidimensional composite pain scale for assessing postoperative pain in cattle.

PubMed

de Oliveira, Flávia Augusta; Luna, Stelio Pacca Loureiro; do Amaral, Jackson Barros; Rodrigues, Karoline Alves; Sant'Anna, Aline Cristina; Daolio, Milena; Brondani, Juliana Tabarelli

2014-09-06

The recognition and measurement of pain in cattle are important in determining the necessity for and efficacy of analgesic intervention. The aim of this study was to record behaviour and determine the validity and reliability of an instrument to assess acute pain in 40 cattle subjected to orchiectomy after sedation with xylazine and local anaesthesia. The animals were filmed before and after orchiectomy to record behaviour. The pain scale was based on previous studies, on a pilot study and on analysis of the camera footage. Three blinded observers and a local observer assessed the edited films obtained during the preoperative and postoperative periods, before and after rescue analgesia and 24 hours after surgery. Re-evaluation was performed one month after the first analysis. Criterion validity (agreement) and item-total correlation using Spearman's coefficient were employed to refine the scale. Based on factor analysis, a unidimensional scale was adopted. The internal consistency of the data was excellent after refinement (Cronbach's α coefficient = 0.866). There was a high correlation (p < 0.001) between the proposed scale and the visual analogue, simple descriptive and numerical rating scales. The construct validity and responsiveness were confirmed by the increase and decrease in pain scores after surgery and rescue analgesia, respectively (p < 0.001). Inter- and intra-observer reliability ranged from moderate to very good. The optimal cut-off point for rescue analgesia was > 4, and analysis of the area under the curve (AUC = 0.963) showed excellent discriminatory ability. The UNESP-Botucatu unidimensional pain scale for assessing acute postoperative pain in cattle is a valid, reliable and responsive instrument with excellent internal consistency and discriminatory ability. The cut-off point for rescue analgesia provides an additional tool for guiding analgesic therapy.

Live versus Video Observations: Comparing the Reliability and Validity of Two Methods of Assessing Classroom Quality

ERIC Educational Resources Information Center

Curby, Timothy W.; Johnson, Price; Mashburn, Andrew J.; Carlis, Lydia

2016-01-01

When conducting classroom observations, researchers are often confronted with the decision of whether to conduct observations live or by using pre-recorded video. The present study focuses on comparing and contrasting observations of live and video administrations of the Classroom Assessment Scoring System-PreK (CLASS-PreK). Associations between…

Is the presence of a validated malnutrition screening tool associated with better nutritional care in hospitalized patients?

PubMed

Eglseer, Doris; Halfens, Ruud J G; Lohrmann, Christa

2017-05-01

The aims of this study were to evaluate the association between the use of clinical guidelines and the use of validated screening tools, evaluate the nutritional screening policy in hospitals, and examine the association between the use of validated screening tools and the prevalence of malnutrition and nutritional interventions in hospitalized patients. This was a cross-sectional, multicenter study. Data were collected using a standardized questionnaire on three levels: institution (presence of a guideline for malnutrition), department (use of a validated screening tool), and patient (e.g., malnutrition prevalence). In all, 53 hospitals with 5255 patients participated. About 45% of the hospitals indicated that they have guidelines for malnutrition. Of the departments surveyed, 38.6% used validated screening tools as part of a standard procedure. The nutritional status of 74.5% of the patients was screened during admission, mostly on the basis of clinical observation and patient weight. A validated screening tool was used for 21.2% of the patients. Significant differences between wards with and without validated screening tools were found with regard to malnutrition prevalence (P = 0.002) and the following interventions: referral to a dietitian (P < 0.001), provision of energy-enriched snacks (P = 0.038), adjustment of consistency (food/drinks; P = 0.004), monitoring of the nutritional intake (P = 0.001), and adjustment of the meal ambiance (P < 0.001). Nutritional screening with validated tools in hospitalized patients remains poor. Generally, the nutritional status of patients is screened with unreliable parameters such as clinical observation and body mass index. The results of the present study suggest that the use of validated malnutrition screening tools is associated with better nutritional care and lower malnutrition prevalence rates in hospitalized patients. Copyright © 2017 Elsevier Inc. All rights reserved.

Validation of a Japanese version of the Scoliosis Research Society-22 Patient Questionnaire among idiopathic scoliosis patients in Japan.

PubMed

Hashimoto, Hideki; Sase, Takeshi; Arai, Yasuhisa; Maruyama, Toru; Isobe, Keijirou; Shouno, Yasuhiro

2007-02-15

A cross-sectional observational study to determine the response distribution, internal consistency, and construct, concurrent, and discriminative validities of The Scoliosis Research Society-22 (SRS-22) Patient Questionnaire translated into Japanese as compared with the other language versions. To validate the Japanese version of SRS22. The SRS-22 was translated into several languages but yet not into Japanese. The Japanese SRS-22 and Medical Outcomes Study Short Form 36 were simultaneously administered to 114 adolescent idiopathic scoliosis patients. Exploratory factor analysis revealed a 4-factor structure, though several items were not loaded as theoretically expected. The originally constructed Japanese SRS-22 subscales and the English version showed similar response distribution. Internal consistency was fair but lower than that of the English version. The concurrent validity of the translated version, except for the self-image subscale, was supported using Medical Outcomes Study Short Form 36 subscales as a reference. The function scale differed significantly by curve angle magnitude and treatment status. The self-image score was the highest in patients under observation when curve angle was < 40 degrees, while postsurgical patients marked the highest scores when the angle > or = 40 degrees, respectively. The Japanese SRS-22 is valid and may be useful for clinical evaluation of Japanese scoliosis patients, though the self-image subscale may need further assessment.

Developing evaluation instrument based on CIPP models on the implementation of portfolio assessment

NASA Astrophysics Data System (ADS)

Kurnia, Feni; Rosana, Dadan; Supahar

2017-08-01

This study aimed to develop an evaluation instrument constructed by CIPP model on the implementation of portfolio assessment in science learning. This study used research and development (R & D) method; adapting 4-D by the development of non-test instrument, and the evaluation instrument constructed by CIPP model. CIPP is the abbreviation of Context, Input, Process, and Product. The techniques of data collection were interviews, questionnaires, and observations. Data collection instruments were: 1) the interview guidelines for the analysis of the problems and the needs, 2) questionnaire to see level of accomplishment of portfolio assessment instrument, and 3) observation sheets for teacher and student to dig up responses to the portfolio assessment instrument. The data obtained was quantitative data obtained from several validators. The validators consist of two lecturers as the evaluation experts, two practitioners (science teachers), and three colleagues. This paper shows the results of content validity obtained from the validators and the analysis result of the data obtained by using Aikens' V formula. The results of this study shows that the evaluation instrument based on CIPP models is proper to evaluate the implementation of portfolio assessment instruments. Based on the experts' judgments, practitioners, and colleagues, the Aikens' V coefficient was between 0.86-1,00 which means that it is valid and can be used in the limited trial and operational field trial.

Construct validity of the individual work performance questionnaire.

PubMed

Koopmans, Linda; Bernaards, Claire M; Hildebrandt, Vincent H; de Vet, Henrica C W; van der Beek, Allard J

2014-03-01

To examine the construct validity of the Individual Work Performance Questionnaire (IWPQ). A total of 1424 Dutch workers from three occupational sectors (blue, pink, and white collar) participated in the study. First, IWPQ scores were correlated with related constructs (convergent validity). Second, differences between known groups were tested (discriminative validity). First, IWPQ scores correlated weakly to moderately with absolute and relative presenteeism, and work engagement. Second, significant differences in IWPQ scores were observed for workers differing in job satisfaction, and workers differing in health. Overall, the results indicate acceptable construct validity of the IWPQ. Researchers are provided with a reliable and valid instrument to measure individual work performance comprehensively and generically, among workers from different occupational sectors, with and without health problems.

Detecting ecosystem performance anomalies for land management in the upper colorado river basin using satellite observations, climate data, and ecosystem models

USGS Publications Warehouse

Gu, Yingxin; Wylie, B.K.

2010-01-01

This study identifies areas with ecosystem performance anomalies (EPA) within the Upper Colorado River Basin (UCRB) during 2005-2007 using satellite observations, climate data, and ecosystem models. The final EPA maps with 250-m spatial resolution were categorized as normal performance, underperformance, and overperformance (observed performance relative to weather-based predictions) at the 90% level of confidence. The EPA maps were validated using "percentage of bare soil" ground observations. The validation results at locations with comparable site potential showed that regions identified as persistently underperforming (overperforming) tended to have a higher (lower) percentage of bare soil, suggesting that our preliminary EPA maps are reliable and agree with ground-based observations. The 3-year (2005-2007) persistent EPA map from this study provides the first quantitative evaluation of ecosystem performance anomalies within the UCRB and will help the Bureau of Land Management (BLM) identify potentially degraded lands. Results from this study can be used as a prototype by BLM and other land managers for making optimal land management decisions. ?? 2010 by the authors.

Detecting Ecosystem Performance Anomalies for Land Management in the Upper Colorado River Basin Using Satellite Observations, Climate Data, and Ecosystem Models

USGS Publications Warehouse

Gu, Yingxin; Wylie, Bruce K.

2010-01-01

This study identifies areas with ecosystem performance anomalies (EPA) within the Upper Colorado River Basin (UCRB) during 2005–2007 using satellite observations, climate data, and ecosystem models. The final EPA maps with 250-m spatial resolution were categorized as normal performance, underperformance, and overperformance (observed performance relative to weather-based predictions) at the 90% level of confidence. The EPA maps were validated using “percentage of bare soil” ground observations. The validation results at locations with comparable site potential showed that regions identified as persistently underperforming (overperforming) tended to have a higher (lower) percentage of bare soil, suggesting that our preliminary EPA maps are reliable and agree with ground-based observations. The 3-year (2005–2007) persistent EPA map from this study provides the first quantitative evaluation of ecosystem performance anomalies within the UCRB and will help the Bureau of Land Management (BLM) identify potentially degraded lands. Results from this study can be used as a prototype by BLM and other land managers for making optimal land management decisions.

[Reconsidering evaluation criteria regarding health care research: toward an integrative framework of quantitative and qualitative criteria].

PubMed

Miyata, Hiroaki; Kai, Ichiro

2006-05-01

Debate about the relationship between quantitative and qualitative paradigms is often muddled and confused and the clutter of terms and arguments has resulted in the concepts becoming obscure and unrecognizable. It is therefore very important to reconsider evaluation criteria regarding rigor in social science. As Lincoln & Guba have already compared quantitative paradigms (validity, reliability, neutrality, generalizability) with qualitative paradigms (credibility, dependability, confirmability, transferability), we have discuss use of evaluation criteria based on pragmatic perspective. Validity/Credibility is the paradigm concerned to observational framework, while Reliability/Dependability refer to the range of stability in observations, Neutrality/Confirmability reflect influences between observers and subjects, Generalizability/Transferability have epistemological difference in the way findings are applied. Qualitative studies, however, does not always chose the qualitative paradigms. If we assume the stability to some extent, it is better to use the quantitative paradigm (reliability). Moreover as a quantitative study can not always guarantee a perfect observational framework, with stability in all phases of observations, it is useful to use qualitative paradigms to enhance the rigor in the study.

A model of scientific attitudes assessment by observation in physics learning based scientific approach: case study of dynamic fluid topic in high school

NASA Astrophysics Data System (ADS)

Yusliana Ekawati, Elvin

2017-01-01

This study aimed to produce a model of scientific attitude assessment in terms of the observations for physics learning based scientific approach (case study of dynamic fluid topic in high school). Development of instruments in this study adaptation of the Plomp model, the procedure includes the initial investigation, design, construction, testing, evaluation and revision. The test is done in Surakarta, so that the data obtained are analyzed using Aiken formula to determine the validity of the content of the instrument, Cronbach’s alpha to determine the reliability of the instrument, and construct validity using confirmatory factor analysis with LISREL 8.50 program. The results of this research were conceptual models, instruments and guidelines on scientific attitudes assessment by observation. The construct assessment instruments include components of curiosity, objectivity, suspended judgment, open-mindedness, honesty and perseverance. The construct validity of instruments has been qualified (rated load factor > 0.3). The reliability of the model is quite good with the Alpha value 0.899 (> 0.7). The test showed that the model fits the theoretical models are supported by empirical data, namely p-value 0.315 (≥ 0.05), RMSEA 0.027 (≤ 0.08)

Performance assessment instrument to assess the senior high students' psychomotor for the salt hydrolysis material

NASA Astrophysics Data System (ADS)

Nahadi, Firman, Harry; Yulina, Erlis

2016-02-01

The purposes of this study were to develop a performance assessment instrument for assessing the competence of psychomotor high school students on salt hydrolysis concepts. The design used in this study was the Research & Development which consists of three phases: development, testing and application of instruments. Subjects in this study were high school students in class XI science, which amounts to 93 students. In the development phase, seven validators validated 17 tasks instrument. In the test phase, we divided 19 students into three-part different times to conduct performance test in salt hydrolysis lab work and observed by six raters. The first, the second, and the third groups recpectively consist of five, six, and eight students. In the application phase, two raters observed the performance of 74 students in the salt hydrolysis lab work in several times. The results showed that 16 of 17 tasks of performance assessment instrument developed can be stated to be valid with CVR value of 1,00 and 0,714. While, the rest was not valid with CVR value was 0.429, below the critical value (0.622). In the test phase, reliability value of instrument obtained were 0,951 for the five-student group, 0,806 for the six-student group and 0,743 for the eight-student group. From the interviews, teachers strongly agree with the performance instrument developed. They stated that the instrument was feasible to use for maximum number of students were six in a single observation.

Validation of the Beurer BM 44 upper arm blood pressure monitor for home measurement, according to the European Society of Hypertension International Protocol 2002.

PubMed

Lüders, Stephan; Krüger, Ralf; Zemmrich, Claudia; Forstner, Klaus; Sturm, Claus-Dieter; Bramlage, Peter

2012-12-01

The present study aimed to validate the automated upper arm blood pressure (BP) measuring device BM 44 for home BP monitoring according to the 2002 Protocol of the European Society of Hypertension. The most important new feature of the new device was an integrated 'WHO indicator', which categorizes the patient's individual result within the WHO recommendations for target BP by a coloured scale. Systolic and diastolic BPs were measured sequentially in 35 adult participants (16 men, 19 women) using a standard mercury y-tubed reference sphygmomanometer (two observers) and the BM 44 device (one supervisor). Ninety-nine pairs of comparisons were obtained from 15 participants in phase 1 and a further 18 participants in phase 2 of the validation study. The BM 44 device passed phase 1 of the validation study successfully with a number of absolute differences between device and observers of 5, 10 and 15 mmHg for at least 28 out of 25, 35 out of 35 and 40 out of 40 measurements, respectively. The device also achieved the targets for phases 2.1 and 2.2, with 23 and 26 participants having had at least two of three device-observers differences within 5 mmHg for systolic and diastolic BP, respectively. The Beurer BM 44 upper arm BP monitor has passed the International Protocol requirements, and hence can be recommended for home use in adults. © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins.

Concurrent validity and reliability of the Alberta Infant Motor Scale in premature infants.

PubMed

Almeida, Kênnea Martins; Dutra, Maria Virginia Peixoto; Mello, Rosane Reis de; Reis, Ana Beatriz Rodrigues; Martins, Priscila Silveira

2008-01-01

To verify the concurrent validity and interobserver reliability of the Alberta Infant Motor Scale (AIMS) in premature infants followed-up at the outpatient clinic of Instituto Fernandes Figueira, Fundação Oswaldo Cruz (IFF/Fiocruz), in Rio de Janeiro, Brazil. A total of 88 premature infants were enrolled at the follow-up clinic at IFF/Fiocruz, between February and December of 2006. For the concurrent validity study, 46 infants were assessed at either 6 (n = 26) or 12 (n = 20) months' corrected age using the AIMS and the second edition of the Bayley Scales of Infant Development, by two different observers, and applying Pearson's correlation coefficient to analyze the results. For the reliability study, 42 infants between 0 and 18 months were assessed using the Alberta Infant Motor Scale, by two different observers and the results analyzed using the intraclass correlation coefficient. The concurrent validity study found a high level of correlation between the two scales (r = 0.95) and one that was statistically significant (p < 0.01) for the entire population of infants, with higher values at 12 months (r = 0.89) than at 6 months (r = 0.74). The interobserver reliability study found satisfactory intraclass correlation coefficients at all ages tested, varying from 0.76 to 0.99. The AIMS is a valid and reliable instrument for the evaluation of motor development in high-risk infants within the Brazilian public health system.

Validity and feasibility of the EMG direct observation tool (EMG-DOT).

PubMed

Leep Hunderfund, Andrea N; Rubin, Devon I; Laughlin, Ruple S; Sorenson, Eric J; Watson, James C; Jones, Lyell K; Juul, Dorthea; Park, Yoon Soo

2016-04-26

To develop a new workplace-based EMG direct observation tool (EMG-DOT) and gather validity evidence supporting its use for assessing electrodiagnostic skills among postgraduate medical trainees. The EMG-DOT was developed by experts using an iterative process. Validity evidence from content, response process, internal structure, relations to other variables, and consequences of testing was collected during the 2013-2014 academic year. Of 3,412 studies performed by trainees during the study period, 299 (9%) were assessed using the EMG-DOT. Of these, 203 (68%) involved a physician rater and 96 (32%) involved a technician rater. The 14-item EMG-DOT had excellent internal-consistency reliability (Cronbach α 0.94). Correlations between individual items and criterion-referenced global ratings of performance ranged from 0.36 to 0.72 (all p < 0.001). Mean total scores increased from 70% to 80% over 4 months of the EMG rotation (p < 0.001) despite a corresponding significant increase in case complexity (0.21-0.74 on a 3-point rating scale; p < 0.001). Trainees reported that the observational assessment exercise improved their knowledge or skills in 82% of encounters (188/230) and that feedback generated by the EMG-DOT improved the quality of care provided to patients in 58% (133/230). Trainees were "satisfied" or "very satisfied" with the observational assessment exercise in 96% of encounters (234/243). This study provides validity evidence supporting the use of EMG-DOT scores to assess electrodiagnostic skills of residents and fellows. The EMG-DOT can be used to inform milestone-based assessments of trainee performance in neurology, child neurology, physical medicine and rehabilitation, neuromuscular, and clinical neurophysiology training programs. © 2016 American Academy of Neurology.

Validation of the Konsung QD217A for clinical use and self-measurement according to the European Society of Hypertension International Protocol.

PubMed

Wu, Ning; Zhang, Xuezhong; Wang, Wen; Zhang, Hongye

2015-08-01

This study aimed to evaluate the accuracy of the automated oscillometric upper arm blood pressure (BP) monitor Konsung QD217A for home BP monitoring according to the European Society of Hypertension International Protocol revision 2010. Three trained observers validated the performance of these devices by comparing the measurements obtained from these devices with those taken using a standard mercury sphygmomanometer. Systolic blood pressure (SBP) and diastolic blood pressure (DBP) were sequentially measured in 33 participants using a standard mercury sphygmomanometer and the Konsung QD217A device. A total of 99 pairs of comparisons were obtained from 33 participants. The QD217A device achieved the targets in part 1 of the validation study. The number of absolute differences between the device and the observers within a range of 5, 10 and 15 mmHg was 70/99, 92/99 and 96/99, respectively, for SBP and 80/99, 94/99 and 99/99, respectively, for DBP. The device also achieved the targets in part 2 of the validation study. A total of 27 and 31 participants for SBP and DBP, respectively, showed at least two of the three device-observers differences within 5 mmHg (required≥24). The number of participants without device-observer difference within 5 mmHg was one for SBP and one for DBP (required≤3). The Konsung upper arm BP monitor QD217A has passed the International Protocol requirements and it can be recommended for clinical use and self-measurement in adults. Copyright © 2015 Wolters Kluwer Health, Inc. All rights reserved.

Simultaneous Observation of Hybrid States for Cyber-Physical Systems: A Case Study of Electric Vehicle Powertrain.

PubMed

Lv, Chen; Liu, Yahui; Hu, Xiaosong; Guo, Hongyan; Cao, Dongpu; Wang, Fei-Yue

2017-08-22

As a typical cyber-physical system (CPS), electrified vehicle becomes a hot research topic due to its high efficiency and low emissions. In order to develop advanced electric powertrains, accurate estimations of the unmeasurable hybrid states, including discrete backlash nonlinearity and continuous half-shaft torque, are of great importance. In this paper, a novel estimation algorithm for simultaneously identifying the backlash position and half-shaft torque of an electric powertrain is proposed using a hybrid system approach. System models, including the electric powertrain and vehicle dynamics models, are established considering the drivetrain backlash and flexibility, and also calibrated and validated using vehicle road testing data. Based on the developed system models, the powertrain behavior is represented using hybrid automata according to the piecewise affine property of the backlash dynamics. A hybrid-state observer, which is comprised of a discrete-state observer and a continuous-state observer, is designed for the simultaneous estimation of the backlash position and half-shaft torque. In order to guarantee the stability and reachability, the convergence property of the proposed observer is investigated. The proposed observer are validated under highly dynamical transitions of vehicle states. The validation results demonstrates the feasibility and effectiveness of the proposed hybrid-state observer.

Measuring the Process and Quality of Informed Consent for Clinical Research: Development and Testing

PubMed Central

Cohn, Elizabeth Gross; Jia, Haomiao; Smith, Winifred Chapman; Erwin, Katherine; Larson, Elaine L.

2013-01-01

Purpose/Objectives To develop and assess the reliability and validity of an observational instrument, the Process and Quality of Informed Consent (P-QIC). Design A pilot study of the psychometrics of a tool designed to measure the quality and process of the informed consent encounter in clinical research. The study used professionally filmed, simulated consent encounters designed to vary in process and quality. Setting A major urban teaching hospital in the northeastern region of the United States. Sample 63 students enrolled in health-related programs participated in psychometric testing, 16 students participated in test-retest reliability, and 5 investigator-participant dyads were observed for the actual consent encounters. Methods For reliability and validity testing, students watched and rated videotaped simulations of four consent encounters intentionally varied in process and content and rated them with the proposed instrument. Test-retest reliability was established by raters watching the videotaped simulations twice. Inter-rater reliability was demonstrated by two simultaneous but independent raters observing an actual consent encounter. Main Research Variables The essential elements of information and communication for informed consent. Findings The initial testing of the P-QIC demonstrated reliable and valid psychometric properties in both the simulated standardized consent encounters and actual consent encounters in the hospital setting. Conclusions The P-QIC is an easy-to-use observational tool that provides a quick assessment of the areas of strength and areas that need improvement in a consent encounter. It can be used in the initial trainings of new investigators or consent administrators and in ongoing programs of improvement for informed consent. Implications for Nursing The development of a validated observational instrument will allow investigators to assess the consent process more accurately and evaluate strategies designed to improve it. PMID:21708532

TURKISH VERSION QUALITY OF LIFE IN ESSENTIAL TREMOR QUESTIONNAIRE (QUEST): VALIDITY AND RELIABILITY STUDY.

PubMed

Güler, Sibel; Turan, F Nesrin

2015-09-30

Our aim was to translate the Quality of Life in Essential Tremor Questionnaire (QUEST) advanced by Troster (2005) and to analyse the validity and reliability of this questionnaire. Two hundred twelve consecutive patients with essential tremor (ET) and forty-three control subjects were included in the study. Permission for the translation and validation of the QUEST scale was obtained. The translation was performed according to the guidelines provided by the publisher. After the translation, the final version of the scale was administered to both groups to determine its reliability and validity. The QUEST Physical, Psychosocial, communication, Hobbies/leisure and Work/finance scores were 0.967, 0.968, 0.933, 0.964 and 0.925, respectively. There were good correlations between each of the QUEST scores that were indicative of good internal consistency. Additionally, we observed that all of the QUEST scores were most strongly related to the right and left arms (p=0.0001). However, we observed that all of the QUEST scores were weakly related to the voice, head and right leg (p=0.0001). These findings support the notion that the Turkish version of the Quality of Life in Essential Tremor (QUEST) questionnaire is a valid and reliable tool for the assessment of the quality of life of patients with ET.

Evaluation of the methodological quality of studies of the performance of diagnostic tests for bovine tuberculosis using QUADAS.

PubMed

Downs, Sara H; More, Simon J; Goodchild, Anthony V; Whelan, Adam O; Abernethy, Darrell A; Broughan, Jennifer M; Cameron, Angus; Cook, Alasdair J; Ricardo de la Rua-Domenech, R; Greiner, Matthias; Gunn, Jane; Nuñez-Garcia, Javier; Rhodes, Shelley; Rolfe, Simon; Sharp, Michael; Upton, Paul; Watson, Eamon; Welsh, Michael; Woolliams, John A; Clifton-Hadley, Richard S; Parry, Jessica E

2018-05-01

There has been little assessment of the methodological quality of studies measuring the performance (sensitivity and/or specificity) of diagnostic tests for animal diseases. In a systematic review, 190 studies of tests for bovine tuberculosis (bTB) in cattle (published 1934-2009) were assessed by at least one of 18 reviewers using the QUADAS (Quality Assessment of Diagnostic Accuracy Studies) checklist adapted for animal disease tests. VETQUADAS (VQ) included items measuring clarity in reporting (n = 3), internal validity (n = 9) and external validity (n = 2). A similar pattern for compliance was observed in studies of different diagnostic test types. Compliance significantly improved with year of publication for all items measuring clarity in reporting and external validity but only improved in four of the nine items measuring internal validity (p < 0.05). 107 references, of which 83 had performance data eligible for inclusion in a meta-analysis were reviewed by two reviewers. In these references, agreement between reviewers' responses was 71% for compliance, 32% for unsure and 29% for non-compliance. Mean compliance with reporting items was 2, 5.2 for internal validity and 1.5 for external validity. The index test result was described in sufficient detail in 80.1% of studies and was interpreted without knowledge of the reference standard test result in only 33.1%. Loss to follow-up was adequately explained in only 31.1% of studies. The prevalence of deficiencies observed may be due to inadequate reporting but may also reflect lack of attention to methodological issues that could bias the results of diagnostic test performance estimates. QUADAS was a useful tool for assessing and comparing the quality of studies measuring the performance of diagnostic tests but might be improved further by including explicit assessment of population sampling strategy. Crown Copyright © 2017. Published by Elsevier B.V. All rights reserved.

Developing Kindergarten Children's Mathematical Abilities and Character by Using Area Instruction Model

ERIC Educational Resources Information Center

Mardiana, Dinny; Mudrikah, Achmad; Amna, Nurjanah

2016-01-01

This study aimed to describe the application of Area Instruction Model on one of the state kindergarten in Bandung city. The study used a qualitative approach with descriptive qualitative design. Data was obtained through interviews, observation, and documentation. The validity of the analysis was guaranteed through perseverance observation and…

Observed Emotional and Behavioral Indicators of Motivation Predict School Readiness in Head Start Graduates

PubMed Central

Berhenke, Amanda; Miller, Alison L.; Brown, Eleanor; Seifer, Ronald; Dickstein, Susan

2011-01-01

Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in young children. Head Start graduates completed challenging puzzle and trivia tasks during their kindergarten year. Children's emotion expression and task engagement were assessed based on their observed facial and verbal expressions and behavioral cues. Hierarchical regression analyses revealed that observed persistence and shame predicted teacher ratings of children's academic achievement, whereas interest, anxiety, pride, shame, and persistence predicted children's social skills and learning-related behaviors. Children's emotional and behavioral responses to challenge thus appeared to be important indicators of school success. Observation of such responses may be a useful and valid alternative to self-report measures of motivation at this age. PMID:21949599

Observed Emotional and Behavioral Indicators of Motivation Predict School Readiness in Head Start Graduates.

PubMed

Berhenke, Amanda; Miller, Alison L; Brown, Eleanor; Seifer, Ronald; Dickstein, Susan

2011-01-01

Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in young children. Head Start graduates completed challenging puzzle and trivia tasks during their kindergarten year. Children's emotion expression and task engagement were assessed based on their observed facial and verbal expressions and behavioral cues. Hierarchical regression analyses revealed that observed persistence and shame predicted teacher ratings of children's academic achievement, whereas interest, anxiety, pride, shame, and persistence predicted children's social skills and learning-related behaviors. Children's emotional and behavioral responses to challenge thus appeared to be important indicators of school success. Observation of such responses may be a useful and valid alternative to self-report measures of motivation at this age.

A new framework of statistical inferences based on the valid joint sampling distribution of the observed counts in an incomplete contingency table.

PubMed

Tian, Guo-Liang; Li, Hui-Qiong

2017-08-01

Some existing confidence interval methods and hypothesis testing methods in the analysis of a contingency table with incomplete observations in both margins entirely depend on an underlying assumption that the sampling distribution of the observed counts is a product of independent multinomial/binomial distributions for complete and incomplete counts. However, it can be shown that this independency assumption is incorrect and can result in unreliable conclusions because of the under-estimation of the uncertainty. Therefore, the first objective of this paper is to derive the valid joint sampling distribution of the observed counts in a contingency table with incomplete observations in both margins. The second objective is to provide a new framework for analyzing incomplete contingency tables based on the derived joint sampling distribution of the observed counts by developing a Fisher scoring algorithm to calculate maximum likelihood estimates of parameters of interest, the bootstrap confidence interval methods, and the bootstrap testing hypothesis methods. We compare the differences between the valid sampling distribution and the sampling distribution under the independency assumption. Simulation studies showed that average/expected confidence-interval widths of parameters based on the sampling distribution under the independency assumption are shorter than those based on the new sampling distribution, yielding unrealistic results. A real data set is analyzed to illustrate the application of the new sampling distribution for incomplete contingency tables and the analysis results again confirm the conclusions obtained from the simulation studies.

Tutorial in Biostatistics: Instrumental Variable Methods for Causal Inference*

PubMed Central

Baiocchi, Michael; Cheng, Jing; Small, Dylan S.

2014-01-01

A goal of many health studies is to determine the causal effect of a treatment or intervention on health outcomes. Often, it is not ethically or practically possible to conduct a perfectly randomized experiment and instead an observational study must be used. A major challenge to the validity of observational studies is the possibility of unmeasured confounding (i.e., unmeasured ways in which the treatment and control groups differ before treatment administration which also affect the outcome). Instrumental variables analysis is a method for controlling for unmeasured confounding. This type of analysis requires the measurement of a valid instrumental variable, which is a variable that (i) is independent of the unmeasured confounding; (ii) affects the treatment; and (iii) affects the outcome only indirectly through its effect on the treatment. This tutorial discusses the types of causal effects that can be estimated by instrumental variables analysis; the assumptions needed for instrumental variables analysis to provide valid estimates of causal effects and sensitivity analysis for those assumptions; methods of estimation of causal effects using instrumental variables; and sources of instrumental variables in health studies. PMID:24599889

Reliability and criterion validity of an observation protocol for working technique assessments in cash register work.

PubMed

Palm, Peter; Josephson, Malin; Mathiassen, Svend Erik; Kjellberg, Katarina

2016-06-01

We evaluated the intra- and inter-observer reliability and criterion validity of an observation protocol, developed in an iterative process involving practicing ergonomists, for assessment of working technique during cash register work for the purpose of preventing upper extremity symptoms. Two ergonomists independently assessed 17 15-min videos of cash register work on two occasions each, as a basis for examining reliability. Criterion validity was assessed by comparing these assessments with meticulous video-based analyses by researchers. Intra-observer reliability was acceptable (i.e. proportional agreement >0.7 and kappa >0.4) for 10/10 questions. Inter-observer reliability was acceptable for only 3/10 questions. An acceptable inter-observer reliability combined with an acceptable criterion validity was obtained only for one working technique aspect, 'Quality of movements'. Thus, major elements of the cashiers' working technique could not be assessed with an acceptable accuracy from short periods of observations by one observer, such as often desired by practitioners. Practitioner Summary: We examined an observation protocol for assessing working technique in cash register work. It was feasible in use, but inter-observer reliability and criterion validity were generally not acceptable when working technique aspects were assessed from short periods of work. We recommend the protocol to be used for educational purposes only.

Convergent Validity of and Bias in Maternal Reports of Child Emotion

ERIC Educational Resources Information Center

Durbin, C. Emily; Wilson, Sylia

2012-01-01

This study examined the convergent validity of maternal reports of child emotion in a sample of 190 children between the ages of 3 and 6. Children completed a battery of 10 emotion-eliciting laboratory tasks; their mothers and untrained naive observers rated child emotions (happiness, surprise, fear, sadness, and anger) following each task, and…

Field-scale moisture estimates using COSMOS sensors: a validation study with temporary networks and leaf-area-indices

USDA-ARS?s Scientific Manuscript database

The Cosmic-ray Soil Moisture Observing System (COSMOS) is a new and innovative method for estimating surface and near surface soil moisture at large (~700 m) scales. This system accounts for liquid water within its measurement volume. Many of the sites used in the early validation of the system had...

Measuring Students' Physical Activity Levels: Validating SOFIT for Use with High-School Students

ERIC Educational Resources Information Center

van der Mars, Hans; Rowe, Paul J.; Schuldheisz, Joel M.; Fox, Susan

2004-01-01

This study was conducted to validate the System for Observing Fitness Instruction Time (SOFIT) for measuring physical activity levels of high-school students. Thirty-five students (21 girls and 14 boys from grades 9-12) completed a standardized protocol including lying, sitting, standing, walking, running, curl-ups, and push-ups. Heart rates and…

Designing and Piloting a Leadership Daily Practice Log: Using Logs to Study the Practice of Leadership

ERIC Educational Resources Information Center

Spillane, James P.; Zuberi, Anita

2009-01-01

Purpose: This article aims to validate the Leadership Daily Practice (LDP) log, an instrument for conducting research on leadership in schools. Research Design: Using a combination of data sources--namely, a daily practice log, observations, and open-ended cognitive interviews--the authors evaluate the validity of the LDP log. Participants: Formal…

Assessing Parenting Behaviors in Euro-Canadian and East Asian Immigrant Mothers: Limitations to Observations of Responsiveness

ERIC Educational Resources Information Center

Chan, Kathy; Penner, Kailee; Mah, Janet W. T.; Johnston, Charlotte

2010-01-01

The use of parenting measures that are developed for use with Western families without testing their validity among families from non-Western cultural backgrounds may not be appropriate. Similar parenting behaviors may affect child outcomes in different ways across different cultures. This study examined the cross-cultural validity of an…

External validation of preexisting first trimester preeclampsia prediction models.

PubMed

Allen, Rebecca E; Zamora, Javier; Arroyo-Manzano, David; Velauthar, Luxmilar; Allotey, John; Thangaratinam, Shakila; Aquilina, Joseph

2017-10-01

To validate the increasing number of prognostic models being developed for preeclampsia using our own prospective study. A systematic review of literature that assessed biomarkers, uterine artery Doppler and maternal characteristics in the first trimester for the prediction of preeclampsia was performed and models selected based on predefined criteria. Validation was performed by applying the regression coefficients that were published in the different derivation studies to our cohort. We assessed the models discrimination ability and calibration. Twenty models were identified for validation. The discrimination ability observed in derivation studies (Area Under the Curves) ranged from 0.70 to 0.96 when these models were validated against the validation cohort, these AUC varied importantly, ranging from 0.504 to 0.833. Comparing Area Under the Curves obtained in the derivation study to those in the validation cohort we found statistically significant differences in several studies. There currently isn't a definitive prediction model with adequate ability to discriminate for preeclampsia, which performs as well when applied to a different population and can differentiate well between the highest and lowest risk groups within the tested population. The pre-existing large number of models limits the value of further model development and future research should be focussed on further attempts to validate existing models and assessing whether implementation of these improves patient care. Crown Copyright © 2017. Published by Elsevier B.V. All rights reserved.

Risk prediction models of breast cancer: a systematic review of model performances.

PubMed

Anothaisintawee, Thunyarat; Teerawattananon, Yot; Wiratkapun, Chollathip; Kasamesup, Vijj; Thakkinstian, Ammarin

2012-05-01

The number of risk prediction models has been increasingly developed, for estimating about breast cancer in individual women. However, those model performances are questionable. We therefore have conducted a study with the aim to systematically review previous risk prediction models. The results from this review help to identify the most reliable model and indicate the strengths and weaknesses of each model for guiding future model development. We searched MEDLINE (PubMed) from 1949 and EMBASE (Ovid) from 1974 until October 2010. Observational studies which constructed models using regression methods were selected. Information about model development and performance were extracted. Twenty-five out of 453 studies were eligible. Of these, 18 developed prediction models and 7 validated existing prediction models. Up to 13 variables were included in the models and sample sizes for each study ranged from 550 to 2,404,636. Internal validation was performed in four models, while five models had external validation. Gail and Rosner and Colditz models were the significant models which were subsequently modified by other scholars. Calibration performance of most models was fair to good (expected/observe ratio: 0.87-1.12), but discriminatory accuracy was poor to fair both in internal validation (concordance statistics: 0.53-0.66) and in external validation (concordance statistics: 0.56-0.63). Most models yielded relatively poor discrimination in both internal and external validation. This poor discriminatory accuracy of existing models might be because of a lack of knowledge about risk factors, heterogeneous subtypes of breast cancer, and different distributions of risk factors across populations. In addition the concordance statistic itself is insensitive to measure the improvement of discrimination. Therefore, the new method such as net reclassification index should be considered to evaluate the improvement of the performance of a new develop model.

Observational Assessment of Preschool Disruptive Behavior, Part II: validity of the Disruptive Behavior Diagnostic Observation Schedule (DB-DOS).

PubMed

Wakschlag, Lauren S; Briggs-Gowan, Margaret J; Hill, Carri; Danis, Barbara; Leventhal, Bennett L; Keenan, Kate; Egger, Helen L; Cicchetti, Domenic; Burns, James; Carter, Alice S

2008-06-01

To examine the validity of the Disruptive Behavior Diagnostic Observation Schedule (DB-DOS), a new observational method for assessing preschool disruptive behavior. A total of 327 behaviorally heterogeneous preschoolers from low-income environments comprised the validation sample. Parent and teacher reports were used to identify children with clinically significant disruptive behavior. The DB-DOS assessed observed disruptive behavior in two domains, problems in Behavioral Regulation and Anger Modulation, across three interactional contexts: Examiner Engaged, Examiner Busy, and Parent. Convergent and divergent validity of the DB-DOS were tested in relation to parent and teacher reports and independently observed behavior. Clinical validity was tested in terms of criterion and incremental validity of the DB-DOS for discriminating disruptive behavior status and impairment, concurrently and longitudinally. DB-DOS scores were significantly associated with reported and independently observed behavior in a theoretically meaningful fashion. Scores from both DB-DOS domains and each of the three DB-DOS contexts contributed uniquely to discrimination of disruptive behavior status, concurrently and predictively. Observed behavior on the DB-DOS also contributed incrementally to prediction of impairment over time, beyond variance explained by meeting DSM-IV disruptive behavior disorder symptom criteria based on parent/teacher report. The multidomain, multicontext approach of the DB-DOS is a valid method for direct assessment of preschool disruptive behavior. This approach shows promise for enhancing accurate identification of clinically significant disruptive behavior in young children and for characterizing subtypes in a manner that can directly inform etiological and intervention research.

Validation of the iHealth BP5 wireless upper arm blood pressure monitor for self-measurement according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Shang, Fujun; Zhu, Yizheng; Zhu, Zhenlai; Liu, Lei; Wan, Yi

2013-10-01

The aim of this study was to validate the iHealth BP5 wireless upper arm blood pressure (BP) monitor according to the European Society of Hypertension International Protocol (ESH-IP) revision 2010. The ESH-IP revision 2010 for validation of BP measuring devices in adults was followed precisely. A total of 99 pairs of test device and reference BP measurements (three pairs for each of the 33 participants) were obtained in the study. The device produced 71, 89, and 97 measurements within 5, 10, and 15 mmHg for systolic blood pressure (SBP) and 73, 90, and 99 mmHg for diastolic blood pressure (DBP), respectively. The mean ± SD device-observer difference was -1.21 ± 5.87 mmHg for SBP and -1.04 ± 5.28 mmHg for DBP. The number of participants with two or three device-observer differences within 5 mmHg was 25 for SBP and 28 for DBP. In addition, three participants had no device-observer difference within 5 mmHg for SBP and none of the participants had the same for DBP. According to the validation results on the basis of the ESH-IP revision 2010, the iHealth BP5 wireless upper arm BP monitor can be recommended for self/home measurement in an adult population.

Calibration power of the Braden scale in predicting pressure ulcer development.

PubMed

Chen, Hong-Lin; Cao, Ying-Juan; Wang, Jing; Huai, Bao-Sha

2016-11-02

Calibration is the degree of correspondence between the estimated probability produced by a model and the actual observed probability. The aim of this study was to investigate the calibration power of the Braden scale in predicting pressure ulcer development (PU). A retrospective analysis was performed among consecutive patients in 2013. The patients were separated into training a group and a validation group. The predicted incidence was calculated using a logistic regression model in the training group and the Hosmer-Lemeshow test was used for assessing the goodness of fit. In the validation cohort, the observed and the predicted incidence were compared by the Chi-square (χ 2 ) goodness of fit test for calibration power. We included 2585 patients in the study, of these 78 patients (3.0%) developed a PU. Between the training and validation groups the patient characteristics were non-significant (p>0.05). In the training group, the logistic regression model for predicting pressure ulcer was Logit(P) = -0.433*Braden score+2.616. The Hosmer-Lemeshow test showed no goodness fit (χ 2 =13.472; p=0.019). In the validation group, the predicted pressure ulcer incidence also did not fit well with the observed incidence (χ 2 =42.154, p=0.000 by Braden scores; and χ 2 =17.223, p=0.001 by Braden scale risk classification). The Braden scale has low calibration power in predicting PU formation.

Refinement and partial validation of the UNESP-Botucatu multidimensional composite pain scale for assessing postoperative pain in horses.

PubMed

Taffarel, Marilda Onghero; Luna, Stelio Pacca Loureiro; de Oliveira, Flavia Augusta; Cardoso, Guilherme Schiess; Alonso, Juliana de Moura; Pantoja, Jose Carlos; Brondani, Juliana Tabarelli; Love, Emma; Taylor, Polly; White, Kate; Murrell, Joanna C

2015-04-01

Quantification of pain plays a vital role in the diagnosis and management of pain in animals. In order to refine and validate an acute pain scale for horses a prospective, randomized, blinded study was conducted. Twenty-four client owned adult horses were recruited and allocated to one of four following groups: anaesthesia only (GA); pre-emptive analgesia and anaesthesia (GAA,); anaesthesia, castration and postoperative analgesia (GC); or pre-emptive analgesia, anaesthesia and castration (GCA). One investigator, unaware of the treatment group, assessed all horses at time-points before and after intervention and completed the pain scale. Videos were also obtained at these time-points and were evaluated by a further four blinded evaluators who also completed the scale. The data were used to investigate the relevance, specificity, criterion validity and inter- and intra-observer reliability of each item on the pain scale, and to evaluate construct validity and responsiveness of the scale. Construct validity was demonstrated by the observed differences in scores between the groups, four hours after anaesthetic recovery and before administration of systemic analgesia in the GC group. Inter- and intra-observer reliability for the items was only satisfactory. Subsequently the pain scale was refined, based on results for relevance, specificity and total item correlation. Scale refinement and exclusion of items that did not meet predefined requirements generated a selection of relevant pain behaviours in horses. After further validation for reliability, these may be used to evaluate pain under clinical and experimental conditions.

Observed Emotional and Behavioral Indicators of Motivation Predict School Readiness in Head Start Graduates

ERIC Educational Resources Information Center

Berhenke, Amanda; Miller, Alison L.; Brown, Eleanor; Seifer, Ronald; Dickstein, Susan

2011-01-01

Emotions and behaviors observed during challenging tasks are hypothesized to be valuable indicators of young children's motivation, the assessment of which may be particularly important for children at risk for school failure. The current study demonstrated reliability and concurrent validity of a new observational assessment of motivation in…

Florida's EETT Leveraging Laptops Initiative and Its Impact on Teaching Practices

ERIC Educational Resources Information Center

Dawson, Kara; Cavanaugh, Cathy; Ritzhaupt, Albert D.

2008-01-01

This study measures changes in teaching practices that occurred during a school year that included laptop implementation and professional development. The changes were documented through direct observations of more than 400 classrooms in more than 50 K-12 schools in 11 Florida districts. Trained observers used two valid observation instruments to…

Validating the Early Childhood Classroom Observation Measure in First and Third Grade Classrooms

ERIC Educational Resources Information Center

Tang, Xin; Pakarinen, Eija; Lerkkanen, Marja-Kristiina; Kikas, Eve; Muotka, Joona; Nurmi, Jari-Erik

2017-01-01

The present study reports on the psychometric properties of the Early Childhood Classroom Observation Measure (ECCOM) in Finnish and Estonian first and third grade classrooms. The observation data were collected from 91 first grade teachers and 70 third grade teachers. Teachers' curriculum goals, teaching experience and the classroom size were…

Is the Scale for Measuring Motivational Interviewing Skills a valid and reliable instrument for measuring the primary care professionals motivational skills?: EVEM study protocol.

PubMed

Pérula, Luis Á; Campiñez, Manuel; Bosch, Josep M; Barragán Brun, Nieves; Arboniés, Juan C; Bóveda Fontán, Julia; Martín Alvarez, Remedios; Prados, Jose A; Martín-Rioboó, Enrique; Massons, Josep; Criado, Margarita; Fernández, José Á; Parras, Juan M; Ruiz-Moral, Roger; Novo, Jesús M

2012-11-22

Lifestyle is one of the main determinants of people's health. It is essential to find the most effective prevention strategies to be used to encourage behavioral changes in their patients. Many theories are available that explain change or adherence to specific health behaviors in subjects. In this sense the named Motivational Interviewing has increasingly gained relevance. Few well-validated instruments are available for measuring doctors' communication skills, and more specifically the Motivational Interviewing. The hypothesis of this study is that the Scale for Measuring Motivational Interviewing Skills (EVEM questionnaire) is a valid and reliable instrument for measuring the primary care professionals skills to get behavior change in patients. To test the hypothesis we have designed a prospective, observational, multi-center study to validate a measuring instrument. - Thirty-two primary care centers in Spain. -Sampling and Size: a) face and consensual validity: A group composed of 15 experts in Motivational Interviewing. b) Assessment of the psychometric properties of the scale; 50 physician- patient encounters will be videoed; a total of 162 interviews will be conducted with six standardized patients, and another 200 interviews will be conducted with 50 real patients (n=362). Four physicians will be specially trained to assess 30 interviews randomly selected to test the scale reproducibility. -Measurements for to test the hypothesis: a) Face validity: development of a draft questionnaire based on a theoretical model, by using Delphi-type methodology with experts. b) Scale psychometric properties: intraobservers will evaluate video recorded interviews: content-scalability validity (Exploratory Factor Analysis), internal consistency (Cronbach alpha), intra-/inter-observer reliability (Kappa index, intraclass correlation coefficient, Bland & Altman methodology), generalizability, construct validity and sensitivity to change (Pearson product-moment correlation coefficient). The verification of the hypothesis that EVEM is a valid and reliable tool for assessing motivational interviewing would be a major breakthrough in the current theoretical and practical knowledge, as it could be used to assess if the providers put into practice a patient centered communication style and can be used both for training or researching purposes. TRIALS REGISTRATION Dislip-EM study: NCT01282190 (ClinicalTrials.gov).

Assessing fidelity in individual and family therapy for adolescent substance abuse.

PubMed

Hogue, Aaron; Dauber, Sarah; Chinchilla, Priscilla; Fried, Adam; Henderson, Craig; Inclan, Jaime; Reiner, Robert H; Liddle, Howard A

2008-09-01

This study introduces an observational measure of fidelity in evidence-based practices for adolescent substance abuse treatment. The Therapist Behavior Rating Scale-Competence (TBRS-C) measures adherence and competence in individual cognitive-behavioral therapy and multidimensional family therapy for adolescent substance abuse. The TBRS-C assesses fidelity to the core therapeutic goals of each approach and also contains global ratings of therapist competence. Study participants were 136 clinically referred adolescents and their families observed in 437 treatment sessions. The TBRS-C demonstrated strong interrater reliability for goal-specific ratings of treatment adherence, and modest reliability for goal-specific and global ratings of therapist competence, evidence of construct validity, and discriminant validity with an observational measure of therapeutic alliance. The utility of the TBRS-C for evaluating treatment fidelity in field settings is discussed.

From sensor data to animal behaviour: an oystercatcher example.

PubMed

Shamoun-Baranes, Judy; Bom, Roeland; van Loon, E Emiel; Ens, Bruno J; Oosterbeek, Kees; Bouten, Willem

2012-01-01

Animal-borne sensors enable researchers to remotely track animals, their physiological state and body movements. Accelerometers, for example, have been used in several studies to measure body movement, posture, and energy expenditure, although predominantly in marine animals. In many studies, behaviour is often inferred from expert interpretation of sensor data and not validated with direct observations of the animal. The aim of this study was to derive models that could be used to classify oystercatcher (Haematopus ostralegus) behaviour based on sensor data. We measured the location, speed, and tri-axial acceleration of three oystercatchers using a flexible GPS tracking system and conducted simultaneous visual observations of the behaviour of these birds in their natural environment. We then used these data to develop three supervised classification trees of behaviour and finally applied one of the models to calculate time-activity budgets. The model based on accelerometer data developed to classify three behaviours (fly, terrestrial locomotion, and no movement) was much more accurate (cross-validation error = 0.14) than the model based on GPS-speed alone (cross-validation error = 0.35). The most parsimonious acceleration model designed to classify eight behaviours could distinguish five: fly, forage, body care, stand, and sit (cross-validation error = 0.28); other behaviours that were observed, such as aggression or handling of prey, could not be distinguished. Model limitations and potential improvements are discussed. The workflow design presented in this study can facilitate model development, be adapted to a wide range of species, and together with the appropriate measurements, can foster the study of behaviour and habitat use of free living animals throughout their annual routine.

Satellite Based Soil Moisture Product Validation Using NOAA-CREST Ground and L-Band Observations

NASA Astrophysics Data System (ADS)

Norouzi, H.; Campo, C.; Temimi, M.; Lakhankar, T.; Khanbilvardi, R.

2015-12-01

Soil moisture content is among most important physical parameters in hydrology, climate, and environmental studies. Many microwave-based satellite observations have been utilized to estimate this parameter. The Advanced Microwave Scanning Radiometer 2 (AMSR2) is one of many remotely sensors that collects daily information of land surface soil moisture. However, many factors such as ancillary data and vegetation scattering can affect the signal and the estimation. Therefore, this information needs to be validated against some "ground-truth" observations. NOAA - Cooperative Remote Sensing and Technology (CREST) center at the City University of New York has a site located at Millbrook, NY with several insitu soil moisture probes and an L-Band radiometer similar to Soil Moisture Passive and Active (SMAP) one. This site is among SMAP Cal/Val sites. Soil moisture information was measured at seven different locations from 2012 to 2015. Hydra probes are used to measure six of these locations. This study utilizes the observations from insitu data and the L-Band radiometer close to ground (at 3 meters height) to validate and to compare soil moisture estimates from AMSR2. Analysis of the measurements and AMSR2 indicated a weak correlation with the hydra probes and a moderate correlation with Cosmic-ray Soil Moisture Observing System (COSMOS probes). Several differences including the differences between pixel size and point measurements can cause these discrepancies. Some interpolation techniques are used to expand point measurements from 6 locations to AMSR2 footprint. Finally, the effect of penetration depth in microwave signal and inconsistencies with other ancillary data such as skin temperature is investigated to provide a better understanding in the analysis. The results show that the retrieval algorithm of AMSR2 is appropriate under certain circumstances. This validation algorithm and similar study will be conducted for SMAP mission. Keywords: Remote Sensing, Soil Moisture, AMSR2, SMAP, L-Band.

Quality standards for real-world research. Focus on observational database studies of comparative effectiveness.

PubMed

Roche, Nicolas; Reddel, Helen; Martin, Richard; Brusselle, Guy; Papi, Alberto; Thomas, Mike; Postma, Dirjke; Thomas, Vicky; Rand, Cynthia; Chisholm, Alison; Price, David

2014-02-01

Real-world research can use observational or clinical trial designs, in both cases putting emphasis on high external validity, to complement the classical efficacy randomized controlled trials (RCTs) with high internal validity. Real-world research is made necessary by the variety of factors that can play an important a role in modulating effectiveness in real life but are often tightly controlled in RCTs, such as comorbidities and concomitant treatments, adherence, inhalation technique, access to care, strength of doctor-caregiver communication, and socio-economic and other organizational factors. Real-world studies belong to two main categories: pragmatic trials and observational studies, which can be prospective or retrospective. Focusing on comparative database observational studies, the process aimed at ensuring high-quality research can be divided into three parts: preparation of research, analyses and reporting, and discussion of results. Key points include a priori planning of data collection and analyses, identification of appropriate database(s), proper outcomes definition, study registration with commitment to publish, bias minimization through matching and adjustment processes accounting for potential confounders, and sensitivity analyses testing the robustness of results. When these conditions are met, observational database studies can reach a sufficient level of evidence to help create guidelines (i.e., clinical and regulatory decision-making).

Efficient strategies for leave-one-out cross validation for genomic best linear unbiased prediction.

PubMed

Cheng, Hao; Garrick, Dorian J; Fernando, Rohan L

2017-01-01

A random multiple-regression model that simultaneously fit all allele substitution effects for additive markers or haplotypes as uncorrelated random effects was proposed for Best Linear Unbiased Prediction, using whole-genome data. Leave-one-out cross validation can be used to quantify the predictive ability of a statistical model. Naive application of Leave-one-out cross validation is computationally intensive because the training and validation analyses need to be repeated n times, once for each observation. Efficient Leave-one-out cross validation strategies are presented here, requiring little more effort than a single analysis. Efficient Leave-one-out cross validation strategies is 786 times faster than the naive application for a simulated dataset with 1,000 observations and 10,000 markers and 99 times faster with 1,000 observations and 100 markers. These efficiencies relative to the naive approach using the same model will increase with increases in the number of observations. Efficient Leave-one-out cross validation strategies are presented here, requiring little more effort than a single analysis.

Using wound care algorithms: a content validation study.

PubMed

Beitz, J M; van Rijswijk, L

1999-09-01

Valid and reliable heuristic devices facilitating optimal wound care are lacking. The objectives of this study were to establish content validation data for a set of wound care algorithms, to identify their associated strengths and weaknesses, and to gain insight into the wound care decision-making process. Forty-four registered nurse wound care experts were surveyed and interviewed at national and regional educational meetings. Using a cross-sectional study design and an 83-item, 4-point Likert-type scale, this purposive sample was asked to quantify the degree of validity of the algorithms' decisions and components. Participants' comments were tape-recorded, transcribed, and themes were derived. On a scale of 1 to 4, the mean score of the entire instrument was 3.47 (SD +/- 0.87), the instrument's Content Validity Index was 0.86, and the individual Content Validity Index of 34 of 44 participants was > 0.8. Item scores were lower for those related to packing deep wounds (P < .001). No other significant differences were observed. Qualitative data analysis revealed themes of difficulty associated with wound assessment and care issues, that is, the absence of valid and reliable definitions. The wound care algorithms studied proved valid. However, the lack of valid and reliable wound assessment and care definitions hinders optimal use of these instruments. Further research documenting their clinical use is warranted. Research-based practice recommendations should direct the development of future valid and reliable algorithms designed to help nurses provide optimal wound care.

Threats to validity of nonrandomized studies of postdiagnosis exposures on cancer recurrence and survival.

PubMed

Chubak, Jessica; Boudreau, Denise M; Wirtz, Heidi S; McKnight, Barbara; Weiss, Noel S

2013-10-02

Studies of the effects of exposures after cancer diagnosis on cancer recurrence and survival can provide important information to the growing group of cancer survivors. Observational studies that address this issue generally fall into one of two categories: 1) those using health plan automated data that contain "continuous" information on exposures, such as studies that use pharmacy records; and 2) survey or interview studies that collect information directly from patients once or periodically postdiagnosis. Reverse causation, confounding, selection bias, and information bias are common in observational studies of cancer outcomes in relation to exposures after cancer diagnosis. We describe these biases, focusing on sources of bias specific to these types of studies, and we discuss approaches for reducing them. Attention to known challenges in epidemiologic research is critical for the validity of studies of postdiagnosis exposures and cancer outcomes.

Threats to Validity of Nonrandomized Studies of Postdiagnosis Exposures on Cancer Recurrence and Survival

PubMed Central

2013-01-01

Studies of the effects of exposures after cancer diagnosis on cancer recurrence and survival can provide important information to the growing group of cancer survivors. Observational studies that address this issue generally fall into one of two categories: 1) those using health plan automated data that contain “continuous” information on exposures, such as studies that use pharmacy records; and 2) survey or interview studies that collect information directly from patients once or periodically postdiagnosis. Reverse causation, confounding, selection bias, and information bias are common in observational studies of cancer outcomes in relation to exposures after cancer diagnosis. We describe these biases, focusing on sources of bias specific to these types of studies, and we discuss approaches for reducing them. Attention to known challenges in epidemiologic research is critical for the validity of studies of postdiagnosis exposures and cancer outcomes. PMID:23940288

Predictive validity of the classroom strategies scale-observer form on statewide testing scores: an initial investigation.

PubMed

Reddy, Linda A; Fabiano, Gregory A; Dudek, Christopher M; Hsu, Louis

2013-12-01

The present study examined the validity of a teacher observation measure, the Classroom Strategies Scale--Observer Form (CSS), as a predictor of student performance on statewide tests of mathematics and English language arts. The CSS is a teacher practice observational measure that assesses evidence-based instructional and behavioral management practices in elementary school. A series of two-level hierarchical generalized linear models were fitted to data of a sample of 662 third- through fifth-grade students to assess whether CSS Part 2 Instructional Strategy and Behavioral Management Strategy scale discrepancy scores (i.e., ∑ |recommended frequency--frequency ratings|) predicted statewide mathematics and English language arts proficiency scores when percentage of minority students in schools was controlled. Results indicated that the Instructional Strategy scale discrepancy scores significantly predicted mathematics and English language arts proficiency scores: Relatively larger discrepancies on observer ratings of what teachers did versus what should have been done were associated with lower proficiency scores. Results offer initial evidence of the predictive validity of the CSS Part 2 Instructional Strategy discrepancy scores on student academic outcomes. PsycINFO Database Record (c) 2013 APA, all rights reserved.

A systematic review of reliable and valid tools for the measurement of patient participation in healthcare.

PubMed

Phillips, Nicole Margaret; Street, Maryann; Haesler, Emily

2016-02-01

Patient participation in healthcare is recognised internationally as essential for consumer-centric, high-quality healthcare delivery. Its measurement as part of continuous quality improvement requires development of agreed standards and measurable indicators. This systematic review sought to identify strategies to measure patient participation in healthcare and to report their reliability and validity. In the context of this review, patient participation was constructed as shared decision-making, acknowledging the patient as having critical knowledge regarding their own health and care needs and promoting self-care/autonomy. Following a comprehensive search, studies reporting reliability or validity of an instrument used in a healthcare setting to measure patient participation, published in English between January 2004 and March 2014 were eligible for inclusion. From an initial search, which identified 1582 studies, 156 studies were retrieved and screened against inclusion criteria. Thirty-three studies reporting 24 patient participation measurement tools met inclusion criteria, and were critically appraised. The majority of studies were descriptive psychometric studies using prospective, cross-sectional designs. Almost all the tools completed by patients, family caregivers, observers or more than one stakeholder focused on aspects of patient-professional communication. Few tools designed for completion by patients or family caregivers provided valid and reliable measures of patient participation. There was low correlation between many of the tools and other measures of patient satisfaction. Few reliable and valid tools for measurement of patient participation in healthcare have been recently developed. Of those reported in this review, the dyadic Observing Patient Involvement in Decision Making (dyadic-OPTION) tool presents the most promise for measuring core components of patient participation. There remains a need for further study into valid, reliable and feasible strategies for measuring patient participation as part of continuous quality improvement. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

Isokinetic knee strength qualities as predictors of jumping performance in high-level volleyball athletes: multiple regression approach.

PubMed

Sattler, Tine; Sekulic, Damir; Spasic, Miodrag; Osmankac, Nedzad; Vicente João, Paulo; Dervisevic, Edvin; Hadzic, Vedran

2016-01-01

Previous investigations noted potential importance of isokinetic strength in rapid muscular performances, such as jumping. This study aimed to identify the influence of isokinetic-knee-strength on specific jumping performance in volleyball. The secondary aim of the study was to evaluate reliability and validity of the two volleyball-specific jumping tests. The sample comprised 67 female (21.96±3.79 years; 68.26±8.52 kg; 174.43±6.85 cm) and 99 male (23.62±5.27 years; 84.83±10.37 kg; 189.01±7.21 cm) high- volleyball players who competed in 1st and 2nd National Division. Subjects were randomly divided into validation (N.=55 and 33 for males and females, respectively) and cross-validation subsamples (N.=54 and 34 for males and females, respectively). Set of predictors included isokinetic tests, to evaluate the eccentric and concentric strength capacities of the knee extensors, and flexors for dominant and non-dominant leg. The main outcome measure for the isokinetic testing was peak torque (PT) which was later normalized for body mass and expressed as PT/Kg. Block-jump and spike-jump performances were measured over three trials, and observed as criteria. Forward stepwise multiple regressions were calculated for validation subsamples and then cross-validated. Cross validation included correlations between and t-test differences between observed and predicted scores; and Bland Altman graphics. Jumping tests were found to be reliable (spike jump: ICC of 0.79 and 0.86; block-jump: ICC of 0.86 and 0.90; for males and females, respectively), and their validity was confirmed by significant t-test differences between 1st vs. 2nd division players. Isokinetic variables were found to be significant predictors of jumping performance in females, but not among males. In females, the isokinetic-knee measures were shown to be stronger and more valid predictors of the block-jump (42% and 64% of the explained variance for validation and cross-validation subsample, respectively) than that of the spike-jump (39% and 34% of the explained variance for validation and cross-validation subsample, respectively). Differences between prediction models calculated for males and females are mostly explained by gender-specific biomechanics of jumping. Study defined importance of knee-isokinetic-strength in volleyball jumping performance in female athletes. Further studies should evaluate association between ankle-isokinetic-strength and volleyball-specific jumping performances. Results reinforce the need for the cross-validation of the prediction-models in sport and exercise sciences.

Development and validation of a tool to evaluate the quality of medical education websites in pathology.

PubMed

Alyusuf, Raja H; Prasad, Kameshwar; Abdel Satir, Ali M; Abalkhail, Ali A; Arora, Roopa K

2013-01-01

The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites.

Developing and Validating a New Classroom Climate Observation Assessment Tool

PubMed Central

Leff, Stephen S.; Thomas, Duane E.; Shapiro, Edward S.; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F.

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children’s psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression. PMID:21643447

Developing and Validating a New Classroom Climate Observation Assessment Tool.

PubMed

Leff, Stephen S; Thomas, Duane E; Shapiro, Edward S; Paskewich, Brooke; Wilson, Kim; Necowitz-Hoffman, Beth; Jawad, Abbas F

2011-01-01

The climate of school classrooms, shaped by a combination of teacher practices and peer processes, is an important determinant for children's psychosocial functioning and is a primary factor affecting bullying and victimization. Given that there are relatively few theoretically-grounded and validated assessment tools designed to measure the social climate of classrooms, our research team developed an observation tool through participatory action research (PAR). This article details how the assessment tool was designed and preliminarily validated in 18 third-, fourth-, and fifth-grade classrooms in a large urban public school district. The goals of this study are to illustrate the feasibility of a PAR paradigm in measurement development, ascertain the psychometric properties of the assessment tool, and determine associations with different indices of classroom levels of relational and physical aggression.

Global Precipitation Measurement (GPM) Ground Validation (GV) Science Implementation Plan

NASA Technical Reports Server (NTRS)

Petersen, Walter A.; Hou, Arthur Y.

2008-01-01

For pre-launch algorithm development and post-launch product evaluation Global Precipitation Measurement (GPM) Ground Validation (GV) goes beyond direct comparisons of surface rain rates between ground and satellite measurements to provide the means for improving retrieval algorithms and model applications.Three approaches to GPM GV include direct statistical validation (at the surface), precipitation physics validation (in a vertical columns), and integrated science validation (4-dimensional). These three approaches support five themes: core satellite error characterization; constellation satellites validation; development of physical models of snow, cloud water, and mixed phase; development of cloud-resolving model (CRM) and land-surface models to bridge observations and algorithms; and, development of coupled CRM-land surface modeling for basin-scale water budget studies and natural hazard prediction. This presentation describes the implementation of these approaches.

Estimating functional cognition in older adults using observational assessments of task performance in complex everyday activities: A systematic review and evaluation of measurement properties.

PubMed

Wesson, Jacqueline; Clemson, Lindy; Brodaty, Henry; Reppermund, Simone

2016-09-01

Functional cognition is a relatively new concept in assessment of older adults with mild cognitive impairment or dementia. Instruments need to be reliable and valid, hence we conducted a systematic review of observational assessments of task performance used to estimate functional cognition in this population. Two separate database searches were conducted: firstly to identify instruments; and secondly to identify studies reporting on the psychometric properties of the instruments. Studies were analysed using a published checklist and their quality reviewed according to specific published criteria. Clinical utility was reviewed and the information formulated into a best evidence synthesis. We found 21 instruments and included 58 studies reporting on measurement properties. The majority of studies were rated as being of fair methodological quality and the range of properties investigated was restricted. Most instruments had studies reporting on construct validity (hypothesis testing), none on content validity and there were few studies reporting on reliability. Overall the evidence on psychometric properties is lacking and there is an urgent need for further evaluation of instruments. Copyright © 2016 Elsevier Ltd. All rights reserved.

A Pilot Study of the Validity of Self-reported Ultraviolet Radiation Exposure and Sun Protection Practices Among Lifeguards, Parents and Children

PubMed Central

O’Riordan, David L.; Glanz, Karen; Gies, Peter; Elliott, Tom

2013-01-01

Outdoor recreation settings, such as swimming pools, provide a promising venue to assess UVR exposure and sun protection practices among individuals who are minimally clothed and exposed to potentially high levels of UVR. Most studies assessing sun exposure/protection practices rely on self-reported data, which are subject to bias. The aim of this study was to establish the feasibility of conducting a multimethod study to examine the validity of self-reported measures within a swimming pool setting. Data were collected from 27 lifeguards, children and parents in Hawaii. Each participant filled out a survey and a 4 day sun habits diary. On two occasions, researchers assessed observable sun protection behaviors (wearing hats, shirts, sunglasses), swabbed the skin to detect the presence of sunscreen, and subjects wore polysulphone dosimeters to measure UVR exposure. Overall, observed sun protection behaviors were more highly correlated with diary reports than with survey reports. While lifeguards and children reported spending comparable amounts of time in the sun, dosimeter measures showed that lifeguards received twice as much UVR exposure. This study demonstrated the feasibility of implementing a multimethod validity study within a broader population of swimming pools. PMID:18179624

Believing androids - fMRI activation in the right temporo-parietal junction is modulated by ascribing intentions to non-human agents.

PubMed

Özdem, Ceylan; Wiese, Eva; Wykowska, Agnieszka; Müller, Hermann; Brass, Marcel; Van Overwalle, Frank

2017-10-01

Attributing mind to interaction partners has been shown to increase the social relevance we ascribe to others' actions and to modulate the amount of attention dedicated to them. However, it remains unclear how the relationship between higher-order mind attribution and lower-level attention processes is established in the brain. In this neuroimaging study, participants saw images of an anthropomorphic robot that moved its eyes left- or rightwards to signal the appearance of an upcoming stimulus in the same (valid cue) or opposite location (invalid cue). Independently, participants' beliefs about the intentionality underlying the observed eye movements were manipulated by describing the eye movements as under human control or preprogrammed. As expected, we observed a validity effect behaviorally and neurologically (increased response times and activation in the invalid vs. valid condition). More importantly, we observed that this effect was more pronounced for the condition in which the robot's behavior was believed to be controlled by a human, as opposed to be preprogrammed. This interaction effect between cue validity and belief was, however, only found at the neural level and was manifested as a significant increase of activation in bilateral anterior temporoparietal junction.

Validation of a model to investigate the effects of modifying cardiovascular disease (CVD) risk factors on the burden of CVD: the rotterdam ischemic heart disease and stroke computer simulation (RISC) model.

PubMed

van Kempen, Bob J H; Ferket, Bart S; Hofman, Albert; Steyerberg, Ewout W; Colkesen, Ersen B; Boekholdt, S Matthijs; Wareham, Nicholas J; Khaw, Kay-Tee; Hunink, M G Myriam

2012-12-06

We developed a Monte Carlo Markov model designed to investigate the effects of modifying cardiovascular disease (CVD) risk factors on the burden of CVD. Internal, predictive, and external validity of the model have not yet been established. The Rotterdam Ischemic Heart Disease and Stroke Computer Simulation (RISC) model was developed using data covering 5 years of follow-up from the Rotterdam Study. To prove 1) internal and 2) predictive validity, the incidences of coronary heart disease (CHD), stroke, CVD death, and non-CVD death simulated by the model over a 13-year period were compared with those recorded for 3,478 participants in the Rotterdam Study with at least 13 years of follow-up. 3) External validity was verified using 10 years of follow-up data from the European Prospective Investigation of Cancer (EPIC)-Norfolk study of 25,492 participants, for whom CVD and non-CVD mortality was compared. At year 5, the observed incidences (with simulated incidences in brackets) of CHD, stroke, and CVD and non-CVD mortality for the 3,478 Rotterdam Study participants were 5.30% (4.68%), 3.60% (3.23%), 4.70% (4.80%), and 7.50% (7.96%), respectively. At year 13, these percentages were 10.60% (10.91%), 9.90% (9.13%), 14.20% (15.12%), and 24.30% (23.42%). After recalibrating the model for the EPIC-Norfolk population, the 10-year observed (simulated) incidences of CVD and non-CVD mortality were 3.70% (4.95%) and 6.50% (6.29%). All observed incidences fell well within the 95% credibility intervals of the simulated incidences. We have confirmed the internal, predictive, and external validity of the RISC model. These findings provide a basis for analyzing the effects of modifying cardiovascular disease risk factors on the burden of CVD with the RISC model.

Validation and Clinical Evaluation of a Novel Method To Measure Miltefosine in Leishmaniasis Patients Using Dried Blood Spot Sample Collection

PubMed Central

Rosing, H.; Hillebrand, M. J. X.; Blesson, S.; Mengesha, B.; Diro, E.; Hailu, A.; Schellens, J. H. M.; Beijnen, J. H.

2016-01-01

To facilitate future pharmacokinetic studies of combination treatments against leishmaniasis in remote regions in which the disease is endemic, a simple cheap sampling method is required for miltefosine quantification. The aims of this study were to validate a liquid chromatography-tandem mass spectrometry method to quantify miltefosine in dried blood spot (DBS) samples and to validate its use with Ethiopian patients with visceral leishmaniasis (VL). Since hematocrit (Ht) levels are typically severely decreased in VL patients, returning to normal during treatment, the method was evaluated over a range of clinically relevant Ht values. Miltefosine was extracted from DBS samples using a simple method of pretreatment with methanol, resulting in >97% recovery. The method was validated over a calibration range of 10 to 2,000 ng/ml, and accuracy and precision were within ±11.2% and ≤7.0% (≤19.1% at the lower limit of quantification), respectively. The method was accurate and precise for blood spot volumes between 10 and 30 μl and for Ht levels of 20 to 35%, although a linear effect of Ht levels on miltefosine quantification was observed in the bioanalytical validation. DBS samples were stable for at least 162 days at 37°C. Clinical validation of the method using paired DBS and plasma samples from 16 VL patients showed a median observed DBS/plasma miltefosine concentration ratio of 0.99, with good correlation (Pearson's r = 0.946). Correcting for patient-specific Ht levels did not further improve the concordance between the sampling methods. This successfully validated method to quantify miltefosine in DBS samples was demonstrated to be a valid and practical alternative to venous blood sampling that can be applied in future miltefosine pharmacokinetic studies with leishmaniasis patients, without Ht correction. PMID:26787691

Validation of a quality-of-life instrument for patients with nonmelanoma skin cancer.

PubMed

Rhee, John S; Matthews, B Alex; Neuburg, Marcy; Logan, Brent R; Burzynski, Mary; Nattinger, Ann B

2006-01-01

To validate a disease-specific quality-of-life instrument--the Skin Cancer Index--intended to measure quality-of-life issues relevant to patients with nonmelanoma skin cancer. Internal reliability, convergent and divergent validity with existing scales, and factor analyses were performed in a cross-sectional study of 211 patients presenting with cervicofacial nonmelanoma skin cancer to a dermatologic surgery clinic. Factor analyses of the Skin Cancer Index confirmed a multidimensional scale with 3 distinct subscales-emotional, social, and appearance. Excellent internal validity of the 3 subscales was demonstrated. Substantial evidence was observed for convergent validity with the Dermatology Life Quality Index, Rosenberg Self-Esteem Scale, Lerman's Cancer Worry Scale, and Medical Outcomes Survey Short-Form 12 domains for vitality, emotion, social function, and mental health. These findings validate a new disease-specific quality-of-life instrument for patients with cervicofacial nonmelanoma skin cancer. Studies on the responsiveness of the Skin Cancer Index to clinical intervention are currently under way.

Validation of the Australian Propensity for Angry Driving Scale (Aus-PADS).

PubMed

Leal, Nerida L; Pachana, Nancy A

2009-09-01

The present study used a university sample to assess the test-retest reliability and validity of the Australian Propensity for Angry Driving Scale (Aus-PADS). The scale has stability over time, and convergent validity was established, as Aus-PADS scores correlated significantly with established anger and impulsivity measures. Discriminant validity was also established, as Aus-PADS scores did not correlate with Venturesomeness scores. The Aus-PADS has demonstrated criterion validity, as scores were correlated with behavioural measures, such as yelling at other drivers, gesturing at other drivers, and feeling angry but not doing anything. Aus-PADS scores reliably predicted the frequency of these behaviours over and above other study variables. No significant relationship between aggressive driving and crash involvement was observed. It was concluded that the Aus-PADS is a reliable and valid tool appropriate for use in Australian research, and that the potential relationship between aggressive driving and crash involvement warrants further investigation with a more representative (and diverse) driver sample.

Validation of a common data model for active safety surveillance research

PubMed Central

Ryan, Patrick B; Reich, Christian G; Hartzema, Abraham G; Stang, Paul E

2011-01-01

Objective Systematic analysis of observational medical databases for active safety surveillance is hindered by the variation in data models and coding systems. Data analysts often find robust clinical data models difficult to understand and ill suited to support their analytic approaches. Further, some models do not facilitate the computations required for systematic analysis across many interventions and outcomes for large datasets. Translating the data from these idiosyncratic data models to a common data model (CDM) could facilitate both the analysts' understanding and the suitability for large-scale systematic analysis. In addition to facilitating analysis, a suitable CDM has to faithfully represent the source observational database. Before beginning to use the Observational Medical Outcomes Partnership (OMOP) CDM and a related dictionary of standardized terminologies for a study of large-scale systematic active safety surveillance, the authors validated the model's suitability for this use by example. Validation by example To validate the OMOP CDM, the model was instantiated into a relational database, data from 10 different observational healthcare databases were loaded into separate instances, a comprehensive array of analytic methods that operate on the data model was created, and these methods were executed against the databases to measure performance. Conclusion There was acceptable representation of the data from 10 observational databases in the OMOP CDM using the standardized terminologies selected, and a range of analytic methods was developed and executed with sufficient performance to be useful for active safety surveillance. PMID:22037893

Validity of Cognitive Load Measures in Simulation-Based Training: A Systematic Review.

PubMed

Naismith, Laura M; Cavalcanti, Rodrigo B

2015-11-01

Cognitive load theory (CLT) provides a rich framework to inform instructional design. Despite the applicability of CLT to simulation-based medical training, findings from multimedia learning have not been consistently replicated in this context. This lack of transferability may be related to issues in measuring cognitive load (CL) during simulation. The authors conducted a review of CLT studies across simulation training contexts to assess the validity evidence for different CL measures. PRISMA standards were followed. For 48 studies selected from a search of MEDLINE, EMBASE, PsycInfo, CINAHL, and ERIC databases, information was extracted about study aims, methods, validity evidence of measures, and findings. Studies were categorized on the basis of findings and prevalence of validity evidence collected, and statistical comparisons between measurement types and research domains were pursued. CL during simulation training has been measured in diverse populations including medical trainees, pilots, and university students. Most studies (71%; 34) used self-report measures; others included secondary task performance, physiological indices, and observer ratings. Correlations between CL and learning varied from positive to negative. Overall validity evidence for CL measures was low (mean score 1.55/5). Studies reporting greater validity evidence were more likely to report that high CL impaired learning. The authors found evidence that inconsistent correlations between CL and learning may be related to issues of validity in CL measures. Further research would benefit from rigorous documentation of validity and from triangulating measures of CL. This can better inform CLT instructional design for simulation-based medical training.

An observation tool for instructor and student behaviors to measure in-class learner engagement: a validation study

PubMed Central

Alimoglu, Mustafa K.; Sarac, Didar B.; Alparslan, Derya; Karakas, Ayse A.; Altintas, Levent

2014-01-01

Background Efforts are made to enhance in-class learner engagement because it stimulates and enhances learning. However, it is not easy to quantify learner engagement. This study aimed to develop and validate an observation tool for instructor and student behaviors to determine and compare in-class learner engagement levels in four different class types delivered by the same instructor. Methods Observer pairs observed instructor and student behaviors during lectures in large class (LLC, n=2) with third-year medical students, lectures in small class (LSC, n=6) and case-based teaching sessions (CBT, n=4) with fifth-year students, and problem-based learning (PBL) sessions (~7 hours) with second-year students. The observation tool was a revised form of STROBE, an instrument for recording behaviors of an instructor and four randomly selected students as snapshots for 5-min cycles. Instructor and student behaviors were scored 1–5 on this tool named ‘in-class engagement measure (IEM)’. The IEM scores were parallel to the degree of behavior's contribution to active student engagement, so higher scores were associated with more in-class learner engagement. Additionally, the number of questions asked by the instructor and students were recorded. A total of 203 5-min observations were performed (LLC 20, LSC 85, CBT 50, and PBL 48). Results Interobserver agreement on instructor and student behaviors was 93.7% (κ=0.87) and 80.6% (κ=0.71), respectively. Higher median IEM scores were found in student-centered and problem-oriented methods such as CBT and PBL. A moderate correlation was found between instructor and student behaviors (r=0.689). Conclusions This study provides some evidence for validity of the IEM scores as a measure of student engagement in different class types. PMID:25308966

Development and validation of a clinical prediction rule to identify suspected breast cancer: a prospective cohort study.

PubMed

Galvin, Rose; Joyce, Doireann; Downey, Eithne; Boland, Fiona; Fahey, Tom; Hill, Arnold K

2014-10-03

The number of primary care referrals of women with breast symptoms to symptomatic breast units (SBUs) has increased exponentially in the past decade in Ireland. The aim of this study is to develop and validate a clinical prediction rule (CPR) to identify women with breast cancer so that a more evidence based approach to referral from primary care to these SBUs can be developed. We analysed routine data from a prospective cohort of consecutive women reviewed at a SBU with breast symptoms. The dataset was split into a derivation and validation cohort. Regression analysis was used to derive a CPR from the patient's history and clinical findings. Validation of the CPR consisted of estimating the number of breast cancers predicted to occur compared with the actual number of observed breast cancers across deciles of risk. A total of 6,590 patients were included in the derivation study and 4.9% were diagnosed with breast cancer. Independent clinical predictors for breast cancer were: increasing age by year (adjusted odds ratio 1.08, 95% CI 1.07-1.09); presence of a lump (5.63, 95% CI 4.2-7.56); nipple change (2.77, 95% CI 1.68-4.58) and nipple discharge (2.09, 95% CI 1.1-3.97). Validation of the rule (n = 911) demonstrated that the probability of breast cancer was higher with an increasing number of these independent variables. The Hosmer-Lemeshow goodness of fit showed no overall significant difference between the expected and the observed numbers of breast cancer (χ(2)HL: 6.74, p-value: 0.56). This study derived and validated a CPR for breast cancer in women attending an Irish national SBU. We found that increasing age, presence of a lump, nipple discharge and nipple change are all associated with increased risk of breast cancer. Further validation of the rule is necessary as well as an assessment of its impact on referral practice.

Children's Physical Activity While Gardening: Development of a Valid and Reliable Direct Observation Tool.

PubMed

Myers, Beth M; Wells, Nancy M

2015-04-01

Gardens are a promising intervention to promote physical activity (PA) and foster health. However, because of the unique characteristics of gardening, no extant tool can capture PA, postures, and motions that take place in a garden. The Physical Activity Research and Assessment tool for Garden Observation (PARAGON) was developed to assess children's PA levels, tasks, postures, and motions, associations, and interactions while gardening. PARAGON uses momentary time sampling in which a trained observer watches a focal child for 15 seconds and then records behavior for 15 seconds. Sixty-five children (38 girls, 27 boys) at 4 elementary schools in New York State were observed over 8 days. During the observation, children simultaneously wore Actigraph GT3X+ accelerometers. The overall interrater reliability was 88% agreement, and Ebel was .97. Percent agreement values for activity level (93%), garden tasks (93%), motions (80%), associations (95%), and interactions (91%) also met acceptable criteria. Validity was established by previously validated PA codes and by expected convergent validity with accelerometry. PARAGON is a valid and reliable observation tool for assessing children's PA in the context of gardening.

NASA Ocean Altimeter Pathfinder Project. Report 2; Data Set Validation

NASA Technical Reports Server (NTRS)

Koblinsky, C. J.; Ray, Richard D.; Beckley, Brian D.; Bremmer, Anita; Tsaoussi, Lucia S.; Wang, Yan-Ming

1999-01-01

The NOAA/NASA Pathfinder program was created by the Earth Observing System (EOS) Program Office to determine how existing satellite-based data sets can be processed and used to study global change. The data sets are designed to be long time-series data processed with stable calibration and community consensus algorithms to better assist the research community. The Ocean Altimeter Pathfinder Project involves the reprocessing of all altimeter observations with a consistent set of improved algorithms, based on the results from TOPEX/POSEIDON (T/P), into easy-to-use data sets for the oceanographic community for climate research. Details are currently presented in two technical reports: Report# 1: Data Processing Handbook Report #2: Data Set Validation This report describes the validation of the data sets against a global network of high quality tide gauge measurements and provides an estimate of the error budget. The first report describes the processing schemes used to produce the geodetic consistent data set comprised of SEASAT, GEOSAT, ERS-1, TOPEX/ POSEIDON, and ERS-2 satellite observations.

Criterion and concurrent validity of Conners Adult ADHD Diagnostic Interview for DSM-IV (CAADID) Spanish version.

PubMed

Ramos-Quiroga, Josep Antoni; Bosch, Rosa; Richarte, Vanesa; Valero, Sergi; Gómez-Barros, Nuria; Nogueira, Mariana; Palomar, Gloria; Corrales, Montse; Sáez-Francàs, Naia; Corominas, Margarida; Real, Alberto; Vidal, Raquel; Chalita, Pablo J; Casas, Miguel

2012-01-01

Attention deficit hyperactivity disorder (ADHD) is a common neuropsychiatric disorder in adulthood. Its diagnosis requires a retrospective evaluation of ADHD symptoms in childhood, the continuity of these symptoms in adulthood, and a differential diagnosis. For these reasons, diagnosis of ADHD in adults is a complex process which needs effective diagnostic tools. To analyse the criterion validity of the CAADID semi-structured interview, Spanish version, and the concurrent validity compared with other ADHD severity scales. An observational case-control study was conducted on 691 patients with ADHD. They were out-patients treated in a program for adults with ADHD in a hospital. A sensitivity of 98.86%, specificity 67.68%, positive predictive value 90.77% and a negative predictive value 94.87% were observed. Diagnostic precision was 91.46%. The kappa index concordance between the clinical diagnostic interview and the CAADID was 0.88. Good concurrent validity was obtained, the CAADID correlated significantly with WURS scale (r=0.522, P<.01), ADHD Rating Scale (r=0.670, P<.0.1) and CAARS (self-rating version; r=0.656, P<.01 and observer-report r=0.514, P<.01). CAADID is a valid and useful tool for the diagnosis of ADHD in adults for clinical, as well as for research purposes. Copyright © 2012 SEP y SEPB. Published by Elsevier España, S.L. All rights reserved.

Validation of the iHealth BP7 wrist blood pressure monitor, for self-measurement, according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Wang, Qing; Zhao, Huadong; Chen, Wan; Li, Ni; Wan, Yi

2014-02-01

The aim of this study was to validate the iHealth BP7 wireless wrist blood pressure monitor according to the European Society of Hypertension International Protocol (ESH-IP) revision 2010. A total of 99 pairs of test device and reference blood pressure measurements (three pairs for each of the 33 participants) were obtained for validation. The ESH-IP revision 2010 for the validation of blood pressure measuring devices in adults was followed precisely. The device produced 66, 87, and 97 measurements within 5, 10, and 15 mmHg for systolic blood pressure (SBP) and 72, 93, and 99 mmHg for diastolic blood pressure (DBP), respectively. The mean±SD device-observer difference was -0.7±6.9 mmHg for SBP and -1.0±5.1 mmHg for DBP. The number of participants with two or three device-observer differences within 5 mmHg was 25 for SBP and 26 for DBP; furthermore, there were three participants for SBP and one participant for DBP, with none of the device-observer differences within 5 mmHg. On the basis of the validation results, the iHealth BP7 wireless wrist blood pressure monitor can be recommended for self-measurement in an adult population.

Validation of intermediate end points in cancer research.

PubMed

Schatzkin, A; Freedman, L S; Schiffman, M H; Dawsey, S M

1990-11-21

Investigations using intermediate end points as cancer surrogates are quicker, smaller, and less expensive than studies that use malignancy as the end point. We present a strategy for determining whether a given biomarker is a valid intermediate end point between an exposure and incidence of cancer. Candidate intermediate end points may be selected from case series, ecologic studies, and animal experiments. Prospective cohort and sometimes case-control studies may be used to quantify the intermediate end point-cancer association. The most appropriate measure of this association is the attributable proportion. The intermediate end point is a valid cancer surrogate if the attributable proportion is close to 1.0, but not if it is close to 0. Usually, the attributable proportion is close to neither 1.0 nor 0; in this case, valid surrogacy requires that the intermediate end point mediate an established exposure-cancer relation. This would in turn imply that the exposure effect would vanish if adjusted for the intermediate end point. We discuss the relative advantages of intervention and observational studies for the validation of intermediate end points. This validation strategy also may be applied to intermediate end points for adverse reproductive outcomes and chronic diseases other than cancer.

Validity and reliability of Persian version of Listening Styles Profile-Revised (LSP- R) in Iranian students.

PubMed

Fatehi, Zahra; Baradaran, Hamid Reza; Asadpour, Mohamad; Rezaeian, Mohsen

2017-01-01

Background: Individuals' listening styles differs based on their characters, professions and situations. This study aimed to assess the validity and reliability of Listening Styles Profile- Revised (LSP- R) in Iranian students. Methods: After translating into Persian, LSP-R was employed in a sample of 240 medical and nursing Persian speaking students in Iran. Statistical analysis was performed to test the reliability and validity of the LSP-R. Results: The study revealed high internal consistency and good test-retest reliability for the Persian version of the questionnaire. The Cronbach's alpha coefficient was 0.72 and intra-class correlation coefficient 0.87. The means for the content validity index and the content validity ratio (CVR) were 0.90 and 0.83, respectively. Exploratory factor analysis (EFA) yielded a four-factor solution accounted for 60.8% of the observed variance. Majority of medical students (73%) as well as majority of nursing students (70%) stated that their listening styles were task-oriented. Conclusion: In general, the study finding suggests that the Persian version of LSP-R is a valid and reliable instrument for assessing listening styles profile in the studied sample.

The definition of radiological signs in gastric ulcer and assessment of their validity by inter-observer variation study.

PubMed

Schulman, A; Simpkins, K C

1975-07-01

The initial aim was to program a computer with information on the frequency of radiological signs in benign and malignant gastric ulcers in order to obtain a percentage probability of benignancy or malignancy in succeeding ulcers in clinical practice. However, only four of the many signs described in gastric ulcer were confirmed to be of validity (i.e. reliable existence) by an inter-observer variation study using two observers and the films from 69 barium meal examinations. These were projection or non-projection of the in-profile ulcer, presence or absence of adjacent mucosal folds, good or poor definition of the in-face ulcer's edge, and extension of radiating folds to the in-face ulcer's edge. A few more remained unassessed due to insufficient numbers of relevant cases. It is condluced that: as defined in the literature the majority of radiological signs in this field are of uncertain existence; and the four that were found to be valid do not fully describe the important appearances that may be seen in benign and malignant ulcers and would be inadequate to differentiate them to a sufficiently high degree of probability.

Balloon Borne Soundings of Water Vapor, Ozone and Temperature in the Upper Tropospheric and Lower Stratosphere as Part of the Second SAGE III Ozone Loss and Validation Experiment (SOLVE-2)

NASA Technical Reports Server (NTRS)

Voemel, Holger

2004-01-01

The main goal of our work was to provide in situ water vapor and ozone profiles in the upper troposphere and lower stratosphere as reference measurements for the validation of SAGE III water vapor and ozone retrievals. We used the NOAA/CMDL frost point hygrometer and ECC ozone sondes on small research balloons to provide continuous profiles between the surface and the mid stratosphere. The NOAA/CMDL frost point hygrometer is currently the only lightweight balloon borne instrument capable of measuring water vapor between the lower troposphere and middle stratosphere. The validation measurements were based in the arctic region of Scandinavia for northern hemisphere observations and in New Zealand for southern hemisphere observations and timed to coincide with overpasses of the SAGE III instrument. In addition to SAGE III validation we also tried to coordinate launches with other instruments and studied dehydration and transport processes in the Arctic stratospheric vortex.

Validation of recent geopotential models in Tierra Del Fuego

NASA Astrophysics Data System (ADS)

Gomez, Maria Eugenia; Perdomo, Raul; Del Cogliano, Daniel

2017-10-01

This work presents a validation study of global geopotential models (GGM) in the region of Fagnano Lake, located in the southern Andes. This is an excellent area for this type of validation because it is surrounded by the Andes Mountains, and there is no terrestrial gravity or GNSS/levelling data. However, there are mean lake level (MLL) observations, and its surface is assumed to be almost equipotential. Furthermore, in this article, we propose improved geoid solutions through the Residual Terrain Modelling (RTM) approach. Using a global geopotential model, the results achieved allow us to conclude that it is possible to use this technique to extend an existing geoid model to those regions that lack any information (neither gravimetric nor GNSS/levelling observations). As GGMs have evolved, our results have improved progressively. While the validation of EGM2008 with MLL data shows a standard deviation of 35 cm, GOCO05C shows a deviation of 13 cm, similar to the results obtained on land.

Validity and reliability of the Greek version of the xerostomia questionnaire in head and neck cancer patients.

PubMed

Memtsa, Pinelopi Theopisti; Tolia, Maria; Tzitzikas, Ioannis; Bizakis, Ioannis; Pistevou-Gombaki, Kyriaki; Charalambidou, Martha; Iliopoulou, Chrysoula; Kyrgias, George

2017-03-01

Xerostomia after radiation therapy for head and neck (H&N) cancer has serious effects on patients' quality of life. The purpose of this study was to validate the Greek version of the self-reported eight-item xerostomia questionnaire (XQ) in patients treated with radiotherapy for H&N cancer. The XQ was translated into Greek and administered to 100 XQ patients. An exploratory factor analysis was performed. Reliability measures were calculated. Several types of validity were evaluated. The observer-rated scoring system was also used. The mean XQ value was 41.92 (SD 22.71). Factor analysis revealed the unidimensional nature of the questionnaire. High reliability measures (ICC, Cronbach's α, Pearson coefficients) were obtained. Patients differed statistically significantly in terms of XQ score, depending on the RTOG/EORTC classification. The Greek version of XQ is valid and reliable. Its score is well related to observer's findings and it can be used to evaluate the impact of radiation therapy on the subjective feeling of xerostomia.

Examining Subtypes of Behavior Problems among 3-Year-Old Children, Part I: Investigating Validity of Subtypes and Biological Risk-Factors

ERIC Educational Resources Information Center

Harvey, Elizabeth A.; Friedman-Weieneth, Julie L.; Goldstein, Lauren H.; Sherman, Alison H.

2007-01-01

This study examined 3-year-old children who were classified as hyperactive (HYP), oppositional-defiant (OD), hyperactive and oppositional defiant (HYP/OD), and non-problem based on mothers' reports of behavior. Using fathers', teachers', and observers' ratings of children's behavior, concurrent validity was excellent for the HYP/OD group, moderate…

Validation of cross-sectional time series and multivariate adaptive regression splines models for the prediction of energy expenditure in children and adolescents using doubly labeled water

USDA-ARS?s Scientific Manuscript database

Accurate, nonintrusive, and inexpensive techniques are needed to measure energy expenditure (EE) in free-living populations. Our primary aim in this study was to validate cross-sectional time series (CSTS) and multivariate adaptive regression splines (MARS) models based on observable participant cha...

Value-Added and Observational Measures Used in the Teacher Evaluation Process: A Validation Study

ERIC Educational Resources Information Center

Guerere, Claudia

2013-01-01

Scores from value-added models (VAMs), as used for educational accountability, represent the educational effect teachers have on their students. The use of these scores in teacher evaluations for high-stakes decision making is new for the State of Florida. Validity evidence that supports or questions the use of these scores is critically needed.…

Evaluation of p-phenylenediamine, o-phenylphenol sodium salt, and 2,4-diaminotoluene in the rat comet assay as part of the Japanese Center for the Validation of Alternative Methods (JaCVAM)-initiated international validation study of in vivo rat alkaline comet assay.

PubMed

De Boeck, Marlies; van der Leede, Bas-jan; De Vlieger, Kathleen; Geys, Helena; Vynckier, An; Van Gompel, Jacky

2015-07-01

As part of the Japanese Center for the Validation of Alternative Methods (JaCVAM)-initiated international validation study of in vivo rat alkaline comet assay (comet assay), p-phenylenediamine dihydrochloride (PPD), o-phenylphenol sodium salt (OPP), and 2,4-diaminotoluene (2,4-DAT), were analyzed in this laboratory as coded test chemicals. Male Sprague-Dawley rats (7-9 weeks of age) were given three oral doses of the test compounds, 24 and 21 h apart and liver and stomach were sampled 3h after the final dose administration. Under the conditions of the test, no increases in DNA damage were observed in liver and stomach with PPD and OPP up to 100 and 1000 mg/kg/day, respectively. 2,4-DAT, a known genotoxic carcinogen, induced a weak but reproducible, dose-related and statistically significant increase in DNA damage in liver cells while no increases were observed in stomach cells. Copyright © 2015 Elsevier B.V. All rights reserved.

Heart rate variability indicates emotional value during pro-social economic laboratory decisions with large external validity.

PubMed

Fooken, Jonas

2017-03-10

The present study investigates the external validity of emotional value measured in economic laboratory experiments by using a physiological indicator of stress, heart rate variability (HRV). While there is ample evidence supporting the external validity of economic experiments, there is little evidence comparing the magnitude of internal levels of emotional stress during decision making with external stress. The current study addresses this gap by comparing the magnitudes of decision stress experienced in the laboratory with the stress from outside the laboratory. To quantify a large change in HRV, measures observed in the laboratory during decision-making are compared to the difference between HRV during a university exam and other mental activity for the same individuals in and outside of the laboratory. The results outside the laboratory inform about the relevance of laboratory findings in terms of their relative magnitude. Results show that psychologically induced HRV changes observed in the laboratory, particularly in connection with social preferences, correspond to large effects outside. This underscores the external validity of laboratory findings and shows the magnitude of emotional value connected to pro-social economic decisions in the laboratory.

Bird radar validation in the field by time-referencing line-transect surveys.

PubMed

Dokter, Adriaan M; Baptist, Martin J; Ens, Bruno J; Krijgsveld, Karen L; van Loon, E Emiel

2013-01-01

Track-while-scan bird radars are widely used in ornithological studies, but often the precise detection capabilities of these systems are unknown. Quantification of radar performance is essential to avoid observational biases, which requires practical methods for validating a radar's detection capability in specific field settings. In this study a method to quantify the detection capability of a bird radar is presented, as well a demonstration of this method in a case study. By time-referencing line-transect surveys, visually identified birds were automatically linked to individual tracks using their transect crossing time. Detection probabilities were determined as the fraction of the total set of visual observations that could be linked to radar tracks. To avoid ambiguities in assigning radar tracks to visual observations, the observer's accuracy in determining a bird's transect crossing time was taken into account. The accuracy was determined by examining the effect of a time lag applied to the visual observations on the number of matches found with radar tracks. Effects of flight altitude, distance, surface substrate and species size on the detection probability by the radar were quantified in a marine intertidal study area. Detection probability varied strongly with all these factors, as well as species-specific flight behaviour. The effective detection range for single birds flying at low altitude for an X-band marine radar based system was estimated at ~1.5 km. Within this range the fraction of individual flying birds that were detected by the radar was 0.50 ± 0.06 with a detection bias towards higher flight altitudes, larger birds and high tide situations. Besides radar validation, which we consider essential when quantification of bird numbers is important, our method of linking radar tracks to ground-truthed field observations can facilitate species-specific studies using surveillance radars. The methodology may prove equally useful for optimising tracking algorithms.

The Reliability and Validity of the Thin Slice Technique: Observational Research on Video Recorded Medical Interactions

ERIC Educational Resources Information Center

Foster, Tanina S.

2014-01-01

Introduction: Observational research using the thin slice technique has been routinely incorporated in observational research methods, however there is limited evidence supporting use of this technique compared to full interaction coding. The purpose of this study was to determine if this technique could be reliability coded, if ratings are…

Initial Validation of the Prekindergarten Classroom Observation Tool and Goal Setting System for Data-Based Coaching

ERIC Educational Resources Information Center

Crawford, April D.; Zucker, Tricia A.; Williams, Jeffrey M.; Bhavsar, Vibhuti; Landry, Susan H.

2013-01-01

Although coaching is a popular approach for enhancing the quality of Tier 1 instruction, limited research has addressed observational measures specifically designed to focus coaching on evidence-based practices. This study explains the development of the prekindergarten (pre-k) Classroom Observation Tool (COT) designed for use in a data-based…

Study to validate the Non-Interference Performance Assessment (NIPA) technique

NASA Technical Reports Server (NTRS)

Seeman, J. S.; Murphy, G. L.

1973-01-01

The NIPA (Non-Interference Performance Assessment) technique involves direct observation of group verbal activities by trained observers who rate the emotional content (affect) of each verbal interaction as either positive, negative, or neutral. During the test, in which four men were confined for 90 consecutive days, feasibility of the NIPA technique was demonstrated and observer reliability was verified. However, the validity of the test was not proved because an independent criterion measure of morale for the confined crew was lacking. There were indications, however, that NIPA measures were tracking changes in crew morale. At approximately the two-thirds point (Days 60 to 70), morale apparently fell dramatically for a period of about ten days, and simultaneously NIPA measure of positive verbalization decreased in number. A need was indicated for a separate study to apply the NIPA technique under experimental conditions and using a clearly defined criterion measure against which the ability of NIPA observations to truly measure morale changes could be determined.

Passive and Active Detection of Clouds: Comparisons between MODIS and GLAS Observations

NASA Technical Reports Server (NTRS)

Mahesh, Ashwin; Gray, Mark A.; Palm, Stephen P.; Hart, William D.; Spinhirne, James D.

2003-01-01

The Geoscience Laser Altimeter System (GLAS), launched on board the Ice, Cloud and Land Elevation Satellite in January 2003 provides space-borne laser observations of atmospheric layers. GLAS provides opportunities to validate passive observations of the atmosphere for the first time from space with an active optical instrument. Data from the Moderate Resolution Imaging Spectrometer aboard the Aqua satellite is examined along with GLAS observations of cloud layers. In more than three-quarters of the cases, MODIS scene identification from spectral radiances agrees with GLAS. Disagreement between the two platforms is most significant over snow-covered surfaces in the northern hemisphere. Daytime clouds detected by GLAS are also more easily seen in the MODIS data as well, compared to observations made at night. These comparisons illustrate the capabilities of active remote sensing to validate and assess passive measurements, and also to complement them in studies of atmospheric layers.

Validation of Radiometric Standards for the Laboratory Calibration of Reflected-Solar Earth Observing Satellite Instruments

NASA Technical Reports Server (NTRS)

Butler, James J.; Johnson, B. Carol; Rice, Joseph P.; Brown, Steven W.; Barnes, Robert A.

2007-01-01

Historically, the traceability of the laboratory calibration of Earth-observing satellite instruments to a primary radiometric reference scale (SI units) is the responsibility of each instrument builder. For the NASA Earth Observing System (EOS), a program has been developed using laboratory transfer radiometers, each with its own traceability to the primary radiance scale of a national metrology laboratory, to independently validate the radiances assigned to the laboratory sources of the instrument builders. The EOS Project Science Office also developed a validation program for the measurement of onboard diffuse reflecting plaques, which are also used as radiometric standards for Earth-observing satellite instruments. Summarized results of these validation campaigns, with an emphasis on the current state-of-the-art uncertainties in laboratory radiometric standards, will be presented. Future mission uncertainty requirements, and possible enhancements to the EOS validation program to ensure that those uncertainties can be met, will be presented.

Cluster designs to assess the prevalence of acute malnutrition by lot quality assurance sampling: a validation study by computer simulation

PubMed Central

Olives, Casey; Pagano, Marcello; Deitchler, Megan; Hedt, Bethany L; Egge, Kari; Valadez, Joseph J

2009-01-01

Traditional lot quality assurance sampling (LQAS) methods require simple random sampling to guarantee valid results. However, cluster sampling has been proposed to reduce the number of random starting points. This study uses simulations to examine the classification error of two such designs, a 67×3 (67 clusters of three observations) and a 33×6 (33 clusters of six observations) sampling scheme to assess the prevalence of global acute malnutrition (GAM). Further, we explore the use of a 67×3 sequential sampling scheme for LQAS classification of GAM prevalence. Results indicate that, for independent clusters with moderate intracluster correlation for the GAM outcome, the three sampling designs maintain approximate validity for LQAS analysis. Sequential sampling can substantially reduce the average sample size that is required for data collection. The presence of intercluster correlation can impact dramatically the classification error that is associated with LQAS analysis. PMID:20011037

Psychometric performance of the brazilian version of the Mini-cuestionario de calidad de vida en la hipertensión arterial (MINICHAL).

PubMed

Soutello, Ana Lúcia Soares; Rodrigues, Roberta Cunha Matheus; Jannuzzi, Fernanda Freire; Spana, Thaís Moreira; Gallani, Maria Cecília Bueno Jayme; Nadruz Junior, Wilson

2011-01-01

This study aimed to evaluate the feasibility, acceptability, ceiling and floor effects, reliability, and convergent construct validity of the Brazilian version of the Mini Cuestionario de Calidad de Vida en la Hipertensión Arterial (MINICHAL). The study included 200 hypertensive outpatients in a university hospital and a primary healthcare unit. The MINICHAL was applied in 3.0 (± 1.0) minutes with 100% of the items answered. A "ceiling effect" was observed in both dimensions and in the total score, as well as evidence of measurement stability (ICC=0.74). The convergent validity was confirmed by significant positive correlations between similar dimensions of the MINICHAL and the SF-36, and significant negative correlations with the Minnesota Living with Heart Failure Questionnaire - MLHFQ, however, correlations between dissimilar constructs were also observed. It was concluded that the Brazilian version of the MINICHAL presents evidence of reliability and validity when applied to hypertensive outpatients.

Development of a novel observational measure for anxiety in young children: The Anxiety Dimensional Observation Scale

PubMed Central

Mian, Nicholas D.; Carter, Alice S.; Pine, Daniel S.; Wakschlag, Lauren S.; Briggs-Gowan, Margaret J.

2015-01-01

Background Identifying anxiety disorders in preschool-age children represents an important clinical challenge. Observation is essential to clinical assessment and can help differentiate normative variation from clinically significant anxiety. Yet, most anxiety assessment methods for young children rely on parent-reports. The goal of this article is to present and preliminarily test the reliability and validity of a novel observational paradigm for assessing a range of fearful and anxious behaviors in young children, the Anxiety Dimensional Observation Schedule (Anx-DOS). Methods A diverse sample of 403 children, aged 3 to 6 years, and their mothers was studied. Reliability and validity in relation to parent reports (Preschool Age Psychiatric Assessment) and known risk factors, including indicators of behavioral inhibition (latency to touch novel objects) and attention bias to threat (in the dot-probe task) were investigated. Results The Anx-DOS demonstrated good inter-rater reliability and internal consistency. Evidence for convergent validity was demonstrated relative to mother-reported separation anxiety, social anxiety, phobic avoidance, trauma symptoms, and past service use. Finally, fearfulness was associated with observed latency and attention bias toward threat. Conclusions Findings support the Anx-DOS as a method for capturing early manifestations of fearfulness and anxiety in young children. Multimethod assessments incorporating standardized methods for assessing discrete, observable manifestations of anxiety may be beneficial for early identification and clinical intervention efforts. PMID:25773515

Validity of the Associated Symptom Criteria for Generalized Anxiety Disorder: Observations From the Singapore Mental Health Study.

PubMed

Lee, Siau Pheng; Ong, Clarissa; Vaingankar, Janhavi Ajit; Chong, Siow Ann; Subramaniam, Mythily

2017-05-01

Previous findings on the diagnostic validity and reliability of generalized anxiety disorder (GAD)-associated symptom criteria suggest need for further evaluation. The current study examined convergent validity and specificity of GAD-associated symptoms in a representative Singapore community sample. The Singapore of Mental Health Study a cross-sectional epidemiological survey conducted among 6166 Singapore residents aged 18 and older. The Composite International Diagnostic Interview version 3.0 was used to diagnose mental disorders. Associated symptoms in the GAD criteria and autonomic hyperactivity symptoms showed convergent validity with a GAD diagnosis. However, associated symptoms of GAD were also linked to major depressive disorder (MDD), bipolar disorder, and obsessive-compulsive disorder, suggesting lack of adequate specificity. The inability of the diagnostic criteria to differentiate GAD from symptoms of other conditions highlights the need to better define its associated symptoms criteria. The relationship of overlapping symptoms between GAD and MDD is also discussed.

Validation of the AVITA BPM64 upper-arm blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Kang, Yuan-Yuan; Chen, Qi; Liu, Chang-Yuan; Li, Yan; Wang, Ji-Guang

2018-02-01

The aim of this study was to evaluate the accuracy of the automated oscillometric upper arm blood pressure (BP) monitor AVITA BPM64 for home BP monitoring according to the International Protocol of the European Society of Hypertension revision 2010. Systolic and diastolic BPs were measured sequentially in 33 adult Chinese (14 women, mean age 47.0 years) using a mercury sphygmomanometer (two observers) and the AVITA BPM64 device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. The AVITA BPM64 device achieved the targets in part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 91/99, 98/99, and 98/99, respectively, for systolic BP and 92/99, 99/99, and 99/99, respectively, for diastolic BP. The device also fulfilled the criteria in part 2 of the validation study. Thirty-two participants for both systolic and diastolic BP had at least two of the three device-observer differences within 5 mmHg (required ≥24). Only one participant for systolic BP had all three device-observer comparisons greater than 5 mmHg. The AVITA upper arm BP monitor BPM64 has passed the requirements of the International Protocol revision 2010, and hence can be recommended for home use in adults.

A Primer on Observational Measurement.

PubMed

Girard, Jeffrey M; Cohn, Jeffrey F

2016-08-01

Observational measurement plays an integral role in a variety of scientific endeavors within biology, psychology, sociology, education, medicine, and marketing. The current article provides an interdisciplinary primer on observational measurement; in particular, it highlights recent advances in observational methodology and the challenges that accompany such growth. First, we detail the various types of instrument that can be used to standardize measurements across observers. Second, we argue for the importance of validity in observational measurement and provide several approaches to validation based on contemporary validity theory. Third, we outline the challenges currently faced by observational researchers pertaining to measurement drift, observer reactivity, reliability analysis, and time/expense. Fourth, we describe recent advances in computer-assisted measurement, fully automated measurement, and statistical data analysis. Finally, we identify several key directions for future observational research to explore.

Validating Remotely Sensed Land Surface Evapotranspiration Based on Multi-scale Field Measurements

NASA Astrophysics Data System (ADS)

Jia, Z.; Liu, S.; Ziwei, X.; Liang, S.

2012-12-01

The land surface evapotranspiration plays an important role in the surface energy balance and the water cycle. There have been significant technical and theoretical advances in our knowledge of evapotranspiration over the past two decades. Acquisition of the temporally and spatially continuous distribution of evapotranspiration using remote sensing technology has attracted the widespread attention of researchers and managers. However, remote sensing technology still has many uncertainties coming from model mechanism, model inputs, parameterization schemes, and scaling issue in the regional estimation. Achieving remotely sensed evapotranspiration (RS_ET) with confident certainty is required but difficult. As a result, it is indispensable to develop the validation methods to quantitatively assess the accuracy and error sources of the regional RS_ET estimations. This study proposes an innovative validation method based on multi-scale evapotranspiration acquired from field measurements, with the validation results including the accuracy assessment, error source analysis, and uncertainty analysis of the validation process. It is a potentially useful approach to evaluate the accuracy and analyze the spatio-temporal properties of RS_ET at both the basin and local scales, and is appropriate to validate RS_ET in diverse resolutions at different time-scales. An independent RS_ET validation using this method was presented over the Hai River Basin, China in 2002-2009 as a case study. Validation at the basin scale showed good agreements between the 1 km annual RS_ET and the validation data such as the water balanced evapotranspiration, MODIS evapotranspiration products, precipitation, and landuse types. Validation at the local scale also had good results for monthly, daily RS_ET at 30 m and 1 km resolutions, comparing to the multi-scale evapotranspiration measurements from the EC and LAS, respectively, with the footprint model over three typical landscapes. Although some validation experiments demonstrated that the models yield accurate estimates at flux measurement sites, the question remains whether they are performing well over the broader landscape. Moreover, a large number of RS_ET products have been released in recent years. Thus, we also pay attention to the cross-validation method of RS_ET derived from multi-source models. "The Multi-scale Observation Experiment on Evapotranspiration over Heterogeneous Land Surfaces: Flux Observation Matrix" campaign is carried out at the middle reaches of the Heihe River Basin, China in 2012. Flux measurements from an observation matrix composed of 22 EC and 4 LAS are acquired to investigate the cross-validation of multi-source models over different landscapes. In this case, six remote sensing models, including the empirical statistical model, the one-source and two-source models, the Penman-Monteith equation based model, the Priestley-Taylor equation based model, and the complementary relationship based model, are used to perform an intercomparison. All the results from the two cases of RS_ET validation showed that the proposed validation methods are reasonable and feasible.

Brazilian validation of the Alberta Infant Motor Scale.

PubMed

Valentini, Nadia Cristina; Saccani, Raquel

2012-03-01

The Alberta Infant Motor Scale (AIMS) is a well-known motor assessment tool used to identify potential delays in infants' motor development. Although Brazilian researchers and practitioners have used the AIMS in laboratories and clinical settings, its translation to Portuguese and validation for the Brazilian population is yet to be investigated. This study aimed to translate and validate all AIMS items with respect to internal consistency and content, criterion, and construct validity. A cross-sectional and longitudinal design was used. A cross-cultural translation was used to generate a Brazilian-Portuguese version of the AIMS. In addition, a validation process was conducted involving 22 professionals and 766 Brazilian infants (aged 0-18 months). The results demonstrated language clarity and internal consistency for the motor criteria (motor development score, α=.90; prone, α=.85; supine, α=.92; sitting, α=.84; and standing, α=.86). The analysis also revealed high discriminative power to identify typical and atypical development (motor development score, P<.001; percentile, P=.04; classification criterion, χ(2)=6.03; P=.05). Temporal stability (P=.07) (rho=.85, P<.001) was observed, and predictive power (P<.001) was limited to the group of infants aged from 3 months to 9 months. Limited predictive validity was observed, which may have been due to the restricted time that the groups were followed longitudinally. In sum, the translated version of AIMS presented adequate validity and reliability.

Improved Conceptual Models Methodology (ICoMM) for Validation of Non-Observable Systems

DTIC Science & Technology

2015-12-01

distribution is unlimited IMPROVED CONCEPTUAL MODELS METHODOLOGY (ICoMM) FOR VALIDATION OF NON-OBSERVABLE SYSTEMS by Sang M. Sok December 2015...REPORT TYPE AND DATES COVERED Dissertation 4. TITLE AND SUBTITLE IMPROVED CONCEPTUAL MODELS METHODOLOGY (ICoMM) FOR VALIDATION OF NON-OBSERVABLE...importance of the CoM. The improved conceptual model methodology (ICoMM) is developed in support of improving the structure of the CoM for both face and

Observing and modelling phytoplankton community structure in the North Sea

NASA Astrophysics Data System (ADS)

Ford, David A.; van der Molen, Johan; Hyder, Kieran; Bacon, John; Barciela, Rosa; Creach, Veronique; McEwan, Robert; Ruardij, Piet; Forster, Rodney

2017-03-01

Phytoplankton form the base of the marine food chain, and knowledge of phytoplankton community structure is fundamental when assessing marine biodiversity. Policy makers and other users require information on marine biodiversity and other aspects of the marine environment for the North Sea, a highly productive European shelf sea. This information must come from a combination of observations and models, but currently the coastal ocean is greatly under-sampled for phytoplankton data, and outputs of phytoplankton community structure from models are therefore not yet frequently validated. This study presents a novel set of in situ observations of phytoplankton community structure for the North Sea using accessory pigment analysis. The observations allow a good understanding of the patterns of surface phytoplankton biomass and community structure in the North Sea for the observed months of August 2010 and 2011. Two physical-biogeochemical ocean models, the biogeochemical components of which are different variants of the widely used European Regional Seas Ecosystem Model (ERSEM), were then validated against these and other observations. Both models were a good match for sea surface temperature observations, and a reasonable match for remotely sensed ocean colour observations. However, the two models displayed very different phytoplankton community structures, with one better matching the in situ observations than the other. Nonetheless, both models shared some similarities with the observations in terms of spatial features and inter-annual variability. An initial comparison of the formulations and parameterizations of the two models suggests that diversity between the parameter settings of model phytoplankton functional types, along with formulations which promote a greater sensitivity to changes in light and nutrients, is key to capturing the observed phytoplankton community structure. These findings will help inform future model development, which should be coupled with detailed validation studies, in order to help facilitate the wider application of marine biogeochemical modelling to user and policy needs.

Development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS): An observation-based tool for assessing cognitive behavioral therapy competence.

PubMed

Muse, Kate; McManus, Freda; Rakovshik, Sarah; Thwaites, Richard

2017-05-01

This article outlines the development and psychometric evaluation of the Assessment of Core CBT Skills (ACCS) rating scale. The ACCS aims to provide a novel assessment framework to deliver formative and summative feedback regarding therapists' performance within observed cognitive-behavioral treatment sessions, and for therapists to rate and reflect on their own performance. Findings from 3 studies are outlined: (a) a feedback study (n = 66) examining content validity, face validity and usability; (b) a focus group (n = 9) evaluating usability and utility; and (c) an evaluation of the psychometric properties of the ACCS in real world cognitive behavioral therapy (CBT) training and routine clinical practice contexts. Results suggest that the ACCS has good face validity, content validity, and usability and provides a user-friendly tool that is useful for promoting self-reflection and providing formative feedback. Scores on both the self and assessor-rated versions of the ACCS demonstrate good internal consistency, interrater reliability, and discriminant validity. In addition, ACCS scores were found to be correlated with, but distinct from, the Revised Cognitive Therapy Scale (CTS-R) and were comparable to CTS-R scores in terms of internal consistency and discriminant validity. In addition, the ACCS may have advantages over the CTS-R in terms of interrater reliability of scores. The studies also provided insight into areas for refinement and a number of modifications were undertaken to improve the scale. In summary, the ACCS is an appropriate and useful measure of CBT competence that can be used to promote self-reflection and provide therapists with formative and summative feedback. (PsycINFO Database Record (c) 2017 APA, all rights reserved).

The Validity and Reliability of the Turkish Version of the Neonatal Skin Risk Assessment Scale.

PubMed

Sari, Çiğdem; Altay, Naime

2017-03-01

The study created a Turkish translation of the Neonatal Skin Risk Assessment Scale (NSRAS) that was developed by Huffines and Longsdon in 1997. Study authors used a cross-sectional survey design in order to determine the validity and reliability of the Turkish translation. The study was conducted at the neonatal intensive care unit of a university hospital in Ankara between March 15 and June 30, 2014. The research sample included 130 neonatal assessments from 17 patients. Data were collected by questionnaire regarding the characteristics of the participating neonates, 7 nurse observers, and the NSRAS and its subarticles. After translation and back-translation were performed to assess language validity of the scale, necessary corrections were made in line with expert suggestions, and content validity was ensured. Internal consistency of the scale was assessed by its homogeneity, Cronbach's α, and subarticle-general scale grade correlation. Cronbach's α for the scale overall was .88, and Cronbach's α values for the subarticles were between .83 and .90. Results showed a positive relationship among all the subarticles and the overall NSRAS scale grade (P < .01) with correlation values between 0.333 and 0.721. Explanatory and predicative factor analysis was applied for structural validity. Kaiser-Meyer-Olkin analysis was applied for sample sufficiency, and Bartlett test analysis was applied in order to assess the factor analysis of the sample. The Kaiser-Meyer-Olkin coefficient was 0.73, and the χ value found according to the Bartlett test was statistically significant at an advanced level (P < .05). In the 6 subarticles of the scale and in the general scale total grade, a high, positive, and significant relationship among the grades given by the researcher and the nurse observers was found (P < .05). The Turkish NSRAS is reliable and valid.

Validity and reliability of the Japanese version of the FIM + FAM in patients with cerebrovascular accident.

PubMed

Miki, Emi; Yamane, Shingo; Yamaoka, Mai; Fujii, Hiroe; Ueno, Hiroka; Kawahara, Toshie; Tanaka, Keiko; Tamashiro, Hiroaki; Inoue, Eiji; Okamoto, Takatsugu; Kuriyama, Masaru

2016-09-01

The study aim was to investigate the validity and reliability of the Functional Independence Measure and Functional Assessment Measure (FIM + FAM), which is unfamiliar in Japan, by using its Japanese version (FIM + FAM-j) in patients with cerebrovascular accident (CVA). Forty-two CVA patients participated. Criterion validity was examined by correlating the full scale and subscales of FIM + FAM-j with several well-established measurements using Spearman's correlation coefficient. Reliability was evaluated by internal consistency (tested by Cronbach's alpha coefficient) and intra-rater reliability (tested by Kendall's tau correlation coefficient). Good-to-excellent criterion validity was found between the full scale and motor subscales of the FIM + FAM-j and the Barthel Index, National Institutes of Health Stroke Scale, modified Rankin Scale, and lower extremity Brunnstrom Recovery Stage. High internal consistency was observed within the full-scale FIM + FAM-j and the motor and cognitive subscales (Cronbach's alphas were 0.968, 0.954, and 0.948, respectively). Additionally, good intra-rater reliability was observed within the full scale and motor subscales, and excellent reliability for the cognitive subscales (taus were 0.83, 0.80, and 0.98, respectively). This study showed that the FIM + FAM-j demonstrated acceptable levels of validity and reliability when used for CVA as a measure of disability.

Validity and Reliability of the 8-Item Work Limitations Questionnaire.

PubMed

Walker, Timothy J; Tullar, Jessica M; Diamond, Pamela M; Kohl, Harold W; Amick, Benjamin C

2017-12-01

Purpose To evaluate factorial validity, scale reliability, test-retest reliability, convergent validity, and discriminant validity of the 8-item Work Limitations Questionnaire (WLQ) among employees from a public university system. Methods A secondary analysis using de-identified data from employees who completed an annual Health Assessment between the years 2009-2015 tested research aims. Confirmatory factor analysis (CFA) (n = 10,165) tested the latent structure of the 8-item WLQ. Scale reliability was determined using a CFA-based approach while test-retest reliability was determined using the intraclass correlation coefficient. Convergent/discriminant validity was tested by evaluating relations between the 8-item WLQ with health/performance variables for convergent validity (health-related work performance, number of chronic conditions, and general health) and demographic variables for discriminant validity (gender and institution type). Results A 1-factor model with three correlated residuals demonstrated excellent model fit (CFI = 0.99, TLI = 0.99, RMSEA = 0.03, and SRMR = 0.01). The scale reliability was acceptable (0.69, 95% CI 0.68-0.70) and the test-retest reliability was very good (ICC = 0.78). Low-to-moderate associations were observed between the 8-item WLQ and the health/performance variables while weak associations were observed between the demographic variables. Conclusions The 8-item WLQ demonstrated sufficient reliability and validity among employees from a public university system. Results suggest the 8-item WLQ is a usable alternative for studies when the more comprehensive 25-item WLQ is not available.

AIRS Retrieval Validation During the EAQUATE

NASA Technical Reports Server (NTRS)

Zhou, Daniel K.; Smith, William L.; Cuomo, Vincenzo; Taylor, Jonathan P.; Barnet, Christopher D.; DiGirolamo, Paolo; Pappalardo, Gelsomina; Larar, Allen M.; Liu, Xu; Newman, Stuart M.

2006-01-01

Atmospheric and surface thermodynamic parameters retrieved with advanced hyperspectral remote sensors of Earth observing satellites are critical for weather prediction and scientific research. The retrieval algorithms and retrieved parameters from satellite sounders must be validated to demonstrate the capability and accuracy of both observation and data processing systems. The European AQUA Thermodynamic Experiment (EAQUATE) was conducted mainly for validation of the Atmospheric InfraRed Sounder (AIRS) on the AQUA satellite, but also for assessment of validation systems of both ground-based and aircraft-based instruments which will be used for other satellite systems such as the Infrared Atmospheric Sounding Interferometer (IASI) on the European MetOp satellite, the Cross-track Infrared Sounder (CrIS) from the NPOESS Preparatory Project and the following NPOESS series of satellites. Detailed inter-comparisons were conducted and presented using different retrieval methodologies: measurements from airborne ultraspectral Fourier transform spectrometers, aircraft in-situ instruments, dedicated dropsondes and radiosondes, and ground based Raman Lidar, as well as from the European Center for Medium range Weather Forecasting (ECMWF) modeled thermal structures. The results of this study not only illustrate the quality of the measurements and retrieval products but also demonstrate the capability of these validation systems which are put in place to validate current and future hyperspectral sounding instruments and their scientific products.

Agility performance in high-level junior basketball players: the predictive value of anthropometrics and power qualities.

PubMed

Sisic, Nedim; Jelicic, Mario; Pehar, Miran; Spasic, Miodrag; Sekulic, Damir

2016-01-01

In basketball, anthropometric status is an important factor when identifying and selecting talents, while agility is one of the most vital motor performances. The aim of this investigation was to evaluate the influence of anthropometric variables and power capacities on different preplanned agility performances. The participants were 92 high-level, junior-age basketball players (16-17 years of age; 187.6±8.72 cm in body height, 78.40±12.26 kg in body mass), randomly divided into a validation and cross-validation subsample. The predictors set consisted of 16 anthropometric variables, three tests of power-capacities (Sargent-jump, broad-jump and medicine-ball-throw) as predictors. The criteria were three tests of agility: a T-Shape-Test; a Zig-Zag-Test, and a test of running with a 180-degree turn (T180). Forward stepwise multiple regressions were calculated for validation subsamples and then cross-validated. Cross validation included correlations between observed and predicted scores, dependent samples t-test between predicted and observed scores; and Bland Altman graphics. Analysis of the variance identified centres being advanced in most of the anthropometric indices, and medicine-ball-throw (all at P<0.05); with no significant between-position-differences for other studied motor performances. Multiple regression models originally calculated for the validation subsample were then cross-validated, and confirmed for Zig-zag-Test (R of 0.71 and 0.72 for the validation and cross-validation subsample, respectively). Anthropometrics were not strongly related to agility performance, but leg length is found to be negatively associated with performance in basketball-specific agility. Power capacities are confirmed to be an important factor in agility. The results highlighted the importance of sport-specific tests when studying pre-planned agility performance in basketball. The improvement in power capacities will probably result in an improvement in agility in basketball athletes, while anthropometric indices should be used in order to identify those athletes who can achieve superior agility performance.

Sources of Intrusions in Children’s Dietary Recalls from a Validation Study of Order Prompts

PubMed Central

Baxter, Suzanne Domel; Hardin, James W.; Royer, Julie A.; Smith, Albert F.; Guinn, Caroline H.

2008-01-01

Validation-study data and foodservice production records were analyzed to test hypotheses concerning sources of intrusions (reports of uneaten items) in the school-meal parts of children’s dietary recalls. Each child was observed eating school meals on two days, and interviewed the morning after each observation day; one interview used forward-order (morning-to-evening) and one used reverse-order (evening-to-morning) prompts. Lunch intrusions were likelier to have been available in the foodservice environment at lunch as day before the interview came closer, and on days before than after the interview. Temporal dating errors are contributing sources of intrusions in the school-lunch parts of children’s recalls. PMID:18987088

Validity and Reliability of Accelerometers in Patients With COPD: A SYSTEMATIC REVIEW.

PubMed

Gore, Shweta; Blackwood, Jennifer; Guyette, Mary; Alsalaheen, Bara

2018-05-01

Reduced physical activity is associated with poor prognosis in chronic obstructive pulmonary disease (COPD). Accelerometers have greatly improved quantification of physical activity by providing information on step counts, body positions, energy expenditure, and magnitude of force. The purpose of this systematic review was to compare the validity and reliability of accelerometers used in patients with COPD. An electronic database search of MEDLINE and CINAHL was performed. Study quality was assessed with the Strengthening the Reporting of Observational Studies in Epidemiology checklist while methodological quality was assessed using the modified Quality Appraisal Tool for Reliability Studies. The search yielded 5392 studies; 25 met inclusion criteria. The SenseWear Pro armband reported high criterion validity under controlled conditions (r = 0.75-0.93) and high reliability (ICC = 0.84-0.86) for step counts. The DynaPort MiniMod demonstrated highest concurrent validity for step count using both video and manual methods. Validity of the SenseWear Pro armband varied between studies especially in free-living conditions, slower walking speeds, and with addition of weights during gait. A high degree of variability was found in the outcomes used and statistical analyses performed between studies, indicating a need for further studies to measure reliability and validity of accelerometers in COPD. The SenseWear Pro armband is the most commonly used accelerometer in COPD, but measurement properties are limited by gait speed variability and assistive device use. DynaPort MiniMod and Stepwatch accelerometers demonstrated high validity in patients with COPD but lack reliability data.

Evaluation of Two Observational Assessment Systems for Children's Development and Learning

ERIC Educational Resources Information Center

Kim, Do-Hong; Smith, JaneDiane

2010-01-01

This study provided preliminary evidence for the reliability and validity of "Teaching Strategies GOLD", a recently developed observational system for assessing young children's development and learning. The measurement properties of "Teaching Strategies GOLD" were compared with those of an older instrument, "The Creative…

Development and validation of a tool to evaluate the quality of medical education websites in pathology

PubMed Central

Alyusuf, Raja H.; Prasad, Kameshwar; Abdel Satir, Ali M.; Abalkhail, Ali A.; Arora, Roopa K.

2013-01-01

Background: The exponential use of the internet as a learning resource coupled with varied quality of many websites, lead to a need to identify suitable websites for teaching purposes. Aim: The aim of this study is to develop and to validate a tool, which evaluates the quality of undergraduate medical educational websites; and apply it to the field of pathology. Methods: A tool was devised through several steps of item generation, reduction, weightage, pilot testing, post-pilot modification of the tool and validating the tool. Tool validation included measurement of inter-observer reliability; and generation of criterion related, construct related and content related validity. The validated tool was subsequently tested by applying it to a population of pathology websites. Results and Discussion: Reliability testing showed a high internal consistency reliability (Cronbach's alpha = 0.92), high inter-observer reliability (Pearson's correlation r = 0.88), intraclass correlation coefficient = 0.85 and κ =0.75. It showed high criterion related, construct related and content related validity. The tool showed moderately high concordance with the gold standard (κ =0.61); 92.2% sensitivity, 67.8% specificity, 75.6% positive predictive value and 88.9% negative predictive value. The validated tool was applied to 278 websites; 29.9% were rated as recommended, 41.0% as recommended with caution and 29.1% as not recommended. Conclusion: A systematic tool was devised to evaluate the quality of websites for medical educational purposes. The tool was shown to yield reliable and valid inferences through its application to pathology websites. PMID:24392243

Assessing treatment effects in older breast cancer patients: systematic review of observational research methods.

PubMed

de Glas, N A; Kiderlen, M; de Craen, A J M; Hamaker, M E; Portielje, J E A; van de Velde, C J H; Liefers, G J; Bastiaannet, E

2015-03-01

Solid evidence of treatment effects in older women with breast cancer is lacking, as they are generally underrepresented in randomized clinical trials on which guideline recommendations are based. An alternative way to study treatment effects in older patients could be to use data from observational studies. However, using appropriate methods in analyzing observational data is a key condition in order to draw valid conclusions, as directly comparing treatments generally results in biased estimates due to confounding by indication. The aim of this systematic review was to investigate the methods that have been used in observational studies that assessed the effects of breast cancer treatment on survival, breast cancer survival and recurrence in older patients (aged 65 years and older). Studies were identified through systematic review of the literature published between January 1st 2009 and December 13th 2013 in the PubMed database and EMBASe. Finally, 31 studies fulfilled the inclusion criteria. Of these, 22 studies directly compared two treatments. Fifteen out of these 22 studies addressed the problem of confounding by indication, while seven studies did not. Nine studies used some form of instrumental variable analysis. In conclusion, the vast majority of observational studies that investigate treatment effects in older breast cancer patients compared treatments directly. These studies are therefore likely to be biased. Observational research will be essential to improve treatment and outcome of older breast cancer patients, but the use of accurate methods is essential to draw valid conclusions from this type of data. Copyright © 2015 Elsevier Ltd. All rights reserved.

Development of a new instrument for determining the level of chewing function in children.

PubMed

Serel Arslan, S; Demir, N; Barak Dolgun, A; Karaduman, A A

2016-07-01

This study aimed to develop a chewing performance scale that classifies chewing from normal to severely impaired and to investigate its validity and reliability. The study included the developmental phase and reported the content, structural, criterion validity, interobserver and intra-observer reliability of the chewing performance scale, which was called the Karaduman Chewing Performance Scale (KCPS). A dysphagia literature review, other questionnaires and clinical experiences were used in the developmental phase. Seven experts assessed the steps for content validity over two Delphi rounds. To test structural, criterion validity, interobserver and intra-observer reliability, two swallowing therapists evaluated chewing videos of 144 children (Group I: 61 healthy children without chewing disorders, mean age of 42·38 ± 9·36 months; Group II: 83 children with cerebral palsy who have chewing disorders, mean age of 39·09 ± 22·95 months) using KCPS. The Behavioral Pediatrics Feeding Assessment Scale (BPFAS) was used for criterion validity. The KCPS steps arranged between 0-4 were found to be necessary. The content validity index was 0·885. The KCPS levels were found to be different between groups I and II (χ(2) = 123·286, P < 0·001). A moderately strong positive correlation was found between the KCPS and the subscales of the BPFAS (r = 0·444-0·773, P < 0·001). An excellent positive correlation was detected between two swallowing therapists and between two examinations of one swallowing therapist (r = 0·962, P < 0·001; r = 0·990, P < 0·001, respectively). The KCPS is a valid, reliable, quick and clinically easy-to-use functional instrument for determining the level of chewing function in children. © 2016 John Wiley & Sons Ltd.

DNA methylation array analysis identifies breast cancer associated RPTOR, MGRN1 and RAPSN hypomethylation in peripheral blood DNA.

PubMed

Tang, Qiuqiong; Holland-Letz, Tim; Slynko, Alla; Cuk, Katarina; Marme, Frederik; Schott, Sarah; Heil, Jörg; Qu, Bin; Golatta, Michael; Bewerunge-Hudler, Melanie; Sutter, Christian; Surowy, Harald; Wappenschmidt, Barbara; Schmutzler, Rita; Hoth, Markus; Bugert, Peter; Bartram, Claus R; Sohn, Christof; Schneeweiss, Andreas; Yang, Rongxi; Burwinkel, Barbara

2016-09-27

DNA methylation changes in peripheral blood DNA have been shown to be associated with solid tumors. We sought to identify methylation alterations in whole blood DNA that are associated with breast cancer (BC). Epigenome-wide DNA methylation profiling on blood DNA from BC cases and healthy controls was performed by applying Infinium HumanMethylation450K BeadChips. Promising CpG sites were selected and validated in three independent larger sample cohorts via MassARRAY EpiTyper assays. CpG sites located in three genes (cg06418238 in RPTOR, cg00736299 in MGRN1 and cg27466532 in RAPSN), which showed significant hypomethylation in BC patients compared to healthy controls in the discovery cohort (p < 1.00 x 10-6) were selected and successfully validated in three independent cohorts (validation I, n =211; validation II, n=378; validation III, n=520). The observed methylation differences are likely not cell-type specific, as the differences were only seen in whole blood, but not in specific sub cell-types of leucocytes. Moreover, we observed in quartile analysis that women in the lower methylation quartiles of these three loci had higher ORs than women in the higher quartiles. The combined AUC of three loci was 0.79 (95%CI 0.73-0.85) in validation cohort I, and was 0.60 (95%CI 0.54-0.66) and 0.62 (95%CI 0.57-0.67) in validation cohort II and III, respectively. Our study suggests that hypomethylation of CpG sites in RPTOR, MGRN1 and RAPSN in blood is associated with BC and might serve as blood-based marker supplements for BC if these could be verified in prospective studies.

Teaching Play Skills to Children with Autism through Video Modeling: Small Group Arrangement and Observational Learning

ERIC Educational Resources Information Center

Ozen, Arzu; Batu, Sema; Birkan, Binyamin

2012-01-01

The purpose of the present study was to examine if video modeling was an effective way of teaching sociodramatic play skills to individuals with autism in a small group arrangement. Besides maintenance, observational learning and social validation data were collected. Three 9 year old boys with autism participated in the study. Multiple probe…

The Development, Validation, and Reliability of SAM: A Tool for Measurement of Moderate to Vigorous Physical Activity in School Physical Education

ERIC Educational Resources Information Center

Surapiboonchai, Kampol

2010-01-01

There is a lack of valid and reliable low cost observational instruments to measure moderate to vigorous physical activity (MVPA) in school physical education (PE). The participants in this study were third to tenth grade boys and girls from a south Texas school district. The SAM (Simple Activity Measurement) activity levels were compared with…

Validation of the Actigraph GT3X and ActivPAL Accelerometers for the Assessment of Sedentary Behavior

ERIC Educational Resources Information Center

Kim, Youngdeok; Barry, Vaughn W.; Kang, Minsoo

2015-01-01

This study examined (a) the validity of two accelerometers (ActiGraph GT3X [ActiGraph LLC, Pensacola, FL, USA] and activPAL [PAL Technologies Ltd., Glasgow, Scotland]) for the assessment of sedentary behavior; and (b) the variations in assessment accuracy by setting minimum sedentary bout durations against a proxy for direct observation using an…

Reliability and Validity of a New Physical Activity Self-Report Measure for Younger Children

ERIC Educational Resources Information Center

Belton, Sarahjane; Mac Donncha, Ciaran

2010-01-01

The purpose of this study was to assess the test-retest reliability and validity of a new Youth Physical Activity Self-Report measure. Heart rate and direct observation were employed as criterion measures with a sample of 79 children (aged 7-9 years). Spearman's rho correlation between self reported activity intensity and heart rate was 0.87 for…

Relation between Direct Observation of Relaxation and Self-Reported Mindfulness and Relaxation States

ERIC Educational Resources Information Center

Hites, Lacey S.; Lundervold, Duane A.

2013-01-01

Forty-four individuals, 18-47 (MN 21.8, SD 5.63) years of age, took part in a study examining the magnitude and direction of the relationship between self-report and direct observation measures of relaxation and mindfulness. The Behavioral Relaxation Scale (BRS), a valid direct observation measure of relaxation, was used to assess relaxed behavior…

Factor Structure and Validity of the Therapy Process Observational Coding System for Child Psychotherapy--Alliance Scale

ERIC Educational Resources Information Center

Fjermestad, Krister W.; McLeod, Bryce D.; Heiervang, Einar R.; Havik, Odd E.; Ost, Lars-Goran; Haugland, Bente S. M.

2012-01-01

The aim of this study was to examine the factor structure and psychometric properties of an observer-rated youth alliance measure, the Therapy Process Observational Coding System for Child Psychotherapy-Alliance scale (TPOCS-A). The sample was 52 youth diagnosed with anxiety disorders ("M" age = 12.43, "SD" = 2.23, range = 15;…

[Desing and validation of a scale to measure caregiving dedication in caregivers of dependent older people].

PubMed

Serrano-Ortega, Natalia; Frías-Osuna, Antonio; Recio-Gómez, Juan M; Del-Pino-Casado, Rafael

2015-11-01

To develop and validate a scale to measure caregiving dedication regarding activities of daily living in caregivers of dependent older people. Cross-sectional study. Primary Health Care (Andalusia, Spain). a probabilistic sample of 200 caregivers of older relatives from Córdoba, Spain. Content validation by experts, construct validity (by exploratory factor analysis), divergent validity and reliability (internal consistency, test-retest reliability and inter-observers reliability). Cronbach's alpha was 0.86. Intraclass Correlation Coefficient was 0.96 for test-retest reliability and 0.88 for inter-observers reliability. When the sample was divided in two groups according to perceived burden level (presence and absence), the perceived burden was significantly different in each group (P=.001). The factor analysis revealed one only factor that explained 64% of the variance. The scale allows a suitable measure of caregiving dedication regarding activities of daily living in caregivers of older people, because this scale allows a quickly, easy administration, is well accepted by caregivers, has acceptable psychometric results and includes the frequency of caregiving, the kind of attended need and the dependence level in each need. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

A Structured Clinical Interview for Kleptomania (SCI-K): preliminary validity and reliability testing.

PubMed

Grant, Jon E; Kim, Suck Won; McCabe, James S

2006-06-01

Kleptomania presents difficulties in diagnosis for clinicians. This study aimed to develop and test a DSM-IV-based diagnostic instrument for kleptomania. To assess for current kleptomania the Structured Clinical Interview for Kleptomania (SCI-K) was administered to 112 consecutive subjects requesting psychiatric outpatient treatment for a variety of disorders. Reliability and validity were determined. Classification accuracy was examined using the longitudinal course of illness. The SCI-K demonstrated excellent test-retest (Phi coefficient = 0.956 (95% CI = 0.937, 0.970)) and inter-rater reliability (phi coefficient = 0.718 (95% CI = 0.506, 0.848)) in the diagnosis of kleptomania. Concurrent validity was observed with a self-report measure using DSM-IV kleptomania criteria (phi coefficient = 0.769 (95% CI = 0.653, 0.850)). Discriminant validity was observed with a measure of depression (point biserial coefficient = -0.020 (95% CI = -0.205, 0.166)). The SCI-K demonstrated both high sensitivity and specificity based on longitudinal assessment. The SCI-K demonstrated excellent reliability and validity in diagnosing kleptomania in subjects presenting with various psychiatric problems. These findings require replication in larger groups, including non-psychiatric populations, to examine their generalizability. Copyright (c) 2006 John Wiley & Sons, Ltd.

Systematic review of methods for quantifying teamwork in the operating theatre

PubMed Central

Marshall, D.; Sykes, M.; McCulloch, P.; Shalhoub, J.; Maruthappu, M.

2018-01-01

Background Teamwork in the operating theatre is becoming increasingly recognized as a major factor in clinical outcomes. Many tools have been developed to measure teamwork. Most fall into two categories: self‐assessment by theatre staff and assessment by observers. A critical and comparative analysis of the validity and reliability of these tools is lacking. Methods MEDLINE and Embase databases were searched following PRISMA guidelines. Content validity was assessed using measurements of inter‐rater agreement, predictive validity and multisite reliability, and interobserver reliability using statistical measures of inter‐rater agreement and reliability. Quantitative meta‐analysis was deemed unsuitable. Results Forty‐eight articles were selected for final inclusion; self‐assessment tools were used in 18 and observational tools in 28, and there were two qualitative studies. Self‐assessment of teamwork by profession varied with the profession of the assessor. The most robust self‐assessment tool was the Safety Attitudes Questionnaire (SAQ), although this failed to demonstrate multisite reliability. The most robust observational tool was the Non‐Technical Skills (NOTECHS) system, which demonstrated both test–retest reliability (P > 0·09) and interobserver reliability (Rwg = 0·96). Conclusion Self‐assessment of teamwork by the theatre team was influenced by professional differences. Observational tools, when used by trained observers, circumvented this.

Effects of Including Misidentified Sharks in Life History Analyses: A Case Study on the Grey Reef Shark Carcharhinus amblyrhynchos from Papua New Guinea

PubMed Central

Smart, Jonathan J.; Chin, Andrew; Baje, Leontine; Green, Madeline E.; Appleyard, Sharon A.; Tobin, Andrew J.; Simpfendorfer, Colin A.; White, William T.

2016-01-01

Fisheries observer programs are used around the world to collect crucial information and samples that inform fisheries management. However, observer error may misidentify similar-looking shark species. This raises questions about the level of error that species misidentifications could introduce to estimates of species’ life history parameters. This study addressed these questions using the Grey Reef Shark Carcharhinus amblyrhynchos as a case study. Observer misidentification rates were quantified by validating species identifications using diagnostic photographs taken on board supplemented with DNA barcoding. Length-at-age and maturity ogive analyses were then estimated and compared with and without the misidentified individuals. Vertebrae were retained from a total of 155 sharks identified by observers as C. amblyrhynchos. However, 22 (14%) of these were sharks were misidentified by the observers and were subsequently re-identified based on photographs and/or DNA barcoding. Of the 22 individuals misidentified as C. amblyrhynchos, 16 (73%) were detected using photographs and a further 6 via genetic validation. If misidentified individuals had been included, substantial error would have been introduced to both the length-at-age and the maturity estimates. Thus validating the species identification, increased the accuracy of estimated life history parameters for C. amblyrhynchos. From the corrected sample a multi-model inference approach was used to estimate growth for C. amblyrhynchos using three candidate models. The model averaged length-at-age parameters for C. amblyrhynchos with the sexes combined were  L¯∞ = 159 cm TL and  L¯0 = 72 cm TL. Females mature at a greater length (l50 = 136 cm TL) and older age (A50 = 9.1 years) than males (l50 = 123 cm TL; A50 = 5.9 years). The inclusion of techniques to reduce misidentification in observer programs will improve the results of life history studies and ultimately improve management through the use of more accurate data for assessments. PMID:27058734

Effects of Including Misidentified Sharks in Life History Analyses: A Case Study on the Grey Reef Shark Carcharhinus amblyrhynchos from Papua New Guinea.

PubMed

Smart, Jonathan J; Chin, Andrew; Baje, Leontine; Green, Madeline E; Appleyard, Sharon A; Tobin, Andrew J; Simpfendorfer, Colin A; White, William T

2016-01-01

Fisheries observer programs are used around the world to collect crucial information and samples that inform fisheries management. However, observer error may misidentify similar-looking shark species. This raises questions about the level of error that species misidentifications could introduce to estimates of species' life history parameters. This study addressed these questions using the Grey Reef Shark Carcharhinus amblyrhynchos as a case study. Observer misidentification rates were quantified by validating species identifications using diagnostic photographs taken on board supplemented with DNA barcoding. Length-at-age and maturity ogive analyses were then estimated and compared with and without the misidentified individuals. Vertebrae were retained from a total of 155 sharks identified by observers as C. amblyrhynchos. However, 22 (14%) of these were sharks were misidentified by the observers and were subsequently re-identified based on photographs and/or DNA barcoding. Of the 22 individuals misidentified as C. amblyrhynchos, 16 (73%) were detected using photographs and a further 6 via genetic validation. If misidentified individuals had been included, substantial error would have been introduced to both the length-at-age and the maturity estimates. Thus validating the species identification, increased the accuracy of estimated life history parameters for C. amblyrhynchos. From the corrected sample a multi-model inference approach was used to estimate growth for C. amblyrhynchos using three candidate models. The model averaged length-at-age parameters for C. amblyrhynchos with the sexes combined were L∞ = 159 cm TL and L0 = 72 cm TL. Females mature at a greater length (l50 = 136 cm TL) and older age (A50 = 9.1 years) than males (l50 = 123 cm TL; A50 = 5.9 years). The inclusion of techniques to reduce misidentification in observer programs will improve the results of life history studies and ultimately improve management through the use of more accurate data for assessments.

Meeting Report: Long Term Monitoring of Global Vegetation using Moderate Resolution Satellites

NASA Technical Reports Server (NTRS)

Morisette, Jeffrey; Heinsch, Fath Ann; Running, Steven W.

2006-01-01

The international community has long recognized the need to coordinate observations of Earth from space. In 1984, this situation provided the impetus for creating the Committee on Earth Observation Satellites (CEOS), an international coordinating mechanism charged with coordinating international civil spaceborne missions designed to observe and study planet Earth. Within CEOS, its Working Group on Calibration and Validation (WGCV) is tasked with coordinating satellite-based global observations of vegetation. Currently, several international organizations are focusing on the requirements for Earth observation from space to address key science questions and societal benefits related to our terrestrial environment. The Global Vegetation Workshop, sponsored by the WGCV and held in Missoula, Montana, 7-10 August, 2006, was organized to establish a framework to understand the inter-relationships among multiple, global vegetation products and identify opportunities for: 1) Increasing knowledge through combined products, 2) Realizing efficiency by avoiding redundancy, and 3) Developing near- and long-term plans to avoid gaps in our understanding of critical global vegetation information. The Global Vegetation Workshop brought together 135 researchers from 25 states and 14 countries to advance these themes and formulate recommendations for CEOS members and the Global Earth Observation System of Systems (GEOSS). The eighteen oral presentations and most of the 74 posters presented at the meeting can be downloaded from the meeting website (www.ntsg.umt.edu/VEGMTG/). Meeting attendees were given a copy of the July 2006 IEEE Transactions on Geoscience and Remote Sensing Special Issue on Global Land Product Validation, coordinated by the CEOS Working Group on Calibration and Validation (WGCV). This issue contains 29 articles focusing on validation products from several of the sensors discussed during the workshop.

External validation and comparison of three prediction tools for risk of osteoporotic fractures using data from population based electronic health records: retrospective cohort study

PubMed Central

Cohen-Stavi, Chandra; Leventer-Roberts, Maya; Balicer, Ran D

2017-01-01

Objective To directly compare the performance and externally validate the three most studied prediction tools for osteoporotic fractures—QFracture, FRAX, and Garvan—using data from electronic health records. Design Retrospective cohort study. Setting Payer provider healthcare organisation in Israel. Participants 1 054 815 members aged 50 to 90 years for comparison between tools and cohorts of different age ranges, corresponding to those in each tools’ development study, for tool specific external validation. Main outcome measure First diagnosis of a major osteoporotic fracture (for QFracture and FRAX tools) and hip fractures (for all three tools) recorded in electronic health records from 2010 to 2014. Observed fracture rates were compared to probabilities predicted retrospectively as of 2010. Results The observed five year hip fracture rate was 2.7% and the rate for major osteoporotic fractures was 7.7%. The areas under the receiver operating curve (AUC) for hip fracture prediction were 82.7% for QFracture, 81.5% for FRAX, and 77.8% for Garvan. For major osteoporotic fractures, AUCs were 71.2% for QFracture and 71.4% for FRAX. All the tools underestimated the fracture risk, but the average observed to predicted ratios and the calibration slopes of FRAX were closest to 1. Tool specific validation analyses yielded hip fracture prediction AUCs of 88.0% for QFracture (among those aged 30-100 years), 81.5% for FRAX (50-90 years), and 71.2% for Garvan (60-95 years). Conclusions Both QFracture and FRAX had high discriminatory power for hip fracture prediction, with QFracture performing slightly better. This performance gap was more pronounced in previous studies, likely because of broader age inclusion criteria for QFracture validations. The simpler FRAX performed almost as well as QFracture for hip fracture prediction, and may have advantages if some of the input data required for QFracture are not available. However, both tools require calibration before implementation. PMID:28104610

Validation of Modelled Ice Dynamics of the Greenland Ice Sheet using Historical Forcing

NASA Astrophysics Data System (ADS)

Hoffman, M. J.; Price, S. F.; Howat, I. M.; Bonin, J. A.; Chambers, D. P.; Tezaur, I.; Kennedy, J. H.; Lenaerts, J.; Lipscomb, W. H.; Neumann, T.; Nowicki, S.; Perego, M.; Saba, J. L.; Salinger, A.; Guerber, J. R.

2015-12-01

Although ice sheet models are used for sea level rise projections, the degree to which these models have been validated by observations is fairly limited, due in part to the limited duration of the satellite observation era and the long adjustment time scales of ice sheets. Here we describe a validation framework for the Greenland Ice Sheet applied to the Community Ice Sheet Model by forcing the model annually with flux anomalies at the major outlet glaciers (Enderlin et al., 2014, observed from Landsat/ASTER/Operation IceBridge) and surface mass balance (van Angelen et al., 2013, calculated from RACMO2) for the period 1991-2012. The ice sheet model output is compared to ice surface elevation observations from ICESat and ice sheet mass change observations from GRACE. Early results show promise for assessing the performance of different model configurations. Additionally, we explore the effect of ice sheet model resolution on validation skill.

Alternating Renewal Process Models for Behavioral Observation: Simulation Methods, Software, and Validity Illustrations

ERIC Educational Resources Information Center

Pustejovsky, James E.; Runyon, Christopher

2014-01-01

Direct observation recording procedures produce reductive summary measurements of an underlying stream of behavior. Previous methodological studies of these recording procedures have employed simulation methods for generating random behavior streams, many of which amount to special cases of a statistical model known as the alternating renewal…

Measuring Afterschool Program Quality Using Setting-Level Observational Approaches

ERIC Educational Resources Information Center

Oh, Yoonkyung; Osgood, D. Wayne; Smith, Emilie P.

2015-01-01

The importance of afterschool hours for youth development is widely acknowledged, and afterschool settings have recently received increasing attention as an important venue for youth interventions, bringing a growing need for reliable and valid measures of afterschool quality. This study examined the extent to which the two observational tools,…

Assessing Peer Entry and Play in Preschoolers at Risk for Maladjustment

ERIC Educational Resources Information Center

Brotman, Laurie Miller; Gouley, Kathleen Kiely; Chesir-Teran, Daniel

2005-01-01

This study evaluated the psychometric properties of an observational rating system for assessing preschoolers' peer entry and play skills: Observed Peer Play in Unfamiliar Settings (OPPUS). Participants were 84 preschoolers at risk for psychopathology. Reliability and concurrent validity are reported. The 30-min paradigm yielded reliable indexes…

Construct Validity and Reliability of the SARA Gait and Posture Sub-scale in Early Onset Ataxia

PubMed Central

Lawerman, Tjitske F.; Brandsma, Rick; Verbeek, Renate J.; van der Hoeven, Johannes H.; Lunsing, Roelineke J.; Kremer, Hubertus P. H.; Sival, Deborah A.

2017-01-01

Aim: In children, gait and posture assessment provides a crucial marker for the early characterization, surveillance and treatment evaluation of early onset ataxia (EOA). For reliable data entry of studies targeting at gait and posture improvement, uniform quantitative biomarkers are necessary. Until now, the pediatric test construct of gait and posture scores of the Scale for Assessment and Rating of Ataxia sub-scale (SARA) is still unclear. In the present study, we aimed to validate the construct validity and reliability of the pediatric (SARAGAIT/POSTURE) sub-scale. Methods: We included 28 EOA patients [15.5 (6–34) years; median (range)]. For inter-observer reliability, we determined the ICC on EOA SARAGAIT/POSTURE sub-scores by three independent pediatric neurologists. For convergent validity, we associated SARAGAIT/POSTURE sub-scores with: (1) Ataxic gait Severity Measurement by Klockgether (ASMK; dynamic balance), (2) Pediatric Balance Scale (PBS; static balance), (3) Gross Motor Function Classification Scale -extended and revised version (GMFCS-E&R), (4) SARA-kinetic scores (SARAKINETIC; kinetic function of the upper and lower limbs), (5) Archimedes Spiral (AS; kinetic function of the upper limbs), and (6) total SARA scores (SARATOTAL; i.e., summed SARAGAIT/POSTURE, SARAKINETIC, and SARASPEECH sub-scores). For discriminant validity, we investigated whether EOA co-morbidity factors (myopathy and myoclonus) could influence SARAGAIT/POSTURE sub-scores. Results: The inter-observer agreement (ICC) on EOA SARAGAIT/POSTURE sub-scores was high (0.97). SARAGAIT/POSTURE was strongly correlated with the other ataxia and functional scales [ASMK (rs = -0.819; p < 0.001); PBS (rs = -0.943; p < 0.001); GMFCS-E&R (rs = -0.862; p < 0.001); SARAKINETIC (rs = 0.726; p < 0.001); AS (rs = 0.609; p = 0.002); and SARATOTAL (rs = 0.935; p < 0.001)]. Comorbid myopathy influenced SARAGAIT/POSTURE scores by concurrent muscle weakness, whereas comorbid myoclonus predominantly influenced SARAKINETIC scores. Conclusion: In young EOA patients, separate SARAGAIT/POSTURE parameters reveal a good inter-observer agreement and convergent validity, implicating the reliability of the scale. In perspective of incomplete discriminant validity, it is advisable to interpret SARAGAIT/POSTURE scores for comorbid muscle weakness. PMID:29326569

Guidance for Use When Regurgitation is Observed in Avian Acute Toxicity Studies with Passerine Species

EPA Pesticide Factsheets

Guidance based on comparison of results from the TG223 validation studies to results from avian acute oral studies previously submitted to EPA for two test chemicals following EPA's 850.2100 (public draft) guidelines.

Development of reference practices for the calibration and validation of atmospheric composition satellites

NASA Astrophysics Data System (ADS)

Lambert, Jean-Christopher; Bojkov, Bojan

The Committee on Earth Observation Satellites (CEOS)/Working Group on Calibration and Validation (WGCV) is developing a global data quality strategy for the Global Earth Obser-vation System of Systems (GEOSS). In this context, CEOS WGCV elaborated the GEOSS Quality Assurance framework for Earth Observation (QA4EO, http://qa4eo.org). QA4EO en-compasses a documentary framework and a set of ten guidelines, which describe the top-level approach of QA activities and key requirements that drive the QA process. QA4EO is appli-cable virtually to all Earth Observation data. Calibration and validation activities are a cornerstone of the GEOSS data quality strategy. Proper uncertainty assessment of the satellite measurements and their derived data products is essential, and needs to be continuously monitored and traceable to standards. As a practical application of QA4EO, CEOS WGCV has undertaken to establish a set of best practices, methodologies and guidelines for satellite calibration and validation. The present paper reviews current developments of best practices and guidelines for the vali-dation of atmospheric composition satellites. Aimed as a community effort, the approach is to start with current practices that could be improved with time. The present review addresses current validation capabilities, achievements, caveats, harmonization efforts, and challenges. Terminologies and general principles of validation are reminded. Going beyond elementary def-initions of validation like the assessment of uncertainties, the specific GEOSS context requires considering also the validation of individual service components and against user requirements.

Validation of the Economic and Health Outcomes Model of Type 2 Diabetes Mellitus (ECHO-T2DM).

PubMed

Willis, Michael; Johansen, Pierre; Nilsson, Andreas; Asseburg, Christian

2017-03-01

The Economic and Health Outcomes Model of Type 2 Diabetes Mellitus (ECHO-T2DM) was developed to address study questions pertaining to the cost-effectiveness of treatment alternatives in the care of patients with type 2 diabetes mellitus (T2DM). Naturally, the usefulness of a model is determined by the accuracy of its predictions. A previous version of ECHO-T2DM was validated against actual trial outcomes and the model predictions were generally accurate. However, there have been recent upgrades to the model, which modify model predictions and necessitate an update of the validation exercises. The objectives of this study were to extend the methods available for evaluating model validity, to conduct a formal model validation of ECHO-T2DM (version 2.3.0) in accordance with the principles espoused by the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the Society for Medical Decision Making (SMDM), and secondarily to evaluate the relative accuracy of four sets of macrovascular risk equations included in ECHO-T2DM. We followed the ISPOR/SMDM guidelines on model validation, evaluating face validity, verification, cross-validation, and external validation. Model verification involved 297 'stress tests', in which specific model inputs were modified systematically to ascertain correct model implementation. Cross-validation consisted of a comparison between ECHO-T2DM predictions and those of the seminal National Institutes of Health model. In external validation, study characteristics were entered into ECHO-T2DM to replicate the clinical results of 12 studies (including 17 patient populations), and model predictions were compared to observed values using established statistical techniques as well as measures of average prediction error, separately for the four sets of macrovascular risk equations supported in ECHO-T2DM. Sub-group analyses were conducted for dependent vs. independent outcomes and for microvascular vs. macrovascular vs. mortality endpoints. All stress tests were passed. ECHO-T2DM replicated the National Institutes of Health cost-effectiveness application with numerically similar results. In external validation of ECHO-T2DM, model predictions agreed well with observed clinical outcomes. For all sets of macrovascular risk equations, the results were close to the intercept and slope coefficients corresponding to a perfect match, resulting in high R 2 and failure to reject concordance using an F test. The results were similar for sub-groups of dependent and independent validation, with some degree of under-prediction of macrovascular events. ECHO-T2DM continues to match health outcomes in clinical trials in T2DM, with prediction accuracy similar to other leading models of T2DM.

OCO-2 Observation and Validation Overview: Observations Data Modes and Target Observations, Taken During the First 15 Months of Operations

NASA Astrophysics Data System (ADS)

Osterman, G. B.; Fisher, B.; Wunch, D.; Eldering, A.; Wennberg, P. O.; Roehl, C. M.; Naylor, B. J.; Lee, R.; Pollock, R.; Gunson, M. R.

2015-12-01

The OCO-2 instrument was successfully launched on July 2, 2014 from Vandenberg Air Force Base in California. The instrument reached its observational orbit about three weeks later. The spacecraft is at the head of the A-train satellites and began collecting operational data on Sept 5, 2014. OCO-2 makes measurements in three modes: nadir, glint and target. Target observations are designed to provide large amounts of data in a small area near a ground validation site. The instruments of the Total Carbon Column Observing Network (TCCON) provide the ground validation data for the OCO-2 XCO2 observations and comparisons to TCCON form the basis of the OCO-2 validation plan. There are now 27 locations at which OCO-2 can perform target observations and CCON sites make up 23 of those possible target locations. For its first year in orbit, OCO-2 operated in nadir mode for 16 days and then in glint mode for 16 days. Each 16-day cycle spans 233 orbits. On July 1, 2015, OCO-2 changed to an observational mode of alternating nadir and glint measurements on an orbit-by-orbit basis. By December 2015, this operational mode may be modified such that orbits that measure only over ocean will always observed in glint mode. In this presentation we will provide information on the observations made by OCO-2 during its first 15 month in operations. We will show maps of the OCO-2 ground tracks and XCO2 data, calendars illustrating the observational schedule and statistics on the target observations taken. We will provide more information on what is involved in making target observations and how it affects the standard operational data acquisition patterns. Changes to the standard observational patterns of OCO-2 and to the list of locations for target observations will be discussed as well. We will provide an overview of some of the validation related analysis being done using nadir and glint mode OCO-2 data in addition to an overview on validation analyses that do not directly utilize TCCON data.

Predictive validity of the Braden Scale, Norton Scale, and Waterlow Scale in the Czech Republic.

PubMed

Šateková, Lenka; Žiaková, Katarína; Zeleníková, Renáta

2017-02-01

The aim of this study was to determine the predictive validity of the Braden, Norton, and Waterlow scales in 2 long-term care departments in the Czech Republic. Assessing the risk for developing pressure ulcers is the first step in their prevention. At present, many scales are used in clinical practice, but most of them have not been properly validated yet (for example, the Modified Norton Scale in the Czech Republic). In the Czech Republic, only the Braden Scale has been validated so far. This is a prospective comparative instrument testing study. A random sample of 123 patients was recruited. The predictive validity of the pressure ulcer risk assessment scales was evaluated based on sensitivity, specificity, positive and negative predictive values, and the area under the receiver operating characteristic curve. The data were collected from April to August 2014. In the present study, the best predictive validity values were observed for the Norton Scale, followed by the Braden Scale and the Waterlow Scale, in that order. We recommended that the above 3 pressure ulcer risk assessment scales continue to be evaluated in the Czech clinical setting. © 2016 John Wiley & Sons Australia, Ltd.

Scrutinizing a Survey-Based Measure of Science and Mathematics Teacher Knowledge: Relationship to Observations of Teaching Practice

NASA Astrophysics Data System (ADS)

Talbot, Robert M.

2017-12-01

There is a clear need for valid and reliable instrumentation that measures teacher knowledge. However, the process of investigating and making a case for instrument validity is not a simple undertaking; rather, it is a complex endeavor. This paper presents the empirical case of one aspect of such an instrument validation effort. The particular instrument under scrutiny was developed in order to determine the effect of a teacher education program on novice science and mathematics teachers' strategic knowledge (SK). The relationship between novice science and mathematics teachers' SK as measured by a survey and their SK as inferred from observations of practice using a widely used observation protocol is the subject of this paper. Moderate correlations between parts of the observation-based construct and the SK construct were observed. However, the main finding of this work is that the context in which the measurement is made (in situ observations vs. ex situ survey) is an essential factor in establishing the validity of the measurement itself.

Is the Scale for Measuring Motivational Interviewing Skills a valid and reliable instrument for measuring the primary care professionals motivational skills?: EVEM study protocol

PubMed Central

2012-01-01

Background Lifestyle is one of the main determinants of people’s health. It is essential to find the most effective prevention strategies to be used to encourage behavioral changes in their patients. Many theories are available that explain change or adherence to specific health behaviors in subjects. In this sense the named Motivational Interviewing has increasingly gained relevance. Few well-validated instruments are available for measuring doctors’ communication skills, and more specifically the Motivational Interviewing. Methods/Design The hypothesis of this study is that the Scale for Measuring Motivational Interviewing Skills (EVEM questionnaire) is a valid and reliable instrument for measuring the primary care professionals skills to get behavior change in patients. To test the hypothesis we have designed a prospective, observational, multi-center study to validate a measuring instrument. –Scope: Thirty-two primary care centers in Spain. -Sampling and Size: a) face and consensual validity: A group composed of 15 experts in Motivational Interviewing. b) Assessment of the psychometric properties of the scale; 50 physician- patient encounters will be videoed; a total of 162 interviews will be conducted with six standardized patients, and another 200 interviews will be conducted with 50 real patients (n=362). Four physicians will be specially trained to assess 30 interviews randomly selected to test the scale reproducibility. -Measurements for to test the hypothesis: a) Face validity: development of a draft questionnaire based on a theoretical model, by using Delphi-type methodology with experts. b) Scale psychometric properties: intraobservers will evaluate video recorded interviews: content-scalability validity (Exploratory Factor Analysis), internal consistency (Cronbach alpha), intra-/inter-observer reliability (Kappa index, intraclass correlation coefficient, Bland & Altman methodology), generalizability, construct validity and sensitivity to change (Pearson product–moment correlation coefficient). Discussion The verification of the hypothesis that EVEM is a valid and reliable tool for assessing motivational interviewing would be a major breakthrough in the current theoretical and practical knowledge, as it could be used to assess if the providers put into practice a patient centered communication style and can be used both for training or researching purposes. Trials registration Dislip-EM study NCT01282190 (ClinicalTrials.gov) PMID:23173902

Partial validation of the Dutch model for emission and transport of nutrients (STONE).

PubMed

Overbeek, G B; Tiktak, A; Beusen, A H; van Puijenbroek, P J

2001-11-17

The Netherlands has to cope with large losses of N and P to groundwater and surface water. Agriculture is the dominant source of these nutrients, particularly with reference to nutrient excretion due to intensive animal husbandry in combination with fertilizer use. The Dutch government has recently launched a stricter eutrophication abatement policy to comply with the EC nitrate directive. The Dutch consensus model for N and P emission to groundwater and surface water (STONE) has been developed to evaluate the environmental benefits of abatement plans. Due to the possibly severe socioeconomic consequences of eutrophication abatement plans, it is of utmost importance that the model is thoroughly validated. Because STONE is applied on a nationwide scale, the model validation has also been carried out on this scale. For this purpose the model outputs were compared with lumped results from monitoring networks in the upper groundwater and in surface waters. About 13,000 recent point source observations of nitrate in the upper groundwater were available, along with several hundreds of observations showing N and P in local surface water systems. Comparison of observations from the different spatial scales available showed the issue of scale to be important. Scale issues will be addressed in the next stages of the validation study.

Invited Commentary: Beware the Test-Negative Design.

PubMed

Westreich, Daniel; Hudgens, Michael G

2016-09-01

In this issue of the Journal, Sullivan et al. (Am J Epidemiol. 2016;184(5):345-353) carefully examine the theoretical justification for use of the test-negative design, a common observational study design, in assessing the effectiveness of influenza vaccination. Using modern causal inference methods (in particular, directed acyclic graphs), they describe different threats to the validity of inferences drawn about the effect of vaccination from test-negative design studies. These threats include confounding, selection bias, and measurement error in either the exposure or the outcome. While confounding and measurement error are common in observational studies, the potential for selection bias inherent in the test-negative design brings into question the validity of inferences drawn from such studies. © The Author 2016. Published by Oxford University Press on behalf of the Johns Hopkins Bloomberg School of Public Health. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.

Validity and reliability of the Fitbit Zip as a measure of preschool children’s step count

PubMed Central

Sharp, Catherine A; Mackintosh, Kelly A; Erjavec, Mihela; Pascoe, Duncan M; Horne, Pauline J

2017-01-01

Objectives Validation of physical activity measurement tools is essential to determine the relationship between physical activity and health in preschool children, but research to date has not focused on this priority. The aims of this study were to ascertain inter-rater reliability of observer step count, and interdevice reliability and validity of Fitbit Zip accelerometer step counts in preschool children. Methods Fifty-six children aged 3–4 years (29 girls) recruited from 10 nurseries in North Wales, UK, wore two Fitbit Zip accelerometers while performing a timed walking task in their childcare settings. Accelerometers were worn in secure pockets inside a custom-made tabard. Video recordings enabled two observers to independently code the number of steps performed in 3 min by each child during the walking task. Intraclass correlations (ICCs), concordance correlation coefficients, Bland-Altman plots and absolute per cent error were calculated to assess the reliability and validity of the consumer-grade device. Results An excellent ICC was found between the two observer codings (ICC=1.00) and the two Fitbit Zips (ICC=0.91). Concordance between the Fitbit Zips and observer counts was also high (r=0.77), with an acceptable absolute per cent error (6%–7%). Bland-Altman analyses identified a bias for Fitbit 1 of 22.8±19.1 steps with limits of agreement between −14.7 and 60.2 steps, and a bias for Fitbit 2 of 25.2±23.2 steps with limits of agreement between −20.2 and 70.5 steps. Conclusions Fitbit Zip accelerometers are a reliable and valid method of recording preschool children’s step count in a childcare setting. PMID:29081984

Validation of the school lunch recall questionnaire to capture school lunch intake of third- to fifth-grade students.

PubMed

Paxton, Amy; Baxter, Suzanne Domel; Fleming, Phyllis; Ammerman, Alice

2011-03-01

Children's dietary intake is a key variable in evaluations of school-based interventions. Current methods for assessing children's intake, such as 24-hour recalls and meal observations, are time- and resource-intensive. As part of a study to evaluate the impact of farm-to-school programs, the school lunch recall was developed from a need for a valid and efficient tool to assess school lunch intake among large samples of children. A self-administered paper-and-pencil questionnaire, the school lunch recall prompts for school lunch items by asking children whether they chose a menu item, how much of it they ate, how much they liked it, and whether they would choose it again. The school lunch recall was validated during summer school in 2008 with 18 third- to fifth-grade students (8 to 11 years old) in a North Carolina elementary school. For 4 consecutive days, trained observers recorded foods and amounts students ate during school lunch. Students completed the school lunch recall immediately after lunch. Thirty-seven total observation school lunch recall sets were analyzed. Comparison of school lunch recalls against observations indicated high accuracy, with means of 6% for omission rate (items observed but unreported), 10% for intrusion rate (items unobserved but reported), and 0.63 servings for total inaccuracy (a measure that combines errors for reporting items and amounts). For amounts, accuracy was high for matches (0.06 and 0.01 servings for absolute and arithmetic differences, respectively) but lower for omissions (0.47 servings) and intrusions (0.54 servings). In this pilot study, the school lunch recall was a valid, efficient tool for assessing school lunch intake for a small sample of third- to fifth-grade students. Copyright © 2011 American Dietetic Association. Published by Elsevier Inc. All rights reserved.

Validation of the Andon KD5031 for clinical use and self-measurement according to the European Society of Hypertension International Protocol.

PubMed

Wu, Ning; Zhang, Xuezhong; Wang, Wen; Zhang, Hongye

2016-10-01

This study aimed to evaluate the accuracy of the automated oscillometric upper arm blood pressure (BP) monitor Andon KD5031 for home BP monitoring according to the European Society of Hypertension International Protocol revision 2010. Systolic blood pressure (SBP) and diastolic blood pressure (DBP) were sequentially measured in 33 participants using the standard mercury sphygmomanometer and the Andon KD5031 device. Ninety-nine pairs of comparisons were obtained from 33 participants for analysis. The KD5031 device achieved the targets in part 1 of the validation study. The number of absolute differences between the device and the observers within a range of 5, 10, and 15 mmHg was 66/99, 93/99, and 98/99, respectively, for SBP and 72/99, 94/99, and 99/99, respectively, for DBP. The device also achieved the targets in part 2 of the validation study. Twenty-six participants for both SBP and DBP had at least two of the three device-observer differences within 5 mmHg (required ≥24). The number of participants without a device-observer difference within 5 mmHg was one for SBP and three for DBP (required ≤3). The Andon upper arm BP monitor KD5031 has passed the International Protocol requirements, and it can be recommended for clinical use and self-measurement in adults.

Validation of the Andon KD595 for clinical use and self-measurement according to the European Society of Hypertension International Protocol.

PubMed

Wu, Ning; Zhang, Xuezhong; Wang, Wen; Zhang, Hongye

2016-04-01

This study aimed to evaluate the accuracy of the automated oscillometric upper arm blood pressure monitor Andon KD595 for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010. Systolic blood pressure (SBP) and diastolic blood pressure (DBP) were sequentially measured in 33 participants using the standard mercury sphygmomanometer and the Andon KD595 device. Ninety-nine pairs of comparisons were obtained from 33 participants for analysis. The KD595 device achieved the targets in part 1 of the validation study. The number of absolute differences between the device and the observers within a range of 5, 10, and 15 mmHg was 72/99, 93/99, and 96/99, respectively, for SBP and 72/99, 96/99, and 99/99, respectively, for DBP. The device also achieved the targets in part 2 of the validation study. A total of 28 and 25 participants had at least two of the three device-observer differences within 5 mmHg (required≥24) for SBP and DBP, respectively. The number of participants without device-observer difference within 5 mmHg was two for SBP and two for DBP (required≤3). The Andon upper arm blood pressure monitor KD595 has passed the International Protocol requirements and it can be recommended for clinical use and self-measurement in adults.

Global precipitation measurements for validating climate models

NASA Astrophysics Data System (ADS)

Tapiador, F. J.; Navarro, A.; Levizzani, V.; García-Ortega, E.; Huffman, G. J.; Kidd, C.; Kucera, P. A.; Kummerow, C. D.; Masunaga, H.; Petersen, W. A.; Roca, R.; Sánchez, J.-L.; Tao, W.-K.; Turk, F. J.

2017-11-01

The advent of global precipitation data sets with increasing temporal span has made it possible to use them for validating climate models. In order to fulfill the requirement of global coverage, existing products integrate satellite-derived retrievals from many sensors with direct ground observations (gauges, disdrometers, radars), which are used as reference for the satellites. While the resulting product can be deemed as the best-available source of quality validation data, awareness of the limitations of such data sets is important to avoid extracting wrong or unsubstantiated conclusions when assessing climate model abilities. This paper provides guidance on the use of precipitation data sets for climate research, including model validation and verification for improving physical parameterizations. The strengths and limitations of the data sets for climate modeling applications are presented, and a protocol for quality assurance of both observational databases and models is discussed. The paper helps elaborating the recent IPCC AR5 acknowledgment of large observational uncertainties in precipitation observations for climate model validation.

Using Lunar Observations to Validate In-Flight Calibrations of Clouds and Earth Radiant Energy System Instruments

NASA Technical Reports Server (NTRS)

Daniels, Janet L.; Smith, G. Louis; Priestley, Kory J.; Thomas, Susan

2014-01-01

The validation of in-orbit instrument performance requires stability in both instrument and calibration source. This paper describes a method of validation using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. Unlike internal calibrations, the Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, in-orbit observations have become standardized and compiled for the Flight Models-1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance parameters which can be gleaned are detector gain, pointing accuracy and static detector point response function validation. Lunar observations are used to examine the stability of all three detectors on each of these instruments from 2006 to present. This validation method has yielded results showing trends per CERES data channel of 1.2% per decade or less.

The development and validation of the Dormitory Observation Report: a behavioral rating instrument for juvenile delinquents in residential care.

PubMed

Veneziano, Louis; Veneziano, Carol

2002-09-01

In order to provide an objective measure of problematic behavioral patterns among juvenile delinquents in residential facilities, the Dormitory Observation Report (DOR) was developed. The DOR assesses 11 dimensions of problematic behavioral patterns (e.g., physical assaultiveness, manipulativeness), as well as three dimensions of desirable behavioral patterns expected in an institutional setting (e.g., independent functioning, personal hygiene, care of surroundings). Empirical study regarding the reliability and validity of the DOR are reported, and the results are discussed in terms of the theoretical and practical implications of this instrument. Copyright 2002 Wiley Periodicals, Inc.

Observational and Modeling Studies of Clouds and the Hydrological Cycle

NASA Technical Reports Server (NTRS)

Somerville, Richard C. J.

1997-01-01

Our approach involved validating parameterizations directly against measurements from field programs, and using this validation to tune existing parameterizations and to guide the development of new ones. We have used a single-column model (SCM) to make the link between observations and parameterizations of clouds, including explicit cloud microphysics (e.g., prognostic cloud liquid water used to determine cloud radiative properties). Surface and satellite radiation measurements were used to provide an initial evaluation of the performance of the different parameterizations. The results of this evaluation will then used to develop improved cloud and cloud-radiation schemes, which were tested in GCM experiments.

Is prostate-specific antigen a valid surrogate end point for survival in hormonally treated patients with metastatic prostate cancer? Joint research of the European Organisation for Research and Treatment of Cancer, the Limburgs Universitair Centrum, and AstraZeneca Pharmaceuticals.

PubMed

Collette, Laurence; Burzykowski, Tomasz; Carroll, Kevin J; Newling, Don; Morris, Tom; Schröder, Fritz H

2005-09-01

The long duration of phase III clinical trials of overall survival (OS) slows down the treatment-development process. It could be shortened by using surrogate end points. Prostate-specific antigen (PSA) is the most studied biomarker in prostate cancer (PCa). This study attempts to validate PSA end points as surrogates for OS in advanced PCa. Individual data from 2,161 advanced PCa patients treated in studies comparing bicalutamide to castration were used in a meta-analytic approach to surrogate end-point validation. PSA response, PSA normalization, time to PSA progression, and longitudinal PSA measurements were considered. The known association between PSA and OS at the individual patient level was confirmed. The association between the effect of intervention on any PSA end point and on OS was generally low (determination coefficient, < 0.69). It is a common misconception that high correlation between biomarkers and true end point justify the use of the former as surrogates. To statistically validate surrogate end points, a high correlation between the treatment effects on the surrogate and true end point needs to be established across groups of patients treated with two alternative interventions. The levels of association observed in this study indicate that the effect of hormonal treatment on OS cannot be predicted with a high degree of precision from observed treatment effects on PSA end points, and thus statistical validity is unproven. In practice, non-null treatment effects on OS can be predicted only from precisely estimated large effects on time to PSA progression (TTPP; hazard ratio, < 0.50).

An Argument Approach to Observation Protocol Validity

ERIC Educational Resources Information Center

Bell, Courtney A.; Gitomer, Drew H.; McCaffrey, Daniel F.; Hamre, Bridget K.; Pianta, Robert C.; Qi, Yi

2012-01-01

This article develops a validity argument approach for use on observation protocols currently used to assess teacher quality for high-stakes personnel and professional development decisions. After defining the teaching quality domain, we articulate an interpretive argument for observation protocols. To illustrate the types of evidence that might…

The validity of compliance monitors to assess wearing time of thoracic-lumbar-sacral orthoses in children with spinal cord injury.

PubMed

Hunter, Louis N; Sison-Williamson, Mitell; Mendoza, Melissa M; McDonald, Craig M; Molitor, Fred; Mulcahey, M J; Betz, Randal R; Vogel, Lawrence C; Bagley, Anita

2008-06-15

Prospective multicenter observation. To determine the validity of 3 commercially available at recording thoracic-lumbar-sacral orthosis (TLSO) wearing time of children with spinal cord injury (SCI) and to assess each monitor's function during daily activities. A major limitation to studies assessing the effectiveness of spinal prophylactic bracing is the patient's compliance with the prescribed wearing time. Although some studies have begun to use objective compliance monitors, there is little documentation of the validity of the monitors during activities of daily life and no comparisons of available monitors. Fifteen children with SCI who wore a TLSO for paralytic scoliosis were observed for 4 days during their rehabilitation stay. Three compliance monitors (2 temperature and 1 pressure sensitive) were mounted onto each TLSO. Time of brace wear from the monitors was compared with the wear time per day recorded in diaries. Observed versus monitored duration of brace wear found the HOBO (temperature sensitive) to be the most valid compliance monitor. The HOBO had the lowest average of difference and variance of difference scores. The correlation between the recorded daily entries and monitored brace wear time was also highest for the HOBO in analysis of dependent and independent scores. Bland-Altman plots showed that the pressure sensitive monitor underestimated wear time whereas the temperature monitors overestimated wear time. Compliance to prescribed wearing schedule has been a barrier to studying TLSO efficacy. All 3 monitors were found to measure TLSO compliance, but the 2 temperature monitors were more in agreement with the daily diaries. Based on its functional advantages compared with the HOBO, the StowAway TidbiT will be used to further investigate the long-term compliance of TLSO bracing in children with SCI.

Bird Radar Validation in the Field by Time-Referencing Line-Transect Surveys

PubMed Central

Dokter, Adriaan M.; Baptist, Martin J.; Ens, Bruno J.; Krijgsveld, Karen L.; van Loon, E. Emiel

2013-01-01

Track-while-scan bird radars are widely used in ornithological studies, but often the precise detection capabilities of these systems are unknown. Quantification of radar performance is essential to avoid observational biases, which requires practical methods for validating a radar’s detection capability in specific field settings. In this study a method to quantify the detection capability of a bird radar is presented, as well a demonstration of this method in a case study. By time-referencing line-transect surveys, visually identified birds were automatically linked to individual tracks using their transect crossing time. Detection probabilities were determined as the fraction of the total set of visual observations that could be linked to radar tracks. To avoid ambiguities in assigning radar tracks to visual observations, the observer’s accuracy in determining a bird’s transect crossing time was taken into account. The accuracy was determined by examining the effect of a time lag applied to the visual observations on the number of matches found with radar tracks. Effects of flight altitude, distance, surface substrate and species size on the detection probability by the radar were quantified in a marine intertidal study area. Detection probability varied strongly with all these factors, as well as species-specific flight behaviour. The effective detection range for single birds flying at low altitude for an X-band marine radar based system was estimated at ∼1.5 km. Within this range the fraction of individual flying birds that were detected by the radar was 0.50±0.06 with a detection bias towards higher flight altitudes, larger birds and high tide situations. Besides radar validation, which we consider essential when quantification of bird numbers is important, our method of linking radar tracks to ground-truthed field observations can facilitate species-specific studies using surveillance radars. The methodology may prove equally useful for optimising tracking algorithms. PMID:24066103

Brazilian Portuguese version of the Revised Fibromyalgia Impact Questionnaire (FIQR-Br): cross-cultural validation, reliability, and construct and structural validation.

PubMed

Lupi, Jaqueline Basilio; Carvalho de Abreu, Daniela Cristina; Ferreira, Mariana Candido; Oliveira, Renê Donizeti Ribeiro de; Chaves, Thais Cristina

2017-08-01

This study aimed to culturally adapt and validate the Revised Fibromyalgia Impact Questionnaire (FIQR) to Brazilian Portuguese, by the use of analysis of internal consistency, reliability, and construct and structural validity. A total of 100 female patients with fibromyalgia participated in the validation process of the Brazilian Portuguese version of the FIQR (FIQR-Br).The intraclass correlation coefficient (ICC) was used for statistical analysis of reliability (test-retest), Cronbach's alpha for internal consistency, Pearson's rank correlation for construct validity, and confirmatory factor analysis (CFA) for structural validity. It was verified excellent levels of reliability, with ICC greater than 0.75 for all questions and domains of the FIQR-Br. For internal consistency, alpha values greater than 0.70 for the items and domains of the questionnaire were observed. Moderate (0.40 < r < 0.70) and strong (r > 0.70) correlations were observed for the scores of domains and total score between the FIQR-Br and FIQ-Br. The structure of the three domains of the FIQR-Br was confirmed by CFA. The results of this study suggest that that the FIQR-Br is a reliable and valid instrument for assessing fibromyalgia-related impact, and supports its use in clinical settings and research. The structure of the three domains of the FIQR-Br was also confirmed. Implications for Rehabilitation Fibromyalgia is a chronic musculoskeletal disorder characterized by widespread and diffuse pain, fatigue, sleep disturbances, and depression. The disease significantly impairs patients' quality of life and can be highly disabling. To be used in multicenter research efforts, the Revised Fibromyalgia Impact Questionnaire (FIQR) must be cross-culturally validated and psychometrically tested. This paper will make available a new version of the FIQR-Br since another version already exists, but there are concerns about its measurement properties. The availability of an instrument adapted to and validated for Brazilian Portuguese may make it possible to reliably verify the effects of rehabilitation programs on disability from fibromyalgia. The FIQR-Br showed results comparable with other versions of the FIQR in other languages, thereby enabling comparison of effects of rehabilitation interventions on disability from fibromyalgia conducted in Brazil with results of studies carried out in other parts of the world.

Display format, highlight validity, and highlight method: Their effects on search performance

NASA Technical Reports Server (NTRS)

Donner, Kimberly A.; Mckay, Tim D.; Obrien, Kevin M.; Rudisill, Marianne

1991-01-01

Display format and highlight validity were shown to affect visual display search performance; however, these studies were conducted on small, artificial displays of alphanumeric stimuli. A study manipulating these variables was conducted using realistic, complex Space Shuttle information displays. A 2x2x3 within-subjects analysis of variance found that search times were faster for items in reformatted displays than for current displays. Responses to valid applications of highlight were significantly faster than responses to non or invalidly highlighted applications. The significant format by highlight validity interaction showed that there was little difference in response time to both current and reformatted displays when the highlight validity was applied; however, under the non or invalid highlight conditions, search times were faster with reformatted displays. A separate within-subject analysis of variance of display format, highlight validity, and several highlight methods did not reveal a main effect of highlight method. In addition, observed display search times were compared to search time predicted by Tullis' Display Analysis Program. Benefits of highlighting and reformatting displays to enhance search and the necessity to consider highlight validity and format characteristics in tandem for predicting search performance are discussed.

Validity of self-reported mechanical demands for occupational epidemiologic research of musculoskeletal disorders

PubMed Central

Barrero, Lope H; Katz, Jeffrey N; Dennerlein, Jack T

2012-01-01

Objectives To describe the relation of the measured validity of self-reported mechanical demands (self-reports) with the quality of validity assessments and the variability of the assessed exposure in the study population. Methods We searched for original articles, published between 1990 and 2008, reporting the validity of self-reports in three major databases: EBSCOhost, Web of Science, and PubMed. Identified assessments were classified by methodological characteristics (eg, type of self-report and reference method) and exposure dimension was measured. We also classified assessments by the degree of comparability between the self-report and the employed reference method, and the variability of the assessed exposure in the study population. Finally, we examined the association of the published validity (r) with this degree of comparability, as well as with the variability of the exposure variable in the study population. Results Of the 490 assessments identified, 75% used observation-based reference measures and 55% tested self-reports of posture duration and movement frequency. Frequently, validity studies did not report demographic information (eg, education, age, and gender distribution). Among assessments reporting correlations as a measure of validity, studies with a better match between the self-report and the reference method, and studies conducted in more heterogeneous populations tended to report higher correlations [odds ratio (OR) 2.03, 95% confidence interval (95% CI) 0.89–4.65 and OR 1.60, 95% CI 0.96–2.61, respectively]. Conclusions The reported data support the hypothesis that validity depends on study-specific factors often not examined. Experimentally manipulating the testing setting could lead to a better understanding of the capabilities and limitations of self-reported information. PMID:19562235

Comparative effectiveness research in cancer with observational data.

PubMed

Giordano, Sharon H

2015-01-01

Observational studies are increasingly being used for comparative effectiveness research. These studies can have the greatest impact when randomized trials are not feasible or when randomized studies have not included the population or outcomes of interest. However, careful attention must be paid to study design to minimize the likelihood of selection biases. Analytic techniques, such as multivariable regression modeling, propensity score analysis, and instrumental variable analysis, also can also be used to help address confounding. Oncology has many existing large and clinically rich observational databases that can be used for comparative effectiveness research. With careful study design, observational studies can produce valid results to assess the benefits and harms of a treatment or intervention in representative real-world populations.

Measuring Changes in Social Communication Behaviors: Preliminary Development of the Brief Observation of Social Communication Change (BOSCC).

PubMed

Grzadzinski, Rebecca; Carr, Themba; Colombi, Costanza; McGuire, Kelly; Dufek, Sarah; Pickles, Andrew; Lord, Catherine

2016-07-01

Psychometric properties and initial validity of the Brief Observation of Social Communication Change (BOSCC), a measure of treatment-response for social-communication behaviors, are described. The BOSCC coding scheme is applied to 177 video observations of 56 young children with ASD and minimal language abilities. The BOSCC has high to excellent inter-rater and test-retest reliability and shows convergent validity with measures of language and communication skills. The BOSCC Core total demonstrates statistically significant amounts of change over time compared to a no change alternative while the ADOS CSS over the same period of time did not. This work is a first step in the development of a novel outcome measure for social-communication behaviors with applications to clinical trials and longitudinal studies.

Development of a Peer Teaching-Assessment Program and a Peer Observation and Evaluation Tool

PubMed Central

Trujillo, Jennifer M.; Barr, Judith; Gonyeau, Michael; Van Amburgh, Jenny A.; Matthews, S. James; Qualters, Donna

2008-01-01

Objectives To develop a formalized, comprehensive, peer-driven teaching assessment program and a valid and reliable assessment tool. Methods A volunteer taskforce was formed and a peer-assessment program was developed using a multistep, sequential approach and the Peer Observation and Evaluation Tool (POET). A pilot study was conducted to evaluate the efficiency and practicality of the process and to establish interrater reliability of the tool. Intra-class correlation coefficients (ICC) were calculated. Results ICCs for 8 separate lectures evaluated by 2-3 observers ranged from 0.66 to 0.97, indicating good interrater reliability of the tool. Conclusion Our peer assessment program for large classroom teaching, which includes a valid and reliable evaluation tool, is comprehensive, feasible, and can be adopted by other schools of pharmacy. PMID:19325963

Validation of the Activities of Community Transportation model for individuals with cognitive impairments.

PubMed

Sohlberg, McKay Moore; Fickas, Stephen; Lemoncello, Rik; Hung, Pei-Fang

2009-01-01

To develop a theoretical, functional model of community navigation for individuals with cognitive impairments: the Activities of Community Transportation (ACTs). Iterative design using qualitative methods (i.e. document review, focus groups and observations). Four agencies providing travel training to adults with cognitive impairments in the USA participated in the validation study. A thorough document review and series of focus groups led to the development of a comprehensive model (ACTs Wheels) delineating the requisite steps and skills for community navigation. The model was validated and updated based on observations of 395 actual trips by travellers with navigational challenges from the four participating agencies. Results revealed that the 'ACTs Wheel' models were complete and comprehensive. The 'ACTs Wheels' represent a comprehensive model of the steps needed to navigate to destinations using paratransit and fixed-route public transportation systems for travellers with cognitive impairments. Suggestions are made for future investigations of community transportation for this population.

Scanning elastic lidar observations of aerosol transport in New York City

NASA Astrophysics Data System (ADS)

Diaz, Adrian; Dominguez, Victor; Dobryansky, Selma; Wu, Yonghua; Arend, Mark; Vladutescu, Daniela Viviana; Gross, Barry; Moshary, Fred

2018-04-01

In this study, spatial distribution of aerosols in New York City is observed using a scanning eyesafe 532 nm elastic-backscatter micro-pulse lidar system. Observations show dynamics of the boundary layer and inhomogeneous distribution and transport of aerosols. The data acquired are complemented with simultaneous measurements of particulate matter and wind speed and direction. Furthermore, the system observations are validated by comparing them with a colocated multi-wavelength lidar.

Agent-Based vs. Equation-based Epidemiological Models:A Model Selection Case Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sukumar, Sreenivas R; Nutaro, James J

This paper is motivated by the need to design model validation strategies for epidemiological disease-spread models. We consider both agent-based and equation-based models of pandemic disease spread and study the nuances and complexities one has to consider from the perspective of model validation. For this purpose, we instantiate an equation based model and an agent based model of the 1918 Spanish flu and we leverage data published in the literature for our case- study. We present our observations from the perspective of each implementation and discuss the application of model-selection criteria to compare the risk in choosing one modeling paradigmmore » to another. We conclude with a discussion of our experience and document future ideas for a model validation framework.« less

An Attempt to Determine the Construct Validity of Measures Hypothesized to Represent an Orientation to Right, Left, or Integrated Hemispheric Brain Function for a Sample of Primary School Children.

ERIC Educational Resources Information Center

Dumbrower, Jule; And Others

1981-01-01

This study attempts to obtain evidence of the construct validity of pupil ability tests hypothesized to represent orientation to right, left, or integrated hemispheric function, and of teacher observation subscales intended to reveal behaviors in school setting that were hypothesized to portray preference for right or left brain function. (Author)

Reliability and Validity of the Acanthosis Nigricans Screening Tool for Use in Elementary School-Age Children by School Nurses

ERIC Educational Resources Information Center

Scott, Leslie K.; Hall, Lynne M.

2012-01-01

The purpose of this study was to test the reliability and validity of an acanthosis nigricans (AN) screening tool for use in elementary school-age children of different ethnic groups. Cross-sectional data were collected via observation of 288, 5- to 12-year-old school-age children. Three nurse clinicians used a 0-4 grade AN screening tool to rate…

Validation of the automated self-administered 24-hour dietary recall for children (ASA24-Kids) among 9- to 11-year-old youth

USDA-ARS?s Scientific Manuscript database

Our purpose was to validate ASA24-Kids-2012, a self-administered web-based 24-hour dietary recall (24hDR) among 9- to 11-year-old children. Sixty-nine children in two sites participated in the study. In one site, trained staff observed and recorded types and portions of foods and drinks consumed by ...

A French adaptation of the Overt Behaviour Scale (OBS) measuring challenging behaviours following acquired brain injury: The Échelle des comportements observables (ÉCO).

PubMed

Gagnon, Jean; Simpson, Grahame Kenneth; Kelly, Glenn; Godbout, Denis; Ouellette, Michel; Drolet, Jacques

2016-01-01

To develop a French version of the Overt Behaviour Scale (OBS) and examine some of its psychometric properties. The scale was adapted and validated according to standard guidelines for cross-cultural adaptation of questionnaires (Échelle des comportements observables; ÉCO). The reliability and construct validity of the ÉCO were studied among 29 inpatients and outpatients who sustained an acquired brain injury. The instruments were administered by 12 clinicians located at eight rehabilitation centres and the local brain injury association. The ÉCO provided behaviour profile descriptives much like the original scale. It showed excellent reliability and good convergent and divergent validity, as reflected by significant associations with other measures that contained similar behavioural items and by the absence of signification correlations with broader constructs such as physical and cognitive abilities. This study provides evidence that the ÉCO behaves much like the original OBS, has promising initial findings with respect to reliability and validity and is a valuable research and clinical instrument to assess the severity and typology of challenging behaviour after an acquired brain injury and to monitor the evolution of behaviours after intervention in French and bilingual communities.

Validity and relative validity of a novel digital approach for 24-h dietary recall in athletes

PubMed Central

2014-01-01

Background We developed a digital dietary analysis tool for athletes (DATA) using a modified 24-h recall method and an integrated, customized nutrient database. The purpose of this study was to assess DATA’s validity and relative validity by measuring its agreement with registered dietitians’ (RDs) direct observations (OBSERVATION) and 24-h dietary recall interviews using the USDA 5-step multiple-pass method (INTERVIEW), respectively. Methods Fifty-six athletes (14–20 y) completed DATA and INTERVIEW in randomized counter-balanced order. OBSERVATION (n = 26) consisted of RDs recording participants’ food/drink intake in a 24-h period and were completed the day prior to DATA and INTERVIEW. Agreement among methods was estimated using a repeated measures t-test and Bland-Altman analysis. Results The paired differences (with 95% confidence intervals) between DATA and OBSERVATION were not significant for carbohydrate (10.1%, -1.2–22.7%) and protein (14.1%, -3.2–34.5%) but was significant for energy (14.4%, 1.2–29.3%). There were no differences between DATA and INTERVIEW for energy (-1.1%, -9.1–7.7%), carbohydrate (0.2%, -7.1–8.0%) or protein (-2.7%, -11.3–6.7%). Bland-Altman analysis indicated significant positive correlations between absolute values of the differences and the means for OBSERVATION vs. DATA (r = 0.40 and r = 0.47 for energy and carbohydrate, respectively) and INTERVIEW vs. DATA (r = 0.52, r = 0.29, and r = 0.61 for energy, carbohydrate, and protein, respectively). There were also wide 95% limits of agreement (LOA) for most method comparisons. The mean bias ratio (with 95% LOA) for OBSERVATION vs. DATA was 0.874 (0.551-1.385) for energy, 0.906 (0.522-1.575) for carbohydrate, and 0.895(0.395-2.031) for protein. The mean bias ratio (with 95% LOA) for INTERVIEW vs. DATA was 1.016 (0.538-1.919) for energy, 0.995 (0.563-1.757) for carbohydrate, and 1.031 (0.514-2.068) for protein. Conclusion DATA has good relative validity for group-level comparisons in athletes. However, there are large variations in the relative validity of individuals’ dietary intake estimates from DATA, particularly in athletes with higher energy and nutrient intakes. DATA can be a useful athlete-specific, digital alternative to conventional 24-h dietary recall methods at the group level. Further development and testing is needed to improve DATA’s validity for estimations of individual dietary intakes. PMID:24779565

Validity and relative validity of a novel digital approach for 24-h dietary recall in athletes.

PubMed

Baker, Lindsay B; Heaton, Lisa E; Stein, Kimberly W; Nuccio, Ryan P; Jeukendrup, Asker E

2014-04-30

We developed a digital dietary analysis tool for athletes (DATA) using a modified 24-h recall method and an integrated, customized nutrient database. The purpose of this study was to assess DATA's validity and relative validity by measuring its agreement with registered dietitians' (RDs) direct observations (OBSERVATION) and 24-h dietary recall interviews using the USDA 5-step multiple-pass method (INTERVIEW), respectively. Fifty-six athletes (14-20 y) completed DATA and INTERVIEW in randomized counter-balanced order. OBSERVATION (n = 26) consisted of RDs recording participants' food/drink intake in a 24-h period and were completed the day prior to DATA and INTERVIEW. Agreement among methods was estimated using a repeated measures t-test and Bland-Altman analysis. The paired differences (with 95% confidence intervals) between DATA and OBSERVATION were not significant for carbohydrate (10.1%, -1.2-22.7%) and protein (14.1%, -3.2-34.5%) but was significant for energy (14.4%, 1.2-29.3%). There were no differences between DATA and INTERVIEW for energy (-1.1%, -9.1-7.7%), carbohydrate (0.2%, -7.1-8.0%) or protein (-2.7%, -11.3-6.7%). Bland-Altman analysis indicated significant positive correlations between absolute values of the differences and the means for OBSERVATION vs. DATA (r = 0.40 and r = 0.47 for energy and carbohydrate, respectively) and INTERVIEW vs. DATA (r = 0.52, r = 0.29, and r = 0.61 for energy, carbohydrate, and protein, respectively). There were also wide 95% limits of agreement (LOA) for most method comparisons. The mean bias ratio (with 95% LOA) for OBSERVATION vs. DATA was 0.874 (0.551-1.385) for energy, 0.906 (0.522-1.575) for carbohydrate, and 0.895(0.395-2.031) for protein. The mean bias ratio (with 95% LOA) for INTERVIEW vs. DATA was 1.016 (0.538-1.919) for energy, 0.995 (0.563-1.757) for carbohydrate, and 1.031 (0.514-2.068) for protein. DATA has good relative validity for group-level comparisons in athletes. However, there are large variations in the relative validity of individuals' dietary intake estimates from DATA, particularly in athletes with higher energy and nutrient intakes. DATA can be a useful athlete-specific, digital alternative to conventional 24-h dietary recall methods at the group level. Further development and testing is needed to improve DATA's validity for estimations of individual dietary intakes.

Validation of the Rossmax CF175 upper-arm blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Zhang, Lu; Kang, Yuan-Yuan; Zeng, Wei-Fang; Li, Yan; Wang, Ji-Guang

2015-04-01

The present study aimed to evaluate the accuracy of the Rossmax CF175 upper-arm blood pressure monitor for home blood pressure monitoring according to the International Protocol of the European Society of Hypertension revision 2010. Systolic and diastolic blood pressures were sequentially measured in 33 adult Chinese (17 women, mean age 46 years) using a mercury sphygmomanometer (two observers) and the Rossmax CF175 device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. All the blood pressure requirements were fulfilled. The Rossmax CF175 device achieved the targets in part 1 of the validation study. The number of absolute differences between the device and observers within 5, 10, and 15 mmHg was 78/99, 94/99, and 98/99, respectively, for systolic blood pressure, and 81/99, 96/99, and 97/99, respectively, for diastolic blood pressure. The device also achieved the criteria in part 2 of the validation study. Twenty-nine participants, for both of systolic and diastolic blood pressure, had at least two of the three device-observers differences within 5 mmHg (required ≥24). Only one participant for diastolic blood pressure had all three device-observers comparisons greater than 5 mmHg. The Rossmax automated oscillometric upper-arm blood pressure monitor CF175 fulfilled the requirements of the International Protocol revision 2010, and hence can be recommended for blood pressure measurement in adults.

Validation of the AVITA BPM15S wrist blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Kang, Yuan-Yuan; Zeng, Wei-Fang; Zhang, Lu; Li, Yan; Wang, Ji-Guang

2014-06-01

The present study aimed to evaluate the accuracy of the automated oscillometric wrist blood pressure monitor AVITA BPM15S for home blood pressure monitoring according to the International Protocol revision 2010 of the European Society of Hypertension. Systolic and diastolic blood pressures were sequentially measured in 33 Chinese adults (15 women, mean age 51 years) using a mercury sphygmomanometer (two observers) and the AVITA BPM15S device (one supervisor). Ninety-nine pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. The AVITA BPM15S device achieved the targets in part 1 of the validation study. The number of absolute differences between the device and observers within 5, 10, and 15 mmHg were 85/99, 94/99, and 98/99, respectively, for systolic blood pressure, and 82/99, 96/99, and 98/99, respectively, for diastolic blood pressure. The device also achieved the criteria in part 2 of the validation study. Thirty-two and 28 participants for systolic and diastolic blood pressure, respectively, had at least two of the three device-observer differences within 5 mmHg (required ≥ 24). No participant had all of the three device-observer comparisons greater than 5 mmHg for systolic or diastolic blood pressure. The AVITA wrist blood pressure monitor BPM15S fulfilled the requirements of the International Protocol revision 2010 and hence can be recommended for home use in an adult population.

Validation of the SCIAN LD-735 wrist blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Kang, Yuan-Yuan; Chen, Qi; Li, Yan; Wang, Ji-Guang

2016-08-01

This study aimed to evaluate the accuracy of the automated oscillometric wrist blood pressure monitor SCIAN LD-735 for home blood pressure monitoring according to the International Protocol of the European Society of Hypertension revision 2010. Systolic and diastolic blood pressures were measured sequentially in 33 adult Chinese participants (10 women, mean age 44.8 years) using a mercury sphygmomanometer (two observers) and the SCIAN LD-735 device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. The SCIAN LD-735 device achieved the targets in part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 86/99, 97/99, and 98/99, respectively, for systolic blood pressure and 85/99, 98/99, and 99/99, respectively, for diastolic blood pressure. The device also fulfilled the criteria in part 2 of the validation study. In total, 30 and 33 participants for systolic and diastolic blood pressure, respectively, had at least two of the three device-observer differences within 5 mmHg (required ≥24). No participant had all of the three device-observer comparisons greater than 5 mmHg for systolic or diastolic blood pressure. The SCIAN wrist blood pressure monitor LD-735 has passed the requirements of the International Protocol revision 2010, and hence can be recommended for home use in adults.

Validation of the BPUMP BF1112 upper-arm blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Chen, Qi; Kang, Yuan-Yuan; Li, Yan; Wang, Ji-Guang

2017-04-01

The present study aimed to evaluate the accuracy of the automated oscillometric upper-arm blood pressure (BP) monitor BPUMP BF1112 for home BP monitoring according to the International Protocol of the European Society of Hypertension revision 2010 (ESH-IP2010). Systolic and diastolic BPs were sequentially measured in 33 adult Chinese (13 women, mean age 46.7 years) using a mercury sphygmomanometer (two observers) and the BF1112 device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. The BPUMP BF1112 device achieved the targets in part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 85/99, 96/99, and 97/99, respectively, for systolic BP, and 83/99, 97/99, and 99/99, respectively, for diastolic BP. The device also fulfilled the criteria in part 2 of the validation study. A total of 31 and 30 participants for systolic and diastolic BP, respectively, had at least two of the three device-observer differences within 5 mmHg (required≥24mmHg). No participant for systolic or diastolic BP had all the three device-observer comparisons greater than 5 mmHg. The BPUMP BP monitor BF1112 has passed the requirements of the ESH-IP2010, and hence can be recommended for home use in adults.

Validation of a Brief Questionnaire Against Direct Observation to Assess Adolescents' School Lunchtime Beverage Consumption.

PubMed

Grummon, Anna H; Hampton, Karla E; Hecht, Amelie; Oliva, Ariana; McCulloch, Charles E; Brindis, Claire D; Patel, Anisha I

Beverage consumption is an important determinant of youth health outcomes. Beverage interventions often occur in schools, yet no brief validated questionnaires exist to assess whether these efforts improve in-school beverage consumption. This study validated a brief questionnaire to assess beverage consumption during school lunch. Researchers observed middle school students' (n = 25) beverage consumption during school lunchtime using a standardized tool. After lunch, students completed questionnaires regarding their lunchtime beverage consumption. Kappa statistics compared self-reported with observed beverage consumption across 15 beverage categories. Eight beverages showed at least fair agreement (kappa [κ] > 0.20) for both type and amount consumed, with most showing substantial agreement (κ > 0.60). One beverage had high raw agreement but κ < 0.20. Six beverages had too few ratings to compute κ's. This brief questionnaire was useful for assessing school lunchtime consumption of many beverages and provides a low-cost tool for evaluating school-based beverage interventions. Copyright © 2017 Society for Nutrition Education and Behavior. Published by Elsevier Inc. All rights reserved.

Validation of Mismatch Negativity and P3a for Use in Multi-Site Studies of Schizophrenia: Characterization of Demographic, Clinical, Cognitive, and Functional Correlates in COGS-2

PubMed Central

Light, Gregory A.; Swerdlow, Neal R.; Thomas, Michael L.; Calkins, Monica E.; Green, Michael F.; Greenwood, Tiffany A.; Gur, Raquel E.; Gur, Ruben C.; Lazzeroni, Laura C.; Nuechterlein, Keith H.; Pela, Marlena; Radant, Allen D.; Seidman, Larry J.; Sharp, Richard F.; Siever, Larry J.; Silverman, Jeremy M.; Sprock, Joyce; Stone, William S.; Sugar, Catherine A.; Tsuang, Debby W.; Tsuang, Ming T.; Braff, David L.; Turetsky, Bruce I.

2014-01-01

Mismatch negativity (MMN) and P3a are auditory event-related potential (ERP) components that show robust deficits in schizophrenia (SZ) patients and exhibit qualities of endophenotypes, including substantial heritability, test-retest reliability, and trait-like stability. These measures also fulfill criteria for use as cognition and function-linked biomarkers in outcome studies, but have not yet been validated for use in large-scale multi-site clinical studies. This study tested the feasibility of adding MMN and P3a to the ongoing Consortium on the Genetics of Schizophrenia (COGS) study. The extent to which demographic, clinical, cognitive, and functional characteristics contribute to variability in MMN and P3a amplitudes was also examined. Participants (HCS n=824, SZ n=966) underwent testing at 5 geographically distributed COGS laboratories. Valid ERP data was obtained from 91% of HCS and 91% of SZ patients. Highly significant MMN (d=0.96) and P3a (d=0.93) amplitude reductions were observed in SZ patients, comparable in magnitude to those observed in single-lab studies with no appreciable differences across laboratories. Demographic characteristics accounted for 26% and 18% of the variance in MMN and P3a amplitudes, respectively. Significant relationships were observed among demographically-adjusted MMN and P3a measures and medication status as well as several clinical, cognitive, and functional characteristics of the SZ patients. This study demonstrates that MMN and P3a ERP biomarkers can be feasibly used in multi-site clinical studies. As with many clinical tests of brain function, demographic factors contribute to MMN and P3a amplitudes and should be carefully considered in future biomarker-informed clinical studies. PMID:25449710

Validation of mismatch negativity and P3a for use in multi-site studies of schizophrenia: characterization of demographic, clinical, cognitive, and functional correlates in COGS-2.

PubMed

Light, Gregory A; Swerdlow, Neal R; Thomas, Michael L; Calkins, Monica E; Green, Michael F; Greenwood, Tiffany A; Gur, Raquel E; Gur, Ruben C; Lazzeroni, Laura C; Nuechterlein, Keith H; Pela, Marlena; Radant, Allen D; Seidman, Larry J; Sharp, Richard F; Siever, Larry J; Silverman, Jeremy M; Sprock, Joyce; Stone, William S; Sugar, Catherine A; Tsuang, Debby W; Tsuang, Ming T; Braff, David L; Turetsky, Bruce I

2015-04-01

Mismatch negativity (MMN) and P3a are auditory event-related potential (ERP) components that show robust deficits in schizophrenia (SZ) patients and exhibit qualities of endophenotypes, including substantial heritability, test-retest reliability, and trait-like stability. These measures also fulfill criteria for use as cognition and function-linked biomarkers in outcome studies, but have not yet been validated for use in large-scale multi-site clinical studies. This study tested the feasibility of adding MMN and P3a to the ongoing Consortium on the Genetics of Schizophrenia (COGS) study. The extent to which demographic, clinical, cognitive, and functional characteristics contribute to variability in MMN and P3a amplitudes was also examined. Participants (HCS n=824, SZ n=966) underwent testing at 5 geographically distributed COGS laboratories. Valid ERP recordings were obtained from 91% of HCS and 91% of SZ patients. Highly significant MMN (d=0.96) and P3a (d=0.93) amplitude reductions were observed in SZ patients, comparable in magnitude to those observed in single-lab studies with no appreciable differences across laboratories. Demographic characteristics accounted for 26% and 18% of the variance in MMN and P3a amplitudes, respectively. Significant relationships were observed among demographically-adjusted MMN and P3a measures and medication status as well as several clinical, cognitive, and functional characteristics of the SZ patients. This study demonstrates that MMN and P3a ERP biomarkers can be feasibly used in multi-site clinical studies. As with many clinical tests of brain function, demographic factors contribute to MMN and P3a amplitudes and should be carefully considered in future biomarker-informed clinical studies. Published by Elsevier B.V.

Development and validation of a cost-utility model for Type 1 diabetes mellitus.

PubMed

Wolowacz, S; Pearson, I; Shannon, P; Chubb, B; Gundgaard, J; Davies, M; Briggs, A

2015-08-01

To develop a health economic model to evaluate the cost-effectiveness of new interventions for Type 1 diabetes mellitus by their effects on long-term complications (measured through mean HbA1c ) while capturing the impact of treatment on hypoglycaemic events. Through a systematic review, we identified complications associated with Type 1 diabetes mellitus and data describing the long-term incidence of these complications. An individual patient simulation model was developed and included the following complications: cardiovascular disease, peripheral neuropathy, microalbuminuria, end-stage renal disease, proliferative retinopathy, ketoacidosis, cataract, hypoglycemia and adverse birth outcomes. Risk equations were developed from published cumulative incidence data and hazard ratios for the effect of HbA1c , age and duration of diabetes. We validated the model by comparing model predictions with observed outcomes from studies used to build the model (internal validation) and from other published data (external validation). We performed illustrative analyses for typical patient cohorts and a hypothetical intervention. Model predictions were within 2% of expected values in the internal validation and within 8% of observed values in the external validation (percentages represent absolute differences in the cumulative incidence). The model utilized high-quality, recent data specific to people with Type 1 diabetes mellitus. In the model validation, results deviated less than 8% from expected values. © 2014 Research Triangle Institute d/b/a RTI Health Solutions. Diabetic Medicine © 2014 Diabetes UK.

Assessing behavioural changes in ALS: cross-validation of ALS-specific measures.

PubMed

Pinto-Grau, Marta; Costello, Emmet; O'Connor, Sarah; Elamin, Marwa; Burke, Tom; Heverin, Mark; Pender, Niall; Hardiman, Orla

2017-07-01

The Beaumont Behavioural Inventory (BBI) is a behavioural proxy report for the assessment of behavioural changes in ALS. This tool has been validated against the FrSBe, a non-ALS-specific behavioural assessment, and further comparison of the BBI against a disease-specific tool was considered. This study cross-validates the BBI against the ALS-FTD-Q. Sixty ALS patients, 8% also meeting criteria for FTD, were recruited. All patients were evaluated using the BBI and the ALS-FTD-Q, completed by a carer. Correlational analysis was performed to assess construct validity. Precision, sensitivity, specificity, and overall accuracy of the BBI when compared to the ALS-FTD-Q, were obtained. The mean score of the whole sample on the BBI was 11.45 ± 13.06. ALS-FTD patients scored significantly higher than non-demented ALS patients (31.6 ± 14.64, 9.62 ± 11.38; p < 0.0001). A significant large positive correlation between the BBI and the ALS-FTD-Q was observed (r = 0.807, p < 0.0001), and no significant correlations between the BBI and other clinical/demographic characteristics indicate good convergent and discriminant validity, respectively. 72% of overall concordance was observed. Precision, sensitivity, and specificity for the classification of severely impaired patients were adequate. However, lower concordance in the classification of mild behavioural changes was observed, with higher sensitivity using the BBI, most likely secondary to BBI items which endorsed behavioural aspects not measured by the ALS-FTD-Q. Good construct validity has been further confirmed when the BBI is compared to an ALS-specific tool. Furthermore, the BBI is a more comprehensive behavioural assessment for ALS, as it measures the whole behavioural spectrum in this condition.

Model-based methods for case definitions from administrative health data: application to rheumatoid arthritis

PubMed Central

Kroeker, Kristine; Widdifield, Jessica; Muthukumarana, Saman; Jiang, Depeng; Lix, Lisa M

2017-01-01

Objective This research proposes a model-based method to facilitate the selection of disease case definitions from validation studies for administrative health data. The method is demonstrated for a rheumatoid arthritis (RA) validation study. Study design and setting Data were from 148 definitions to ascertain cases of RA in hospital, physician and prescription medication administrative data. We considered: (A) separate univariate models for sensitivity and specificity, (B) univariate model for Youden’s summary index and (C) bivariate (ie, joint) mixed-effects model for sensitivity and specificity. Model covariates included the number of diagnoses in physician, hospital and emergency department records, physician diagnosis observation time, duration of time between physician diagnoses and number of RA-related prescription medication records. Results The most common case definition attributes were: 1+ hospital diagnosis (65%), 2+ physician diagnoses (43%), 1+ specialist physician diagnosis (51%) and 2+ years of physician diagnosis observation time (27%). Statistically significant improvements in sensitivity and/or specificity for separate univariate models were associated with (all p values <0.01): 2+ and 3+ physician diagnoses, unlimited physician diagnosis observation time, 1+ specialist physician diagnosis and 1+ RA-related prescription medication records (65+ years only). The bivariate model produced similar results. Youden’s index was associated with these same case definition criteria, except for the length of the physician diagnosis observation time. Conclusion A model-based method provides valuable empirical evidence to aid in selecting a definition(s) for ascertaining diagnosed disease cases from administrative health data. The choice between univariate and bivariate models depends on the goals of the validation study and number of case definitions. PMID:28645978

Validating the WRF-Chem model for wind energy applications using High Resolution Doppler Lidar data from a Utah 2012 field campaign

NASA Astrophysics Data System (ADS)

Mitchell, M. J.; Pichugina, Y. L.; Banta, R. M.

2015-12-01

Models are important tools for assessing potential of wind energy sites, but the accuracy of these projections has not been properly validated. In this study, High Resolution Doppler Lidar (HRDL) data obtained with high temporal and spatial resolution at heights of modern turbine rotors were compared to output from the WRF-chem model in order to help improve the performance of the model in producing accurate wind forecasts for the industry. HRDL data were collected from January 23-March 1, 2012 during the Uintah Basin Winter Ozone Study (UBWOS) field campaign. A model validation method was based on the qualitative comparison of the wind field images, time-series analysis and statistical analysis of the observed and modeled wind speed and direction, both for case studies and for the whole experiment. To compare the WRF-chem model output to the HRDL observations, the model heights and forecast times were interpolated to match the observed times and heights. Then, time-height cross-sections of the HRDL and WRF-Chem wind speed and directions were plotted to select case studies. Cross-sections of the differences between the observed and forecasted wind speed and directions were also plotted to visually analyze the model performance in different wind flow conditions. A statistical analysis includes the calculation of vertical profiles and time series of bias, correlation coefficient, root mean squared error, and coefficient of determination between two datasets. The results from this analysis reveals where and when the model typically struggles in forecasting winds at heights of modern turbine rotors so that in the future the model can be improved for the industry.

'Mechanical restraint-confounders, risk, alliance score': testing the clinical validity of a new risk assessment instrument.

PubMed

Deichmann Nielsen, Lea; Bech, Per; Hounsgaard, Lise; Alkier Gildberg, Frederik

2017-08-01

Unstructured risk assessment, as well as confounders (underlying reasons for the patient's risk behaviour and alliance), risk behaviour, and parameters of alliance, have been identified as factors that prolong the duration of mechanical restraint among forensic mental health inpatients. To clinically validate a new, structured short-term risk assessment instrument called the Mechanical Restraint-Confounders, Risk, Alliance Score (MR-CRAS), with the intended purpose of supporting the clinicians' observation and assessment of the patient's readiness to be released from mechanical restraint. The content and layout of MR-CRAS and its user manual were evaluated using face validation by forensic mental health clinicians, content validation by an expert panel, and pilot testing within two, closed forensic mental health inpatient units. The three sub-scales (Confounders, Risk, and a parameter of Alliance) showed excellent content validity. The clinical validations also showed that MR-CRAS was perceived and experienced as a comprehensible, relevant, comprehensive, and useable risk assessment instrument. MR-CRAS contains 18 clinically valid items, and the instrument can be used to support the clinical decision-making regarding the possibility of releasing the patient from mechanical restraint. The present three studies have clinically validated a short MR-CRAS scale that is currently being psychometrically tested in a larger study.

Modeling complex treatment strategies: construction and validation of a discrete event simulation model for glaucoma.

PubMed

van Gestel, Aukje; Severens, Johan L; Webers, Carroll A B; Beckers, Henny J M; Jansonius, Nomdo M; Schouten, Jan S A G

2010-01-01

Discrete event simulation (DES) modeling has several advantages over simpler modeling techniques in health economics, such as increased flexibility and the ability to model complex systems. Nevertheless, these benefits may come at the cost of reduced transparency, which may compromise the model's face validity and credibility. We aimed to produce a transparent report on the construction and validation of a DES model using a recently developed model of ocular hypertension and glaucoma. Current evidence of associations between prognostic factors and disease progression in ocular hypertension and glaucoma was translated into DES model elements. The model was extended to simulate treatment decisions and effects. Utility and costs were linked to disease status and treatment, and clinical and health economic outcomes were defined. The model was validated at several levels. The soundness of design and the plausibility of input estimates were evaluated in interdisciplinary meetings (face validity). Individual patients were traced throughout the simulation under a multitude of model settings to debug the model, and the model was run with a variety of extreme scenarios to compare the outcomes with prior expectations (internal validity). Finally, several intermediate (clinical) outcomes of the model were compared with those observed in experimental or observational studies (external validity) and the feasibility of evaluating hypothetical treatment strategies was tested. The model performed well in all validity tests. Analyses of hypothetical treatment strategies took about 30 minutes per cohort and lead to plausible health-economic outcomes. There is added value of DES models in complex treatment strategies such as glaucoma. Achieving transparency in model structure and outcomes may require some effort in reporting and validating the model, but it is feasible.

Credible Set Estimation, Analysis, and Applications in Synthetic Aperture Radar Canonical Feature Extraction

DTIC Science & Technology

2015-03-26

depicting the CSE implementation for use with CV Domes data. . . 88 B.1 Validation results for N = 1 observation at 1.0 interval. Legendre polynomial of... Legendre polynomial of order Nl = 5. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 98 B.3 Validation results for N = 1 observation at...0.01 interval. Legendre polynomial of order Nl = 5. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 99 B.4 Validation results for N

Objective categorization of interferential tear film lipid layer pattern: validation of the technique

NASA Astrophysics Data System (ADS)

García-Resúa, C.; Giráldez, M. J.; Barreira, N.; Penedo, M. G.; Yebra-Pimentel, E.

2011-05-01

Purpose: The lipid layer of the tear film limits evaporation during the inter-blink interval and also affects tear stability. This study was designed to validate a new software application designed to characterize the tear film lipid layer through texture and colour pattern recognition. Methods: Using the Tearscope-plus (slit lamp magnification 200X), the lipid layer was examined in 105 healthy young adults and interference photographs acquired with a Topcon DV-3 digital camera. The photographs were classified by the new software and by 2 further observers (observer 1 and observer 2) with experience in examining the eye surface. Results: Strong correlation was detected between the categories determined by the new application, observer 1 and observer 2 (Cramer's V, from 0.81 to 0.87, p<0.001). Best agreement (96.2%) was noted between the new method and observers 1 and 2 for recognizing meshwork patterns, whereas observers 1 and 2 showed greatest correspondence when classifying colour fringe patterns. Conclusions: The new application can objectively categorize LLPs using the Tearscope-plus.

The GRACE checklist for rating the quality of observational studies of comparative effectiveness: a tale of hope and caution.

PubMed

Dreyer, Nancy A; Velentgas, Priscilla; Westrich, Kimberly; Dubois, Robert

2014-03-01

While there is growing demand for information about comparative effectiveness (CE), there is substantial debate about whether and when observational studies have sufficient quality to support decision making. To develop and test an item checklist that can be used to qualify those observational CE studies sufficiently rigorous in design and execution to contribute meaningfully to the evidence base for decision support. An 11-item checklist about data and methods (the GRACE checklist) was developed through literature review and consultation with experts from professional societies, payer groups, the private sector, and academia. Since no single gold standard exists for validation, checklist item responses were compared with 3 different types of external quality ratings (N=88 articles). The articles compared treatment effectiveness and/or safety of drugs, medical devices, and medical procedures. We validated checklist item responses 3 ways against external quality ratings, using published articles of observational CE or safety studies: (a) Systematic Review-quality assessment from a published systematic review; (b) Single Expert Review-quality assessment made according to the solicited "expert opinion" of a senior researcher; and (c) Concordant Expert Review-quality assessments from 2 experts for which there was concordance. Volunteers (N=113) from 5 continents completed 280 article assessments using the checklist. Positive and negative predictive values (PPV, NPV, respectively) of individual items were estimated to compare testers' assessments with those of experts. Taken as a whole, the scale had better NPV than PPV, for both data and methods. The most consistent predictor of quality relates to the validity of the primary outcomes measurement for the study purpose. Other consistent markers of quality relate to using concurrent comparators, minimizing the effects of bias by prudent choice of covariates, and using sensitivity analysis to test robustness of results. Concordance of expert opinion on the quality of the rated articles was 52%; most checklist items performed better. The 11-item GRACE checklist provides guidance to help determine which observational studies of CE have used strong scientific methods and good data that are fit for purpose and merit consideration for decision making. The checklist contains a parsimonious set of elements that can be objectively assessed in published studies, and user testing shows that it can be successfully applied to studies of drugs, medical devices, and clinical and surgical interventions. Although no scoring is provided, study reports that rate relatively well across checklist items merit in-depth examination to understand applicability, effect size, and likelihood of residual bias. The current testing and validation efforts did not achieve clear discrimination between studies fit for purpose and those not, but we have identified a critical, though remediable, limitation in our approach. Not specifying a specific granular decision for evaluation, or not identifying a single study objective in reports that included more than one, left reviewers with too broad an assessment challenge. We believe that future efforts will be more successful if reviewers are asked to focus on a specific objective or question. Despite the challenges encountered in this testing, an agreed upon set of assessment elements, checklists, or score cards is critical for the maturation of this field. Substantial resources will be expended on studies of real-world effectiveness, and if the rigor of these observational assessments cannot be assessed, then the impact of the studies will be suboptimal. Similarly, agreement on key elements of quality will ensure that budgets are appropriately directed toward those elements. Given the importance of this task and the lessons learned from these extensive efforts at validation and user testing, we are optimistic about the potential for improved assessments that can be used for diverse situations by people with a wide range of experience and training. Future testing would benefit by directing reviewers to address a single, granular research question, which would avoid problems that arose by using the checklist to evaluate multiple objectives, by using other types of validation test sets, and by employing further multivariate analysis to see if any combination or sequence of item responses has particularly high predictive validity.

The Use of Virtual Reality in the Study of People's Responses to Violent Incidents.

PubMed

Rovira, Aitor; Swapp, David; Spanlang, Bernhard; Slater, Mel

2009-01-01

This paper reviews experimental methods for the study of the responses of people to violence in digital media, and in particular considers the issues of internal validity and ecological validity or generalisability of results to events in the real world. Experimental methods typically involve a significant level of abstraction from reality, with participants required to carry out tasks that are far removed from violence in real life, and hence their ecological validity is questionable. On the other hand studies based on field data, while having ecological validity, cannot control multiple confounding variables that may have an impact on observed results, so that their internal validity is questionable. It is argued that immersive virtual reality may provide a unification of these two approaches. Since people tend to respond realistically to situations and events that occur in virtual reality, and since virtual reality simulations can be completely controlled for experimental purposes, studies of responses to violence within virtual reality are likely to have both ecological and internal validity. This depends on a property that we call 'plausibility' - including the fidelity of the depicted situation with prior knowledge and expectations. We illustrate this with data from a previously published experiment, a virtual reprise of Stanley Milgram's 1960s obedience experiment, and also with pilot data from a new study being developed that looks at bystander responses to violent incidents.

The Use of Virtual Reality in the Study of People's Responses to Violent Incidents

PubMed Central

Rovira, Aitor; Swapp, David; Spanlang, Bernhard; Slater, Mel

2009-01-01

This paper reviews experimental methods for the study of the responses of people to violence in digital media, and in particular considers the issues of internal validity and ecological validity or generalisability of results to events in the real world. Experimental methods typically involve a significant level of abstraction from reality, with participants required to carry out tasks that are far removed from violence in real life, and hence their ecological validity is questionable. On the other hand studies based on field data, while having ecological validity, cannot control multiple confounding variables that may have an impact on observed results, so that their internal validity is questionable. It is argued that immersive virtual reality may provide a unification of these two approaches. Since people tend to respond realistically to situations and events that occur in virtual reality, and since virtual reality simulations can be completely controlled for experimental purposes, studies of responses to violence within virtual reality are likely to have both ecological and internal validity. This depends on a property that we call ‘plausibility’ – including the fidelity of the depicted situation with prior knowledge and expectations. We illustrate this with data from a previously published experiment, a virtual reprise of Stanley Milgram's 1960s obedience experiment, and also with pilot data from a new study being developed that looks at bystander responses to violent incidents. PMID:20076762

Spanish version of the Kidney Disease Knowledge Survey (KiKS) in Peru: cross-cultural adaptation and validation.

PubMed

Mota-Anaya, Evelin; Yumpo-Cárdenas, Daniel; Alva-Bravo, Edmundo; Wright-Nunes, Julie; Mayta-Tristán, Percy

2016-08-08

Chronic kidney disease (CKD) affects 50 million people globally. Several studies show the importance of implementing interventions that enhance patients’ knowledge about their disease. In 2011 the Kidney Disease Knowledge Survey (KiKS) was developed: a questionnaire that assesses the specific knowledge about chronic kidney disease in pre-dialysis patients. To translate to Spanish, culturally adapt and validate the Kidney Disease Knowledge Survey questionnaire in a population of patients with pre-dialysis chronic kidney disease. We carried out a Spanish translation and cross-cultural adaptation of the Kidney Disease Knowledge Survey questionnaire. Subsequently, we determined its validity and reliability. We determined the validity through construct validity; and reliability by evaluating its internal consistency and its intra-observer reliability (test-retest). We found a good internal consistency (Kuder-Richardson = 0.85). The intra-observer reliability was measured by the intra-class correlation coefficient that yielded a value of 0.78 (95% CI: 0.5-1.0). This value indicated a good reproducibility; also, the mean difference of -1.1 test-retest SD 6.0 (p = 0.369) confirms this finding. The translated Spanish version of the Kidney Disease Knowledge Survey is acceptable and equivalent to the original version; it also has a good reliability, validity and reproducibility. Therefore, it can be used in a population of patients with pre-dialysis chronic kidney disease.

CODEMamb - an observational communication behavior assessment tool for use in ambulatory dementia care.

PubMed

Knebel, Maren; Haberstroh, Julia; Kümmel, Anne; Pantel, Johannes; Schröder, Johannes

2016-12-01

Communication improves well-being and quality of life for both people with dementia and their professional and family caregivers. Individualized communication, as required in informed consent procedures and psychosocial interventions, can improve quality of life, especially in ambulatory settings. However, few valid and reliable instruments exist that enable communication to be assessed and communication and behavioral resources to be identified. We, therefore, extended and adapted the newly developed observational instrument CODEM for use in ambulatory settings (CODEM amb ). Reliability and validity of the new instrument were studied in a total of 171 patients, whereby principal component analysis revealed three important factors: relationship aspects, verbal communication behavior and nonverbal communication behavior. CODEM amb [Formula: see text]s internal consistency, interrater and retest reliability were satisfactory to excellent. Convergent validity indices, as shown by examining correlations with similar but not identical constructs (CERAD-NP verbal subscales), were medium-high, while the divergent validity index (constructional praxis) was relatively low. The relationship to peer-rating remained nonsignificant. Criterion validity was investigated in groups of patients in accordance with their cognitive status. As expected, verbal communication abilities deteriorate faster than the relationship aspects of communication as the disease progresses. In summary, CODEM amb is a reliable and valid instrument that can be used to collect important information with the ultimate aim of supporting communication with people with dementia.

Explicit Instructional Interactions: Observed Stability and Predictive Validity during Early Literacy and Beginning Mathematics Instruction

ERIC Educational Resources Information Center

Doabler, Christian T.; Nelson-Walker, Nancy; Kosty, Derek; Baker, Scott K.; Smolkowski, Keith; Fien, Hank

2013-01-01

In this study, the authors conceptualize teaching episodes such as an integrated set of observable student-teacher interactions. Instructional interactions that take place between teachers and students around critical academic content are a defining characteristic of classroom instruction and a component carefully defined in many education…

Developing an Observation Instrument to Support Authentic Independent Reading Time during School in a Data-Driven World

ERIC Educational Resources Information Center

Williams, Lunetta M.; Hall, Katrina W.; Hedrick, Wanda B.; Lamkin, Marcia; Abendroth, Jennifer

2013-01-01

The purpose of the present study was to develop an instrument to measure reading during in-school independent reading (ISIR). Procedures to establish validity and reliability of the instrument included videotaping and observing students during ISIR, gathering feedback from literacy experts, establishing interrater reliability, crosschecking…

The Learning Behaviors Scale: National Standardization in Trinidad and Tobago

ERIC Educational Resources Information Center

Chao, Jessica L.; McDermott, Paul A.; Watkins, Marley W.; Drogalis, Anna Rhoad; Worrell, Frank C.; Hall, Tracey E.

2018-01-01

This study reports on the national standardization and validation of the Learning Behaviors Scale (LBS) for use in Trinidad and Tobago. The LBS is a teacher rating scale centering on observable behaviors relevant to identifying childhood approaches to classroom learning. Teachers observed a stratified sample of 900 students across the islands'…

Pain Management in Intellectually Disabled Children: Assessment, Treatment, and Translational Research

ERIC Educational Resources Information Center

Valkenburg, Abraham J.; van Dijk, Monique; de Klein, Annelies; van den Anker, Johannes N.; Tibboel, Dick

2010-01-01

The primary focus of pain research in intellectually disabled individuals is still on pain assessment. Several observational pain assessment scales are available, each with its own characteristics, its own target group and its own validated use. Observational studies report differences in the treatment of intra- and postoperative pain of…

Development of the System for Observing Student Movement in Academic Routines and Transitions (SOSMART)

ERIC Educational Resources Information Center

Russ, Laura B.; Webster, Collin A.; Beets, Michael W.; Egan, Catherine; Weaver, Robert Glenn; Harvey, Rachel; Phillips, David S.

2017-01-01

National attention on whole-of-school approaches to decrease children's sedentary behavior and increase physical activity includes movement integration (MI) in classrooms. The purpose of this study was to describe instrument development, reliability, and validity of the System for Observing Student Movement in Academic Routines and Transitions…

An Observational Assessment of Physical Activity Levels and Social Behaviour during Elementary School Recess

ERIC Educational Resources Information Center

Roberts, Simon J.; Fairclough, Stuart J.; Ridgers, Nicola D.; Porteous, Conor

2013-01-01

Objective: The purpose of the present study was to assess children's physical activity, social play behaviour, activity type and social interactions during elementary school recess using a pre-validated systematic observation system. Design: Cross-sectional. Setting: Two elementary schools located in Merseyside, England. Method: Fifty-six…

Teacher Observation of Classroom Adaptation--Checklist: Development and Factor Structure

ERIC Educational Resources Information Center

Koth, Christine W.; Bradshaw, Catherine P.; Leaf, Philip J.

2009-01-01

Two studies examined the validity and factor structure of the Teacher Observation of Classroom Adaptation-Checklist, an instrument used to evaluate school-based programs. The checklist is a cost-effective alternative to the original interview format, and the factor structure is consistent across gender, race, age, and time of administration.…

Evaluating Classroom Interaction with the iPad®: An Updated Stalling's Tool

ERIC Educational Resources Information Center

MacKinnon, Gregory; Schep, Lourens; Borden, Lisa Lunney; Murray-Orr, Anne; Orr, Jeff; MacKinnon, Paula

2016-01-01

A large study of classrooms in the Caribbean context necessitated the use of a validated classroom observation tool. In practice, the paper-version Stalling's instrument (Stallings & Kaskowitz 1974) presented specific challenges with respect to (a) facile data collection and (b) qualitative observations of classrooms. In response to these…

Validation and Continued Development of Methods for Spheromak Simulation

NASA Astrophysics Data System (ADS)

Benedett, Thomas

2016-10-01

The HIT-SI experiment has demonstrated stable sustainment of spheromaks. Determining how the underlying physics extrapolate to larger, higher-temperature regimes is of prime importance in determining the viability of the inductively-driven spheromak. It is thus prudent to develop and validate a computational model that can be used to study current results and study the effect of possible design choices on plasma behavior. A zero-beta Hall-MHD model has shown good agreement with experimental data at 14.5 kHz injector operation. Experimental observations at higher frequency, where the best performance is achieved, indicate pressure effects are important and likely required to attain quantitative agreement with simulations. Efforts to extend the existing validation to high frequency (36-68 kHz) using an extended MHD model implemented in the PSI-TET arbitrary-geometry 3D MHD code will be presented. An implementation of anisotropic viscosity, a feature observed to improve agreement between NIMROD simulations and experiment, will also be presented, along with investigations of flux conserver features and their impact on density control for future SIHI experiments. Work supported by DoE.

Health and Safety Checklist for Early Care and Education Programs to Assess Key National Health and Safety Standards.

PubMed

Alkon, Abbey; Rose, Roberta; Wolff, Mimi; Kotch, Jonathan B; Aronson, Susan S

2016-01-01

The project aims were to (1) develop an observational Health and Safety Checklist to assess health and safety practices and conditions in early care and education (ECE) programs using Stepping Stones To Caring For Our Children, 3rd Edition national standards, (2) pilot test the Checklist, completed by nurse child care health consultants, to assess feasibility, ease of completion, objectivity, validity, and reliability, and (3) revise the Checklist based on the qualitative and quantitative results of the pilot study. The observable national health and safety standards were identified and then rated by health, safety, and child care experts using a Delphi technique to validate the standards as essential to prevent harm and promote health. Then, child care health consultants recruited ECE centers and pilot tested the 124-item Checklist. The pilot study was conducted in Arizona, California and North Carolina. The psychometric properties of the Checklist were assessed. The 37 participating ECE centers had 2627 children from ethnically-diverse backgrounds and primarily low-income families. The child care health consultants found the Checklist easy to complete, objective, and useful for planning health and safety interventions. The Checklist had content and face validity, inter-rater reliability, internal consistency, and concurrent validity. Based on the child care health consultant feedback and psychometric properties of the Checklist, the Checklist was revised and re-written at an 8th grade literacy level. The Health and Safety Checklist provides a standardized instrument of observable, selected national standards to assess the quality of health and safety in ECE centers.

Validation of triaxial accelerometers to measure the lying behaviour of adult domestic horses.

PubMed

DuBois, C; Zakrajsek, E; Haley, D B; Merkies, K

2015-01-01

Examining the characteristics of an animal's lying behaviour, such as frequency and duration of lying bouts, has become increasingly relevant for animal welfare research. Triaxial accelerometers have the advantage of being able to continuously monitor an animal's standing and lying behaviour without relying on live observations or video recordings. Multiple models of accelerometers have been validated for use in monitoring dairy cattle; however, no units have been validated for use in equines. This study tested Onset Pendant G data loggers attached to the hind limb of each of two mature Standardbred horses for a period of 5 days. Data loggers were set to record their position every 20 s. Horses were monitored via live observations during the day and by video recordings during the night to compare activity against accelerometer data. All lying events occurred overnight (three to five lying bouts per horse per night). Data collected from the loggers was converted and edited using a macro program to calculate the number of bouts and the length of time each animal spent lying down by hour and by day. A paired t-test showed no significant difference between the video observations and the output from the data loggers (P=0.301). The data loggers did not distinguish standing hipshot from standing square. Predictability, sensitivity, and specificity were all >99%. This study has validated the use of Onset Pendant G data loggers to determine the frequency and duration of standing and lying bouts in adult horses when set to sample and register readings at 20 s intervals.

TU-FG-209-11: Validation of a Channelized Hotelling Observer to Optimize Chest Radiography Image Processing for Nodule Detection: A Human Observer Study

DOE Office of Scientific and Technical Information (OSTI.GOV)

Sanchez, A; Little, K; Chung, J

Purpose: To validate the use of a Channelized Hotelling Observer (CHO) model for guiding image processing parameter selection and enable improved nodule detection in digital chest radiography. Methods: In a previous study, an anthropomorphic chest phantom was imaged with and without PMMA simulated nodules using a GE Discovery XR656 digital radiography system. The impact of image processing parameters was then explored using a CHO with 10 Laguerre-Gauss channels. In this work, we validate the CHO’s trend in nodule detectability as a function of two processing parameters by conducting a signal-known-exactly, multi-reader-multi-case (MRMC) ROC observer study. Five naive readers scored confidencemore » of nodule visualization in 384 images with 50% nodule prevalence. The image backgrounds were regions-of-interest extracted from 6 normal patient scans, and the digitally inserted simulated nodules were obtained from phantom data in previous work. Each patient image was processed with both a near-optimal and a worst-case parameter combination, as determined by the CHO for nodule detection. The same 192 ROIs were used for each image processing method, with 32 randomly selected lung ROIs per patient image. Finally, the MRMC data was analyzed using the freely available iMRMC software of Gallas et al. Results: The image processing parameters which were optimized for the CHO led to a statistically significant improvement (p=0.049) in human observer AUC from 0.78 to 0.86, relative to the image processing implementation which produced the lowest CHO performance. Conclusion: Differences in user-selectable image processing methods on a commercially available digital radiography system were shown to have a marked impact on performance of human observers in the task of lung nodule detection. Further, the effect of processing on humans was similar to the effect on CHO performance. Future work will expand this study to include a wider range of detection/classification tasks and more observers, including experienced chest radiologists.« less

Using Small UAS for Mission Simulation, Science Validation, and Definition

NASA Astrophysics Data System (ADS)

Abakians, H.; Donnellan, A.; Chapman, B. D.; Williford, K. H.; Francis, R.; Ehlmann, B. L.; Smith, A. T.

2017-12-01

Small Unmanned Aerial Systems (sUAS) are increasingly being used across JPL and NASA for science data collection, mission simulation, and mission validation. They can also be used as proof of concept for development of autonomous capabilities for Earth and planetary exploration. sUAS are useful for reconstruction of topography and imagery for a variety of applications ranging from fault zone morphology, Mars analog studies, geologic mapping, photometry, and estimation of vegetation structure. Imagery, particularly multispectral imagery can be used for identifying materials such as fault lithology or vegetation type. Reflectance maps can be produced for wetland or other studies. Topography and imagery observations are useful in radar studies such as from UAVSAR or the future NISAR mission to validate 3D motions and to provide imagery in areas of disruption where the radar measurements decorrelate. Small UAS are inexpensive to operate, reconfigurable, and agile, making them a powerful platform for validating mission science measurements, and also for providing surrogate data for existing or future missions.

DBS-LC-MS/MS assay for caffeine: validation and neonatal application.

PubMed

Bruschettini, Matteo; Barco, Sebastiano; Romantsik, Olga; Risso, Francesco; Gennai, Iulian; Chinea, Benito; Ramenghi, Luca A; Tripodi, Gino; Cangemi, Giuliana

2016-09-01

DBS might be an appropriate microsampling technique for therapeutic drug monitoring of caffeine in infants. Nevertheless, its application presents several issues that still limit its use. This paper describes a validated DBS-LC-MS/MS method for caffeine. The results of the method validation showed an hematocrit dependence. In the analysis of 96 paired plasma and DBS clinical samples, caffeine levels measured in DBS were statistically significantly lower than in plasma but the observed differences were independent from hematocrit. These results clearly showed the need for extensive validation with real-life samples for DBS-based methods. DBS-LC-MS/MS can be considered to be a good alternative to traditional methods for therapeutic drug monitoring or PK studies in preterm infants.

The Development of an Instrument to Measure the Work Capability of People with Limited Work Capacity (LWC).

PubMed

van Ruitenbeek, Gemma M C; Zijlstra, Fred R H; Hülsheger, Ute R

2018-06-04

Purpose Participation in regular paid jobs positively affects mental and physical health of all people, including people with limited work capacities (LWC), people that are limited in their work capacity as a consequence of their disability, such as chronic mental illness, psychological or developmental disorder. For successful participation, a good fit between on one hand persons' capacities and on the other hand well-suited individual support and a suitable work environment is necessary in order to meet the demands of work. However, to date there is a striking paucity of validated measures that indicate the capability to work of people with LWC and that outline directions for support that facilitate the fit. Goal of the present study was therefore to develop such an instrument. Specifically, we adjusted measures of mental ability, conscientiousness, self-efficacy, and coping by simplifying the language level of these measures to make the scales accessible for people with low literacy. In order to validate these adjusted self-report and observer measures we conducted two studies, using multi-source, longitudinal data. Method Study 1 was a longitudinal multi-source study in which the newly developed instrument was administered twice to people with LWC and their significant other. We statistically tested the psychometric properties with respect to dimensionality and reliability. In Study 2, we collected new multi-source data and conducted a confirmatory factor analysis (CFA). Results Studies yielded a congruous factor structure in both samples, internally consistent measures with adequate content validity of scales and subscales, and high test-retest reliability. The CFA confirmed the factorial validity of the scales. Conclusion The adjusted self-report and the observer scales of mental ability, conscientiousness, self-efficacy, and coping are reliable measures that are well-suited to assess the work capability of people with LWC. Further research is needed to examine criterion-related validity with respect to the work demands such as work-behaviour and task performance.

Validation of psychoanalytic theories: towards a conceptualization of references.

PubMed

Zachrisson, Anders; Zachrisson, Henrik Daae

2005-10-01

The authors discuss criteria for the validation of psychoanalytic theories and develop a heuristic and normative model of the references needed for this. Their core question in this paper is: can psychoanalytic theories be validated exclusively from within psychoanalytic theory (internal validation), or are references to sources of knowledge other than psychoanalysis also necessary (external validation)? They discuss aspects of the classic truth criteria correspondence and coherence, both from the point of view of contemporary psychoanalysis and of contemporary philosophy of science. The authors present arguments for both external and internal validation. Internal validation has to deal with the problems of subjectivity of observations and circularity of reasoning, external validation with the problem of relevance. They recommend a critical attitude towards psychoanalytic theories, which, by carefully scrutinizing weak points and invalidating observations in the theories, reduces the risk of wishful thinking. The authors conclude by sketching a heuristic model of validation. This model combines correspondence and coherence with internal and external validation into a four-leaf model for references for the process of validating psychoanalytic theories.

Construction and Validation of an Observational Scale of Neighborhood Characteristics

ERIC Educational Resources Information Center

McDonell, James R.; Waters, Tracy J.

2011-01-01

This paper reports the development and validation of the Neighborhood Observation Scale, a 41 item measure of neighborhood physical appearance, social appearance, safety, and amenities. Three independent ratings were collected on each of 244 neighborhoods in 132 census block groups in five South Carolina counties, for a total of 732 observations.…

GCOM-W AMSR2 soil moisture product validation using core validation sites

USDA-ARS?s Scientific Manuscript database

The Advanced Microwave Scanning Radiometer 2 (AMSR2) is part of the Global Change Observation Mission-Water (GCOM-W). AMSR2 has filled the gap in passive microwave observations left by the loss of the Advanced Microwave Scanning Radiometer–Earth Observing System (AMSR-E) after almost 10 years of obs...

Validation of the 'United Registries for Clinical Assessment and Research' [UR-CARE], a European Online Registry for Clinical Care and Research in Inflammatory Bowel Disease.

PubMed

Burisch, Johan; Gisbert, Javier P; Siegmund, Britta; Bettenworth, Dominik; Thomsen, Sandra Bohn; Cleynen, Isabelle; Cremer, Anneline; Ding, Nik John Sheng; Furfaro, Federica; Galanopoulos, Michail; Grunert, Philip Christian; Hanzel, Jurij; Ivanovski, Tamara Knezevic; Krustins, Eduards; Noor, Nurulamin; O'Morain, Neil; Rodríguez-Lago, Iago; Scharl, Michael; Tua, Julia; Uzzan, Mathieu; Ali Yassin, Nuha; Baert, Filip; Langholz, Ebbe

2018-04-27

The 'United Registries for Clinical Assessment and Research' [UR-CARE] database is an initiative of the European Crohn's and Colitis Organisation [ECCO] to facilitate daily patient care and research studies in inflammatory bowel disease [IBD]. Herein, we sought to validate the database by using fictional case histories of patients with IBD that were to be entered by observers of varying experience in IBD. Nineteen observers entered five patient case histories into the database. After 6 weeks, all observers entered the same case histories again. For each case history, 20 key variables were selected to calculate the accuracy for each observer. We assumed that the database was such that ≥ 90% of the entered data would be correct. The overall proportion of correctly entered data was calculated using a beta-binomial regression model to account for inter-observer variation and compared to the expected level of validity. Re-test reliability was assessed using McNemar's test. For all case histories, the overall proportion of correctly entered items and their confidence intervals included the target of 90% (Case 1: 92% [88-94%]; Case 2: 87% [83-91%]; Case 3: 93% [90-95%]; Case 4: 97% [94-99%]; Case 5: 91% [87-93%]). These numbers did not differ significantly from those found 6 weeks later [NcNemar's test p > 0.05]. The UR-CARE database appears to be feasible, valid and reliable as a tool and easy to use regardless of prior user experience and level of clinical IBD experience. UR-CARE has the potential to enhance future European collaborations regarding clinical research in IBD.

Introducing the VISAGE project - Visualization for Integrated Satellite, Airborne, and Ground-based data Exploration

NASA Astrophysics Data System (ADS)

Gatlin, P. N.; Conover, H.; Berendes, T.; Maskey, M.; Naeger, A. R.; Wingo, S. M.

2017-12-01

A key component of NASA's Earth observation system is its field experiments, for intensive observation of particular weather phenomena, or for ground validation of satellite observations. These experiments collect data from a wide variety of airborne and ground-based instruments, on different spatial and temporal scales, often in unique formats. The field data are often used with high volume satellite observations that have very different spatial and temporal coverage. The challenges inherent in working with such diverse datasets make it difficult for scientists to rapidly collect and analyze the data for physical process studies and validation of satellite algorithms. The newly-funded VISAGE project will address these issues by combining and extending nascent efforts to provide on-line data fusion, exploration, analysis and delivery capabilities. A key building block is the Field Campaign Explorer (FCX), which allows users to examine data collected during field campaigns and simplifies data acquisition for event-based research. VISAGE will extend FCX's capabilities beyond interactive visualization and exploration of coincident datasets, to provide interrogation of data values and basic analyses such as ratios and differences between data fields. The project will also incorporate new, higher level fused and aggregated analysis products from the System for Integrating Multi-platform data to Build the Atmospheric column (SIMBA), which combines satellite and ground-based observations into a common gridded atmospheric column data product; and the Validation Network (VN), which compiles a nationwide database of coincident ground- and satellite-based radar measurements of precipitation for larger scale scientific analysis. The VISAGE proof-of-concept will target "golden cases" from Global Precipitation Measurement Ground Validation campaigns. This presentation will introduce the VISAGE project, initial accomplishments and near term plans.

The International Arctic Buoy Programme (IABP)

NASA Astrophysics Data System (ADS)

Rigor, I. G.; Ortmeyer, M.

2003-12-01

The Arctic has undergone dramatic changes in weather, climate and environment. It should be noted that many of these changes were first observed and studied using data from the International Arctic Buoy Programme (IABP). For example, IABP data were fundamental to Walsh et al. (1996) showing that atmospheric pressure has decreased, Rigor et al. (2000) showing that air temperatures have increased, and to Proshutinsky and Johnson (1997); Steele and Boyd, (1998); Kwok, (2000); and Rigor et al. (2002) showing that the clockwise circulation of sea ice and the ocean has weakened. All these results relied heavily on data from the IABP. In addition to supporting these studies of climate change, the IABP observations are also used to forecast weather and ice conditions, validate satellite retrievals of environmental variables, to force, validate and initialize numerical models. Over 350 papers have been written using data from the IABP. The observations and datasets of the IABP data are one of the cornerstones for environmental forecasting and research in the Arctic.

Preliminary development of POEAW in enhancing K-11 students’ understanding level on impulse and momentum

NASA Astrophysics Data System (ADS)

Luthfiani, T. A.; Sinaga, P.; Samsudin, A.

2018-05-01

We have been analyzed that there were limited research about Predict-Observe- Explain which use writing process with conceptual change text strategy. This study aims to develop a learning model namely Predict-Observe-Explain-Apply-Writing (POEAW) which is able to enhance students’ understanding level. The research method utilized the 4D model (Defining, Designing, Developing and Disseminating) that is formally limited to Developing Stage. There are four experts who judge the learning component (syntax, lesson plan, teaching material and student worksheet) and matter component (learning quality and content component). The result of this study are obtained expert validity test score average of 87% for learning content and 89% for matter component that means the POEAW is valid and can be tested in classroom learning. This research producing POEAW learning model that has five main steps, Predict, Observe, Explain, Apply and Write. To sum up, we have early developed POEAW in enhancing K-11 students’ understanding levels on impulse and momentum.

Validity of "sputtering and re-condensation" model in active screen cage plasma nitriding process

NASA Astrophysics Data System (ADS)

Saeed, A.; Khan, A. W.; Jan, F.; Abrar, M.; Khalid, M.; Zakaullah, M.

2013-05-01

The validity of "sputtering and re-condensation" model in active screen plasma nitriding for nitrogen mass transfer mechanism is investigated. The dominant species including NH, Fe-I, N2+, N-I and N2 along with Hα and Hβ lines are observed in the optical emission spectroscopy (OES) analysis. Active screen cage and dc plasma nitriding of AISI 316 stainless steel as function of treatment time is also investigated. The structure and phases composition of the nitrided layer is studied by X-ray diffraction (XRD). Surface morphology is studied by scanning electron microscopy (SEM) and hardness profile is obtained by Vicker's microhardness tester. Increasing trend in microhardness is observed in both cases but the increase in active screen plasma nitriding is about 3 times greater than that achieved by dc plasma nitriding. On the basis of metallurgical and OES observations the use of "sputtering and re-condensation" model in active screen plasma nitriding is tested.

Development and validation of self-reported line drawings for assessment of knee malalignment and foot rotation: a cross-sectional comparative study

PubMed Central

2010-01-01

Background For large scale epidemiological studies clinical assessments and radiographs can be impractical and expensive to apply to more than just a sample of the population examined. The study objectives were to develop and validate two novel instruments for self-reported knee malalignment and foot rotation suitable for use in questionnaire studies of knee pain and osteoarthritis. Methods Two sets of line drawings were developed using similar methodology. Each instrument consisted of an explanatory question followed by a set of drawings showing straight alignment, then two each at 7.5° angulation and 15° angulation in the varus/valgus (knee) and inward/outward (foot) directions. Forty one participants undertaking a community study completed the instruments on two occasions. Participants were assessed once by a blinded expert clinical observer with demonstrated excellent reproducibility. Validity was assessed by sensitivity, specificity and likelihood ratio (LR) using the observer as the reference standard. Reliability was assessed using weighted kappa (κ). Knee malalignment was measured on 400 knee radiographs. General linear model was used to assess for the presence of a linear increase in knee alignment angle (measured medially) from self-reported severe varus to mild varus, straight, mild valgus and severe valgus deformity. Results Observer reproducibility (κ) was 0.89 and 0.81 for the knee malalignment and foot rotation instruments respectively. Self-reported participant reproducibility was also good for the knee (κ 0.73) and foot (κ 0.87) instruments. Validity was excellent for the knee malalignment instrument, with a sensitivity of 0.74 (95%CI 0.54, 0.93) and specificity of 0.97 (95%CI 0.94, 1.00). Similarly the foot rotation instrument was also found to have high sensitivity (0.92, 95%CI 0.83, 1.01) and specificity (0.96, 95%CI 0.93, 1.00). The knee alignment angle increased progressively from self reported severe varus to mild varus, straight, mild valgus and severe valgus knee malalignment (ptrend <0.001). Conclusions The two novel instruments appear to provide a valid and reliable assessment of self-reported knee malalignment and foot rotation, and may have a practical use in epidemiological studies. PMID:20565825

DNA Fingerprinting Validates Seed Dispersal Curves from Observational Studies in the Neotropical Legume Parkia

PubMed Central

Heymann, Eckhard W.; Lüttmann, Kathrin; Michalczyk, Inga M.; Saboya, Pedro Pablo Pinedo; Ziegenhagen, Birgit; Bialozyt, Ronald

2012-01-01

Background Determining the distances over which seeds are dispersed is a crucial component for examining spatial patterns of seed dispersal and their consequences for plant reproductive success and population structure. However, following the fate of individual seeds after removal from the source tree till deposition at a distant place is generally extremely difficult. Here we provide a comparison of observationally and genetically determined seed dispersal distances and dispersal curves in a Neotropical animal-plant system. Methodology/Principal Findings In a field study on the dispersal of seeds of three Parkia (Fabaceae) species by two Neotropical primate species, Saguinus fuscicollis and Saguinus mystax, in Peruvian Amazonia, we observationally determined dispersal distances. These dispersal distances were then validated through DNA fingerprinting, by matching DNA from the maternally derived seed coat to DNA from potential source trees. We found that dispersal distances are strongly right-skewed, and that distributions obtained through observational and genetic methods and fitted distributions do not differ significantly from each other. Conclusions/Significance Our study showed that seed dispersal distances can be reliably estimated through observational methods when a strict criterion for inclusion of seeds is observed. Furthermore, dispersal distances produced by the two primate species indicated that these primates fulfil one of the criteria for efficient seed dispersers. Finally, our study demonstrated that DNA extraction methods so far employed for temperate plant species can be successfully used for hard-seeded tropical plants. PMID:22514748

Apparent and internal validity of a Monte Carlo-Markov model for cardiovascular disease in a cohort follow-up study.

PubMed

Nijhuis, Rogier L; Stijnen, Theo; Peeters, Anna; Witteman, Jacqueline C M; Hofman, Albert; Hunink, M G Myriam

2006-01-01

To determine the apparent and internal validity of the Rotterdam Ischemic heart disease & Stroke Computer (RISC) model, a Monte Carlo-Markov model, designed to evaluate the impact of cardiovascular disease (CVD) risk factors and their modification on life expectancy (LE) and cardiovascular disease-free LE (DFLE) in a general population (hereinafter, these will be referred to together as (DF)LE). The model is based on data from the Rotterdam Study, a cohort follow-up study of 6871 subjects aged 55 years and older who visited the research center for risk factor assessment at baseline (1990-1993) and completed a follow-up visit 7 years later (original cohort). The transition probabilities and risk factor trends used in the RISC model were based on data from 3501 subjects (the study cohort). To validate the RISC model, the number of simulated CVD events during 7 years' follow-up were compared with the observed number of events in the study cohort and the original cohort, respectively, and simulated (DF)LEs were compared with the (DF)LEs calculated from multistate life tables. Both in the study cohort and in the original cohort, the simulated distribution of CVD events was consistent with the observed number of events (CVD deaths: 7.1% v. 6.6% and 7.4% v. 7.6%, respectively; non-CVD deaths: 11.2% v. 11.5% and 12.9% v. 13.0%, respectively). The distribution of (DF)LEs estimated with the RISC model consistently encompassed the (DF)LEs calculated with multistate life tables. The simulated events and (DF)LE estimates from the RISC model are consistent with observed data from a cohort follow-up study.

Research Diagnostic Criteria for Temporomandibular Disorders: Validity of Axis I Diagnoses

PubMed Central

Truelove, Edmond; Pan, Wei; Look, John O.; Mancl, Lloyd A.; Ohrbach, Richard K.; Velly, Ana; Huggins, Kimberly; Lenton, Patricia; Schiffman, Eric L.

2011-01-01

AIMS To estimate the criterion validity of the Research Diagnostic Criteria for Temporomandibular Disorders (RDC/TMD) Axis I TMD diagnoses. METHODS A combined total of 614 TMD community and clinic cases and 91 controls were examined at 3 study sites. RDC/TMD Axis I diagnoses were algorithmically derived from an examination performed by calibrated dental hygienists. Reference standards (Gold Standards) were established by means of consensus diagnoses rendered by 2 TMD experts using all available clinical data, including imaging studies. Validity of the RDC/TMD Axis I TMD diagnoses was estimated relative to reference-standard diagnoses (gold standard diagnoses). Target sensitivity and specificity were set a priori at ≥ 0.70 and ≥ 0.95, respectively. RESULTS Target sensitivity and specificity were not observed for any of the 8 RDC/TMD diagnoses. The highest validity was achieved for Group Ia myofascial pain (sensitivity 0.65, specificity 0.92) and Group Ib myofascial pain with limited opening (sensitivity 0.79, specificity 0.92). Target sensitivity and specificity were observed only when both Group I diagnoses were combined (0.87 and 0.98, respectively). For Group II (disc displacements) and Group III (arthralgia, arthritis, arthrosis) diagnoses, all estimates for sensitivity were below target (0.03 to 0.53), and specificity ranged from below to on target (0.86 to 0.99). CONCLUSION The RDC/TMD Axis I TMD diagnoses did not reach the targets set at sensitivity of ≥ 0.70 and specificity of ≥ 0.95. Target validity was obtained only for myofascial pain without differentiation between normal and limited opening. Revision of the current Axis I TMD diagnostic algorithms is warranted to improve their validity. PMID:20213030

Reliability and validity of the Turkish version of the Berg Balance Scale.

PubMed

Sahin, Fusun; Yilmaz, Figen; Ozmaden, Asli; Kotevolu, Nurdan; Sahin, Tulay; Kuran, Banu

2008-01-01

The purpose of this study was to develop a Turkish version of the Berg Balance Scale (BBS) and assess its reliability and validity. Sixty healthy volunteers older than 65 years were included in to the study. Subjects who had lower extremity amputation, or were armchair or bedridden were excluded. After translation process, the Turkish version of the scale was administered to each participant twice with an interval of 2 weeks. The intraclass correlation coefficient (ICC) was calculated to assess intra- and inter-observer reliability. Chronbach alpha was calculated to evaluate internal consistency of the total BBS score. Interclass correlation coefficient was calcuated to examine test-retest reliability. Convergent validity was assessed by correlating the scale with Modified Barthel Index (MBI) and Timed Up and Go Test (TUG). Construct validity was assessed with factor analysis. The mean age in years of the participants were 77.00+/-5.67 (range: 67-92 yrs). The ICC for intra- and inter- observer reliability was 0.98 (p<0.0001) and 0.97 (p<0.0001), respectively. Chronbach alpha of the Turkish version of the BBS was 0.98. The test-retest reliability (ICC) of the Turkish version of the BBS was determined as 0.98 for the total score, and ranged from 0.86-0.99 for individual items. In terms of validity, the Turkish version of the BBS was correlated with the MBI (in positive direction) and TUG (in negative direction) (r=0.67 p<0.0001; r=-0.75 p<0.0001, respectively). The Turkish version of the BBS is a reliable and valid scale to be used in balance assessment of Turkish older adults.

The influence of validity criteria on Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) test-retest reliability among high school athletes.

PubMed

Brett, Benjamin L; Solomon, Gary S

2017-04-01

Research findings to date on the stability of Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) Composite scores have been inconsistent, requiring further investigation. The use of test validity criteria across these studies also has been inconsistent. Using multiple measures of stability, we examined test-retest reliability of repeated ImPACT baseline assessments in high school athletes across various validity criteria reported in previous studies. A total of 1146 high school athletes completed baseline cognitive testing using the online ImPACT test battery at two time periods of approximately two-year intervals. No participant sustained a concussion between assessments. Five forms of validity criteria used in previous test-retest studies were applied to the data, and differences in reliability were compared. Intraclass correlation coefficients (ICCs) ranged in composite scores from .47 (95% confidence interval, CI [.38, .54]) to .83 (95% CI [.81, .85]) and showed little change across a two-year interval for all five sets of validity criteria. Regression based methods (RBMs) examining the test-retest stability demonstrated a lack of significant change in composite scores across the two-year interval for all forms of validity criteria, with no cases falling outside the expected range of 90% confidence intervals. The application of more stringent validity criteria does not alter test-retest reliability, nor does it account for some of the variation observed across previously performed studies. As such, use of the ImPACT manual validity criteria should be utilized in the determination of test validity and in the individualized approach to concussion management. Potential future efforts to improve test-retest reliability are discussed.

Validation of Computerized Automatic Calculation of the Sequential Organ Failure Assessment Score

PubMed Central

Harrison, Andrew M.; Pickering, Brian W.; Herasevich, Vitaly

2013-01-01

Purpose. To validate the use of a computer program for the automatic calculation of the sequential organ failure assessment (SOFA) score, as compared to the gold standard of manual chart review. Materials and Methods. Adult admissions (age > 18 years) to the medical ICU with a length of stay greater than 24 hours were studied in the setting of an academic tertiary referral center. A retrospective cross-sectional analysis was performed using a derivation cohort to compare automatic calculation of the SOFA score to the gold standard of manual chart review. After critical appraisal of sources of disagreement, another analysis was performed using an independent validation cohort. Then, a prospective observational analysis was performed using an implementation of this computer program in AWARE Dashboard, which is an existing real-time patient EMR system for use in the ICU. Results. Good agreement between the manual and automatic SOFA calculations was observed for both the derivation (N=94) and validation (N=268) cohorts: 0.02 ± 2.33 and 0.29 ± 1.75 points, respectively. These results were validated in AWARE (N=60). Conclusion. This EMR-based automatic tool accurately calculates SOFA scores and can facilitate ICU decisions without the need for manual data collection. This tool can also be employed in a real-time electronic environment. PMID:23936639

Human factors engineering and design validation for the redesigned follitropin alfa pen injection device.

PubMed

Mahony, Mary C; Patterson, Patricia; Hayward, Brooke; North, Robert; Green, Dawne

2015-05-01

To demonstrate, using human factors engineering (HFE), that a redesigned, pre-filled, ready-to-use, pre-asembled follitropin alfa pen can be used to administer prescribed follitropin alfa doses safely and accurately. A failure modes and effects analysis identified hazards and harms potentially caused by use errors; risk-control measures were implemented to ensure acceptable device use risk management. Participants were women with infertility, their significant others, and fertility nurse (FN) professionals. Preliminary testing included 'Instructions for Use' (IFU) and pre-validation studies. Validation studies used simulated injections in a representative use environment; participants received prior training on pen use. User performance in preliminary testing led to IFU revisions and a change to outer needle cap design to mitigate needle stick potential. In the first validation study (49 users, 343 simulated injections), in the FN group, one observed critical use error resulted in a device design modification and another in an IFU change. A second validation study tested the mitigation strategies; previously reported use errors were not repeated. Through an iterative process involving a series of studies, modifications were made to the pen design and IFU. Simulated-use testing demonstrated that the redesigned pen can be used to administer follitropin alfa effectively and safely.

Validation of the OMRON M7 (HEM-780-E) blood pressure measuring device in a population requiring large cuff use according to the International Protocol of the European Society of Hypertension.

PubMed

El Feghali, Ramzi N; Topouchian, Jirar A; Pannier, Bruno M; El Assaad, Hiba A; Asmar, Roland G

2007-06-01

A high percentage of hypertensive patients present an arm circumference of over 32 cm; the use of a large cuff is therefore recommended. Validation studies are usually performed in the general population using a standard-size cuff. The aim of this study was to assess the accuracy of the Omron M7 device in a population with an arm circumference ranging from 32 to 42 cm. A validation study was performed according to the International Protocol of the European Society of Hypertension. This protocol is divided into two phases: the first phase is performed on 15 selected participants (45 pairs of blood-pressure measurements); if the device passes this phase, 18 supplementary participants are included (54 pairs of blood-pressure measurements), making a total number of 33 participants (99 pairs of blood-pressure measurements), on whom the analysis is performed. For each participant, four blood-pressure measurements were performed simultaneously by two trained observers, using mercury sphygmomanometers fitted with a Y tube; the measurements alternated with three by the test device. The difference between the blood-pressure value given by the device and that obtained by the two observers (mean of the two observations) was calculated for each measure. The 99 pairs of blood-pressure differences were classified into three categories (

SAMOS Surface Fluxes

NASA Astrophysics Data System (ADS)

Smith, Shawn; Bourassa, Mark

2014-05-01

The development of a new surface flux dataset based on underway meteorological observations from research vessels will be presented. The research vessel data center at the Florida State University routinely acquires, quality controls, and distributes underway surface meteorological and oceanographic observations from over 30 oceanographic vessels. These activities are coordinated by the Shipboard Automated Meteorological and Oceanographic System (SAMOS) initiative in partnership with the Rolling Deck to Repository (R2R) project. Recently, the SAMOS data center has used these underway observations to produce bulk flux estimates for each vessel along individual cruise tracks. A description of this new flux product, along with the underlying data quality control procedures applied to SAMOS observations, will be provided. Research vessels provide underway observations at high-temporal frequency (1 min. sampling interval) that include navigational (position, course, heading, and speed), meteorological (air temperature, humidity, wind, surface pressure, radiation, rainfall), and oceanographic (surface sea temperature and salinity) samples. Vessels recruited to the SAMOS initiative collect a high concentration of data within the U.S. continental shelf and also frequently operate well outside routine shipping lanes, capturing observations in extreme ocean environments (Southern, Arctic, South Atlantic, and South Pacific oceans). These observations are atypical for their spatial and temporal sampling, making them very useful for many applications including validation of numerical models and satellite retrievals, as well as local assessments of natural variability. Individual SAMOS observations undergo routine automated quality control and select vessels receive detailed visual data quality inspection. The result is a quality-flagged data set that is ideal for calculating turbulent flux estimates. We will describe the bulk flux algorithms that have been applied to the observations and the choices of constants that are used. Analysis of the preliminary SAMOS flux products will be presented, including spatial and temporal coverage for each derived parameter. The unique quality and sampling locations of research vessel observations and their independence from many models and products makes them ideal for validation studies. The strengths and limitations of research observations for flux validation studies will be discussed. The authors welcome a discussion with the flux community regarding expansion of the SAMOS program to include additional international vessels, thus facilitating and expansion of this research vessel-based flux product.

[The psychometric properties of the Turkish version of Myocardial Infarction Dimensional Assessment Scale (MIDAS)].

PubMed

Yılmaz, Emel; Eser, Erhan; Şekuri, Cevad; Kültürsay, Hakan

2011-08-01

The purpose of this study was to describe the psychometric properties of the Myocardial Infarction Dimensional Assessment Scale (MIDAS). This is a methodological cultural adaptation study. The MIDAS consists of 35-items covering seven domains: physical activity, insecurity, emotional reaction, dependency, diet, concerns over medication, and side effects which are rated on a five-point Likert scale from 1: never to 5:always. The highest score of MIDAS is 100.Quality of life (QOL) decreases as the score of scale increases. Overall 185 myocardial infarction (MI) patients were enrolled in this study. Cronbach alpha was used for the reliability analysis. The criterion validity, structural validity, and sensitivity analysis approach was used for validity analysis. New York Heart Association (NYHA) and the Canadian Cardiovascular Society Functional Classifications (CCSFC) for testing the criterion validity; SF-36 for construct validity testing of the Turkish version of the MIDAS were used. The range of Cronbach alpha values is 0.79-0.90 for seven domains of the scale. No problematic items were observed for the entire scale. Medication related domains of the MIDAS showed considerable floor effects (35.7%-22.7%). Confirmatory Factor analysis indicators [Comparative Fit Index (CFI) =0.95 and Root Mean Square Error of Approximation (RMSEA) =0.075] supported the construct validity of MIDAS. Convergent validity of the MIDAS was confirmed with correlation of SF-36 scale where appropriate. Criterion validity results was also satisfactory by comparing different stages of the NYHA and the CCSFC (p<0.05). Overall results revealed that Turkish version of the MIDAS is a reliable and valid instrument.

Validation of Clinical Observations of Mastication in Persons with ALS.

PubMed

Simione, Meg; Wilson, Erin M; Yunusova, Yana; Green, Jordan R

2016-06-01

Amyotrophic lateral sclerosis (ALS) is a progressive neurological disease that can result in difficulties with mastication leading to malnutrition, choking or aspiration, and reduced quality of life. When evaluating mastication, clinicians primarily observe spatial and temporal aspects of jaw motion. The reliability and validity of clinical observations for detecting jaw movement abnormalities is unknown. The purpose of this study is to determine the reliability and validity of clinician-based ratings of chewing performance in neuro-typical controls and persons with varying degrees of chewing impairments due to ALS. Adults chewed a solid food consistency while full-face video were recorded along with jaw kinematic data using a 3D optical motion capture system. Five experienced speech-language pathologists watched the videos and rated the spatial and temporal aspects of chewing performance. The jaw kinematic data served as the gold-standard for validating the clinicians' ratings. Results showed that the clinician-based rating of temporal aspects of chewing performance had strong inter-rater reliability and correlated well with comparable kinematic measures. In contrast, the reliability of rating the spatial and spatiotemporal aspects of chewing (i.e., range of motion of the jaw, consistency of the chewing pattern) was mixed. Specifically, ratings of range of motion were at best only moderately reliable. Ratings of chewing movement consistency were reliable but only weakly correlated with comparable measures of jaw kinematics. These findings suggest that clinician ratings of temporal aspects of chewing are appropriate for clinical use, whereas ratings of the spatial and spatiotemporal aspects of chewing may not be reliable or valid.

Genome-based prediction of test cross performance in two subsequent breeding cycles.

PubMed

Hofheinz, Nina; Borchardt, Dietrich; Weissleder, Knuth; Frisch, Matthias

2012-12-01

Genome-based prediction of genetic values is expected to overcome shortcomings that limit the application of QTL mapping and marker-assisted selection in plant breeding. Our goal was to study the genome-based prediction of test cross performance with genetic effects that were estimated using genotypes from the preceding breeding cycle. In particular, our objectives were to employ a ridge regression approach that approximates best linear unbiased prediction of genetic effects, compare cross validation with validation using genetic material of the subsequent breeding cycle, and investigate the prospects of genome-based prediction in sugar beet breeding. We focused on the traits sugar content and standard molasses loss (ML) and used a set of 310 sugar beet lines to estimate genetic effects at 384 SNP markers. In cross validation, correlations >0.8 between observed and predicted test cross performance were observed for both traits. However, in validation with 56 lines from the next breeding cycle, a correlation of 0.8 could only be observed for sugar content, for standard ML the correlation reduced to 0.4. We found that ridge regression based on preliminary estimates of the heritability provided a very good approximation of best linear unbiased prediction and was not accompanied with a loss in prediction accuracy. We conclude that prediction accuracy assessed with cross validation within one cycle of a breeding program can not be used as an indicator for the accuracy of predicting lines of the next cycle. Prediction of lines of the next cycle seems promising for traits with high heritabilities.

Assessing Psychodynamic Conflict.

PubMed

Simmonds, Joshua; Constantinides, Prometheas; Perry, J Christopher; Drapeau, Martin; Sheptycki, Amanda R

2015-09-01

Psychodynamic psychotherapies suggest that symptomatic relief is provided, in part, with the resolution of psychic conflicts. Clinical researchers have used innovative methods to investigate such phenomenon. This article aims to review the literature on quantitative psychodynamic conflict rating scales. An electronic search of the literature was conducted to retrieve quantitative observer-rated scales used to assess conflict noting each measure's theoretical model, information source, and training and clinical experience required. Scales were also examined for levels of reliability and validity. Five quantitative observer-rated conflict scales were identified. Reliability varied from poor to excellent with each measure demonstrating good validity. However a small number of studies and limited links to current conflict theory suggest further clinical research is needed.

Validity of a food frequency questionnaire to estimate long-chain polyunsaturated fatty acid intake among Japanese women in early and late pregnancy.

PubMed

Kobayashi, Minatsu; Jwa, Seung Chik; Ogawa, Kohei; Morisaki, Naho; Fujiwara, Takeo

2017-01-01

The relative validity of food frequency questionnaires for estimating long-chain polyunsaturated fatty acid (LC-PUFA) intake among pregnant Japanese women is currently unclear. The aim of this study was to verify the external validity of a food frequency questionnaire, originally developed for non-pregnant adults, to assess the dietary intake of LC-PUFA using dietary records and serum phospholipid levels among Japanese women in early and late pregnancy. A validation study involving 188 participants in early pregnancy and 169 participants in late pregnancy was conducted. Intake LC-PUFA was estimated using a food frequency questionnaire and evaluated using a 3-day dietary record and serum phospholipid concentrations in both early and late pregnancy. The food frequency questionnaire provided estimates of eicosapentaenoic acid (EPA) and docosahexaenoic acid (DHA) intake with higher precision than dietary records in both early and late pregnancy. Significant correlations were observed for LC-PUFA intake estimated using dietary records in both early and late pregnancy, particularly for EPA and DHA (correlation coefficients ranged from 0.34 to 0.40, p < 0.0001). Similarly, high correlations for EPA and DHA in serum phospholipid composition were also observed in both early and late pregnancy (correlation coefficients ranged 0.27 to 0.34, p < 0.0001). Our findings suggest that the food frequency questionnaire, which was originally designed for non-pregnant adults and was evaluated in this study against dietary records and biological markers, has good validity for assessing LC-PUFA intake, especially EPA and DHA intake, among Japanese women in early and late pregnancy. Copyright © 2016 The Authors. Production and hosting by Elsevier B.V. All rights reserved.

Validity and reliability of global operative assessment of laparoscopic skills (GOALS) in novice trainees performing a laparoscopic cholecystectomy.

PubMed

Kramp, Kelvin H; van Det, Marc J; Hoff, Christiaan; Lamme, Bas; Veeger, Nic J G M; Pierie, Jean-Pierre E N

2015-01-01

Global Operative Assessment of Laparoscopic Skills (GOALS) assessment has been designed to evaluate skills in laparoscopic surgery. A longitudinal blinded study of randomized video fragments was conducted to estimate the validity and reliability of GOALS in novice trainees. In total, 10 trainees each performed 6 consecutive laparoscopic cholecystectomies. Sixty procedures were recorded on video. Video fragments of (1) opening of the peritoneum; (2) dissection of Calot's triangle and achievement of critical view of safety; and (3) dissection of the gallbladder from the liver bed were blinded, randomized, and rated by 2 consultant surgeons using GOALS. Also, a grade was given for overall competence. The correlation of GOALS with live observation Objective Structured Assessment of Technical Skills (OSATS) scores was calculated. Construct validity was estimated using the Friedman 2-way analysis of variance by ranks and the Wilcoxon signed-rank test. The interrater reliability was calculated using the absolute and consistency agreement 2-way random-effects model intraclass correlation coefficient. A high correlation was found between mean GOALS score (r = 0.879, p = 0.021) and mean OSATS score. The GOALS score increased significantly across the 6 procedures (p = 0.002). The trainees performed significantly better on their sixth when compared with their first cholecystectomy (p = 0.004). The consistency agreement interrater reliability was 0.37 for the mean GOALS score (p = 0.002) and 0.55 for overall competence (p < 0.001) of the 3 video fragments. The validity observed in this randomized blinded longitudinal study supports the existing evidence that GOALS is a valid tool for assessment of novice trainees. A relatively low reliability was found in this study. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

MR Imaging Anatomy in Neurodegeneration: A Robust Volumetric Parcellation Method of the Frontal Lobe Gyri with Quantitative Validation in Patients with Dementia

PubMed Central

Iordanova, B.; Rosenbaum, D.; Norman, D.; Weiner, M.; Studholme, C.

2007-01-01

BACKGROUND AND PURPOSE Brain volumetry is widely used for evaluating tissue degeneration; however, the parcellation methods are rarely validated and use arbitrary planes to mark boundaries of brain regions. The goal of this study was to develop, validate, and apply an MR imaging tracing method for the parcellation of 3 major gyri of the frontal lobe, which uses only local landmarks intrinsic to the structures of interest, without the need for global reorientation or the use of dividing planes or lines. METHODS Studies were performed on 25 subjects—healthy controls and subjects diagnosed with Lewy body dementia and Alzheimer disease—with significant variation in the underlying gyral anatomy and state of atrophy. The protocol was evaluated by using multiple observers tracing scans of subjects diagnosed with neurodegenerative disease and those aging normally, and the results were compared by spatial overlap agreement. To confirm the results, observers marked the same locations in different brains. We illustrated the variabilities of the key boundaries that pose the greatest challenge to defining consistent parcellations across subjects. RESULTS The resulting gyral volumes were evaluated, and their consistency across raters was used as an additional assessment of the validity of our marking method. The agreement on a scale of 0–1 was found to be 0.83 spatial and 0.90 volumetric for the same rater and 0.85 spatial and 0.90 volumetric for 2 different raters. The results revealed that the protocol remained consistent across different neurodegenerative conditions. CONCLUSION Our method provides a simple and reliable way for the volumetric evaluation of frontal lobe neurodegeneration and can be used as a resource for larger comparative studies as well as a validation procedure of automated algorithms. PMID:16971629

German validation of the Conners Adult ADHD Rating Scales (CAARS) II: reliability, validity, diagnostic sensitivity and specificity.

PubMed

Christiansen, H; Kis, B; Hirsch, O; Matthies, S; Hebebrand, J; Uekermann, J; Abdel-Hamid, M; Kraemer, M; Wiltfang, J; Graf, E; Colla, M; Sobanski, E; Alm, B; Rösler, M; Jacob, C; Jans, T; Huss, M; Schimmelmann, B G; Philipsen, A

2012-07-01

The German version of the Conners Adult ADHD Rating Scales (CAARS) has proven to show very high model fit in confirmative factor analyses with the established factors inattention/memory problems, hyperactivity/restlessness, impulsivity/emotional lability, and problems with self-concept in both large healthy control and ADHD patient samples. This study now presents data on the psychometric properties of the German CAARS-self-report (CAARS-S) and observer-report (CAARS-O) questionnaires. CAARS-S/O and questions on sociodemographic variables were filled out by 466 patients with ADHD, 847 healthy control subjects that already participated in two prior studies, and a total of 896 observer data sets were available. Cronbach's-alpha was calculated to obtain internal reliability coefficients. Pearson correlations were performed to assess test-retest reliability, and concurrent, criterion, and discriminant validity. Receiver Operating Characteristics (ROC-analyses) were used to establish sensitivity and specificity for all subscales. Coefficient alphas ranged from .74 to .95, and test-retest reliability from .85 to .92 for the CAARS-S, and from .65 to .85 for the CAARS-O. All CAARS subscales, except problems with self-concept correlated significantly with the Barrett Impulsiveness Scale (BIS), but not with the Wender Utah Rating Scale (WURS). Criterion validity was established with ADHD subtype and diagnosis based on DSM-IV criteria. Sensitivity and specificity were high for all four subscales. The reported results confirm our previous study and show that the German CAARS-S/O do indeed represent a reliable and cross-culturally valid measure of current ADHD symptoms in adults. Copyright © 2011 Elsevier Masson SAS. All rights reserved.

Cultural adaptation and validation of the Lasater Clinical Judgment Rubric in nursing students in Spain.

PubMed

Román-Cereto, Montserrat; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; García-Gámez, Marina; León-Campos, Alvaro; Fernández-Ordóñez, Eloisa; Ruiz-García, Maria Luisa; Martí-García, C; López-Leiva, Inmaculada; Lasater, Kathie; Morales-Asencio, José Miguel

2018-05-01

The clinical judgment and decision-making abilities of nurses can influence many health outcomes, hence the importance of addressing these qualities in university studies. In this respect, clinical simulation is a commonly employed teaching method. The evaluation of simulation activities requires standardised instruments, such as the Lasater Clinical Judgment Rubric, which is widely used for this purpose, although a culturally adapted and validated version in Spain is not available. To obtain a Spanish culturally adapted and validated version of the rubric for undergraduate students of nursing. Cultural adaptation and psychometric validation study carried out with undergraduate nursing students in the simulation laboratories at the University of Málaga (Spain). A process of translation/back-translation and cultural adaptation was carried out in accordance with international standards. The rubric was empirically evaluated in standardised scenarios with high and medium-fidelity simulators. Each student took part in two different simulation sessions, led by two instructors. In each simulation, the data were collected by two independent observers. 152 observations were obtained from 76 students. The interobserver reliability was high, with an intraclass correlation coefficient of 0.93 (95% CI 0.92-0.95) (p = 0.0001) and Cronbach's alpha of 0.93. According to the confirmatory factor analysis, the fit of the model was satisfactory in all indices, with a χ 2 /df value of 1.08, GFI 0.96, TLI 0.99, NFI 0.97 and RMSEA 0.24 (90% CI 0.000-0.066). The rubric obtained is culturally adapted to the Spanish educational context, and is valid and reliable for nursing students. Further prospective studies should be undertaken to evaluate the responsiveness, potential for transfer to clinical practice and cost-benefit ratios of different simulation designs. Copyright © 2018 Elsevier Ltd. All rights reserved.

Validating the Construct of Coercion in Family Routines: Expanding the Unit of Analysis in Behavioral Assessment with Families of Children with Developmental Disabilities

PubMed Central

Lucyshyn, Joseph M.; Irvin, Larry K.; Blumberg, E. Richard; Laverty, Robelyn; Horner, Robert H.; Sprague, Jeffrey R.

2015-01-01

We conducted an observational study of parent-child interaction in home activity settings (routines) of families raising young children with developmental disabilities and problem behavior. Our aim was to empirically investigate the construct validity of coercion in typical but unsuccessful family routines. The long-term goal was to develop an expanded ecological unit of analysis that may contribute to sustainable behavioral family intervention. Ten children with autism and/or mental retardation and their families participated. Videotaped observations were conducted in typical but unsuccessful home routines. Parent-child interaction in routines was coded in real time and sequential analyses were conducted to test hypotheses about coercive processes. Following observation, families were interviewed about the social validity of the construct. Results confirmed the presence of statistically significant, attention-driven coercive processes in routines in which parents were occupied with non-child centered tasks. Results partially confirmed the presence of escape-driven coercive processes in routines in which parent demands are common. Additional analysis revealed an alternative pattern with greater magnitude. Family perspectives suggested the social validity of the construct. Results are discussed in terms of preliminary, partial evidence for coercive processes in routines of families of children with developmental disabilities. Implications for behavioral assessment and intervention design are discussed. PMID:26321883

Development of the Academic Performance Perception Scale

ERIC Educational Resources Information Center

Gur, Recep

2017-01-01

Purpose: While numerous studies about academic performance that focused on only one factor, studies aiming to measure academicians' perceptions across many factors have not been observed in the literature. The current study aims to fill this gap and become a resource for upcoming studies. The aim of this study is to develop a valid and reliable…

[Validity of the questionnaire MOS-SSS of social support in neoplastic patients].

PubMed

Costa Requena, Gema; Salamero, Manuel; Gil, Francisco

2007-05-12

Previous studies have pointed out how the perception of social support benefits the wellbeing of patients. The main objective in this study is to adapt and validate the MOS-SSS (Medical Outcomes Study-Social Support Survey) questionnaire to measure social support. In a sample of 400 oncology out-patients, in order to validate the MOS-SSS questionnaire, we have applied a exploratory factorial analysis. The factors were extracted by principal components and varimax rotation. Then, we compared the dimensions of the questionnaire with other variables as size of social network, sex and age. We have observed a high reliability of the MOS-SSS questionnaire, with the alpha coefficient around 0.94 . By a factorial analysis, we have extracted 3 factors: emotional/informational support, affective support and instrumental support. The fourth dimension included in the original questionnaire, positive social interaction, was included in the emotional/informational support dimension. Comparing the mean scores of the 3 dimensions with other variables (number of members in the family and friends, sex and age), we have observed that a high number of relatives and friends were related with a higher perception of social support. However, the men received more instrumental and emotional/informational support than women; and the age was not related with the perception of social support in patients with cancer. The MOS-SSS questionnaire is a valid instrument to assess the multidimensionality of the perception of social support in Spanish cancer patients.

Validity and Diagnostic Accuracy of Scores from the Autism Diagnostic Observation Schedule-Generic

ERIC Educational Resources Information Center

Reid, Melissa A.

2012-01-01

The purpose of this study was to examine the internal structure, relationships with other variables, and diagnostic accuracy of scores on the Autism Diagnostic Observation Schedule-Generic (ADOS-G; Lord et al., 1999) for the purpose of diagnostic decision-making. Participants were 462 children enrolled in a public school district in the southern…

Conventional Energy and Macronutrient Variables Distort the Accuracy of Children’s Dietary Reports: Illustrative Data from a Validation Study of Effect of Order Prompts

PubMed Central

Baxter, Suzanne Domel; Smith, Albert F.; Hardin, James W.; Nichols, Michele D.

2008-01-01

Objective Validation-study data are used to illustrate that conventional energy and macronutrient (protein, carbohydrate, fat) variables, which disregard accuracy of reported items and amounts, misrepresent reporting accuracy. Reporting-error-sensitive variables are proposed which classify reported items as matches or intrusions, and reported amounts as corresponding or overreported. Methods 58 girls and 63 boys were each observed eating school meals on 2 days separated by ≥4 weeks, and interviewed the morning after each observation day. One interview per child had forward-order (morning-to-evening) prompts; one had reverse-order prompts. Original food-item-level analyses found a sex-x-order prompt interaction for omission rates. Current analyses compared reference (observed) and reported information transformed to energy and macronutrients. Results Using conventional variables, reported amounts were less than reference amounts (ps<0.001; paired t-tests); report rates were higher for the first than second interview for energy, protein, and carbohydrate (ps≤0.049; mixed models). Using reporting-error-sensitive variables, correspondence rates were higher for girls with forward- but boys with reverse-order prompts (ps≤0.041; mixed models); inflation ratios were lower with reverse- than forward-order prompts for energy, carbohydrate, and fat (ps≤0.045; mixed models). Conclusions Conventional variables overestimated reporting accuracy and masked order prompt and sex effects. Reporting-error-sensitive variables are recommended when assessing accuracy for energy and macronutrients in validation studies. PMID:16959308

New Sentinel-2 radiometric validation approaches (SEOM program)

NASA Astrophysics Data System (ADS)

Bruniquel, Véronique; Lamquin, Nicolas; Ferron, Stéphane; Govaerts, Yves; Woolliams, Emma; Dilo, Arta; Gascon, Ferran

2016-04-01

SEOM is an ESA program element whose one of the objectives aims at launching state-of-the-art studies for the scientific exploitation of operational missions. In the frame of this program, ESA awarded ACRI-ST and its partners Rayference and National Physical Laboratory (NPL) early 2016 for a R&D study on the development and intercomparison of algorithms for validating the Sentinel-2 radiometric L1 data products beyond the baseline algorithms used operationally in the frame of the S2 Mission Performance Centre. In this context, several algorithms have been proposed and are currently in development: The first one is based on the exploitation of Deep Convective Cloud (DCC) observations over ocean. This method allows an inter-band radiometry validation from the blue to the NIR (typically from B1 to B8a) from a reference band already validated for example with the well-known Rayleigh method. Due to their physical properties, DCCs appear from the remote sensing point of view to have bright and cold tops and they can be used as invariant targets to monitor the radiometric response degradation of reflective solar bands. The DCC approach is statistical i.e. the method shall be applied on a large number of measurements to derive reliable statistics and decrease the impact of the perturbing contributors. The second radiometric validation method is based on the exploitation of matchups combining both concomitant in-situ measurements and Sentinel-2 observations. The in-situ measurements which are used here correspond to measurements acquired in the frame of the RadCalNet networks. The validation is performed for the Sentinel-2 bands similar to the bands of the instruments equipping the validation site. The measurements from the Cimel CE 318 12-filters BRDF Sun Photometer installed recently in the Gobabeb site near the Namib desert are used for this method. A comprehensive verification of the calibration requires an analysis of MSI radiances over the full dynamic range, including low radiances, as extreme values are more subject to instrument response non-linearity. The third method developed in the frame of this project aims to address this point. It is based on a comparison of Sentinel-2 observations over coastal waters which have low radiometry and corresponding Radiative Transfer (RT) simulations using AERONET-OC measurements. Finally, a last method is developed using RadCalNet measurements and Sentinel-2 observations to validate the radiometry of mid/low resolution sensors such as Sentinel-3/OLCI. The RadCalNet measurements are transferred from the RadCalNet sites to Pseudo Invariant Calibration Sites (PICS) using Sentinel-2, and then these larger sites are used to validate mid- and low-resolution sensors to the RadCalNet reference. For all the developed methods, an uncertainty budget is derived following QA4EO guidelines. A last step of this ESA project is dedicated to an Inter-comparison Workshop open to entities involved in Sentinel-2 radiometric validation activities. Blind inter-comparison tests over a series of images will be proposed and the results will be discussed during the workshop.

High spatial resolution satellite observations for validation of MODIS land products: IKONOS observations acquired under the NASA scientific data purchase.

Treesearch

Jeffrey T. Morisette; Jaime E. Nickeson; Paul Davis; Yujie Wang; Yuhong Tian; Curtis E. Woodcock; Nikolay Shabanov; Matthew Hansen; Warren B. Cohen; Doug R. Oetter; Robert E. Kennedy

2003-01-01

Phase 1I of the Scientific Data Purchase (SDP) has provided NASA investigators access to data from four different satellite and airborne data sources. The Moderate Resolution Imaging Spectrometer (MODIS) land discipline team (MODLAND) sought to utilize these data in support of land product validation activities with a lbcus on tile EOS Land Validation Core Sites. These...

Collocation mismatch uncertainties in satellite aerosol retrieval validation

NASA Astrophysics Data System (ADS)

Virtanen, Timo H.; Kolmonen, Pekka; Sogacheva, Larisa; Rodríguez, Edith; Saponaro, Giulia; de Leeuw, Gerrit

2018-02-01

Satellite-based aerosol products are routinely validated against ground-based reference data, usually obtained from sun photometer networks such as AERONET (AEROsol RObotic NETwork). In a typical validation exercise a spatial sample of the instantaneous satellite data is compared against a temporal sample of the point-like ground-based data. The observations do not correspond to exactly the same column of the atmosphere at the same time, and the representativeness of the reference data depends on the spatiotemporal variability of the aerosol properties in the samples. The associated uncertainty is known as the collocation mismatch uncertainty (CMU). The validation results depend on the sampling parameters. While small samples involve less variability, they are more sensitive to the inevitable noise in the measurement data. In this paper we study systematically the effect of the sampling parameters in the validation of AATSR (Advanced Along-Track Scanning Radiometer) aerosol optical depth (AOD) product against AERONET data and the associated collocation mismatch uncertainty. To this end, we study the spatial AOD variability in the satellite data, compare it against the corresponding values obtained from densely located AERONET sites, and assess the possible reasons for observed differences. We find that the spatial AOD variability in the satellite data is approximately 2 times larger than in the ground-based data, and the spatial variability correlates only weakly with that of AERONET for short distances. We interpreted that only half of the variability in the satellite data is due to the natural variability in the AOD, and the rest is noise due to retrieval errors. However, for larger distances (˜ 0.5°) the correlation is improved as the noise is averaged out, and the day-to-day changes in regional AOD variability are well captured. Furthermore, we assess the usefulness of the spatial variability of the satellite AOD data as an estimate of CMU by comparing the retrieval errors to the total uncertainty estimates including the CMU in the validation. We find that accounting for CMU increases the fraction of consistent observations.

Evaluating the validity of multiple imputation for missing physiological data in the national trauma data bank.

PubMed

Moore, Lynne; Hanley, James A; Lavoie, André; Turgeon, Alexis

2009-05-01

The National Trauma Data Bank (NTDB) is plagued by the problem of missing physiological data. The Glasgow Coma Scale score, Respiratory Rate and Systolic Blood Pressure are an essential part of risk adjustment strategies for trauma system evaluation and clinical research. Missing data on these variables may compromise the feasibility and the validity of trauma group comparisons. To evaluate the validity of Multiple Imputation (MI) for completing missing physiological data in the National Trauma Data Bank (NTDB), by assessing the impact of MI on 1) frequency distributions, 2) associations with mortality, and 3) risk adjustment. Analyses were based on 170,956 NTDB observations with complete physiological data (observed data set). Missing physiological data were artificially imposed on this data set and then imputed using MI (MI data set). To assess the impact of MI on risk adjustment, 100 pairs of hospitals were randomly selected with replacement and compared using adjusted Odds Ratios (OR) of mortality. OR generated by the observed data set were then compared to those generated by the MI data set. Frequency distributions and associations with mortality were preserved following MI. The median absolute difference between adjusted OR of mortality generated by the observed data set and by the MI data set was 3.6% (inter-quartile range: 2.4%-6.1%). This study suggests that, provided it is implemented with care, MI of missing physiological data in the NTDB leads to valid frequency distributions, preserves associations with mortality, and does not compromise risk adjustment in inter-hospital comparisons of mortality.

Validation in the Absence of Observed Events

DOE PAGES

Lathrop, John; Ezell, Barry

2015-07-22

Here our paper addresses the problem of validating models in the absence of observed events, in the area of Weapons of Mass Destruction terrorism risk assessment. We address that problem with a broadened definition of “Validation,” based on “backing up” to the reason why modelers and decision makers seek validation, and from that basis re-define validation as testing how well the model can advise decision makers in terrorism risk management decisions. We develop that into two conditions: Validation must be based on cues available in the observable world; and it must focus on what can be done to affect thatmore » observable world, i.e. risk management. That in turn leads to two foci: 1.) the risk generating process, 2.) best use of available data. Based on our experience with nine WMD terrorism risk assessment models, we then describe three best use of available data pitfalls: SME confidence bias, lack of SME cross-referencing, and problematic initiation rates. Those two foci and three pitfalls provide a basis from which we define validation in this context in terms of four tests -- Does the model: … capture initiation? … capture the sequence of events by which attack scenarios unfold? … consider unanticipated scenarios? … consider alternative causal chains? Finally, we corroborate our approach against three key validation tests from the DOD literature: Is the model a correct representation of the simuland? To what degree are the model results comparable to the real world? Over what range of inputs are the model results useful?« less

Observations on CFD Verification and Validation from the AIAA Drag Prediction Workshops

NASA Technical Reports Server (NTRS)

Morrison, Joseph H.; Kleb, Bil; Vassberg, John C.

2014-01-01

The authors provide observations from the AIAA Drag Prediction Workshops that have spanned over a decade and from a recent validation experiment at NASA Langley. These workshops provide an assessment of the predictive capability of forces and moments, focused on drag, for transonic transports. It is very difficult to manage the consistency of results in a workshop setting to perform verification and validation at the scientific level, but it may be sufficient to assess it at the level of practice. Observations thus far: 1) due to simplifications in the workshop test cases, wind tunnel data are not necessarily the “correct” results that CFD should match, 2) an average of core CFD data are not necessarily a better estimate of the true solution as it is merely an average of other solutions and has many coupled sources of variation, 3) outlier solutions should be investigated and understood, and 4) the DPW series does not have the systematic build up and definition on both the computational and experimental side that is required for detailed verification and validation. Several observations regarding the importance of the grid, effects of physical modeling, benefits of open forums, and guidance for validation experiments are discussed. The increased variation in results when predicting regions of flow separation and increased variation due to interaction effects, e.g., fuselage and horizontal tail, point out the need for validation data sets for these important flow phenomena. Experiences with a recent validation experiment at NASA Langley are included to provide guidance on validation experiments.

Validation in the Absence of Observed Events.

PubMed

Lathrop, John; Ezell, Barry

2016-04-01

This article addresses the problem of validating models in the absence of observed events, in the area of weapons of mass destruction terrorism risk assessment. We address that problem with a broadened definition of "validation," based on stepping "up" a level to considering the reason why decisionmakers seek validation, and from that basis redefine validation as testing how well the model can advise decisionmakers in terrorism risk management decisions. We develop that into two conditions: validation must be based on cues available in the observable world; and it must focus on what can be done to affect that observable world, i.e., risk management. That leads to two foci: (1) the real-world risk generating process, and (2) best use of available data. Based on our experience with nine WMD terrorism risk assessment models, we then describe three best use of available data pitfalls: SME confidence bias, lack of SME cross-referencing, and problematic initiation rates. Those two foci and three pitfalls provide a basis from which we define validation in this context in terms of four tests--Does the model: … capture initiation? … capture the sequence of events by which attack scenarios unfold? … consider unanticipated scenarios? … consider alternative causal chains? Finally, we corroborate our approach against three validation tests from the DOD literature: Is the model a correct representation of the process to be simulated? To what degree are the model results comparable to the real world? Over what range of inputs are the model results useful? © 2015 Society for Risk Analysis.

Can training in empathetic validation improve medical students' communication with patients suffering pain? A test of concept.

PubMed

Linton, Steven J; Flink, Ida K; Nilsson, Emma; Edlund, Sara

2017-05-01

Patient-centered, empathetic communication has been recommended as a means for improving the health care of patients suffering pain. However, a problem has been training health care providers since programs may be time-consuming and difficult to learn. Validation, a form of empathetic response that communicates that what a patient experiences is accepted as true, has been suggested as an appropriate method for improving communication with patients suffering pain. We study the immediate effects of providing medical students with a 2-session (45-minute duration each) program in validation skills on communication. A one group, pretest vs posttest design was employed with 22 volunteer medical students. To control patient variables, actors simulated 1 of 2 patient scenarios (randomly provided at pretest and posttest). Video recordings were blindly evaluated. Self-ratings of validation and satisfaction were also employed. Observed validation responses increased significantly after training and corresponded to significant reductions in invalidating responses. Both the patient simulators and the medical students were significantly more satisfied after the training. We demonstrated that training empathetic validation results in improved communication thus extending previous findings to a medical setting with patients suffering pain. Our results suggest that it would be feasible to provide validation training for health care providers and this warrants further investigation in controlled studies.

Brief report: The Brief Alcohol Social Density Assessment (BASDA): convergent, criterion-related, and incremental validity.

PubMed

MacKillop, James; Acker, John D; Bollinger, Jared; Clifton, Allan; Miller, Joshua D; Campbell, W Keith; Goodie, Adam S

2013-09-01

Alcohol misuse is substantially influenced by social factors, but systematic assessments of social network drinking are typically lengthy. The goal of the present study was to provide further validation of a brief measure of social network alcohol use, the Brief Alcohol Social Density Assessment (BASDA), in a sample of emerging adults. Specifically, the study sought to examine the BASDA's convergent, criterion, and incremental validity in relation to well-established measures of drinking motives and problematic drinking. Participants were 354 undergraduates who were assessed using the BASDA, the Alcohol Use Disorders Identification Test (AUDIT), and the Drinking Motives Questionnaire. Significant associations were observed between the BASDA index of alcohol-related social density and alcohol misuse, social motives, and conformity motives, supporting convergent validity. Criterion-related validity was supported by evidence that significantly greater alcohol involvement was present in the social networks of individuals scoring at or above an AUDIT score of 8, a validated criterion for hazardous drinking. Finally, the BASDA index was significantly associated with alcohol misuse above and beyond drinking motives in relation to AUDIT scores, supporting incremental validity. Taken together, these findings provide further support for the BASDA as an efficient measure of drinking in an individual's social network. Methodological considerations as well as recommendations for future investigations in this area are discussed.

Validation of 2D flood models with insurance claims

NASA Astrophysics Data System (ADS)

Zischg, Andreas Paul; Mosimann, Markus; Bernet, Daniel Benjamin; Röthlisberger, Veronika

2018-02-01

Flood impact modelling requires reliable models for the simulation of flood processes. In recent years, flood inundation models have been remarkably improved and widely used for flood hazard simulation, flood exposure and loss analyses. In this study, we validate a 2D inundation model for the purpose of flood exposure analysis at the river reach scale. We validate the BASEMENT simulation model with insurance claims using conventional validation metrics. The flood model is established on the basis of available topographic data in a high spatial resolution for four test cases. The validation metrics were calculated with two different datasets; a dataset of event documentations reporting flooded areas and a dataset of insurance claims. The model fit relating to insurance claims is in three out of four test cases slightly lower than the model fit computed on the basis of the observed inundation areas. This comparison between two independent validation data sets suggests that validation metrics using insurance claims can be compared to conventional validation data, such as the flooded area. However, a validation on the basis of insurance claims might be more conservative in cases where model errors are more pronounced in areas with a high density of values at risk.

Development and preliminary validation of a self-report measure of psychopathic personality traits in noncriminal populations.

PubMed

Lilienfeld, S O; Andrews, B P

1996-06-01

Research on psychopathology has been hindered by persisting difficulties and controversies regarding its assessment. The primary goals of this set of studies were to (a) develop, and initiate the construct validation of, a self-report measure that assesses the major personality traits of psychopathy in noncriminal populations and (b) clarify the nature of these traits via an exploratory approach to test construction. This measure, the Psychopathic Personality Inventory (PPI), was developed by writing items to assess a large number of personality domains relevant to psychopathy and performing successive item-level factor analyses and revisions on three undergraduate samples. The PPI total score and its eight subscales were found to possess satisfactory internal consistency and test-retest reliability. In four studies with undergraduates, the PPI and its subscales exhibited a promising pattern of convergent and discriminant validity with self-report, psychiatric interview, observer rating, and family history data. In addition, the PPI total score demonstrated incremental validity relative to several commonly used self-report psychopathy-related measures. Future construct validation studies, unresolved conceptual issues regarding the assessment of psychopathy, and potential research uses of the PPI are outlined.

[Validating the Spanish version of the Nursing Activities Score].

PubMed

Sánchez-Sánchez, M M; Arias-Rivera, S; Fraile-Gamo, M P; Thuissard-Vasallo, I J; Frutos-Vivar, F

2015-01-01

Validating workload scores ensures that they are appropriate for the purpose for which they were developed. To validate the Nursing Activities Score (NAS) Spanish version. Observational and prospective study. 1,045 patients who were admitted to a medical-surgical unit and a serious burns unit in 2006 were included. The nurse in charge assessed patient workloads by Nine Equivalent of Nursing Manpower use Score and NAS. To assess the internal consistency of the measurements of NAS, item-test correlations, Cronbach's α and Cronbach's α corrected by omitting each of the items were calculated. The intraobserver and interobserver reliability were assessed with the intraclass correlation coefficient by viewing recordings and Kappa (interobserver reliability) was estimated. For the analysis of internal validity, a factorial principal components analysis was performed. Convergent validity was assessed using the Spearman correlation coefficient values obtained from the Nine Equivalent of Nursing Manpower use Score and Spanish-NAS scales. For internal consistency, 164 questionnaires were analysed and a Cronbach's α of 0.373 was calculated. The intraclass correlation coefficient for intraobserver reliability estimate was 0.837 (95% IC: 0.466-0.950) and 0.662 (95% IC: 0.033-0.882) for interobserver reliability. The estimated kappa was 0.371. For internal validity, exploratory factor analysis showed that the first item explained 58.9% of the variance of the questionnaire. For convergent validity 1006 questionnaires were included and a Spearman correlation coefficient of 0.746 was observed. The psychometric properties of Spanish-NAS are acceptable. Copyright © 2014 Elsevier España, S.L.U. y SEEIUC. All rights reserved.

Validation of the AVITA BPM63S upper arm blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Kang, Yuan-Yuan; Zeng, Wei-Fang; Liu, Ming; Li, Yan; Wang, Ji-Guang

2014-02-01

The present study aimed to evaluate the accuracy of the AVITA BPM63S upper arm blood pressure monitor for home blood pressure monitoring according to the International Protocol of the European Society of Hypertension revision 2010. Systolic and diastolic blood pressures were sequentially measured in 33 adult Chinese (14 women, mean age of 47 years) using a mercury sphygmomanometer (two observers) and the AVITA BPM63S device (one supervisor). Ninety-nine pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. All the blood pressure requirements were fulfilled. The AVITA BPM63S device achieved the targets in part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 68/99, 89/99, and 96/99, respectively, for systolic blood pressure, and 75/99, 95/99, and 97/99, respectively, for diastolic blood pressure. The device also achieved the criteria in part 2 of the validation study. Twenty-four and 25 participants for systolic and diastolic blood pressure, respectively, had at least two of the three device-observers differences within 5 mmHg (required ≥24). One and two participants for systolic and diastolic blood pressure, respectively, had all three device-observers differences greater than 5 mmHg. The AVITA BPM63S automated oscillometric upper arm blood pressure monitor has passed the requirements of the International Protocol revision 2010, and hence can be recommended for blood pressure measurement at home in adults.

Validation of the YuWell YE690A upper-arm blood pressure monitor, for clinic use and self-measurement, according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Chen, Qi; Lei, Lei; Li, Yan; Wang, Ji-Guang

2017-10-01

The present study aimed to evaluate the accuracy of the automated oscillometric upper-arm blood pressure monitor YuWell YE690A for blood pressure measurement according to the International Protocol of the European Society of Hypertension revision 2010. Systolic and diastolic blood pressures were measured sequentially in 33 adult Chinese (12 women, 44.2 years of mean age) using a mercury sphygmomanometer (two observers) and the YE690A device (one supervisor). A total of 99 pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. All the blood pressure requirements were fulfilled. The YuWell YE690A device achieved the targets in part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 79/99, 96/99, and 97/99, respectively, for systolic blood pressure and 72/99, 95/99, and 98/99, respectively, for diastolic blood pressure. The device also fulfilled the criteria in part 2 of the validation study. Thirty-one and 25 participants for systolic and diastolic blood pressure, respectively, had at least two of the three device-observer differences within 5 mmHg (required ≥24). No participant for systolic and two participants for diastolic blood pressure had all the three device-observer comparisons greater than 5 mmHg. The YuWell blood pressure monitor YE690A has passed the requirements of the International Protocol revision 2010 and hence can be recommended for blood pressure measurement in adults.

Towards TCCON Tropics: Assessment and Measurements of Carbon and its Climate Impacts in Southeast Asia (T3AM C2lImA)

NASA Astrophysics Data System (ADS)

Morino, I.; Velazco, V. A.; Schwandner, F. M.; Macatangay, R. C.; Griffith, D. W. T.

2015-12-01

TCCON (Total Carbon Column Observing Network) measurements of CO2 and CH4 have been and are currently used extensively and globally for satellite validation, for comparison with atmospheric chemistry models and to study atmosphere-biosphere exchanges of carbon. With the global effort to cap greenhouse gas emissions, TCCON has become vital for validating satellite-based greenhouse gas data from past, current and future missions like Japanese GOSAT (Greenhouse Gas Observing SATellite) and GOSAT-2, NASA's OCO-2 (Orbiting Carbon Observatory-2) and OCO-3, ESA's Carbon Monitoring Satellite (CarbonSat), Chinese TanSat, and others. The lack of reliable validation data for the satellite-based greenhouse gas observing missions in the tropical regions is a common limitation in global carbon-cycle modeling studies that have a tropical component. The international CO2 modeling community have specified a requirement for "expansion of the CO2 observation network within the tropics" to reduce uncertainties in regional estimates of CO2 sources and sinks using atmospheric transport models. A TCCON site in the western tropical Pacific is a logical next step in obtaining additional knowledge that would greatly contribute to the understanding of the Earth's atmosphere and better constraining a major tropical region experiencing tremendous economic and population growth. Here, we present a complete site assessment for a possible TCCON site in the Philippines and our decision on the site where a new TCCON FTS will be installed. This site assessment was conducted in cooperation with the Energy Development Corporation (EDC, Philippines), National Institute for Environmental Studies (NIES, Japan), University of Wollongong (UoW, Australia), NASA's Jet Propulsion Laboratory (JPL), the University of the Philippines (UP-IESM), the TCCON science team, and the GOSAT-2 science team.

Ethical leadership: meta-analytic evidence of criterion-related and incremental validity.

PubMed

Ng, Thomas W H; Feldman, Daniel C

2015-05-01

This study examines the criterion-related and incremental validity of ethical leadership (EL) with meta-analytic data. Across 101 samples published over the last 15 years (N = 29,620), we observed that EL demonstrated acceptable criterion-related validity with variables that tap followers' job attitudes, job performance, and evaluations of their leaders. Further, followers' trust in the leader mediated the relationships of EL with job attitudes and performance. In terms of incremental validity, we found that EL significantly, albeit weakly in some cases, predicted task performance, citizenship behavior, and counterproductive work behavior-even after controlling for the effects of such variables as transformational leadership, use of contingent rewards, management by exception, interactional fairness, and destructive leadership. The article concludes with a discussion of ways to strengthen the incremental validity of EL. (PsycINFO Database Record (c) 2015 APA, all rights reserved).

Impact of External Cue Validity on Driving Performance in Parkinson's Disease

PubMed Central

Scally, Karen; Charlton, Judith L.; Iansek, Robert; Bradshaw, John L.; Moss, Simon; Georgiou-Karistianis, Nellie

2011-01-01

This study sought to investigate the impact of external cue validity on simulated driving performance in 19 Parkinson's disease (PD) patients and 19 healthy age-matched controls. Braking points and distance between deceleration point and braking point were analysed for red traffic signals preceded either by Valid Cues (correctly predicting signal), Invalid Cues (incorrectly predicting signal), and No Cues. Results showed that PD drivers braked significantly later and travelled significantly further between deceleration and braking points compared with controls for Invalid and No-Cue conditions. No significant group differences were observed for driving performance in response to Valid Cues. The benefit of Valid Cues relative to Invalid Cues and No Cues was significantly greater for PD drivers compared with controls. Trail Making Test (B-A) scores correlated with driving performance for PDs only. These results highlight the importance of external cues and higher cognitive functioning for driving performance in mild to moderate PD. PMID:21789275

Clinical composite measures of disease activity and damage used to evaluate patients with systemic lupus erythematosus: A systematic literature review.

PubMed

Castrejón, Isabel; Rúa-Figueroa, Iñigo; Rosario, María Piedad; Carmona, Loreto

2014-01-01

To determine the most appropriate indices to evaluate the disease activity and damage in patients with sytemic lupus erythematosus (SLE). A systematic literature search was performed to identify validation studies of indices used to evaluate disease activity and damage. We collected information for each instrument on every aspect of validation including feasibility, reliability, validity and sensitivity to change using ad hoc forms. A total of 38 articles were included addressing the validation of 6 composite indices to evaluate disease activity (BILAG, ECLAM, SLAM, SLEDAI, LAI and SLAQ); and 3 indices to evaluate damage (SLICC/ACE-DI, LDIQ and BILD). Only the SLAQ, LIDIQ and the BILD were self-administered. Feasibility and internal consistency was only studied in 3 indices (BILAG, SLAQ and SDI) with a Cronbach's α ranging from 0.35 to 0.87. The intra-observer reliability was examined by the intraclass correlation coefficient for BILAG with a result of 0.48 (95%CI: 0,23-0,81) and using analysis of variance for SLAM-R (0,78), SLEDAI (0,33) and the LAI (0,81). The inter-observer feasibility was evaluated using the correlation coefficient for ECLAM (0,90-0,93), the SLAM (0,86) and MEX-SLEDAI (0,97-0,89). The construct validity was examined by means of convergence with other instruments, specifically with global assessment by the physician, with similar results between indices (0,48-0,75). Lastly, responsiveness was tested in all indices except LAI, SDI and LDIQ, with a standardized response mean ranging from 0.12 to 0.75. Although multiple instruments have been validated for use in SLE it was not possible to find direct evidence of which is the most appropriate. BILAG and SLEDAI, with moderate feasibility and low responsiveness, are the 2 indices with a most complete validation and more extensively used. Copyright © 2013 Elsevier España, S.L.U. All rights reserved.

Spanish validation of the Negative Symptom Assessment-16 (NSA-16) in patients with schizophrenia.

PubMed

Garcia-Alvarez, Leticia; Garcia-Portilla, María Paz; Saiz, Pilar Alejandra; Fonseca-Pedrero, Eduardo; Bobes-Bascaran, María Teresa; Gomar, Jesús; Muñiz, José; Bobes, Julio

2018-04-05

Negative symptoms are prevalent in schizophrenia and associated with a poorer outcome. Validated newer psychometric instruments could contribute to better assessment and improved treatment of negative symptoms. The Negative Symptom Assessment-16 (NSA-16) has been shown to have strong psychometric properties, but there is a need for validation in non-English languages. This study aimed to examine the psychometric properties of a Spanish version of the NSA-16 (Sp-NSA-16). Observational, cross-sectional validation study in a sample of 123 outpatients with schizophrenia. NSA-16, PANSS, HDRS, CGI-SCH and PSP. The results indicate appropriate psychometric properties, high internal consistency (Cronbach's alpha=0.86), convergent validity (PANSS negative scale, PANSS Marder Negative Factor and CGI-negative symptoms r values between 0.81 and 0.94) and divergent validity (PANSS positive scale and the HDRS r values between 0.10 and 0.34). In addition, the NSA-16 also exhibited discriminant validity (ROC curve=0.97, 95% CI=0.94 to 1.00; 94.3% sensitivity and 83.3% specificity). The Sp-NSA-16 is reliable and valid for measuring negative symptoms in patients with schizophrenia. This provides Spanish clinicians with a new tool for clinical practice and research. However, it is necessary to provide further information about its inter-rater reliability. Copyright © 2018 SEP y SEPB. Publicado por Elsevier España, S.L.U. All rights reserved.

The Best of Both Worlds: Building on the COPUS and RTOP Observation Protocols to Easily and Reliably Measure Various Levels of Reformed Instructional Practice

PubMed Central

Lund, Travis J.; Pilarz, Matthew; Velasco, Jonathan B.; Chakraverty, Devasmita; Rosploch, Kaitlyn; Undersander, Molly; Stains, Marilyne

2015-01-01

Researchers, university administrators, and faculty members are increasingly interested in measuring and describing instructional practices provided in science, technology, engineering, and mathematics (STEM) courses at the college level. Specifically, there is keen interest in comparing instructional practices between courses, monitoring changes over time, and mapping observed practices to research-based teaching. While increasingly common observation protocols (Reformed Teaching Observation Protocol [RTOP] and Classroom Observation Protocol in Undergraduate STEM [COPUS]) at the postsecondary level help achieve some of these goals, they also suffer from weaknesses that limit their applicability. In this study, we leverage the strengths of these protocols to provide an easy method that enables the reliable and valid characterization of instructional practices. This method was developed empirically via a cluster analysis using observations of 269 individual class periods, corresponding to 73 different faculty members, 28 different research-intensive institutions, and various STEM disciplines. Ten clusters, called COPUS profiles, emerged from this analysis; they represent the most common types of instructional practices enacted in the classrooms observed for this study. RTOP scores were used to validate the alignment of the 10 COPUS profiles with reformed teaching. Herein, we present a detailed description of the cluster analysis method, the COPUS profiles, and the distribution of the COPUS profiles across various STEM courses at research-intensive universities. PMID:25976654

Cloud parameters from zenith transmittances measured by sky radiometer at surface: Method development and satellite product validation

NASA Astrophysics Data System (ADS)

Khatri, Pradeep; Hayasaka, Tadahiro; Iwabuchi, Hironobu; Takamura, Tamio; Irie, Hitoshi; Nakajima, Takashi Y.; Letu, Husi; Kai, Qin

2017-04-01

Clouds are known to have profound impacts on atmospheric radiation and water budget, climate change, atmosphere-surface interaction, and so on. Cloud optical thickness (COT) and effective radius (Re) are two fundamental cloud parameters required to study clouds from climatological and hydrological point of view. Large spatial-temporal coverages of those cloud parameters from space observation have proved to be very useful for cloud research; however, validation of space-based products is still a challenging task due to lack of reliable data. Ground-based remote sensing instruments, such as sky radiometers distributed around the world through international observation networks of SKYNET (http://atmos2.cr.chiba-u.jp/skynet/) and AERONET (https://aeronet.gsfc.nasa.gov/) have a great potential to produce ground-truth cloud parameters at different parts of the globe to validate satellite products. Focusing to the sky radiometers of SKYNET and AERONET, a few cloud retrieval methods exists, but those methods have some difficulties to address the problem when cloud is optically thin. It is because the observed transmittances at two wavelengths can be originated from more than one set of COD and Re, and the choice of the most plausible set is difficult. At the same time, calibration issue, especially for the wavelength of near infrared (NIR) region, which is important to retrieve Re, is also a difficult task at present. As a result, instruments need to be calibrated at a high mountain or calibration terms need to be transferred from a standard instrument. Taking those points on account, we developed a new retrieval method emphasizing to overcome above-mentioned difficulties. We used observed transmittances of multiple wavelengths to overcome the first problem. We further proposed a method to obtain calibration constant of NIR wavelength channel using observation data. Our cloud retrieval method is found to produce relatively accurate COD and Re when validated them using data of a narrow field of view radiometer of collocated observation in one SKYNET site. Though the method is developed for the sky radiometer of SKYNET, it can be still used for the sky radiometer of AERONET and other instruments observing spectral zenith transmittances. The proposed retrieval method is then applied to retrieve cloud parameters at key sites of SKYNET within Japan, which are then used to validate cloud products obtained from space observations by MODIS sensors onboard TERRA/AQUA satellites and Himawari 8, a Japanese geostationary satellite. Our analyses suggest the underestimation (overestimation) of COD (Re) from space observations.

Using Ground-Based Measurements and Retrievals to Validate Satellite Data

NASA Technical Reports Server (NTRS)

Dong, Xiquan

2002-01-01

The proposed research is to use the DOE ARM ground-based measurements and retrievals as the ground-truth references for validating satellite cloud results and retrieving algorithms. This validation effort includes four different ways: (1) cloud properties on different satellites, therefore different sensors, TRMM VIRS and TERRA MODIS; (2) cloud properties at different climatic regions, such as DOE ARM SGP, NSA, and TWP sites; (3) different cloud types, low and high level cloud properties; and (4) day and night retrieving algorithms. Validation of satellite-retrieved cloud properties is very difficult and a long-term effort because of significant spatial and temporal differences between the surface and satellite observing platforms. The ground-based measurements and retrievals, only carefully analyzed and validated, can provide a baseline for estimating errors in the satellite products. Even though the validation effort is so difficult, a significant progress has been made during the proposed study period, and the major accomplishments are summarized in the follow.

Validity of High School Physic Module With Character Values Using Process Skill Approach In STKIP PGRI West Sumatera

NASA Astrophysics Data System (ADS)

Anaperta, M.; Helendra, H.; Zulva, R.

2018-04-01

This study aims to describe the validity of physics module with Character Oriented Values Using Process Approach Skills at Dynamic Electrical Material in high school physics / MA and SMK. The type of research is development research. The module development model uses the development model proposed by Plomp which consists of (1) preliminary research phase, (2) the prototyping phase, and (3) assessment phase. In this research is done is initial investigation phase and designing. Data collecting technique to know validation is observation and questionnaire. In the initial investigative phase, curriculum analysis, student analysis, and concept analysis were conducted. In the design phase and the realization of module design for SMA / MA and SMK subjects in dynamic electrical materials. After that, the formative evaluation which include self evaluation, prototyping (expert reviews, one-to-one, and small group. At this stage validity is performed. This research data is obtained through the module validation sheet, which then generates a valid module.

A trace map comparison algorithm for the discrete fracture network models of rock masses

NASA Astrophysics Data System (ADS)

Han, Shuai; Wang, Gang; Li, Mingchao

2018-06-01

Discrete fracture networks (DFN) are widely used to build refined geological models. However, validating whether a refined model can match to reality is a crucial problem, concerning whether the model can be used for analysis. The current validation methods include numerical validation and graphical validation. However, the graphical validation, aiming at estimating the similarity between a simulated trace map and the real trace map by visual observation, is subjective. In this paper, an algorithm for the graphical validation of DFN is set up. Four main indicators, including total gray, gray grade curve, characteristic direction and gray density distribution curve, are presented to assess the similarity between two trace maps. A modified Radon transform and loop cosine similarity are presented based on Radon transform and cosine similarity respectively. Besides, how to use Bézier curve to reduce the edge effect is described. Finally, a case study shows that the new algorithm can effectively distinguish which simulated trace map is more similar to the real trace map.

[Validation of a knowledge-questionnaire about asthma applied to teachers of elementary school of Monterrey, Mexico].

PubMed

González Diaz, Sandra Nora; Cruz, Alfredo Arias; González González, Arya Yannel; Félix Berumen, José Alfredo; Weinmann, Alejandra Macías

2010-01-01

asthma is one of the most common chronic childhood diseases; is increasing in prevalence and an important cause of school absenteeism. Previous studies have failed to evaluate knowledge about asthma among elementary school teachers worldwide because of the lack of validated questionnaires. to validate a questionnaire about asthma knowledge for elementary school teachers in Monterrey, Nuevo Leon. an observational, cross sectional, descriptive study, from February to December 2004, by applying a questionnaire to a group of elementary school teachers in Monterrey, Nuevo Leon. The questionnaire is a translation and adaptation to the questionnaire of 13 questions used to assess the knowledge about asthma among parents, according to the National Asthma Education Program of US. a total of 179 questionnaires were applied, in which 6 of the 13 questions were answered correctly by more than 90% of the teachers. The internal consistency reliability was adequate with a Cronbach a coefficient of 0.75. in order to obtain reliable data using questionnaires, these must undergo a validation process. Our questionnaire got validation because of the reliability shown according to the internal consistency analysis.

A Preliminary Analysis of the Reliability and Validity of the Leader Observation System.

DTIC Science & Technology

1982-08-01

financial instituition , a state agency, a medium sized manufacturing plant, a campus police department, and the Navy and Army R.O.T.C. units of a...specifics of the study. The outside observers (N=8) used in the study were graduate students in management . Three were assigned to the financial ... managing Interpersonal conflict etc. between subordinates or others d. routine financial reporting nnd b. appealing to higher authority to bookkeeping

Recent developments with the asian dust and aerosol lidar observation network (AD-NET)

NASA Astrophysics Data System (ADS)

Sugimoto, Nobuo; Shimizu, Atsushi; Nishizawa, Tomoaki; Jin, Yoshitaka

2018-04-01

Recent developments of lidars and data analysis methods for AD-Net, and the studies using ADNet are presented. Continuous observation was started in 2001 at three stations using polarizationsensitive Mie-scattering lidars. Currently, lidars, including three multi-wavelength Raman lidars and one high-spectral-resolution lidar, are operated at 20 stations. Recent studies on validation/assimilation of chemical transport models, climatology, and epidemiology of Asian dust are also described.

Using Web-Based Questionnaires and Obstetric Records to Assess General Health Characteristics Among Pregnant Women: A Validation Study

PubMed Central

Schouten, Naomi PE; Merkus, Peter JFM; Verhaak, Chris M; Roeleveld, Nel; Roukema, Jolt

2015-01-01

Background Self-reported medical history information is included in many studies. However, data on the validity of Web-based questionnaires assessing medical history are scarce. If proven to be valid, Web-based questionnaires may provide researchers with an efficient means to collect data on this parameter in large populations. Objective The aim of this study was to assess the validity of a Web-based questionnaire on chronic medical conditions, allergies, and blood pressure readings against obstetric records and data from general practitioners. Methods Self-reported questionnaire data were compared with obstetric records for 519 pregnant women participating in the Dutch PRegnancy and Infant DEvelopment (PRIDE) Study from July 2011 through November 2012. These women completed Web-based questionnaires around their first prenatal care visit and in gestational weeks 17 and 34. We calculated kappa statistics (κ) and the observed proportions of positive and negative agreement between the baseline questionnaire and obstetric records for chronic conditions and allergies. In case of inconsistencies between these 2 data sources, medical records from the woman’s general practitioner were consulted as the reference standard. For systolic and diastolic blood pressure, intraclass correlation coefficients (ICCs) were calculated for multiple data points. Results Agreement between the baseline questionnaire and the obstetric record was substantial (κ=.61) for any chronic condition and moderate for any allergy (κ=.51). For specific conditions, we found high observed proportions of negative agreement (range 0.88-1.00) and on average moderate observed proportions of positive agreement with a wide range (range 0.19-0.90). Using the reference standard, the sensitivity of the Web-based questionnaire for chronic conditions and allergies was comparable to or even better than the sensitivity of the obstetric records, in particular for migraine (0.90 vs 0.40, P=.02), asthma (0.86 vs 0.61, P=.04), inhalation allergies (0.92 vs 0.74, P=.003), hay fever (0.90 vs 0.64, P=.001), and allergies to animals (0.89 vs 0.53, P=.01). However, some overreporting of allergies was observed in the questionnaire and for some nonsomatic conditions sensitivity of both measurement instruments was low. The ICCs for blood pressure readings ranged between 0.72 and 0.92 with very small mean differences between the 2 methods of data collection. Conclusions Web-based questionnaires can be used to validly collect data on many chronic disorders, allergies, and blood pressure readings among pregnant women. PMID:26081990

Using Web-Based Questionnaires and Obstetric Records to Assess General Health Characteristics Among Pregnant Women: A Validation Study.

PubMed

van Gelder, Marleen M H J; Schouten, Naomi P E; Merkus, Peter J F M; Verhaak, Chris M; Roeleveld, Nel; Roukema, Jolt

2015-06-16

Self-reported medical history information is included in many studies. However, data on the validity of Web-based questionnaires assessing medical history are scarce. If proven to be valid, Web-based questionnaires may provide researchers with an efficient means to collect data on this parameter in large populations. The aim of this study was to assess the validity of a Web-based questionnaire on chronic medical conditions, allergies, and blood pressure readings against obstetric records and data from general practitioners. Self-reported questionnaire data were compared with obstetric records for 519 pregnant women participating in the Dutch PRegnancy and Infant DEvelopment (PRIDE) Study from July 2011 through November 2012. These women completed Web-based questionnaires around their first prenatal care visit and in gestational weeks 17 and 34. We calculated kappa statistics (κ) and the observed proportions of positive and negative agreement between the baseline questionnaire and obstetric records for chronic conditions and allergies. In case of inconsistencies between these 2 data sources, medical records from the woman's general practitioner were consulted as the reference standard. For systolic and diastolic blood pressure, intraclass correlation coefficients (ICCs) were calculated for multiple data points. Agreement between the baseline questionnaire and the obstetric record was substantial (κ=.61) for any chronic condition and moderate for any allergy (κ=.51). For specific conditions, we found high observed proportions of negative agreement (range 0.88-1.00) and on average moderate observed proportions of positive agreement with a wide range (range 0.19-0.90). Using the reference standard, the sensitivity of the Web-based questionnaire for chronic conditions and allergies was comparable to or even better than the sensitivity of the obstetric records, in particular for migraine (0.90 vs 0.40, P=.02), asthma (0.86 vs 0.61, P=.04), inhalation allergies (0.92 vs 0.74, P=.003), hay fever (0.90 vs 0.64, P=.001), and allergies to animals (0.89 vs 0.53, P=.01). However, some overreporting of allergies was observed in the questionnaire and for some nonsomatic conditions sensitivity of both measurement instruments was low. The ICCs for blood pressure readings ranged between 0.72 and 0.92 with very small mean differences between the 2 methods of data collection. Web-based questionnaires can be used to validly collect data on many chronic disorders, allergies, and blood pressure readings among pregnant women.

Randomized controlled trials and real-world observational studies in evaluating cardiovascular safety of inhaled bronchodilator therapy in COPD.

PubMed

Kardos, Peter; Worsley, Sally; Singh, Dave; Román-Rodríguez, Miguel; Newby, David E; Müllerová, Hana

2016-01-01

Long-acting muscarinic antagonist (LAMA) or long-acting β2-agonist (LABA) bronchodilators and their combination are recommended for the maintenance treatment of chronic obstructive pulmonary disease (COPD). Although the efficacy of LAMAs and LABAs has been well established through randomized controlled trials (RCTs), questions remain regarding their cardiovascular (CV) safety. Furthermore, while the safety of LAMA and LABA monotherapy has been extensively studied, data are lacking for LAMA/LABA combination therapy, and the majority of the studies that have reported on the CV safety of LAMA/LABA combination therapy were not specifically designed to assess this. Evaluation of CV safety for COPD treatments is important because many patients with COPD have underlying CV comorbidities. However, severe CV and other comorbidities are often exclusion criteria for RCTs, contributing to a lack in external validity and generalizability. Real-world observational studies are another important tool to evaluate the effectiveness and safety of COPD therapies in a broader population of patients and can improve upon the external validity limitations of RCTs. We examine what is already known regarding the CV and cerebrovascular safety of LAMA/LABA combination therapy from RCTs and real-world observational studies, and explore the advantages and limitations of data derived from each study type. We also describe an ongoing prospective, observational, comparative post-authorization safety study of a LAMA/LABA combination therapy (umeclidinium/vilanterol) and LAMA monotherapy (umeclidinium) versus tiotropium, with a focus on the relative merits of the study design.

Observations of Tropospheric Carbon Monoxide From the Atmospheric InfraRed Sounder (AIRS): An Alternative Retrieval Scheme and Its Validation.

NASA Astrophysics Data System (ADS)

Douglass, D. H.; Kalnay, E.; Li, H.; Cai, M.

2005-05-01

Carbon monoxide (CO) is present in the troposphere as a product of fossil fuel combustion, biomass burning and the oxidation of volatile hydrocarbons. It is the principal sink of the hydroxyl radical (OH), thereby affecting the concentrations of greenhouse gases such as CH4 and O3. In addition, CO has a lifetime of 1-3 months, making it a good tracer for studying the long range transport of pollution. Satellite observations present a valuable tool in the investigation of tropospheric CO. The Atmospheric InfraRed Sounder (AIRS), onboard the Aqua satellite, is sensitive to tropospheric CO in a number of its 2378 channels. This sensitivity to CO, combined with the daily global coverage provided by AIRS, makes AIRS a potentially useful instrument for observing CO sources and transport. A maximum a posteriori (MAP) retrieval scheme (Rodgers 2000) has been developed for AIRS, to provide CO profiles from near-surface altitudes to around 150 hPa. An extensive validation data set, consisting of over 50 in-situ aircraft CO profiles, has been constructed. This data set combines CO data from a number of independent aircraft campaigns. Results from this validation study and comparisons with the AIRS level 2 CO product will be presented. Rodgers, C. D. (2000), Inverse Methods for Atmospheric Sounding : Theory and Practice, World Scientific, Singapore.

Investigation of sodium arsenite, thioacetamide, and diethanolamine in the alkaline comet assay: Part of the JaCVAM comet validation exercise.

PubMed

Beevers, Carol; Henderson, Debbie; Lillford, Lucinda

2015-07-01

As part of the Japanese Center for the Validation of Alternative Methods (JaCVAM)-initiative international validation study of the in vivo rat alkaline comet assay (comet assay), we examined sodium arsenite, thioacetamide, and diethanolamine. Using the JaCVAM approved study protocol version 14.2, each chemical was tested in male rats up to maximum tolerated dose levels and DNA damage in the liver and stomach was assessed approximately 3h after the final administration by gavage. Histopathology assessments of liver and stomach sections from the same animals were also examined for evidence of cytotoxicity or necrosis. No evidence of DNA damage was observed in the stomach of animals treated with sodium arsenite at 7.5, 15, or 30 mg/kg/day. However, equivocal findings were found in the liver, where increases in DNA migration were observed in two independent experiments, but not in all treated animals and not at the same dose levels. Thioacetamide caused an increase in DNA migration in the stomach of rats treated at 19, 38, and 75 mg/kg/day, but not in the liver, despite evidence of marked hepatotoxicity following histopathology assessments. No evidence of DNA damage was observed in the stomach or liver of animals treated with diethanolamine at 175, 350, or 700 mg/kg/day. Copyright © 2015 Elsevier B.V. All rights reserved.

Modelling Short-Term Maximum Individual Exposure from Airborne Hazardous Releases in Urban Environments. Part ΙI: Validation of a Deterministic Model with Wind Tunnel Experimental Data.

PubMed

Efthimiou, George C; Bartzis, John G; Berbekar, Eva; Hertwig, Denise; Harms, Frank; Leitl, Bernd

2015-06-26

The capability to predict short-term maximum individual exposure is very important for several applications including, for example, deliberate/accidental release of hazardous substances, odour fluctuations or material flammability level exceedance. Recently, authors have proposed a simple approach relating maximum individual exposure to parameters such as the fluctuation intensity and the concentration integral time scale. In the first part of this study (Part I), the methodology was validated against field measurements, which are governed by the natural variability of atmospheric boundary conditions. In Part II of this study, an in-depth validation of the approach is performed using reference data recorded under truly stationary and well documented flow conditions. For this reason, a boundary-layer wind-tunnel experiment was used. The experimental dataset includes 196 time-resolved concentration measurements which detect the dispersion from a continuous point source within an urban model of semi-idealized complexity. The data analysis allowed the improvement of an important model parameter. The model performed very well in predicting the maximum individual exposure, presenting a factor of two of observations equal to 95%. For large time intervals, an exponential correction term has been introduced in the model based on the experimental observations. The new model is capable of predicting all time intervals giving an overall factor of two of observations equal to 100%.

A Multisample Analysis of Psychometric Properties for the Malaysian Adapted Sport Anxiety Scale-2 Among Youth Athletes.

PubMed

Hashim, Hairul Anuar; Shaharuddin, Saidatin Sabiyah; Hamidan, Shazarina; Grove, J Robert

2017-02-01

This study examined psychometric properties of a Malaysian-language Sport Anxiety Scale-2 (SAS-2) in three separate studies. Study 1 examined the criterion validity and internal consistency of SAS-2 among 119 developmental hockey players. Measures of trait anxiety and mood states along with digit vigilance, choice reaction time, and depth perception tests were administered. Regression analysis revealed that somatic anxiety and concentration disruption were significantly associated with sustained attention. Worry was significantly associated with depth perception but not sustained attention. Pearson correlation coefficients also revealed significant relationships between SAS-2 subscales and negative mood state dimensions. Study 2 examined the convergent and discriminant validity of SAS-2 by correlating it with state anxiety measured by the CSAI-2R. Significant positive relationships were obtained between SAS-2 subscales and somatic and cognitive state anxiety. Conversely, state self-confidence was negatively related to SAS-2 subscales. In addition, significant differences were observed between men and women in somatic anxiety. Study 3 examined the factorial validity of the Malaysian SAS-2 using confirmatory factor analysis in a sample of 539 young athletes. Confirmatory factor analysis results provided strong support for the SAS-2 factor structure. Path loadings exceeding 0.5 indicated convergent validity among the subscales, and low to moderate subscale intercorrelations provided evidence of discriminant validity. Overall, the results supported the criterion and construct validity of this Malaysian-language SAS-2 instrument.

Reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire: a pilot study amongst older car drivers and motorcycle riders.

PubMed

Ang, B H; Chen, W S; Ngin, C K; Oxley, J A; Lee, S W H

2018-02-01

This study aimed to examine the reliability and validity of the English and Malay versions of the Driving and Riding Questionnaire. An observational study with a mix-method approach by utilising both questionnaire and short debriefing interviews. Forward and backward translations of the original questionnaire were performed. The translated questionnaire was assessed for clarity by a multidisciplinary research team, translators, and several Malay native speakers. A total of 24 subjects participated in the pilot study. Reliability (Cronbach's alpha) and validity (content validity) of the original and translated questionnaires were examined. The English and Malay versions of the Driving and Riding Questionnaire were found to be reliable tools in measuring driving behaviours amongst older drivers and riders, with Cronbach's alpha of 0.9158 and 0.8919, respectively. For content validity, the questionnaires were critically reviewed in terms of relevance, clarity, simplicity, and ambiguity. The feedback obtained from participants addressed various aspects of the questionnaire related to the improvement of wordings used and inclusion of visual guide to enhance the understanding of the items in the questionnaire. This feedback was incorporated into the final versions of the English and Malay questionnaires. The findings of this study demonstrated both the English and Malay versions of the Driving and Riding Questionnaire to be valid and reliable. Copyright © 2017 The Royal Society for Public Health. Published by Elsevier Ltd. All rights reserved.

An extended protocol for usability validation of medical devices: Research design and reference model.

PubMed

Schmettow, Martin; Schnittker, Raphaela; Schraagen, Jan Maarten

2017-05-01

This paper proposes and demonstrates an extended protocol for usability validation testing of medical devices. A review of currently used methods for the usability evaluation of medical devices revealed two main shortcomings. Firstly, the lack of methods to closely trace the interaction sequences and derive performance measures. Secondly, a prevailing focus on cross-sectional validation studies, ignoring the issues of learnability and training. The U.S. Federal Drug and Food Administration's recent proposal for a validation testing protocol for medical devices is then extended to address these shortcomings: (1) a novel process measure 'normative path deviations' is introduced that is useful for both quantitative and qualitative usability studies and (2) a longitudinal, completely within-subject study design is presented that assesses learnability, training effects and allows analysis of diversity of users. A reference regression model is introduced to analyze data from this and similar studies, drawing upon generalized linear mixed-effects models and a Bayesian estimation approach. The extended protocol is implemented and demonstrated in a study comparing a novel syringe infusion pump prototype to an existing design with a sample of 25 healthcare professionals. Strong performance differences between designs were observed with a variety of usability measures, as well as varying training-on-the-job effects. We discuss our findings with regard to validation testing guidelines, reflect on the extensions and discuss the perspectives they add to the validation process. Copyright © 2017 Elsevier Inc. All rights reserved.

Validity of an Observation Method for Assessing Pain Behavior in Individuals With Multiple Sclerosis

PubMed Central

Cook, Karon F.; Roddey, Toni S.; Bamer, Alyssa M.; Amtmann, Dagmar; Keefe, Francis J

2012-01-01

Context Pain is a common and complex experience for individuals who live with multiple sclerosis (MS) that interferes with physical, psychological and social function. A valid and reliable tool for quantifying observed pain behaviors in MS is critical to understanding how pain behaviors contribute to pain-related disability in this clinical population. Objectives To evaluate the reliability and validity of a pain behavioral observation protocol in individuals who have MS. Methods Community-dwelling volunteers with multiple sclerosis (N=30), back pain (N=5), or arthritis (N=8) were recruited based on clinician referrals, advertisements, fliers, web postings, and participation in previous research. Participants completed measures of pain severity, pain interference, and self-reported pain behaviors and were videotaped doing typical activities (e.g., walking, sitting). Two coders independently recorded frequencies of pain behaviors by category (e.g., guarding, bracing) and inter-rater reliability statistics were calculated. Naïve observers reviewed videotapes of individuals with MS and rated their pain. Spearman correlations were calculated between pain behavior frequencies and self-reported pain and pain ratings by naïve observers. Results Inter-rater reliability estimates indicated the reliability of pain codes in the MS sample. Kappa coefficients ranged from moderate agreement (sighing = 0.40) to substantial agreement (guarding = 0.83). These values were comparable to those obtained in the combined back pain and arthritis sample. Concurrent validity was supported by correlations with self-reported pain (0.46-0.53) and with self-reports of pain behaviors (0.58). Construct validity was supported by finding of 0.87 correlation between total pain behaviors observed by coders and mean pain ratings by naïve observers. Conclusion Results support use of the pain behavior observation protocol for assessing pain behaviors of individuals with MS. Valid assessments of pain behaviors of individuals with MS in could lead to creative interventions in the management of chronic pain in this population. PMID:23159684

Earth as an Extrasolar Planet: Earth Model Validation Using EPOXI Earth Observations

NASA Astrophysics Data System (ADS)

Robinson, Tyler D.; Meadows, Victoria S.; Crisp, David; Deming, Drake; A'Hearn, Michael F.; Charbonneau, David; Livengood, Timothy A.; Seager, Sara; Barry, Richard K.; Hearty, Thomas; Hewagama, Tilak; Lisse, Carey M.; McFadden, Lucy A.; Wellnitz, Dennis D.

2011-06-01

The EPOXI Discovery Mission of Opportunity reused the Deep Impact flyby spacecraft to obtain spatially and temporally resolved visible photometric and moderate resolution near-infrared (NIR) spectroscopic observations of Earth. These remote observations provide a rigorous validation of whole-disk Earth model simulations used to better understand remotely detectable extrasolar planet characteristics. We have used these data to upgrade, correct, and validate the NASA Astrobiology Institute's Virtual Planetary Laboratory three-dimensional line-by-line, multiple-scattering spectral Earth model. This comprehensive model now includes specular reflectance from the ocean and explicitly includes atmospheric effects such as Rayleigh scattering, gas absorption, and temperature structure. We have used this model to generate spatially and temporally resolved synthetic spectra and images of Earth for the dates of EPOXI observation. Model parameters were varied to yield an optimum fit to the data. We found that a minimum spatial resolution of ∼100 pixels on the visible disk, and four categories of water clouds, which were defined by using observed cloud positions and optical thicknesses, were needed to yield acceptable fits. The validated model provides a simultaneous fit to Earth's lightcurve, absolute brightness, and spectral data, with a root-mean-square (RMS) error of typically less than 3% for the multiwavelength lightcurves and residuals of ∼10% for the absolute brightness throughout the visible and NIR spectral range. We have extended our validation into the mid-infrared by comparing the model to high spectral resolution observations of Earth from the Atmospheric Infrared Sounder, obtaining a fit with residuals of ∼7% and brightness temperature errors of less than 1 K in the atmospheric window. For the purpose of understanding the observable characteristics of the distant Earth at arbitrary viewing geometry and observing cadence, our validated forward model can be used to simulate Earth's time-dependent brightness and spectral properties for wavelengths from the far ultraviolet to the far infrared.

Earth as an extrasolar planet: Earth model validation using EPOXI earth observations.

PubMed

Robinson, Tyler D; Meadows, Victoria S; Crisp, David; Deming, Drake; A'hearn, Michael F; Charbonneau, David; Livengood, Timothy A; Seager, Sara; Barry, Richard K; Hearty, Thomas; Hewagama, Tilak; Lisse, Carey M; McFadden, Lucy A; Wellnitz, Dennis D

2011-06-01

The EPOXI Discovery Mission of Opportunity reused the Deep Impact flyby spacecraft to obtain spatially and temporally resolved visible photometric and moderate resolution near-infrared (NIR) spectroscopic observations of Earth. These remote observations provide a rigorous validation of whole-disk Earth model simulations used to better understand remotely detectable extrasolar planet characteristics. We have used these data to upgrade, correct, and validate the NASA Astrobiology Institute's Virtual Planetary Laboratory three-dimensional line-by-line, multiple-scattering spectral Earth model. This comprehensive model now includes specular reflectance from the ocean and explicitly includes atmospheric effects such as Rayleigh scattering, gas absorption, and temperature structure. We have used this model to generate spatially and temporally resolved synthetic spectra and images of Earth for the dates of EPOXI observation. Model parameters were varied to yield an optimum fit to the data. We found that a minimum spatial resolution of ∼100 pixels on the visible disk, and four categories of water clouds, which were defined by using observed cloud positions and optical thicknesses, were needed to yield acceptable fits. The validated model provides a simultaneous fit to Earth's lightcurve, absolute brightness, and spectral data, with a root-mean-square (RMS) error of typically less than 3% for the multiwavelength lightcurves and residuals of ∼10% for the absolute brightness throughout the visible and NIR spectral range. We have extended our validation into the mid-infrared by comparing the model to high spectral resolution observations of Earth from the Atmospheric Infrared Sounder, obtaining a fit with residuals of ∼7% and brightness temperature errors of less than 1 K in the atmospheric window. For the purpose of understanding the observable characteristics of the distant Earth at arbitrary viewing geometry and observing cadence, our validated forward model can be used to simulate Earth's time-dependent brightness and spectral properties for wavelengths from the far ultraviolet to the far infrared. Key Words: Astrobiology-Extrasolar terrestrial planets-Habitability-Planetary science-Radiative transfer. Astrobiology 11, 393-408.

Earth as an Extrasolar Planet: Earth Model Validation Using EPOXI Earth Observations

NASA Technical Reports Server (NTRS)

Robinson, Tyler D.; Meadows, Victoria S.; Crisp, David; Deming, Drake; A'Hearn, Michael F.; Charbonneau, David; Livengood, Timothy A.; Seager, Sara; Barry, Richard; Hearty, Thomas;

Validation and Inter-comparison Against Observations of GODAE Ocean View Ocean Prediction Systems

NASA Astrophysics Data System (ADS)

Xu, J.; Davidson, F. J. M.; Smith, G. C.; Lu, Y.; Hernandez, F.; Regnier, C.; Drevillon, M.; Ryan, A.; Martin, M.; Spindler, T. D.; Brassington, G. B.; Oke, P. R.

2016-02-01

For weather forecasts, validation of forecast performance is done at the end user level as well as by the meteorological forecast centers. In the development of Ocean Prediction Capacity, the same level of care for ocean forecast performance and validation is needed. Herein we present results from a validation against observations of 6 Global Ocean Forecast Systems under the GODAE OceanView International Collaboration Network. These systems include the Global Ocean Ice Forecast System (GIOPS) developed by the Government of Canada, two systems PSY3 and PSY4 from the French Mercator-Ocean Ocean Forecasting Group, the FOAM system from UK met office, HYCOM-RTOFS from NOAA/NCEP/NWA of USA, and the Australian Bluelink-OceanMAPS system from the CSIRO, the Australian Meteorological Bureau and the Australian Navy.The observation data used in the comparison are sea surface temperature, sub-surface temperature, sub-surface salinity, sea level anomaly, and sea ice total concentration data. Results of the inter-comparison demonstrate forecast performance limits, strengths and weaknesses of each of the six systems. This work establishes validation protocols and routines by which all new prediction systems developed under the CONCEPTS Collaborative Network will be benchmarked prior to approval for operations. This includes anticipated delivery of CONCEPTS regional prediction systems over the next two years including a pan Canadian 1/12th degree resolution ice ocean prediction system and limited area 1/36th degree resolution prediction systems. The validation approach of comparing forecasts to observations at the time and location of the observation is called Class 4 metrics. It has been adopted by major international ocean prediction centers, and will be recommended to JCOMM-WMO as routine validation approach for operational oceanography worldwide.

Validity and reliability of a simple, low cost measure to quantify children’s dietary intake in afterschool settings

PubMed Central

Davison, Kirsten K.; Austin, S. Bryn; Giles, Catherine; Cradock, Angie L.; Lee, Rebekka M.; Gortmaker, Steven L.

2017-01-01

Interest in evaluating and improving children’s diets in afterschool settings has grown, necessitating the development of feasible yet valid measures for capturing children’s intake in such settings. This study’s purpose was to test the criterion validity and cost of three unobtrusive visual estimation methods compared to a plate-weighing method: direct on-site observation using a 4-category rating scale and off-site rating of digital photographs taken on-site using 4- and 10-category scales. Participants were 111 children in grades 1–6 attending four afterschool programs in Boston, MA in December 2011. Researchers observed and photographed 174 total snack meals consumed across two days at each program. Visual estimates of consumption were compared to weighed estimates (the criterion measure) using intra-class correlations. All three methods were highly correlated with the criterion measure, ranging from 0.92–0.94 for total calories consumed, 0.86–0.94 for consumption of pre-packaged beverages, 0.90–0.93 for consumption of fruits/vegetables, and 0.92–0.96 for consumption of grains. For water, which was not pre-portioned, coefficients ranged from 0.47–0.52. The photographic methods also demonstrated excellent inter-rater reliability: 0.84–0.92 for the 4-point and 0.92–0.95 for the 10-point scale. The costs of the methods for estimating intake ranged from $0.62 per observation for the on-site direct visual method to $0.95 per observation for the criterion measure. This study demonstrates that feasible, inexpensive methods can validly and reliably measure children’s dietary intake in afterschool settings. Improving precision in measures of children’s dietary intake can reduce the likelihood of spurious or null findings in future studies. PMID:25596895

Validation: Codes to compare simulation data to various observations

NASA Astrophysics Data System (ADS)

Cohn, J. D.

2017-02-01

Validation provides codes to compare several observations to simulated data with stellar mass and star formation rate, simulated data stellar mass function with observed stellar mass function from PRIMUS or SDSS-GALEX in several redshift bins from 0.01-1.0, and simulated data B band luminosity function with observed stellar mass function, and to create plots for various attributes, including stellar mass functions, and stellar mass to halo mass. These codes can model predictions (in some cases alongside observational data) to test other mock catalogs.

Anxiety in early Parkinson's disease: Validation of the Italian observer-rated version of the Parkinson Anxiety Scale (OR-PAS).

PubMed

Santangelo, Gabriella; Falco, Fabrizia; D'Iorio, Alfonsina; Cuoco, Sofia; Raimo, Simona; Amboni, Marianna; Pellecchia, Maria Teresa; Longo, Katia; Vitale, Carmine; Barone, Paolo

2016-08-15

Anxiety disorders are common in Parkinson's Disease (PD) and their identification is relevant even at early stages. The Parkinson Anxiety Scale (PAS) evaluates anxiety in PD; it was used only in the original validation study in PD patients mainly at 2-3 stages of Hoehn & Yahr system (H&Y). The study aimed to investigate psychometric properties of observer-rated version of the PAS (OR-PAS), prevalence rate of anxiety and its features, compared with diagnostic criteria in early PD patients. A sample of 101 PD patients with H&Y:1-2 underwent the OR-PAS. To assess convergent and divergent validity, PD patients underwent Beck Anxiety Inventory, and scales assessing depression, apathy, anhedonia and cognition. To diagnose anxiety disorders, Mini International Neuropsychiatric Inventory was used as gold standard. A "receiver operating characteristics" curve was obtained; positive and negative predictive values were calculated for different cut-off points of the OR-PAS and its subscales. There was no missing data, no floor and ceiling effects; mean score was 12.2±10.1; Cronbach's alpha was 0.899. The OR-PAS showed good convergent and divergent validity. Maximum discrimination was obtained with a cut-off score of 8.5. The anxiety occurred in 59 patients (58.4%). The OR-PAS is a reliable and valid screening instrument for assessing anxiety in patients at early PD. Anxiety was found in 58.4% of PD patients, demonstrating that anxiety occurs even at early stages. Copyright © 2016 Elsevier B.V. All rights reserved.

Milestone-compatible neurology resident assessments: A role for observable practice activities.

PubMed

Jones, Lyell K; Dimberg, Elliot L; Boes, Christopher J; Eggers, Scott D Z; Dodick, David W; Cutsforth-Gregory, Jeremy K; Leep Hunderfund, Andrea N; Capobianco, David J

2015-06-02

Beginning in 2014, US neurology residency programs were required to report each trainee's educational progression within 29 neurology Milestone competency domains. Trainee assessment systems will need to be adapted to inform these requirements. The primary aims of this study were to validate neurology resident assessment content using observable practice activities (OPAs) and to develop assessment formats easily translated to the Neurology Milestones. A modified Delphi technique was used to establish consensus perceptions of importance of 73 neurology OPAs among neurology educators and trainees at 3 neurology residency programs. A content validity score (CVS) was derived for each neurology OPA, with scores ≥4.0 determined in advance to indicate sufficient content validity. The mean CVS for all OPAs was 4.4 (range 3.5-5.0). Fifty-seven (78%) OPAs had a CVS ≥4.0, leaving 16 (22%) below the pre-established threshold for content validity. Trainees assigned a higher importance to individual OPAs (mean CVS 4.6) compared to faculty (mean 4.4, p = 0.016), but the effect size was small (η(2) = 0.10). There was no demonstrated effect of length of education experience on perceived importance of neurology OPAs (p = 0.23). Two sample resident assessment formats were developed, one using neurology OPAs alone and another using a combination of neurology OPAs and the Neurology Milestones. This study provides neurology training programs with content validity evidence for items to include in resident assessments, and sample assessment formats that directly translate to the Neurology Milestones. Length of education experience has little effect on perceptions of neurology OPA importance. © 2015 American Academy of Neurology.

The Chelsea critical care physical assessment tool (CPAx): validation of an innovative new tool to measure physical morbidity in the general adult critical care population; an observational proof-of-concept pilot study.

PubMed

Corner, E J; Wood, H; Englebretsen, C; Thomas, A; Grant, R L; Nikoletou, D; Soni, N

2013-03-01

To develop a scoring system to measure physical morbidity in critical care - the Chelsea Critical Care Physical Assessment Tool (CPAx). The development process was iterative involving content validity indices (CVI), a focus group and an observational study of 33 patients to test construct validity against the Medical Research Council score for muscle strength, peak cough flow, Australian Therapy Outcome Measures score, Glasgow Coma Scale score, Bloomsbury sedation score, Sequential Organ Failure Assessment score, Short Form 36 (SF-36) score, days of mechanical ventilation and inter-rater reliability. Trauma and general critical care patients from two London teaching hospitals. Users of the CPAx felt that it possessed content validity, giving a final CVI of 1.00 (P<0.05). Construct validation data showed moderate to strong significant correlations between the CPAx score and all secondary measures, apart from the mental component of the SF-36 which demonstrated weak correlation with the CPAx score (r=0.024, P=0.720). Reliability testing showed internal consistency of α=0.798 and inter-rater reliability of κ=0.988 (95% confidence interval 0.791 to 1.000) between five raters. This pilot work supports proof of concept of the CPAx as a measure of physical morbidity in the critical care population, and is a cogent argument for further investigation of the scoring system. Copyright © 2012 Chartered Society of Physiotherapy. Published by Elsevier Ltd. All rights reserved.

Ocean Observations with EOS/MODIS: Algorithm Development and Post Launch Studies

NASA Technical Reports Server (NTRS)

Gordon, Howard R.; Conboy, Barbara (Technical Monitor)

1999-01-01

This separation has been logical thus far; however, as launch of AM-1 approaches, it must be recognized that many of these activities will shift emphasis from algorithm development to validation. For example, the second, third, and fifth bullets will become almost totally validation-focussed activities in the post-launch era, providing the core of our experimental validation effort. Work under the first bullet will continue into the post-launch time frame, driven in part by algorithm deficiencies revealed as a result of validation activities. Prior to the start of the 1999 fiscal year (FY99) we were requested to prepare a brief plan for our FY99 activities. This plan is included as Appendix 1. The present report describes the progress made on our planned activities.

Construct Validity of the Emotional Eating Scale Adapted for Children and Adolescents

PubMed Central

Vannucci, Anna; Tanofsky-Kraff, Marian; Shomaker, Lauren B.; Ranzenhofer, Lisa M.; Matheson, Brittany E.; Cassidy, Omni L.; Zocca, Jaclyn M.; Kozlosky, Merel; Yanovski, Susan Z.; Yanovski, Jack A.

2012-01-01

Background Emotional eating, defined as eating in response to a range of negative emotions, is common in youth. Yet, there are few easily administered and well-validated methods to assess emotional eating in pediatric populations. Objective The current study tested the construct validity of the Emotional Eating Scale Adapted for Children and Adolescents (EES-C) by examining its relationship to observed emotional eating at laboratory test meals. Method One hundred fifty-one youth (8-18 years) participated in two multi-item lunch buffet meals on separate days. They ate ad libitum after being instructed to “eat as much as you would at a normal meal” or to “let yourself go and eat as much as you want.” State negative affect was assessed immediately prior to each meal. The EES-C was completed three months, on average, prior to the first test meal. Results Among youth with high EES-C total scores, but not low EES-C scores, higher pre-meal state negative affect was related to greater total energy intake at both meals, with and without the inclusion of age, race, sex, and BMI-z as covariates (ps < 0.03). Discussion The EES-C demonstrates good construct validity for children and adolescents’ observed energy intake across laboratory test meals designed to capture both normal and disinhibited eating. Future research is required to evaluate the construct validity of the EES-C in the natural environment and the predictive validity of the EES-C longitudinally. PMID:22124451

A newly developed tool for classifying study designs in systematic reviews of interventions and exposures showed substantial reliability and validity.

PubMed

Seo, Hyun-Ju; Kim, Soo Young; Lee, Yoon Jae; Jang, Bo-Hyoung; Park, Ji-Eun; Sheen, Seung-Soo; Hahn, Seo Kyung

2016-02-01

To develop a study Design Algorithm for Medical Literature on Intervention (DAMI) and test its interrater reliability, construct validity, and ease of use. We developed and then revised the DAMI to include detailed instructions. To test the DAMI's reliability, we used a purposive sample of 134 primary, mainly nonrandomized studies. We then compared the study designs as classified by the original authors and through the DAMI. Unweighted kappa statistics were computed to test interrater reliability and construct validity based on the level of agreement between the original and DAMI classifications. Assessment time was also recorded to evaluate ease of use. The DAMI includes 13 study designs, including experimental and observational studies of interventions and exposure. Both the interrater reliability (unweighted kappa = 0.67; 95% CI [0.64-0.75]) and construct validity (unweighted kappa = 0.63, 95% CI [0.52-0.67]) were substantial. Mean classification time using the DAMI was 4.08 ± 2.44 minutes (range, 0.51-10.92). The DAMI showed substantial interrater reliability and construct validity. Furthermore, given its ease of use, it could be used to accurately classify medical literature for systematic reviews of interventions although minimizing disagreement between authors of such reviews. Copyright © 2016 Elsevier Inc. All rights reserved.

The Added Value of the Combined Use of the Autism Diagnostic Interview-Revised and the Autism Diagnostic Observation Schedule: Diagnostic Validity in a Clinical Swedish Sample of Toddlers and Young Preschoolers

ERIC Educational Resources Information Center

Zander, Eric; Sturm, Harald; Bölte, Sven

2015-01-01

The diagnostic validity of the new research algorithms of the Autism Diagnostic Interview-Revised and the revised algorithms of the Autism Diagnostic Observation Schedule was examined in a clinical sample of children aged 18-47 months. Validity was determined for each instrument separately and their combination against a clinical consensus…

Modeling Clinical Outcomes in Prostate Cancer: Application and Validation of the Discrete Event Simulation Approach.

PubMed

Pan, Feng; Reifsnider, Odette; Zheng, Ying; Proskorovsky, Irina; Li, Tracy; He, Jianming; Sorensen, Sonja V

2018-04-01

Treatment landscape in prostate cancer has changed dramatically with the emergence of new medicines in the past few years. The traditional survival partition model (SPM) cannot accurately predict long-term clinical outcomes because it is limited by its ability to capture the key consequences associated with this changing treatment paradigm. The objective of this study was to introduce and validate a discrete-event simulation (DES) model for prostate cancer. A DES model was developed to simulate overall survival (OS) and other clinical outcomes based on patient characteristics, treatment received, and disease progression history. We tested and validated this model with clinical trial data from the abiraterone acetate phase III trial (COU-AA-302). The model was constructed with interim data (55% death) and validated with the final data (96% death). Predicted OS values were also compared with those from the SPM. The DES model's predicted time to chemotherapy and OS are highly consistent with the final observed data. The model accurately predicts the OS hazard ratio from the final data cut (predicted: 0.74; 95% confidence interval [CI] 0.64-0.85 and final actual: 0.74; 95% CI 0.6-0.88). The log-rank test to compare the observed and predicted OS curves indicated no statistically significant difference between observed and predicted curves. However, the predictions from the SPM based on interim data deviated significantly from the final data. Our study showed that a DES model with properly developed risk equations presents considerable improvements to the more traditional SPM in flexibility and predictive accuracy of long-term outcomes. Copyright © 2018 International Society for Pharmacoeconomics and Outcomes Research (ISPOR). Published by Elsevier Inc. All rights reserved.

A clinician-administered observation and corresponding caregiver interview capturing DSM-5 sensory reactivity symptoms in children with ASD.

PubMed

Siper, Paige M; Kolevzon, Alexander; Wang, A Ting; Buxbaum, Joseph D; Tavassoli, Teresa

2017-06-01

Sensory reactivity is a new criterion for autism spectrum disorder (ASD) in the Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5). However, there is no consensus on how to reliably measure sensory reactivity, particularly in minimally verbal individuals. The current study is an initial validation of the Sensory Assessment for Neurodevelopmental Disorders (SAND), a novel clinician-administered observation and corresponding caregiver interview that captures sensory symptoms based on DSM-5 criteria for ASD. Eighty children between the ages of 2 and 12 participated in this study; 44 children with ASD and 36 typically developing (TD) children. Sensory reactivity symptoms were measured using the SAND and the already validated Short Sensory Profile (SSP). Initial psychometric properties of the SAND were examined including reliability, validity, sensitivity and specificity. Children with ASD showed significantly more sensory reactivity symptoms compared to TD children across sensory domains (visual, tactile, and auditory) and within sensory subtypes (hyperreactivity, hyporeactivity and seeking). The SAND showed strong internal consistency, inter-rater reliability and test-retest reliability, high sensitivity (95.5%) and specificity (91.7%), and strong convergent validity with the SSP. The SAND provides a novel method to characterize sensory reactivity symptoms based on DSM-5 criteria for ASD. This is the first known sensory assessment that combines a clinician-administered observation and caregiver interview to optimally capture sensory phenotypes characteristic of individuals with neurodevelopmental disorders. The SAND offers a beneficial new tool for both research and clinical purposes and has the potential to meaningfully enhance gold-standard assessment of ASD. Autism Res 2017, 10: 1133-1140. © 2017 International Society for Autism Research, Wiley Periodicals, Inc. © 2017 International Society for Autism Research, Wiley Periodicals, Inc.

Face Validity of the Single Work Ability Item: Comparison with Objectively Measured Heart Rate Reserve over Several Days

PubMed Central

Gupta, Nidhi; Jensen, Bjørn Søvsø; Søgaard, Karen; Carneiro, Isabella Gomes; Christiansen, Caroline Stordal; Hanisch, Christiana; Holtermann, Andreas

2014-01-01

Purpose: The purpose of this study was to investigate the face validity of the self-reported single item work ability with objectively measured heart rate reserve (%HRR) among blue-collar workers. Methods: We utilized data from 127 blue-collar workers (Female = 53; Male = 74) aged 18–65 years from the cross-sectional “New method for Objective Measurements of physical Activity in Daily living (NOMAD)” study. The workers reported their single item work ability and completed an aerobic capacity cycling test and objective measurements of heart rate reserve monitored with Actiheart for 3–4 days with a total of 5,810 h, including 2,640 working hours. Results: A significant moderate correlation between work ability and %HRR was observed among males (R = −0.33, P = 0.005), but not among females (R = 0.11, P = 0.431). In a gender-stratified multi-adjusted logistic regression analysis, males with high %HRR were more likely to report a reduced work ability compared to males with low %HRR [OR = 4.75, 95% confidence interval (95% CI) = 1.31 to 17.25]. However, this association was not found among females (OR = 0.26, 95% CI 0.03 to 2.16), and a significant interaction between work ability, %HRR and gender was observed (P = 0.03). Conclusions: The observed association between work ability and objectively measured %HRR over several days among male blue-collar workers supports the face validity of the single work ability item. It is a useful and valid measure of the relation between physical work demands and resources among male blue-collar workers. The contrasting association among females needs to be further investigated. PMID:24840350

Unresolved versus resolved: testing the validity of young simple stellar population models with VLT/MUSE observations of NGC 3603

NASA Astrophysics Data System (ADS)

Kuncarayakti, H.; Galbany, L.; Anderson, J. P.; Krühler, T.; Hamuy, M.

2016-09-01

Context. Stellar populations are the building blocks of galaxies, including the Milky Way. The majority, if not all, extragalactic studies are entangled with the use of stellar population models given the unresolved nature of their observation. Extragalactic systems contain multiple stellar populations with complex star formation histories. However, studies of these systems are mainly based upon the principles of simple stellar populations (SSP). Hence, it is critical to examine the validity of SSP models. Aims: This work aims to empirically test the validity of SSP models. This is done by comparing SSP models against observations of spatially resolved young stellar population in the determination of its physical properties, that is, age and metallicity. Methods: Integral field spectroscopy of a young stellar cluster in the Milky Way, NGC 3603, was used to study the properties of the cluster as both a resolved and unresolved stellar population. The unresolved stellar population was analysed using the Hα equivalent width as an age indicator and the ratio of strong emission lines to infer metallicity. In addition, spectral energy distribution (SED) fitting using STARLIGHT was used to infer these properties from the integrated spectrum. Independently, the resolved stellar population was analysed using the colour-magnitude diagram (CMD) to determine age and metallicity. As the SSP model represents the unresolved stellar population, the derived age and metallicity were tested to determine whether they agree with those derived from resolved stars. Results: The age and metallicity estimate of NGC 3603 derived from integrated spectroscopy are confirmed to be within the range of those derived from the CMD of the resolved stellar population, including other estimates found in the literature. The result from this pilot study supports the reliability of SSP models for studying unresolved young stellar populations. Based on observations collected at the European Organisation for Astronomical Research in the Southern Hemisphere under ESO programme 60.A-9344.

Applicability of Monte Carlo cross validation technique for model development and validation using generalised least squares regression

NASA Astrophysics Data System (ADS)

Haddad, Khaled; Rahman, Ataur; A Zaman, Mohammad; Shrestha, Surendra

2013-03-01

SummaryIn regional hydrologic regression analysis, model selection and validation are regarded as important steps. Here, the model selection is usually based on some measurements of goodness-of-fit between the model prediction and observed data. In Regional Flood Frequency Analysis (RFFA), leave-one-out (LOO) validation or a fixed percentage leave out validation (e.g., 10%) is commonly adopted to assess the predictive ability of regression-based prediction equations. This paper develops a Monte Carlo Cross Validation (MCCV) technique (which has widely been adopted in Chemometrics and Econometrics) in RFFA using Generalised Least Squares Regression (GLSR) and compares it with the most commonly adopted LOO validation approach. The study uses simulated and regional flood data from the state of New South Wales in Australia. It is found that when developing hydrologic regression models, application of the MCCV is likely to result in a more parsimonious model than the LOO. It has also been found that the MCCV can provide a more realistic estimate of a model's predictive ability when compared with the LOO.

Are secondary data sources on the neighbourhood food environment accurate? Case-study in Glasgow, UK.

PubMed

Cummins, Steven; Macintyre, Sally

2009-12-01

To assess the validity of a publicly available list of food stores through field observations of their existence, in order to contribute to research on neighbourhood food environments and health. All multiple-owned supermarkets, and a 1 in 8 sample of other food outlets, listed in 1997 and 2007 in the public register of food premises held by Glasgow City Council, Scotland, were visited to establish whether they were trading as foodstores. Postcode sectors in which foodstores were located were classified into least, middling and most deprived neighbourhoods. In total, 325 listed foodstores were visited in 1997 and 508 in 2007. Of these 87% and 88%, respectively, were trading as foodstores. There was a very slight gradient in validity by deprivation, with validity higher in least deprived neighbourhoods, though this was not statistically significant. There was reasonable, but not perfect, agreement between the list of food premises and field observations, with nearly 1 in 9 of sampled foodstores not present on the ground. Since the use of inaccurate secondary data sources may affect estimates of relationships between the neighbourhood food environment and health, further work is required to establish the validity of such data in different contexts.

Validation of the Medisana MTP Plus upper arm blood pressure monitor, for self-measurement, according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Erdem, Emre; Aydogdu, Türkan; Akpolat, Tekin

2011-02-01

Standard validation protocols are objective guides for healthcare providers, physicians, and patients. The purpose of this study was to test validation of the Medisana MTP Plus upper arm blood pressure (BP) measuring monitor for self-measurement according to the European Society of Hypertension International Protocol (ESH-IP2) in adults. The Medisana MTP Plus monitor is an automated and oscillometric upper arm device for home BP monitoring. Nine consecutive measurements were made according to the ESH-IP2. Overseen by an independent supervisor, measurements were recorded by two observers blinded from both each other's readings and from the device readings. The Medisana MTP Plus device fulfills the validation criteria of the ESH-IP2 for the general population. The mean (standard deviation) of the difference between the observers and the device measurements was 0.6 mmHg (5.1 mmHg) for systolic and 2.7 mmHg (3.4 mmHg) for diastolic pressures, respectively. As the Medisana MTP Plus device has achieved the required standards, it is recommended for home BP monitoring in an adult population.

Surface Emissivity Effects on Thermodynamic Retrieval of IR Spectral Radiance

NASA Technical Reports Server (NTRS)

Zhou, Daniel K.; Larar, Allen M.; Smith, William L.; Liu, Xu

2006-01-01

The surface emissivity effect on the thermodynamic parameters (e.g., the surface skin temperature, atmospheric temperature, and moisture) retrieved from satellite infrared (IR) spectral radiance is studied. Simulation analysis demonstrates that surface emissivity plays an important role in retrieval of surface skin temperature and terrestrial boundary layer (TBL) moisture. NAST-I ultraspectral data collected during the CLAMS field campaign are used to retrieve thermodynamic properties of the atmosphere and surface. The retrievals are then validated by coincident in-situ measurements, such as sea surface temperature, radiosonde temperature and moisture profiles. Retrieved surface emissivity is also validated by that computed from the observed radiance and calculated emissions based on the retrievals of surface temperature and atmospheric profiles. In addition, retrieved surface skin temperature and emissivity are validated together by radiance comparison between the observation and retrieval-based calculation in the window region where atmospheric contribution is minimized. Both simulation and validation results have lead to the conclusion that variable surface emissivity in the inversion process is needed to obtain accurate retrievals from satellite IR spectral radiance measurements. Retrieval examples are presented to reveal that surface emissivity plays a significant role in retrieving accurate surface skin temperature and TBL thermodynamic parameters.

Diagnosing paratonia in the demented elderly: reliability and validity of the Paratonia Assessment Instrument (PAI).

PubMed

Hobbelen, Johannes S M; Koopmans, Raymond T C M; Verhey, Frans R J; Habraken, Kitty M; de Bie, Rob A

2008-08-01

Paratonia is one of the associated movement disorders characteristic of dementia. The aim of this study was to develop an assessment tool (the Paratonia Assessment Instrument, PAI), based on the new consensus definition of paratonia. An additional aim was to investigate the reliability and validity of the PAI. A three-phase cross-sectional survey was conducted. In the first two phases, the PAI was developed and validated. In the third phase, the inter-observer reliability and feasibility of the instrument was tested. The original PAI consisted of five criteria that all needed to be met in order to make the diagnosis. On the basis of a qualitative analysis, one criterion was reformulated and another was removed. Following this, inter-observer reliability between the two assessors resulted in an improvement of Cohen's kappa from 0.532 in the initial phase to 0.677 in the second phase. This improvement was substantiated in the third phase by two independent assessors with Cohen's kappa ranging from 0.625 to 1. The PAI is a reliable and valid assessment tool for diagnosing paratonia in elderly people with dementia that can be applied easily in daily practice.

MicroRNA Expression Profiling to Identify and Validate Reference Genes for the Relative Quantification of microRNA in Rectal Cancer.

PubMed

Eriksen, Anne Haahr Mellergaard; Andersen, Rikke Fredslund; Pallisgaard, Niels; Sørensen, Flemming Brandt; Jakobsen, Anders; Hansen, Torben Frøstrup

2016-01-01

MicroRNAs (miRNAs) play important roles in regulating biological processes at the post-transcriptional level. Deregulation of miRNAs has been observed in cancer, and miRNAs are being investigated as potential biomarkers regarding diagnosis, prognosis and prediction in cancer management. Real-time quantitative polymerase chain reaction (RT-qPCR) is commonly used, when measuring miRNA expression. Appropriate normalisation of RT-qPCR data is important to ensure reliable results. The aim of the present study was to identify stably expressed miRNAs applicable as normaliser candidates in future studies of miRNA expression in rectal cancer. We performed high-throughput miRNA profiling (OpenArray®) on ten pairs of laser micro-dissected rectal cancer tissue and adjacent stroma. A global mean expression normalisation strategy was applied to identify the most stably expressed miRNAs for subsequent validation. In the first validation experiment, a panel of miRNAs were analysed on 25 pairs of micro dissected rectal cancer tissue and adjacent stroma. Subsequently, the same miRNAs were analysed in 28 pairs of rectal cancer tissue and normal rectal mucosa. From the miRNA profiling experiment, miR-645, miR-193a-5p, miR-27a and let-7g were identified as stably expressed, both in malignant and stromal tissue. In addition, NormFinder confirmed high expression stability for the four miRNAs. In the RT-qPCR based validation experiments, no significant difference between tumour and stroma/normal rectal mucosa was detected for the mean of the normaliser candidates miR-27a, miR-193a-5p and let-7g (first validation P = 0.801, second validation P = 0.321). MiR-645 was excluded from the data analysis, because it was undetected in 35 of 50 samples (first validation) and in 24 of 56 samples (second validation), respectively. Significant difference in expression level of RNU6B was observed between tumour and adjacent stromal (first validation), and between tumour and normal rectal mucosa (second validation). We recommend the mean expression of miR-27a, miR-193a-5p and let-7g as normalisation factor, when performing miRNA expression analyses by RT-qPCR on rectal cancer tissue.

Evaluating Land-Atmosphere Interactions with the North American Soil Moisture Database

NASA Astrophysics Data System (ADS)

Giles, S. M.; Quiring, S. M.; Ford, T.; Chavez, N.; Galvan, J.

2015-12-01

The North American Soil Moisture Database (NASMD) is a high-quality observational soil moisture database that was developed to study land-atmosphere interactions. It includes over 1,800 monitoring stations the United States, Canada and Mexico. Soil moisture data are collected from multiple sources, quality controlled and integrated into an online database (soilmoisture.tamu.edu). The period of record varies substantially and only a few of these stations have an observation record extending back into the 1990s. Daily soil moisture observations have been quality controlled using the North American Soil Moisture Database QAQC algorithm. The database is designed to facilitate observationally-driven investigations of land-atmosphere interactions, validation of the accuracy of soil moisture simulations in global land surface models, satellite calibration/validation for SMOS and SMAP, and an improved understanding of how soil moisture influences climate on seasonal to interannual timescales. This paper provides some examples of how the NASMD has been utilized to enhance understanding of land-atmosphere interactions in the U.S. Great Plains.

Assessing the validity and intra-observer agreement of the MIDAM-LTC; an instrument measuring factors that influence personal dignity in long-term care facilities

PubMed Central

2014-01-01

Background Patients who are cared for in long-term care facilities are vulnerable to lose personal dignity. An instrument measuring factors that influence dignity can be used to better target dignity-conserving care to an individual patient, but no such instrument is yet available for the long-term care setting. The aim of this study was to create the Measurement Instrument for Dignity AMsterdam - for Long-Term Care facilities (MIDAM-LTC) and to assess its validity and intra-observer agreement. Methods Thirteen items specific for the LTC setting were added to the earlier developed, more general MIDAM. The MIDAM-LTC consisted of 39 symptoms or experiences for which presence as well as influence on dignity were asked, and a single item score for overall personal dignity. Questionnaires containing the MIDAM-LTC were administered face-to-face at two moments (with a 1-week interval) to 95 nursing home residents residing on general medical wards of six nursing homes in the Netherlands. Constructs related to dignity (WHO Well-Being Five Index, quality of life and physical health status) were also measured. Ten residents answered the questions while thinking aloud. Content validity, construct validity and intra-observer agreement were examined. Results Nine of the 39 items barely exerted influence on dignity. Eight of them could be omitted from the MIDAM-LTC, because the thinking aloud method revealed sensible explanations for their small influence on dignity. Residents reported that they missed no important items. Hypotheses to support construct validity, about the strength of correlations between on the one hand personal dignity and on the other hand well-being, quality of life or physical health status, were confirmed. On average, 83% of the scores given for each item’s influence on dignity were practically consistent over 1 week, and more than 80% of the residents gave consistent scores for the single item score for overall dignity. Conclusion The MIDAM-LTC has good content validity, construct validity and intra-observer agreement. By omitting 8 items from the instrument, a good balance between comprehensiveness and feasibility is realised. The MIDAM-LTC allows researchers to examine the concept of dignity more closely in the LTC setting, and can assist caregivers in providing dignity-conserving care. PMID:24512296

Transcultural adaptation into Spanish of the Induction Compliance Checklist for assessing children's behaviour during induction of anaesthesia.

PubMed

Jerez-Molina, Carmen; Lázaro-Alcay, Juan J; Ullán-de la Fuente, Ana M

2017-10-17

Cross-cultural adaptation into Spanish of the Induction Compliance Checklist (ICC) for assessing children's behaviour during induction of anaesthesia. A descriptive cross-sectional observational study was conducted on a sample of 81 children aged 2 to 12 years operated in an ambulatory surgery unit of a paediatric hospital in Barcelona. Adaptation by translation-back translation of the tool and analysis of the scale's validity and reliability. Face validity of the tool was guaranteed through a discussion group and inter-observer reliability was evaluated, obtaining an intraclass correlation index of r = 0.956. The ICC scale validated for the Spanish population can be an effective tool for the presurgical evaluation of activities carried out to minimise children's anxiety. The ICC is an easy-to-use scale completed by operating room staff in one minute and would provide important information about children's behaviour, specifically during induction. Copyright © 2017 Elsevier España, S.L.U. All rights reserved.

A Tool for Measuring Active Learning in the Classroom

PubMed Central

Devlin, John W.; Kirwin, Jennifer L.; Qualters, Donna M.

2007-01-01

Objectives To develop a valid and reliable active-learning inventory tool for use in large classrooms and compare faculty perceptions of active-learning using the Active-Learning Inventory Tool. Methods The Active-Learning Inventory Tool was developed using published literature and validated by national experts in educational research. Reliability was established by trained faculty members who used the Active-Learning Inventory Tool to observe 9 pharmacy lectures. Instructors were then interviewed to elicit perceptions regarding active learning and asked to share their perceptions. Results Per lecture, 13 (range: 4-34) episodes of active learning encompassing 3 (range: 2-5) different types of active learning occurred over 2.2 minutes (0.6-16) per episode. Both interobserver (≥87%) and observer-instructor agreement (≥68%) were high for these outcomes. Conclusions The Active-Learning Inventory Tool is a valid and reliable tool to measure active learning in the classroom. Future studies are needed to determine the impact of the Active-Learning Inventory Tool on teaching and its usefulness in other disciplines. PMID:17998982

Visual judgements of steadiness in one-legged stance: reliability and validity.

PubMed

Haupstein, T; Goldie, P

2000-01-01

There is a paucity of information about the validity and reliability of clinicians' visual judgements of steadiness in one-legged stance. Such judgements are used frequently in clinical practice to support decisions about treatment in the fields of neurology, sports medicine, paediatrics and orthopaedics. The aim of the present study was to address the validity and reliability of visual judgements of steadiness in one-legged stance in a group of physiotherapists. A videotape of 20 five-second performances was shown to 14 physiotherapists with median clinical experience of 6.75 years. Validity of visual judgement was established by correlating scores obtained from an 11-point rating scale with criterion scores obtained from a force platform. In addition, partial correlations were used to control for the potential influence of body weight on the relationship between the visual judgements and criterion scores. Inter-observer reliability was quantified between the physiotherapists; intra-observer reliability was quantified between two tests four weeks apart. Mean criterion-related validity was high, regardless of whether body weight was controlled for statistically (Pearson's r = 0.84, 0.83, respectively). The standard error of estimating the criterion score was 3.3 newtons. Inter-observer reliability was high (ICC (2,1) = 0.81 at Test 1 and 0.82 at Test 2). Intra-observer reliability was high (on average ICC (2,1) = 0.88; Pearson's r = 0.90). The standard error of measurement for the 11-point scale was one unit. The finding of higher accuracy of making visual judgements than previously reported may be due to several aspects of design: use of a criterion score derived from the variability of the force signal which is more discriminating than variability of centre of pressure; use of a discriminating visual rating scale; specificity and clear definition of the phenomenon to be rated.

Bio-Optical Measurement and Modeling of the California Current and Polar Oceans. Chapter 13

NASA Technical Reports Server (NTRS)

Mitchell, B. Greg

2001-01-01

This Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project contract supports in situ ocean optical observations in the California Current, Southern Ocean, Indian Ocean as well as merger of other in situ data sets we have collected on various global cruises supported by separate grants or contracts. The principal goals of our research are to validate standard or experimental products through detailed bio-optical and biogeochemical measurements, and to combine ocean optical observations with advanced radiative transfer modeling to contribute to satellite vicarious radiometric calibration and advanced algorithm development. In collaboration with major oceanographic ship-based observation programs funded by various agencies (CalCOFI, US JGOFS, NOAA AMLR, INDOEX and Japan/East Sea) our SIMBIOS effort has resulted in data from diverse bio-optical provinces. For these global deployments we generate a high-quality, methodologically consistent, data set encompassing a wide-range of oceanic conditions. Global data collected in recent years have been integrated with our on-going CalCOFI database and have been used to evaluate Sea-Viewing Wide Field-of-view Sensor (SeaWiFS) algorithms and to carry out validation studies. The combined database we have assembled now comprises more than 700 stations and includes observations for the clearest oligotrophic waters, highly eutrophic blooms, red-tides and coastal case two conditions. The data has been used to validate water-leaving radiance estimated with SeaWiFS as well as bio optical algorithms for chlorophyll pigments. The comprehensive data is utilized for development of experimental algorithms (e.g., high-low latitude pigment transition, phytoplankton absorption, and cDOM).

Development of a measure of student self-evaluation of physics exam performance

NASA Astrophysics Data System (ADS)

Hagedorn, Eric Anthony

The central purpose of this study was to provide preliminary evidence of the reliability and validity of the SEVSI - P (Self- evaluation scaled instrument - physics). This instrument, designed to measure student self-evaluation of physics exam performance, was developed in congruence with social cognitive theory. Self-evaluation in this study is defined to consist of two of the three subprocesses of self-regulation: self-observation and judgmental process. As such, the SEVSI - P consists of two subscales, one measuring the frequency and types of self-observations made during a physics exam and one measuring the frequency and types of judgmental comparisons made after an exam. Data from 621 completed surveys, voluntarily taken by first semester algebra/trigonometry based physics students at six Midwestern universities and one Southern university, were analyzed for reliability and factorial validity. Cronbach alphas of .71 and .83 for the self-observation and judgment subscales, respectively, indicate acceptable reliability for the instrument. Confirmatory factor analysis indicates the acceptability of the hypothesis that the data analyzed could have indeed been obtained from the proposed two factor model (self-observation and judgment). The results of this confirmatory factor analysis provide preliminary construct validity for this instrument. A number of theoretically related items were included on the SEVSI - P form to elicity information about the use of goals and pre-planned strategies, actions taken in response to previous poor performances, and emotional responses to performance. A correlational analysis of these items along with the self-observation and judgment subscale scores provided a limited degree of convergent validity for the two subscales. Analyses of variance were done to determine the presence of differences in scoring patterns based on gender or reported ethnic origin. These results indicate slightly higher judgment subscale scores for women and members of minority groups. The implications of these differences are suggested as warranting future research. Future uses of the SEVSI - P include classroom use to assist students self-evaluate their exam performances in order to increase their achievement. Future research using the SEVSI - P to determine the causal relationships between self-evaluation, actual achievement, and other social cognitive constructs such as self-efficacy are suggested.

Early Detection of Increased Intracranial Pressure Episodes in Traumatic Brain Injury: External Validation in an Adult and in a Pediatric Cohort.

PubMed

Güiza, Fabian; Depreitere, Bart; Piper, Ian; Citerio, Giuseppe; Jorens, Philippe G; Maas, Andrew; Schuhmann, Martin U; Lo, Tsz-Yan Milly; Donald, Rob; Jones, Patricia; Maier, Gottlieb; Van den Berghe, Greet; Meyfroidt, Geert

2017-03-01

A model for early detection of episodes of increased intracranial pressure in traumatic brain injury patients has been previously developed and validated based on retrospective adult patient data from the multicenter Brain-IT database. The purpose of the present study is to validate this early detection model in different cohorts of recently treated adult and pediatric traumatic brain injury patients. Prognostic modeling. Noninterventional, observational, retrospective study. The adult validation cohort comprised recent traumatic brain injury patients from San Gerardo Hospital in Monza (n = 50), Leuven University Hospital (n = 26), Antwerp University Hospital (n = 19), Tübingen University Hospital (n = 18), and Southern General Hospital in Glasgow (n = 8). The pediatric validation cohort comprised patients from neurosurgical and intensive care centers in Edinburgh and Newcastle (n = 79). None. The model's performance was evaluated with respect to discrimination, calibration, overall performance, and clinical usefulness. In the recent adult validation cohort, the model retained excellent performance as in the original study. In the pediatric validation cohort, the model retained good discrimination and a positive net benefit, albeit with a performance drop in the remaining criteria. The obtained external validation results confirm the robustness of the model to predict future increased intracranial pressure events 30 minutes in advance, in adult and pediatric traumatic brain injury patients. These results are a large step toward an early warning system for increased intracranial pressure that can be generally applied. Furthermore, the sparseness of this model that uses only two routinely monitored signals as inputs (intracranial pressure and mean arterial blood pressure) is an additional asset.

Automation Hooks Architecture for Flexible Test Orchestration - Concept Development and Validation

NASA Technical Reports Server (NTRS)

Lansdowne, C. A.; Maclean, John R.; Winton, Chris; McCartney, Pat

2011-01-01

The Automation Hooks Architecture Trade Study for Flexible Test Orchestration sought a standardized data-driven alternative to conventional automated test programming interfaces. The study recommended composing the interface using multicast DNS (mDNS/SD) service discovery, Representational State Transfer (Restful) Web Services, and Automatic Test Markup Language (ATML). We describe additional efforts to rapidly mature the Automation Hooks Architecture candidate interface definition by validating it in a broad spectrum of applications. These activities have allowed us to further refine our concepts and provide observations directed toward objectives of economy, scalability, versatility, performance, severability, maintainability, scriptability and others.

The development and validity of the Salford Gait Tool: an observation-based clinical gait assessment tool.

PubMed

Toro, Brigitte; Nester, Christopher J; Farren, Pauline C

2007-03-01

To develop the construct, content, and criterion validity of the Salford Gait Tool (SF-GT) and to evaluate agreement between gait observations using the SF-GT and kinematic gait data. Tool development and comparative evaluation. University in the United Kingdom. For designing construct and content validity, convenience samples of 10 children with hemiplegic, diplegic, and quadriplegic cerebral palsy (CP) and 152 physical therapy students and 4 physical therapists were recruited. For developing criterion validity, kinematic gait data of 13 gait clusters containing 56 children with hemiplegic, diplegic, and quadriplegic CP and 11 neurologically intact children was used. For clinical evaluation, a convenience sample of 23 pediatric physical therapists participated. We developed a sagittal plane observational gait assessment tool through a series of design, test, and redesign iterations. The tool's grading system was calibrated using kinematic gait data of 13 gait clusters and was evaluated by comparing the agreement of gait observations using the SF-GT with kinematic gait data. Criterion standard kinematic gait data. There was 58% mean agreement based on grading categories and 80% mean agreement based on degree estimations evaluated with the least significant difference method. The new SF-GT has good concurrent criterion validity.

Reliability and Validity of the Footprint Assessment Method Using Photoshop CS5 Software in Young People with Down Syndrome.

PubMed

Gutiérrez-Vilahú, Lourdes; Massó-Ortigosa, Núria; Rey-Abella, Ferran; Costa-Tutusaus, Lluís; Guerra-Balic, Myriam

2016-05-01

People with Down syndrome present skeletal abnormalities in their feet that can be analyzed by commonly used gold standard indices (the Hernández-Corvo index, the Chippaux-Smirak index, the Staheli arch index, and the Clarke angle) based on footprint measurements. The use of Photoshop CS5 software (Adobe Systems Software Ireland Ltd, Dublin, Ireland) to measure footprints has been validated in the general population. The present study aimed to assess the reliability and validity of this footprint assessment technique in the population with Down syndrome. Using optical podography and photography, 44 footprints from 22 patients with Down syndrome (11 men [mean ± SD age, 23.82 ± 3.12 years] and 11 women [mean ± SD age, 24.82 ± 6.81 years]) were recorded in a static bipedal standing position. A blinded observer performed the measurements using a validated manual method three times during the 4-month study, with 2 months between measurements. Test-retest was used to check the reliability of the Photoshop CS5 software measurements. Validity and reliability were obtained by intraclass correlation coefficient (ICC). The reliability test for all of the indices showed very good values for the Photoshop CS5 method (ICC, 0.982-0.995). Validity testing also found no differences between the techniques (ICC, 0.988-0.999). The Photoshop CS5 software method is reliable and valid for the study of footprints in young people with Down syndrome.

Effect of high-dose pitavastatin on glucose homeostasis in patients at elevated risk of new-onset diabetes: insights from the CAPITAIN and PREVAIL-US studies.

PubMed

Chapman, M J; Orsoni, A; Robillard, P; Hounslow, N; Sponseller, C A; Giral, P

2014-05-01

Statin treatment may impair glucose homeostasis and increase the risk of new-onset diabetes mellitus, although this may depend on the statin, dose and patient population. We evaluated the effects of pitavastatin 4 mg/day on glucose homeostasis in patients with metabolic syndrome in the CAPITAIN trial. Findings were validated in a subset of patients enrolled in PREVAIL-US. Participants with a well defined metabolic syndrome phenotype were recruited to CAPITAIN to reduce the influence of confounding factors. Validation and comparison datasets were selected comprising phenotypically similar subsets of individuals enrolled in PREVAIL-US and treated with pitavastatin or pravastatin, respectively. Mean change from baseline in parameters of glucose homeostasis (fasting plasma glucose [FPG], glycated hemoglobin [HbA1c], insulin, quantitative insulin-sensitivity check index [QUICKI] and homeostasis model of assessment-insulin resistance [HOMA-IR]) and plasma lipid profile were assessed at 6 months (CAPITAIN) and 3 months (PREVAIL-US) after initiating treatment. In CAPITAIN (n = 12), no significant differences from baseline in HbA1c, insulin, HOMA-IR and QUICKI were observed at day 180 in patients treated with pitavastatin. A small (4%) increase in FPG from baseline to day 180 (P < 0.05), was observed. In the validation dataset (n = 9), no significant differences from baseline in glycemic parameters were observed at day 84 (all comparisons P > 0.05). Similar results were observed for pravastatin in the comparison dataset (n = 14). Other than a small change in FPG in the CAPITAIN study, neutral effects of pitavastatin on glucose homeostasis were observed in two cohorts of patients with metabolic syndrome, independent of its efficacy in reducing levels of atherogenic lipoproteins. The small number of patients and relatively short follow-up period represent limitations of the study. Nevertheless, these data suggest that statin-induced diabetogenesis may not represent a class effect.

Development and validation of a new self-report measure of pain behaviors.

PubMed

Cook, Karon F; Keefe, Francis; Jensen, Mark P; Roddey, Toni S; Callahan, Leigh F; Revicki, Dennis; Bamer, Alyssa M; Kim, Jiseon; Chung, Hyewon; Salem, Rana; Amtmann, Dagmar

2013-12-01

Pain behaviors that are maintained beyond the acute stage after injury can contribute to subsequent psychosocial and physical disability. Critical to the study of pain behaviors is the availability of psychometrically sound pain behavior measures. In this study we developed a self-report measure of pain behaviors, the Pain Behaviors Self Report (PaB-SR). PaB-SR scores were developed using item response theory and evaluated using a rigorous, multiple-witness approach to validity testing. Participants included 661 survey participants with chronic pain and with multiple sclerosis, back pain, or arthritis; 618 survey participants who were significant others of a chronic pain participant; and 86 participants in a videotaped pain behavior observation protocol. Scores on the PaB-SR were found to be measurement invariant with respect to clinical condition. PaB-SR scores, observer reports, and the videotaped protocol yielded distinct, but convergent views of pain behavior, supporting the validity of the new measure. The PaB-SR is expected to be of substantial utility to researchers wishing to explore the relationship between pain behaviors and constructs such as pain intensity, pain interference, and disability. Copyright © 2013 International Association for the Study of Pain. Published by Elsevier B.V. All rights reserved.

The Development and Validation of Test Instruments to Measure Observation and Comparison in Junior High School Science.

ERIC Educational Resources Information Center

Hungerford, Harold Ralph

This study attempted to design tests for the purpose of measuring the acquisition of the science skills of observation and comparison, to determine if these skills, as measured by these tests, could be differentially improved using differing amounts of training, and to determine the effects of race and cultural status on performance with the…

How Non-Linearity and Grade-Level Differences Complicate the Validation of Observation Protocols

ERIC Educational Resources Information Center

Lazarev, Valeriy; Newman, Denis

2013-01-01

Teacher evaluation is currently a major policy issue at all levels of the K-12 system driven in large part by current US Department of Education requirements. The main objective of this study is to explore the patterns of relationship between observational scores and value-added measures of teacher performance in math classrooms and the variation…

The Teacher's Role in Quality Classroom Interactions: Q&A with Dr. Drew Gitomer. REL Mid-Atlantic Teacher Effectiveness Webinar Series

ERIC Educational Resources Information Center

Regional Educational Laboratory Mid-Atlantic, 2013

2013-01-01

In this webinar, Dr. Drew Gitomer, professor at Rutgers University, shared results from recent studies of classroom observations that helped participants understand both general findings about the qualities of classroom interactions and also the challenges to carrying out valid and reliable observations. This Q&A addressed the questions…

Validation of a Spanish version of the Spine Functional Index.

PubMed

Cuesta-Vargas, Antonio I; Gabel, Charles P

2014-06-27

The Spine Functional Index (SFI) is a recently published, robust and clinimetrically valid patient reported outcome measure. The purpose of this study was the adaptation and validation of a Spanish-version (SFI-Sp) with cultural and linguistic equivalence. A two stage observational study was conducted. The SFI was cross-culturally adapted to Spanish through double forward and backward translation then validated for its psychometric characteristics. Participants (n = 226) with various spine conditions of >12 weeks duration completed the SFI-Sp and a region specific measure: for the back, the Roland Morris Questionnaire (RMQ) and Backache Index (BADIX); for the neck, the Neck Disability Index (NDI); for general health the EQ-5D and SF-12. The full sample was employed to determine internal consistency, concurrent criterion validity by region and health, construct validity and factor structure. A subgroup (n = 51) was used to determine reliability at seven days. The SFI-Sp demonstrated high internal consistency (α = 0.85) and reliability (r = 0.96). The factor structure was one-dimensional and supported construct validity. Criterion specific validity for function was high with the RMQ (r = 0.79), moderate with the BADIX (r = 0.59) and low with the NDI (r = 0.46). For general health it was low with the EQ-5D and inversely correlated (r = -0.42) and fair with the Physical and Mental Components of the SF-12 and inversely correlated (r = -0.56 and r = -0.48), respectively. The study limitations included the lack of longitudinal data regarding other psychometric properties, specifically responsiveness. The SFI-Sp was demonstrated as a valid and reliable spine-regional outcome measure. The psychometric properties were comparable to and supported those of the English-version, however further longitudinal investigations are required.

29 CFR Section 1607.16 - Definitions.

Code of Federal Regulations, 2010 CFR

2010-07-01

... action are open to users. T. Skill. A present, observable competence to perform a learned psychomoter act... criterion-related validity studies. These conditions include: (1) An adequate sample of persons available for the study to achieve findings of statistical significance; (2) having or being able to obtain a...

Active listening in medical consultations: development of the Active Listening Observation Scale (ALOS-global).

PubMed

Fassaert, Thijs; van Dulmen, Sandra; Schellevis, François; Bensing, Jozien

2007-11-01

Active listening is a prerequisite for a successful healthcare encounter, bearing potential therapeutic value especially in clinical situations that require no specific medical intervention. Although generally acknowledged as such, active listening has not been studied in depth. This paper describes the development of the Active Listening Observation Scale (ALOS-global), an observation instrument measuring active listening and its validation in a sample of general practice consultations for minor ailments. Five hundred and twenty-four videotaped general practice consultations involving minor ailments were observed with the ALOS-global. Hypotheses were tested to determine validity, incorporating patients' perception of GPs' affective performance, GPs' verbal attention, patients' self-reported anxiety level and gender differences. The final 7-item ALOS-global had acceptable inter- and intra-observer agreement. Factor analysis revealed one homogeneous dimension. The scalescore was positively related to verbal attention measured by RIAS, to patients' perception of GPs' performance and to their pre-visit anxiety level. Female GPs received higher active listening scores. The results of this study are promising concerning the psychometric properties of the ALOS-global. More research is needed to confirm these preliminary findings. After establishing how active listening differentiates between health professionals, the ALOS-global may become a valuable tool in feedback and training aimed at increasing listening skills.

Workflow interruptions and mental workload in hospital pediatricians: an observational study.

PubMed

Weigl, Matthias; Müller, Andreas; Angerer, Peter; Hoffmann, Florian

2014-09-24

Pediatricians' workload is increasingly thought to affect pediatricians' quality of work life and patient safety. Workflow interruptions are a frequent stressor in clinical work, impeding clinicians' attention and contributing to clinical malpractice. We aimed to investigate prospective associations of workflow interruptions with multiple dimensions of mental workload in pediatricians during clinical day shifts. In an Academic Children's Hospital a prospective study of 28 full shift observations was conducted among pediatricians providing ward coverage. The prevalence of workflow interruptions was based on expert observation using a validated observation instrument. Concurrently, Pediatricians' workload ratings were assessed with three workload dimensions of the well-validated NASA-Task Load Index: mental demands, effort, and frustration. Observed pediatricians were, on average, disrupted 4.7 times per hour. Most frequent were interruptions by colleagues (30.2%), nursing staff (29.7%), and by telephone/beeper calls (16.3%). Interruption measures were correlated with two workload outcomes of interest: frequent workflow interruptions were related to less cognitive demands, but frequent interruptions were associated with increased frustration. With regard to single sources, interruptions by colleagues showed the strongest associations to workload. The findings provide insights into specific pathways between different types of interruptions and pediatricians' mental workload. These findings suggest further research and yield a number of work and organization re-design suggestions for pediatric care.

AEROSE 2004 - An Interdisciplinary Atmosphere-Ocean Saharan Dust Expedition

NASA Astrophysics Data System (ADS)

Clemente-Colón, P.

2004-05-01

The NOAA Center for Atmospheric Sciences (NCAS) is sponsoring a Trans-Atlantic Saharan Dust AERosol and Ocean Science Expedition (AEROSE) aboard the NOAA Ship Ronald H. Brown in March 2004. The fundamental purpose of this aerosol cruise is to study the impacts and microphysical evolution of Saharan dust aerosol as it is transported across the Atlantic Ocean. The mission encompasses both, atmospheric and oceanographic components. Participating institutions include Howard University, NCAS lead institution, the University of Puerto Rico at Mayagüez, the Canary Institute of Marine Sciences, the Spanish Institute of Oceanography, the Laboratory of Atmospheric Physics Siméon Fongang, the University of Miami Rosenstiel School of Marine and Atmospheric Science, the University of Washington Applied Physics Laboratory, NASA Goddard Space Flight Center, the NOAA Cooperative Institute for Meteorological Satellite Studies at the University of Wisconsin-Madison, NASA Jet Propulsion Laboratory, and the NOAA/NESDIS Office of Research and Applications. This collaboration provides unique atmospheric and oceanic observations across the North Tropical Atlantic during eastward and westward tracks during a period of nearly one month. Characterization of microphysical properties of Saharan dust aerosol is done trough direct observations of mass, size, and particle number distributions, chemical composition, spatial distributions, and air chemistry. Aerosol radiative properties are studied through a suite of sensors that include a Multi-Angle Absorption Photometer (MAAP), the Marine-Atmosphere Emitted Radiance Interferometer (M-AERI), sunphotometers, and an assortment of other radiometers. Characterization of atmospheric conditions is done through a combination of over 250 radiosonde and ozonesonde launches at 3 to 5 hour intervals during the duration of the cruise and in coordination with satellite overpasses. AEROSE is also supporting the collection of bio-optics and oceanographic observations including water sampling, spectroradiometry, and continuous in-water optical measurements using and under-tow undulating instrument aimed at investigate deposition rates of aerosol and the response of oceanographic systems. Additionally, the cruise effort provides complementary in-situ and remote sensing observations that support the validation and improvement of AVHRR SST corrections under tropospheric aerosol conditions, the validation of MODIS aerosol and oceanographic data and products, the validation of AIRS soundings, and the validation of ICESat aerosol observations, among other activities. An overview of the cruise, available datasets, preliminary results, and follow-on research plans are be presented in this paper.

Standardized assessment of psychosocial factors and their influence on medically confirmed health outcomes in workers: a systematic review.

PubMed

Rosário, Susel; Fonseca, João A; Nienhaus, Albert; da Costa, José Torres

2016-01-01

Previous studies of psychosocial work factors have indicated their importance for workers' health. However, to what extent health problems can be attributed to the nature of the work environment or other psychosocial factors is not clear. No previous systematic review has used inclusion criteria based on specific medical evaluation of work-related health outcomes and the use of validated instruments for the assessment of the psychosocial (work) environment. The aim of this systematic review is to summarize the evidence assessing the relationship between the psychosocial work environment and workers' health based on studies that used standardized and validated instruments to assess the psychosocial work environment and that focused on medically confirmed health outcomes. A systematic review of the literature was carried out by searching the databases PubMed, B-ON, Science Direct, Psycarticles, Psychology and Behavioral Sciences Collection and the search engine (Google Scholar) using appropriate words for studies published from 2004 to 2014. This review follows the recommendations of the Statement for Reporting Systematic Reviews (PRISMA). Studies were included in the review if data on psychosocial validated assessment method(s) for the study population and specific medical evaluation of health-related work outcome(s) were presented. In total, the search strategy yielded 10,623 references, of which 10 studies (seven prospective cohort and three cross-sectional) met the inclusion criteria. Most studies (7/10) observed an adverse effect of poor psychosocial work factors on workers' health: 3 on sickness absence, 4 on cardiovascular diseases. The other 3 studies reported detrimental effects on sleep and on disease-associated biomarkers. A more consistent effect was observed in studies of higher methodological quality that used a prospective design jointly with the use of validated instruments for the assessment of the psychosocial (work) environment and clinical evaluation. More prospective studies are needed to assess the evidence of work-related psychosocial factors on workers´ health.

Measurement of patient safety: a systematic review of the reliability and validity of adverse event detection with record review

PubMed Central

Hanskamp-Sebregts, Mirelle; Zegers, Marieke; Vincent, Charles; van Gurp, Petra J; de Vet, Henrica C W; Wollersheim, Hub

2016-01-01

Objectives Record review is the most used method to quantify patient safety. We systematically reviewed the reliability and validity of adverse event detection with record review. Design A systematic review of the literature. Methods We searched PubMed, EMBASE, CINAHL, PsycINFO and the Cochrane Library and from their inception through February 2015. We included all studies that aimed to describe the reliability and/or validity of record review. Two reviewers conducted data extraction. We pooled κ values (κ) and analysed the differences in subgroups according to number of reviewers, reviewer experience and training level, adjusted for the prevalence of adverse events. Results In 25 studies, the psychometric data of the Global Trigger Tool (GTT) and the Harvard Medical Practice Study (HMPS) were reported and 24 studies were included for statistical pooling. The inter-rater reliability of the GTT and HMPS showed a pooled κ of 0.65 and 0.55, respectively. The inter-rater agreement was statistically significantly higher when the group of reviewers within a study consisted of a maximum five reviewers. We found no studies reporting on the validity of the GTT and HMPS. Conclusions The reliability of record review is moderate to substantial and improved when a small group of reviewers carried out record review. The validity of the record review method has never been evaluated, while clinical data registries, autopsy or direct observations of patient care are potential reference methods that can be used to test concurrent validity. PMID:27550650

Systematic behavioural observation of executive performance after brain injury.

PubMed

Lewis, Mark W; Babbage, Duncan R; Leathem, Janet M

2017-01-01

To develop an ecologically valid measure of executive functioning (i.e. Planning and Organization, Executive Memory, Initiation, Cognitive Shifting, Impulsivity, Sustained and Directed Attention, Error Detection, Error Correction and Time Management) during a functional chocolate brownie cooking task. In Study 1, the inter-rater reliability of a novel behavioural observation assessment method was assessed with 10 people with traumatic brain injury (TBI). In Study 2, 27 people with TBI and 16 healthy controls completed the functional task along with other measures of executive functioning to assess validity. Intraclass correlation coefficients for six of the nine aspects of executive functioning ranged from .54 to 1.00. Percentage agreements for the remaining aspects ranged from 70% to 90%. Significant and non-significant, moderate, correlations were found between the functional cooking task and standard neuropsychological measures. The healthy control group performed better than the TBI group in six areas (d = 0.56 to 1.23). In this initial trial of a novel assessment method, adequate inter-rater reliability was found. The measure was associated with standard neuropsychological measures, and our healthy control group performed better than the TBI group. The measure appears to be an ecologically valid measure of executive functioning.

DEVELOPMENT AND VALIDATION OF A NEW SELF-REPORT MEASURE OF PAIN BEHAVIORS

PubMed Central

Cook, Karon F.; Keefe, Francis; Jensen, Mark P.; Roddey, Toni S.; Callahan, Leigh F.; Revicki, Dennis; Bamer, Alyssa M.; Kim, Jiseon; Chung, Hyewon; Salem, Rana; Amtmann, Dagmar

2013-01-01

Pain behaviors that are maintained beyond the acute stage post-injury can contribute to subsequent psychosocial and physical disability. Critical to the study of pain behaviors is the availability of psychometrically sound pain behavior measures. In this study we developed a self-report measure of pain behaviors, the Pain Behaviors Self Report (PaB-SR). PaB-SR scores were developed using item response theory and evaluated using a rigorous, multiple-witness approach to validity testing. Participants included: a) 661 survey participants with chronic pain and with multiple sclerosis (MS), back pain, or arthritis; b) 618 survey participants who were significant others of a chronic pain participant; and c) 86 participants in a videotaped pain behavior observation protocol. Scores on the PaB-SR were found to be measurement invariant with respect to clinical condition. PaB-SR scores, observer-reports, and the video-taped protocol yielded distinct, but convergent views of pain behavior, supporting the validity of the new measure. The PaB-SR is expected to be of substantial utility to researchers wishing to explore the relationship between pain behaviors and constructs such as pain intensity, pain interference, and disability. PMID:23994451

Developmental validation of a Cannabis sativa STR multiplex system for forensic analysis.

PubMed

Howard, Christopher; Gilmore, Simon; Robertson, James; Peakall, Rod

2008-09-01

A developmental validation study based on recommendations of the Scientific Working Group on DNA Analysis Methods (SWGDAM) was conducted on a multiplex system of 10 Cannabis sativa short tandem repeat loci. Amplification of the loci in four multiplex reactions was tested across DNA from dried root, stem, and leaf sources, and DNA from fresh, frozen, and dried leaf tissue with a template DNA range of 10.0-0.01 ng. The loci were amplified and scored consistently for all DNA sources when DNA template was in the range of 10.0-1.0 ng. Some allelic dropout and PCR failure occurred in reactions with lower template DNA amounts. Overall, amplification was best using 10.0 ng of template DNA from dried leaf tissue indicating that this is the optimal source material. Cross species amplification was observed in Humulus lupulus for three loci but there was no allelic overlap. This is the first study following SWGDAM validation guidelines to validate short tandem repeat markers for forensic use in plants.

Application of the Modified Erikson Psychosocial Stage Inventory: 25 Years in Review.

PubMed

Darling-Fisher, Cynthia S

2018-04-01

The Modified Erikson Psychosocial Stage Inventory (MEPSI) is an 80-item, comprehensive measure of psychosocial development based on Erikson's theory with published reliability and validity data. Although designed as a comprehensive measure, some researchers have used individual subscales for specific developmental stages as a measure; however, these subscale reliability scores have not been generally shared. This article reviewed the literature to evaluate the use of the MEPSI: the major research questions, samples/populations studied, and individual subscale and total reliability and validity data. In total, 16 research articles (1990-2011) and 28 Dissertations/Theses (1991-2016) from nursing, social work, psychology, criminal justice, and religious studies met criteria. Results support the MEPSI's global reliability (aggregate scores ranged .89-.99) and validity in terms of consistent patterns of changes observed in the predicted direction. Reliability and validity data for individual subscales were more variable. Limitations of the tool and recommendations for possible revision and future research are addressed.

Neighborhood Quality and Attachment: Validation of the Revised Residential Environment Assessment Tool.

PubMed

Poortinga, Wouter; Calve, Tatiana; Jones, Nikki; Lannon, Simon; Rees, Tabitha; Rodgers, Sarah E; Lyons, Ronan A; Johnson, Rhodri

2017-04-01

Various studies have shown that neighborhood quality is linked to neighborhood attachment and satisfaction. However, most have relied upon residents' own perceptions rather than independent observations of the neighborhood environment. This study examines the reliability and validity of the revised Residential Environment Assessment Tool (REAT 2.0), an audit instrument covering both public and private spaces of the neighborhood environment. The research shows that REAT 2.0 is a reliable, easy-to-use instrument and that most underlying constructs can be validated against residents' own neighborhood perceptions. The convergent validity of the instrument, which was tested against digital map data, can be improved for a number of miscellaneous urban form items. The research further found that neighborhood attachment was significantly associated with the overall REAT 2.0 score. This association can mainly be attributed to the property-level neighborhood quality and natural elements components. The research demonstrates the importance of private spaces in the outlook of the neighborhood environment.

Evaluation of nucleus segmentation in digital pathology images through large scale image synthesis

NASA Astrophysics Data System (ADS)

Zhou, Naiyun; Yu, Xiaxia; Zhao, Tianhao; Wen, Si; Wang, Fusheng; Zhu, Wei; Kurc, Tahsin; Tannenbaum, Allen; Saltz, Joel; Gao, Yi

2017-03-01

Digital histopathology images with more than 1 Gigapixel are drawing more and more attention in clinical, biomedical research, and computer vision fields. Among the multiple observable features spanning multiple scales in the pathology images, the nuclear morphology is one of the central criteria for diagnosis and grading. As a result it is also the mostly studied target in image computing. Large amount of research papers have devoted to the problem of extracting nuclei from digital pathology images, which is the foundation of any further correlation study. However, the validation and evaluation of nucleus extraction have yet been formulated rigorously and systematically. Some researches report a human verified segmentation with thousands of nuclei, whereas a single whole slide image may contain up to million. The main obstacle lies in the difficulty of obtaining such a large number of validated nuclei, which is essentially an impossible task for pathologist. We propose a systematic validation and evaluation approach based on large scale image synthesis. This could facilitate a more quantitatively validated study for current and future histopathology image analysis field.

A simplified approach to the pooled analysis of calibration of clinical prediction rules for systematic reviews of validation studies

PubMed Central

Dimitrov, Borislav D; Motterlini, Nicola; Fahey, Tom

2015-01-01

Objective Estimating calibration performance of clinical prediction rules (CPRs) in systematic reviews of validation studies is not possible when predicted values are neither published nor accessible or sufficient or no individual participant or patient data are available. Our aims were to describe a simplified approach for outcomes prediction and calibration assessment and evaluate its functionality and validity. Study design and methods: Methodological study of systematic reviews of validation studies of CPRs: a) ABCD2 rule for prediction of 7 day stroke; and b) CRB-65 rule for prediction of 30 day mortality. Predicted outcomes in a sample validation study were computed by CPR distribution patterns (“derivation model”). As confirmation, a logistic regression model (with derivation study coefficients) was applied to CPR-based dummy variables in the validation study. Meta-analysis of validation studies provided pooled estimates of “predicted:observed” risk ratios (RRs), 95% confidence intervals (CIs), and indexes of heterogeneity (I2) on forest plots (fixed and random effects models), with and without adjustment of intercepts. The above approach was also applied to the CRB-65 rule. Results Our simplified method, applied to ABCD2 rule in three risk strata (low, 0–3; intermediate, 4–5; high, 6–7 points), indicated that predictions are identical to those computed by univariate, CPR-based logistic regression model. Discrimination was good (c-statistics =0.61–0.82), however, calibration in some studies was low. In such cases with miscalibration, the under-prediction (RRs =0.73–0.91, 95% CIs 0.41–1.48) could be further corrected by intercept adjustment to account for incidence differences. An improvement of both heterogeneities and P-values (Hosmer-Lemeshow goodness-of-fit test) was observed. Better calibration and improved pooled RRs (0.90–1.06), with narrower 95% CIs (0.57–1.41) were achieved. Conclusion Our results have an immediate clinical implication in situations when predicted outcomes in CPR validation studies are lacking or deficient by describing how such predictions can be obtained by everyone using the derivation study alone, without any need for highly specialized knowledge or sophisticated statistics. PMID:25931829

Validation of the A&D UM-211 device for office blood pressure measurement according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Fania, Claudio; Albertini, Federica; Palatini, Paolo

2017-10-01

The aim of this study was to define the accuracy of UM-211, an automated oscillometric device for office use coupled to several cuffs for different arm sizes, according to the International Protocol of the European Society of Hypertension. The validation was performed in 33 individuals. Their mean age was 59.6±12.9 years, systolic blood pressure (BP) was 144.3±21.5 mmHg (range: 96-184 mmHg), diastolic BP was 86.8±18.5 mmHg (range: 48-124 mmHg), and arm circumference was 30.2±4.3 cm (range: 23-39 cm). Four sequential readings were taken by observers 1 and 2 using a double-headed stethoscope and a mercury sphygmomanometer, whereas three BP readings were taken by the supervisor using the test instrument. The differences between the readings provided by the device and the mean observer measurements were calculated. Therefore, each device measurement was compared with the previous and the next mean observer measurement. The validation results fulfilled all the 2010 European Society of Hypertension revision Protocol criteria for the general population and passed all validation grades. On average, the device overestimated systolic BP by 1.7±2.4 mmHg and diastolic BP by 1.7±2.5 mmHg. These data show that the UM-211 device coupled to several cuffs for different ranges of arm circumference met the requirements for validation according to the International Protocol and can be recommended for clinical use in the adult population. However, these results mainly apply to the use of the 22-32 and the 31-45 cm cuffs.

The use of multiple imputation method for the validation of 24-h food recalls by part-time observation of dietary intake in school.

PubMed

Kupek, Emil; de Assis, Maria Alice A

2016-09-01

External validation of food recall over 24 h in schoolchildren is often restricted to eating events in schools and is based on direct observation as the reference method. The aim of this study was to estimate the dietary intake out of school, and consequently the bias in such research design based on only part-time validated food recall, using multiple imputation (MI) conditioned on the information on child age, sex, BMI, family income, parental education and the school attended. The previous-day, web-based questionnaire WebCAAFE, structured as six meals/snacks and thirty-two foods/beverage, was answered by a sample of 7-11-year-old Brazilian schoolchildren (n 602) from five public schools. Food/beverage intake recalled by children was compared with the records provided by trained observers during school meals. Sensitivity analysis was performed with artificial data emulating those recalled by children on WebCAAFE in order to evaluate the impact of both differential and non-differential bias. Estimated bias was within ±30 % interval for 84·4 % of the thirty-two foods/beverages evaluated in WebCAAFE, and half of the latter reached statistical significance (P<0·05). Rarely (<3 %) consumed dietary items were often under-reported (fish/seafood, vegetable soup, cheese bread, French fries), whereas some of those most frequently reported (meat, bread/biscuits, fruits) showed large overestimation. Compared with the analysis restricted to fully validated data, MI reduced differential bias in sensitivity analysis but the bias still remained large in most cases. MI provided a suitable statistical framework for part-time validation design of dietary intake over six daily eating events.

Evaluation of WRF PBL parameterization schemes against direct observations during a dry event over the Ganges valley

NASA Astrophysics Data System (ADS)

Sathyanadh, Anusha; Prabha, Thara V.; Balaji, B.; Resmi, E. A.; Karipot, Anandakumar

2017-09-01

Accurate representations of the planetary boundary layer (PBL) are important in all weather forecast systems, especially in simulations of turbulence, wind and air quality in the lower atmosphere. In the present study, detailed observations from the Cloud Aerosol Interaction and Precipitation Enhancement Experiment - Integrated Ground based Observational Campaign (CAIPEEX-IGOC) 2014 comprising of the complete surface energy budget and detailed boundary layer observations are used to validate Advanced Research Weather Research and Forecasting (WRF) model simulations over a diverse terrain over the Ganges valley region, Uttar Pradesh, India. A drying event in June 2014 associated with a heat wave is selected for validation.Six local and nonlocal PBL schemes from WRF at 1 km resolution are compared with hourly observations during the diurnal cycle. Near-surface observations of weather parameters, radiation components and eddy covariance fluxes from micrometeorological tower, and profiles of variables from microwave radiometer, and radiosonde observations are used for model evaluations. Models produce a warmer, drier surface layer with higher wind speed, sensible heat flux and temperature than observations. Layered boundary layer dynamics, including the residual layer structure as illustrated in the observations over the Ganges valley are missed in the model, which lead to deeper mixed layers and excessive drying.Although it is difficult to identify any single scheme as the best, the qualitative and quantitative analyses for the entire study period and overall reproducibility of the observations indicate that the MYNN2 simulations describe lower errors and more realistic simulation of spatio-temporal variations in the boundary layer height.

Reproducibility and validity of a food frequency questionnaire in assessing dietary intakes of low-income Caucasian postpartum women living in Sheffield, United Kingdom.

PubMed

Mouratidou, Theodora; Ford, Fiona A; Fraser, Robert B

2011-04-01

The aim of this study was to examine the reproducibility and validity of a semi-quantitative food frequency questionnaire (FFQ) for assessing dietary intakes of low-income, Caucasian, English-speaking, postpartum women living in Sheffield, United Kingdom. Data was obtained from a cross-sectional sample of the 'Healthy Start' study; a population-based survey of mothers and infants. Participants completed two FFQs at 4 and 8 weeks postpartum. Measures from 24-hour dietary recalls (24HDRs) were collected at 4, 6, 8 and 12 weeks postpartum. In the reproducibility study, crude Pearson's correlation coefficients ranged from 0.40 (riboflavin) to 0.73 (thiamine), mean value 0.54. In the validation study, crude Pearson correlation coefficients between the FFQ and the measures from the 24HDRs ranged from 0.10 (B12) to 0.55 (manganese), mean value 0.34. Energy-adjustments and corrections for attenuation had no significant effect on the strength of the correlation both observed in the reproducibility and validity study. On average, 68% of the participants were classified correctly, and 3% were misclassified into the extreme opposite quintile of the distribution. The authors conclude that the questionnaire performed well for the majority of nutrients examined and that is a valid tool for ranking individuals according to nutrient distribution. © 2009 Blackwell Publishing Ltd.

The first Latin-American risk stratification system for cardiac surgery: can be used as a graphic pocket-card score.

PubMed

Carosella, Victorio C; Navia, Jose L; Al-Ruzzeh, Sharif; Grancelli, Hugo; Rodriguez, Walter; Cardenas, Cesar; Bilbao, Jorge; Nojek, Carlos

2009-08-01

This study aims to develop the first Latin-American risk model that can be used as a simple, pocket-card graphic score at bedside. The risk model was developed on 2903 patients who underwent cardiac surgery at the Spanish Hospital of Buenos Aires, Argentina, between June 1994 and December 1999. Internal validation was performed on 708 patients between January 2000 and June 2001 at the same center. External validation was performed on 1087 patients between February 2000 and January 2007 at three other centers in Argentina. In the development dataset the area under receiver operating characteristics (ROC) curve was 0.73 and the Hosmer-Lemeshow (HL) test was P=0.88. In the internal validation ROC curve was 0.77. In the external validation ROC curve was 0.81, but imperfect calibration was detected because the observed in-hospital mortality (3.96%) was significantly lower than the development dataset (8.20%) (P<0.0001). Recalibration was done in 2007, showing excellent level of agreement between the observed and predicted mortality rates on all patients (P=0.92). This is the first risk model for cardiac surgery developed in a population of Latin-America with both internal and external validation. A simple graphic pocket-card score allows an easy bedside application with acceptable statistic precision.

Developing and Validating Personas in e-Commerce: A Heuristic Approach

NASA Astrophysics Data System (ADS)

Thoma, Volker; Williams, Bryn

A multi-method persona development process in a large e-commerce business is described. Personas are fictional representations of customers that describe typical user attributes to facilitate a user-centered approach in interaction design. In the current project persona attributes were derived from various data sources, such as stakeholder interviews, user tests and interviews, data mining, customer surveys, and ethnographic (direct observation, diary studies) research. The heuristic approach of using these data sources conjointly allowed for an early validation of relevant persona dimensions.

Validation of the 1/12 degrees Arctic Cap Nowcast/Forecast System (ACNFS)

DTIC Science & Technology

2010-11-04

IBM Power 6 ( Davinci ) at NAVOCEANO with a 2 hr time step for the ice model and a 30 min time step for the ocean model. All model boundaries are...run using 320 processors on the Navy DSRC IBM Power 6 ( Davinci ) at NAVOCEANO. A typical one-day hindcast takes approximately 1.0 wall clock hour...meter. As more observations become available, further studies of ice draft will be used as a validation tool . The IABP program archived 102 Argos

Validation of the 1/12 deg Arctic Cap Nowcast/Forecast System (ACNFS)

DTIC Science & Technology

2010-11-04

IBM Power 6 ( Davinci ) at NAVOCEANO with a 2 hr time step for the ice model and a 30 min time step for the ocean model. All model boundaries are...run using 320 processors on the Navy DSRC IBM Power 6 ( Davinci ) at NAVOCEANO. A typical one-day hindcast takes approximately 1.0 wall clock hour...meter. As more observations become available, further studies of ice draft will be used as a validation tool . The IABP program archived 102 Argos

Donabedian's structure-process-outcome quality of care model: Validation in an integrated trauma system.

PubMed

Moore, Lynne; Lavoie, André; Bourgeois, Gilles; Lapointe, Jean

2015-06-01

According to Donabedian's health care quality model, improvements in the structure of care should lead to improvements in clinical processes that should in turn improve patient outcome. This model has been widely adopted by the trauma community but has not yet been validated in a trauma system. The objective of this study was to assess the performance of an integrated trauma system in terms of structure, process, and outcome and evaluate the correlation between quality domains. Quality of care was evaluated for patients treated in a Canadian provincial trauma system (2005-2010; 57 centers, n = 63,971) using quality indicators (QIs) developed and validated previously. Structural performance was measured by transposing on-site accreditation visit reports onto an evaluation grid according to American College of Surgeons criteria. The composite process QI was calculated as the average sum of proportions of conformity to 15 process QIs derived from literature review and expert opinion. Outcome performance was measured using risk-adjusted rates of mortality, complications, and readmission as well as hospital length of stay (LOS). Correlation was assessed with Pearson's correlation coefficients. Statistically significant correlations were observed between structure and process QIs (r = 0.33), and process and outcome QIs (r = -0.33 for readmission, r = -0.27 for LOS). Significant positive correlations were also observed between outcome QIs (r = 0.37 for mortality-readmission; r = 0.39 for mortality-LOS and readmission-LOS; r = 0.45 for mortality-complications; r = 0.34 for readmission-complications; 0.63 for complications-LOS). Significant correlations between quality domains observed in this study suggest that Donabedian's structure-process-outcome model is a valid model for evaluating trauma care. Trauma centers that perform well in terms of structure also tend to perform well in terms of clinical processes, which in turn has a favorable influence on patient outcomes. Prognostic study, level III.

Development and Construct Validity of the Classroom Strategies Scale-Observer Form

ERIC Educational Resources Information Center

Reddy, Linda A.; Fabiano, Gregory; Dudek, Christopher M.; Hsu, Louis

2013-01-01

Research on progress monitoring has almost exclusively focused on student behavior and not on teacher practices. This article presents the development and validation of a new teacher observational assessment (Classroom Strategies Scale) of classroom instructional and behavioral management practices. The theoretical underpinnings and empirical…

Validation of personal digital photography to assess dietary quality among people with intellectual disabilities.

PubMed

Elinder, L S; Brunosson, A; Bergström, H; Hagströmer, M; Patterson, E

2012-02-01

Dietary assessment is a challenge in general, and specifically in individuals with intellectual disabilities (ID). This study aimed to evaluate personal digital photography as a method of assessing different aspects of dietary quality in this target group. Eighteen adults with ID were recruited from community residences and activity centres in Stockholm County. Participants were instructed to photograph all foods and beverages consumed during 1 day, while observed. Photographs were coded by two raters. Observations and photographs of meal frequency, intake occasions of four specific food and beverage items, meal quality and dietary diversity were compared. Evaluation of inter-rater reliability and validity of the method was performed by intra-class correlation analysis. With reminders from staff, 85% of all observed eating or drinking occasions were photographed. The inter-rater reliability was excellent for all assessed variables (ICC ≥ 0.88), except for meal quality where ICC was 0.66. The correlations between items assessed in photos and observations were strong to almost perfect with ICC values ranging from 0.71 to 0.92 and all were statistically significant. Personal digital photography appears to be a feasible, reliable and valid method for assessing dietary quality in people with mild to moderate ID, who have daily staff support. © 2011 The Authors. Journal of Intellectual Disability Research © 2011 Blackwell Publishing Ltd.

275 Candidates and 149 Validated Planets Orbiting Bright Stars in K2 Campaigns 0–10

NASA Astrophysics Data System (ADS)

Mayo, Andrew W.; Vanderburg, Andrew; Latham, David W.; Bieryla, Allyson; Morton, Timothy D.; Buchhave, Lars A.; Dressing, Courtney D.; Beichman, Charles; Berlind, Perry; Calkins, Michael L.; Ciardi, David R.; Crossfield, Ian J. M.; Esquerdo, Gilbert A.; Everett, Mark E.; Gonzales, Erica J.; Hirsch, Lea A.; Horch, Elliott P.; Howard, Andrew W.; Howell, Steve B.; Livingston, John; Patel, Rahul; Petigura, Erik A.; Schlieder, Joshua E.; Scott, Nicholas J.; Schumer, Clea F.; Sinukoff, Evan; Teske, Johanna; Winters, Jennifer G.

2018-03-01

Since 2014, NASA’s K2 mission has observed large portions of the ecliptic plane in search of transiting planets and has detected hundreds of planet candidates. With observations planned until at least early 2018, K2 will continue to identify more planet candidates. We present here 275 planet candidates observed during Campaigns 0–10 of the K2 mission that are orbiting stars brighter than 13 mag (in Kepler band) and for which we have obtained high-resolution spectra (R = 44,000). These candidates are analyzed using the vespa package in order to calculate their false-positive probabilities (FPP). We find that 149 candidates are validated with an FPP lower than 0.1%, 39 of which were previously only candidates and 56 of which were previously undetected. The processes of data reduction, candidate identification, and statistical validation are described, and the demographics of the candidates and newly validated planets are explored. We show tentative evidence of a gap in the planet radius distribution of our candidate sample. Comparing our sample to the Kepler candidate sample investigated by Fulton et al., we conclude that more planets are required to quantitatively confirm the gap with K2 candidates or validated planets. This work, in addition to increasing the population of validated K2 planets by nearly 50% and providing new targets for follow-up observations, will also serve as a framework for validating candidates from upcoming K2 campaigns and the Transiting Exoplanet Survey Satellite, expected to launch in 2018.

Reproducibility and relative validity of a food frequency questionnaire to estimate intake of dietary phylloquinone and menaquinones

USDA-ARS?s Scientific Manuscript database

Background: Several observational studies have investigated the relation of dietary phylloquinone and menaquinone intake with occurrence of chronic diseases. Most of these studies relied on food frequency questionnaires (FFQ) to estimate the intake of phylloquinone and menaquinones. However, none of...

Determining whether metals nucleate homogeneously on graphite: A case study with copper

DOE PAGES

Appy, David; Lei, Huaping; Han, Yong; ...

2014-11-05

In this study, we observe that Cu clusters grow on surface terraces of graphite as a result of physical vapor deposition in ultrahigh vacuum. We show that the observation is incompatible with a variety of models incorporating homogeneous nucleation and calculations of atomic-scale energetics. An alternative explanation, ion-mediated heterogeneous nucleation, is proposed and validated, both with theory and experiment. This serves as a case study in identifying when and whether the simple, common observation of metal clusters on carbon-rich surfaces can be interpreted in terms of homogeneous nucleation. We describe a general approach for making system-specific and laboratory-specific predictions.

Active-comparator design and new-user design in observational studies

PubMed Central

Yoshida, Kazuki; Solomon, Daniel H.; Kim, Seoyoung C.

2015-01-01

SUMMARY Over the past decade, an increasing number of observational studies have examined the effectiveness or safety of rheumatoid arthritis treatments. However, unlike randomized controlled trials (RCTs), observational studies of drug effects face methodological challenges including confounding by indication. Two design principles - active comparator design and new user design can help mitigate such challenges in observational studies. To improve validity of study findings, observational studies should be designed in such a way that makes them more closely approximate RCTs. The active comparator design compares the drug of interest to another commonly used agent for the same indication, rather than a ‘non-user’ group. This principle helps select treatment groups similar in treatment indications (both measured and unmeasured characteristics). The new user design includes a cohort of patients from the time of treatment initiation, so that it can assess patients’ pretreatment characteristics and capture all events occurring anytime during follow-up. PMID:25800216

Validation of the Kingyield BP210 wrist blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension-International Protocol.

PubMed

Zeng, Wei-Fang; Huang, Qi-Fang; Sheng, Chang-Sheng; Li, Yan; Wang, Ji-Guang

2012-02-01

The present study aimed to evaluate the accuracy of the automated oscillometric wrist blood pressure monitor BP210 for home blood pressure monitoring according to the International Protocol of the European Society of Hypertension. Systolic and diastolic blood pressures were sequentially measured in 33 adult Chinese participants (21 women, 51 years of mean age) using a mercury sphygmomanometer (two observers) and the BP210 device (one supervisor). Ninety-nine pairs of comparisons were obtained from 15 participants in phase 1 and a further 18 participants in phase 2 of the validation study. Data analysis was conducted using the ESHIP analyzer. The BP210 device successfully passed phase 1 of the validation study with a number of absolute differences between device and observers within 5, 10, and 15 mmHg for at least 33/45, 44/45, and 44/45 measurements, respectively. The device also achieved the targets for phase 2.1, with 77/99, 95/99, and 97/99 differences within 5, 10, and 15 mmHg, respectively for systolic blood pressure, and with 78/99, 97/99, and 99/99 within 5, 10, and 15 mmHg, respectively for diastolic blood pressure. In phase 2.2, 29 and 25 participants had at least two of the three device-observers differences within 5 mmHg (required≥22) for systolic blood pressure and diastolic blood pressure, respectively. The Kingyield wrist blood pressure monitor BP210 has passed the International Protocol requirements, and hence can be recommended for home use in adults.

Validation of the HONSUN LD-578 blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol.

PubMed

Zhang, Yi; Wang, Jie; Huang, Qi-Fang; Sheng, Chang-Sheng; Li, Yan; Wang, Ji-Guang

2009-06-01

This study aimed to evaluate the accuracy of the automated oscillometric upper arm blood pressure monitor LD-578 (HONSUN Group, Shanghai, China) for home blood pressure monitoring according to the International Protocol. Systolic and diastolic blood pressures were sequentially measured in 33 adult Chinese using a mercury sphygmomanometer (two observers) and the LD-578 device (one supervisor). Ninety-nine pairs of comparisons were obtained from 15 participants in phase 1 and a further 18 participants in phase 2 of the validation study. Data analysis was performed using the ESHIP Analyzer. The LD-578 device successfully passed phase 1 of the validation study with a number of absolute differences between device and observers within 5, 10, and 15 mmHg for at least 32 of 45, 41 of 45, and 45 of 45 measurements (required 25, 35, and 40), respectively. The device also achieved the targets for phase 2.1, with 67 of 99, 90 of 99, and 98 of 99 differences within 5, 10, and 15 mmHg, respectively, for systolic blood pressure, and with 69 of 99, 95 of 99, and 98 of 99 within 5, 10, and 15 mmHg, respectively, for diastolic blood pressure. In phase 2.2, 24 participants had at least two of the three device-observers differences within 5 mmHg (required >or=22) for systolic and diastolic blood pressure. The HONSUN upper arm blood pressure monitor LD-578 can be recommended for home use in adults.

Validation of the AVITA BPM17 wrist blood pressure monitor for home blood pressure monitoring according to the European Society of Hypertension International Protocol revision 2010.

PubMed

Kang, Yuan-Yuan; Chen, Qi; Liu, Chang-Yuan; Li, Yan; Wang, Ji-Guang

2017-08-01

The aim of the present study was to evaluate the accuracy of the automated oscillometric wrist blood pressure monitor AVITA BPM17 for home blood pressure monitoring according to the International Protocol of the European Society of Hypertension revision 2010. Systolic and diastolic blood pressures were sequentially measured in 33 adult Chinese (19 men, 45.7 years of mean age) using a mercury sphygmomanometer (two observers) and the AVITA BPM17 device (one supervisor). Ninety-nine pairs of comparisons were obtained from 33 participants for judgments in two parts with three grading phases. The AVITA BPM17 device achieved the targets in part 1 of the validation study. The number of absolute differences between device and observers within 5, 10, and 15 mmHg was 94/99, 98/99, and 98/99, respectively, for systolic blood pressure and 92/99, 99/99, and 99/99, respectively, for diastolic blood pressure. The device also fulfilled the criteria in part 2 of the validation study. Overall, 32 participants for both systolic and diastolic blood pressure, respectively, had at least two of the three device-observerss differences within 5 mmHg (required ≥24). None had all the three device-observers comparisons greater than 5 mmHg for systolic and diastolic blood pressure. The AVITA wrist blood pressure monitor BPM17 has passed the requirements of the International Protocol revision 2010, and hence can be recommended for home use in adults.

Validation of the Simple Shoulder Test in a Portuguese-Brazilian population. Is the latent variable structure and validation of the Simple Shoulder Test Stable across cultures?

PubMed

Neto, Jose Osni Bruggemann; Gesser, Rafael Lehmkuhl; Steglich, Valdir; Bonilauri Ferreira, Ana Paula; Gandhi, Mihir; Vissoci, João Ricardo Nickenig; Pietrobon, Ricardo

2013-01-01

The validation of widely used scales facilitates the comparison across international patient samples. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. The Simple Shoulder Test was translated from English into Brazilian Portuguese, translated back into English, and evaluated for accuracy by an expert committee. It was then administered to 100 patients with shoulder conditions. Psychometric properties were analyzed including factor analysis, internal reliability, test-retest reliability at seven days, and construct validity in relation to the Short Form 36 health survey (SF-36). Factor analysis demonstrated a three factor solution. Cronbach's alpha was 0.82. Test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.84. Associations were observed in the hypothesized direction with all subscales of SF-36 questionnaire. The Simple Shoulder Test translation and cultural adaptation to Brazilian-Portuguese demonstrated adequate factor structure, internal reliability, and validity, ultimately allowing for its use in the comparison with international patient samples.

Validation of the Simple Shoulder Test in a Portuguese-Brazilian Population. Is the Latent Variable Structure and Validation of the Simple Shoulder Test Stable across Cultures?

PubMed Central

Neto, Jose Osni Bruggemann; Gesser, Rafael Lehmkuhl; Steglich, Valdir; Bonilauri Ferreira, Ana Paula; Gandhi, Mihir; Vissoci, João Ricardo Nickenig; Pietrobon, Ricardo

2013-01-01

Background The validation of widely used scales facilitates the comparison across international patient samples. The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. Objective The objective of this study was to translate, culturally adapt and validate the Simple Shoulder Test into Brazilian Portuguese. Also we test the stability of factor analysis across different cultures. Methods The Simple Shoulder Test was translated from English into Brazilian Portuguese, translated back into English, and evaluated for accuracy by an expert committee. It was then administered to 100 patients with shoulder conditions. Psychometric properties were analyzed including factor analysis, internal reliability, test-retest reliability at seven days, and construct validity in relation to the Short Form 36 health survey (SF-36). Results Factor analysis demonstrated a three factor solution. Cronbach’s alpha was 0.82. Test-retest reliability index as measured by intra-class correlation coefficient (ICC) was 0.84. Associations were observed in the hypothesized direction with all subscales of SF-36 questionnaire. Conclusion The Simple Shoulder Test translation and cultural adaptation to Brazilian-Portuguese demonstrated adequate factor structure, internal reliability, and validity, ultimately allowing for its use in the comparison with international patient samples. PMID:23675436

Modelling exploration of non-stationary hydrological system

NASA Astrophysics Data System (ADS)

Kim, Kue Bum; Kwon, Hyun-Han; Han, Dawei

2015-04-01

Traditional hydrological modelling assumes that the catchment does not change with time (i.e., stationary conditions) which means the model calibrated for the historical period is valid for the future period. However, in reality, due to change of climate and catchment conditions this stationarity assumption may not be valid in the future. It is a challenge to make the hydrological model adaptive to the future climate and catchment conditions that are not observable at the present time. In this study a lumped conceptual rainfall-runoff model called IHACRES was applied to a catchment in southwest England. Long observation data from 1961 to 2008 were used and seasonal calibration (in this study only summer period is further explored because it is more sensitive to climate and land cover change than the other three seasons) has been done since there are significant seasonal rainfall patterns. We expect that the model performance can be improved by calibrating the model based on individual seasons. The data is split into calibration and validation periods with the intention of using the validation period to represent the future unobserved situations. The success of the non-stationary model will depend not only on good performance during the calibration period but also the validation period. Initially, the calibration is based on changing the model parameters with time. Methodology is proposed to adapt the parameters using the step forward and backward selection schemes. However, in the validation both the forward and backward multiple parameter changing models failed. One problem is that the regression with time is not reliable since the trend may not be in a monotonic linear relationship with time. The second issue is that changing multiple parameters makes the selection process very complex which is time consuming and not effective in the validation period. As a result, two new concepts are explored. First, only one parameter is selected for adjustment while the other parameters are set as constant. Secondly, regression is made against climate condition instead of against time. It has been found that such a new approach is very effective and this non-stationary model worked very well both in the calibration and validation period. Although the catchment is specific in southwest England and the data are for only the summer period, the methodology proposed in this study is general and applicable to other catchments. We hope this study will stimulate the hydrological community to explore a variety of sites so that valuable experiences and knowledge could be gained to improve our understanding of such a complex modelling issue in climate change impact assessment.

Reliability and factorial validity of flexibility tests for team sports.

PubMed

Sporis, Goran; Vucetic, Vlatko; Jovanovic, Mario; Jukic, Igor; Omrcen, Darija

2011-04-01

The main goal of this method paper was to evaluate the reliability and factorial validity of flexibility tests used in soccer, and to do crossvalidation study on 2 other team sports using handball and basketball players. The second aim was to compare the validity of the different tests and evaluate the flexibility of soccer players; the third was to determine the positional differences between attackers, defenders, and midfielders in all flexibility tests. One hundred and fifty (n = 150) elite male junior soccer players, members of the First Croatian Junior League Teams, and 60 (n = 60) handball and 60 (n = 60) basketball players also members of the First Croatian Junior League Teams volunteered to participate in the study, tested for the purpose of crossvalidation. The SAR and V-SAR had the greatest AVR and ICC. The within-subjects variation ranged from between 0.3 and 3.8%. The lowest value of CV was found between the LSPL and LSPR. Low to moderate statistically significant correlation coefficients were found among all the measured flexibility tests. It was observed that the greatest correlations existed between the SAR and V-SAR (r = 0.65) and between the LLSR and LLSL (r = 0.56). Statistically significant correlations were also observed between the BLPL and BLPR (r = 0.62). The principal components factor analysis of 9 flexibility tests resulted in the extraction of 3 significant components. The results of this study have the following implications for the assessment of flexibility in soccer: (a) all flexibility tests used in this study have the acceptable between and within-subjects reliability and they can be used to estimate the flexibility of soccer players; (b) the LSPL and LSPR tests are the most reliable and valid flexibility tests for the estimation of flexibility of professional soccer players.

Prioritisation of patients on waiting lists for hip and knee arthroplasties and cataract surgery: Instruments validation

PubMed Central

Allepuz, Alejandro; Espallargues, Mireia; Moharra, Montse; Comas, Mercè; Pons, Joan MV

2008-01-01

Background Prioritisation instruments were developed for patients on waiting list for hip and knee arthroplasties (AI) and cataract surgery (CI). The aim of the study was to assess their convergent and discriminant validity and inter-observer reliability. Methods Multicentre validation study which included orthopaedic surgeons and ophthalmologists from 10 hospitals. Participating doctors were asked to include all eligible patients placed in the waiting list for the procedures under study during the medical visit. Doctors assessed patients' priority through a visual analogue scale (VAS) and administered the prioritisation instrument. Information on socio-demographic data and health-related quality of life (HRQOL) (HUI3, EQ-5D, WOMAC and VF-14) was obtained through a telephone interview with patients. The correlation coefficients between the prioritisation instrument score and VAS and HRQOL were calculated. For the reliability study a self-administered questionnaire, which included hypothetic patients' scenarios, was sent via postal mail to the doctors. The priority of these scenarios was assessed through the prioritisation instrument. The intraclass correlation coefficient (ICC) between doctors was calculated. Results Correlations with VAS were strong for the AI (0.64, CI95%: 0.59–0.68) and for the CI (0.65, CI95%: 0.62–0.69), and moderate between the WOMAC and the AI (0.39, CI95%: 0.33–0.45) and the VF-14 and the CI (0.38, IC95%: 0.33–0.43). The results of the discriminant analysis were in general as expected. Inter-observer reliability was 0.79 (CI95%: 0.64–0.94) for the AI, and 0.79 (CI95%: 0.63–0.95) for the CI. Conclusion The results show acceptable validity and reliability of the prioritisation instruments in establishing priority for surgery. PMID:18397519

The Psychopathy Q-Sort. Construct Validity Evidence in a Nonclinical Sample

ERIC Educational Resources Information Center

Fowler, Katherine A.; Lilienfeld, Scott O.

2007-01-01

Scant research has examined the validity of instruments that permit observer ratings of psychopathy. Using a nonclinical (undergraduate) sample, the authors examined the associations between both self- and observer ratings on a psychopathy prototype (Psychopathy Q-Sort, PQS) and widely used measures of psychopathy, antisocial behavior, and…

Portuguese version of a stress and well-being evaluation tool (ASSET)at the workplace: validation of the psychometric properties

PubMed Central

Moreira, Sérgio; Carreiras, Joana; Cooper, Cary; Smeed, Matthew; Reis, Maria de Fátima; Pereira Miguel, José

2018-01-01

Objective The main objective of this work was to translate the English version of ASSET (A Shortened Stress Evaluation Tool) into the Portuguese version and to validate its psychometric properties. Additionally, this work tested the convergent validity of the instrument. Methods The translation and retroversion were conducted by experts and submitted to the authors for approval. Within an observational, cross-sectional study, regarding mental health at the workplace, ASSET together with other scales was applied to a sample of 405 participants. The psychometric validity of the subscales was studied using confirmatory factorial analysis. Results The factorial structure of ASSET is globally supported by the results, with the Perceptions of Your Job and Attitudes Towards your Organisation subscales requiring slight adjustments in the item structure and the Your Health subscales replicating the original structure. The convergent validity also supports the ASSET, showing that all subscales are significantly correlated with variables used to test convergence. Conclusions Globally, the results constitute an important contribution to ASSET and open the possibility of its usage among Portuguese-speaking countries. The results provide an evidence on the validity of the instrument and, in particular, of the mental and physical health subscales. PMID:29440211

Assessing motivation orientations in schizophrenia: Scale development and validation

PubMed Central

Cooper, Shanna; Lavaysse, Lindsey M.; Gard, David E.

2014-01-01

Motivation deficits are common in several disorders including schizophrenia, and are an important factor in both functioning and treatment adherence. Self-Determination Theory (SDT), a leading macro-theory of motivation, has contributed a number of insights into how motivation is impaired in schizophrenia. Nonetheless, self-report measures of motivation appropriate for people with severe mental illness (including those that emphasize SDT) are generally lacking in literature. To fill this gap, we adapted and abbreviated the well-validated General Causality Orientation Scale for use with people with schizophrenia and with other severe mental disorders (GCOS-clinical populations; GCOS-CP). In Study 1, we tested the similarity of our measure to the existing GCOS (using a college sample) and then validated this new measure in a schizophrenia and healthy control sample (Study 2). Results from Study 1 (N=360) indicated that the GCOS-CP was psychometrically similar to the original GCOS and provided good convergent and discriminant validity. In Study 2, the GCOS-CP was given to individuals with (N=44) and without schizophrenia (N=42). In line with both laboratory-based and observer-based research, people with schizophrenia showed lower motivational autonomy and higher impersonal/amotivated orientations. Additional applications of the GCOS-CP are discussed. PMID:25454115

Toward Supersonic Retropropulsion CFD Validation

NASA Technical Reports Server (NTRS)

Kleb, Bil; Schauerhamer, D. Guy; Trumble, Kerry; Sozer, Emre; Barnhardt, Michael; Carlson, Jan-Renee; Edquist, Karl

2011-01-01

This paper begins the process of verifying and validating computational fluid dynamics (CFD) codes for supersonic retropropulsive flows. Four CFD codes (DPLR, FUN3D, OVERFLOW, and US3D) are used to perform various numerical and physical modeling studies toward the goal of comparing predictions with a wind tunnel experiment specifically designed to support CFD validation. Numerical studies run the gamut in rigor from code-to-code comparisons to observed order-of-accuracy tests. Results indicate that this complex flowfield, involving time-dependent shocks and vortex shedding, design order of accuracy is not clearly evident. Also explored is the extent of physical modeling necessary to predict the salient flowfield features found in high-speed Schlieren images and surface pressure measurements taken during the validation experiment. Physical modeling studies include geometric items such as wind tunnel wall and sting mount interference, as well as turbulence modeling that ranges from a RANS (Reynolds-Averaged Navier-Stokes) 2-equation model to DES (Detached Eddy Simulation) models. These studies indicate that tunnel wall interference is minimal for the cases investigated; model mounting hardware effects are confined to the aft end of the model; and sparse grid resolution and turbulence modeling can damp or entirely dissipate the unsteadiness of this self-excited flow.

Identification and Validation of ESP Teacher Competencies: A Research Design

ERIC Educational Resources Information Center

Venkatraman, G.; Prema, P.

2013-01-01

The paper presents the research design used for identifying and validating a set of competencies required of ESP (English for Specific Purposes) teachers. The identification of the competencies and the three-stage validation process are also discussed. The observation of classes of ESP teachers for field-testing the validated competencies and…

Comparison of tools for assessing the methodological quality of primary and secondary studies in health technology assessment reports in Germany.

PubMed

Dreier, Maren; Borutta, Birgit; Stahmeyer, Jona; Krauth, Christian; Walter, Ulla

2010-06-14

HEALTH CARE POLICY BACKGROUND: Findings from scientific studies form the basis for evidence-based health policy decisions. Quality assessments to evaluate the credibility of study results are an essential part of health technology assessment reports and systematic reviews. Quality assessment tools (QAT) for assessing the study quality examine to what extent study results are systematically distorted by confounding or bias (internal validity). The tools can be divided into checklists, scales and component ratings. What QAT are available to assess the quality of interventional studies or studies in the field of health economics, how do they differ from each other and what conclusions can be drawn from these results for quality assessments? A systematic search of relevant databases from 1988 onwards is done, supplemented by screening of the references, of the HTA reports of the German Agency for Health Technology Assessment (DAHTA) and an internet search. The selection of relevant literature, the data extraction and the quality assessment are carried out by two independent reviewers. The substantive elements of the QAT are extracted using a modified criteria list consisting of items and domains specific to randomized trials, observational studies, diagnostic studies, systematic reviews and health economic studies. Based on the number of covered items and domains, more and less comprehensive QAT are distinguished. In order to exchange experiences regarding problems in the practical application of tools, a workshop is hosted. A total of eight systematic methodological reviews is identified as well as 147 QAT: 15 for systematic reviews, 80 for randomized trials, 30 for observational studies, 17 for diagnostic studies and 22 for health economic studies. The tools vary considerably with regard to the content, the performance and quality of operationalisation. Some tools do not only include the items of internal validity but also the items of quality of reporting and external validity. No tool covers all elements or domains. Design-specific generic tools are presented, which cover most of the content criteria. The evaluation of QAT by using content criteria is difficult, because there is no scientific consensus on the necessary elements of internal validity, and not all of the generally accepted elements are based on empirical evidence. Comparing QAT with regard to contents neglects the operationalisation of the respective parameters, for which the quality and precision are important for transparency, replicability, the correct assessment and interrater reliability. QAT, which mix items on the quality of reporting and internal validity, should be avoided. There are different, design-specific tools available which can be preferred for quality assessment, because of its wider coverage of substantive elements of internal validity. To minimise the subjectivity of the assessment, tools with a detailed and precise operationalisation of the individual elements should be applied. For health economic studies, tools should be developed and complemented with instructions, which define the appropriateness of the criteria. Further research is needed to identify study characteristics that influence the internal validity of studies.

Validation of Satellite-Based Objective Overshooting Cloud-Top Detection Methods Using CloudSat Cloud Profiling Radar Observations

NASA Technical Reports Server (NTRS)

Bedka, Kristopher M.; Dworak, Richard; Brunner, Jason; Feltz, Wayne

2012-01-01

Two satellite infrared-based overshooting convective cloud-top (OT) detection methods have recently been described in the literature: 1) the 11-mm infrared window channel texture (IRW texture) method, which uses IRW channel brightness temperature (BT) spatial gradients and thresholds, and 2) the water vapor minus IRW BT difference (WV-IRW BTD). While both methods show good performance in published case study examples, it is important to quantitatively validate these methods relative to overshooting top events across the globe. Unfortunately, no overshooting top database currently exists that could be used in such study. This study examines National Aeronautics and Space Administration CloudSat Cloud Profiling Radar data to develop an OT detection validation database that is used to evaluate the IRW-texture and WV-IRW BTD OT detection methods. CloudSat data were manually examined over a 1.5-yr period to identify cases in which the cloud top penetrates above the tropopause height defined by a numerical weather prediction model and the surrounding cirrus anvil cloud top, producing 111 confirmed overshooting top events. When applied to Moderate Resolution Imaging Spectroradiometer (MODIS)-based Geostationary Operational Environmental Satellite-R Series (GOES-R) Advanced Baseline Imager proxy data, the IRW-texture (WV-IRW BTD) method offered a 76% (96%) probability of OT detection (POD) and 16% (81%) false-alarm ratio. Case study examples show that WV-IRW BTD.0 K identifies much of the deep convective cloud top, while the IRW-texture method focuses only on regions with a spatial scale near that of commonly observed OTs. The POD decreases by 20% when IRW-texture is applied to current geostationary imager data, highlighting the importance of imager spatial resolution for observing and detecting OT regions.

The Multitheoretical List of Therapeutic Interventions - 30 items (MULTI-30).

PubMed

Solomonov, Nili; McCarthy, Kevin S; Gorman, Bernard S; Barber, Jacques P

2018-01-16

To develop a brief version of the Multitheoretical List of Therapeutic Interventions (MULTI-60) in order to decrease completion time burden by approximately half, while maintaining content coverage. Study 1 aimed to select 30 items. Study 2 aimed to examine the reliability and internal consistency of the MULTI-30. Study 3 aimed to validate the MULTI-30 and ensure content coverage. In Study 1, the sample included 186 therapist and 255 patient MULTI ratings, and 164 ratings of sessions coded by trained observers. Internal consistency (Chronbach's alpha and McDonald's omega) was calculated and confirmatory factor analysis was conducted. Psychotherapy experts rated content relevance. Study 2 included a sample of 644 patient and 522 therapist ratings, and 793 codings of psychotherapy sessions. In Study 3, the sample included 33 codings of sessions. A series of regression analyses was conducted to examine replication of previously published findings using the MULTI-30. The MULTI-30 was found valid, reliable, and internally consistent across 2564 ratings examined across the three studies presented. The MULTI-30 a brief and reliable process measure. Future studies are required for further validation.